WO2021159683A1

WO2021159683A1 - Exception object determination method and system, and machine readable medium and device

Info

Publication number: WO2021159683A1
Application number: PCT/CN2020/110457
Authority: WO
Inventors: 周曦; 姚志强; 龚强
Original assignee: 上海云从汇临人工智能科技有限公司
Priority date: 2020-02-12
Filing date: 2020-08-21
Publication date: 2021-08-19
Also published as: CN111325127A

Abstract

An exception object determination method, comprising: obtaining a visible light image of a detection object (S11); determining, on the basis of the visible light image, whether the detection object wears a protection apparatus (S12); and determining, depending on whether the detection object wears the protection apparatus, whether the detection object is an exception object (S13). Whether a mask is worn is intelligently detected by collecting a visible light image of a detection object, determining, according to the visible light image, whether the mask is worn, and determining, depending on whether the detection object wears the mask, whether the detection object is an exception object.

Description

一种异常对象判断方法、***、机器可读介质及设备Method, system, machine-readable medium and equipment for judging abnormal objects

技术领域Technical field

本发明涉及异常情况检测领域，具体涉及一种异常对象判断方法、***、机器可读介质及设备。The present invention relates to the field of abnormal situation detection, in particular to an abnormal object judgment method, system, machine-readable medium and equipment.

背景技术Background technique

目前世界各地传染病泛滥，如何快速找到人流量密集处的感染者，又不影响人们快速通关，同时降低检查人员的感染风险成了目前对抗疫情的难点。At present, infectious diseases are spreading all over the world. How to quickly find infected persons in densely-traffic areas without affecting people's rapid customs clearance and reducing the infection risk of inspectors has become the current difficulty in fighting the epidemic.

现目前，配戴口罩是降低所有人员感染风险的一种有效手段，没有配戴口罩不建议进入到公共场合，因此，如何判断戴没有戴口罩，成了一个关键。At present, wearing a mask is an effective means to reduce the risk of infection for all people. It is not recommended to enter public places without a mask. Therefore, how to judge whether to wear a mask has become a key.

另外我们知道，发热是各种传染病的共同表现，很多传染病甚至以“热”命名，如出血热、登革热、猩红热等，可见发热与传染病关系密切。发热通常是人体对致病因子的一种病理生理反应。一般认为口温高于37.3C或一日体温变人超过1.2C时称之为“发热”。In addition, we know that fever is a common manifestation of various infectious diseases. Many infectious diseases are even named after "heat", such as hemorrhagic fever, dengue fever, and scarlet fever. It can be seen that fever is closely related to infectious diseases. Fever is usually a pathophysiological response of the human body to pathogenic factors. It is generally believed that when the oral temperature is higher than 37.3C or the body temperature per day exceeds 1.2C, it is called "fever".

我们可以根据发热与传染病的关系，找出人群中的发热疑似人员，然后进行进一步排查。但是传统排查采用人工一人一测的方式，严重影响通关效率，而且也会增加检测人员的感染风险。According to the relationship between fever and infectious diseases, we can find out the suspected fever in the crowd, and then carry out further investigation. However, traditional investigations use a manual one-person-one-test method, which seriously affects the efficiency of customs clearance and also increases the risk of infection of the inspectors.

发明内容Summary of the invention

鉴于以上所述现有技术的缺点，本发明的目的在于提供一种异常对象判断方法、***、机器可读介质及设备，用于解决现有技术存在的问题。In view of the above-mentioned shortcomings of the prior art, the purpose of the present invention is to provide a method, system, machine-readable medium and equipment for judging an abnormal object to solve the problems existing in the prior art.

为实现上述目的及其他相关目的，本发明提供一种异常对象判断方法，包括：In order to achieve the above objectives and other related objectives, the present invention provides a method for judging abnormal objects, including:

获取检测对象的可见光图像；Obtain a visible light image of the detection object;

基于所述可见光图像判断所述检测对象是否配戴防护装置；Judging whether the detection object wears a protective device based on the visible light image;

根据所述检测对象是否配戴防护装置，判断检测对象是否为异常对象。According to whether the detection object is wearing a protective device, it is determined whether the detection object is an abnormal object.

可选地，若检测对象没有配戴防护装置，则认为该检测对象为异常对象。Optionally, if the detection object does not wear a protective device, the detection object is considered to be an abnormal object.

可选地，所述防护装置包括口罩、面罩。Optionally, the protective device includes a respirator and a face mask.

可选地，该方法还包括：Optionally, the method further includes:

在检测对象配戴防护装置的情况下，获取检测对象的红外图像；In the case of the detection object wearing a protective device, obtain an infrared image of the detection object;

对所述可见光图像进行目标部位检测，得到目标部位位置；确定所述目标部位位置在检测对象的红外图像中的目标检测区域；Performing target part detection on the visible light image to obtain the target part position; determining the target detection area of the target part position in the infrared image of the detection object;

获取检测对象的目标检测区域的检测指标；Acquiring the detection index of the target detection area of the detection object;

根据所述目标检测区域的检测指标，判断检测对象是否为异常对象。According to the detection index of the target detection area, it is determined whether the detection object is an abnormal object.

可选地，该方法还包括：所述检测指标为温度。Optionally, the method further includes: the detection index is temperature.

可选地，该方法还包括：Optionally, the method further includes:

在检测对象配戴防护装置的情况下，获取检测对象的激光图像；Acquire a laser image of the test subject when the test subject is wearing a protective device;

对所述可见光图像进行目标部位检测，得到目标部位位置；确定所述目标部位位置在检测对象的激光图像中的目标检测区域；Performing target part detection on the visible light image to obtain a target part position; determining the target part position in the target detection area in the laser image of the detection object;

可选地，所述检测指标为血液核酸特征。Optionally, the detection index is a blood nucleic acid characteristic.

可选地，所述目标部位包括人脸、手背、脖子、肩头，所述目标检测区域为人脸区域、手背区域、脖子区域、肩头区域。Optionally, the target part includes a face, a back of the hand, a neck, and a shoulder, and the target detection area is a face area, a back of the hand area, a neck area, and a shoulder area.

可选地，若所述目标检测区域为人脸区域，则当检测对象的人脸区域的温度超过温度阈值时，该检测对象为异常对象。Optionally, if the target detection area is a face area, when the temperature of the face area of the detection object exceeds a temperature threshold, the detection object is an abnormal object.

可选地，当检测对象的血液核酸特征符合预设条件时，该检测对象为异常对象。Optionally, when the blood nucleic acid characteristic of the detection object meets a preset condition, the detection object is an abnormal object.

可选地，该方法还包括：Optionally, the method further includes:

采用人脸识别技术或人体识别技术对所述异常对象进行追踪。Use face recognition technology or human body recognition technology to track the abnormal object.

可选地，该方法还包括：Optionally, the method further includes:

当检测到异常对象时，发出报警提示。When an abnormal object is detected, an alarm will be issued.

可选地，该方法还包括：Optionally, the method further includes:

基于检测对象与图像采集装置的距离对所述人脸区域的温度进行补偿。The temperature of the face area is compensated based on the distance between the detection object and the image acquisition device.

可选地，该方法还包括：Optionally, the method further includes:

获取环境温度；Get the ambient temperature;

根据所述环境温度对所述目标检测区域的温度进行补偿。The temperature of the target detection area is compensated according to the ambient temperature.

可选地，该方法还包括：Optionally, the method further includes:

获取检测对象的年龄属性；Obtain the age attribute of the detected object;

根据不同的年龄属性设定与不同年龄段对应的温度阈值。Set temperature thresholds corresponding to different age groups according to different age attributes.

可选地，确定目标部位位置在检测对象的红外图像中的目标检测区域，包括：Optionally, determining the target detection area in the infrared image of the detection object includes:

将所述可见光图像中的目标部位位置映射到所述检测对象的红外图像中，以得到该检测对象的红外图像中的人脸区域。The target position in the visible light image is mapped to the infrared image of the detection object to obtain the human face area in the infrared image of the detection object.

可选地，确定目标部位位置在检测对象的激光图像中的目标检测区域，包括：Optionally, determining the target detection area in the laser image of the detection object includes:

将所述可见光图像中的目标部位位置映射到所述检测对象的激光图像中，以得到该检测对象的激光图像中的人脸区域。The target position in the visible light image is mapped to the laser image of the detection object to obtain the human face area in the laser image of the detection object.

为实现上述目的及其他相关目的，本发明提供一种异常对象判断***，包括：In order to achieve the above objectives and other related objectives, the present invention provides an abnormal object judgment system, including:

可见光图像获取模块，用于获取检测对象的可见光图像；The visible light image acquisition module is used to acquire the visible light image of the detection object;

行为检测模块，用于基于所述可见光图像判断所述检测对象是否配戴防护装置；A behavior detection module, configured to determine whether the detection object is wearing a protective device based on the visible light image;

第一异常对象判断模块，用于根据所述检测对象是否配戴防护装置，判断检测对象是否为异常对象。The first abnormal object judgment module is used for judging whether the detection object is an abnormal object according to whether the detection object wears a protective device.

可选地，该***还包括：Optionally, the system further includes:

红外图像获取模块，用于在检测对象配戴防护装置的情况下获取检测对象的红外图像；The infrared image acquisition module is used to acquire the infrared image of the inspection object when the inspection object is wearing a protective device;

第一目标检测模块，用于对所述可见光图像进行目标部位检测，得到目标部位位置；The first target detection module is configured to perform target part detection on the visible light image to obtain the target part position;

第一目标区域确定模块，用于确定所述目标部位位置在检测对象的红外图像中的目标检测区域；The first target area determination module is used to determine the target detection area in the infrared image of the detection object where the position of the target part is;

第一检测指标获取模块，用于获取检测对象的目标检测区域的检测指标；The first detection index acquisition module is used to acquire the detection index of the target detection area of the detection object;

第二异常对象判断模块，用于根据所述目标检测区域的检测指标，判断检测对象是否为异常对象。The second abnormal object judgment module is used for judging whether the detection object is an abnormal object according to the detection index of the target detection area.

可选地，所述检测指标为温度。Optionally, the detection index is temperature.

可选地，该***还包括：Optionally, the system further includes:

激光图像获取模块，用于在检测对象配戴防护装置的情况下，获取检测对象的激光图像；The laser image acquisition module is used to acquire the laser image of the detection object when the detection object is wearing a protective device;

第二目标检测模块，用于对所述可见光图像进行目标部位检测，得到目标部位位置；The second target detection module is used to detect the target part of the visible light image to obtain the position of the target part;

第二目标区域确定模块，用于确定所述目标部位位置在检测对象的激光图像中的目标检测区域；The second target area determining module is used to determine the target detection area in the laser image of the detection object where the position of the target part is;

第二检测指标获取模块，用于获取检测对象的目标检测区域的检测指标；The second detection index acquisition module is used to acquire the detection index of the target detection area of the detection object;

第三异常对象判断模块，用于根据所述目标检测区域的检测指标，判断检测对象是否为异常对象。The third abnormal object judgment module is used for judging whether the detection object is an abnormal object according to the detection index of the target detection area.

可选地，该***还包括：Optionally, the system further includes:

追踪模块，用于采用人脸识别技术或人体识别技术对所述异常对象进行追踪。The tracking module is used to track the abnormal object using face recognition technology or human body recognition technology.

可选地，该***还包括：Optionally, the system further includes:

报警提示模块，用于当检测到异常对象时，发出报警提示。The alarm prompt module is used to send out an alarm prompt when an abnormal object is detected.

可选地，该***还包括：Optionally, the system further includes:

第一温度补偿模块，基于检测对象与图像采集装置的距离对所述人脸区域的温度进行补偿。The first temperature compensation module compensates the temperature of the face area based on the distance between the detection object and the image acquisition device.

可选地，该***还包括：Optionally, the system further includes:

温度获取模块，用于获取环境温度；The temperature acquisition module is used to acquire the ambient temperature;

第二温度补偿模块，用于根据所述环境温度对所述目标检测区域的温度进行补偿。The second temperature compensation module is used to compensate the temperature of the target detection area according to the ambient temperature.

可选地，该***还包括：Optionally, the system further includes:

年龄属性获取模块，用于获取检测对象的年龄属性；The age attribute acquisition module is used to acquire the age attribute of the detected object;

温度阈值设定模块，用于根据不同的年龄属性设定与不同年龄段对应的温度阈值。The temperature threshold setting module is used to set temperature thresholds corresponding to different age groups according to different age attributes.

可选地，所述确定目标部位位置在检测对象的红外图像中的目标检测区域，包括：Optionally, the determining the target detection area in the infrared image of the detection object includes:

可选地，所述确定目标部位位置在检测对象的激光图像中的目标检测区域，包括：Optionally, the determining the target detection area in the laser image of the detection object includes:

将所述可见光图像中的目标部位位置映射到所述检测对象的激光图像中，以得到该检测对象的激光图像中的目标检测区域。The target position in the visible light image is mapped to the laser image of the detection object to obtain the target detection area in the laser image of the detection object.

为实现上述目的及其他相关目的，本发明提供一种设备，包括：In order to achieve the above objectives and other related objectives, the present invention provides a device, including:

一个或多个处理器；和One or more processors; and

其上存储有指令的一个或多个机器可读介质，当所述一个或多个处理器执行时，使得所述设备执行前述的一个或多个所述的方法。One or more machine-readable media on which instructions are stored, when executed by the one or more processors, cause the device to execute one or more of the aforementioned methods.

为实现上述目的及其他相关目的，本发明提供一个或多个机器可读介质，其上存储有指令，当由一个或多个处理器执行时，使得设备执行前述的一个或多个所述的方法。In order to achieve the above objectives and other related objectives, the present invention provides one or more machine-readable media on which instructions are stored. When executed by one or more processors, the device executes one or more of the aforementioned method.

如上所述，本发明提供的一种异常对象判断方法、***、机器可读介质及设备，具有以下As mentioned above, an abnormal object judgment method, system, machine-readable medium and equipment provided by the present invention have the following

有益效果：Beneficial effects:

本发明通过可见光图像采集模块采集检测对象的可见光图像，通过可见光图像判断是否配戴口罩，根据所述检测对象是否配戴口罩，判断检测对象是否为异常对象。本发明实现了对是否戴配口罩的智能检测。The present invention collects the visible light image of the detection object through the visible light image acquisition module, determines whether to wear a mask through the visible light image, and determines whether the detection object is an abnormal object according to whether the detection object wears a mask. The invention realizes the intelligent detection of whether to wear a mask.

通过使用图像采集装置，同时结合人工智能算法，可对发热人员自动跟踪、测量、告警，达到正常人员无感快速通关、发热人员及时告警，降低检查人员感染的风险。Through the use of image acquisition devices, combined with artificial intelligence algorithms, it can automatically track, measure, and warn feverish personnel, so that normal personnel can pass customs quickly without feeling, and feverish personnel can be alerted in time, reducing the risk of infection of inspectors.

附图说明Description of the drawings

图1为本发明一实施例提供的一种异常对象判断方法的流程图；FIG. 1 is a flowchart of a method for judging abnormal objects according to an embodiment of the present invention;

图2为本发明另一实施例提供的一种异常对象判断方法的流程图；2 is a flowchart of a method for judging abnormal objects according to another embodiment of the present invention;

图3为本发明又一实施例提供的一种异常对象判断方法的流程图；FIG. 3 is a flowchart of a method for judging abnormal objects according to another embodiment of the present invention;

图4为本发明一实施例提供的一种异常对象判断***的硬件结构示意图；4 is a schematic diagram of the hardware structure of an abnormal object judgment system provided by an embodiment of the present invention;

图5为本发明另一实施例提供的一种异常对象判断***的硬件结构示意图；5 is a schematic diagram of the hardware structure of an abnormal object judgment system provided by another embodiment of the present invention;

图6为本发明又一实施例提供的一种异常对象判断***的硬件结构示意图；6 is a schematic diagram of the hardware structure of an abnormal object judgment system provided by another embodiment of the present invention;

图7为本发明一实施例提供的终端设备的硬件结构示意图；FIG. 7 is a schematic diagram of the hardware structure of a terminal device provided by an embodiment of the present invention;

图8为本发明另一实施例提供的终端设备的硬件结构示意图。FIG. 8 is a schematic diagram of the hardware structure of a terminal device provided by another embodiment of the present invention.

具体实施方式Detailed ways

以下通过特定的具体实例说明本发明的实施方式，本领域技术人员可由本说明书所揭露的内容轻易地了解本发明的其他优点与功效。本发明还可以通过另外不同的具体实施方式加以实施或应用，本说明书中的各项细节也可以基于不同观点与应用，在没有背离本发明的精神下进行各种修饰或改变。需说明的是，在不冲突的情况下，以下实施例及实施例中的特征可以相互组合。The following describes the implementation of the present invention through specific specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that, in the case of no conflict, the following embodiments and the features in the embodiments can be combined with each other.

需要说明的是，以下实施例中所提供的图示仅以示意方式说明本发明的基本构想，遂图式中仅显示与本发明中有关的组件而非按照实际实施时的组件数目、形状及尺寸绘制，其实际实施时各组件的型态、数量及比例可为一种随意的改变，且其组件布局型态也可能更为复杂。It should be noted that the illustrations provided in the following embodiments only illustrate the basic idea of the present invention in a schematic manner. The figures only show the components related to the present invention instead of the actual implementation of the number, shape and number of components. For size drawing, the type, quantity, and ratio of each component can be changed at will during actual implementation, and the component layout type may also be more complicated.

如图1所示，一种异常对象判断方法，包括：As shown in Figure 1, an abnormal object judgment method includes:

S11获取检测对象的可见光图像；S11 obtains a visible light image of the detection object;

S12基于所述可见光图像判断所述检测对象是否配戴防护装置；S12 Determine whether the detection object wears a protective device based on the visible light image;

S13根据所述检测对象是否配戴防护装置，判断检测对象是否为异常对象。S13 Determine whether the detected object is an abnormal object according to whether the detected object wears a protective device.

本发明通过采集检测对象的可见光图像，通过可见光图像判断是否配戴口罩，根据所述检测对象是否配戴口罩，判断检测对象是否为异常对象。本发明实现了对是否戴配口罩的智能检测。In the present invention, the visible light image of the detection object is collected, and the visible light image is used to determine whether to wear a mask, and according to whether the detection object is wearing a mask, it is determined whether the detection object is an abnormal object. The invention realizes the intelligent detection of whether to wear a mask.

在检测对象没有配戴防护装置的情况下，则认为该检测对象为异常对象。In the case that the detection object is not wearing a protective device, the detection object is considered to be an abnormal object.

其中，防护装置包括口罩、面罩，是否佩戴口罩可以通过以下方法检测：Among them, protective devices include masks and face shields. Whether to wear a mask can be tested by the following methods:

先获取检测对象的行为图片；First obtain the behavior picture of the detected object;

然后将所述行为图片输入至预先训练好的基于神经网络的行为识别模型中进行行为识别处理，得到用于标记检测对象的行为的行为标识；Then input the behavior picture into a pre-trained neural network-based behavior recognition model for behavior recognition processing to obtain a behavior identifier for marking the behavior of the detection object;

若所述行为标识为预设的口罩配戴标识，则确定所述检测对象的行为属于配戴口罩行为。If the behavior identifier is a preset mask wearing identifier, it is determined that the behavior of the detection object belongs to the behavior of wearing a mask.

如图2所示，一种异常对象判断方法，包括：As shown in Figure 2, an abnormal object judgment method includes:

S21获取检测对象的可见光图像；S21 acquire a visible light image of the detection object;

S22基于所述可见光图像判断所述检测对象是否配戴防护装置；S22, based on the visible light image, judge whether the detection object wears a protective device;

S23在检测对象配戴防护装置的情况下，获取检测对象的红外图像；S23, when the detection object is wearing a protective device, obtain an infrared image of the detection object;

S24对所述可见光图像进行目标部位检测，得到目标部位位置；S24 performs target part detection on the visible light image to obtain the target part position;

S25确定所述目标部位位置在检测对象的红外图像中的目标检测区域；S25: Determine the target detection area where the position of the target part is in the infrared image of the detection object;

S26获取检测对象的目标检测区域的检测指标；S26 acquire the detection index of the target detection area of the detection object;

S27根据所述目标检测区域的检测指标，判断检测对象是否为异常对象。S27, according to the detection index of the target detection area, judge whether the detection object is an abnormal object.

本发明通过使用红外图像及可见光图像，同时结合人工智能算法，可对发热人员自动跟踪、测量、告警，达到正常人员无感快速通关、发热人员及时告警，降低检查人员感染的风险。By using infrared images and visible light images, and combining artificial intelligence algorithms, the invention can automatically track, measure, and warn feverish personnel, achieve quick customs clearance for normal personnel without feeling, and prompt warning for feverish personnel, thereby reducing the risk of infection of inspectors.

在本实施例中，所述目标部位包括人脸、手背、脖子、肩头，所述目标检测区域为人脸区域、手背区域、脖子区域、肩头区域，所述检测指标为温度。以下以目标检测区域为人脸区域进行说明。In this embodiment, the target part includes the face, the back of the hand, the neck, and the shoulder, the target detection area is the face area, the back of the hand area, the neck area, and the shoulder area, and the detection index is the temperature. The following describes the target detection area as the face area.

在本实施例中，可见光图像可以通过可见光图像采集传感器进行采集，红外图像可以通过红外图像采集传感器进行采集。当然，在另一实施例中，可以采用通过一个设备对两种图像进行采集，例如，可以同时对可见光图像和红外图像进行采集的红外测温探头。当然，也可以由RGB-IR图像传感器(可同时接收RGB分量和IR分量)采集图像后，通过RGB-IR处理单元将接收到的RGB-IR图像数据，经过分离，得到同步的RGB图像(可见光图像)和IR图像(红外图像)。In this embodiment, the visible light image can be collected by a visible light image acquisition sensor, and the infrared image can be collected by an infrared image acquisition sensor. Of course, in another embodiment, two types of images can be collected by one device, for example, an infrared temperature measuring probe that can collect visible light images and infrared images at the same time. Of course, after the image is collected by the RGB-IR image sensor (which can receive both RGB and IR components), the received RGB-IR image data can be separated by the RGB-IR processing unit to obtain a synchronized RGB image (visible light Image) and IR image (infrared image).

可以理解的是，由于红外探测是一个持续的过程，会在一段时间内持续性地进行检测以获得多个红外图像。因此，在进行人脸温度测量时，需要获得同一时刻的图像，即当前时刻的红外图像和当前时刻的可见光图像。在人脸区域确定过程中，先对当前时刻的可见光图像进行人脸检测，获得人脸的位置，然后将当前时刻的可见光图像中的人脸位置映射到所述检测对象当前时刻的红外图像，以得到该检测对象在当前时刻的红外图像中的人脸区域。It is understandable that since infrared detection is a continuous process, multiple infrared images will be obtained continuously for a period of time. Therefore, when measuring the face temperature, it is necessary to obtain the image at the same time, that is, the infrared image at the current time and the visible light image at the current time. In the process of determining the face area, first perform face detection on the visible light image at the current moment to obtain the position of the face, and then map the face position in the visible light image at the current moment to the infrared image of the detection object at the current moment. In order to obtain the face area of the detected object in the infrared image at the current moment.

由于人脸区域的图像为红外线图像，可以预先获取颜色与温度之间的对应关系，根据颜色与温度之间的对应关系，确定人脸区域中的颜色对应的温度，从而可以确定人脸区域的温度。Since the image of the face area is an infrared image, the corresponding relationship between the color and the temperature can be obtained in advance, and the temperature corresponding to the color in the face area can be determined according to the corresponding relationship between the color and the temperature, so that the color of the face area can be determined temperature.

本实施例采用的是人脸检测技术，可对图像画面内多人脸同时进行检测，以获取检测对象的人脸数据。进一步，可以通过人脸数据获得最佳人脸，测量人脸温度以最佳人脸时的人脸区域作为测温对象。最佳人脸可以通过人脸质量分、人脸大小、人脸角度、人脸遮挡率等多维度综合选择。This embodiment adopts a face detection technology, which can detect multiple faces in an image frame at the same time to obtain face data of a detection object. Furthermore, the best face can be obtained through the face data, and the face area at the best face temperature can be used as the temperature measurement object when the face temperature is measured. The best face can be comprehensively selected through multiple dimensions such as face quality score, face size, face angle, and face occlusion rate.

判断人检测对象为异常对象的方法为：当检测对象的人脸区域的温度超过温度阈值时，该检测对象为异常对象，此时可以发出报警提示。The method for judging that the human detection object is an abnormal object is: when the temperature of the face area of the detection object exceeds a temperature threshold, the detection object is an abnormal object, and an alarm can be issued at this time.

需要说明的是，用户可以对报警参数进行设置，比如预设温度阈值、报警灵敏度等。比如，当人脸区域的温度超过37.3度时，进行报警。其中，报警的方式有多种，比如声光指示报警，或者语音报警。It should be noted that the user can set the alarm parameters, such as preset temperature thresholds, alarm sensitivity, etc. For example, when the temperature of the face area exceeds 37.3 degrees, an alarm is issued. Among them, there are many ways to alarm, such as sound and light indication alarm, or voice alarm.

或者，在呈现红外图像的屏幕上用醒目颜色显示，并可对报警等级进行设定，可以用不同色彩显示不同报警等级，不同的报警等级发出不同的报警信号。比如，报警等级低，可以只发出声光报警，报警等极较高的发出语言报警，报警等级高的，同时发出声光报警和语音报警。Or, display in eye-catching colors on the screen showing the infrared image, and set the alarm level. Different colors can be used to display different alarm levels, and different alarm levels send different alarm signals. For example, if the alarm level is low, only audible and visual alarms can be issued. If the alarm level is very high, verbal alarms can be issued. If the alarm level is high, audible and visual alarms and voice alarms can be issued at the same time.

可以理解的是，目标检测区域的温度与获取图像的图像采集装置和目标检测区域之间的距离相关，因此，在一实施例中，该方法还包括：基于检测对象与所述图像采集装置的距离对所述目标检测区域的温度进行补偿。通过对目标检测区域的温度进行补偿提高了测量的精度。It can be understood that the temperature of the target detection area is related to the distance between the image acquisition device that acquires the image and the target detection area. Therefore, in one embodiment, the method further includes: The distance compensates for the temperature of the target detection area. The accuracy of the measurement is improved by compensating the temperature of the target detection area.

由于在进行红外测温的时候，环境因素会对测温的准确性产生影响，因此需要对目标检测区的温度进行补偿。具体地，获取环境温度，根据所述环境温度对所述目标检测区域的温度进行补偿。更加具体地，在环境温度较低情况下，检测温度值会低于真实体温，此时应该根据环境温度对红外传感测量值做适当提升；在环境温度较高情况下，检测温度值可能会高于真实体温，此时应该根据环境温度对红外传感测量值做适当降低。Since environmental factors will affect the accuracy of temperature measurement when infrared temperature measurement is performed, it is necessary to compensate the temperature of the target detection area. Specifically, the ambient temperature is acquired, and the temperature of the target detection area is compensated according to the ambient temperature. More specifically, in the case of low ambient temperature, the detected temperature value will be lower than the real body temperature. At this time, the infrared sensor measurement value should be appropriately increased according to the ambient temperature; in the case of high ambient temperature, the detected temperature value may be If the temperature is higher than the real body temperature, the infrared sensor measurement value should be appropriately lowered according to the ambient temperature.

由于不同的年龄会有不同的温度，因此，该方法还包括：Since different ages have different temperatures, this method also includes:

例如，小孩代谢率较高，体温较成人稍高，对应小孩的温度阈值可设置稍高一点；年老者代谢率较低，温度可比青壮年稍低，因此，对应年老者阈值可设置稍低一点。For example, children have a higher metabolic rate and a slightly higher body temperature than adults, and the corresponding temperature threshold for children can be set a little higher; for the elderly, the metabolic rate is lower, and the temperature can be slightly lower than that of young adults. Therefore, the corresponding threshold for the elderly can be set a little lower .

在一实施例中，该方法还包括：采用人脸识别技术或人体识别技术对所述异常对象进行追踪。In an embodiment, the method further includes: using face recognition technology or human body recognition technology to track the abnormal object.

抓拍检测对象人脸或人体后，通过对检测指标进行检测，判断为异常对象后，通过识别出的人脸或人体特征，对异常对象进行追踪。After capturing the face or human body of the detected object, the detection index is used to detect the abnormal object, and after the abnormal object is judged, the abnormal object is tracked through the recognized face or human body characteristics.

或者，抓拍检测对象的人脸或人体后，与异常对象库中的人脸或人体进行比对，比对成功的，则对该检测对象进行跟踪。Or, after capturing the face or human body of the detection object, it is compared with the face or human body in the abnormal object library, and if the comparison is successful, the detection object is tracked.

如图3所示，一种异常对象判断方法，包括：As shown in Figure 3, an abnormal object judgment method includes:

S31获取检测对象的可见光图像；S31 acquire a visible light image of the detection object;

S32基于所述可见光图像判断所述检测对象是否配戴防护装置；S32, based on the visible light image, judge whether the detection object wears a protective device;

S33在检测对象配戴防护装置的情况下，获取检测对象的激光图像；S33, when the detection object is wearing a protective device, obtain a laser image of the detection object;

S34对所述可见光图像进行目标部位检测，得到目标部位位置；S34 performs target part detection on the visible light image to obtain the target part position;

S35确定所述目标部位位置在检测对象的激光图像中的目标检测区域；S35: Determine the target detection area where the position of the target part is in the laser image of the detection object;

S36获取检测对象的目标检测区域的检测指标；S36 acquire the detection index of the target detection area of the detection object;

S37根据所述目标检测区域的检测指标，判断检测对象是否为异常对象。S37 Determine whether the detection object is an abnormal object according to the detection index of the target detection area.

在本实施例中，所述目标部位包括人脸、手背、脖子、肩头，所述目标检测区域为人脸区域、手背区域、脖子区域、肩头区域，所述检测指标为血液核酸特征。以下以目标检测区域为人脸区域进行说明。In this embodiment, the target parts include the face, the back of the hand, the neck, and the shoulder, the target detection area is the face area, the back of the hand area, the neck area, and the shoulder area, and the detection index is the blood nucleic acid feature. The following describes the target detection area as the face area.

在本实施例中，可见光图像可以通过可见光图像采集传感器进行采集，激光图像可以通过激光图像采集传感器获取。当然，在另一实施例中，可以采用通过一个设备对两种图像进行采集，例如，可以同时对可见光图像和激光图像进行采集的设备。当然，也可以由RGB-IR图像传感器(可同时接收RGB分量和IR分量)采集图像后，通过RGB-IR处理单元将接收到的RGB-IR图像数据，经过分离，得到同步的RGB图像(可见光图像)和IR图像(红外图像)。In this embodiment, the visible light image can be acquired by a visible light image acquisition sensor, and the laser image can be acquired by a laser image acquisition sensor. Of course, in another embodiment, one device can be used to collect two kinds of images, for example, a device that can collect a visible light image and a laser image at the same time. Of course, after the image is collected by the RGB-IR image sensor (which can receive both RGB and IR components), the received RGB-IR image data can be separated by the RGB-IR processing unit to obtain a synchronized RGB image (visible light Image) and IR image (infrared image).

可以理解的是，在人脸区域确定过程中，先对当前时刻的可见光图像进行人脸检测，获得人脸的位置，然后将当前时刻的可见光图像中的人脸位置映射到所述检测对象当前时刻的激光图像，以得到该检测对象在当前时刻的激光图像中的人脸区域。It is understandable that in the process of determining the face area, the visible light image at the current moment is first detected to obtain the position of the face, and then the face position in the visible light image at the current moment is mapped to the current detection object. The laser image at the time to obtain the face area of the detection object in the laser image at the current time.

本实施例采用的是人脸检测技术，可对图像画面内多人脸同时进行检测，以获取检测对象的人脸数据。进一步，可以通过人脸数据获得最佳人脸，测量人脸温度以最佳人脸时的人脸区域作为检测对象。最佳人脸可以通过人脸质量分、人脸大小、人脸角度、人脸遮挡率等多维度综合选择。This embodiment adopts the face detection technology, which can simultaneously detect multiple faces in the image frame to obtain the face data of the detection object. Further, the best face can be obtained through the face data, and the face area at the best face can be used as the detection target by measuring the face temperature. The best face can be comprehensively selected through multiple dimensions such as face quality score, face size, face angle, and face occlusion rate.

所述检测指标为血液核酸特征，则当检测对象的目标检测区域的血液核酸特征符合预设条件时，则该检测对象为异常对象。可以理解的是，需预先设置有一异常核酸特征库，其中存有若干核酸特征，这些核酸特征能够反映人体的不正常状态，通过这些核酸特征可以确定与之对应的异常症状。符合预设条件则可以认为是检测对象的血液核酸特征为异常核酸特征库中的一种。最后，当检测到异常对象时，发出报警提示。发出报警的提示可以参考前述实施例，此处不再进行赘述。The detection index is a blood nucleic acid feature, and when the blood nucleic acid feature of the target detection area of the detection object meets the preset condition, the detection object is an abnormal object. It is understandable that an abnormal nucleic acid feature library needs to be set up in advance, in which there are several nucleic acid features, which can reflect the abnormal state of the human body, and the corresponding abnormal symptoms can be determined through these nucleic acid features. If the preset conditions are met, it can be considered that the blood nucleic acid feature of the test object is one of the abnormal nucleic acid feature libraries. Finally, when an abnormal object is detected, an alarm is issued. For the reminder of issuing an alarm, refer to the foregoing embodiment, which will not be repeated here.

在一实施例中，还可以采用人脸识别技术或人体识别技术对所述异常对象进行追踪。In an embodiment, face recognition technology or human body recognition technology may also be used to track the abnormal object.

如图4所示，一种异常对象判断***，包括：As shown in Figure 4, an abnormal object judgment system includes:

可见光图像获取模块41，用于获取检测对象的可见光图像；The visible light image acquisition module 41 is used to acquire a visible light image of the detection object;

行为检测模块42，用于基于所述可见光图像判断所述检测对象是否配戴防护装置；The behavior detection module 42 is configured to determine whether the detection object wears a protective device based on the visible light image;

第一异常对象判断模块43，用于根据所述检测对象是否配戴防护装置，判断检测对象是否为异常对象。The first abnormal object judgment module 43 is used for judging whether the detection object is an abnormal object according to whether the detection object wears a protective device.

若检测对象没有配戴防护装置，则认为该检测对象为异常对象。If the detection object is not wearing a protective device, the detection object is considered to be an abnormal object.

其中，所述防护装置包括口罩、面罩，是否佩戴口罩可以通过以下方法检测：Wherein, the protective device includes a mask and a face mask, and whether the mask is worn can be detected by the following methods:

如图5所示，一种异常对象判断***，包括：As shown in Figure 5, an abnormal object judgment system includes:

第一可见光图像获取模块51，用于获取检测对象的可见光图像；The first visible light image acquisition module 51 is configured to acquire a visible light image of the detection object;

第一行为检测模块52，用于基于所述可见光图像判断所述检测对象是否配戴防护装置；The first behavior detection module 52 is configured to determine whether the detection object wears a protective device based on the visible light image;

红外图像获取模块53，用于在检测对象配戴防护装置的情况下获取检测对象的红外图像；The infrared image acquisition module 53 is used to acquire an infrared image of the detection object when the detection object is wearing a protective device;

第一目标检测模块54，用于对所述可见光图像进行目标部位检测，得到目标部位位置；The first target detection module 54 is configured to perform target part detection on the visible light image to obtain the target part position;

第一目标区域确定模块55，用于确定所述目标部位位置在检测对象的红外图像中的目标检测区域；The first target area determining module 55 is configured to determine the target detection area where the position of the target part is in the infrared image of the detection object;

第一检测指标获取模块56，用于获取检测对象的目标检测区域的检测指标；The first detection index acquisition module 56 is used to acquire the detection index of the target detection area of the detection object;

第二异常对象判断模块57，用于根据所述目标检测区域的检测指标，判断检测对象是否为异常对象。The second abnormal object judgment module 57 is used for judging whether the detection object is an abnormal object according to the detection index of the target detection area.

判断人检测对象为异常对象的方法为：当检测对象的人脸区域的温度超过温度阈值时，该检测对象为异常对象，此时报警提示模块发出报警提示。The method for judging that the human detection object is an abnormal object is: when the temperature of the face area of the detection object exceeds the temperature threshold, the detection object is an abnormal object, and the alarm prompt module sends an alarm prompt at this time.

可以理解的是，目标检测区域的温度与获取图像的图像采集装置和目标检测区域之间的距离相关，因此，在一实施例中，该***还包括：第一温度补偿模块，用于基于检测对象与所述图像采集装置的距离对所述目标检测区域的温度进行补偿。通过对目标检测区域的温度进行补偿提高了测量的精度。It can be understood that the temperature of the target detection area is related to the distance between the image acquisition device that acquires the image and the target detection area. Therefore, in an embodiment, the system further includes: a first temperature compensation module for detecting The distance between the object and the image acquisition device compensates the temperature of the target detection area. The accuracy of the measurement is improved by compensating the temperature of the target detection area.

由于在进行红外测温的时候，环境因素会对测温的准确性产生影响，因此需要对目标检测区的温度进行补偿。因此，该***还包括：Since environmental factors will affect the accuracy of temperature measurement when infrared temperature measurement is performed, it is necessary to compensate the temperature of the target detection area. Therefore, the system also includes:

具体地，更加具体地，在环境温度较低情况下，检测温度值会低于真实体温，此时应该根据环境温度对红外传感测量值做适当提升；在环境温度较高情况下，检测温度值可能会高于真实体温，此时应该根据环境温度对红外传感测量值做适当降低。Specifically, more specifically, when the ambient temperature is low, the detected temperature value will be lower than the real body temperature. At this time, the infrared sensor measurement value should be appropriately increased according to the ambient temperature; when the ambient temperature is high, the detected temperature The value may be higher than the real body temperature. At this time, the infrared sensor measurement value should be appropriately reduced according to the ambient temperature.

由于不同的年龄会有不同的温度，因此，该***还包括：Since different ages have different temperatures, the system also includes:

在一实施例中，该***还包括：追踪模块，用于采用人脸识别技术或人体识别技术对所述异常对象进行追踪。In an embodiment, the system further includes: a tracking module for tracking the abnormal object using face recognition technology or human body recognition technology.

抓拍检测对象人脸或人体后，通过对检测指标进行检测，判断为异常对象后，通过识别出的人脸或人体特征，对异常对象进行追踪。After capturing the face or human body of the detected object, the detection index is used to detect the abnormal object, and then the abnormal object is tracked through the recognized face or human body characteristics.

如图6所示，一种异常对象判断***，包括：As shown in Figure 6, an abnormal object judgment system includes:

第二可见光图像获取模块61，用于获取检测对象的可见光图像；The second visible light image acquisition module 61 is configured to acquire a visible light image of the detection object;

第二行为检测模块62，用于基于所述可见光图像判断所述检测对象是否配戴防护装置；The second behavior detection module 62 is configured to determine whether the detection object wears a protective device based on the visible light image;

激光图像获取模块63，用于在检测对象配戴防护装置的情况下，获取检测对象的激光图像；The laser image acquisition module 63 is configured to acquire a laser image of the detection object when the detection object is wearing a protective device;

第二目标检测模块64，用于对所述可见光图像进行目标部位检测，得到目标部位位置；The second target detection module 64 is configured to perform target part detection on the visible light image to obtain the position of the target part;

第二目标区域确定模块65，用于确定所述目标部位位置在检测对象的激光图像中的目标检测区域；The second target area determining module 65 is configured to determine the target detection area in the laser image of the detection object where the position of the target part is;

第二检测指标获取模块66，用于获取检测对象的目标检测区域的检测指标；The second detection index acquisition module 66 is used to acquire the detection index of the target detection area of the detection object;

第三异常对象判断模块67，用于根据所述目标检测区域的检测指标，判断检测对象是否为异常对象。The third abnormal object judgment module 67 is used for judging whether the detection object is an abnormal object according to the detection index of the target detection area.

在本实施例中，可见光图像可以通过可见光图像采集传感器进行采集，激光图像可以通过激光图像采集传感器获取。当然，在另一实施例中，可以采用通过一个设备对两种图像进行采集，例如，可以同时对可见光图像和激光图像进行采集的设备。In this embodiment, the visible light image can be acquired by a visible light image acquisition sensor, and the laser image can be acquired by a laser image acquisition sensor. Of course, in another embodiment, one device can be used to collect two kinds of images, for example, a device that can collect a visible light image and a laser image at the same time.

本实施例采用的是人脸检测技术，可对图像画面内多人脸同时进行检测，以获取检测对象的人脸数据。进一步，可以通过人脸数据获得最佳人脸，测量人脸温度以最佳人脸时的人脸区域作为检测对象。最佳人脸可以通过人脸质量分、人脸大小、人脸角度、人脸遮挡率等多维度综合选择。This embodiment adopts a face detection technology, which can detect multiple faces in an image frame at the same time to obtain face data of a detection object. Further, the best face can be obtained through the face data, and the face area at the best face can be used as the detection target by measuring the face temperature. The best face can be comprehensively selected through multiple dimensions such as face quality score, face size, face angle, and face occlusion rate.

在一实施例中，该方法还包括：采用人脸识别技术或人体识别技术对所述异常对象进行追踪。抓拍检测对象人脸或人体后，通过对检测指标进行检测，判断为异常对象后，通过识别出的人脸或人体特征，对异常对象进行追踪。In an embodiment, the method further includes: using face recognition technology or human body recognition technology to track the abnormal object. After capturing the face or human body of the detected object, the detection index is used to detect the abnormal object, and then the abnormal object is tracked through the recognized face or human body characteristics.

本发明采用非接触式测温，被检测人员无需停止、站立或做出任何动作，即可完成体温检测。同时，工作人员远离被测人群，有效地避免交叉感染。图像响应速度为0.04ms，测温响应速度快，能够在30毫秒内完成16个目标检测，可同时对16个目标实时测温，具有非接触快速、方便、直观、安全等特点，克服了传统的体温计、额温计、点温计和耳温计等仅针对个体测量，(如使用传统的体温计检测一般需要3分钟/人次，普通点温计、额温计、耳温计为单个人体检测，一般检测时间需要4～5秒/人次)。The invention adopts non-contact temperature measurement, and the detected person can complete body temperature detection without stopping, standing or making any actions. At the same time, the staff stay away from the tested population, effectively avoiding cross-infection. The image response speed is 0.04ms, and the temperature measurement response speed is fast. It can complete 16 target detections within 30 milliseconds, and can measure the temperature of 16 targets at the same time. It has the characteristics of non-contact fast, convenient, intuitive, and safe, which overcomes the traditional The clinical thermometers, forehead thermometers, spot thermometers and ear thermometers are only for individual measurement, (such as the use of traditional thermometers to test generally takes 3 minutes/person, ordinary spot thermometers, forehead thermometers, and ear thermometers are for individual human testing , The general detection time takes 4 to 5 seconds/person).

本发明测温范围为：0℃～60℃，测温精度：28℃～45℃≤±0.3℃，内置自动测温修正。人脸检疫体温筛查预警避免了耗时多、易交叉感染等不足，而可有效的控制疫情扩散，减少人员伤亡，非常适合于在机场、码头、车站、银行、医院和商场等人流量较大的场合进行体温快速排查。The temperature measurement range of the invention is: 0℃～60℃, the temperature measurement accuracy: 28℃～45℃≤±0.3℃, built-in automatic temperature measurement correction. Face quarantine and body temperature screening early warning avoids the deficiencies of time-consuming and easy cross-infection, and can effectively control the spread of the epidemic and reduce casualties. It is very suitable for heavy traffic in airports, docks, stations, banks, hospitals and shopping malls. Perform a quick temperature check on large occasions.

本发明能够进行远距离、大面积检测The invention can carry out long-distance, large-area detection

热成像分辨率384*288；焦距6.8/15mm：1.2-2米检测距离，15mm焦距：3-7米检测距离；Thermal imaging resolution 384*288; focal length 6.8/15mm: 1.2-2 meters detection distance, 15mm focal length: 3-7 meters detection distance;

可见光分辨率：1920*1080，焦距5mm；Visible light resolution: 1920*1080, focal length 5mm;

本申请实施例还提供了一种设备，该设备可以包括：一个或多个处理器；和其上存储有指令的一个或多个机器可读介质，当由所述一个或多个处理器执行时，使得所述设备执行图1所述的方法。在实际应用中，该设备可以作为终端设备，也可以作为服务器，终端设备的例子可以包括：智能手机、平板电脑、电子书阅读器、MP3(动态影像专家压缩标准语音层面3，Moving Picture Experts Group Audio Layer III)播放器、MP4(动态影像专家压缩标准语音层面4，Moving Picture Experts Group Audio Layer IV)播放器、膝上型便携计算机、车载电脑、台式计算机、机顶盒、智能电视机、可穿戴设备等等，本申请实施例对于具体的设备不加以限制。The embodiment of the present application also provides a device, which may include: one or more processors; and one or more machine-readable media on which instructions are stored, when executed by the one or more processors At this time, the device is caused to execute the method described in FIG. 1. In practical applications, the device can be used as a terminal device or a server. Examples of terminal devices can include: smartphones, tablets, e-book readers, MP3 (moving picture experts compress standard voice level 3, Moving Picture Experts Group Audio Layer III) Players, MP4 (Moving Picture Experts Group Audio Layer IV) Players, laptop portable computers, car computers, desktop computers, set-top boxes, smart TVs, wearable devices And so on, the embodiments of the present application do not impose restrictions on specific devices.

本申请实施例还提供了一种非易失性可读存储介质，该存储介质中存储有一个或多个模块(programs)，该一个或多个模块被应用在设备时，可以使得该设备执行本申请实施例的图1中方法所包含步骤的指令(instructions)。The embodiment of the present application also provides a non-volatile readable storage medium. The storage medium stores one or more modules (programs). When the one or more modules are applied to a device, the device can execute Instructions for the steps included in the method in FIG. 1 of the embodiment of the present application.

图7为本申请一实施例提供的终端设备的硬件结构示意图。如图所示，该终端设备可以包括：输入设备1100、第一处理器1101、输出设备1102、第一存储器1103和至少一个通信总线1104。通信总线1104用于实现元件之间的通信连接。第一存储器1103可能包含高速RAM存储器，也可能还包括非易失性存储NVM，例如至少一个磁盘存储器，第一存储器1103中可以存储各种程序，用于完成各种处理功能以及实现本实施例的方法步骤。FIG. 7 is a schematic diagram of the hardware structure of a terminal device provided by an embodiment of the application. As shown in the figure, the terminal device may include: an input device 1100, a first processor 1101, an output device 1102, a first memory 1103, and at least one communication bus 1104. The communication bus 1104 is used to implement communication connections between components. The first memory 1103 may include a high-speed RAM memory, or may also include a non-volatile storage NVM, such as at least one disk memory. The first memory 1103 may store various programs for completing various processing functions and implementing this embodiment. Method steps.

可选的，上述第一处理器1101例如可以为中央处理器(Central Processing Unit，简称CPU)、应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现，该第一处理器1101通过有线或无线连接耦合到上述输入设备1100和输出设备1102。Optionally, the foregoing first processor 1101 may be, for example, a central processing unit (Central Processing Unit, CPU for short), an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), and A programmable logic device (PLD), a field programmable gate array (FPGA), a controller, a microcontroller, a microprocessor or other electronic components are implemented, and the first processor 1101 is coupled to the aforementioned input device 1100 and via a wired or wireless connection. Output device 1102.

可选的，上述输入设备1100可以包括多种输入设备，例如可以包括面向用户的用户接口、面向设备的设备接口、软件的可编程接口、摄像头、传感器中至少一种。可选的，该面向设备的设备接口可以是用于设备与设备之间进行数据传输的有线接口、还可以是用于设备与设备之间进行数据传输的硬件***接口(例如USB接口、串口等)；可选的，该面向用户的用户接口例如可以是面向用户的控制按键、用于接收语音输入的语音输入设备以及用户接收用户触摸输入的触摸感知设备(例如具有触摸感应功能的触摸屏、触控板等)；可选的，上述软件的可编程接口例如可以是供用户编辑或者修改程序的入口，例如芯片的输入引脚接口或者输入接口等；输出设备1102可以包括显示器、音响等输出设备。Optionally, the aforementioned input device 1100 may include multiple input devices, for example, it may include at least one of a user-oriented user interface, a device-oriented device interface, a software programmable interface, a camera, and a sensor. Optionally, the device-oriented device interface may be a wired interface for data transmission between the device and the device, or a hardware plug-in interface for data transmission between the device and the device (such as a USB interface, a serial port, etc.) ); Optionally, the user-oriented user interface may be, for example, user-oriented control buttons, a voice input device for receiving voice input, and a touch sensing device for receiving user touch input (such as a touch screen with touch sensing function, touch Control board, etc.); Optionally, the programmable interface of the above software may be, for example, an entry for the user to edit or modify the program, such as the input pin interface or input interface of the chip, etc.; the output device 1102 may include output devices such as a display and audio .

在本实施例中，该终端设备的处理器包括用于执行各设备中各模块的功能，具体功能和技术效果参照上述实施例即可，此处不再赘述。In this embodiment, the processor of the terminal device includes functions for executing each module in each device. For specific functions and technical effects, please refer to the above-mentioned embodiment, which will not be repeated here.

图8为本申请的一个实施例提供的终端设备的硬件结构示意图。图8是对图7在实现过程中的一个具体的实施例。如图所示，本实施例的终端设备可以包括第二处理器1201以及第二存储器1202。FIG. 8 is a schematic diagram of the hardware structure of a terminal device provided by an embodiment of the application. Fig. 8 is a specific embodiment of Fig. 7 in the implementation process. As shown in the figure, the terminal device of this embodiment may include a second processor 1201 and a second memory 1202.

第二处理器1201执行第二存储器1202所存放的计算机程序代码，实现上述实施例中图1所述方法。The second processor 1201 executes the computer program code stored in the second memory 1202 to implement the method described in FIG. 1 in the foregoing embodiment.

第二存储器1202被配置为存储各种类型的数据以支持在终端设备的操作。这些数据的示例包括用于在终端设备上操作的任何应用程序或方法的指令，例如消息，图片，视频等。第二存储器1202可能包含随机存取存储器(random access memory，简称RAM)，也可能还包括非易失性存储器(non-volatile memory)，例如至少一个磁盘存储器。The second memory 1202 is configured to store various types of data to support operations on the terminal device. Examples of these data include instructions for any application or method operating on the terminal device, such as messages, pictures, videos, and so on. The second memory 1202 may include a random access memory (random access memory, RAM for short), and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

可选地，第二处理器1201设置在处理组件1200中。该终端设备还可以包括：通信组件1203，电源组件1204，多媒体组件1205，语音组件1206，输入/输出接口1207和/或传感器组件1208。终端设备具体所包含的组件等依据实际需求设定，本实施例对此不作限定。Optionally, the second processor 1201 is provided in the processing component 1200. The terminal device may also include: a communication component 1203, a power supply component 1204, a multimedia component 1205, a voice component 1206, an input/output interface 1207 and/or a sensor component 1208. The specific components included in the terminal device are set according to actual requirements, which is not limited in this embodiment.

处理组件1200通常控制终端设备的整体操作。处理组件1200可以包括一个或多个第二处理器1201来执行指令，以完成上述数据处理方法中的全部或部分步骤。此外，处理组件1200可以包括一个或多个模块，便于处理组件1200和其他组件之间的交互。例如，处理组件1200可以包括多媒体模块，以方便多媒体组件1205和处理组件1200之间的交互。The processing component 1200 generally controls the overall operation of the terminal device. The processing component 1200 may include one or more second processors 1201 to execute instructions to complete all or part of the steps in the foregoing data processing method. In addition, the processing component 1200 may include one or more modules to facilitate the interaction between the processing component 1200 and other components. For example, the processing component 1200 may include a multimedia module to facilitate the interaction between the multimedia component 1205 and the processing component 1200.

电源组件1204为终端设备的各种组件提供电力。电源组件1204可以包括电源管理***，一个或多个电源，及其他与为终端设备生成、管理和分配电力相关联的组件。The power supply component 1204 provides power for various components of the terminal device. The power supply component 1204 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for terminal devices.

多媒体组件1205包括在终端设备和用户之间的提供一个输出接口的显示屏。在一些实施例中，显示屏可以包括液晶显示器(LCD)和触摸面板(TP)。如果显示屏包括触摸面板，显示屏可以被实现为触摸屏，以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界，而且还检测与所述触摸或滑动操作相关的持续时间和压力。The multimedia component 1205 includes a display screen that provides an output interface between the terminal device and the user. In some embodiments, the display screen may include a liquid crystal display (LCD) and a touch panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.

语音组件1206被配置为输出和/或输入语音信号。例如，语音组件1206包括一个麦克风(MIC)，当终端设备处于操作模式，如语音识别模式时，麦克风被配置为接收外部语音信号。所接收的语音信号可以被进一步存储在第二存储器1202或经由通信组件1203发送。在一些实施例中，语音组件1206还包括一个扬声器，用于输出语音信号。The voice component 1206 is configured to output and/or input voice signals. For example, the voice component 1206 includes a microphone (MIC). When the terminal device is in an operating mode, such as a voice recognition mode, the microphone is configured to receive external voice signals. The received voice signal may be further stored in the second memory 1202 or transmitted via the communication component 1203. In some embodiments, the voice component 1206 further includes a speaker for outputting voice signals.

输入/输出接口1207为处理组件1200和***接口模块之间提供接口，上述***接口模块可以是点击轮，按钮等。这些按钮可包括但不限于：音量按钮、启动按钮和锁定按钮。The input/output interface 1207 provides an interface between the processing component 1200 and a peripheral interface module. The peripheral interface module may be a click wheel, a button, or the like. These buttons may include, but are not limited to: volume buttons, start buttons, and lock buttons.

传感器组件1208包括一个或多个传感器，用于为终端设备提供各个方面的状态评估。例如，传感器组件1208可以检测到终端设备的打开/关闭状态，组件的相对定位，用户与终端设备接触的存在或不存在。传感器组件1208可以包括接近传感器，被配置用来在没有任何的物理接触时检测附近物体的存在，包括检测用户与终端设备间的距离。在一些实施例中，该传感器组件1208还可以包括摄像头等。The sensor component 1208 includes one or more sensors, which are used to provide various aspects of state evaluation for the terminal device. For example, the sensor component 1208 can detect the open/close state of the terminal device, the relative positioning of the component, and the presence or absence of contact between the user and the terminal device. The sensor component 1208 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact, including detecting the distance between the user and the terminal device. In some embodiments, the sensor component 1208 may also include a camera and the like.

通信组件1203被配置为便于终端设备和其他设备之间有线或无线方式的通信。终端设备可以接入基于通信标准的无线网络，如WiFi，2G或3G，或它们的组合。在一个实施例中，该终端设备中可以包括SIM卡插槽，该SIM卡插槽用于***SIM卡，使得终端设备可以登录GPRS网络，通过互联网与服务器建立通信。The communication component 1203 is configured to facilitate wired or wireless communication between the terminal device and other devices. Terminal devices can access wireless networks based on communication standards, such as WiFi, 2G or 3G, or a combination of them. In one embodiment, the terminal device may include a SIM card slot for inserting a SIM card so that the terminal device can log in to the GPRS network and establish communication with the server via the Internet.

由上可知，在图8实施例中所涉及的通信组件1203、语音组件1206以及输入/输出接口1207、传感器组件1208均可以作为图7实施例中的输入设备的实现方式。It can be seen from the above that the communication component 1203, voice component 1206, input/output interface 1207, and sensor component 1208 involved in the embodiment in FIG. 8 can all be used as implementations of the input device in the embodiment in FIG. 7.

上述实施例仅例示性说明本发明的原理及其功效，而非用于限制本发明。任何熟悉此技术的人士皆可在不违背本发明的精神及范畴下，对上述实施例进行修饰或改变。因此，举凡所属技术领域中具有通常知识者在未脱离本发明所揭示的精神与技术思想下所完成的一切等效修饰或改变，仍应由本发明的权利要求所涵盖。The above-mentioned embodiments only exemplarily illustrate the principles and effects of the present invention, but are not used to limit the present invention. Anyone familiar with this technology can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or changes made by those with ordinary knowledge in the technical field without departing from the spirit and technical ideas disclosed in the present invention should still be covered by the claims of the present invention.

Claims

一种异常对象判断方法，其特征在于，包括：A method for judging abnormal objects, which is characterized in that it includes:

获取检测对象的可见光图像；Obtain a visible light image of the detection object;

基于所述可见光图像判断所述检测对象是否配戴防护装置；Judging whether the detection object wears a protective device based on the visible light image;

根据所述检测对象是否配戴防护装置，判断检测对象是否为异常对象。According to whether the detection object is wearing a protective device, it is determined whether the detection object is an abnormal object.
根据权利要求1所述的异常对象判断方法，其特征在于，若检测对象没有配戴防护装置，则认为该检测对象为异常对象。The method for judging an abnormal object according to claim 1, wherein if the detection object does not wear a protective device, the detection object is considered to be an abnormal object.
根据权利要求1所述的异常对象判断方法，其特征在于，所述防护装置包括口罩、面罩。The method for judging an abnormal object according to claim 1, wherein the protective device comprises a mask and a face mask.
根据权利要求1所述的异常对象判断方法，其特征在于，该方法还包括：The method for judging an abnormal object according to claim 1, wherein the method further comprises:

在检测对象配戴防护装置的情况下，获取检测对象的红外图像；In the case of the detection object wearing a protective device, obtain an infrared image of the detection object;

对所述可见光图像进行目标部位检测，得到目标部位位置；确定所述目标部位位置在检测对象的红外图像中的目标检测区域；Performing target part detection on the visible light image to obtain the target part position; determining the target detection area of the target part position in the infrared image of the detection object;

获取检测对象的目标检测区域的检测指标；Acquiring the detection index of the target detection area of the detection object;

根据所述目标检测区域的检测指标，判断检测对象是否为异常对象。According to the detection index of the target detection area, it is determined whether the detection object is an abnormal object.
根据权利要求4所述的异常对象判断方法，其特征在于，该方法还包括：所述检测指标为温度。The method for judging an abnormal object according to claim 4, wherein the method further comprises: the detection index is temperature.
根据权利要求1所述的异常对象判断方法，其特征在于，该方法还包括：The method for judging an abnormal object according to claim 1, wherein the method further comprises:

在检测对象配戴防护装置的情况下，获取检测对象的激光图像；Acquire a laser image of the test subject when the test subject is wearing a protective device;

对所述可见光图像进行目标部位检测，得到目标部位位置；确定所述目标部位位置在检测对象的激光图像中的目标检测区域；Performing target part detection on the visible light image to obtain a target part position; determining the target part position in the target detection area in the laser image of the detection object;

获取检测对象的目标检测区域的检测指标；Acquiring the detection index of the target detection area of the detection object;

根据所述目标检测区域的检测指标，判断检测对象是否为异常对象。According to the detection index of the target detection area, it is determined whether the detection object is an abnormal object.
根据权利要求6所述的异常对象判断方法，其特征在于，所述检测指标为血液核酸特征。The method for judging an abnormal object according to claim 6, wherein the detection index is a blood nucleic acid characteristic.
根据权利要求5或7所述的异常对象判断方法，其特征在于，所述目标部位包括人脸、手背、脖子、肩头，所述目标检测区域为人脸区域、手背区域、脖子区域、肩头区域。The method for judging an abnormal object according to claim 5 or 7, wherein the target part includes a face, back of the hand, neck, and shoulder, and the target detection area is a face area, back of hand area, neck area, and shoulder area.
根据权利要求8所述的异常对象判断方法，其特征在于，若所述目标检测区域为人脸区域，则当检测对象的人脸区域的温度超过温度阈值时，该检测对象为异常对象。The method for judging an abnormal object according to claim 8, wherein if the target detection area is a face area, when the temperature of the face area of the detection object exceeds a temperature threshold, the detection object is an abnormal object.
根据权利要求8所述的异常对象判断方法，其特征在于，当检测对象的血液核酸特征符合预设条件时，该检测对象为异常对象。The method for judging an abnormal object according to claim 8, wherein the detection object is an abnormal object when the blood nucleic acid characteristic of the detection object meets a preset condition.
根据权利要求1所述的异常对象判断方法，其特征在于，该方法还包括：The method for judging an abnormal object according to claim 1, wherein the method further comprises:

采用人脸识别技术或人体识别技术对所述异常对象进行追踪。Use face recognition technology or human body recognition technology to track the abnormal object.
根据权利要求1所述的异常对象判断方法，其特征在于，该方法还包括：The method for judging an abnormal object according to claim 1, wherein the method further comprises:

当检测到异常对象时，发出报警提示。When an abnormal object is detected, an alarm will be issued.
根据权利要求9所述的异常对象判断方法，其特征在于，该方法还包括：The method for judging an abnormal object according to claim 9, wherein the method further comprises:

基于检测对象与图像采集装置的距离对所述人脸区域的温度进行补偿。The temperature of the face area is compensated based on the distance between the detection object and the image acquisition device.
根据权利要求9所述的异常对象判断方法，其特征在于，该方法还包括：The method for judging an abnormal object according to claim 9, wherein the method further comprises:

获取环境温度；Get the ambient temperature;

根据所述环境温度对所述目标检测区域的温度进行补偿。The temperature of the target detection area is compensated according to the ambient temperature.
根据权利要求9所述的异常对象判断方法，其特征在于，该方法还包括：The method for judging an abnormal object according to claim 9, wherein the method further comprises:

获取检测对象的年龄属性；Obtain the age attribute of the detected object;

根据不同的年龄属性设定与不同年龄段对应的温度阈值。Set temperature thresholds corresponding to different age groups according to different age attributes.
根据权利要求4所述的异常对象判断方法，其特征在于，确定目标部位位置在检测对象的红外图像中的目标检测区域，包括：The method for judging an abnormal object according to claim 4, wherein determining the target detection area in the infrared image of the detection object comprises:

将所述可见光图像中的目标部位位置映射到所述检测对象的红外图像中，以得到该检测对象的红外图像中的人脸区域。The target position in the visible light image is mapped to the infrared image of the detection object to obtain the human face area in the infrared image of the detection object.
根据权利要求6所述的异常对象判断方法，其特征在于，确定目标部位位置在检测对象的激光图像中的目标检测区域，包括：The method for judging an abnormal object according to claim 6, wherein the determining the target detection area in the laser image of the detection target comprises:

将所述可见光图像中的目标部位位置映射到所述检测对象的激光图像中，以得到该检测对象的激光图像中的人脸区域。The target position in the visible light image is mapped to the laser image of the detection object to obtain the human face area in the laser image of the detection object.
一种异常对象判断***，其特征在于，包括：An abnormal object judging system, which is characterized in that it comprises:

可见光图像获取模块，用于获取检测对象的可见光图像；The visible light image acquisition module is used to acquire the visible light image of the detection object;

行为检测模块，用于基于所述可见光图像判断所述检测对象是否配戴防护装置；A behavior detection module, configured to determine whether the detection object is wearing a protective device based on the visible light image;

第一异常对象判断模块，用于根据所述检测对象是否配戴防护装置，判断检测对象是否为异常对象。The first abnormal object judgment module is used for judging whether the detection object is an abnormal object according to whether the detection object wears a protective device.
根据权利要求18所述的异常对象判断***，其特征在于，若检测对象没有配戴防护装置，则认为该检测对象为异常对象。The abnormal object judging system according to claim 18, wherein if the detected object does not wear a protective device, the detected object is considered to be an abnormal object.
根据权利要求18所述的异常对象判断***，其特征在于，所述防护装置包括口罩、面罩。The abnormal object judgment system according to claim 18, wherein the protective device comprises a mask and a face mask.
根据权利要求18所述的异常对象判断***，其特征在于，该***还包括：The abnormal object judgment system according to claim 18, wherein the system further comprises:

红外图像获取模块，用于在检测对象配戴防护装置的情况下获取检测对象的红外图像；The infrared image acquisition module is used to acquire the infrared image of the inspection object when the inspection object is wearing a protective device;

第一目标检测模块，用于对所述可见光图像进行目标部位检测，得到目标部位位置；The first target detection module is configured to perform target part detection on the visible light image to obtain the target part position;

第一目标区域确定模块，用于确定所述目标部位位置在检测对象的红外图像中的目标检测区域；The first target area determination module is used to determine the target detection area in the infrared image of the detection object where the position of the target part is;

第一检测指标获取模块，用于获取检测对象的目标检测区域的检测指标；The first detection index acquisition module is used to acquire the detection index of the target detection area of the detection object;

第二异常对象判断模块，用于根据所述目标检测区域的检测指标，判断检测对象是否为异常对象。The second abnormal object judgment module is used for judging whether the detection object is an abnormal object according to the detection index of the target detection area.
根据权利要求21所述的异常对象判断***，其特征在于，所述检测指标为温度。The abnormal object judging system according to claim 21, wherein the detection index is temperature.
根据权利要求18所述的异常对象判断***，其特征在于，该***还包括：The abnormal object judgment system according to claim 18, wherein the system further comprises:

激光图像获取模块，用于在检测对象配戴防护装置的情况下，获取检测对象的激光图像；The laser image acquisition module is used to acquire the laser image of the detection object when the detection object is wearing a protective device;

第二目标检测模块，用于对所述可见光图像进行目标部位检测，得到目标部位位置；The second target detection module is used to detect the target part of the visible light image to obtain the position of the target part;

第二目标区域确定模块，用于确定所述目标部位位置在检测对象的激光图像中的目标检测区域；The second target area determining module is used to determine the target detection area in the laser image of the detection object where the position of the target part is;

第二检测指标获取模块，用于获取检测对象的目标检测区域的检测指标；The second detection index acquisition module is used to acquire the detection index of the target detection area of the detection object;

第三异常对象判断模块，用于根据所述目标检测区域的检测指标，判断检测对象是否为异常对象。The third abnormal object judgment module is used for judging whether the detection object is an abnormal object according to the detection index of the target detection area.
根据权利要求23所述的异常对象判断***，其特征在于，所述检测指标为血液核酸特征。The abnormal object judgment system according to claim 23, wherein the detection index is a blood nucleic acid characteristic.
根据权利要求22或24所述的异常对象判断***，其特征在于，所述目标部位包括人脸、手背、脖子、肩头，所述目标检测区域为人脸区域、手背区域、脖子区域、肩头区域。The abnormal object judgment system according to claim 22 or 24, wherein the target part includes a face, the back of the hand, a neck, and a shoulder, and the target detection area is a face area, the back of the hand area, a neck area, and a shoulder area.
根据权利要求25所述的异常对象判断***，其特征在于，若所述目标检测区域为人脸区域，则当检测对象的人脸区域的温度超过温度阈值时，该检测对象为异常对象。The abnormal object judging system according to claim 25, wherein if the target detection area is a face area, when the temperature of the face area of the detection object exceeds a temperature threshold, the detection object is an abnormal object.
根据权利要求25所述的异常对象判断***，其特征在于，当检测对象的血液核酸特征符合预设条件时，该检测对象为异常对象。The abnormal object judgment system according to claim 25, wherein the detection object is an abnormal object when the blood nucleic acid characteristic of the detection object meets a preset condition.
根据权利要求18所述的异常对象判断***，其特征在于，该***还包括：The abnormal object judgment system according to claim 18, wherein the system further comprises:

追踪模块，用于采用人脸识别技术或人体识别技术对所述异常对象进行追踪。The tracking module is used to track the abnormal object using face recognition technology or human body recognition technology.
根据权利要求18所述的异常对象判断***，其特征在于，该***还包括：The abnormal object judgment system according to claim 18, wherein the system further comprises:

报警提示模块，用于当检测到异常对象时，发出报警提示。The alarm prompt module is used to send out an alarm prompt when an abnormal object is detected.
根据权利要求26所述的异常对象判断***，其特征在于，该***还包括：The abnormal object judgment system according to claim 26, wherein the system further comprises:

第一温度补偿模块，基于检测对象与图像采集装置的距离对所述人脸区域的温度进行补偿。The first temperature compensation module compensates the temperature of the face area based on the distance between the detection object and the image acquisition device.
根据权利要求26所述的异常对象判断***，其特征在于，该***还包括：The abnormal object judgment system according to claim 26, wherein the system further comprises:

温度获取模块，用于获取环境温度；The temperature acquisition module is used to acquire the ambient temperature;

第二温度补偿模块，用于根据所述环境温度对所述目标检测区域的温度进行补偿。The second temperature compensation module is used to compensate the temperature of the target detection area according to the ambient temperature.
根据权利要求26所述的异常对象判断***，其特征在于，该***还包括：The abnormal object judgment system according to claim 26, wherein the system further comprises:

年龄属性获取模块，用于获取检测对象的年龄属性；The age attribute acquisition module is used to acquire the age attribute of the detected object;

温度阈值设定模块，用于根据不同的年龄属性设定与不同年龄段对应的温度阈值。The temperature threshold setting module is used to set temperature thresholds corresponding to different age groups according to different age attributes.
根据权利要求21所述的异常对象判断***，其特征在于，所述确定目标部位位置在检测对象的红外图像中的目标检测区域，包括：The abnormal object judging system according to claim 21, wherein the determining the target detection area in the infrared image of the detection object comprises:

将所述可见光图像中的目标部位位置映射到所述检测对象的红外图像中，以得到该检测对象的红外图像中的目标检测区域。The target position in the visible light image is mapped to the infrared image of the detection object to obtain the target detection area in the infrared image of the detection object.
根据权利要求23所述的异常对象判断***，其特征在于，所述确定目标部位位置在检测对象的激光图像中的目标检测区域，包括：The abnormal object judging system according to claim 23, wherein the determining the target detection area in the laser image of the detection target comprises:

将所述可见光图像中的目标部位位置映射到所述检测对象的激光图像中，以得到该检测对象的激光图像中的目标检测区域。The target position in the visible light image is mapped to the laser image of the detection object to obtain the target detection area in the laser image of the detection object.
一种设备，其特征在于，包括：A device, characterized in that it comprises:

一个或多个处理器；和One or more processors; and

其上存储有指令的一个或多个机器可读介质，当所述一个或多个处理器执行时，使得所述设备执行如权利要求1-17所述的一个或多个所述的方法。One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, cause the device to execute one or more of the methods according to claims 1-17.
一个或多个机器可读介质，其特征在于，其上存储有指令，当由一个或多个处理器执行时，使得设备执行如权利要求1-17所述的一个或多个所述的方法。One or more machine-readable media, characterized in that instructions are stored thereon, which when executed by one or more processors, cause the device to execute one or more of the methods described in claims 1-17 .