WO2020258720A1 - 图像采集设备遮挡状态检测方法、装置、设备和存储介质 - Google Patents
图像采集设备遮挡状态检测方法、装置、设备和存储介质 Download PDFInfo
- Publication number
- WO2020258720A1 WO2020258720A1 PCT/CN2019/122213 CN2019122213W WO2020258720A1 WO 2020258720 A1 WO2020258720 A1 WO 2020258720A1 CN 2019122213 W CN2019122213 W CN 2019122213W WO 2020258720 A1 WO2020258720 A1 WO 2020258720A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- area
- equal
- collected
- brightness threshold
- Prior art date
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 34
- 230000000903 blocking effect Effects 0.000 title claims abstract description 12
- 238000000034 method Methods 0.000 claims abstract description 68
- 230000004044 response Effects 0.000 claims description 27
- 238000004590 computer program Methods 0.000 claims description 21
- 230000015654 memory Effects 0.000 claims description 14
- 230000001815 facial effect Effects 0.000 description 15
- 238000005516 engineering process Methods 0.000 description 9
- 238000012544 monitoring process Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 230000011218 segmentation Effects 0.000 description 4
- 230000006399 behavior Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000013135 deep learning Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 208000036828 Device occlusion Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/28—Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/162—Detection; Localisation; Normalisation using pixel segmentation or colour matching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
- H04N23/811—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/40—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the details of the power supply or the coupling to vehicle components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30168—Image quality inspection
Definitions
- the present disclosure relates to the field of driving monitoring, and in particular, to a method, device, electronic device, and computer storage medium for detecting the occlusion state of an image acquisition device.
- cameras are widely used in various scenarios, such as security monitoring, image acquisition, and monitoring of fatigue driving and dangerous driving behaviors.
- security monitoring image acquisition
- monitoring of fatigue driving and dangerous driving behaviors.
- the camera is blocked, it cannot be taken because A meaningful image results in the deployment of cameras meaningless.
- the embodiments of the present disclosure are expected to provide a technical solution for detecting the occlusion state of an image acquisition device.
- the embodiment of the present disclosure provides a method for detecting the occlusion state of an image acquisition device, the method including:
- the captured image it is determined whether the image capturing device is in a blocked state.
- the determining whether the image capturing device is in a blocked state according to the captured image includes:
- the first brightness threshold is less than the second brightness threshold.
- the determining whether the image capturing device is in a blocked state according to the captured image further includes:
- the average brightness of the collected image is greater than or equal to a first brightness threshold and less than or equal to a second brightness threshold, and the first brightness threshold is less than the second brightness threshold;
- the image capture device In response to the duration of the ratio of the foreground area to the effective area of the captured image being greater than the set value greater than or equal to the third set duration, it is determined that the image capture device is in a blocked state; wherein, the foreground area represents The area of the foreground part of the image identified in the collected image; the effective area is preset, and the effective area is less than or equal to the area of the collected image.
- the determining whether the image capturing device is in a blocked state according to the captured image further includes:
- the average brightness of the collected image is greater than or equal to a first brightness threshold and less than or equal to a second brightness threshold, and the first brightness threshold is less than the second brightness threshold;
- the ratio of the foreground area of the collected image to the effective area is less than or equal to a set value; wherein, the foreground area represents the area of the foreground part of the image identified in the collected image; the effective The area is preset, and the effective area is less than or equal to the area of the collected image;
- the image capture device In response to the number of contours in the captured image being less than the set number and the duration is greater than or equal to the fourth set time period, it is determined that the image capture device is in a blocked state; wherein, the number of contours is passed to the The number of target contours obtained by contour detection on the collected images.
- the determining whether the image capturing device is in a blocked state according to the captured image further includes:
- the average brightness of the collected image is greater than or equal to a first brightness threshold and less than or equal to a second brightness threshold, and the first brightness threshold is less than the second brightness threshold;
- the ratio of the foreground area of the collected image to the effective area is less than or equal to a set value; wherein, the foreground area represents the area of the foreground part of the image identified in the collected image; the effective The area is preset, and the effective area is less than or equal to the area of the collected image;
- the number of contours is the number of target contours obtained by performing contour detection on the collected image.
- the effective area of the captured image is preset according to the relative position of the image capture device and the fill light, and the fill light is used to fill the area where the image capture device performs image capture. Light.
- the method further includes:
- the method further includes:
- the image acquisition device is a vehicle-mounted image acquisition device, and the vehicle-mounted image acquisition device is installed on a vehicle and is used to acquire at least an image of a driving position area of the vehicle;
- Obtain the images collected by the image acquisition device including:
- that the vehicle is in the starting state includes that the traveling speed of the vehicle is greater than a set speed.
- the image acquisition device is an infrared camera.
- the embodiment of the present disclosure also proposes a device for detecting the occlusion state of an image acquisition device.
- the device includes an acquisition module and a first processing module, wherein:
- the acquisition module is configured to acquire the image collected by the image acquisition device
- the first processing module is configured to determine whether the image capture device is in a blocked state according to the captured image.
- the configuration of the first processing module to determine whether the image capture device is in a blocked state according to the captured image includes:
- the duration is greater than or equal to the second set duration or the duration greater than the second brightness threshold is greater than or Equal to the second set time period, it is determined that the image acquisition device is in a blocked state; wherein, the first brightness threshold is less than the second brightness threshold.
- the first processing module is configured to determine whether the image capture device is in a blocked state according to the captured image, and further includes:
- the average brightness of the collected image is greater than or equal to a first brightness threshold and less than or equal to a second brightness threshold, and the first brightness threshold is less than the second brightness threshold;
- the image capture device In response to the duration of the ratio of the foreground area to the effective area of the captured image being greater than the set value greater than or equal to the third set duration, it is determined that the image capture device is in a blocked state; wherein, the foreground area represents The area of the foreground part of the image identified in the collected image; the effective area is preset, and the effective area is less than or equal to the area of the collected image.
- the first processing module is configured to determine whether the image capture device is in a blocked state according to the captured image, and further includes:
- the average brightness of the collected image is greater than or equal to a first brightness threshold and less than or equal to a second brightness threshold, and the first brightness threshold is less than the second brightness threshold;
- the ratio of the foreground area of the collected image to the effective area is less than or equal to a set value; wherein, the foreground area represents the area of the foreground part of the image identified in the collected image; the effective The area is preset, and the effective area is less than or equal to the area of the collected image;
- the image capture device In response to the number of contours in the captured image being less than the set number and the duration is greater than or equal to the fourth set time period, it is determined that the image capture device is in a blocked state; wherein, the number of contours is passed to the The number of target contours obtained by contour detection on the collected images.
- the first processing module is configured to determine whether the image capture device is in a blocked state according to the captured image, and further includes:
- the average brightness of the collected image is greater than or equal to a first brightness threshold and less than or equal to a second brightness threshold, and the first brightness threshold is less than the second brightness threshold;
- the ratio of the foreground area of the collected image to the effective area is less than or equal to a set value; wherein, the foreground area represents the area of the foreground part of the image identified in the collected image; the effective The area is preset, and the effective area is less than or equal to the area of the collected image;
- the number of contours is the number of target contours obtained by performing contour detection on the collected image.
- the effective area of the captured image is preset according to the relative position of the image capture device and the fill light, and the fill light is used to fill the area where the image capture device performs image capture. Light.
- the first processing module is further configured to, in a case in which it is determined that the image acquisition device is in the blocked state, in response to the time period during which the image capture device is continuously in the blocked state greater than a fifth set time period, Issue a warning message.
- the first processing module is further configured to stop issuing the alarm information after the alarm information is issued and after it is determined that the image acquisition device is in an unobstructed state.
- the image acquisition device is a vehicle-mounted image acquisition device, which is installed on a vehicle and is used to acquire at least an image of a driving position area of the vehicle;
- the acquisition module is configured to acquire an image collected by the vehicle-mounted image acquisition device when the vehicle is in a starting state.
- that the vehicle is in the starting state includes that the traveling speed of the vehicle is greater than a set speed.
- the image acquisition device is an infrared camera.
- the embodiment of the present disclosure also provides an electronic device including a processor and a memory configured to store a computer program that can run on the processor; wherein,
- the processor When the processor is configured to run the computer program, it executes any one of the aforementioned methods for detecting the occlusion state of an image acquisition device.
- the embodiment of the present disclosure also proposes a computer storage medium on which a computer program is stored, and when the computer program is executed by a processor, any one of the aforementioned methods for detecting the blocking state of an image acquisition device is implemented.
- the embodiment of the present disclosure also proposes a computer program product, wherein the computer program product includes computer executable instructions. After the computer executable instructions are executed, they can realize the shielding of any image acquisition device provided by the embodiments of the present disclosure. State detection method.
- the image captured by the image capturing device is acquired; according to the captured image, it is determined whether the image capturing device is in a blocked state .
- it can be determined whether the image collection device is blocked or not based on the image collected by the image collection device, which has the feature of facilitating the realization of the blocking judgment, so that it can be found in time whether the image collection device is blocked, so as to determine the collection Whether the use value of the image is convenient for the application of the collected image in a specific scene.
- FIG. 1 is a flowchart of a method for detecting a blocking state of an image capture device according to an embodiment of the disclosure
- FIG. 2 is a flowchart of a method for detecting the occlusion state of a vehicle-mounted image acquisition device according to an embodiment of the disclosure
- FIG. 3 is a schematic diagram of the composition structure of a device for detecting a blocking state of an image acquisition device according to an embodiment of the disclosure
- FIG. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure.
- the terms "including”, “including” or any other variations thereof are intended to cover non-exclusive inclusion, so that a method or device including a series of elements not only includes what is clearly stated Elements, but also include other elements not explicitly listed, or elements inherent to the implementation of the method or device. Without more restrictions, the element defined by the sentence “including a" does not exclude the existence of other related elements (such as steps or steps in the method) in the method or device that includes the element.
- the unit in the device for example, the unit may be part of a circuit, part of a processor, part of a program or software, etc.).
- the method for detecting the occlusion state of an image capture device provided by the embodiment of the present disclosure includes a series of steps, but the method for detecting the occlusion state of an image capture device provided by the embodiment of the present disclosure is not limited to the recorded steps.
- the embodiment of the present disclosure The provided device for detecting the occlusion state of the image acquisition equipment includes a series of modules, but the device provided by the embodiments of the present disclosure is not limited to including the explicitly recorded modules, and may also include settings that need to be set for obtaining relevant information or processing based on information. Module.
- the embodiments of the present disclosure can be applied to a terminal and can operate with many other general-purpose or special-purpose computing system environments or configurations.
- the terminal may be a vehicle-mounted terminal, a thin client, a thick client, a handheld or laptop device, a microprocessor-based system, a set-top box, a programmable consumer electronic product, a network personal computer, a small computer system, etc.
- Electronic devices such as terminals can be described in the general context of computer system executable instructions (such as program modules) executed by a computer system.
- program modules may include routines, programs, object programs, components, logic, data structures, etc., which perform specific tasks or implement specific abstract data types.
- the computer system/server can be implemented in a distributed cloud computing environment. In the distributed cloud computing environment, tasks are executed by remote processing equipment linked through a communication network.
- program modules may be located on a storage medium of a local or remote computing system including a storage device.
- FIG. 1 is a flowchart of a method for detecting the occlusion state of an image acquisition device according to an embodiment of the disclosure. As shown in FIG. 1, the process may include:
- Step 101 Obtain an image collected by an image collecting device.
- the image acquisition device may be a camera.
- the image acquisition device may be an infrared camera, so that image data may be collected at night or in other dark conditions.
- Step 102 Determine whether the image capture device is in a blocked state according to the captured image.
- the image capture device is blocked means that an opaque material is used to block more than 75% of the field of view of the image capture device.
- the feature information of the collected image may include at least one of the following: average brightness, the ratio of the foreground area to the effective area, and the number of image contours; here, the average brightness of the image represents the average brightness of the entire image, and the The foreground area represents the area of the foreground part of the image recognized in the captured image; the effective area of the image is preset, and the effective area of the image is less than or equal to the area of the captured image; The number of target contours obtained from the collected images for target recognition.
- the dynamic threshold segmentation method can be used to achieve the separation of the foreground and background parts of the image;
- the process of separating the foreground part and the background part specifically, different gray thresholds can be set for different areas of the image. For the pixels in the image, by comparing the gray value of the pixel with the corresponding gray threshold, It can be determined whether the pixel point belongs to the front scenic spot or the background point, and then the foreground part and background part of the image can be determined.
- the contour detection method can be used to perform target detection and recognition on the image to obtain the contour of the target, and further, the number of contours of the target can be determined; in the embodiment of the present disclosure, the contour detection method is not limited.
- the effective area of the captured image may be preset according to the relative position of the image capture device and the fill light, and the fill light is used to fill the area where the image capture device performs image capture.
- the fill light is an infrared fill light.
- the effective area of the image may be the area of the entire captured image;
- the supplementary light is mainly distributed in the center of the collected image frame, the effective area can be determined as the area of a circle whose diameter is the short side of the collected image frame.
- the image acquisition device can send the collected images to the processor and other devices for further processing; the image acquisition device can collect images in real time to obtain multiple images continuously collected
- the image capture device can capture images every N seconds, and N can be preset.
- steps 101 to 102 can be implemented based on the processor in the occlusion state detection device of the image acquisition device.
- the processor can be an application specific integrated circuit (ASIC) or a digital signal processor (Digital Signal Processor). Signal Processor, DSP), Digital Signal Processing Device (DSPD), Programmable Logic Device (PLD), Field Programmable Gate Array (FPGA), Central Processing Unit (Central) At least one of a Processing Unit (CPU), a controller, a microcontroller, and a microprocessor.
- ASIC application specific integrated circuit
- DSP Digital Signal Processor
- DSPD Digital Signal Processing Device
- PLD Programmable Logic Device
- FPGA Field Programmable Gate Array
- Central Processing Unit Central Processing Unit
- CPU Processing Unit
- controller a controller
- microcontroller a microcontroller
- the image acquisition device it is possible to determine whether the image acquisition device is occluded according to the image collected by the image acquisition device, which has the feature of facilitating the realization of occlusion judgment, so that it can be found in time whether the image acquisition device is occluded, so as to determine the acquisition. Whether the use value of the image is convenient for the application of the collected image in a specific scene.
- face recognition technology can be used to extract face images in the collected images; embodiments of the present disclosure do not limit the types of face recognition technologies, for example, a face recognition technology based on deep learning can be used.
- the average brightness of the captured image can be determined according to the captured image; the average brightness of the captured image When the duration of brightness less than the first brightness threshold is greater than or equal to the second set duration, or the average brightness of the captured image is greater than the duration of the second brightness threshold greater than or equal to the second set duration, the image capture can be determined
- the device is in a blocked state; here, the first brightness threshold is less than the second brightness threshold.
- the ratio of the foreground area to the effective area of the collected image can be determined; If the ratio of the foreground area to the effective area of the image is greater than the set value and the duration is greater than or equal to the third set time period, it can be determined that the image capture device is in a blocked state.
- the defined occlusion area foreground area
- the image capture device such as an infrared camera
- the number of contours in the captured image can be determined; when the number of contours in the captured image is less than the set number and the duration is greater than or equal to the fourth set duration, it can be determined that the image capture device is in Blocked state; in the case that the number of contours in the captured image is greater than or equal to the set number, it can be determined that the image capture device is in an unblocked state.
- the first brightness threshold, the second brightness threshold, the set value, and the set number can all be preset according to actual application scenarios.
- the value range of the set value can be 65% to 85%.
- the value range of a certain number can be from 8 to 12;
- the second set time, the third set time, and the fourth set time can all be preset according to the actual application scenario.
- the second set time, the third set time and The fourth set duration may be the same or different between the two.
- the value ranges of the second set duration, the third set duration, and the fourth set duration are all 4 seconds to 7 seconds.
- the fifth set duration may be preset according to actual application scenarios; the fifth set duration and the first set duration may be the same or different.
- the fifth set duration may be 5 seconds.
- the form of alarm information includes but is not limited to: sound alarm information, light-emitting alarm information, vibration alarm information, etc.
- the alarm information can be stopped; in this way, it is possible to flexibly decide whether to send the alarm information according to whether the image acquisition device is obstructed, which is more in line with actual needs .
- the alarm information can be saved locally for subsequent query; after the alarm information is issued, the alarm information can also be uploaded to the cloud to facilitate notification of remote monitoring personnel.
- the image acquisition device is an infrared camera
- the characteristics of the infrared camera need to be considered. If the infrared fill light is completely blocked by tape, etc., the foreground area may not be greater than 75% at this time.
- Brightness judges whether the infrared camera is blocked for example, judges whether the average brightness of the image is less than the first brightness threshold, if the average brightness of the image is less than the first brightness threshold or greater than the second brightness threshold, start timing, if the duration reaches 5 seconds, It is considered that there is a situation where the infrared camera is blocked; if the average brightness of the image is greater than or equal to the first brightness threshold and less than or equal to the second brightness threshold, start to segment the foreground and background of the image according to the dynamic threshold segmentation method, if the foreground area is greater than the effective If the area is 75% of the area, the timer starts.
- the duration reaches 5 seconds, it is considered that the infrared camera is blocked; if the foreground area is not greater than 75% of the effective area, the number of contours of the image is obtained through contour detection. If there are less than 10 and the duration reaches 5 seconds, it is considered that the infrared camera is blocked; if the number of contours is not less than 10, it can be considered that the infrared camera is not blocked.
- an alarm message may be issued.
- the alarm message may be a voice alarm of "Do not block the camera".
- the image capture device may be a vehicle-mounted image capture device, a home image capture device, etc.
- the following takes the image capture device as a vehicle-mounted image capture device as an example to illustrate the implementation of the method for detecting the blocking state of the image capture device.
- FIG. 2 is a flowchart of a method for detecting the occlusion state of a vehicle-mounted image acquisition device according to an embodiment of the disclosure. As shown in FIG. 2, the process may include:
- Step 201 Acquire an image collected by the vehicle-mounted image collection device when the vehicle is in the starting state.
- the on-vehicle image acquisition device may be a camera.
- the on-vehicle image acquisition device may be an infrared camera, which can then collect in-vehicle image data at night or in other dark conditions.
- the vehicle-mounted image acquisition device can be installed toward the driving position area, so that images of the person in the driving position can be captured when there are people in the driving position.
- the starting state of the vehicle refers to the state when the vehicle is ignited and before the vehicle is turned off.
- the vehicle when the vehicle is in the starting state, it includes that the driving speed of the vehicle is greater than the set speed.
- the set speed can be set according to actual requirements.
- the set speed can be 1 km/h or other speed values.
- Step 202 Determine whether the vehicle-mounted image capture device is in a blocked state according to the captured image.
- the occlusion of the vehicle-mounted image capture device refers to the use of opaque materials to block more than 75% of the field of view of the vehicle-mounted image capture device.
- the feature information of the collected image may include at least one of the following: average brightness, the ratio of the foreground area to the effective area, and the number of image contours; here, the average brightness of the image represents the average brightness of the entire image, and the The foreground area represents the area of the foreground part of the image recognized in the captured image; the effective area of the image is preset, and the effective area of the image is less than or equal to the area of the captured image; The number of target contours obtained from the collected images for target recognition.
- the dynamic threshold segmentation method can be used to achieve the separation of the foreground and background parts of the image;
- the process of separating the foreground part and the background part specifically, different gray thresholds can be set for different areas of the image. For the pixels in the image, by comparing the gray value of the pixel with the corresponding gray threshold, It can be determined whether the pixel point belongs to the front scenic spot or the background point, and then the foreground part and background part of the image can be determined.
- the contour detection method can be used to detect and recognize the image of the target to obtain the contour of the target, and then the number of contours of the target can be determined; for example, after contour detection is performed on the image, the car seat and human body can be obtained. Waiting for 5 target contours, the number of image contours is 5.
- the contour detection method is not limited.
- the effective area of the captured image may be preset according to the relative position of the vehicle-mounted image acquisition device and the fill light, and the fill light is used to fill the area where the vehicle image capture device performs image capture.
- the fill light is an infrared fill light.
- the effective area of the image may be the area of the entire captured image;
- the supplementary light is mainly distributed in the center of the collected image frame, the effective area can be determined as the area of a circle whose diameter is the size of the short side of the collected image frame.
- the vehicle-mounted image acquisition device can send the collected images to the processor and other devices for further processing; the vehicle-mounted image acquisition device can collect images in real time to obtain continuous acquisition
- a vehicle-mounted image capture device can capture images every N seconds, and N can be preset.
- step 201 to step 202 can be implemented based on the processor in the vehicle-mounted image acquisition device occlusion state detection device, etc.
- the aforementioned processor can be ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, etc. , At least one of the microprocessors. It is understandable that, for different vehicle-mounted image acquisition equipment occlusion state detection devices, the electronic device for realizing the above-mentioned processor function may also be other, which is not specifically limited in the embodiment of the present disclosure.
- the vehicle-mounted image acquisition device it is possible to directly determine whether the vehicle-mounted image acquisition device is blocked based on the image collected by the vehicle-mounted image acquisition device when the vehicle is in the starting state, which is easy to implement. Further, it is convenient to determine the driving according to the result of the blocking judgment Behavior, for example, when it is determined that the vehicle-mounted image collection device is not blocked, the driving behavior can be detected based on the collected image, which is beneficial to improve driving safety.
- the face image may be extracted from the image collected by the vehicle-mounted image acquisition device when the vehicle is in the starting state; the vehicle-mounted image acquisition device is installed on the vehicle and is used to acquire at least the image of the driving position area of the vehicle.
- face recognition technology can be used to extract face images in the collected images; embodiments of the present disclosure do not limit the types of face recognition technologies, for example, a face recognition technology based on deep learning can be used.
- the departure of the driver from the post indicates the preset state that the driver is not in the driving position or the state where no one is in the driving position; when no facial image is extracted from the collected images, the driving can be directly determined There is no one in the location, so it can be determined that the driver is leaving the post.
- driver monitoring system Due to the actual use of the driver monitoring system, some drivers will be monitored due to dislike, and some objects such as clothes, paper cups and tape will be used to cover the monitoring camera, resulting in the failure of the monitoring system and the inability to achieve the driver’s on-the-job Accurately judge the status.
- the vehicle-mounted image acquisition device contains a face image after it is determined that the vehicle-mounted image acquisition device is not blocked, to determine the driver’s on-the-job status;
- the impact of equipment on the detection of the driver's on-the-job status can improve the accuracy and reliability of the driver's on-the-job status detection.
- the face image when the face image is extracted from the collected image, it can be determined whether the feature of the face image extracted from the image matches the feature of the driver's face image stored in advance; If the feature of the face image extracted from the image does not match the feature of the driver’s face image stored in advance, it can be determined that the driver is leaving the post.
- the driver in response to a situation where the feature of the facial image extracted from the collected image matches the feature of the facial image of the driver stored in advance, it may be determined that the driver is on duty.
- the driver registration method can be used to realize the pre-storage of the driver's face image.
- the following steps can be used to pre-store the driver's face image: after successful authentication on the mobile terminal, upload the driver's face image to the cloud server through the mobile terminal and save it in the cloud server; After the face image of the driver related to the vehicle stored in the cloud server is updated, after the vehicle establishes a connection with the cloud server, the cloud server sends the vehicle related information to the vehicle , The updated face image of the driver.
- the driver registration can be performed on the cloud server through an application (APPlication, APP) installed on the mobile terminal, and the face image of the driver can be uploaded to the cloud server through the mobile terminal when the driver registration is performed through the mobile terminal; here , You can register the driver on the cloud server when the vehicle is not started; you can also register the driver on the cloud server when the vehicle is already started and not driving.
- APP application
- the following steps pre-store the driver's facial image: when the vehicle is in a started and not driving state, after the authentication is successful, the driver's facial image is collected and saved by the on-board image acquisition device.
- the embodiments of the present disclosure it is possible to realize accurate detection of whether the driver is off or on duty by judging whether the face image in the collected image matches the face image of the driver stored in advance.
- the unsafe or unsafe driving of the vehicle caused by only detecting whether there are people in the driving position when irrelevant or unqualified persons appear in the driving position is avoided.
- the embodiment of the present disclosure can obtain the face image of the driver on duty in advance, and then determine whether the face image of the driver on duty matches the currently extracted facial image and the pre-stored facial image of the driver on duty.
- the on-the-job status further improves driving safety.
- the face image in the image collected above may include one face image or multiple face images; when the face images in the collected image are multiple face images, the above-mentioned collected For each face image in the image, you can determine the image area where each face image is located; for example, a face image in the captured image can be in the driving position area of the captured image, or it can be in the captured image.
- the non-driving position area of the image; the driving position area of the image can be preset, for example, the driving position area of the image can be the left half of the image.
- the facial image in the driving position area of the captured image can be selected from the multiple facial images; response In the case that the feature of the selected face image does not match the feature of the driver's face image stored in advance, it is determined that the driver leaves the post.
- the driver is on duty in response to the situation that the feature of the selected face image matches the feature of the face image of the driver stored in advance.
- the feature matching judgment of the subsequent face image can be performed for the face image selected in the driving position area of the image, and then it can be determined whether the person currently present in the driving position area is the responder.
- On-the-job drivers further improve the accuracy of the driver’s on-the-job status detection.
- the duration of the driver’s continuous departure can be determined according to the acquisition time of multiple frames of images; for example, for multiple frames of images acquired within 1 minute, if the judgment results are all mismatches, then the driver can be determined to be continuous
- the length of leaving the job is at least 1 minute.
- the driver's continuous off-duty duration exceeds the first set duration.
- the driver's continuous off-duty duration exceeds the first set duration (ie greater than or equal to the first set duration)
- the first Warning information when the duration of the driver's continuous departure does not exceed the first set duration, the duration of the driver's continuous departure can be continued.
- the first set duration may be preset according to actual application scenarios, for example, the first set duration may be 2 seconds.
- the form of the first alarm information includes but is not limited to: sound alarm information, light-emitting alarm information, vibration alarm information, etc.
- the first warning message can be stopped; in this way, the first warning message can be flexibly processed according to the change of the driver's on-post status, which is more realistic demand.
- the first alarm information can be saved locally for subsequent query; after the first alarm information is issued, the first alarm information can also be uploaded to the cloud to facilitate notification of remote monitoring personnel.
- the images collected by the on-board image collection device when the driver is off duty can also be saved locally or uploaded to the cloud for subsequent analysis.
- the average brightness of the acquired image may be determined according to the acquired image; When the average brightness of the captured image is less than the first brightness threshold and the duration is greater than or equal to the second set duration, or the average brightness of the captured image is greater than the second brightness threshold and the duration is greater than or equal to the second set duration In this case, it can be determined that the vehicle-mounted image acquisition device is in a blocked state; here, the first brightness threshold is smaller than the second brightness threshold.
- the ratio of the foreground area to the effective area of the collected image can be determined; If the ratio of the foreground area to the effective area of the image is greater than the set value and the duration is greater than or equal to the third set period, it can be determined that the vehicle-mounted image capture device is in a blocked state.
- a vehicle-mounted image acquisition device such as an infrared camera
- the average brightness of the collected image is greater than or equal to the first brightness threshold and less than or equal to the second brightness threshold, and it is determined that the ratio of the foreground area to the effective area of the collected image is less than or equal to a set
- the number of contours in the captured image can be determined; when the number of contours in the captured image is less than the set number and the duration is greater than or equal to the fourth set period, the vehicle-mounted image capture device can be determined In the blocked state; in the case that the number of contours in the captured image is greater than or equal to the set number, it can be determined that the vehicle-mounted image capture device is in the unblocked state.
- the first brightness threshold, the second brightness threshold, the set value, and the set number can all be preset according to actual application scenarios.
- the value range of the set value can be 65% to 85%.
- the value range of a certain number can be from 8 to 12;
- the second set time, the third set time, and the fourth set time can all be preset according to the actual application scenario.
- the second set time, the third set time and The fourth set duration may be the same or different between the two.
- the value ranges of the second set duration, the third set duration, and the fourth set duration are all 4 seconds to 7 seconds.
- the vehicle-mounted image capture device start timing, and obtain the duration of the vehicle-mounted image capture device being blocked; and determine whether the duration of the vehicle-mounted image capture device being blocked exceeds the fifth set duration (ie Greater than or equal to the fifth set duration), when the duration of the on-board image acquisition device being blocked exceeds the fifth set duration, the second warning message can be issued; the duration of the on-board image capture device being blocked does not exceed the first In the case of setting the duration, you can continue to count to continue to obtain the duration of the vehicle-mounted image capture device being blocked.
- the fifth set duration may be preset according to actual application scenarios; the fifth set duration and the first set duration may be the same or different.
- the fifth set duration may be 5 seconds.
- the form of the second alarm information includes but is not limited to: sound alarm information, light-emitting alarm information, vibration alarm information, etc.
- the second alarm information can be stopped; in this way, it is possible to flexibly determine whether to issue the second alarm information according to whether the vehicle-mounted image acquisition device is blocked or not. Warning letter, which is more in line with actual needs.
- the second alarm information can be saved locally for subsequent query; after the second alarm information is issued, the second alarm information can also be uploaded to the cloud to facilitate notification of remote monitoring personnel.
- the characteristics of the infrared camera need to be considered. If the driver blocks the infrared fill light with tape, etc., the foreground area may not be greater than 75% at this time. Determine whether the infrared camera is blocked or not. For example, determine whether the average brightness of the image is less than the first brightness threshold. If the average brightness of the image is less than the first brightness threshold or greater than the second brightness threshold, start timing, if the duration reaches 5 Seconds, it is considered that the infrared camera is blocked; if the average brightness of the image is greater than the first brightness threshold and less than the second brightness threshold, start to segment the foreground and background of the image according to the dynamic threshold segmentation method.
- the foreground area is greater than the effective area 75%, then start timing, if the duration reaches 5 seconds, it is considered that the infrared camera is blocked; if the foreground area is not greater than 75% of the effective area, the number of contours of the image is obtained through contour detection, if the number of contours is less than 10 and the duration reaches 5 seconds, it is considered that the infrared camera is blocked; if the number of contours is not less than 10, it can be considered that the infrared camera is not blocked.
- a second warning message can be issued.
- the second warning message can be a voice of "do not block the camera" Warning; when it is detected that the driver has left the post and the duration of the driver’s continuous absence exceeds the first set time, the first warning message can be issued.
- the first warning message can be the voice of "please return to the driving position" Alarm.
- an embodiment of the present disclosure proposes a device for detecting the occlusion state of an image capture device.
- FIG. 3 is a schematic diagram of the composition structure of an apparatus for detecting a occlusion state of an image acquisition device according to an embodiment of the present disclosure.
- the apparatus includes: an acquisition module 300 and a first processing module 301, wherein,
- the obtaining module 300 is configured to obtain images collected by an image collection device
- the first processing module 301 is configured to determine whether the image capture device is in a blocked state according to the captured image.
- the first processing module 301 is configured to determine whether the image capture device is in a blocked state according to the captured image, including:
- the duration is greater than or equal to the second set duration or the duration greater than the second brightness threshold is greater than or Equal to the second set time period, it is determined that the image acquisition device is in a blocked state; wherein, the first brightness threshold is less than the second brightness threshold.
- the first processing module 301 is configured to determine whether the image capture device is in a blocked state according to the captured image, and further includes:
- the image capture device In response to the duration of the ratio of the foreground area to the effective area of the captured image being greater than the set value greater than or equal to the third set duration, it is determined that the image capture device is in a blocked state; wherein, the foreground area represents The area of the foreground part of the image identified in the collected image; the effective area is preset, and the effective area is less than or equal to the area of the collected image.
- the first processing module 301 is configured to determine whether the image capture device is in a blocked state according to the captured image, and further includes:
- the average brightness of the collected image is greater than or equal to a first brightness threshold and less than or equal to a second brightness threshold, and the first brightness threshold is less than the second brightness threshold;
- the ratio of the foreground area of the collected image to the effective area is less than or equal to a set value; wherein, the foreground area represents the area of the foreground part of the image identified in the collected image; the effective The area is preset, and the effective area is less than or equal to the area of the collected image;
- the image capture device In response to the number of contours in the captured image being less than the set number and the duration is greater than or equal to the fourth set time period, it is determined that the image capture device is in a blocked state; wherein, the number of contours is passed to the The number of target contours obtained by contour detection on the collected images.
- the first processing module 301 is configured to determine whether the image capture device is in a blocked state according to the captured image, and further includes:
- the average brightness of the collected image is greater than or equal to a first brightness threshold and less than or equal to a second brightness threshold, and the first brightness threshold is less than the second brightness threshold;
- the ratio of the foreground area of the collected image to the effective area is less than or equal to a set value; wherein, the foreground area represents the area of the foreground part of the image identified in the collected image; the effective The area is preset, and the effective area is less than or equal to the area of the collected image;
- the number of contours is the number of target contours obtained by performing contour detection on the collected image.
- the effective area of the captured image is preset according to the relative position of the image capture device and the fill light, and the fill light is used to perform image capture for the image capture device Area fill light.
- the first processing module 301 is further configured to respond to that the image capture device is continuously in the blocked state for a period of time greater than that of the fifth device when it is determined that the image capture device is in the blocked state. If the timing is long, an alarm message will be sent.
- the first processing module 301 is further configured to stop issuing the alarm information after the alarm information is issued, and after it is determined that the image acquisition device is in an unobstructed state.
- the image acquisition device is a vehicle-mounted image acquisition device, and the vehicle-mounted image acquisition device is installed on a vehicle and is used to acquire at least an image of a driving position area of the vehicle;
- the acquisition module 300 is configured to acquire the images acquired by the on-board image acquisition device when the vehicle is in the starting state.
- that the vehicle is in the starting state includes that the traveling speed of the vehicle is greater than the set speed.
- the image acquisition device is an infrared camera.
- both the acquisition module 300 and the first processing module 301 can be implemented by a processor located in an electronic device, and the processor can be an ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, or microcontroller. , At least one of the microprocessors.
- the functional modules in this embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
- the above-mentioned integrated unit can be realized in the form of hardware or software function module.
- the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer readable storage medium.
- the technical solution of this embodiment is essentially or It is said that the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product.
- the computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can A personal computer, server, or network device, etc.) or a processor (processor) executes all or part of the steps of the method described in this embodiment.
- the aforementioned storage media include: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.
- the computer program instructions corresponding to the method for detecting the occlusion state of an image capture device in this embodiment can be stored on storage media such as an optical disk, a hard disk, and a U disk. When the storage medium is blocked by an image capture device, any one of the aforementioned methods for detecting the occlusion state of an image acquisition device is implemented.
- FIG. 4 shows an electronic device 40 provided by an embodiment of the present disclosure, which may include: a memory 41 and a processor 42; wherein,
- the memory 41 is configured to store computer programs and data
- the processor 42 is configured to execute a computer program stored in the memory to implement any one of the methods for detecting the occlusion state of an image acquisition device in the foregoing embodiments.
- the aforementioned memory 41 may be a volatile memory (volatile memory), such as RAM; or a non-volatile memory (non-volatile memory), such as ROM, flash memory, or hard disk (Hard Disk). Drive, HDD) or Solid-State Drive (SSD); or a combination of the foregoing types of memories, and provide instructions and data to the processor 42.
- volatile memory volatile memory
- non-volatile memory non-volatile memory
- ROM read-only memory
- flash memory read-only memory
- HDD hard disk
- SSD Solid-State Drive
- the aforementioned processor 42 may be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor. It can be understood that, for different devices, the electronic devices used to implement the above-mentioned processor functions may also be other, which is not specifically limited in the embodiment of the present disclosure.
- the embodiment of the present disclosure also proposes a computer storage medium on which a computer program is stored, and when the computer program is executed by a processor, it implements any method for detecting the occlusion state of an image acquisition device provided in the embodiments of the present disclosure.
- the embodiment of the present disclosure also proposes a computer program product, wherein the computer program product includes computer executable instructions. After the computer executable instructions are executed, they can realize the shielding of any image acquisition device provided by the embodiments of the present disclosure. State detection method.
- the functions or modules contained in the device provided in the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments.
- the functions or modules contained in the device provided in the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments.
- the technical solution of the present disclosure essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, The optical disc) includes several instructions to make a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present disclosure.
- a terminal which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Geometry (AREA)
- Quality & Reliability (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Mechanical Engineering (AREA)
- Image Analysis (AREA)
- Studio Devices (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
Claims (25)
- 一种图像采集设备遮挡状态检测方法,其中,所述方法包括:获取图像采集设备采集到的图像;根据采集到的图像,确定所述图像采集设备是否处于被遮挡状态。
- 根据权利要求1所述的方法,其中,所述根据采集到的图像,确定所述图像采集设备是否处于被遮挡状态,包括:根据所述采集到的图像确定所述图像的平均亮度;响应于所述图像的平均亮度小于第一亮度阈值的持续时长大于或等于第二设定时长或者大于第二亮度阈值的持续时长大于或等于第二设定时长,确定所述图像采集设备处于被遮挡状态;其中,所述第一亮度阈值小于所述第二亮度阈值。
- 根据权利要求1所述的方法,其中,所述根据采集到的图像,确定所述图像采集设备是否处于被遮挡状态,还包括:确定所述采集到的图像的平均亮度大于或等于第一亮度阈值且小于或等于第二亮度阈值,所述第一亮度阈值小于所述第二亮度阈值;响应于所述采集到的图像的前景面积与有效面积之比大于设定值的持续时长大于或等于第三设定时长,确定所述图像采集设备处于被遮挡状态;其中,所述前景面积表示在所述采集到的图像中识别出的图像的前景部分的面积;所述有效面积是预先设定的,且所述有效面积小于或等于所述采集到的图像的面积。
- 根据权利要求1所述的方法,其中,所述根据采集到的图像,确定所述图像采集设备是否处于被遮挡状态,还包括:确定所述采集到的图像的平均亮度大于或等于第一亮度阈值且小于或等于第二亮度阈值,所述第一亮度阈值小于所述第二亮度阈值;确定所述采集到的图像的前景面积与有效面积之比小于或等于设定值;其中,所述前景面积表示在所述采集到的图像中识别出的图像的前景部分的面积;所述有效面积是预先设定的,且所述有效面积小于或等于所述采集到的图像的面积;响应于所述采集到的图像中的轮廓数量小于设定数量的持续时长大于或等于第四设定时长,确定所述图像采集设备处于被遮挡状态;其中,所述轮廓数量为通过对所述采集到的图像进行轮廓检测得出的目标轮廓数。
- 根据权利要求1所述的方法,其中,所述根据采集到的图像,确定所述图像采集设备是否处于被遮挡状态,还包括:确定所述采集到的图像的平均亮度大于或等于第一亮度阈值且小于或等于第二亮度阈值,所述第一亮度阈值小于所述第二亮度阈值;确定所述采集到的图像的前景面积与有效面积之比小于或等于设定值;其中,所述前景面积表示在所述采集到的图像中识别出的图像的前景部分的面积;所述有效面积是预先设定的,且所述有效面积小于或等于所述采集到的图像的面积;响应于所述采集到的图像中的轮廓数量大于或等于设定数量,确定所述图像采集设备处于未被遮挡状态;其中,所述轮廓数量为通过对所述采集到的图像进行轮廓检测得出的目标轮廓数。
- 根据权利要求3至5任一项所述的方法,其中,所述采集到的图像的有效面积根据所述图像采集设备与补光灯的相对位置预先设定的,所述补光灯用于为所述图像采集设备进行图像采集的区域补光。
- 根据权利要求1-6任一项所述的方法,其中,在确定所述图像采集设备处于被遮挡状态的情况下,所述方法还包括:响应于所述图像采集设备连续处于被遮挡状态的时长大于第五设定时长,发出告警信息。
- 根据权利要求7所述的方法,其中,在发出告警信息后,所述方法还包括:在确定所述图像采集设备处于未被遮挡状态后,停止发出所述告警信息。
- 根据权利要求1-8任一所述的方法,其中,所述图像采集设备为车载图像采集设备,所述车载图像采集设备安装在车辆上并至少用于采集所述车辆的驾驶位置区域的图像;获取图像采集设备采集到的图像,包括:获取所述车载图像采集设备在所述车辆处于启动状态时采集到的图像。
- 根据权利要求9所述的方法,其中,所述车辆处于启动状态包括所述车辆的行驶速度大于设定速度。
- 根据权利要求1-10任一项所述的方法,其中,所述图像采集设备为红外摄像头。
- 一种图像采集设备遮挡状态检测装置,其中,所述装置包括获取模块和第一 处理模块,其中,获取模块,配置为获取图像采集设备采集到的图像;第一处理模块,配置为根据采集到的图像,确定所述图像采集设备是否处于被遮挡状态。
- 根据权利要求12所述的装置,其中,所述第一处理模块配置为根据采集到的图像,确定所述图像采集设备是否处于被遮挡状态,包括:根据所述采集到的图像确定所述图像的平均亮度;响应于所述图像的平均亮度小于第一亮度阈值的持续时长大于或等于第二设定时长或者大于第二亮度阈值的持续时长大于或等于第二设定时长,确定所述图像采集设备处于被遮挡状态;其中,所述第一亮度阈值小于所述第二亮度阈值。
- 根据权利要求12所述的装置,其中,所述第一处理模块配置为根据采集到的图像,确定所述图像采集设备是否处于被遮挡状态,还包括:确定所述采集到的图像的平均亮度大于或等于第一亮度阈值且小于或等于第二亮度阈值,所述第一亮度阈值小于所述第二亮度阈值;响应于所述采集到的图像的前景面积与有效面积之比大于设定值的持续时长大于或等于第三设定时长,确定所述图像采集设备处于被遮挡状态;其中,所述前景面积表示在所述采集到的图像中识别出的图像的前景部分的面积;所述有效面积是预先设定的,且所述有效面积小于或等于所述采集到的图像的面积。
- 根据权利要求12所述的装置,其中,所述第一处理模块配置为根据采集到的图像,确定所述图像采集设备是否处于被遮挡状态,还包括:确定所述采集到的图像的平均亮度大于或等于第一亮度阈值且小于或等于第二亮度阈值,所述第一亮度阈值小于所述第二亮度阈值;确定所述采集到的图像的前景面积与有效面积之比小于或等于设定值;其中,所述前景面积表示在所述采集到的图像中识别出的图像的前景部分的面积;所述有效面积是预先设定的,且所述有效面积小于或等于所述采集到的图像的面积;响应于所述采集到的图像中的轮廓数量小于设定数量的持续时长大于或等于第四设定时长,确定所述图像采集设备处于被遮挡状态;其中,所述轮廓数量为通过对所述采集到的图像进行轮廓检测得出的目标轮廓数。
- 根据权利要求12所述的装置,其中,所述第一处理模块配置为根据采集到的图像,确定所述图像采集设备是否处于被遮挡状态,还包括:确定所述采集到的图像的平均亮度大于或等于第一亮度阈值且小于或等于第二亮度阈值,所述第一亮度阈值小于所述第二亮度阈值;确定所述采集到的图像的前景面积与有效面积之比小于或等于设定值;其中,所述前景面积表示在所述采集到的图像中识别出的图像的前景部分的面积;所述有效面积是预先设定的,且所述有效面积小于或等于所述采集到的图像的面积;响应于所述采集到的图像中的轮廓数量大于或等于设定数量,确定所述图像采集设备处于未被遮挡状态;其中,所述轮廓数量为通过对所述采集到的图像进行轮廓检测得出的目标轮廓数。
- 根据权利要求14至16任一项所述的装置,其中,所述采集到的图像的有效面积根据所述图像采集设备与补光灯的相对位置预先设定的,所述补光灯用于为所述图像采集设备进行图像采集的区域补光。
- 根据权利要求12至17任一项所述的装置,其中,所述第一处理模块,还配置为在确定所述图像采集设备处于被遮挡状态的情况下,响应于所述图像采集设备连续处于被遮挡状态的时长大于第五设定时长,发出告警信息。
- 根据权利要求18所述的装置,其中,所述第一处理模块,还配置为在发出告警信息后,且在确定所述图像采集设备处于未被遮挡状态后,停止发出所述告警信息。
- 根据权利要求12至19任一项所述的装置,其中,所述图像采集设备为车载图像采集设备,所述车载图像采集设备安装在车辆上并至少用于采集所述车辆的驾驶位置区域的图像;所述获取模块,配置为获取所述车载图像采集设备在所述车辆处于启动状态时采集到的图像。
- 根据权利要求20所述的装置,其中,所述车辆处于启动状态包括所述车辆的行驶速度大于设定速度。
- 根据权利要求12至21任一项所述的装置,其中,所述图像采集设备为红外摄像头。
- 一种电子设备,其中,包括处理器和配置为存储能够在处理器上运行的计算机程序的存储器;其中,所述处理器配置为运行所述计算机程序时,执行权利要求1至11任一项所述的 方法。
- 一种计算机存储介质,其上存储有计算机程序,其中,该计算机程序被处理器执行时实现权利要求1至11任一项所述的方法。
- 一种计算机程序产品,其中,所述计算机程序产品包括计算机可执行指令,该计算机可执行指令被执行后,能够实现权利要求1至11任一项所述的方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020217012973A KR20210065177A (ko) | 2019-06-28 | 2019-11-29 | 이미지 수집 기기 가림 상태 검출 방법, 장치, 기기 및 저장 매체 |
SG11202104488YA SG11202104488YA (en) | 2019-06-28 | 2019-11-29 | Method and apparatus for detecting blocking state of image acquisition device, device and storage medium |
JP2021523700A JP2022511669A (ja) | 2019-06-28 | 2019-11-29 | 画像取得装置の遮断状態の検出方法及び装置、機器並びに記憶媒体 |
US17/242,455 US11457126B2 (en) | 2019-06-28 | 2021-04-28 | Method for detecting blocking state of image acquisition device, electronic device and storage medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910580603.6A CN112150534A (zh) | 2019-06-28 | 2019-06-28 | 图像采集设备遮挡状态检测方法、装置、设备和存储介质 |
CN201910580603.6 | 2019-06-28 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/242,455 Continuation US11457126B2 (en) | 2019-06-28 | 2021-04-28 | Method for detecting blocking state of image acquisition device, electronic device and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020258720A1 true WO2020258720A1 (zh) | 2020-12-30 |
Family
ID=73891239
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/122213 WO2020258720A1 (zh) | 2019-06-28 | 2019-11-29 | 图像采集设备遮挡状态检测方法、装置、设备和存储介质 |
Country Status (6)
Country | Link |
---|---|
US (1) | US11457126B2 (zh) |
JP (1) | JP2022511669A (zh) |
KR (1) | KR20210065177A (zh) |
CN (1) | CN112150534A (zh) |
SG (1) | SG11202104488YA (zh) |
WO (1) | WO2020258720A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113628236A (zh) * | 2021-08-16 | 2021-11-09 | 北京百度网讯科技有限公司 | 摄像头遮挡检测方法、装置、设备、存储介质及程序产品 |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113573444B (zh) * | 2021-07-23 | 2023-06-16 | 宁波方太厨具有限公司 | 智能家电及其光感控制方法、装置、存储介质 |
CN114734456A (zh) * | 2022-03-23 | 2022-07-12 | 深圳市商汤科技有限公司 | 摆棋方法、装置、电子设备、对弈机器人及存储介质 |
US20230391344A1 (en) * | 2022-06-01 | 2023-12-07 | GM Global Technology Operations LLC | In-vehicle multimodal violence detection for shared vehicles and self-driving shuttles |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9161029B1 (en) * | 2014-07-03 | 2015-10-13 | Interra Systems, Inc. | Systems and methods for detecting defective pixels in a video sequence |
CN105744268A (zh) * | 2016-05-04 | 2016-07-06 | 深圳众思科技有限公司 | 摄像头遮挡检测方法及装置 |
CN107347151A (zh) * | 2016-05-04 | 2017-11-14 | 深圳众思科技有限公司 | 双目摄像头遮挡检测方法及装置 |
CN108710885A (zh) * | 2018-03-29 | 2018-10-26 | 百度在线网络技术(北京)有限公司 | 目标对象的检测方法和装置 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6324090B2 (ja) * | 2014-01-31 | 2018-05-16 | 株式会社 日立産業制御ソリューションズ | 撮像装置 |
US20170036599A1 (en) * | 2015-08-06 | 2017-02-09 | Ford Global Technologies, Llc | Vehicle display and mirror |
JP6772113B2 (ja) * | 2017-08-02 | 2020-10-21 | クラリオン株式会社 | 付着物検出装置、および、それを備えた車両システム |
US10769454B2 (en) * | 2017-11-07 | 2020-09-08 | Nvidia Corporation | Camera blockage detection for autonomous driving systems |
US11016492B2 (en) * | 2019-02-28 | 2021-05-25 | Zoox, Inc. | Determining occupancy of occluded regions |
-
2019
- 2019-06-28 CN CN201910580603.6A patent/CN112150534A/zh active Pending
- 2019-11-29 SG SG11202104488YA patent/SG11202104488YA/en unknown
- 2019-11-29 JP JP2021523700A patent/JP2022511669A/ja not_active Ceased
- 2019-11-29 KR KR1020217012973A patent/KR20210065177A/ko active Search and Examination
- 2019-11-29 WO PCT/CN2019/122213 patent/WO2020258720A1/zh active Application Filing
-
2021
- 2021-04-28 US US17/242,455 patent/US11457126B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9161029B1 (en) * | 2014-07-03 | 2015-10-13 | Interra Systems, Inc. | Systems and methods for detecting defective pixels in a video sequence |
CN105744268A (zh) * | 2016-05-04 | 2016-07-06 | 深圳众思科技有限公司 | 摄像头遮挡检测方法及装置 |
CN107347151A (zh) * | 2016-05-04 | 2017-11-14 | 深圳众思科技有限公司 | 双目摄像头遮挡检测方法及装置 |
CN108710885A (zh) * | 2018-03-29 | 2018-10-26 | 百度在线网络技术(北京)有限公司 | 目标对象的检测方法和装置 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113628236A (zh) * | 2021-08-16 | 2021-11-09 | 北京百度网讯科技有限公司 | 摄像头遮挡检测方法、装置、设备、存储介质及程序产品 |
Also Published As
Publication number | Publication date |
---|---|
KR20210065177A (ko) | 2021-06-03 |
US11457126B2 (en) | 2022-09-27 |
US20210250470A1 (en) | 2021-08-12 |
JP2022511669A (ja) | 2022-02-01 |
SG11202104488YA (en) | 2021-05-28 |
CN112150534A (zh) | 2020-12-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020258720A1 (zh) | 图像采集设备遮挡状态检测方法、装置、设备和存储介质 | |
WO2018223955A1 (zh) | 目标监控方法、目标监控装置、摄像机及计算机可读介质 | |
CN107967806B (zh) | 车辆套牌检测方法、装置、可读存储介质及电子设备 | |
US9679210B2 (en) | Using passive driver identification and other input for providing real-time alerts or actions | |
US11176390B2 (en) | Cloud-controlled vehicle security system | |
WO2019178851A1 (zh) | 一种基于深度学习的井盖缺失检测***及方法 | |
CN108921046A (zh) | 一种基于身份识别的小区停车场防盗预警***及其方法 | |
US11479260B1 (en) | Systems and methods for proximate event capture | |
CN110728218A (zh) | 危险驾驶行为的预警方法、装置、电子设备及存储介质 | |
CN109204114B (zh) | 车辆迎宾灯的投射方法和装置 | |
US10867511B2 (en) | Apparatus and method for identifying license plate tampering | |
US11482012B2 (en) | Method for driving assistance and mobile device using the method | |
CN105702049A (zh) | 一种基于dsp的应急车道监控***及实现方法 | |
WO2020258719A1 (zh) | 驾驶员在岗状态检测方法、装置、设备和计算机存储介质 | |
AU2023270232A1 (en) | Infringement detection method, device and system | |
CN112017401A (zh) | 监测人员安全的警报***、相应的方法和存储介质 | |
CN117565819A (zh) | 车辆控制方法、装置和车辆 | |
CN111710168A (zh) | 基于5g传输的违停车牌抓拍和监控方法及***、设备 | |
JP7268959B2 (ja) | 車両が停止後に自動的に再び前進させないようにすることを可能にする装置及び方法 | |
SE542225C2 (en) | A method for facilitating identification of a reckless driver of a road vehicle, a system, a computer program, a computer-readable medium and a vehicle | |
CN108520630A (zh) | 一种违章自动抓拍***及其方法 | |
CN112530176B (zh) | 酒驾预警方法、装置、设备和介质 | |
CN111462480A (zh) | 交通图像证据验证方法、装置、计算机设备和存储介质 | |
KR20200063294A (ko) | 차량용 블랙박스 영상의 자동 수집이 가능한 객체추적 시스템 및 방법 | |
WO2020255629A1 (ja) | 画像処理装置及び画像処理用プログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19935303 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 20217012973 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2021523700 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 21.04.2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19935303 Country of ref document: EP Kind code of ref document: A1 |