CN112329504A - Door opening and closing state monitoring method, device, equipment and computer readable storage medium - Google Patents
Door opening and closing state monitoring method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN112329504A CN112329504A CN202010297734.6A CN202010297734A CN112329504A CN 112329504 A CN112329504 A CN 112329504A CN 202010297734 A CN202010297734 A CN 202010297734A CN 112329504 A CN112329504 A CN 112329504A
- Authority
- CN
- China
- Prior art keywords
- door
- monitored
- picture
- closing state
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 59
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000012806 monitoring device Methods 0.000 claims abstract description 13
- 238000004891 communication Methods 0.000 claims description 14
- 230000035515 penetration Effects 0.000 claims description 11
- 230000002159 abnormal effect Effects 0.000 claims description 9
- 230000000873 masking effect Effects 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 6
- 238000004364 calculation method Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 230000000149 penetrating effect Effects 0.000 description 2
- 241000282326 Felis catus Species 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000007670 refining Methods 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses a method for monitoring the opening and closing state of a door, which comprises the following steps: shooting a door to be monitored through a preset shooting device, acquiring shooting information sent by the shooting device, and judging whether a person is in contact with the door to be monitored according to the shooting information; if a person is in contact with the door to be monitored, acquiring a first picture and a second picture before and after the person is in contact with the door to be monitored in the camera information; and determining the opening and closing state of the door to be monitored according to the first picture and the second picture. The invention also discloses a door opening and closing state monitoring device, equipment and a readable storage medium. The invention realizes the real-time monitoring of the opening and closing state of the door to be monitored.
Description
Technical Field
The invention relates to the field of monitoring of the Internet of things, in particular to a method, a device and equipment for monitoring the opening and closing state of a door and a computer readable storage medium.
Background
With the continuous maturity of the technology of the internet of things, smart homes are rapidly developed, more and more families use smart door locks which can be incorporated into the internet of things network, however, the smart door locks provide convenience (the traditional step of opening and closing the door by using a key is saved), and meanwhile, the problem that the door can not be closed tightly (namely, hidden under the false condition) also exists. The existing method for solving the problem of virtual masking of the intelligent door is to use the intelligent door lock with a power assisting mechanism, namely, extra rotary power is provided for the intelligent door until the intelligent door is locked and cannot rotate.
Disclosure of Invention
The invention mainly aims to provide a method for monitoring the opening and closing state of a door, and aims to solve the technical problems that the opening and closing state of the door cannot be monitored, a special door lock is required to be used, the door lock is not popular, extra rotary power needs to be provided, and the cost is increased in the prior art.
In addition, in order to achieve the above object, the present invention also provides a door opening and closing state monitoring method, including the steps of:
shooting a door to be monitored through a preset shooting device, acquiring shooting information sent by the shooting device, and judging whether a person is in contact with the door to be monitored according to the shooting information;
if a person is in contact with the door to be monitored, acquiring a first picture and a second picture before and after the person is in contact with the door to be monitored in the camera information;
and determining the opening and closing state of the door to be monitored according to the first picture and the second picture.
Optionally, the step of determining the opening/closing state of the door to be monitored according to the first picture and the second picture includes:
according to the first picture and the second picture, performing infrared reflection penetration operation to respectively obtain a first infrared reflection value and a second infrared reflection value;
calculating a reflection ratio value of the second infrared reflection value and the first infrared reflection value;
and if the reflection ratio value is greater than or equal to a first preset threshold value, judging that the door to be monitored is in a closed state.
Optionally, after the step of calculating the reflection ratio of the second infrared reflection value to the first infrared reflection value, the method includes:
if the reflection ratio value is smaller than a first preset threshold value, calculating a first average pixel value of all areas in a first picture, and calculating a second average pixel value of an unreflected area in a second picture;
calculating a pixel proportion value of the first average pixel value and the second average pixel value;
if the pixel proportion value is larger than or equal to a second preset threshold value, judging that the door to be monitored is in a closed state;
and if the pixel proportion value is smaller than the second preset threshold value, judging that the door to be monitored is in a virtual masking state.
Optionally, the determining of the unreflected area includes:
according to the second picture, performing infrared reflection penetration operation, and determining a target infrared emission line corresponding to unreflected infrared rays;
and extracting target pixel points corresponding to the target infrared emission lines, and taking the region where the target pixel points are gathered as an unreflected region.
Optionally, the step of determining whether a person is in contact with the door to be monitored according to the camera information includes:
extracting a video picture in the camera information, comparing all video frames of the video picture, and judging whether a moving body exists in the video picture;
if the moving body exists in the video picture, judging whether the body outline of the moving body is matched with a preset human body outline or not;
and if the main body contour is matched with the preset human body contour, judging that a person is in contact with the door to be monitored.
Optionally, the method for monitoring the opening and closing state of the door is applied to a door opening and closing state monitoring device, the door opening and closing state monitoring device may be in communication connection with a plurality of image pickup devices, the step of acquiring image pickup information sent by the image pickup devices and judging whether a person contacts with the door to be monitored according to the image pickup information includes:
acquiring picture information sent by a target camera device, extracting main body color information in the picture information, and judging whether the target camera device can shoot a door to be monitored or not according to the main body color information;
and if the target camera device can shoot the door to be monitored, establishing communication connection between the target camera device and the door opening and closing state monitoring equipment.
Optionally, after the step of determining the opening/closing state of the door to be monitored according to the first picture and the second picture, the method includes:
if the door to be monitored is in a virtual masking state, sending switch abnormity prompt information through a terminal corresponding to the camera device; or,
and acquiring the mobile terminal bound with the door to be monitored, and sending the abnormal switch prompt information through the mobile terminal.
In addition, to achieve the above object, the present invention also provides a door opening and closing state monitoring device, including:
the system comprises a judging module, a monitoring module and a monitoring module, wherein the judging module is used for shooting a door to be monitored through a preset camera device, acquiring camera information sent by the camera device and judging whether a person is in contact with the door to be monitored according to the camera information;
the acquisition module is used for acquiring a first picture and a second picture before and after the contact between the personnel in the camera shooting information and the door to be monitored if the personnel is in contact with the door to be monitored;
and the determining module is used for determining the opening and closing state of the door to be monitored according to the first picture and the second picture.
In addition, to achieve the above object, the present invention also provides a door opening and closing state monitoring apparatus, comprising: the monitoring system comprises a memory, a processor and a door switch state monitoring program stored on the memory and capable of running on the processor, wherein the door switch state monitoring program realizes the steps of the door switch state monitoring method when being executed by the processor.
In addition, to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a door open/close state monitoring program, which when executed by a processor, implements the steps of the door open/close state monitoring method as described above.
The embodiment of the invention provides a method, a device and equipment for monitoring the opening and closing state of a door and a readable storage medium. In the embodiment of the invention, a door to be monitored is shot through a preset camera device, so that camera information containing a video picture is obtained, whether a person is in contact with the door to be monitored is determined through further analyzing a video frame of the video picture, so that an application scene that the person walks out of the door to be monitored is given, when a switch state monitoring program judges that the person is in contact with the door to be monitored, two pictures before and after the person is in contact with the door to be monitored are further intercepted, namely a first picture and a second picture, and finally the switch state of the door to be monitored is determined through the first picture and the second picture. The embodiment realizes the real-time monitoring of the opening and closing state of the door to be monitored under the condition of not increasing the cost (not using a special door lock).
Drawings
Fig. 1 is a schematic hardware structure diagram of an embodiment of a door opening and closing state monitoring device according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart illustrating a door opening/closing status monitoring method according to a first embodiment of the present invention;
FIG. 3 is a schematic view of a first embodiment of a door opening/closing state monitoring method according to the present invention for determining contact between a person and a door to be monitored;
FIG. 4 is a schematic flow chart illustrating a door opening/closing status monitoring method according to a second embodiment of the present invention;
FIG. 5 is a schematic flow chart illustrating a door opening/closing status monitoring method according to a third embodiment of the present invention;
FIG. 6 is a flowchart illustrating a fourth embodiment of a method for monitoring the opening/closing status of a door according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.
The door opening and closing state monitoring terminal (called terminal, equipment or terminal equipment) in the embodiment of the invention can be information processing equipment such as a personal computer, an intelligent mobile phone and the like, further comprises information acquisition equipment such as a camera and the like, and further comprises information storage equipment such as a memory and a server and the like.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Optionally, the terminal may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like. Such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display screen according to the brightness of ambient light, and a proximity sensor that may turn off the display screen and/or the backlight when the mobile terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when the mobile terminal is stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer and tapping) and the like for recognizing the attitude of the mobile terminal; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a door switch state monitoring program.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to invoke a door switch state monitoring program stored in the memory 1005 that, when executed by the processor, implements the operations in the door switch state monitoring method provided by the embodiments described below.
Based on the hardware structure of the switching state monitoring equipment, the embodiment of the door switching state monitoring method is provided.
Referring to fig. 2, in a first embodiment of a door open/close state monitoring method of the present invention, the door open/close state monitoring method includes:
and step S10, shooting the door to be monitored through a preset camera device, acquiring camera information sent by the camera device, and judging whether a person is in contact with the door to be monitored according to the camera information.
The door opening and closing state monitoring method in this embodiment is applied to a door opening and closing state monitoring device, wherein the door opening and closing state monitoring device includes an information processing device (hereinafter, expressed as a smart phone) such as a personal computer and a smart phone, an information acquiring device (hereinafter, expressed as a camera) such as a camera, and an information storage device (hereinafter, expressed as a memory) such as a memory and a server. The preset camera device in this embodiment means that, in an environment of internet of things home, a plurality of devices are connected with each other through a public wireless network, the camera device is a part of the devices, and the camera device may not be an independent individual, and may also be a camera installed on a television, a mobile phone and a remote control unmanned aerial vehicle. The door to be monitored is a door in a home environment, namely an inlet and an outlet of the home environment, and the opening and closing state of the door to be monitored directly influences the safety of the home environment. The camera device in this embodiment can shoot a door to be monitored from multiple angles and acquire camera information, where the camera information includes video pictures, sound, and camera time information. Therefore, whether a person exists in the video image containing the door to be monitored can be judged through the video image or the sound in the camera shooting information, and if the person exists, whether the person contacts with the door to be monitored can be further judged.
And step S20, if a person contacts with the door to be monitored, acquiring a first picture and a second picture before and after the person contacts with the door to be monitored in the camera shooting information.
Therefore, the method for determining whether there is contact between a person and a door to be monitored may be that the moving track of the person is captured by a camera, and if the person is captured and enters the video picture from the outside and disappears in the video picture (the person does not go out of the video picture), it is determined that there is contact between the person and the door to be monitored, that is, the person goes out of the door to be monitored in the video picture, and the specific determination method is not described in this embodiment. When a person contacts with a door to be monitored, the door opening and closing state monitoring program acquires the system time when the person contacts with the door to be monitored, and respectively intercepts a clear picture from the video pictures before and after the system time, the picture intercepted before the system time is a first picture and is used for displaying the opening and closing state of the door to be monitored before the person contacts with the door to be monitored, generally, when the person is not out of the door to be monitored, the door to be monitored is in a closed state, the picture intercepted after the system time is a second picture and is used for displaying the opening and closing state of the door to be monitored after the person contacts with the door to be monitored, namely, the opening and closing state needing to be judged in the embodiment.
And step S30, determining the opening and closing state of the door to be monitored according to the first picture and the second picture.
Through the analysis of the first picture and the second picture, the opening and closing state of the door to be monitored can be determined, wherein the opening and closing state of the door to be monitored includes an off state and a virtual mask state (i.e., an off state), and in particular, how to determine the opening and closing state of the door to be monitored through the analysis of the first picture and the second picture is not described in detail in this embodiment.
Specifically, the step S10 is a step of refining, including:
step a1, extracting the video pictures in the camera information, comparing the video frames of the video pictures, and judging whether a moving body exists in the video pictures.
Step a2, if the moving body exists in the video picture, determining whether the body contour of the moving body matches with a preset human body contour.
Step a3, if the main body contour is matched with the preset human body contour, judging that a person is in contact with the door to be monitored.
The video frames in this embodiment refer to each frame of the video, and it is known that each frame of the video is compared, and if differences in the content of the frames continuously occur, it can be determined that a moving subject exists in the video frames, which is similar to the process of animation production. When it is determined that a moving body exists in the video frame, the door opening/closing state monitoring program will further acquire the outline of the outer edge of the moving body, i.e. the outline of the body in this embodiment, and the purpose of acquiring the outline of the moving body is to further determine that the moving body is a person, as shown in fig. 3, fig. 3 is a case where a moving person exists and other moving objects exist in the video frame (the mobile remote control cart in the figure may also be a pet cat and a pet dog), and fig. 3 is a case where a moving person exists on the left side and another moving object exists on the right side. Through obtaining the main part profile to further match the main part profile with predetermineeing human body profile, wherein, predetermineeing human body profile for the profile of human body under each normal walking posture of prestoring, match through main part profile and predetermineeing human body profile, judge whether have personnel and wait to monitor the door contact, if match successfully, judge that there is personnel and wait to monitor the door contact. It can be known that, in order to eliminate the situation that the person only walks from the video picture, when comparing each video frame of the video picture, the situation that the moving subject walks from the video picture is eliminated, and only the moving subject that enters the video picture and disappears from the door to be monitored in the video picture is subjected to contour matching, so that the moving subject that enters the video picture and disappears from the door to be monitored in the video picture can be determined to have walked out of the door to be monitored, and can be further determined to be the person.
In the embodiment, a door to be monitored is shot through a preset camera device, so that camera information containing a video picture is obtained, whether a person is in contact with the door to be monitored is determined by further analyzing a video frame of the video picture, so that an application scene that the person walks out of the door to be monitored is given, when the switch state monitoring program judges that the person is in contact with the door to be monitored, two pictures before and after the person is in contact with the door to be monitored are further intercepted, the two pictures are respectively a first picture and a second picture, and finally the switch state of the door to be monitored is determined through the first picture and the second picture. The embodiment realizes the real-time monitoring of the opening and closing state of the door to be monitored without increasing the cost (not using a special door lock).
Further, referring to fig. 4, a second embodiment of the door opening and closing state monitoring method of the present invention is provided on the basis of the above-described embodiment of the present invention.
This embodiment is a step of the first embodiment, which is a refinement of step S30, and the difference between this embodiment and the above-described embodiment of the present invention is:
and step S31, performing infrared reflection and penetration operation according to the first picture and the second picture to respectively obtain a first infrared reflection value and a second infrared reflection value.
And step S32, calculating a reflection ratio value of the second infrared reflection value and the first infrared reflection value.
Step S33, if the reflection ratio is greater than or equal to a first preset threshold, it is determined that the door to be monitored is in a closed state.
The infrared reflection penetration operation in this embodiment means that infrared rays are emitted to an object, and if the object has a gap or has a transparent portion, the infrared rays irradiated to these positions will not be reflected. Firstly, the positions of the door to be monitored in the first picture and the second picture are obtained, then the infrared reflection penetration module is started to conduct infrared 360-degree scanning on the door to be monitored, and the infrared rays reflected back are received. It can be known that, when the infrared reflection and penetration module is activated to perform infrared scanning on the door to be monitored in the first picture, the reflected infrared ray corresponds to a first infrared reflection value (e.g., 100 × 100), and when the infrared scanning is performed on the door to be monitored in the second picture, the reflected infrared ray corresponds to a second infrared reflection value (e.g., 90 × 100), because the door to be monitored in the first picture is in the closed state, the first infrared reflection value is greater than or equal to the second infrared reflection value. The reflection ratio value in this embodiment is a ratio of the second infrared reflection value to the first infrared reflection value, for example, if the first infrared reflection value is 100 × 100 and the second infrared reflection value is 90 × 100, the reflection ratio value is 0.9, and it is known that if the reflection ratio value is larger, it indicates that when the door to be monitored in the second picture is subjected to infrared scanning, the more infrared rays are reflected, and the smaller the door gap of the door to be monitored in the second picture is. In this embodiment, the first preset threshold is obtained according to experience of multiple experiments, and is a preset value and is adjustable, for example, the first preset threshold is 0.95, and if the reflection ratio value is 0.96, it indicates that when the door to be monitored in the second picture is subjected to infrared scanning, the reflected infrared ray accounts for 0.96 when the door to be monitored in the first picture is subjected to infrared scanning, that is, the reflected infrared ray is more, and in this case, the door open-close state monitoring program determines that the door to be monitored is in the closed state.
Specifically, steps subsequent to step S32 include:
step b1, if the reflection ratio is smaller than a first preset threshold, calculating a first average pixel value of all areas in the first picture, and calculating a second average pixel value of the non-reflection area in the second picture.
And b2, calculating the pixel proportion value of the first average pixel value and the second average pixel value.
And b3, if the pixel proportion value is greater than or equal to a second preset threshold value, determining that the door to be monitored is in a closed state.
Step b4, if the pixel proportion value is smaller than the second preset threshold, determining that the door to be monitored is in a virtual masking state.
In this embodiment, when the reflectance value is smaller than the first predetermined threshold, the door switch state monitoring program further obtains pixel values of all pixel points in the first picture, and calculates an average pixel value (i.e., the first average pixel value in this embodiment). The unreflected area in this embodiment refers to an area where infrared rays are unreflected when infrared scanning is performed on the door to be monitored in the second picture, and the area corresponds to a door gap of the door to be monitored, and as can be known, compared with the color of the door to be monitored in the picture, the color at the door gap is obviously different, and appears bright due to light transmission. Similarly, the pixel ratio value in this embodiment is a ratio of the first average pixel value and the second average pixel value, for example, if the first infrared reflectance value is 220 × 200 × 189 and the second infrared reflectance value is 234 × 230 × 240, the reflectance value is about 0.64, and it is known that if the pixel ratio value is smaller, the larger the unreflected area showing bright light is, i.e., the larger the gap of the door to be monitored in the second picture is. The second predetermined threshold is also obtained from experience of multiple experiments in this embodiment, and is an adjustable predetermined value, for example, the second predetermined threshold is 0.6, and if the pixel ratio is 0.7, in this case, the door opening/closing state monitoring program will determine that the door to be monitored is in the closed state. If the reflection ratio value is smaller than a second preset threshold value, the door opening and closing state monitoring program judges that the door to be monitored is in a virtual masking state.
Specifically, the step of determining the unreflected area in step b1 includes:
and c1, performing infrared reflection and penetration operation according to the second picture, and determining the target infrared emission line corresponding to the unreflected infrared ray.
And c2, extracting target pixel points corresponding to the target infrared emission lines, and taking the region where the target pixel points are gathered as an unreflected region.
The target infrared emission ray in this embodiment means that when the infrared ray emitted to the object passes through the non-slit or opaque portion, the infrared ray is reflected, and when the infrared ray emitted to the object passes through the slit or transparent portion, the infrared ray is not reflected, and the non-reflected infrared ray is the target infrared emission ray. Specifically, the correspondence between the infrared rays and the pixel points depends on the emission density of the infrared rays, and generally, the infrared rays and the pixel points have one-to-one or many-to-one relationship.
In the embodiment, the reflection ratio value and the pixel ratio value are obtained by infrared reflection penetration operation and calculation of the average pixel value, and the specific method for judging the door opening and closing state is provided by further judging the reflection ratio value and the pixel ratio value, so that the real-time monitoring of the door opening and closing state to be monitored is realized.
Further, referring to fig. 5, a third embodiment of the door opening and closing state monitoring method of the present invention is provided on the basis of the above-described embodiment of the present invention.
This embodiment is a step before step S10 in the first embodiment, and the difference between this embodiment and the above-described embodiment of the present invention is:
step S40, acquiring picture information sent by a target camera device, extracting main body color information in the picture information, and judging whether the target camera device can shoot a door to be monitored according to the main body color information.
And step S50, if the target camera device can shoot the door to be monitored, establishing the communication connection between the target camera device and the door opening and closing state monitoring equipment.
In this embodiment, the target camera device is a device having a camera function in an intelligent home environment, and may include a monitoring camera, a smart phone, a smart television, a remote-control drone, and the like, and obtains picture information taken and sent by the target camera device, further obtains subject color information in the taken picture, and analyzes and judges the subject color information to determine whether the target camera device can take a door to be monitored, specifically, first obtains a subject of the taken picture, and can determine a subject located in the center of the picture by using the existing image recognition technology, and obtains a subject edge, and can determine whether the subject is a door by determining the subject edge, and then further obtains color information of the subject, and it is known that most doors have a fixed color, for example, red, by obtaining color information of the door to be monitored in advance, and then, the acquired main body color is compared with the color of the door to be monitored, if the main body color is similar to the color of the door to be monitored, the main body can be determined as the door to be monitored, the target camera device can be judged to be capable of shooting the door to be monitored, and finally, the target camera device capable of shooting the door to be monitored is in communication connection with the door opening and closing state monitoring equipment.
In the embodiment, through screening of all the target camera devices, the communication connection between the target camera device capable of shooting the door to be monitored and the door opening and closing state monitoring equipment is established, and a foundation is laid for subsequent judgment of the opening and closing state of the door to be monitored.
Further, referring to fig. 6, a third embodiment of the door opening and closing state monitoring method of the present invention is provided on the basis of the above-described embodiment of the present invention.
This embodiment is a step after step S30 in the first embodiment, and the present embodiment is different from the above-described embodiments of the present invention in that:
and step S60, if the door to be monitored is in a virtual state, sending abnormal prompt information of the switch through a terminal corresponding to the camera device.
And step S70, acquiring the mobile terminal bound with the door to be monitored, and sending the switch abnormity prompt information through the mobile terminal.
In this embodiment, the abnormal switch prompt message refers to a prompt message output to remind a user that the door to be monitored is not closed when the door open-close state monitoring program determines that the open-close state of the door to be monitored is a virtual state, where the abnormal switch prompt message may include a voice, a text, a sound, and the like, and may also be output on a terminal corresponding to the camera device, for example, when the open-close state of the door to be monitored is a virtual state, the prompt message is output on an interface on a smart television, and the abnormal switch prompt message may also be sent through a mobile terminal (such as a smart phone carried by the user) bound to the door to be monitored.
In this embodiment, when the door opening and closing state monitoring program determines that the opening and closing state of the door to be monitored is a virtual state, the terminal corresponding to the camera device or the mobile terminal bound to the door to be monitored sends the prompt information of the abnormal opening and closing state, so that the prompt function for the user is achieved.
In addition, an embodiment of the present invention further provides a door opening/closing state monitoring device, where the door opening/closing state monitoring device includes:
the system comprises a judging module, a monitoring module and a monitoring module, wherein the judging module is used for shooting a door to be monitored through a preset camera device, acquiring camera information sent by the camera device and judging whether a person is in contact with the door to be monitored according to the camera information;
the acquisition module is used for acquiring a first picture and a second picture before and after the contact between the personnel in the camera shooting information and the door to be monitored if the personnel is in contact with the door to be monitored;
and the determining module is used for determining the opening and closing state of the door to be monitored according to the first picture and the second picture.
Optionally, the determining module includes:
the penetrating unit is used for carrying out infrared reflection penetrating operation according to the first picture and the second picture to respectively obtain a first infrared reflection value and a second infrared reflection value;
the first calculation unit is used for calculating a reflection ratio value of the second infrared reflection value and the first infrared reflection value;
and the first judging unit is used for judging that the door to be monitored is in a closed state if the reflection ratio value is greater than or equal to a first preset threshold value.
Optionally, the door opening/closing state monitoring device further includes:
the second calculation unit is used for calculating a first average pixel value of all areas in the first picture and calculating a second average pixel value of an unreflected area in the second picture if the reflection ratio value is smaller than a first preset threshold value;
a third calculating unit, configured to calculate a pixel ratio value of the first average pixel value and the second average pixel value;
the second judging unit is used for judging that the door to be monitored is in a closed state if the pixel proportion value is larger than or equal to a second preset threshold value;
and the third judging unit is used for judging that the door to be monitored is in a virtual masking state if the pixel proportion value is smaller than the second preset threshold value.
Optionally, the third computing unit includes:
the reflection unit is used for carrying out infrared reflection penetration operation according to the second picture and determining a target infrared emission line corresponding to the unreflected infrared ray;
and the extraction unit is used for extracting target pixel points corresponding to the target infrared emission lines and taking the region where the target pixel points are gathered as an unreflected region.
Optionally, the determining module includes:
the comparison unit is used for extracting the video pictures in the camera shooting information, comparing all the video frames of the video pictures and judging whether a moving body exists in the video pictures or not;
the judging unit is used for judging whether the main body outline of the moving main body is matched with a preset human body outline or not if the moving main body exists in the video picture;
and the fourth judging unit is used for judging that a person is in contact with the door to be monitored if the main body outline is matched with the preset human body outline.
Optionally, the door opening/closing state monitoring device further includes:
the system comprises an acquisition unit, a monitoring unit and a monitoring unit, wherein the acquisition unit is used for acquiring picture information sent by a target camera device, extracting main color information in the picture information and judging whether the target camera device can shoot a door to be monitored or not according to the main color information;
and the establishing unit is used for establishing communication connection between the target camera device and the door opening and closing state monitoring equipment if the target camera device can shoot the door to be monitored.
Optionally, the door opening/closing state monitoring device further includes:
the first sending unit is used for sending abnormal prompt information of a switch through a terminal corresponding to the camera device if the door to be monitored is in a virtual masking state; or,
and the second sending unit is used for acquiring the mobile terminal bound with the door to be monitored and sending the abnormal switch prompt information through the mobile terminal.
The method executed by each program module can refer to each embodiment of the method of the present invention, and is not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a tablet computer, etc.) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A door open/close state monitoring method, characterized by comprising the steps of:
shooting a door to be monitored through a preset shooting device, acquiring shooting information sent by the shooting device, and judging whether a person is in contact with the door to be monitored according to the shooting information;
if a person is in contact with the door to be monitored, acquiring a first picture and a second picture before and after the person is in contact with the door to be monitored in the camera information;
and determining the opening and closing state of the door to be monitored according to the first picture and the second picture.
2. The door opening and closing state monitoring method of claim 1, wherein the step of determining the opening and closing state of the door to be monitored based on the first picture and the second picture comprises:
according to the first picture and the second picture, performing infrared reflection penetration operation to respectively obtain a first infrared reflection value and a second infrared reflection value;
calculating a reflection ratio value of the second infrared reflection value and the first infrared reflection value;
and if the reflection ratio value is greater than or equal to a first preset threshold value, judging that the door to be monitored is in a closed state.
3. The door open/close state monitoring method as claimed in claim 2, wherein the step of calculating a reflection ratio value of the second infrared reflection value to the first infrared reflection value is followed by:
if the reflection ratio value is smaller than a first preset threshold value, calculating a first average pixel value of all areas in a first picture, and calculating a second average pixel value of an unreflected area in a second picture;
calculating a pixel proportion value of the first average pixel value and the second average pixel value;
if the pixel proportion value is larger than or equal to a second preset threshold value, judging that the door to be monitored is in a closed state;
and if the pixel proportion value is smaller than the second preset threshold value, judging that the door to be monitored is in a virtual masking state.
4. The door opening and closing state monitoring method of claim 3, wherein the determination process of the unreflected area includes:
according to the second picture, performing infrared reflection penetration operation, and determining a target infrared emission line corresponding to unreflected infrared rays;
and extracting target pixel points corresponding to the target infrared emission lines, and taking the region where the target pixel points are gathered as an unreflected region.
5. The door opening and closing state monitoring method according to claim 1, wherein the step of determining whether a person is in contact with the door to be monitored based on the photographed information includes:
extracting a video picture in the camera information, comparing all video frames of the video picture, and judging whether a moving body exists in the video picture;
if the moving body exists in the video picture, judging whether the body outline of the moving body is matched with a preset human body outline or not;
and if the main body contour is matched with the preset human body contour, judging that a person is in contact with the door to be monitored.
6. The door opening and closing state monitoring method according to claim 1, wherein the door opening and closing state monitoring method is applied to a door opening and closing state monitoring apparatus which is capable of being connected with a plurality of image pickup devices in a communication manner, and before the step of acquiring image pickup information sent by the image pickup devices and judging whether a person is in contact with the door to be monitored according to the image pickup information, the method comprises the following steps:
acquiring picture information sent by a target camera device, extracting main body color information in the picture information, and judging whether the target camera device can shoot a door to be monitored or not according to the main body color information;
and if the target camera device can shoot the door to be monitored, establishing communication connection between the target camera device and the door opening and closing state monitoring equipment.
7. The door opening and closing state monitoring method of claim 1, wherein the step of determining the opening and closing state of the door to be monitored based on the first picture and the second picture is followed by the step of:
if the door to be monitored is in a virtual masking state, sending switch abnormity prompt information through a terminal corresponding to the camera device; or,
and acquiring the mobile terminal bound with the door to be monitored, and sending the abnormal switch prompt information through the mobile terminal.
8. A door opening/closing state monitoring device, characterized by comprising:
the system comprises a judging module, a monitoring module and a monitoring module, wherein the judging module is used for shooting a door to be monitored through a preset camera device, acquiring camera information sent by the camera device and judging whether a person is in contact with the door to be monitored according to the camera information;
the acquisition module is used for acquiring a first picture and a second picture before and after the contact between the personnel in the camera shooting information and the door to be monitored if the personnel is in contact with the door to be monitored;
and the determining module is used for determining the opening and closing state of the door to be monitored according to the first picture and the second picture.
9. A door opening and closing state monitoring apparatus, comprising: memory, a processor and a door switch status monitoring program stored on the memory and executable on the processor, the door switch status monitoring program when executed by the processor implementing the steps of the door switch status monitoring method as claimed in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that a door open/close state monitoring program is stored thereon, which when executed by a processor implements the steps of the door open/close state monitoring method according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010297734.6A CN112329504A (en) | 2020-04-15 | 2020-04-15 | Door opening and closing state monitoring method, device, equipment and computer readable storage medium |
| PCT/CN2021/087315 WO2021208986A1 (en) | 2020-04-15 | 2021-04-14 | Door opening/closing state monitoring method, device and apparatus, and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010297734.6A CN112329504A (en) | 2020-04-15 | 2020-04-15 | Door opening and closing state monitoring method, device, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112329504A true CN112329504A (en) | 2021-02-05 |
Family
ID=74302822
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010297734.6A Pending CN112329504A (en) | 2020-04-15 | 2020-04-15 | Door opening and closing state monitoring method, device, equipment and computer readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112329504A (en) |
| WO (1) | WO2021208986A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021208986A1 (en) * | 2020-04-15 | 2021-10-21 | 深圳Tcl新技术有限公司 | Door opening/closing state monitoring method, device and apparatus, and computer readable storage medium |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115578630B (en) * | 2022-11-09 | 2023-03-21 | 广东科凯达智能机器人有限公司 | Method and system for judging working gear of air switch |
| CN117037340B (en) * | 2023-09-06 | 2024-04-12 | 东莞市安邦德智能锁具科技有限公司 | Intelligent lock control system based on data identification |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101540892A (en) * | 2009-04-23 | 2009-09-23 | 上海中安电子信息科技有限公司 | Method for people counting in doorway on DSP video gathering device |
| CN202042025U (en) * | 2011-05-09 | 2011-11-16 | 航天科工深圳（集团）有限公司 | Monitoring terminal |
| CN102747891A (en) * | 2012-07-13 | 2012-10-24 | 深圳市悦德智能科技有限公司 | Intelligent lock |
| CN105160743A (en) * | 2015-09-29 | 2015-12-16 | 吴希文 | Door control system and door control monitoring method |
| CN105245839A (en) * | 2015-09-30 | 2016-01-13 | 万科思自控信息（中国）有限公司 | Automatic opening display method for entrance machine |
| WO2018007468A1 (en) * | 2016-07-06 | 2018-01-11 | Gerd Reime | Device and method for observing an object |
| CN108983620A (en) * | 2018-06-22 | 2018-12-11 | 联想(北京)有限公司 | A kind of control method, device and electronic equipment |
| CN109544535A (en) * | 2018-11-26 | 2019-03-29 | 马杰 | It is a kind of that camera detection method and system are pried through based on infrared cutoff filter optical filtration characteristic |
| CN110415431A (en) * | 2019-07-16 | 2019-11-05 | 合肥美的智能科技有限公司 | Container control method, container control device and container |
| CN110477927A (en) * | 2019-09-18 | 2019-11-22 | 歌尔科技有限公司 | A kind of active blink detection method, apparatus, equipment and readable storage medium storing program for executing |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102747919B (en) * | 2012-06-18 | 2014-11-12 | 浙江工业大学 | Omnidirectional computer vision-based safe and energy-saving control device for pedestrian automatic door |
| CN110526058B (en) * | 2018-05-23 | 2022-06-03 | 奥的斯电梯公司 | Elevator door monitoring system, elevator system and elevator door monitoring method |
| CN112329504A (en) * | 2020-04-15 | 2021-02-05 | 深圳Tcl新技术有限公司 | Door opening and closing state monitoring method, device, equipment and computer readable storage medium |
-
2020
- 2020-04-15 CN CN202010297734.6A patent/CN112329504A/en active Pending
-
2021
- 2021-04-14 WO PCT/CN2021/087315 patent/WO2021208986A1/en active Application Filing
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101540892A (en) * | 2009-04-23 | 2009-09-23 | 上海中安电子信息科技有限公司 | Method for people counting in doorway on DSP video gathering device |
| CN202042025U (en) * | 2011-05-09 | 2011-11-16 | 航天科工深圳（集团）有限公司 | Monitoring terminal |
| CN102747891A (en) * | 2012-07-13 | 2012-10-24 | 深圳市悦德智能科技有限公司 | Intelligent lock |
| CN105160743A (en) * | 2015-09-29 | 2015-12-16 | 吴希文 | Door control system and door control monitoring method |
| CN105245839A (en) * | 2015-09-30 | 2016-01-13 | 万科思自控信息（中国）有限公司 | Automatic opening display method for entrance machine |
| WO2018007468A1 (en) * | 2016-07-06 | 2018-01-11 | Gerd Reime | Device and method for observing an object |
| CN108983620A (en) * | 2018-06-22 | 2018-12-11 | 联想(北京)有限公司 | A kind of control method, device and electronic equipment |
| CN109544535A (en) * | 2018-11-26 | 2019-03-29 | 马杰 | It is a kind of that camera detection method and system are pried through based on infrared cutoff filter optical filtration characteristic |
| CN110415431A (en) * | 2019-07-16 | 2019-11-05 | 合肥美的智能科技有限公司 | Container control method, container control device and container |
| CN110477927A (en) * | 2019-09-18 | 2019-11-22 | 歌尔科技有限公司 | A kind of active blink detection method, apparatus, equipment and readable storage medium storing program for executing |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021208986A1 (en) * | 2020-04-15 | 2021-10-21 | 深圳Tcl新技术有限公司 | Door opening/closing state monitoring method, device and apparatus, and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021208986A1 (en) | 2021-10-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107992794B (en) | A kind of biopsy method, device and storage medium | |
| WO2021017561A1 (en) | Face recognition method and apparatus, electronic device, and storage medium | |
| US20200293754A1 (en) | Task execution method, terminal device, and computer readable storage medium | |
| CN112329504A (en) | Door opening and closing state monitoring method, device, equipment and computer readable storage medium | |
| US20210133468A1 (en) | Action Recognition Method, Electronic Device, and Storage Medium | |
| US10432860B2 (en) | Camera operation mode control | |
| US11538276B2 (en) | Communication system, distributed processing system, distributed processing method, and recording medium | |
| WO2017166469A1 (en) | Security protection method and apparatus based on smart television set | |
| CN107742072B (en) | Face recognition method and mobile terminal | |
| KR101849365B1 (en) | Appratus and method for processing image | |
| CN107231607B (en) | Unlocking method and device of Bluetooth intelligent lock and computer readable storage medium | |
| CN110971823A (en) | Parameter adjusting method and terminal equipment | |
| CN108141568B (en) | OSD information generation camera, synthesis terminal device and sharing system | |
| CN107038776A (en) | A kind of gate control system and access control method | |
| CN102025945A (en) | Electronic device and control method thereof | |
| CN110807405A (en) | Detection method of candid camera device and electronic equipment | |
| US11194894B2 (en) | Electronic device and control method thereof | |
| US20190306175A1 (en) | Communication terminal, communication system, communication control method, and recording medium | |
| US20190068924A1 (en) | Monitoring system having personal information protection function and method thereof | |
| KR20180086048A (en) | Camera and imgae processing method thereof | |
| CN110796015B (en) | Remote monitoring method and device | |
| CN114332925A (en) | Method, system and device for detecting pets in elevator and computer readable storage medium | |
| CN112949467B (en) | Face detection method, device, electronic equipment and storage medium | |
| CN108109188B (en) | Image processing method and mobile terminal | |
| US11209517B2 (en) | Mobile body detection device, mobile body detection method, and mobile body detection program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |