CN106960550A - Electronic equipment monitoring system for prompting of going out based on image recognition - Google Patents
Electronic equipment monitoring system for prompting of going out based on image recognition Download PDFInfo
- Publication number
- CN106960550A CN106960550A CN201710131171.1A CN201710131171A CN106960550A CN 106960550 A CN106960550 A CN 106960550A CN 201710131171 A CN201710131171 A CN 201710131171A CN 106960550 A CN106960550 A CN 106960550A
- Authority
- CN
- China
- Prior art keywords
- electronic equipment
- user
- monitoring device
- going out
- door
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Alarm Systems (AREA)
Abstract
The present invention proposes a kind of electronic equipment monitoring system for prompting of going out based on image recognition, it is characterized in that setting up electronic equipment list under same user；Monitoring device control camera device shoots doorway region within doors, and by image processing and analyzing, recognizes doorway user profile, sends monitoring device；When detecting enabling signal, monitoring device recognizes electronic equipment of going out, and determine its owning user electronic equipment list according to electronic equipment monitoring information；If inconsistent by the doorway user profile of image recognition and the consumer electronic devices list information of going out that is determined by electronic equipment of going out, monitoring device triggering alarm set sends prompting message.
Description
Technical field
System is reminded the present invention relates to electronic technology, more particularly to a kind of electronic equipment monitoring of going out based on image recognition
System.
Background technology
In people's daily life, there is the thing that some needs are carried with, such as key, mobile phone, wallet etc. were on duty
Cheng Zhong, usual household gos out together, because anxiety is hasty, and someone leaves behind carry-on articles or wrong by his personage when going out unavoidably
The situation of product, neglects for the moment, but brings very big trouble.One kind is now needed to carry out electronic equipment monitoring system when going out, when
Prompting is sent when someone leaves behind carry-on thing or mistake with other people articles in the household gone out together.
The content of the invention
It is an object of the invention to provide a kind of electronic equipment monitoring system for prompting of going out based on image recognition, head of a family goes out
Door someone sends prompting when leaving behind carry-on articles or mistake by other people articles.
A kind of electronic equipment monitoring system for prompting of going out based on image recognition proposed by the present invention, including monitoring device,
Door surveys device, electronic equipment, camera device and alarm set, and monitoring device carries out radio communication, shooting dress with electronic equipment
Put and be connected with monitoring device by wired or wireless way, door surveys the switching signal of device detection door and sends monitoring device, its
It is characterized in set up electronic equipment list under same user；Monitoring device control camera device shoots doorway region, and passing through within doors
Image processing and analyzing, recognizes doorway user profile, sends monitoring device；When detecting enabling signal, monitoring device is according to electronics
Monitoring of equipment information, recognizes electronic equipment of going out, and determine its owning user electronic equipment list；If passing through image recognition
Doorway user profile and the consumer electronic devices list information of going out determined by electronic equipment of going out are inconsistent, and monitoring device is touched
Hair alarm set sends prompting message.
Electronic equipment list under the preset same user of the present invention, user's electronics is determined by the electronic equipment of going out of monitoring
List of devices, the user that gos out is judged by electronic equipment list, and the doorway regional image information shot by camera device is analyzed,
Recognize doorway user profile；If the user's number of going out judged by electronic equipment list of going out is less than by image recognition
Doorway number of users, judges that someone gos out non-having electronic equipment, if passing through the user that gos out that electronic equipment list of going out judges
Number is more than the doorway number of users by image recognition, judges that someone gos out many with other people electronic equipments, if passing through electricity of going out
What sub- list of devices differentiated go out user with it is inconsistent by the doorway user of image recognition, the user's mistake that judges to go out is with other people
Electronic equipment and the electronic equipment not with oneself, before user leaves home, send corresponding prompting message.
With reference to embodiment, technical scheme is described in detail.
Brief description of the drawings
Fig. 1 is the system architecture diagram of one embodiment of the invention.
Fig. 2 is the system architecture diagram of another embodiment of the present invention.
Fig. 3 is the structural plan of one embodiment of the invention.
Fig. 4 is the structural plan of another embodiment of the present invention.
Fig. 5 is that one kind of the present invention is gone out electronic equipment monitoring based reminding method flow chart.
Fig. 6 is another electronic equipment monitoring based reminding method flow chart of going out of the present invention.
Embodiment
In the example structure block diagram shown in Fig. 1, including monitoring device, door survey device, mobile electronic device, shooting
Device and alarm set, monitoring device include first microprocessor, the first wireless communication unit, and it is micro- that electronic equipment includes second
Processor, the second wireless communication unit, monitoring device and electronic equipment are communicatively coupled by wireless communication unit, and are passed through
Wired or wireless way controls alarm set.
Mobile electronic device includes Intelligent key, active access card, smart mobile phone, or is associated with mechanical key, wallet etc.
Electric terminal.A kind of wireless near field communication between electronic equipment and monitoring device, including Wi-Fi, bluetooth, infrared ray,
Ultra wide band, RFID, ZigBee, NFC etc., it is automatic to carry out when the spacing between monitoring device and electronic equipment is in communication range
Radio communication.
Electronic equipment can also be smart mobile phone, by application program in mobile phone, and mobile phone of the control in monitoring range leads to
Cross bluetooth and carry out information transmission with monitoring device.
Camera device is communicatively coupled by wired or wireless way with monitoring device.According to camera device set-up mode
Difference, camera device can have different structure compositions, such as camera device can be combined with monitoring device, is arranged on
Camera, capture gate mouth region area image, the image of shooting are provided with camera device on wall near doorframe OR gate mouthful within doors
Information sends monitoring device and carries out Treatment Analysis, recognizes doorway user.In addition, camera device can also be separated with monitoring device,
Somewhere in doors is set, and towards doorway direction, shoots doorway area image within doors, in camera device provided with camera and
Image procossing identification module, is analyzed and processed to the image that camera is shot, and is recognized doorway user, is passed through communication
Recognition result is sent monitoring device.
Door surveys the switching signal that device detects door, and detection signal is sent monitoring device by wired or wireless way；Door
Surveying device includes other devices, such as RFID radio-frequency units such as intelligent door lock, door sensor, or feeler, on door OR gate frame
RFID label tag is set, RFID reader is set on doorframe OR gate, when door is closed, both press close to, and RFID reader is received
RFID label tag feedback signal, when door is opened, both are remote, and RFID reader does not receive RFID label tag signal, is read by RFID
Read whether device receives RFID label tag signal, judge the on off state of door.Door surveys device and can also be a contact switch, works as door
Close, contacting（Or disconnect）, when door is opened, contact disconnects（Or connect）, according to the on-off of contact, judge opening for door
Off status.
The doorway user profile that monitoring device is recognized by enabling signal and combination camera device judges user's inlet/outlet, when
When detecting enabling signal, if recognizing someone in door, monitoring device judges that user gos out from interior, if unidentified in door
Someone, monitoring device judges that user enters from outside.
Further, human body signal in human body detection device, detection door is set on the inside of door, sent out by wired or wireless way
Send monitoring device；The human body detection device is touch inductor, on the door handle for being arranged on an inner side, when touch inductor sense
User's touch signal should be arrived, judges that user is intended to go out.
The human body detection device can also be the infrared inductor for being arranged on doorway, photoelectric sensor, ultrasonic wave transmitting
It is any in receiver, Laser emission receiver, human body signal of the detection in doorway region.
When human body detection device detects human body signal in door, monitoring device judges that user is intended to go out from interior, wakes up shooting
Device is shot in mouth region domain on the door.
Further, human body detection device is surveyed device with door and combined, when door is opened, if human body detection device is detected in door
Human body signal, monitoring device judges that user gos out from interior, when door is opened, if human body detection device is not detected by human body letter in door
Number, monitoring device judges that user enters from outside, and structured flowchart is as shown in Figure 2.
The alarm set includes the instantaneous speech power that doorway is set, and monitoring device control voice output device plays language
Message ceases.Alarm set can also be the reminding unit set in electronic equipment, as shown in Fig. 2 monitoring device passes through wireless parties
The reminding unit that formula is waken up in electronic equipment sends prompting message.
In a kind of example structure layout drawing shown in Fig. 3, the part that door surveys device 1 is arranged on door 2, another portion
Divide and be arranged on doorframe 3, with monitoring door 2 and the on off state of doorframe 3, camera device 4 is combined with monitoring device 5, if
Put on doorframe 3 in doors, monitoring device 5 receives door and surveys the image letter that the switch gate signal and camera device 4 of the detection of device 1 are shot
Breath, radio communication is carried out with electronic equipment 6.Monitoring device 5 carries out processing point by the image information shot to camera device 4
Analysis, recognizes doorway user profile, and monitor the status information of electronic equipment 6.
In another example structure layout drawing shown in Fig. 4, the part that door surveys device 1 is arranged on door 2, another
It is partially disposed on doorframe 3, with monitoring door 2 and the on off state of doorframe 3, human body detection device 4 is arranged on the doorframe 3 of inner side,
Camera device 5 is set in doors, and is set towards doorway direction, and capture gate mouth region area image recognizes doorway by image procossing
User profile, is wirelessly connected with monitoring device 6, and monitoring device 6 is set on doorframe 3, is received door and is surveyed what device 1 was detected
The human body signal that switch gate signal and human body detection device 4 are detected, and the identification information that camera device 5 feeds back, and and electronics
Equipment 7 carries out radio communication, to monitor the status information of electronic equipment 7.
Monitoring device can be arranged on doorway region, such as doorframe or wall, can also be arranged somewhere in doors, such as be schemed
Combined in 4 with camera device, and apart from doorway suitable distance, wirelessly receive door and survey device or human testing
The detection signal that device is sent.
In one kind shown in Fig. 5 gos out electronic equipment monitoring based reminding method flow chart, device is surveyed by door and detects door
Switching signal, monitoring device wakes up camera device according to enabling signal and shoots doorway area image within doors, is known by image procossing
Other doorway user profile, according to user's door opening process electronic equipment monitoring information, it is determined that electronic equipment list of going out, according to image
Inconsistency between the doorway user profile of identification and consumer electronic devices list information of going out, sends corresponding prompting message,
Detailed process is as follows：
（1）Electronic equipment list under preset same user；
（2）Monitoring device monitors state of electronic equipment；
（3）Door surveys the switching signal that device detects door, sends monitoring device；
（4）Whether enabling signal is detected, if it is, into next step, if not, being transferred to step（2）；
（5）Monitoring device wakes up camera device capture gate mouth region domain, by doorway regional image information Treatment Analysis, recognizes doorway
User profile；
（6）Electronic equipment monitoring information of the monitoring device in door opening process differentiates electronic equipment of going out, and passes through electronics of going out
Equipment determines electronic equipment list of going out；
（7）Doorway user profile by image recognition and the consumer electronic devices list of going out by electronic equipment determination of going out
Whether information is consistent, if it is, being transferred to step（2）, if not, into next step；
（8）Corresponding prompting message is sent, step is transferred to（2）.
In monitoring device, memory cell, preset consumer electronic devices list information are set.The electronic equipment list is root
According to the ID information of electronic equipment, pass through any of which each electronic device association under same user in system together
Electronic equipment ID information, can lock the consumer electronic devices list, and then determine the electronic equipment in the list, such as following table
It is shown：
User A, electronic equipment A1, electronic equipment A2, electronic equipment A3 ...
User B, electronic equipment B1, electronic equipment B2, electronic equipment B3 ...
……。
The state of electronic equipment includes the indoor location of electronic equipment, or distance of the electronic equipment away from monitoring device, or
The electronic equipment signal intensity of monitoring device monitoring, or at least one in electronic equipment movable information, can be used with individual event,
Can multinomial comprehensive use.
The indoor location is to use wireless communication method, and the position in electronic equipment indoors space is positioned,
Indoor wireless location technology method is different, and its positioning precision is each variant, preferably RFID location technologies, is carried out using RF-wise
Contactless bidirectional communication data exchange, realizes electronic equipment identification and positions, it can obtain Centimeter Level in several milliseconds and determine
The information of position precision, and transmission range is big, cost is relatively low.
The distance can be according to signal intensity and distance relation deduction, such as, can be according to monitoring using Bluetooth technology
Bluetooth signal intensity RSSI value and the relation of distance that device is received, judge distance of the electronic equipment apart from monitoring device.Bluetooth
Signal intensity is adjusted the distance in 0 ~ 3 meter of scope changes very sensitive.
In system work process, monitoring device monitoring state of electronic equipment information, door surveys the switch letter of device monitoring door
Number, and monitoring device is sent, monitoring device detects signal according to opening the door, and wakes up the image letter in camera device capture gate mouth region domain
Breath, by the analyzing and processing to image information, recognizes doorway user profile.Monitoring device using detect enabling signal as when segmentum intercalaris
Point, the electronic equipment monitoring information in door opening process recognizes electronic equipment of going out.
Door opening process includes setting the period before enabling signal from detecting（Such as detect 5 before enabling signal, 10 seconds）,
To the previous period process of enabling when detecting enabling signal, or from when detecting enabling signal to setting the period thereafter（Such as
Detect 3 after enabling signal, 5 seconds）The latter period process of enabling, or set before enabling signal the period to detection from detecting
The enabling all the period of time process of period is set after to enabling signal.Door opening process is centered on detecting enabling signal, when its is front and rear
Segment length is short different because of the state change situation of electronic equipment, if electronic equipment movement is slow, its state change is slow, monitoring
Process of going out is just long, if electronic equipment movement is fast, its state change is fast, and monitoring device can recognize electronics of going out quickly and set
Standby, the process of going out of monitoring is just short.
User, which gos out, typically carry electronic equipment to doorway, can be set by setting enabling region recognition electronics of going out
It is standby.Enabling region is the position range stood when the user set on doorway opens the door, and 0.5 ~ 3 meter of model is such as less than away from doorway
The position range that position in region, including electronic equipment room is in doorway setting regions is enclosed, or the distance away from doorway is less than setting
The distance range of threshold value, enabling region can also be signal strength range, be included in the electronic equipment signal intensity of doorway monitoring
More than given threshold or the signal strength range of statistical value.
The statistical value is the electronic equipment signal intensity monitored when detecting enabling signal by counting a period
Set up, be included in doorway monitoring electronic equipment signal intensity minimum value, or signal intensity central value correction value, such as it is average
Value subtracts a setting value, and the electronic equipment in enabling region, its electronic equipment signal intensity monitored on doorway is more than system
Evaluation.Statistical value can better conform to the carrying custom and different application scene of different user relative to setting value, such as, blue
Tooth signal intensity is easily affected by environment, including subscriber household environment, user carry custom, according to statistical method set up in opening
The Rule of judgment in door region, reflects scene Comprehensive Characteristics, applicability is stronger.
Further, it is also possible to recognize electronic equipment of going out by the state change of electronic equipment in door opening process, such as place
Electronic equipment near doorway.State of electronic equipment change is the information characteristics that electronic equipment is carried, if electronic equipment
State change occur in door opening process, it can be determined that the electronic equipment is the electronic equipment of going out carried by user.The electricity
Sub- equipment state changes to change including position in electronic equipment room, or electronic equipment becomes away from monitoring device distance
Change, or the electronic equipment signal intensity of monitoring device monitoring changes, or any of motion occurs for electronic equipment.It is described
Motion include electronic equipment by move to it is static or by it is static to move, motion change can according to state of electronic equipment change sentence
Not, or in the electronic device motion sensor, including accelerometer or gyroscope are set, electronic equipment movable information is monitored,
Transmit monitoring device.
It can also be that electronic equipment inertial states in door opening process change that the state of electronic equipment, which changes,.
The inertial states of electronic equipment are a kind of states for keeping or having before enabling signal is detected, and can be that a kind of standing is constant
State, such as place electronic equipment in doors or a kind of state persistently changed, such as be carried in fortune
Dynamic electronic equipment.Inertial states are to discriminate between detecting a kind of division of state before and after enabling signal, are relative to detecting out
Historic state during gate signal.
For the electronic equipment being carried within doors, its inertial states before opening the door is the variable condition in motion, when with
Family is stood when being opened the door on doorway, and the variable condition of the electronic equipment switchs to detect change halted state during enabling signal, supervises
It is electronic equipment of going out by changing to the electronic equipment of change pause to survey state during device identification is gone out.
For the electronic equipment placed within doors, its inertial states before enabling signal is detected is in standing constant shape
State, is taken during going out by user, and the state of the electronic equipment has the constant variable condition for switching to be carried of standing, monitoring
Device identification go out during state by stand to change electronic equipment be electronic equipment of going out.Further, enabling is detected
During signal, state of electronic equipment change pause.
State of electronic equipment change pause is in electronic equipment feature when opening the door, when pausing at enabling.State change
It is the two kinds of relative status of electronic equipment of going out with change pause, state change is that the absolute value of Monitoring Data difference is more than setting threshold
Value, change pause is that the absolute value of Monitoring Data difference is less than given threshold, and change pause can be that a kind of amplitude of variation is less
State or static condition.
The static condition electronic equipment include electronic equipment room in position does not change, or electronic equipment away from monitoring device away from
From not changing, or the electronic equipment signal intensity of monitoring device monitoring does not change, or electronic equipment any of is not moved.
For the electronic equipment placed within doors, before monitoring device can be opened the door with monitoring record, one of the electronic equipment is most
New static condition data, electronic equipment monitoring date comprision during with opening the door or after enabling passes through the prison in door opening process
Data variation is surveyed, electronic equipment of going out is recognized.
The electronic equipment within doors being kept in motion carried to user, monitoring device can be with the monitoring record electronic equipment
The newest state change time, if the time and opening time difference are less than given threshold, or state change continues to out
Suspend during door, it can be determined that the electronic equipment is electronic equipment of going out.
Combined by the state change of electronic equipment and enabling region, can more accurately identify electronic equipment of going out.
Monitoring device determines consumer electronic devices list, arranged by consumer electronic devices according to electronic device information of going out
Table information, can differentiate the user belonging to the electronic equipment, and then the user number that determination is gone out.
When detecting enabling signal, monitoring device triggering camera device capture gate mouth region area image passes through image information
Treatment Analysis, recognizes doorway user profile.The doorway user profile includes the doorway user number judged by image recognition
Or the doorway user of identification.
Described image Treatment Analysis is included by human geometry's feature recognition doorway user number, or the head for passing through people
Feature recognition doorway user number, or gone out people's number by human motion feature recognition, i.e., it is moved in doorway region
Human body number be doorway user number.
Sentenced if the doorway user number recognized according to graphical analysis is not equal to according to the electronic equipment list of going out of monitoring
Disconnected user number of going out, sends prompting message.
If being more than the user that gos out according to electronic equipment list monitoring of going out according to the doorway user number of image recognition
Number, judges that the non-having electronic equipment of someone is gone out, sends the prompting message of non-having electronic equipment.Such as pass through the door of image recognition
Mouth user is 3, and the user that gos out differentiated by electronic equipment list of going out is 2, illustrates that having 1 people to go out does not carry electronics
Equipment, sends the prompting message of the non-having electronic equipment of someone.
If being less than the user that gos out according to electronic equipment list monitoring of going out according to the doorway user number of image recognition
Number, judges that someone is more and is gone out with other people electronic equipments, sends many band prompting messages.Such as pass through the doorway user of image recognition
It is 2, the user that gos out differentiated by electronic equipment list of going out is 3, illustrates have 1 people to go out more with other people electronics
Equipment, sends the prompting message of many having electronic equipment of someone.
In doorway setting instantaneous speech power, such as loudspeaker, monitoring device control voice output device, which is sent, accordingly to be carried
Awake voice.Speech convertor is set in the instantaneous speech power, text information is converted into speech play.
Further, associating for user profile and its electronic equipment list is set up, this can be determined by electronic equipment list
The user of list.If according to the user that gos out for electronic equipment list determination of going out with being differed by the doorway user of image recognition
Cause, judge the wrong electronic equipment not with oneself with other people electronic equipment of user of going out, send prompting message.Such as pass through
The doorway user of image recognition is 2, and the user that gos out differentiated by electronic equipment list of going out is also 2, but is wherein led to
1 doorway user for crossing image recognition is not same people with the user differentiated by electronic equipment list of going out, judges the doorway
Electronic equipment of the user not with oneself, and the wrong electronic equipment with user in the list.
Recognized according to the Treatment Analysis of user images information, distinguish doorway user, described image identification is in a small amount of household
In the range of the personage that carries out distinguish, face feature and the progress of general physical feature can such as be passed through according to simple prominent information
Individual identification.User's process of going out generally faces door, different according to the setting of camera device, can photograph doorway zone user
The image information of different angles.
In the layout drawing shown in Fig. 3, camera device is arranged near doorframe OR gate mouthful on wall, just to the user that gos out,
The direct picture information for the people that gos out can be photographed, doorway number can not only be recognized by face recognition technology, can be with can
To distinguish different home member.
In the layout drawing shown in Fig. 4, if camera device sets the position of somewhere just on the door in doors, shooting direction with
Door is vertical, in an angle of 90 degrees, and shooting is the back image of people of going out, and by human body back geological information, can differentiate people from doorway
Body number, meanwhile, the height of comprehensive household, men and women's hair etc. different characteristic can also be met between a small amount of kinsfolk
Identification.If the position that camera device is staggered just on the door, it is tiltedly right with door to be changed to, such as shooting direction is less than 90 jiaos of models with door
Enclose, to photograph the side image of doorway user, by human geometry's information, with reference to the side-information of face, can differentiate
Doorway number, while recognizing different user.
The method for setting up user profile and its electronic equipment list association, can believe according to preset consumer electronic devices ID
The electronic device information of going out of list, the user images information gathered during individually being gone out by user and monitoring is ceased, automatically
Set up the association of the user profile and corresponding electronic equipment list.During system use, the doorway of constantly storage collection is used
Family image information and monitoring go out electronic device information and between corresponding relation, by intelligence learning method, according to right
The statistical analysis of substantial amounts of collection Monitoring Data, sets up both associations.
Further, the preset user's name in the consumer electronic devices list, monitoring device control voice device is played
Corresponding user's name.
During user gos out, if monitoring device does not monitor the electronic equipment of the doorway user according to image recognition
List information, illustrates that the user gos out and does not carry electronic equipment, monitoring device sends non-having electronic by instantaneous speech power and set
Standby user's name prompting message.
During user gos out, if unidentified to going out for being monitored according to electronic equipment list of going out by graphical analysis
Door user, illustrates that the electronic equipment of the user is gone out wrong band by other people, monitoring device is sent by wrong band by instantaneous speech power
User or electronic device names prompting message.
Further, reminding unit is set in the electronic device, and monitoring device is wirelessly waken up in the list not
Band sends prompting message by the electronic equipment of wrong band, causes user to note.
Reminding unit in electronic equipment includes electromagnetic shaker or thumper or LED, sends vibrations or sound or flicker etc.
Prompting message.
In another electronic equipment monitoring based reminding method flow chart of going out shown in Fig. 6, people's physical examination is set on the inside of door
Device is surveyed, judges that user is intended to go out according to human body signal in door, and then wakes up camera device and is shot, and photographing information is entered
Row Treatment Analysis, recognizes doorway user profile, and detailed process is as follows：
（1）Electronic equipment list under preset same user；
（2）Monitoring device monitors state of electronic equipment；
（3）Door surveys the switching signal that device detects door, sends monitoring device；
（4）Human body signal in human body detection device detection door, sends monitoring device；
（5）Judge whether to detect human body signal in door, if it is, monitoring device judges that user is intended to go out from interior, into next
Step, if not, being transferred to step（2）；
（6）Monitoring device wakes up camera device capture gate mouth region area image, by the Treatment Analysis to image information, recognizes doorway
User profile；
（7）Whether enabling signal is detected, if it is, judging that user gos out, into next step, if not, going to step（2）；
（8）Electronic equipment monitoring information during monitoring device is gone out according to user differentiates electronic equipment of going out, by going out
Electronic equipment determines consumer electronic devices list of going out；
（9）According to the doorway user profile of image recognition and the consumer electronic devices list of going out according to electronic equipment determination of going out
Whether information is consistent, if it is, being transferred to step（2）, if not, into next step；
（10）Corresponding prompting message is sent, step is transferred to（2）.
One kind shown in Fig. 5 go out electronic equipment monitoring based reminding method be monitoring device pass through enabling signal triggering shooting dress
The shooting in mouth region domain on the door is put, in figure 6, system sets human body detection device to detect human body signal in door, monitoring dress in door
Put and shot by human body signal triggering camera device in door.Relative to open the door detect signal, due to detect human body when
Between to shift to an earlier date, shooting dress is waken up by human testing signal, the time-bands that can be started working to camera device shift to an earlier date
Amount, this lead is relevant with the set location of human body detection device and the detection method of use.Equally, human testing is believed
Number as the process of going out timing node, the setting of door opening process can be made to extend forward, i.e. monitoring device monitoring is gone out electronics
The time of equipment is more preceding.
In addition, by the combination of human testing signal in the detection letter AND gate that opens the door, door opening process can be divided into use
Enabling when family is gone out or enabling when entering, you can to distinguish go out and enter process, electronics during being gone out by user
The monitoring information of equipment, recognizes electronic equipment of going out.
The above method is when being not detected by enabling signal or human body signal, and camera device is in dormancy or holding state, leads to
The wake-up for crossing monitoring device is transferred to working condition, to save the energy consumption of camera device.Do not considering the situation of camera device energy consumption
Under, system can make camera device in running order all the time, capture gate mouth region domain user images, and by image information at
Reason, recognizes doorway user, when recognizing doorway user profile, monitoring device judges that user is intended to go out, further combined with enabling
Signal, it is determined that event of going out.
Further, system also includes networking unit, such as WIFI module, connection system to the webserver or smart mobile phone etc.
Ancillary equipment, wireless messages transmission can be carried out by ancillary equipment to system.
The present invention is to be generally in closed mode based on door, that is to say, that just opens the door, is then shut off when user passes in and out.
For reverse situation, such as office, door is generally in open mode, is closed when user leaves, can be people
Body detection means sets outer side of door, such as touch inductor is set on side grip outdoors, believes when detecting human body touch outdoors
Number, judge that user will go out.Or reversely installation door surveys device, door is surveyed a device part on door, another part is positioned on
On the place contacted with the door of door opening state, such as wall, left by both, judge that user will close the door, both press close to, and judge user
Open the door, monitoring device is arranged on doorframe, or somewhere within doors, monitor state of electronic equipment information.
Claims (10)
1. a kind of electronic equipment monitoring system for prompting of going out based on image recognition, including monitoring device, door are surveyed device, electronics and set
Standby, camera device and alarm set, monitoring device carry out radio communication with electronic equipment, and camera device passes through with monitoring device
Wired or wireless way is connected, and door surveys the switching signal of device detection door and sends monitoring device, it is characterized in that：
Electronic equipment list under same user is set up in monitoring device；
Camera device shoots doorway region within doors, and by image processing and analyzing, recognizes doorway user profile；
If detecting enabling signal, monitoring device recognizes electronic equipment of going out, determines its institute according to electronic equipment monitoring information
Belong to consumer electronic devices list information；
When doorway user profile and inconsistent electronic equipment list information of going out, monitoring device triggering alarm set sends prompting
Information.
2. system according to claim 1, it is characterized in that：The electronic equipment of going out is in including user's door opening process to open the door
At least one of electronic equipment that state changes in the electronic equipment in region, or user's door opening process.
3. system according to claim 2, it is characterized in that：The electronic equipment is position in electronic equipment room in enabling region
Put and be less than given threshold, OR gate mouthful monitoring device prison away from doorway monitoring device distance in doorway setting range, or electronic equipment
The electronic equipment signal intensity of survey, which is more than, sets threshold value or statistical value.
4. system according to claim 2, it is characterized in that：The state of electronic equipment changes including in electronic equipment room
Position changes, or electronic equipment changes away from monitoring device distance, or the electronic equipment signal of monitoring device monitoring is strong
Degree changes, or any of motion occurs for electronic equipment.
5. system according to claim 1, it is characterized in that：The doorway user profile is the doorway user by image recognition
Number, the consumer electronic devices list information is consumer electronic devices list number of going out, that is, user number of going out is described to differ
Cause is inconsistent by the doorway user number of image recognition and the user number of going out that is monitored by electronic equipment list of going out.
6. system according to claim 1, it is characterized in that：Set up user profile and its electronic equipment list association, the door
Mouth user profile is the doorway user profile by image recognition, and the consumer electronic devices list information is user's letter of association
Breath, it is described it is inconsistent be to be differed by the doorway user profile and the user profile for electronic equipment list association of going out of image recognition
Cause.
7. system according to claim 6, it is characterized in that：Though the image information gathered during individually being gone out by user is known
Do not go out user profile, electronic equipment of going out is judged by the electronic device information for monitoring of going out, system is set up described automatically
User profile of going out is associated with electronic equipment list of going out.
8. the system according to claim 1 or 5 or 6, it is characterized in that：The alarm set is carrying of setting in the electronic device
Awake unit, monitoring device wirelessly wakes up electronic equipment in the list and sends prompting message.
9. the system according to claim 1 or 5 or 6, it is characterized in that：The alarm set is the voice output dress for setting doorway
Put；
The preset user's name in the consumer electronic devices list, monitoring device plays the user by instantaneous speech power
Title；Or
The preset electronic device names in the consumer electronic devices list, monitoring device plays described by instantaneous speech power
Electronic device names in list.
10. system according to claim 1, it is characterized in that：The system sets human body detection device on the inside of door, detects door
Interior human body signal, and send monitoring device, when human body detection device detects human body signal in door, judge user be intended to from it is interior go out
Door, monitoring device control camera device is shot in mouth region domain on the door.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710131171.1A CN106960550A (en) | 2017-03-07 | 2017-03-07 | Electronic equipment monitoring system for prompting of going out based on image recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710131171.1A CN106960550A (en) | 2017-03-07 | 2017-03-07 | Electronic equipment monitoring system for prompting of going out based on image recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106960550A true CN106960550A (en) | 2017-07-18 |
Family
ID=59471709
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710131171.1A Withdrawn CN106960550A (en) | 2017-03-07 | 2017-03-07 | Electronic equipment monitoring system for prompting of going out based on image recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106960550A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110010241A (en) * | 2019-04-03 | 2019-07-12 | 温州康宁医院股份有限公司 | A kind of patient administration system that medical department uses |
| CN111080848A (en) * | 2019-11-25 | 2020-04-28 | 星络智能科技有限公司 | Storage medium, intelligent panel and unlocking method based on intelligent panel |
| CN111554282A (en) * | 2020-04-20 | 2020-08-18 | 星络智能科技有限公司 | Switching method of voice control function, intelligent home controller and storage medium |
| CN112185077A (en) * | 2019-07-01 | 2021-01-05 | 云丁网络技术(北京)有限公司 | Intelligent reminding method, device and system and camera equipment |
| CN112288912A (en) * | 2020-10-27 | 2021-01-29 | 安徽商贸职业技术学院 | Reminding method and reminding system for articles carried out based on image recognition |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005216186A (en) * | 2004-01-30 | 2005-08-11 | Matsushita Electric Works Ltd | Lockup confirmation system |
| CN103258408A (en) * | 2013-05-31 | 2013-08-21 | 福州大学 | Electronic management system based on RFID |
| CN104464215A (en) * | 2014-11-25 | 2015-03-25 | 蒋代豪 | Reminding device preventing key forgetting |
| CN105357252A (en) * | 2015-05-25 | 2016-02-24 | 曹树槐 | Internet of things based separate alarm and overall control module and ultra-sensing management system |
| CN105389607A (en) * | 2015-11-23 | 2016-03-09 | 李明 | Thing forgetting prevention and intelligent prompting device and method based on electronic labels |
| CN106205071A (en) * | 2016-09-29 | 2016-12-07 | 成都市熵场科技有限公司 | Go out belongings prompt system and reminding method thereof |
| US20160379467A1 (en) * | 2015-06-26 | 2016-12-29 | Moralex Llc | Device to Alert Drivers to the Possibility of Forgetting Objects in Vehicle |
-
2017
- 2017-03-07 CN CN201710131171.1A patent/CN106960550A/en not_active Withdrawn
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005216186A (en) * | 2004-01-30 | 2005-08-11 | Matsushita Electric Works Ltd | Lockup confirmation system |
| CN103258408A (en) * | 2013-05-31 | 2013-08-21 | 福州大学 | Electronic management system based on RFID |
| CN104464215A (en) * | 2014-11-25 | 2015-03-25 | 蒋代豪 | Reminding device preventing key forgetting |
| CN105357252A (en) * | 2015-05-25 | 2016-02-24 | 曹树槐 | Internet of things based separate alarm and overall control module and ultra-sensing management system |
| US20160379467A1 (en) * | 2015-06-26 | 2016-12-29 | Moralex Llc | Device to Alert Drivers to the Possibility of Forgetting Objects in Vehicle |
| CN105389607A (en) * | 2015-11-23 | 2016-03-09 | 李明 | Thing forgetting prevention and intelligent prompting device and method based on electronic labels |
| CN106205071A (en) * | 2016-09-29 | 2016-12-07 | 成都市熵场科技有限公司 | Go out belongings prompt system and reminding method thereof |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110010241A (en) * | 2019-04-03 | 2019-07-12 | 温州康宁医院股份有限公司 | A kind of patient administration system that medical department uses |
| CN112185077A (en) * | 2019-07-01 | 2021-01-05 | 云丁网络技术(北京)有限公司 | Intelligent reminding method, device and system and camera equipment |
| CN111080848A (en) * | 2019-11-25 | 2020-04-28 | 星络智能科技有限公司 | Storage medium, intelligent panel and unlocking method based on intelligent panel |
| CN111554282A (en) * | 2020-04-20 | 2020-08-18 | 星络智能科技有限公司 | Switching method of voice control function, intelligent home controller and storage medium |
| CN112288912A (en) * | 2020-10-27 | 2021-01-29 | 安徽商贸职业技术学院 | Reminding method and reminding system for articles carried out based on image recognition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106960550A (en) | Electronic equipment monitoring system for prompting of going out based on image recognition | |
| CN107066977A (en) | Electronic equipment monitoring system for prompting based on state recognition of going out | |
| US20200228758A1 (en) | Smart doorbell system | |
| CN110598735B (en) | Visitor information reminding method and device | |
| CN107085927A (en) | Electronic equipment based on gesture identification is gone out system for prompting | |
| CN104570747B (en) | Intelligent floor mat and its application process and management method and intelligent floor mat system | |
| US10567711B1 (en) | Batteryless doorbell with rectified power delivery | |
| US20240029531A1 (en) | Integrated security for multiple access control systems | |
| CN108427298A (en) | User's inlet/outlet intelligent home control system based on image recognition | |
| CN106887120A (en) | Electronic equipment based on user's identification is gone out system for prompting | |
| US10867217B1 (en) | Fusion of visual and non-visual information for training deep learning models | |
| CN106465278A (en) | Ultrasound system with three-dimensional volume display | |
| CN107071710A (en) | Inlet/outlet speech-sound intelligent play system based on user's identification | |
| CN104742140B (en) | State decision-making system, condition judgement method and mobile robot | |
| CN110599747A (en) | User reminding method and device and intelligent doorbell system | |
| CN110599710A (en) | Reminding method and related equipment | |
| CN106781325A (en) | Electronic equipment based on speech recognition is gone out system for prompting | |
| CN106920304A (en) | Electronic equipment inlet/outlet identifying system | |
| CN106781314A (en) | Enter and guide key end storage system | |
| CN110264683A (en) | Mobile terminal of going out monitors based reminding method and system | |
| CN106812382A (en) | Monitor the intelligent door lock at electronics end of going out | |
| CN109068176A (en) | TV suspend mode control system | |
| CN106817494A (en) | Bluetooth equipment monitoring system based on switch door state | |
| CN107274640A (en) | Electronics end monitoring system for prompting of going out based on position judgment | |
| CN106652382A (en) | Electronic device wake-up system not in communication range |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20170718 |
|
| WW01 | Invention patent application withdrawn after publication |