EP2977973A1 - Monitoring device with volatile organic compounds sensor and system using same - Google Patents
Monitoring device with volatile organic compounds sensor and system using same Download PDFInfo
- Publication number
- EP2977973A1 EP2977973A1 EP15177627.5A EP15177627A EP2977973A1 EP 2977973 A1 EP2977973 A1 EP 2977973A1 EP 15177627 A EP15177627 A EP 15177627A EP 2977973 A1 EP2977973 A1 EP 2977973A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- organic compounds
- monitoring device
- room
- video monitoring
- baby
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 239000012855 volatile organic compound Substances 0.000 title claims abstract description 47
- 238000012806 monitoring device Methods 0.000 title claims abstract description 39
- 150000002894 organic compounds Chemical class 0.000 claims abstract description 20
- 238000004891 communication Methods 0.000 claims abstract description 4
- 238000000034 method Methods 0.000 claims description 22
- 239000003570 air Substances 0.000 claims description 15
- 230000036387 respiratory rate Effects 0.000 claims description 13
- UHOVQNZJYSORNB-UHFFFAOYSA-N Benzene Chemical compound C1=CC=CC=C1 UHOVQNZJYSORNB-UHFFFAOYSA-N 0.000 claims description 12
- 238000012544 monitoring process Methods 0.000 claims description 11
- 238000004458 analytical method Methods 0.000 claims description 10
- OKKJLVBELUTLKV-UHFFFAOYSA-N Methanol Chemical compound OC OKKJLVBELUTLKV-UHFFFAOYSA-N 0.000 claims description 9
- YXFVVABEGXRONW-UHFFFAOYSA-N Toluene Chemical compound CC1=CC=CC=C1 YXFVVABEGXRONW-UHFFFAOYSA-N 0.000 claims description 9
- 239000007789 gas Substances 0.000 claims description 8
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 claims description 6
- YNQLUTRBYVCPMQ-UHFFFAOYSA-N Ethylbenzene Chemical compound CCC1=CC=CC=C1 YNQLUTRBYVCPMQ-UHFFFAOYSA-N 0.000 claims description 6
- LRHPLDYGYMQRHN-UHFFFAOYSA-N N-Butanol Chemical compound CCCCO LRHPLDYGYMQRHN-UHFFFAOYSA-N 0.000 claims description 6
- ATUOYWHBWRKTHZ-UHFFFAOYSA-N Propane Chemical compound CCC ATUOYWHBWRKTHZ-UHFFFAOYSA-N 0.000 claims description 6
- OFBQJSOFQDEBGM-UHFFFAOYSA-N n-pentane Natural products CCCCC OFBQJSOFQDEBGM-UHFFFAOYSA-N 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 4
- 239000012080 ambient air Substances 0.000 claims description 3
- 150000001491 aromatic compounds Chemical class 0.000 claims description 3
- 239000001273 butane Substances 0.000 claims description 3
- IJDNQMDRQITEOD-UHFFFAOYSA-N n-butane Chemical compound CCCC IJDNQMDRQITEOD-UHFFFAOYSA-N 0.000 claims description 3
- TVMXDCGIABBOFY-UHFFFAOYSA-N octane Chemical compound CCCCCCCC TVMXDCGIABBOFY-UHFFFAOYSA-N 0.000 claims description 3
- BDERNNFJNOPAEC-UHFFFAOYSA-N propan-1-ol Chemical compound CCCO BDERNNFJNOPAEC-UHFFFAOYSA-N 0.000 claims description 3
- 239000001294 propane Substances 0.000 claims description 3
- 238000006722 reduction reaction Methods 0.000 claims description 3
- 238000001514 detection method Methods 0.000 description 16
- 230000033001 locomotion Effects 0.000 description 15
- 210000003128 head Anatomy 0.000 description 9
- 238000012545 processing Methods 0.000 description 4
- CSCPPACGZOOCGX-UHFFFAOYSA-N Acetone Chemical compound CC(C)=O CSCPPACGZOOCGX-UHFFFAOYSA-N 0.000 description 3
- 230000003750 conditioning effect Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- RWSOTUBLDIXVET-UHFFFAOYSA-N Dihydrogen sulfide Chemical compound S RWSOTUBLDIXVET-UHFFFAOYSA-N 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000003708 edge detection Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 150000002500 ions Chemical class 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000012882 sequential analysis Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- VXNZUUAINFGPBY-UHFFFAOYSA-N 1-Butene Chemical compound CCC=C VXNZUUAINFGPBY-UHFFFAOYSA-N 0.000 description 1
- 206010011469 Crying Diseases 0.000 description 1
- 206010038743 Restlessness Diseases 0.000 description 1
- 206010041349 Somnolence Diseases 0.000 description 1
- PPBRXRYQALVLMV-UHFFFAOYSA-N Styrene Chemical compound C=CC1=CC=CC=C1 PPBRXRYQALVLMV-UHFFFAOYSA-N 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 210000004712 air sac Anatomy 0.000 description 1
- 150000001299 aldehydes Chemical class 0.000 description 1
- IAQRGUVFOMOMEM-UHFFFAOYSA-N butene Natural products CC=CC IAQRGUVFOMOMEM-UHFFFAOYSA-N 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 239000002537 cosmetic Substances 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 229910000037 hydrogen sulfide Inorganic materials 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- WSFSSNUMVMOOMR-NJFSPNSNSA-N methanone Chemical compound O=[14CH2] WSFSSNUMVMOOMR-NJFSPNSNSA-N 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 230000000422 nocturnal effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/02416—Detecting, measuring or recording pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0004—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by the type of physiological signal transmitted
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
- A61B5/0816—Measuring devices for examining respiratory frequency
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
- A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique using image analysis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4803—Speech analysis specially adapted for diagnostic purposes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
- A61B5/7207—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/0004—Gaseous mixtures, e.g. polluted air
- G01N33/0009—General constructional details of gas analysers, e.g. portable test equipment
- G01N33/0027—General constructional details of gas analysers, e.g. portable test equipment concerning the detector
- G01N33/0036—General constructional details of gas analysers, e.g. portable test equipment concerning the detector specially adapted to detect a particular component
- G01N33/0047—Organic compounds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
- G06T7/0014—Biomedical image inspection using an image reference approach
- G06T7/0016—Biomedical image inspection using an image reference approach involving temporal comparison
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
- G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/0205—Specific application combined with child monitoring using a transmitter-receiver system
- G08B21/0208—Combination with audio or video communication, e.g. combination with "baby phone" function
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
- H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2503/00—Evaluating a particular growth phase or type of persons or animals
- A61B2503/04—Babies, e.g. for SIDS detection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
- A61B2560/02—Operational features
- A61B2560/0242—Operational features adapted to measure environmental factors, e.g. temperature, pollution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
- G06F2218/08—Feature extraction
- G06F2218/10—Feature extraction by analysing the shape of a waveform, e.g. extracting parameters relating to peaks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30076—Plethysmography
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
Definitions
- the present invention relates to video monitoring devices and methods.
- video monitoring devices and methods can be used to monitor a baby sleeping in its crib, with optionally an interaction between the baby and its parent or caregiver, either an audio interaction or a video/audio interaction
- the present invention is intended to overcome at least some of the disadvantages of the prior art.
- a video monitoring device comprising a computing unit, a camera, a communication interface, and a volatile organic compounds sensor configured to measure at least a concentration of organic compounds in a room of interest, said computing unit being configured to record the concentrations of organic compounds reported by the volatile organic compounds sensor, and configured to send images taken by the camera and volatile organic compounds concentrations to a remote entity, such as a smartphone over a wireless link.
- the invention also relates to a system comprising a monitoring device as described above and a smartphone.
- the invention also relates to a method to monitor events in a room and an air quality in the room, the method comprising :
- the transmission to the smartphone may occur at regular intervals.
- an alert threshold may be provided in the computing unit, the method further comprising:
- Figure 1 shows a baby B lying in a crib 13.
- baby is understood to mean an infant or child less than 10 years old. We are particularly interested in the case where the baby is placed in the crib for a nap or for the night.
- the general lighting in the room will be low or very low, referred to herein as dim or nocturnal conditions providing partial or total darkness.
- a video monitoring system comprises a video monitoring device 1 to be discussed in detail below, a mounting foot 12, and a mounting clamp 11.
- the mounting clamp is attached to a side rail of the crib or more generally of the bed. Note that in the monitoring assembly, it could also be secured to the crosspiece at the head or the foot of the bed.
- the monitoring assembly may also be located elsewhere in the room.
- the video monitoring device 1 may be attached to a different support, to a wall, to a bed canopy, etc.
- the video monitoring device 1 comprises a video camera 2, which has a wide viewing angle over a solid angle of at least 90° or more (110° or 135°) so that the camera can capture images of the entire relevant area of the crib or even the entire room of interest.
- the monitoring device comprises light-emitting diodes 3 (LED) capable of emitting in the infrared band, thus forming a source of infrared light.
- LED light-emitting diodes
- the video monitoring device 1 further comprises a computing unit 4 with a memory 40 as well as a battery 28 or alternatively a power supply unit connecting to the grid.
- the video monitoring device 1 preferably also comprises a wireless communication interface 42 configured for exchanging data with a remote entity such as a smartphone 22.
- the video monitoring device 1 may further comprise a microphone 9 for capturing sound, and a sound generator in the form of a small speaker 19.
- a light source 23 for dim atmospheric lighting whose intensity can be controlled by the monitoring device, an air quality sensor 37 , and auxiliary sensors 27 for example for sensing temperature and/or humidity and/or air quality.
- the video monitoring device 1 may further comprise one or more buttons 18 , intended to be operated by a user (for example to configure the device, turn it on and turn it off) as well as a small display 15 for displaying states or parameters of the device (in which case the buttons 18 may be touch-sensitive).
- buttons 18 intended to be operated by a user (for example to configure the device, turn it on and turn it off) as well as a small display 15 for displaying states or parameters of the device (in which case the buttons 18 may be touch-sensitive).
- the device may comprise a connector 74 , and holes 9' near the bottom of the front face to improve pickup by the microphone. Holes 9' also favor sampling of ambient air for the purpose of air quality sensing as detailed below.
- the camera 2 periodically captures video images 5 of the baby B .
- the image capture frequency will be a few hertz or tens of hertz, preferably higher than 8 Hz. It should be noted that in the context of the invention the same camera is used to capture images in daylight and images in the dark.
- An optical filter may be provided having two positions, i.e. a day position and a night position.
- the device controls excitation of the infrared LEDs 3 either continuously or at times coinciding and consistent with the capture of images.
- the infrared LEDs are arranged so as to substantially illuminate the entire solid angle of view of the camera.
- the method for image processing and analysis will seek to determine the position of the baby's head T.
- a step of the method denoted B1 consists of detecting edges or edge segments in one or more successive images captured by the camera.
- Identification of these edge segments can be confirmed by sequential analysis of several successive images; if similar edge segments are found at the same location in these multiple images, then the determination is confirmed.
- a relevance criterion is established for quantifying the correspondence of the combined edge segments 62,64 with the candidate ellipse.
- This step may in addition identify a plurality of candidate ellipses, in which case a selection filter is applied to the candidate ellipses to choose only one selected ellipse 6 coinciding with the outline of the baby's head T.
- This filter may use the size of the ellipse, the ratio of its major axis to minor axis, and also the proportion of the outline actually found in the previous step.
- the selection of such a selected ellipse 6 allows eliminating from the subsequent analysis all image areas outside of the ellipse, and defining an area of interest centered on the ellipse.
- step denoted C of the method is carried out, this step corresponding to a photoplethysmographic analysis intended to determine vital signs of the baby, particularly the heart rate HR but also the respiratory rate RR.
- a first area of interest 7 for evaluating the heart rate e.g. forehead
- a second area of interest that may be distinct from the first for evaluating the respiratory rate.
- the heart rate determination first there is applied to the light signal spatially averaged over the first area of interest, a sliding-window based offset calculation to eliminate the continuous component of the signal.
- a sliding-window based offset calculation to eliminate the continuous component of the signal.
- a digital filter with passband of 0.75 Hz - 3.5 Hz is applied to the signal 80 in order to obtain a filtered signal 81. This eliminates spurious signals outside the frequency band of interest.
- a peak detection step is then applied to the resulting filtered signal 81. This processing is intended to find the peaks 86 (only the first ones are indicated by crosses in figure 7 ).
- the time interval between each consecutive peak 86 allows calculating the heart rate as illustrated in curve 82.
- a validity criterion relating to the relevance of the filtered signal 8 may be defined, to be used for selectively validating or not validating the heart rate information.
- This validity criterion may be based on the signal-to-noise ratio (S/N) of the signal 81 .
- a filtered and corrected signal is denoted 83 .
- this value may be stored in memory and/or transmitted to a remote device 22 such as a smartphone connected by wireless link to the monitoring device 1.
- Step C is carried out almost continuously, repeating periodically, for example obtaining a measurement every 5 seconds or every 10 seconds, knowing that to obtain each measurement, when appropriate, the device can increase the rate at which it captures images in the area of interest.
- step C the method monitors that the baby is remaining substantially motionless, or in other words that the edge segments identified in step B1 remain substantially stable.
- a special case is handled by the method according to the invention: when there is significant (macroscopic) movement of the baby. In this case, the baby's head moves, and the head's position must be determined again.
- Detection of a significant movement of the baby can be achieved by analysis of the position of the edge segments and their evolution over successive images. Additionally or alternatively, the information provided by the microphone 9 can also be used, because a macroscopic motion of the baby will generate audio signals received by the microphone.
- step D the evolution of these movements are monitored (the step denoted D) in order to identify a return to a stable state where there is no significant movement by the baby, in which case steps B1-B2 are performed again, step C- of photoplethysmographic analysis being repeated with the new area of interest 7 established in step B2.
- the abovementioned processing may be performed on the entire captured image 5.
- the image may be subdivided to limit the computation resources required and the memory required.
- the captured image 5 can be divided into an array of sub-images 50 , each sub-image 50 being the same size to facilitate processing.
- the captured image is divided into 5x5 sub-images.
- One criterion for eliminating the sub-images 50 of no interest can be based on a low light intensity and/or a low variation in the analyzed area.
- the transition 96 initializes the plethysmographic analysis (C-), and this is repeated (denoted 95) as long the baby is not moving. If the baby moves, then the plethysmographic analysis is suspended 97,98 and the step of monitoring the macroscopic movements (step D) puts the plethysmographic process on hold until a stable state is restored, illustrated by transition 99. Then the method restarts steps B1-B2, and then proceeds to step C-.
- the device installation does not require any special precautions, as automatic detection of the baby's head is possible even if the framing by the camera is not perfect relative to the crib.
- the method for detecting the baby's head as disclosed above can also function in the daytime under natural lighting, and not only under dark illumination conditions.
- the video monitoring device 1 further comprises a volatile organic compounds sensor 37 (known as a 'VOC' sensor).
- a volatile organic compounds sensor 37 can detect several organic gases, such as butane, propane, octane, methanol, ethanol, propanol, butanol, and even aromatic compounds such as benzene, ethylbenzene, and toluene.
- the baby monitoring device may record the concentration of organic compounds during one or more periods of time, and send this information either in real time or in deferred mode to the smartphone 22.
- volatile organic compounds sensor 37 can detect hydrogen sulfide (H2S) concentration.
- some organic compounds can be released at home by cosmetics, cleaning products, fresh paint, new piece of furniture, they can include aldehydes, formaldehyde, methylene, toluene, acetone, butene, pentane, benzene or the like.
- the VOC sensor 37 in question is an electrochemical MOS on-chip sensor.
- the sensing element comprises a metal oxyde semiconductor layer reacting with VOCs by oxydation-reduction reactions.
- the conductivity of the metal-oxyde semiconductor increases depending on the gas concentration in the air.
- a simple electrical circuit converts this conductivity into an output voltage which is measured. This voltage is then converted into a concentration level of VOCs in the room by the microcontroller. This conversion may be done by looking at a calibration look-up table, or by calculating a calibration function, and possibly after adjusting for other quantities provided by other sensors, for instance the temperature and/or humidity.
- the VOC sensor 37 can alternatively be an ion detector using photoionization of the molecules in an air sample collected in the room where the baby's crib is located.
- the VOC sensor 37 provides an aggregate level of organic compounds which combines all the organic compounds present.
- the already mentioned humidity sensor 27 is used to compensate for the possible presence of water vapor in the sampled air and for correcting accordingly the sensed VOC concentration level.
- VOC concentration level(s) is(are) transmitted to smartphone user, he/she can decide to ventilate/air the room in which the device is located.
- a VOC scale can be provided on a smartphone application to help the user decide whether it is required to ventilate/air the room.
- collected values of predefined period of time can be used to correlate the heart rate HR and/or respiratory rate RR with the VOC concentration levels in order to determine if the baby was affected by a certain level of VOCs at some time.
- a detection sheet 72 may be provided that acts as a motion sensor, as shown in figure 9 .
- This detection sheet 72 is installed on the mattress and the baby B is placed above it, in other words the detection sheet 72 is placed between the baby B and the mattress.
- the detection sheet may comprise a signal conditioning interface 77 and is connected to the monitoring device 1 by a flexible link 73, either electrical or pneumatic or a combination. This link 73 is connected to the device via the connector 74.
- the signal conditioning may be performed by the conditioning interface 77 or even directly wholly or in part by the monitoring device itself.
- the detection sheet is formed by a thin air bladder, which allows detecting the baby's movements by ballistography.
- atmospheric lighting is provided by the atmospheric lighting means 23 and soft music through the speaker 19, both of them preferably decreasing in intensity.
- the beginning of the drowsiness phase can be detected by video determination of the heart rate as explained above.
- the control unit 4 triggers the light and sound sequence.
- the computing unit uses not only the heart rate information but also the respiratory rate information detected for example by means of the microphone 9 and/or of said detection sheet 72 .
- the computing unit 4 may also use video detection of movements of the baby's head T by means of the edge detection method as explained above.
- the computing unit 4 When the computing unit 4 has triggered the sound and light sequence to assist with falling asleep and the baby starts to move about or to cry, then the sequence can be extended or restarted at the beginning.
- the monitoring device turns the atmospheric lighting completely off and switches to night monitoring mode.
- the video monitoring device can save the highlights of the day and/or night, in other words it can save images of events which occurred earlier; for example, based on detection of movement near the baby, saving images and audio whenever someone enters or leaves the room, and based on detection of crying, saving images and audio whenever the baby starts to cry, whenever there is a significant change in environmental parameters, whenever the baby smiles, etc.
- the video monitoring device can generate an alert sent to a remote device such as a smartphone or other device, upon detection of abnormal conditions such as environmental parameters exceeding preset thresholds, an unusually quiet or unusually restless environment, movement, pollution detection, etc.
- a remote device such as a smartphone or other device
- the video monitoring device can be equipped with a two-way simultaneous audio connection, in other words a full-duplex connection, which allows the parent(s) and baby to exchange words or sound signals truly at the same time.
- the video monitoring device can simply monitor what happens generally in a room of a home.
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Pathology (AREA)
- Medical Informatics (AREA)
- Physiology (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Biophysics (AREA)
- Public Health (AREA)
- Heart & Thoracic Surgery (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Cardiology (AREA)
- Chemical & Material Sciences (AREA)
- Theoretical Computer Science (AREA)
- Pulmonology (AREA)
- Signal Processing (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Multimedia (AREA)
- Immunology (AREA)
- Biochemistry (AREA)
- Analytical Chemistry (AREA)
- Medicinal Chemistry (AREA)
- Food Science & Technology (AREA)
- Combustion & Propulsion (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Dentistry (AREA)
- Psychiatry (AREA)
- Artificial Intelligence (AREA)
- Quality & Reliability (AREA)
- Child & Adolescent Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Emergency Management (AREA)
Abstract
Description
- The present invention relates to video monitoring devices and methods. For example, such video monitoring devices and methods can be used to monitor a baby sleeping in its crib, with optionally an interaction between the baby and its parent or caregiver, either an audio interaction or a video/audio interaction
- More specifically, it is known in the art a method and device for monitoring certain vital signs of the baby, in particular the heart rate and respiratory rate.
-
US8094013 andWO2013170035 disclose devices of this type. - However, the need to improve such known devices and more generally to improve general purpose indoor video monitoring devices/systems has been identified by the inventors.
- The present invention is intended to overcome at least some of the disadvantages of the prior art.
- To this end, it is proposed a video monitoring device comprising a computing unit, a camera, a communication interface, and a volatile organic compounds sensor configured to measure at least a concentration of organic compounds in a room of interest, said computing unit being configured to record the concentrations of organic compounds reported by the volatile organic compounds sensor, and configured to send images taken by the camera and volatile organic compounds concentrations to a remote entity, such as a smartphone over a wireless link.
- With these arrangements, video surveillance can be advantageously complemented by remote surveillance of air quality in a room. Also, images and VOC levels can be analyzed in correlation.
It is noted that volatile organic compounds is called in short 'VOC'. - In various embodiments of the above invention, one or more of the following arrangements may possibly be used.
- the volatile organic compounds sensor (37) is configured to detect multiple organic gases, such as butane, propane, octane, methanol, ethanol, propanol, butanol, and even aromatic compounds such as benzene, ethylbenzene, and toluene; most usual gases that are nocive or at least not particularly healthy to breathe, that may be present in a room of a home, can be detected;
- the volatile organic compounds sensor is configured to detect H2S; this allows detection of something with is decomposing or rotting in the room;
- the volatile organic compounds sensor can be complemented by a humidity sensor to compensate for water vapour in air; improving accuracy;
- the computing unit can store successive organic compound concentration level values in memory, for transmission at regular intervals to the remote entity; this decreases the load on wireless network;
- an alert threshold can be provided in the computing unit, which allows to send immediately to the smartphone an alert message, as soon as the VOC concentration exceeds the predetermined alert threshold;
- the VOC sensor can be an ion detector using photoionization of the molecules in an air sample collected in the room of interest;
- the VOC sensor can be an electrochemical MOS on-chip sensor using oxydation-reduction reactions with gas(es) present in ambient air, to assess VOC concentration level; this facilitates integration of the sensor in the device;
- the VOC sensor provides an aggregate level of organic compounds which combines all the organic compounds present in the air of the room.
- Some vital signs of a baby, such as the heart rate (HR) and/or respiratory rate (RR) of the baby are evaluated by photoplethysmographic analysis of the captured images, thereby the video monitoring device forms a device suitable for monitoring a baby in a room or in a crib; a correlation between on one hand VOC levels and on the other hand heart rate (HR) and/or respiratory rate (RR) can be assessed; R8 The video monitoring device may comprise a loudspeaker and a microphone, thereby forming two-way audio link, particularly suitable for interacting with a baby in a room or in a crib, remotely from a parent/caretaker using the smartphone
- The invention also relates to a system comprising a monitoring device as described above and a smartphone.
- The invention also relates to a method to monitor events in a room and an air quality in the room, the method comprising :
- measuring a concentration of organic compounds in a room with a volatile organic compounds sensor,
- taking images of at least part of the room,
- storing the organic compound concentration data in a memory of a computing unit,
- send images taken by the camera and volatile organic compounds concentrations, from the computing unit to a remote entity such as a smartphone over a wireless link.
- In addition, optionally, the transmission to the smartphone may occur at regular intervals.
- In addition, optionally an alert threshold may be provided in the computing unit, the method further comprising:
- sending quickly to the smartphone an alert message, as soon as the VOC concentration exceeds the predetermined alert threshold.
- Other features, objects, and advantages of the invention will be apparent from reading the following description of an embodiment of the invention, given by way of non-limiting example. The invention will also be better understood by referring to the accompanying drawings, in which:
-
figure 1 is a general view of a crib containing a baby to be monitored by a method according to the invention, -
figure 2 is a view of the video monitoring device, -
figure 3 shows a schematic block diagram of the device offigure 2 , -
figure 4 represents a sample image captured by the camera, -
figure 5 illustrates the construction of edge segments, -
figure 6 illustrates the selection of an ellipse and of the area of interest, -
figure 7 illustrates an example of a filtered signal, -
figure 8 shows a flowchart illustrating the method, -
figure 9 illustrates a variant of the monitoring device with a detection sheet. - In the various figures, the same references designate identical or similar elements.
-
Figure 1 shows a baby B lying in acrib 13. In the context of the invention, baby is understood to mean an infant or child less than 10 years old. We are particularly interested in the case where the baby is placed in the crib for a nap or for the night. Typically, in this configuration, the general lighting in the room will be low or very low, referred to herein as dim or nocturnal conditions providing partial or total darkness. - In the example shown, a video monitoring system, denoted 10, comprises a
video monitoring device 1 to be discussed in detail below, a mountingfoot 12, and amounting clamp 11. In the example shown, the mounting clamp is attached to a side rail of the crib or more generally of the bed. Note that in the monitoring assembly, it could also be secured to the crosspiece at the head or the foot of the bed. - Alternatively, the monitoring assembly may also be located elsewhere in the room.
- The
video monitoring device 1 may be attached to a different support, to a wall, to a bed canopy, etc. - As illustrated in more detail in
figure 2 , thevideo monitoring device 1 comprises avideo camera 2, which has a wide viewing angle over a solid angle of at least 90° or more (110° or 135°) so that the camera can capture images of the entire relevant area of the crib or even the entire room of interest. - In addition, the monitoring device comprises light-emitting diodes 3 (LED) capable of emitting in the infrared band, thus forming a source of infrared light.
- The
video monitoring device 1 further comprises acomputing unit 4 with amemory 40 as well as abattery 28 or alternatively a power supply unit connecting to the grid. - The
video monitoring device 1 preferably also comprises awireless communication interface 42 configured for exchanging data with a remote entity such as asmartphone 22. - The
video monitoring device 1 may further comprise amicrophone 9 for capturing sound, and a sound generator in the form of asmall speaker 19. - In addition, there may be a
light source 23 for dim atmospheric lighting whose intensity can be controlled by the monitoring device, anair quality sensor 37, andauxiliary sensors 27 for example for sensing temperature and/or humidity and/or air quality. - The
video monitoring device 1 may further comprise one ormore buttons 18, intended to be operated by a user (for example to configure the device, turn it on and turn it off) as well as asmall display 15 for displaying states or parameters of the device (in which case thebuttons 18 may be touch-sensitive). - The device may comprise a
connector 74, and holes 9' near the bottom of the front face to improve pickup by the microphone. Holes 9' also favor sampling of ambient air for the purpose of air quality sensing as detailed below. - Advantageously according to the invention, the
camera 2 periodically capturesvideo images 5 of the baby B. The image capture frequency will be a few hertz or tens of hertz, preferably higher than 8 Hz. It should be noted that in the context of the invention the same camera is used to capture images in daylight and images in the dark. - An optical filter may be provided having two positions, i.e. a day position and a night position.
- The device controls excitation of the
infrared LEDs 3 either continuously or at times coinciding and consistent with the capture of images. The infrared LEDs are arranged so as to substantially illuminate the entire solid angle of view of the camera. - Advantageously in the case of baby monitoring, the method for image processing and analysis will seek to determine the position of the baby's head T.
- To do so, a step of the method, denoted B1, consists of detecting edges or edge segments in one or more successive images captured by the camera.
- For each image, spatial convolution with statistical thresholding is performed, or calculation of the correlation to the mean of the red component or of the configured mix of colors. This allows identifying and memorizing the
curve portions - Identification of these edge segments can be confirmed by sequential analysis of several successive images; if similar edge segments are found at the same location in these multiple images, then the determination is confirmed.
- Otherwise it may concern a macroscopic movement of the baby, a case which will be explained below.
- When sequential analysis of several successive images has confirmed the presence of several edge segments, we proceed to the next step in which several edge segments are associated and together they are compared to an elliptical shape (ellipse) with which said several edge segments might match.
- A relevance criterion is established for quantifying the correspondence of the combined
edge segments - Of course, if a continuous outline is found which forms a circle or a closed ellipse in the analyzed image, then the relevance criterion will assume the maximum value; but in practice often the image analysis only detects portions of the candidate ellipse, and the ellipse must be reconstructed and assigned a relevance criterion value.
- This step, referenced B2, may in addition identify a plurality of candidate ellipses, in which case a selection filter is applied to the candidate ellipses to choose only one selected
ellipse 6 coinciding with the outline of the baby's head T. This filter may use the size of the ellipse, the ratio of its major axis to minor axis, and also the proportion of the outline actually found in the previous step. - In the typical case of one head to be detected, the selection of such a selected
ellipse 6 allows eliminating from the subsequent analysis all image areas outside of the ellipse, and defining an area of interest centered on the ellipse. - Once the area of interest has been determined, and subject to the baby making no significant movements (see below), then the step denoted C of the method is carried out, this step corresponding to a photoplethysmographic analysis intended to determine vital signs of the baby, particularly the heart rate HR but also the respiratory rate RR.
- Advantageously, one can determine a first area of
interest 7 for evaluating the heart rate (e.g. forehead), and a second area of interest that may be distinct from the first, for evaluating the respiratory rate. - Preferably, for the heart rate determination, first there is applied to the light signal spatially averaged over the first area of interest, a sliding-window based offset calculation to eliminate the continuous component of the signal. This results in a signal denoted 80 in
figure 7 , which remains relatively noisy but no longer contains a continuous component. - Next, a digital filter with passband of 0.75 Hz - 3.5 Hz is applied to the
signal 80 in order to obtain a filteredsignal 81. This eliminates spurious signals outside the frequency band of interest. - A peak detection step is then applied to the resulting filtered
signal 81. This processing is intended to find the peaks 86 (only the first ones are indicated by crosses infigure 7 ). - The time interval between each
consecutive peak 86 allows calculating the heart rate as illustrated incurve 82. - Optionally, a validity criterion relating to the relevance of the filtered signal 8 may be defined, to be used for selectively validating or not validating the heart rate information. This validity criterion may be based on the signal-to-noise ratio (S/N) of the
signal 81. - A filtered and corrected signal is denoted 83.
- If the heart rate value from step C satisfies the validity criterion, this value may be stored in memory and/or transmitted to a
remote device 22 such as a smartphone connected by wireless link to themonitoring device 1. - Step C is carried out almost continuously, repeating periodically, for example obtaining a measurement every 5 seconds or every 10 seconds, knowing that to obtain each measurement, when appropriate, the device can increase the rate at which it captures images in the area of interest.
- In parallel to step C, the method monitors that the baby is remaining substantially motionless, or in other words that the edge segments identified in step B1 remain substantially stable.
- A special case is handled by the method according to the invention: when there is significant (macroscopic) movement of the baby. In this case, the baby's head moves, and the head's position must be determined again.
- Detection of a significant movement of the baby can be achieved by analysis of the position of the edge segments and their evolution over successive images. Additionally or alternatively, the information provided by the
microphone 9 can also be used, because a macroscopic motion of the baby will generate audio signals received by the microphone. - Those skilled in the art understand that a plethysmographic analysis cannot yield valid results when the baby is making significant movements.
- However, it is arranged that the evolution of these movements are monitored (the step denoted D) in order to identify a return to a stable state where there is no significant movement by the baby, in which case steps B1-B2 are performed again, step C- of photoplethysmographic analysis being repeated with the new area of
interest 7 established in step B2. - The abovementioned processing may be performed on the entire captured
image 5. However, as a variant, the image may be subdivided to limit the computation resources required and the memory required. For example, the capturedimage 5 can be divided into an array of sub-images 50, each sub-image 50 being the same size to facilitate processing. In the illustrated example, the captured image is divided into 5x5 sub-images. - This has the advantage that certain images of flat or
neutral content 50a (meaning with no significant variation in color or intensity over the area of the sub-image) can be eliminated during the edge detection in step B1. One criterion for eliminating thesub-images 50 of no interest can be based on a low light intensity and/or a low variation in the analyzed area. - Now referring to
figure 8 , since steps B1-B2 have identified an area of interest, thetransition 96 initializes the plethysmographic analysis (C-), and this is repeated (denoted 95) as long the baby is not moving. If the baby moves, then the plethysmographic analysis is suspended 97,98 and the step of monitoring the macroscopic movements (step D) puts the plethysmographic process on hold until a stable state is restored, illustrated bytransition 99. Then the method restarts steps B1-B2, and then proceeds to step C-. - It should also be noted that the device installation does not require any special precautions, as automatic detection of the baby's head is possible even if the framing by the camera is not perfect relative to the crib.
- It should be noted that the method for detecting the baby's head as disclosed above can also function in the daytime under natural lighting, and not only under dark illumination conditions.
- The
video monitoring device 1 further comprises a volatile organic compounds sensor 37 (known as a 'VOC' sensor). Such a sensor can detect several organic gases, such as butane, propane, octane, methanol, ethanol, propanol, butanol, and even aromatic compounds such as benzene, ethylbenzene, and toluene. The baby monitoring device may record the concentration of organic compounds during one or more periods of time, and send this information either in real time or in deferred mode to thesmartphone 22. - Also the volatile
organic compounds sensor 37 can detect hydrogen sulfide (H2S) concentration. - Regarding VOCs, some organic compounds can be released at home by cosmetics, cleaning products, fresh paint, new piece of furniture, they can include aldehydes, formaldehyde, methylene, toluene, acetone, butene, pentane, benzene or the like.
- The
VOC sensor 37 in question is an electrochemical MOS on-chip sensor. The sensing element comprises a metal oxyde semiconductor layer reacting with VOCs by oxydation-reduction reactions. In the presence of a detectable gas, the conductivity of the metal-oxyde semiconductor increases depending on the gas concentration in the air. A simple electrical circuit converts this conductivity into an output voltage which is measured. This voltage is then converted into a concentration level of VOCs in the room by the microcontroller. This conversion may be done by looking at a calibration look-up table, or by calculating a calibration function, and possibly after adjusting for other quantities provided by other sensors, for instance the temperature and/or humidity. - The
VOC sensor 37 can alternatively be an ion detector using photoionization of the molecules in an air sample collected in the room where the baby's crib is located. - The
VOC sensor 37 provides an aggregate level of organic compounds which combines all the organic compounds present. - Advantageously, the already mentioned
humidity sensor 27 is used to compensate for the possible presence of water vapor in the sampled air and for correcting accordingly the sensed VOC concentration level. - Advantageously, since the VOC concentration level(s) is(are) transmitted to smartphone user, he/she can decide to ventilate/air the room in which the device is located. Furthermore, a VOC scale can be provided on a smartphone application to help the user decide whether it is required to ventilate/air the room.
- Regarding the case of monitoring the baby, collected values of predefined period of time can be used to correlate the heart rate HR and/or respiratory rate RR with the VOC concentration levels in order to determine if the baby was affected by a certain level of VOCs at some time.
- In addition, a
detection sheet 72 may be provided that acts as a motion sensor, as shown infigure 9 . Thisdetection sheet 72 is installed on the mattress and the baby B is placed above it, in other words thedetection sheet 72 is placed between the baby B and the mattress. The detection sheet may comprise asignal conditioning interface 77 and is connected to themonitoring device 1 by aflexible link 73, either electrical or pneumatic or a combination. Thislink 73 is connected to the device via theconnector 74. The signal conditioning may be performed by theconditioning interface 77 or even directly wholly or in part by the monitoring device itself. - In the example illustrated, the detection sheet is formed by a thin air bladder, which allows detecting the baby's movements by ballistography.
- To help the baby fall asleep more quickly and more easily, atmospheric lighting is provided by the atmospheric lighting means 23 and soft music through the
speaker 19, both of them preferably decreasing in intensity. - To trigger the light and sound sequence, the beginning of the drowsiness phase can be detected by video determination of the heart rate as explained above. When the
heart rate 82 slows and becomes more regular, then thecontrol unit 4 triggers the light and sound sequence. - Alternatively, the computing unit uses not only the heart rate information but also the respiratory rate information detected for example by means of the
microphone 9 and/or of saiddetection sheet 72. Thecomputing unit 4 may also use video detection of movements of the baby's head T by means of the edge detection method as explained above. - When the
computing unit 4 has triggered the sound and light sequence to assist with falling asleep and the baby starts to move about or to cry, then the sequence can be extended or restarted at the beginning. - If the sound and light sequence comes to an end with no change in the heart rate and with no movement of the baby, then the monitoring device turns the atmospheric lighting completely off and switches to night monitoring mode.
- In a particular aspect, the video monitoring device can save the highlights of the day and/or night, in other words it can save images of events which occurred earlier; for example, based on detection of movement near the baby, saving images and audio whenever someone enters or leaves the room, and based on detection of crying, saving images and audio whenever the baby starts to cry, whenever there is a significant change in environmental parameters, whenever the baby smiles, etc.
- According to a particular aspect, the video monitoring device can generate an alert sent to a remote device such as a smartphone or other device, upon detection of abnormal conditions such as environmental parameters exceeding preset thresholds, an unusually quiet or unusually restless environment, movement, pollution detection, etc.
- Lastly, according to a particular aspect, the video monitoring device can be equipped with a two-way simultaneous audio connection, in other words a full-duplex connection, which allows the parent(s) and baby to exchange words or sound signals truly at the same time.
- As a variant, instead of a baby, the video monitoring device can simply monitor what happens generally in a room of a home.
Claims (12)
- Video monitoring device (1) comprising a computing unit (4), a camera (2), a communication interface (42), and a volatile organic compounds sensor (37) configured to measure at least a concentration of organic compounds in a room of interest, said computing unit being configured to record the concentrations of organic compounds reported by the volatile organic compounds sensor, and configured to send images taken by the camera and volatile organic compounds concentrations to a remote entity, such as a smartphone (22) over a wireless link.
- Video monitoring device according to claim 1, wherein the volatile organic compounds sensor (37) configured to detect multiple organic gases, such as butane, propane, octane, methanol, ethanol, propanol, butanol, and even aromatic compounds such as benzene, ethylbenzene, and toluene.
- Video monitoring device according to any of claims 1-2, wherein the computing unit stores successive organic compound concentration level value in memory, for transmission at regular intervals to the remote entity.
- Video monitoring device according to any of claims 1-3, wherein an alert threshold is provided in the computing unit, which allows to send immediately to the smartphone an alert message, as soon as the VOC concentration level exceeds the predetermined alert threshold.
- Video monitoring device according to any of claims 1-4, wherein the VOC sensor (37) is an electrochemical MOS on-chip sensor using oxydation-reduction reactions with gas(es) present in ambient air, whereby a VOC concentration level can be measured.
- Video monitoring device according to any of claims 1-5, wherein the VOC sensor provides an aggregate level of organic compounds which combines all the organic compounds present in the air of the room.
- Video monitoring device according to any of claims 1-6, wherein some vital signs of a baby, such as the heart rate (HR) and/or respiratory rate (RR) of the baby are evaluated by photoplethysmographic analysis of the captured images, thereby forming a device suitable for monitoring a baby in a room or in a crib.
- Video monitoring device according any of claims 1-7, further comprising a loudspeaker and a microphone, thereby forming two-way audio link, particularly suitable for interacting with a baby in a room or in a crib, remotely from a parent/caretaker using the smartphone.
- Video monitoring system comprising a monitoring device (1) according any of claims 1-8, and a smartphone (22).
- Method to monitor events in a room and an air quality in the room, the method comprising:- measuring a concentration of organic compounds in a room with a volatile organic compounds sensor (37)- taking images of at least part of the room,- storing the organic compound concentration data in a memory of a computing unit (4),- send images taken by the camera and volatile organic compounds concentrations, from the computing unit to a remote entity such as a smartphone (22) over a wireless link.
- Method to according to claim 10, wherein the transmission to the smartphone occurs at regular intervals.
- Method to according to claim 10, wherein an alert threshold is provided in the computing unit, the method further comprising:- sending quickly to the smartphone an alert message, as soon as the VOC concentration exceeds the predetermined alert threshold.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1456996A FR3023699B1 (en) | 2014-07-21 | 2014-07-21 | METHOD AND DEVICE FOR MONITORING A BABY AND INTERACTING |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2977973A1 true EP2977973A1 (en) | 2016-01-27 |
EP2977973B1 EP2977973B1 (en) | 2018-06-06 |
Family
ID=51485782
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15177357.9A Active EP2976998B1 (en) | 2014-07-21 | 2015-07-17 | Method and device for monitoring a baby and for interaction |
EP17206100.4A Withdrawn EP3321909A1 (en) | 2014-07-21 | 2015-07-17 | Method and device for monitoring a baby and for interaction |
EP15177627.5A Active EP2977973B1 (en) | 2014-07-21 | 2015-07-21 | Monitoring device with volatile organic compounds sensor and system using same |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15177357.9A Active EP2976998B1 (en) | 2014-07-21 | 2015-07-17 | Method and device for monitoring a baby and for interaction |
EP17206100.4A Withdrawn EP3321909A1 (en) | 2014-07-21 | 2015-07-17 | Method and device for monitoring a baby and for interaction |
Country Status (3)
Country | Link |
---|---|
US (2) | US10694956B2 (en) |
EP (3) | EP2976998B1 (en) |
FR (1) | FR3023699B1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11353381B1 (en) | 2020-06-09 | 2022-06-07 | Applied Materials, Inc. | Portable disc to measure chemical gas contaminants within semiconductor equipment and clean room |
Families Citing this family (69)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017196695A2 (en) * | 2016-05-08 | 2017-11-16 | Udisense Inc. | Monitoring camera and mount |
US11297284B2 (en) | 2014-04-08 | 2022-04-05 | Udisense Inc. | Monitoring camera and mount |
US10708550B2 (en) | 2014-04-08 | 2020-07-07 | Udisense Inc. | Monitoring camera and mount |
JP5866539B1 (en) * | 2014-11-21 | 2016-02-17 | パナソニックIpマネジメント株式会社 | Communication system and sound source reproduction method in communication system |
GB201601143D0 (en) | 2016-01-21 | 2016-03-09 | Oxehealth Ltd | Method and apparatus for health and safety monitoring of a subject in a room |
GB201601140D0 (en) | 2016-01-21 | 2016-03-09 | Oxehealth Ltd | Method and apparatus for estimating heart rate |
GB201601217D0 (en) | 2016-01-22 | 2016-03-09 | Oxehealth Ltd | Signal processing method and apparatus |
USD854074S1 (en) | 2016-05-10 | 2019-07-16 | Udisense Inc. | Wall-assisted floor-mount for a monitoring camera |
US10539268B2 (en) | 2016-07-13 | 2020-01-21 | Chigru Innovations (OPC) Private Limited | Oscillation systems |
US9867597B1 (en) | 2016-07-13 | 2018-01-16 | Withings | Method and system to notify female fertility period |
US10357117B2 (en) | 2016-07-13 | 2019-07-23 | Chigru Innovations (OPC) Private Limited | Rocking cradle |
US10447972B2 (en) | 2016-07-28 | 2019-10-15 | Chigru Innovations (OPC) Private Limited | Infant monitoring system |
GB201615899D0 (en) | 2016-09-19 | 2016-11-02 | Oxehealth Ltd | Method and apparatus for image processing |
US10885349B2 (en) | 2016-11-08 | 2021-01-05 | Oxehealth Limited | Method and apparatus for image processing |
EP3378386A1 (en) * | 2017-03-22 | 2018-09-26 | Koninklijke Philips N.V. | Method and apparatus for determining a health status of an infant |
GB201706449D0 (en) | 2017-04-24 | 2017-06-07 | Oxehealth Ltd | Improvements in or realting to in vehicle monitoring |
US10939833B2 (en) * | 2017-05-01 | 2021-03-09 | Samsung Electronics Company, Ltd. | Determining artery location using camera-based sensing |
US10399409B2 (en) * | 2017-05-16 | 2019-09-03 | GM Global Technology Operations LLC | System and method for reducing volatile organic compounds within a vehicle |
US11385213B2 (en) | 2017-05-17 | 2022-07-12 | Astronics Advanced Electronic Systems Corp. | Storage bin volume sensor with VOC sensing safety feature |
CN107260173B (en) * | 2017-06-30 | 2019-05-10 | 大连理工大学 | A kind of breath measuring method based on camera Yu spherical marker |
USD855684S1 (en) | 2017-08-06 | 2019-08-06 | Udisense Inc. | Wall mount for a monitoring camera |
CN107682665B (en) * | 2017-09-13 | 2021-04-16 | 维沃移动通信有限公司 | Monitoring method and mobile terminal |
US10921763B1 (en) * | 2017-10-25 | 2021-02-16 | Alarm.Com Incorporated | Baby monitoring using a home monitoring system |
TW201918219A (en) * | 2017-11-07 | 2019-05-16 | 財團法人資訊工業策進會 | System and method for identifying baby needs |
US10760803B2 (en) | 2017-11-21 | 2020-09-01 | Emerson Climate Technologies, Inc. | Humidifier control systems and methods |
US10874332B2 (en) * | 2017-11-22 | 2020-12-29 | Udisense Inc. | Respiration monitor |
GB2571125A (en) * | 2018-02-19 | 2019-08-21 | Chestnut Mobile Ltd | Infant monitor apparatus |
EP3531388B1 (en) * | 2018-02-23 | 2020-12-02 | Stanislaw Napiorkowski | Baby monitor assembly |
US10593184B2 (en) * | 2018-03-05 | 2020-03-17 | Google Llc | Baby monitoring with intelligent audio cueing based on an analyzed video stream |
GB201803508D0 (en) | 2018-03-05 | 2018-04-18 | Oxehealth Ltd | Method and apparatus for monitoring of a human or animal subject |
US20190279481A1 (en) * | 2018-03-07 | 2019-09-12 | Google Llc | Subject detection for remote biometric monitoring |
US20190319316A1 (en) * | 2018-04-11 | 2019-10-17 | Astronics Advanced Electronic Systems Corp. | Method and System for Detecting Volatile Organic Compounds within a Battery Assembly |
US11371726B2 (en) | 2018-04-20 | 2022-06-28 | Emerson Climate Technologies, Inc. | Particulate-matter-size-based fan control system |
US11226128B2 (en) | 2018-04-20 | 2022-01-18 | Emerson Climate Technologies, Inc. | Indoor air quality and occupant monitoring systems and methods |
US11486593B2 (en) | 2018-04-20 | 2022-11-01 | Emerson Climate Technologies, Inc. | Systems and methods with variable mitigation thresholds |
US11421901B2 (en) | 2018-04-20 | 2022-08-23 | Emerson Climate Technologies, Inc. | Coordinated control of standalone and building indoor air quality devices and systems |
WO2019204789A1 (en) | 2018-04-20 | 2019-10-24 | Emerson Climate Technologies, Inc. | Indoor air quality sensor calibration systems and methods |
WO2019204790A1 (en) | 2018-04-20 | 2019-10-24 | Emerson Climate Technologies, Inc. | Systems and methods with variable mitigation thresholds |
WO2019204791A1 (en) | 2018-04-20 | 2019-10-24 | Emerson Climate Technologies, Inc. | Hvac filter usage analysis system |
US11153482B2 (en) * | 2018-04-27 | 2021-10-19 | Cubic Corporation | Optimizing the content of a digital omnidirectional image |
GB2571147B (en) * | 2018-06-13 | 2020-03-25 | Braintrain2020 Ltd | Apparatus for sensing |
US10706705B2 (en) * | 2018-10-03 | 2020-07-07 | Paula Holt | Baby cloud |
CN109730659B (en) * | 2018-12-29 | 2021-12-21 | 广东三水合肥工业大学研究院 | Intelligent mattress based on microwave signal monitoring |
GB201900034D0 (en) | 2019-01-02 | 2019-02-13 | Oxehealth Ltd | Method and apparatus for monitoring of a human or animal subject |
GB201900032D0 (en) | 2019-01-02 | 2019-02-13 | Oxehealth Ltd | Method and apparatus for monitoring of a human or animal subject |
GB201900033D0 (en) | 2019-01-02 | 2019-02-13 | Oxehealth Ltd | Mrthod and apparatus for monitoring of a human or animal subject |
USD900431S1 (en) | 2019-01-28 | 2020-11-03 | Udisense Inc. | Swaddle blanket with decorative pattern |
USD900430S1 (en) | 2019-01-28 | 2020-11-03 | Udisense Inc. | Swaddle blanket |
USD900429S1 (en) | 2019-01-28 | 2020-11-03 | Udisense Inc. | Swaddle band with decorative pattern |
USD900428S1 (en) | 2019-01-28 | 2020-11-03 | Udisense Inc. | Swaddle band |
CN110349371B (en) * | 2019-03-15 | 2020-12-11 | 青田县君翔科技有限公司 | Safety monitoring type wireless communication system |
JP7326802B2 (en) * | 2019-03-25 | 2023-08-16 | オムロンヘルスケア株式会社 | Measurement facilitator, method and program |
JP7174358B2 (en) * | 2019-03-29 | 2022-11-17 | 株式会社アイシン | Pulse rate detector and pulse rate detection program |
DE102019119980A1 (en) * | 2019-07-30 | 2021-02-04 | Winzig Stiftung | Method and apparatus for amplifying signals from infants and young children |
CA3186582A1 (en) * | 2020-06-11 | 2021-12-16 | Nanobio Detection Systems Llc | Systems and methods for detection of volatile organic compounds |
US10949948B1 (en) * | 2020-06-21 | 2021-03-16 | Alexandru Kuzmin | Closed form method and system for large image matting |
US11636870B2 (en) | 2020-08-20 | 2023-04-25 | Denso International America, Inc. | Smoking cessation systems and methods |
US11828210B2 (en) | 2020-08-20 | 2023-11-28 | Denso International America, Inc. | Diagnostic systems and methods of vehicles using olfaction |
US11760170B2 (en) | 2020-08-20 | 2023-09-19 | Denso International America, Inc. | Olfaction sensor preservation systems and methods |
US11813926B2 (en) | 2020-08-20 | 2023-11-14 | Denso International America, Inc. | Binding agent and olfaction sensor |
US12017506B2 (en) | 2020-08-20 | 2024-06-25 | Denso International America, Inc. | Passenger cabin air control systems and methods |
US11881093B2 (en) | 2020-08-20 | 2024-01-23 | Denso International America, Inc. | Systems and methods for identifying smoking in vehicles |
US11932080B2 (en) | 2020-08-20 | 2024-03-19 | Denso International America, Inc. | Diagnostic and recirculation control systems and methods |
US11760169B2 (en) | 2020-08-20 | 2023-09-19 | Denso International America, Inc. | Particulate control systems and methods for olfaction sensors |
CN112201007A (en) * | 2020-10-10 | 2021-01-08 | 珠海格力电器股份有限公司 | Alarm method and device for infant sleep |
CN112598887A (en) * | 2020-11-20 | 2021-04-02 | 合肥镭智光电科技有限公司 | Novel play by detection device |
CN114979587B (en) * | 2022-07-29 | 2022-11-04 | 四川锦美环保股份有限公司 | Shared coating line scheduling management control system |
TWI829335B (en) * | 2022-09-12 | 2024-01-11 | 王子文 | Thermal radiation physiological monitoring device and method thereof |
US20240108232A1 (en) * | 2022-09-30 | 2024-04-04 | GE Precision Healthcare LLC | Methods and systems for detecting physiologic signals from a camera |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100225493A1 (en) * | 2007-07-26 | 2010-09-09 | Faiz Zishaan | Improvements to responsive units |
US8094013B1 (en) | 2009-03-31 | 2012-01-10 | Lee Taek Kyu | Baby monitoring system |
WO2013093686A1 (en) * | 2011-12-20 | 2013-06-27 | Koninklijke Philips Electronics N.V. | Apparatus and method for monitoring a sleeping person |
US20130165809A1 (en) * | 2010-07-29 | 2013-06-27 | Digisense Ltd. | Monitoring physiological condition of a subject |
WO2013170035A1 (en) | 2012-05-09 | 2013-11-14 | Technophysics Solutions, Corporation | System and method for attachment free motion, respiration, heartbeat, and video monitoring |
Family Cites Families (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2623388A1 (en) * | 1987-11-23 | 1989-05-26 | Bertin & Cie | METHOD AND DEVICE FOR MONITORING THE BREATHING OF AN INDIVIDUAL |
US7483733B2 (en) * | 1999-07-26 | 2009-01-27 | Cardiosense, Ltd. | Non-invasive method and apparatus to detect and monitor early medical shock, and related conditions |
US20030109790A1 (en) * | 2001-12-06 | 2003-06-12 | Medtronic Physio-Control Manufacturing Corp. | Pulse detection method and apparatus using patient impedance |
EP1357879B1 (en) * | 2001-02-06 | 2008-12-24 | Draeger Medical Systems, Inc. | Infant incubator with non-contact sensing and monitoring |
US7872670B2 (en) * | 2002-04-22 | 2011-01-18 | Sanyo Electric Co., Ltd. | Camera performing photographing in accordance with photographing mode depending on object scene |
US7402167B2 (en) * | 2003-03-03 | 2008-07-22 | Mikhail Nemenov | Portable laser and process for producing controlled pain |
US20050212950A1 (en) * | 2004-03-26 | 2005-09-29 | Chinon Kabushiki Kaisha | Focal length detecting method, focusing device, image capturing method and image capturing apparatus |
JP2006203841A (en) * | 2004-12-24 | 2006-08-03 | Sharp Corp | Device for processing image, camera, device for outputting image, method for processing image, color-correction processing program and readable recording medium |
US20070217199A1 (en) * | 2006-03-17 | 2007-09-20 | Light Dimensions, Inc. | Light-based dermal enhancing apparatus and methods of use |
US7611472B2 (en) * | 2006-10-13 | 2009-11-03 | Guixian Lu | Apnea monitor |
KR100851977B1 (en) * | 2006-11-20 | 2008-08-12 | 삼성전자주식회사 | Controlling Method and apparatus for User Interface of electronic machine using Virtual plane. |
US20080136958A1 (en) * | 2006-12-11 | 2008-06-12 | Pentax Corporation | Camera having a focus adjusting system and a face recognition function |
US20080294012A1 (en) * | 2007-05-22 | 2008-11-27 | Kurtz Andrew F | Monitoring physiological conditions |
EP2266099A1 (en) * | 2008-03-18 | 2010-12-29 | Thomson Licensing | Method and apparatus for adaptive feature of interest color model parameters estimation |
US8755854B2 (en) * | 2009-07-31 | 2014-06-17 | Nellcor Puritan Bennett Ireland | Methods and apparatus for producing and using lightly filtered photoplethysmograph signals |
US9020622B2 (en) * | 2010-06-17 | 2015-04-28 | Evo Inc. | Audio monitoring system and method of use |
US20120220969A1 (en) * | 2011-02-25 | 2012-08-30 | Seungjin Jang | Health monitoring apparatus and method |
CN102309315A (en) * | 2011-09-07 | 2012-01-11 | 周翊民 | Non-contact type optics physiological detection appearance |
RU2625947C2 (en) * | 2012-05-01 | 2017-07-19 | Конинклейке Филипс Н.В. | Device and method for removing information from remote detective characteristic signals |
CA2872478A1 (en) * | 2012-05-02 | 2013-11-07 | Aliphcom | Physiological characteristic detection based on reflected components of light |
US9671482B2 (en) * | 2012-10-18 | 2017-06-06 | Samsung Electronics Co., Ltd. | Method of obtaining image and providing information on screen of magnetic resonance imaging apparatus, and apparatus thereof |
CA2893324A1 (en) * | 2012-12-04 | 2014-06-12 | Koninklijke Philips N.V. | Device and method for obtaining vital sign information of a living being |
US10044844B2 (en) * | 2012-12-17 | 2018-08-07 | Stephen Brian Parker | Child/user mobile device manager |
JP6290248B2 (en) * | 2012-12-21 | 2018-03-07 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | System and method for extracting physiological information from remotely detected electromagnetic radiation |
EP2936466B1 (en) * | 2012-12-21 | 2017-09-20 | SCA Hygiene Products AB | Method and system for detecting urine and/or feces |
US9215428B2 (en) * | 2013-01-07 | 2015-12-15 | Dorel Juvenile Group, Inc. | Child-monitoring system |
KR102195897B1 (en) * | 2013-06-05 | 2020-12-28 | 삼성전자주식회사 | Apparatus for dectecting aucoustic event, operating method thereof, and computer-readable recording medium having embodied thereon a program which when executed by a computer perorms the method |
US9674323B1 (en) * | 2013-08-29 | 2017-06-06 | Variable, Inc. | Modular multi-functional device, method, and system |
CN103680057A (en) * | 2013-12-06 | 2014-03-26 | 闻泰通讯股份有限公司 | Method and system for using electronic device to monitor cry of baby |
US9671383B2 (en) * | 2014-01-27 | 2017-06-06 | Sensor Technologies, Llc | Gas-monitoring apparatus for detecting bowel movements and method of use |
US10045820B2 (en) * | 2014-02-18 | 2018-08-14 | Channel Investments, Llc | Internet connected dermatological devices and systems |
-
2014
- 2014-07-21 FR FR1456996A patent/FR3023699B1/en active Active
-
2015
- 2015-07-17 EP EP15177357.9A patent/EP2976998B1/en active Active
- 2015-07-17 EP EP17206100.4A patent/EP3321909A1/en not_active Withdrawn
- 2015-07-21 EP EP15177627.5A patent/EP2977973B1/en active Active
- 2015-07-21 US US14/804,873 patent/US10694956B2/en active Active
- 2015-07-21 US US14/805,063 patent/US10441178B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100225493A1 (en) * | 2007-07-26 | 2010-09-09 | Faiz Zishaan | Improvements to responsive units |
US8094013B1 (en) | 2009-03-31 | 2012-01-10 | Lee Taek Kyu | Baby monitoring system |
US20130165809A1 (en) * | 2010-07-29 | 2013-06-27 | Digisense Ltd. | Monitoring physiological condition of a subject |
WO2013093686A1 (en) * | 2011-12-20 | 2013-06-27 | Koninklijke Philips Electronics N.V. | Apparatus and method for monitoring a sleeping person |
WO2013170035A1 (en) | 2012-05-09 | 2013-11-14 | Technophysics Solutions, Corporation | System and method for attachment free motion, respiration, heartbeat, and video monitoring |
Non-Patent Citations (2)
Title |
---|
AMS AG: "Withings room monitor helps keep air quality high indoors thanks to MEMS VOC gas sensor from ams, PR", 8 April 2015 (2015-04-08), XP055229922, Retrieved from the Internet <URL:http://ams.com/eng/Press-Center/Press-Releases/AS-MLV-P2_GasSensor> [retrieved on 20151120] * |
RICH GALLAGHER ET AL: "Withings Introduces Home", F, 4 September 2014 (2014-09-04), XP055229932, Retrieved from the Internet <URL:http://vitrine-media-cdn.withings.com/wysiwyg/news_events/Withings_Home_press%20release_040914_US.pdf> [retrieved on 20151120] * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11353381B1 (en) | 2020-06-09 | 2022-06-07 | Applied Materials, Inc. | Portable disc to measure chemical gas contaminants within semiconductor equipment and clean room |
Also Published As
Publication number | Publication date |
---|---|
EP2976998A1 (en) | 2016-01-27 |
EP2977973B1 (en) | 2018-06-06 |
EP3321909A1 (en) | 2018-05-16 |
US10694956B2 (en) | 2020-06-30 |
US10441178B2 (en) | 2019-10-15 |
US20160015278A1 (en) | 2016-01-21 |
EP2976998B1 (en) | 2018-06-06 |
FR3023699A1 (en) | 2016-01-22 |
FR3023699B1 (en) | 2016-09-02 |
US20160015277A1 (en) | 2016-01-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10441178B2 (en) | Monitoring device with volatile organic compounds sensor and system using same | |
US20210358293A1 (en) | Machine learning motion sensing with auxiliary sensors | |
US11614322B2 (en) | Camera having two exposure modes and imaging system using the same | |
US20090091554A1 (en) | Correcting for ambient light in an optical touch-sensitive device | |
US10867217B1 (en) | Fusion of visual and non-visual information for training deep learning models | |
US20210368139A1 (en) | Monitoring system, monitoring sensor apparatus, monitoring method, and program | |
CN208044324U (en) | Domestic environment intelligence control system | |
US20150153061A1 (en) | Method for controlling and monitoring the level of confinement of internal air, and related environment device and station | |
KR20160150364A (en) | Indoor air quality and condition monitoring system and method thereof | |
CN105764219A (en) | Control device and method for intelligent lamp on bedroom scene | |
KR20160073754A (en) | Apparatus for estimating air quality, system for estimating air quality and method for estimating air quality | |
KR101268038B1 (en) | Sensing module for smoke and sensing apparatus for smoke, sensing method for smoke | |
US20230333075A1 (en) | Air quality sensors | |
KR102233937B1 (en) | Server of health management using semantic analysis for sensing data of care plug device, and the method thereof | |
JP2014159916A (en) | Environment control apparatus, method, and program | |
US20230252874A1 (en) | Shadow-based fall detection | |
CN209514395U (en) | A kind of wisdom family health care security system | |
JP2008023051A (en) | Sleep information supply system | |
JP2023546746A (en) | Multifunctional sensors and methods of using multifunctional sensors to monitor facilities and multiple processes | |
JP2007305114A (en) | Alarm | |
KR20160074731A (en) | Air purifier, system for controling air purifier and method for controling air purifier | |
KR101656953B1 (en) | Method and System for Logging and Sensing Outdoor Environments and Method and System for Application Control for Alarm of Outdoor Environments | |
ES2836878B2 (en) | NON-INVASIVE METHOD AND SYSTEM FOR THE CHARACTERIZATION AND CERTIFICATION OF COGNITIVE ACTIVITIES | |
US20230093565A1 (en) | Camera having two exposure modes and imaging system using the same | |
CN203706386U (en) | Emergency response system capable of acquiring disaster information on site |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
17P | Request for examination filed |
Effective date: 20160722 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20170124 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20171213 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: BUARD, NADINE Inventor name: CARPENTIER, STEPHANE Inventor name: CAMPO, DAVID Inventor name: CARREEL, ERIC Inventor name: DUMOULIN, AMAURY |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: NOKIA TECHNOLOGIES (FRANCE ) |
|
GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: NOKIA TECHNOLOGIES OY |
|
GRAR | Information related to intention to grant a patent recorded |
Free format text: ORIGINAL CODE: EPIDOSNIGR71 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
INTC | Intention to grant announced (deleted) | ||
INTG | Intention to grant announced |
Effective date: 20180426 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 1006914 Country of ref document: AT Kind code of ref document: T Effective date: 20180615 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602015011653 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 4 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20180606 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180906 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180906 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180907 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1006914 Country of ref document: AT Kind code of ref document: T Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181006 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602015011653 Country of ref document: DE |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: WITHINGS |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180721 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20180731 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180721 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 |
|
26N | No opposition filed |
Effective date: 20190307 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602015011653 Country of ref document: DE Owner name: WITHINGS, FR Free format text: FORMER OWNER: NOKIA TECHNOLOGIES OY, ESPOO, FI |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180721 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20200213 AND 20200219 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180606 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20150721 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230725 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230727 Year of fee payment: 9 Ref country code: DE Payment date: 20230712 Year of fee payment: 9 |