CN108922085A - A kind of monitoring method, device, custodial care facility and storage medium - Google Patents

A kind of monitoring method, device, custodial care facility and storage medium Download PDF

Info

Publication number
CN108922085A
CN108922085A CN201810791295.7A CN201810791295A CN108922085A CN 108922085 A CN108922085 A CN 108922085A CN 201810791295 A CN201810791295 A CN 201810791295A CN 108922085 A CN108922085 A CN 108922085A
Authority
CN
China
Prior art keywords
care provider
face image
subregion
image
personnel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810791295.7A
Other languages
Chinese (zh)
Other versions
CN108922085B (en
Inventor
赵海杰
秦林婵
黄通兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing 7Invensun Technology Co Ltd
Beijing Qixin Yiwei Information Technology Co Ltd
Original Assignee
Beijing Qixin Yiwei Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qixin Yiwei Information Technology Co Ltd filed Critical Beijing Qixin Yiwei Information Technology Co Ltd
Priority to CN201810791295.7A priority Critical patent/CN108922085B/en
Publication of CN108922085A publication Critical patent/CN108922085A/en
Priority to PCT/CN2019/085945 priority patent/WO2020015439A1/en
Application granted granted Critical
Publication of CN108922085B publication Critical patent/CN108922085B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/04Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0407Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B3/00Audible signalling systems; Audible personal calling systems
    • G08B3/10Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
    • G08B3/1008Personal calling arrangements or devices, i.e. paging systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Psychiatry (AREA)
  • Gerontology & Geriatric Medicine (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Electromagnetism (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Eye Examination Apparatus (AREA)
  • Alarm Systems (AREA)

Abstract

The invention discloses a kind of monitoring method, device, custodial care facility and storage mediums.The method includes:Obtain the face image of personnel in monitoring region;If the face image is matched with pre-set image, it is determined that the corresponding personnel of the face image are to care provider;According to the eyes image in the face image to care provider, the sight to care provider is determined;If the sight to care provider watches any subregion for corresponding to different call functions in the predeterminable area for triggering calling attentively more than early warning duration, then according to the subregion watched attentively or according to the subregion and the physical condition to care provider watched attentively, determines call class and carry out respective call.Authentication can be carried out by treating the matching of care provider's face image and pre-set image using this method, to improve the accuracy of calling;It can also targetedly be called according to the sight to care provider or according to the sight to care provider and the physical condition to care provider.

Description

A kind of monitoring method, device, custodial care facility and storage medium
Technical field
The present embodiments relate to field of communication technology more particularly to a kind of monitoring method, device, custodial care facility and storages Medium.
Background technique
Currently, with the acceleration of people's life rhythm, mental and physical demands increases, the incidence of various diseases is also more next It is higher.When the patient that postoperative or other reasons lose language competence and ability to act is when being hospitalized or accomplishing, whole process is generally required There is medical staff to guard, can succour in time when patient occurs uncomfortable.
The existing monitoring method used for inconvenient sounding and the constrained patient of capacity, is guarded to user During, it is usually alarmed by judging to watch the duration of predeterminable area attentively to care provider, to notify medical staff. It lacks specific aim during being guarded, and cannot effectively call medical staff, to increase the work of medical staff It measures.
Summary of the invention
A kind of monitoring method, device, custodial care facility and storage medium provided by the invention, are able to carry out effective calling, Reduce the workload of medical staff.
In a first aspect, the embodiment of the invention provides a kind of monitoring methods, including:
Obtain the face image of personnel in monitoring region;
If the face image is matched with pre-set image, it is determined that the corresponding personnel of the face image are to guardian Member;
According to the eyes image in the face image to care provider, the sight to care provider is determined;
If the sight to care provider, which is watched attentively in the predeterminable area for triggering calling, corresponds to different call functions Any subregion be more than early warning duration, then according to the subregion watched attentively or according to the subregion watched attentively and described to care provider Physical condition, determine call class and carry out respective call.
Second aspect, the embodiment of the invention also provides a kind of monitor devices, including:
Module is obtained, for obtaining the face image of personnel in monitoring region;
Personnel's determining module, for when the face image is matched with pre-set image, determining that the face image is corresponding Personnel be to care provider;
Blinkpunkt determining module, described in, to the eyes image in the face image of care provider, being determined according to described Sight to care provider;
Calling module corresponds to not for watching attentively in the predeterminable area for triggering calling when the sight to care provider When being more than early warning duration with any subregion of call function, according to the subregion watched attentively or according to the subregion watched attentively and described To the physical condition of care provider, determines call class and carry out respective call.
The third aspect, the embodiment of the invention also provides a kind of custodial care facilities, including:
One or more processors;
Storage device, for storing one or more programs;
One or more of programs are executed by one or more of processors, so that one or more of processors Realize monitoring method provided in an embodiment of the present invention.
Fourth aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer Program, the program realize monitoring method provided in an embodiment of the present invention when being executed by processor.
The embodiment of the invention provides a kind of monitoring method, device, custodial care facility and storage mediums, utilize above-mentioned technical side Case can carry out identification to the face image of the personnel in monitoring region, keep away before treating care provider's Retina transplantation Exempt from non-to calling caused by care provider, improves the accuracy of calling.It is used in addition, watching attentively in the sight to care provider When triggering any subregion for corresponding to different call functions in the predeterminable area of calling more than early warning duration, according to care provider The subregion watched attentively or the physical condition according to the subregion watched attentively and to care provider are targetedly called, and doctor is reduced The workload of shield personnel also slows down the slight illness to care provider, effectively increases the use body to care provider and medical staff It tests.
Detailed description of the invention
Fig. 1 is a kind of flow diagram for monitoring method that the embodiment of the present invention one provides;
Fig. 2 a is a kind of flow diagram of monitoring method provided by Embodiment 2 of the present invention;
Fig. 2 b gives the application scenarios schematic diagram of monitoring method provided by Embodiment 2 of the present invention;
Fig. 2 c gives the schematic diagram of pre-set image provided by Embodiment 2 of the present invention;
Fig. 3 is a kind of structural schematic diagram for monitor device that the embodiment of the present invention three provides;
Fig. 4 is a kind of structural schematic diagram for custodial care facility that the embodiment of the present invention four provides.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just Only the parts related to the present invention are shown in description, attached drawing rather than entire infrastructure.
It should be mentioned that some exemplary embodiments are described as before exemplary embodiment is discussed in greater detail The processing or method described as flow chart.Although operations (or step) are described as the processing of sequence by flow chart, Many of these operations can be implemented concurrently, concomitantly or simultaneously.In addition, the sequence of operations can be pacified again Row.The processing can be terminated when its operations are completed, it is also possible to have the additional step being not included in attached drawing.Institute Stating processing can correspond to method, function, regulation, subroutine, subprogram etc..
Embodiment one
Fig. 1 is a kind of flow diagram for monitoring method that the embodiment of the present invention one provides, and this method is applicable to treat The case where care provider guards, such as to there are aphasis and it is handicapped guarded to care provider, thus The case where being called when care provider has call request.This method can by monitor device provided in an embodiment of the present invention Lai It executes, wherein the device can be implemented by software and/or hardware, and be typically integrated on custodial care facility.It guards in the present embodiment Equipment can integrate in existing equipment, such as in computer, TV or Medical Instruments equipment;Or only realize the present embodiment The custodial care facility of middle monitoring method.The custodial care facility includes but is not limited to:The devices such as camera, loudspeaker and processor.
As shown in Figure 1, a kind of monitoring method that the embodiment of the present invention one provides, includes the following steps:
S101, the face image for obtaining personnel in monitoring region.
In the present embodiment, what monitoring region can be understood as image collecting device can pickup area.It can in the present embodiment It is handled with the face image only to personnel in monitoring region, so as to effectively reduce the time of image procossing, after raising The efficiency of continuous identification.
It should be noted that monitoring method can be for there are aphasiies and handicapped to guardian in the present embodiment Member.Can be constant always to the position of care provider correspondingly, being somebody's turn to do, it can also change relative to custodial care facility.Work as user Position when changing relative to custodial care facility, monitoring region may include being capable of movable maximum model to care provider It encloses.
This step can obtain the face image of personnel in monitoring region by image collecting device (such as camera).This reality Monitoring analysis can be carried out based on face image after obtaining face image by applying example.
In general, this step can directly obtain the face image of personnel in monitoring region by image collecting device, The whole body images comprising environmental information that personnel in monitoring region can be obtained by image collecting device, then extract face Image.It is understood that may include the environmental information that has powerful connections in the face image (as should be to care provider's ambient enviroment).
If S102, the face image are matched with pre-set image, it is determined that the corresponding personnel of the face image be to Care provider.
In the present embodiment, pre-set image can be understood as the face image to care provider of preparatory typing.This is default Image can be used for treating care provider and carry out authentication.
It is obtaining in monitoring region after the face image of personnel, face image and pre-set image that this step can will acquire It is matched, to complete the authentication to personnel in monitoring region, to judge whether personnel are wait supervise in the monitoring region Shield personnel, to prevent from guarding to non-to care provider.In the present embodiment it is considered that working as face image and pre-set image When consistent, the face image of acquisition is matched with pre-set image.
As characteristic information each in face image is consistent with individual features information in pre-set image, in face image it is main Characteristic information is consistent with individual features information in pre-set image or face image in characteristic information consistent in pre-set image Reach certain threshold value.Wherein characteristic information can be understood as the feature of mark face image, such as eye feature, mouth feature or face Type feature etc..Main feature information can be understood as the feature for capableing of unique identification face image, such as eye feature.
Specifically, in this step can by will acquire monitoring region in personnel face image in characteristic information It is matched with the characteristic information in pre-set image, to determine whether face image matches with pre-set image.If it does, then can To determine that the corresponding personnel of the face image are to care provider, to wait for that care provider guards to this, wherein feature is believed Breath may include eye feature, such as the spot of eyes, filament, coronal and/or crypts feature.
For carrying out identification by eye feature:When in eyes image (eyes image is contained in face image) With the identical and/or coronal form and dimension of the number and size of spot is identical at close positions in pre-set image and/or crypts Size and identical shape when, it is believed that eyes image is matched with pre-set image.It is understood that determining face image When whether matching with pre-set image, allow to have preset deviation range.
S103, basis are described to the eyes image in the face image of care provider, determine the view to care provider Line.
It is determining after care provider, this step may determine that the eyes image institute in the face image to care provider Corresponding sight, to judge whether there is call request to care provider.It should be noted that face image in this step can be with It include the eyes of user, to determine the sight to care provider based on the eyes image in eyes image.
In general, this step can navigate to eyes image position in face image according to the face image to care provider Then place can carry out the determination of sight according to eyes image.Sight timing really is being carried out based on eyes image, it can be to eye Eye movement characteristics in portion's image are analyzed, to obtain the sight to care provider.
In general, obtaining when care provider's face image when using common camera, this step can be based on wait guard In personnel's face image the eye feature of eyes image and eye feature when care provider faces predeterminable area determine to The sight of care provider;When using infrared camera (it is configured with infrared lamp, is used to form hot spot letter to care provider's eye Breath) it obtains when care provider's face image, this step can be true by comparing the positional relationship of spot center and pupil center The fixed sight to care provider.
Eye movement characteristics can be understood as the characteristic information of eye.Wherein, eye movement characteristics can by eyeball physiologic information and/ Or eyeball information determines in eye figure.Eye feature can include but is not limited to:Pupil position, pupil shape, iris position, iris Shape, eyelid position, canthus position and/or hot spot (also referred to as Purkinje image) position.
When care provider is fixed relative to custodial care facility position, the present embodiment can be only to the eye in eyes image Feature is analyzed;When care provider is relative to custodial care facility change in location, the present embodiment be can be combined with to guardian The location information of member is analyzed, accurately to determine the sight to care provider.It wherein, can to the location information of care provider By analyzing to obtain to face image.In general, the position of image collecting device is fixed, when being in different positions to care provider When setting, the face image that image collecting device obtains may exist certain difference.
If S104, the sight to care provider, which are watched attentively in the predeterminable area for triggering calling, corresponds to different callings Any subregion of function is more than early warning duration, then according to the subregion watched attentively or according to the subregion watched attentively and described wait guard The physical condition of personnel determines call class and carries out respective call.
In the present embodiment, predeterminable area can be understood as a specified region on custodial care facility, which can For triggering calling.Subregion can be understood as the region that predeterminable area is included, and different subregions can correspond to difference Calling, different callings can correspond to different functions.Early warning duration can be understood as watching predeterminable area attentively to care provider Time threshold.Call class be understood that according to priority set by care provider's physical condition and subregion or according to The priority that subregion determines.Physical condition can be understood as the condition to care provider.E.g. to care provider's Flu state, operation postoperative status or fracture recovering state etc..Different physical conditions combines the subregion watched attentively that can determine Different call class.
It is understood that predeterminable area may include multiple subregions, different subregions can be corresponding with different Call class.The specific location of predeterminable area, quantity and shape are not defined, also predeterminable area are not wrapped herein The number and shape of the subregion contained are defined, and those skilled in the art can set according to actual needs.
In general, can watch predeterminable area attentively when care provider has call request and realize alarm.Wherein custodial care facility The equipment that can be understood as monitoring method provided by operation the present embodiment.If watched attentively to care provider any in predeterminable area The duration of subregion is greater than early warning duration, then can carry out subsequent monitoring processing;If it is not greater, then can continue to obtain monitoring The eyes image of personnel in region, until when the duration that care provider watches any subregion in predeterminable area attentively is more than early warning It is long.
Specifically, this step can be by will be to each sub-district in the corresponding watching area of care provider's sight and predeterminable area Domain is matched, and determines whether watch any subregion in predeterminable area attentively to care provider.If watched attentively to care provider pre- If any subregion in region, then when may further determine that whether the duration for watching the subregion attentively when care provider is more than early warning It is long.
If watching any subregion in predeterminable area attentively to care provider has been more than early warning duration, it may be considered that wait guard Personnel have call request, so as to based on the subregion watched attentively to care provider or according to the subregion watched attentively and to guardian The physical condition of member carries out the determination of call class, and is called accordingly based on the call class determined.If wait supervise The duration that shield personnel's sight watches any subregion in predeterminable area attentively is no more than early warning duration or does not watch attentively to care provider default Any subregion in region can then continue to obtain the prison that the face image for guarding personnel in region treat care provider Shield.
It is determining after the subregion that care provider watches attentively, this step can be directly based upon the sub-district watched attentively to care provider Domain determines corresponding call class and carries out respective call;It can also be according to the subregion watched attentively and to care provider's physical condition Determine corresponding call class.When being based only upon subregion and determining call class, subregion can exist with call class to be corresponded to Relationship.After determining subregion, corresponding call class can be determined.When determining calling etc. by subregion and physical condition When grade, subregion and physical condition can there are corresponding relationships with call class.After determining subregion, body can be combined State determines corresponding call class.
Wherein, it can be determined, can also be passed through based on the medical record information to care provider to the physical condition of care provider Monitoring device for monitoring physical condition obtains.The present embodiment combines the body to care provider when call class determines Body state can be called more targetedly.It is such as, different that care provider, there may be different body shapes State.Difference, can be by combining its physical condition to determine the call class of adaptation when care provider watches same subregion attentively. Such as, predeterminable area includes subregion A and subregion B.It for operation postoperative status and is seen to sub-district when to care provider's physical condition When the A of domain, higher call class can be triggered.If call class is divided into level-one, second level and three-level, (wherein level-one can be highest Grade), then it can trigger level-one calling.When care provider's physical condition is rehabilitation state and sees to subregion A, it can touch Send out call class lower, as three-level calls.In this step, according to the subregion watched attentively to care provider or according to wait guard Subregion that personnel watch attentively and described after care provider's physical condition determines call class can be based further on and determine Call class is called accordingly.It is understood that different call class can correspond to different method of callings, such as shake Bell or bright light;Different medical staff can also be corresponded to, if call class is higher, doctor is called, if call class is lower When, nurse call.
The embodiment of the present invention one provides a kind of monitoring method, can be in the view for treating care provider using the above method Before line analysis, identification is carried out to the face image of the personnel in monitoring region, is avoided non-to caused by care provider Calling, improves the accuracy of calling.Different call functions are corresponded in addition, watching attentively in predeterminable area in the sight to care provider Any subregion be more than early warning duration when, according to the subregion watched attentively to care provider or according to the subregion watched attentively and wait supervise The physical condition of shield personnel is targetedly called, and the workload for reducing medical staff also slows down disease to care provider Bitterly, the usage experience to care provider and medical staff is effectively increased.
Embodiment two
Fig. 2 a is a kind of flow diagram of monitoring method provided by Embodiment 2 of the present invention, and the present embodiment two is above-mentioned each It is optimized on the basis of embodiment.In the present embodiment, if the face image matched with pre-set image, it is determined that institute Stating the corresponding personnel of face image is to be further detailed as to care provider:Characteristic information is extracted from the face image; If the characteristic information is matched with default characteristic information, it is determined that the corresponding personnel of the face image are to care provider.
Further, the present embodiment also, to the eyes image in the face image of care provider, will determine institute according to described State the sight to care provider, advanced optimize for:According to the face image and benchmark image to care provider, institute is determined State the location information to care provider;According to the positional information with the eye movement characteristics in care provider's eyes image, Determine the sight to care provider.
On the basis of above-mentioned optimization, the present embodiment will be according to the subregion watched attentively or according to the subregion watched attentively and described Call class is determined to care provider's physical condition and carries out respective call, is specifically optimized for:Predetermined level tables of data is searched, really It is fixed with the subregion watched attentively and the corresponding call class of the physical condition to care provider and progress is corresponding calls;Or, Predetermined level tables of data is searched, determine call class corresponding with the subregion watched attentively and carries out corresponding call.
Further, the present embodiment obtains in monitoring region before the face image of personnel described, and also optimization includes:Record Enter face image when care provider faces datum mark comprising environmental information as benchmark image.
Further, if the present embodiment is watched attentively in the sight to care provider for triggering the default of calling Any subregion that different call functions are corresponded in region is more than early warning duration, then according to the subregion watched attentively or according to watching attentively Subregion and the physical condition to care provider, after determining call class and carrying out respective call, also optimization includes:Root Corresponding voice reminder is sent to care provider to described according to the call class determined.The not yet detailed content of the present embodiment is asked Reference implementation example one.
As shown in Figure 2 a, a kind of monitoring method provided by Embodiment 2 of the present invention, includes the following steps:
The face image of S201, typing when care provider faces datum mark comprising environmental information is as benchmark image.
In the present embodiment, the point that the confession that datum mark can be understood as showing on custodial care facility is watched attentively to care provider.Base Quasi- image can be understood as the image obtained when care provider watches datum mark attentively, can determine based on the benchmark image wait guard The location information of personnel.
In general, before treating care provider and guarding, this step can typing in advance wait for that care provider faces base Face image when on schedule is as benchmark image.Need care provider's face it should be noted that may include in the face image Background environment locating for portion.This step being capable of significantly more efficient determination using the face image comprising environmental information as benchmark image The location information of user.
S202, the face image for obtaining personnel in monitoring region.
S203, characteristic information is extracted from the face image.
In the present embodiment, it is obtaining in monitoring region after the face image of personnel, this step can pass through feature extraction Technology extracts characteristic information from face image, and the identification for treating care provider is realized with the characteristic information based on extraction. This feature information may include eye feature, mouth feature or shape of face feature etc..
S204, judge whether the characteristic information matches with default characteristic information, if so, executing S205;If it is not, then holding Row S202.
In the present embodiment, default characteristic information can be understood as the characteristic in pre-set image.It is understood that Default characteristic information is corresponding with characteristic information.Illustratively, when characteristic information is eye feature, default characteristic information can be Default eye feature;When characteristic information is mouth feature, default characteristic information can be default mouth feature;Work as characteristic information When for shape of face feature, default characteristic information can be default shape of face feature.
After extracting characteristic information, this step can further judge this feature information and default characteristic information whether Match.If it does, then can further execute monitoring operation, i.e. execution S205;Continue to obtain if it does not match, can return The face image of personnel in region is guarded, i.e. execution S202.
S205, determine that the corresponding personnel of the face image are to care provider.
It in the present embodiment, can will be corresponding to the face image if characteristic information is matched with default characteristic information Personnel be determined as to care provider, to wait for that care provider guards to this.
S206, face image and benchmark image according to care provider determine the position to care provider Information.
In the present embodiment, eyes image determines the sight to care provider in based on the face image to care provider When, this step will can carry out aspect ratio pair to the face image of care provider and benchmark image first, determine to care provider Current location information, to determine the sight to care provider based on the location information.
Specifically, this step can calculate the face image compared to reference map based on the face image to care provider The position deviation of picture is to determine the location information to care provider.It, can be based on each in face image when determining position deviation The location parameter of each characteristic information in characteristic information and benchmark image determines the position deviation of the two.
S207, according to the positional information with the eye movement characteristics in care provider's eyes image, determine it is described to The sight of care provider.
This step can be analyzed by treating eye movement characteristics in care provider's eyes image and location information, with true The fixed sight to care provider.Wherein, eye movement characteristics can be understood as eye motion characteristic, such as twitching of the eyelid information (twitching of the eyelid peak value, speed Degree, number and/or average amplitude), nystagmus information (nystagmus frequency and/or duration) and/or watch information attentively and (watch duration attentively, watch attentively Number, blinkpunkt position and/or first fixation duration) etc..Wherein, eye movement characteristics can pass through pupil position, pupil shape, pupil Bore dia, iris position, iris shape, eyelid position, canthus position, hot spot (also referred to as Purkinje image) feature and/or eyelid Feature etc. determines.
Specifically, this step can be primarily based on the spy of the eye movement in eyes image determining when the sight of care provider Sign determines the sight to be modified to care provider, is then based on the location information determined and corrects the sight to be modified, with To the sight to care provider.In addition, this step can also be directly based upon the location information determined, the eye movement in eyes image Feature and predetermined line of sight model determine the sight to care provider.The predetermined line of sight model establishes position The corresponding relationship of information, eye movement characteristics and sight, can be directly based upon location information and eye movement characteristics determine sight.
It is understood that image collecting device can be common camera in the present embodiment, or infrared photography Head (infrared camera is provided with infrared lamp).When obtaining face image using common camera, face image can be based on In eye feature and benchmark pupil center determine sight.Wherein benchmark pupil center can be to be set to care provider using monitoring What standby preceding correction obtained, it is also possible to the pre-stored reference data for waiting for that care provider's iris feature is obtained based on this.
S208, judge the sight to care provider whether watch attentively for trigger calling predeterminable area in correspond to different callings Any subregion of function is more than early warning duration, if so, executing S209;Otherwise, S202 is executed.
In the present embodiment, it is determining after the sight of care provider, this step may determine that whether the sight watches attentively Any subregion of different call functions is corresponded in predeterminable area for triggering calling.If the sight to care provider is watched attentively Any subregion in predeterminable area, then can further judge to watch whether duration is more than early warning duration attentively, if it is, can To execute S209.Correspondingly, can be returned if the sight to care provider does not watch any subregion in predeterminable area attentively S202.If the sight to care provider watches the sub-regions in predeterminable area attentively, but watches duration attentively and be not above early warning Duration can then return to S202 and continue to monitor.
S209, predetermined level tables of data is searched, the subregion and the physical condition to care provider for determining and watching attentively Corresponding call class is simultaneously called accordingly;Or, searching predetermined level tables of data, determination is corresponding with the subregion watched attentively Call class is simultaneously called accordingly.
In the present embodiment, predetermined level tables of data can be understood as subregion in predeterminable area, physical condition and calling Corresponding relationship in corresponding relationship or predeterminable area between grade between subregion and call class.
Watch attentively in predeterminable area after any subregion is more than early warning duration determining after the sight of care provider, this step can According to the subregion watched attentively to care provider or according to the subregion watched attentively to care provider and to the body shape of care provider State searches predetermined level tables of data, determines corresponding call class, and called accordingly based on the call class.
Wherein, call class can be configured or according to different physical conditions and different subregions according to different Subregion is configured, and different call class can correspond to different docking personnel.This step after determining call class, Corresponding calling can be sent to different terminals, to complete the calling of corresponding personnel.Communication mode is not carried out herein It limits, those skilled in the art can carry out the transmission of data by the way of wired according to specific requirements or use wireless side The transmission of formula progress data.
S210, corresponding voice reminder is sent to care provider to described according to the call class determined.
In the present embodiment, after carrying out respective call, this step can pass through voice according to the call class determined Playing device (such as loudspeaker) corresponds to the voice reminder of the call class to issuing to care provider.Such as, voice informing waits supervising How alone shield personnel have notified corresponding medical staff at present, and combine call class prompting at present should to care provider The calling that is currently triggered is coped with, such as deeply breathed, closed mesh and loosen.It is understood that this step will can also mention accordingly It wakes up and is shown over the display in the form of text.
Fig. 2 b gives the application scenarios schematic diagram of monitoring method provided by Embodiment 2 of the present invention, guards region in Fig. 2 b The personnel of interior (in the pickup area of image collecting device 221b) are to care provider 21b.As shown in Figure 2 b, custodial care facility 22b obtains the face image to care provider 21b by image collecting device 221b in real time, then to the face image of acquisition into Row analysis obtains call class.Then the corresponding calling of different call class is sent to accordingly by module 222b by wireless communication Terminal.Care provider 21b, which is treated, finally by loudspeaker 223b carries out corresponding voice reminder.It should be noted that this is answered Only play the role of signal with the positional relationship of equipment room each in scene, can't specific location be defined.In addition, wireless communication Module 222b illustrates only a kind of communication mode, is not defined herein to specific communication mode.
Wherein, it the quantity of the terminal shown in Fig. 2 b and is not construed as limiting, different terminals can call different personnel.Such as exhale Make grade lower, then call request can be sent to first terminal 231b by module 222b by wireless communication by custodial care facility 22b, First terminal 231b can call the nurse being responsible for care provider 21b;If call class is higher, custodial care facility 22b can be with Call request is sent to first terminal 231b and second terminal 232b by module 222b by wireless communication, wherein second terminal 232b can call the doctor being responsible for care provider 21b.If call class reaches highest, custodial care facility 22b can lead to It crosses wireless communication module 222b and call request is sent to first terminal 231b, second terminal 232b and third terminal 233b, Middle third terminal 233b can call the household to care provider 21b.
Fig. 2 c gives the schematic diagram of pre-set image provided by Embodiment 2 of the present invention;Fig. 2 c shows one eye eyeball, this Place is not defined the number of elements of eyes, in eyes image may include two eyes to improve the standard of judgement in the present embodiment Exactness.This sentences pre-set image as eyes image, it is to be understood that the pre-set image can be face image.Such as figure Shown in 2c, which can be the eyes image to care provider of preparatory typing, and feature letter is preset in the eyes image Breath may include pupil feature and iris feature.
Wherein, eyeball middle layer (annular formations between black pupil and white sclera) are located in eyes image is rainbow Film 22c;Small sircle hole (circle of eye innermost layer) positioned at the center iris 22c is pupil 21c.
Illustratively, the detailed process of monitoring method provided in this embodiment is as follows:
First can be using face image of typing when care provider faces datum mark as benchmark image, the face image packet Contain environmental information.Then custodial care facility obtains the face of personnel in monitoring region by image collecting device (such as camera) in real time Portion's image extracts characteristic information from the face image obtained, and the characteristic information extracted and default characteristic information are carried out It compares.If the matching degree of characteristic information and default characteristic information is in a certain range, then it is assumed that characteristic information and default feature Information matches.
If characteristic information is matched with default characteristic information, the corresponding personnel of the face image can be determined as wait supervise Shield personnel obtain the location information to care provider by analyzing face image and benchmark image to care provider.It determines After the location information of care provider, determine based on the location information and to eye movement characteristics in care provider's eyes image wait guard The sight of personnel.If it is more than early warning duration that the sight to care provider, which watches any subregion in predeterminable area attentively, according to note Depending on subregion or physical condition according to the subregion watched attentively and to care provider determine call class and exhaled accordingly It cries.
A kind of monitoring method provided by Embodiment 2 of the present invention embodies and determines that operation, sight determine to care provider Operation and call operation, in addition, also optimization includes benchmark image typing operation and voice reminder operation.Utilize this method, energy It is enough based on pre-set image, identification is carried out to the personnel in monitoring region, improves the accuracy of monitoring.In addition, treating prison During the call request of shield personnel is determined, can the face image based on benchmark image and to care provider determine To the location information of care provider, call class is determined with the eye movement characteristics based on the location information and to care provider, from And targetedly called, it is effectively reduced the workload of medical staff.By to care provider after being called Corresponding voice reminder is sent, medical staff has been notified at present to care provider to inform, to slow down the discomfort to care provider Sense, effectively raises the usage experience to care provider and medical staff.
Embodiment three
Fig. 3 is the structural schematic diagram of a kind of monitor device that the embodiment of the present invention three provides, and the present embodiment is applicable to pair The case where being guarded to care provider, such as to there are aphasis and it is handicapped guarded to care provider, thus The case where being called when care provider has call request.Wherein the device can be implemented by software and/or hardware, and general It is integrated on custodial care facility.
As shown in figure 3, the monitor device includes:It obtains module 31, personnel's determining module 32, sight determining module 33 and exhales It is module 34.
Wherein, module 31 is obtained, for obtaining the face image of personnel in monitoring region;
Personnel's determining module 32, for determining the face image pair when the face image is matched with pre-set image The personnel answered are to care provider;
Sight determining module 33, described in, to the eyes image in the face image of care provider, being determined according to described Sight to care provider;
Calling module 34 is corresponded to for watching attentively in the predeterminable area for triggering calling when the sight to care provider When any subregion of different call functions is more than early warning duration, according to the subregion watched attentively or according to the subregion and institute watched attentively The physical condition to care provider is stated, determine call class and carries out respective call.
In the present embodiment, which passes through first obtains face's figure that module 31 obtains personnel in monitoring region Picture;Secondly by personnel's determining module 32 when the face image is matched with pre-set image, determine that the face image is corresponding Personnel be to care provider;Then by sight determining module 33 according to the eye in the face image to care provider Image determines the sight to care provider;Finally by calling module 34 when the sight to care provider watches use attentively When corresponding to any subregion of different call functions in the predeterminable area of triggering calling more than early warning duration, according to the son watched attentively Region or according to the subregion and the physical condition to care provider watched attentively, determines call class and carries out respective call.
A kind of monitor device provided in this embodiment, can be before treating the Retina transplantation of care provider, to monitoring area The face image of personnel in domain carries out identification, avoids non-to calling caused by care provider, improves the standard of calling True property.In addition, watching in predeterminable area any subregion for corresponding to different call functions attentively in the sight to care provider more than pre- When alert duration, according to the subregion watched attentively to care provider or according to the subregion watched attentively and to care provider physical condition into Row targetedly calls, and the workload for reducing medical staff also slows down slight illness to care provider, effectively increases wait supervise The usage experience of shield personnel and medical staff.
Further, personnel's determining module 32, including:Feature extraction unit, it is special for being extracted from the face image Reference breath;Personnel's determination unit, for determining the face image pair when the characteristic information is matched with default characteristic information The personnel answered are to care provider.
On the basis of above-mentioned optimization, sight determining module 33 is specifically used for:Schemed according to the face to care provider Picture and benchmark image determine the location information to care provider;According to the positional information with described to care provider's face Eye movement characteristics in portion's eyes image determine the sight to care provider.
Based on the above-mentioned technical proposal, calling module 34 are specifically used for:When the sight to care provider is exhaled for triggering When any subregion that watching attentively in predeterminable area of crying corresponds to different call functions is more than early warning duration, predetermined level data are searched Table, it is determining with the subregion watched attentively and the corresponding call class of the physical condition to care provider and progress is corresponding exhales It cries;Or, searching predetermined level tables of data, determining call class corresponding with the subregion watched attentively and carrying out corresponding call.
Further, the monitor device, optimization includes:Benchmark image recording module 35, for being guarded in the acquisition In region before the face image of personnel, face image conduct of typing when care provider faces datum mark comprising environmental information Benchmark image.
Further, the monitor device, optimization includes:Voice reminder module 36, if for described wait supervise The sight of shield personnel watches any subregion that different call functions are corresponded in the predeterminable area for triggering calling attentively more than early warning Duration determines calling then according to the subregion watched attentively or according to the subregion and the physical condition to care provider watched attentively Grade and after carrying out respective call sends corresponding voice to care provider and mentions according to the call class determined to described It wakes up.
Monitoring method provided by any embodiment of the invention can be performed in above-mentioned monitor device, and it is corresponding to have execution method Functional module and beneficial effect.
Example IV
Fig. 4 is a kind of structural schematic diagram for custodial care facility that the embodiment of the present invention four provides.As shown in figure 4, the present invention is real Applying the custodial care facility that example four provides includes:One or more processors 41 and storage device 42;Processor in the custodial care facility 41 can be one or more, in Fig. 4 by taking a processor 41 as an example;Storage device 42 is for storing one or more programs; One or more of programs are executed by one or more of processors 41, so that one or more of processors 41 are realized Monitoring method as described in any one of embodiment of the present invention.
The custodial care facility can also include:Camera 43, output device 44 and communication device 45.
Processor 41, storage device 42, camera 43, output device 44 and communication device 45 in custodial care facility can lead to It crosses bus or other modes connects, in Fig. 4 for being connected by bus.
Storage device 42 in the custodial care facility is used as a kind of computer readable storage medium, can be used for storing one or more A program, described program can be software program, computer executable program and module, such as the embodiment of the present invention one or two institutes Corresponding program instruction/the module of offer monitoring method (for example, the module in attached monitor device shown in Fig. 3, including:Obtain mould Block 31, personnel's determining module 32, sight determining module 33 and calling module 34 further include:Benchmark image recording module 35 and language Sound reminding module 36).Software program, instruction and the module that processor 41 is stored in storage device 42 by operation, thus The various function application and data processing of custodial care facility are executed, i.e. monitoring method in realization above method embodiment.
Storage device 42 may include storing program area and storage data area, wherein storing program area can storage program area, Application program needed at least one function;Storage data area, which can be stored, uses created data etc. according to equipment.In addition, Storage device 42 may include high-speed random access memory, can also include nonvolatile memory, for example, at least a magnetic Disk storage device, flush memory device or other non-volatile solid state memory parts.In some instances, storage device 42 can be into one Step includes the memory remotely located relative to processor 41, these remote memories can pass through network connection to equipment.On The example for stating network includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
Camera 43 can be used for typing and wait for the eyes image of care provider as in pre-set image, and acquisition monitoring region The eyes image of personnel, wherein camera 43 can be input unit, and terminal device can also include remaining in addition to camera 43 Input unit, such as microphone or keyboard.Output device 44 may include that display screen, loudspeaker or indicator light etc. show equipment.It is logical The corresponding calling of different call class can be sent to different terminals by T unit 45.
Also, when one or more included program of above-mentioned custodial care facility is held by one or more of processors 41 When row, program is proceeded as follows:Obtain the face image of personnel in monitoring region;If the face image and pre-set image Matching, it is determined that the corresponding personnel of the face image are to care provider;According in the face image to care provider Eyes image, determine the sight to care provider;If the sight to care provider is watched attentively for triggering calling Predeterminable area in correspond to any subregion of different call functions be more than early warning duration, then according to the subregion watched attentively or according to The subregion and the physical condition to care provider watched attentively, determine call class and carry out respective call.
In addition, the embodiment of the present invention also provides a kind of computer readable storage medium, it is stored thereon with computer program, it should For executing a kind of monitoring method when program is executed by processor, this method includes:Obtain face's figure of personnel in monitoring region Picture;If the face image is matched with pre-set image, it is determined that the corresponding personnel of the face image are to care provider;Root According to the eyes image in the face image to care provider, the sight to care provider is determined;If described wait supervise The sight of shield personnel watches any subregion that different call functions are corresponded in the predeterminable area for triggering calling attentively more than early warning Duration determines calling then according to the subregion watched attentively or according to the subregion and the physical condition to care provider watched attentively Grade simultaneously carries out respective call.
Optionally, it can be also used for executing one kind provided by any embodiment of the invention when which is executed by processor The technical solution of monitoring method.By the description above with respect to embodiment, those skilled in the art can be clearly It solves, the present invention can be realized by software and required common hardware, naturally it is also possible to by hardware realization, but many situations It is lower the former be more preferably embodiment.Based on this understanding, technical solution of the present invention is substantially in other words to the prior art The part to contribute can be embodied in the form of software products, which can store can in computer It reads in storage medium, floppy disk, read-only memory (Read-Only Memory, ROM), random access memory such as computer (Random Access Memory, RAM), flash memory (FLASH), hard disk or CD etc., including some instructions are used so that one Computer equipment (can be personal computer, server or the network equipment etc.) executes described in each embodiment of the present invention Method.
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation, It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.

Claims (10)

1. a kind of monitoring method, which is characterized in that including:
Obtain the face image of personnel in monitoring region;
If the face image is matched with pre-set image, it is determined that the corresponding personnel of the face image are to care provider;
According to the eyes image in the face image to care provider, the sight to care provider is determined;
If the sight to care provider, which is watched attentively, corresponds to appointing for different call functions in the predeterminable area for triggering calling One subregion is more than early warning duration, then according to the subregion watched attentively or according to the subregion and the body to care provider watched attentively Body state determines call class and carries out respective call.
If 2. the method according to claim 1, wherein the face image is matched with pre-set image, Then determine the corresponding personnel of the face image be to care provider, including:
Characteristic information is extracted from the face image;
If the characteristic information is matched with default characteristic information, it is determined that the corresponding personnel of the face image are to guardian Member.
3. the method according to claim 1, wherein it is described according to in the face image of care provider Eyes image determines the sight to care provider, including:
According to the face image and benchmark image to care provider, the location information to care provider is determined;
According to the positional information with the eye movement characteristics in care provider's eyes image, determine described to care provider's Sight.
4. the method according to claim 1, wherein subregion that the basis is watched attentively or according to the sub-district watched attentively Domain and the physical condition to care provider determine call class and carry out respective call, including:
Predetermined level tables of data is searched, determines calling corresponding with the subregion watched attentively and the physical condition to care provider Grade is simultaneously called accordingly;Or,
Predetermined level tables of data is searched, determine call class corresponding with the subregion watched attentively and carries out corresponding call.
5. the method according to claim 1, wherein it is described obtain monitoring region in personnel face image it Before, further include:
Face image of typing when care provider faces datum mark comprising environmental information is as benchmark image.
6. if the method according to claim 1, wherein watch use attentively in the sight to care provider Any subregion that different call functions are corresponded in the predeterminable area of triggering calling is more than early warning duration, then according to the son watched attentively Region or according to the subregion and the physical condition to care provider watched attentively, determine call class and carry out respective call it Afterwards, further include:
Corresponding voice reminder is sent to care provider to described according to the call class determined.
7. a kind of monitor device, which is characterized in that including:
Module is obtained, for obtaining the face image of personnel in monitoring region;
Personnel's determining module, for determining the corresponding people of the face image when the face image is matched with pre-set image Member is to care provider;
Sight determining module, for, to the eyes image in the face image of care provider, being determined described wait guard according to described The sight of personnel;
Calling module corresponds to difference in the predeterminable area called and exhales for watching attentively when the sight to care provider for trigger When any subregion of function being made to be more than early warning duration, according to the subregion watched attentively or according to the subregion watched attentively and described wait supervise The physical condition of shield personnel determines call class and carries out respective call.
8. device according to claim 7, which is characterized in that personnel's determining module, including:
Feature extraction unit, for extracting characteristic information from the face image;
Personnel's determination unit, for when the characteristic information is matched with default characteristic information, determining that the face image is corresponding Personnel be to care provider.
9. a kind of custodial care facility, which is characterized in that including:
One or more processors;
Storage device, for storing one or more programs;
One or more of programs are executed by one or more of processors, so that one or more of processors are realized Such as monitoring method of any of claims 1-6.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor Such as monitoring method of any of claims 1-6 is realized when execution.
CN201810791295.7A 2018-07-18 2018-07-18 Monitoring method, device, monitoring equipment and storage medium Active CN108922085B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201810791295.7A CN108922085B (en) 2018-07-18 2018-07-18 Monitoring method, device, monitoring equipment and storage medium
PCT/CN2019/085945 WO2020015439A1 (en) 2018-07-18 2019-05-08 Monitoring method and apparatus, monitoring device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810791295.7A CN108922085B (en) 2018-07-18 2018-07-18 Monitoring method, device, monitoring equipment and storage medium

Publications (2)

Publication Number Publication Date
CN108922085A true CN108922085A (en) 2018-11-30
CN108922085B CN108922085B (en) 2020-12-18

Family

ID=64416215

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810791295.7A Active CN108922085B (en) 2018-07-18 2018-07-18 Monitoring method, device, monitoring equipment and storage medium

Country Status (2)

Country Link
CN (1) CN108922085B (en)
WO (1) WO2020015439A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020015439A1 (en) * 2018-07-18 2020-01-23 北京七鑫易维信息技术有限公司 Monitoring method and apparatus, monitoring device, and storage medium
CN111210592A (en) * 2020-01-07 2020-05-29 珠海爬山虎科技有限公司 Video identification monitoring method, computer device and computer readable storage medium
CN111723837A (en) * 2019-03-20 2020-09-29 斯瑞克欧洲控股I公司 Techniques for processing patient-specific image data for computer-assisted surgical navigation
CN115097933A (en) * 2022-06-13 2022-09-23 华能核能技术研究院有限公司 Concentration determination method and device, computer equipment and storage medium
CN116980552A (en) * 2023-08-04 2023-10-31 安徽德恩普智能科技有限责任公司 Ward patient visual calling system based on ZigBee

Citations (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101577035A (en) * 2008-05-02 2009-11-11 通用电气公司 Method for managing alarms in a physiological monitoring system
US7983935B1 (en) * 2010-03-22 2011-07-19 Ios Health Systems, Inc. System and method for automatically and iteratively producing and updating patient summary encounter reports based on recognized patterns of occurrences
CN102663873A (en) * 2010-12-21 2012-09-12 通用电气公司 Alarm control method, physiological monitoring apparatus, and computer program product for a physiological monitoring apparatus
CN102670178A (en) * 2011-03-08 2012-09-19 通用电气公司 Wireless monitoring system and method with dual mode alarming
US20130063596A1 (en) * 2011-09-08 2013-03-14 Honda Motor Co., Ltd Vehicle-mounted device identifying apparatus
US20130265231A1 (en) * 2012-04-05 2013-10-10 Lc Technologies, Inc. Gaze Based Communications for Locked-In Hospital Patients
US20150190100A1 (en) * 2001-12-27 2015-07-09 Medtronic Minimed, Inc. System for monitoring physiological characteristics
US20150323989A1 (en) * 2014-05-09 2015-11-12 Barron Associates, Inc. System and method for communication
US20150324049A1 (en) * 2014-05-06 2015-11-12 Qualcomm Incorporated System and method for optimizing haptic feedback
CN105472179A (en) * 2015-12-10 2016-04-06 深圳市鑫德亮电子有限公司 Method and system for controlling nurse station host to answer calls differentially according to nursing levels
CN105788114A (en) * 2014-12-17 2016-07-20 南通市第人民医院 System for ward on-demand calling
US20160284202A1 (en) * 2006-07-17 2016-09-29 Eloquence Communications, Inc. Method and system for advanced patient communication
CN106200961A (en) * 2016-07-10 2016-12-07 上海青橙实业有限公司 Mobile terminal, wearable device and input method
CN106504271A (en) * 2015-09-07 2017-03-15 三星电子株式会社 Method and apparatus for eye tracking
US20170091520A1 (en) * 2015-09-30 2017-03-30 Fujitsu Limited Line-of-sight detection method and device
CN107252310A (en) * 2017-06-08 2017-10-17 湖南暄程科技有限公司 A kind of comprehensive hospital monitoring system
CN107329562A (en) * 2017-05-18 2017-11-07 北京七鑫易维信息技术有限公司 Monitoring method and device
CN107527005A (en) * 2016-06-21 2017-12-29 通用汽车环球科技运作有限责任公司 Based on watch attentively information be used for determine user view apparatus and method
JP2018045386A (en) * 2016-09-13 2018-03-22 株式会社デンソー Line-of-sight measurement device
CN107847143A (en) * 2015-07-10 2018-03-27 八乐梦床业有限公司 The Notification Method and program of patient's states notice device, patient's states notice device
US20180095539A1 (en) * 2016-10-03 2018-04-05 Microsoft Technology Licensing, Llc Automated e-tran application
CN107957775A (en) * 2016-10-18 2018-04-24 阿里巴巴集团控股有限公司 Data object exchange method and device in virtual reality space environment
US20180188805A1 (en) * 2015-06-04 2018-07-05 Beijing Zhigu Rui Tuo Tech Co., Ltd Information processing method, information processing apparatus and user equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203630908U (en) * 2013-12-12 2014-06-04 浙江中医药大学 Ward beeper controlled by eye movement signal
CN104216521B (en) * 2014-09-10 2017-11-28 苏州德品医疗科技股份有限公司 Eye for ward moves method of calling and system
CN107077214A (en) * 2014-11-06 2017-08-18 皇家飞利浦有限公司 For the method and system of the communication used within the hospital
CN204814294U (en) * 2015-06-18 2015-12-02 苏州德品医疗科技股份有限公司 ICU is eye movement calling system for disability
CN107133612A (en) * 2017-06-06 2017-09-05 河海大学常州校区 Based on image procossing and the intelligent ward of speech recognition technology and its operation method
CN107616797A (en) * 2017-08-25 2018-01-23 深圳职业技术学院 A kind of critically ill patient calling system
CN108922085B (en) * 2018-07-18 2020-12-18 北京七鑫易维信息技术有限公司 Monitoring method, device, monitoring equipment and storage medium

Patent Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150190100A1 (en) * 2001-12-27 2015-07-09 Medtronic Minimed, Inc. System for monitoring physiological characteristics
US20160284202A1 (en) * 2006-07-17 2016-09-29 Eloquence Communications, Inc. Method and system for advanced patient communication
CN101577035A (en) * 2008-05-02 2009-11-11 通用电气公司 Method for managing alarms in a physiological monitoring system
US7983935B1 (en) * 2010-03-22 2011-07-19 Ios Health Systems, Inc. System and method for automatically and iteratively producing and updating patient summary encounter reports based on recognized patterns of occurrences
CN102663873A (en) * 2010-12-21 2012-09-12 通用电气公司 Alarm control method, physiological monitoring apparatus, and computer program product for a physiological monitoring apparatus
CN102670178A (en) * 2011-03-08 2012-09-19 通用电气公司 Wireless monitoring system and method with dual mode alarming
US20130063596A1 (en) * 2011-09-08 2013-03-14 Honda Motor Co., Ltd Vehicle-mounted device identifying apparatus
US20130265231A1 (en) * 2012-04-05 2013-10-10 Lc Technologies, Inc. Gaze Based Communications for Locked-In Hospital Patients
US9244528B2 (en) * 2012-04-05 2016-01-26 Lc Technologies, Inc. Gaze based communications for locked-in hospital patients
US20150324049A1 (en) * 2014-05-06 2015-11-12 Qualcomm Incorporated System and method for optimizing haptic feedback
US20150323989A1 (en) * 2014-05-09 2015-11-12 Barron Associates, Inc. System and method for communication
CN105788114A (en) * 2014-12-17 2016-07-20 南通市第人民医院 System for ward on-demand calling
US20180188805A1 (en) * 2015-06-04 2018-07-05 Beijing Zhigu Rui Tuo Tech Co., Ltd Information processing method, information processing apparatus and user equipment
CN107847143A (en) * 2015-07-10 2018-03-27 八乐梦床业有限公司 The Notification Method and program of patient's states notice device, patient's states notice device
CN106504271A (en) * 2015-09-07 2017-03-15 三星电子株式会社 Method and apparatus for eye tracking
US20170091520A1 (en) * 2015-09-30 2017-03-30 Fujitsu Limited Line-of-sight detection method and device
CN105472179A (en) * 2015-12-10 2016-04-06 深圳市鑫德亮电子有限公司 Method and system for controlling nurse station host to answer calls differentially according to nursing levels
CN107527005A (en) * 2016-06-21 2017-12-29 通用汽车环球科技运作有限责任公司 Based on watch attentively information be used for determine user view apparatus and method
CN106200961A (en) * 2016-07-10 2016-12-07 上海青橙实业有限公司 Mobile terminal, wearable device and input method
JP2018045386A (en) * 2016-09-13 2018-03-22 株式会社デンソー Line-of-sight measurement device
US20180095539A1 (en) * 2016-10-03 2018-04-05 Microsoft Technology Licensing, Llc Automated e-tran application
CN107957775A (en) * 2016-10-18 2018-04-24 阿里巴巴集团控股有限公司 Data object exchange method and device in virtual reality space environment
CN107329562A (en) * 2017-05-18 2017-11-07 北京七鑫易维信息技术有限公司 Monitoring method and device
CN107252310A (en) * 2017-06-08 2017-10-17 湖南暄程科技有限公司 A kind of comprehensive hospital monitoring system

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020015439A1 (en) * 2018-07-18 2020-01-23 北京七鑫易维信息技术有限公司 Monitoring method and apparatus, monitoring device, and storage medium
CN111723837A (en) * 2019-03-20 2020-09-29 斯瑞克欧洲控股I公司 Techniques for processing patient-specific image data for computer-assisted surgical navigation
CN111723837B (en) * 2019-03-20 2024-03-12 斯瑞克欧洲控股I公司 Techniques for processing image data of a particular patient for computer-assisted surgical navigation
CN111210592A (en) * 2020-01-07 2020-05-29 珠海爬山虎科技有限公司 Video identification monitoring method, computer device and computer readable storage medium
CN115097933A (en) * 2022-06-13 2022-09-23 华能核能技术研究院有限公司 Concentration determination method and device, computer equipment and storage medium
CN116980552A (en) * 2023-08-04 2023-10-31 安徽德恩普智能科技有限责任公司 Ward patient visual calling system based on ZigBee

Also Published As

Publication number Publication date
WO2020015439A1 (en) 2020-01-23
CN108922085B (en) 2020-12-18

Similar Documents

Publication Publication Date Title
CN108922085A (en) A kind of monitoring method, device, custodial care facility and storage medium
JP6101684B2 (en) Method and system for assisting patients
US20180325440A1 (en) Emotion regulation device, wearable device and cap for relieving emotion
JP6218427B2 (en) Recognition and feedback of facial expressions and voice emotions
US10332423B2 (en) Cardiopulmonary resuscitation guidance method, computer program product and system
CN117991885A (en) Display system
EP3133471A1 (en) Play control method, apparatus, terminal, and recording medium
CN107361747A (en) A kind of alarming method for power and device for Intelligent worn device
KR102164475B1 (en) Seizure monitoring method and apparatus using video
WO2021098022A1 (en) Healthy environment adjustment method, terminal, and computer-readable storage medium
JP7107302B2 (en) Information processing device, information processing method, and program
WO2020125078A1 (en) Heart rhythm monitoring method, device, electronic apparatus and computer-readable storage medium
CN108566534A (en) Alarm method, device, terminal based on video monitoring and storage medium
US20220245812A1 (en) Platform to detect patient health condition based on images of physiological activity of a patient
CN108852312A (en) Wearable device control method, wearable device and computer readable storage medium
CN110598611A (en) Nursing system, patient nursing method based on nursing system and readable storage medium
CN104216521B (en) Eye for ward moves method of calling and system
CN107329562A (en) Monitoring method and device
CN110531859A (en) Man-machine interaction method and device based on VR aobvious identification user's operation movements
US10643636B2 (en) Information processing apparatus, information processing method, and program
CN109413470A (en) A kind of the determination method and terminal device of image to be detected frame
CN111616722A (en) Method and system for detecting emotion change and wearable device
KR101641027B1 (en) Remote monitoring wearable apparatus for objects to protect and apparatus and method for monitoring objects to protect
CN108563322B (en) Control method and device of VR/AR equipment
CN109917915A (en) Record screen control method, terminal and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant