CN105279494A - Human-computer interaction system, method and equipment capable of regulating user emotion - Google Patents
Human-computer interaction system, method and equipment capable of regulating user emotion Download PDFInfo
- Publication number
- CN105279494A CN105279494A CN201510697118.9A CN201510697118A CN105279494A CN 105279494 A CN105279494 A CN 105279494A CN 201510697118 A CN201510697118 A CN 201510697118A CN 105279494 A CN105279494 A CN 105279494A
- Authority
- CN
- China
- Prior art keywords
- man
- user
- machine interface
- interface
- emotion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a human-computer interaction system, method and equipment capable of regulating user emotion. The human-computer interaction system capable of regulating the user emotion comprises a face acquisition module, a face recognition module and a human-computer interface regulation module, wherein the face acquisition module collects the face information of the user; the face recognition module is connected with the face acquisition module to recognize the face information and determine an emotion type to which the face micro-expression of the user belongs; and the human-computer interface regulation module is connected with the face recognition module and regulates the display state of a human-computer interface according to the emotion type to which the face micro-expression of the user belongs. The user micro-expression is recognized mainly through a face recognition technology, the user emotion generated when the user uses the human-computer interaction system can be judged, so that the content of the human-computer interface is subjected to the switching of aspects including theme templates or colors and the like so as to achieve humanized color interface interaction, a user can regulate the emotion in a short time, and the human-computer interaction system positively influences the user.
Description
Technical field
The invention belongs to technical field of electronic equipment, relate to a kind of display interface of electronic equipment, particularly relate to a kind of man-machine interactive system, method and apparatus of adjustable user emotion.
Background technology
Man-machine interface (also known as user interface or user interface) carries out medium that is mutual and message exchange between system and user, and it realizes the conversion that the internal form of information and the mankind can accept between form.The field that all participant's machine informations exchange all also exists man-machine interface.
Man-machine interface (HumanMachineInteraction is called for short HMI), being medium and the dialog interface of transmitting, exchange information between people and computing machine, is the important component part of computer system.Man-machine interface refer to people and machine message exchange with functionally contact or interactive field or claim said man-computer cooperation face, interface, message exchange, function contacts or interacts, what refer to people and machine firmly contacts and softly to touch, this faying face not only comprises the direct contact of point-line-surface, also comprises the action space of remote information transmission and control.
In the design process of system, the designer of man-machine interface will catch the feature of user, finds the demand of user.Constantly to ask for consumers' opinions in the whole performance history of system, seek advice to user.The design decision of system in conjunction with the work of user and applied environment, will it must be understood that the requirement of user to system.
Summary of the invention
The shortcoming of prior art in view of the above, the object of the present invention is to provide a kind of man-machine interactive system, method and apparatus of adjustable user emotion, for solving existing humanizing of human-computer interaction interface, improve the intelligentized problem of human-computer interaction interface further.
For achieving the above object and other relevant objects, the invention provides a kind of man-machine interaction method of adjustable user emotion, the man-machine interaction method of described adjustable user emotion comprises: the facial information gathering user; Identify described facial information, determine the type of emotion belonging to the micro-expression of the face of user; According to the type of emotion belonging to the micro-expression of the face of described user, regulate the display state of man-machine interface.
Alternatively, the implementation procedure of the display state of described adjustment man-machine interface comprises: the display state switching man-machine interface according to the regulating command of man-machine interface, specifically comprises: arrange the interface corresponding from the different facial emotions of user and regulate indicating template; Under the control of described regulating command, switch to the interface corresponding with the facial emotions of user to regulate indicating template the indicating template of current man-machine interface; Or/and the setting interface corresponding from the different facial emotions of user regulates show colour system; Under the control of described regulating command, switch to the interface corresponding with the facial emotions of user to regulate the display color of current man-machine interface show colour system.
Alternatively, described interface regulates indicating template to comprise the constant indicating template of pattern, or/and the indicating template of pattern gradual change; Described interface regulates display colour system to comprise the constant display color of color, or/and the display color of color gradient.
The present invention also provides a kind of man-machine interactive system of adjustable user emotion, and the man-machine interactive system of described adjustable user emotion comprises: face acquisition module, gathers the facial information of user; Face recognition module, is connected with described face acquisition module, identifies described facial information, determines the type of emotion belonging to the micro-expression of the face of user; Man-machine interface adjustment module, is connected with described face recognition module, according to the type of emotion belonging to the micro-expression of the face of described user, regulates the display state of man-machine interface.
Alternatively, the man-machine interactive system of described adjustable user emotion also comprises: man-machine interface display module, is connected with described man-machine interface adjustment module, switches the display state of man-machine interface according to the regulating command of described man-machine interface adjustment module; Described man-machine interface display module comprises: template for displaying unit, comprises the interface corresponding from the different facial emotions of user and regulates indicating template; The indicating template of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate indicating template by described template for displaying unit under the control of described regulating command; Or/and color displays unit, comprise the interface corresponding from the different facial emotions of user and regulate and show colour system; The display color of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate to show colour system by described color displays unit under the control of described regulating command.
Alternatively, described interface regulates indicating template to comprise the constant indicating template of pattern, or/and the indicating template of pattern gradual change; Described interface regulates display colour system to comprise the constant display color of color, or/and the display color of color gradient.
The present invention also provides a kind of human-computer interaction device of adjustable user emotion, and the human-computer interaction device of described adjustable user emotion comprises: camera, gathers the facial information of user; Man-machine interface; Processor, is connected respectively with described man-machine interface with described camera, comprises: face recognition module, is connected with described camera, identifies described facial information, determines the type of emotion belonging to the micro-expression of the face of user; Man-machine interface adjustment module, is connected with described man-machine interface respectively with described face recognition module, according to the type of emotion belonging to the micro-expression of the face of described user, regulates the display state of described man-machine interface.
Alternatively, described processor also comprises: man-machine interface display module, is connected respectively with man-machine interface with described man-machine interface adjustment module, switches the display state of man-machine interface according to the regulating command of described man-machine interface adjustment module; Described man-machine interface display module comprises: template for displaying unit, comprises the interface corresponding from the different facial emotions of user and regulates indicating template; The indicating template of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate indicating template by described template for displaying unit under the control of described regulating command; Or/and color displays unit, comprise the interface corresponding from the different facial emotions of user and regulate and show colour system; The display color of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate to show colour system by described color displays unit under the control of described regulating command.
Alternatively, described interface regulates indicating template to comprise the constant indicating template of pattern, or/and the indicating template of pattern gradual change; Described interface regulates display colour system to comprise the constant display color of color, or/and the display color of color gradient.
Alternatively, the human-computer interaction device of described adjustable user emotion is the equipment with man-machine interface, comprises mobile phone, Pad, desktop computer or notebook.
As mentioned above, man-machine interactive system, the method and apparatus of adjustable user emotion of the present invention, have following beneficial effect:
The present invention is mainly through the micro-expression of face recognition technology identification user, judge mood when user uses, thus the content of man-machine interface is carried out to the switching of the aspects such as theme template or color, thus reach the color interface alternation of hommization, make user obtain the adjustment of mood at short notice, the positive effect in a front is played to user.
Accompanying drawing explanation
Fig. 1 is shown as a kind of realization flow schematic diagram of the man-machine interaction method of the adjustable user emotion described in the embodiment of the present invention.
Fig. 2 is shown as a kind of realization flow schematic diagram of the step S103 of the man-machine interaction method of the adjustable user emotion described in the embodiment of the present invention.
The one that Fig. 3 is shown as the man-machine interactive system of the adjustable user emotion described in the embodiment of the present invention realizes structural representation.
The one that Fig. 4 is shown as the human-computer interaction device of the adjustable user emotion described in the embodiment of the present invention realizes structural representation.
Element numbers explanation
The man-machine interactive system of 300 adjustable user emotions
310 face acquisition modules
320,431 face recognition module
330,432 man-machine interface adjustment modules
340,433 man-machine interface display modules
341,4331 template for displaying unit
342,4332 color displays unit
The human-computer interaction device of 400 adjustable user emotions
410 cameras
420 man-machine interfaces
430 processors
S101 ~ S103 step
S201 ~ S202 step
Embodiment
Below by way of specific instantiation, embodiments of the present invention are described, those skilled in the art the content disclosed by this instructions can understand other advantages of the present invention and effect easily.The present invention can also be implemented or be applied by embodiments different in addition, and the every details in this instructions also can based on different viewpoints and application, carries out various modification or change not deviating under spirit of the present invention.It should be noted that, when not conflicting, the feature in following examples and embodiment can combine mutually.
It should be noted that, the diagram provided in following examples only illustrates basic conception of the present invention in a schematic way, then only the assembly relevant with the present invention is shown in graphic but not component count, shape and size when implementing according to reality is drawn, it is actual when implementing, and the kenel of each assembly, quantity and ratio can be a kind of change arbitrarily, and its assembly layout kenel also may be more complicated.
Refer to Fig. 1, the invention provides a kind of man-machine interaction method of adjustable user emotion, the man-machine interaction method of described adjustable user emotion comprises:
S101, gathers the facial information of user.This step can be realized by camera, also can realize by realizing the operational blocks which partition system of image collecting function, device or equipment.What protection scope of the present invention was not limited to that the present embodiment enumerates realizes structure.Namely described facial information refers to facial expression.Facial expression is a kind of body language form completing fine information and link up.The face of people has tens of pieces of muscle, can produce extremely abundant expression, accurately passes on ten various different phychology and emotions.Facial expression can show the affirmation and negation, receive with refusal, actively with passiveness, strongly and the emotion such as slight.In general, showing joyful key position is mouth, cheek, eyebrow, volume; What performance was detested is nose, cheek, mouth; What performance was sad is eyebrow, volume, eyes and eyelid: what performance was frightened is eyes and eyelid.
S102, identifies described facial information, determines the type of emotion belonging to the micro-expression of the face of user.Namely the micro-expression of described face also refers to facial expression.This step, according to the facial information read out, can be classified to the facial expression of the user read, and then understand the mood of user's current state.The institute that the mankind may be able to occur according to facial information by this step is in a bad mood and classifies, refinement, then by identifying the type of emotion determining expressed by the current facial information of user, such as: certainly, negative, receive, refusal, positive, passive, strong, slight etc.Protection scope of the present invention is not limited to the division of the type of emotion that the present embodiment is enumerated.
S103, according to the type of emotion belonging to the micro-expression of the face of described user, regulates the display state of man-machine interface.A kind of implementation procedure of the display state of described adjustment man-machine interface comprises: the display state switching man-machine interface according to the regulating command of man-machine interface.The object of this step is when user uses man-machine interface, according to the display state of the type of emotion adjustment man-machine interface of user, and then reaches the object regulating user emotion.
Shown in Figure 2, in described step S103, a kind of specific implementation process switching the display state of man-machine interface according to the regulating command of man-machine interface comprises:
S201, arranges the interface corresponding from the different facial emotions of user and regulates indicating template; Under the control of described regulating command, switch to the interface corresponding with the facial emotions of user to regulate indicating template the indicating template of current man-machine interface.Described interface regulates indicating template to comprise the constant indicating template of pattern, or/and the indicating template of pattern gradual change.Such as: the mood of user is happy when waiting front type mood, can the indicating template of the types such as corresponding employing layout is regular.When the mood of user is the negative type mood such as angry, correspondingly can adopt the indicating template of flexible layout, the type such as ingenious.
S202, arranges the interface corresponding from the different facial emotions of user and regulates and show colour system; Under the control of described regulating command, switch to the interface corresponding with the facial emotions of user to regulate the display color of current man-machine interface show colour system.Described interface regulates display colour system to comprise the constant display color of color, or/and the display color of color gradient.Such as: the mood of user is happy when waiting front type mood, can the corresponding display color adopting routine.When the mood of user is the negative type mood such as angry, correspondingly can adopts and there is soft, the effect such as to releive display color.Display color can be single color, also can be the color of gradual change.
The mode of above 2 kinds of man-machine interface display states of adjustment that the present embodiment is enumerated, but protection scope of the present invention includes but not limited to above-mentioned two kinds of regulative modes.The mode of the adjustment user emotion that every principle according to the present invention realizes all is included in protection scope of the present invention.
The protection domain of the man-machine interaction method of adjustable user emotion of the present invention is not limited to the step execution sequence that the present embodiment is enumerated, and the step increase and decrease of the prior art that every principle according to the present invention is done, step are replaced the scheme realized and be all included in protection scope of the present invention.
The present invention also provides a kind of man-machine interactive system of adjustable user emotion; the man-machine interactive system of described adjustable user emotion can realize the man-machine interaction method of adjustable user emotion of the present invention; but the implement device of the man-machine interaction method of adjustable user emotion of the present invention includes but not limited to the structure of the man-machine interactive system of the adjustable user emotion that the present embodiment is enumerated; the malformation of the prior art that every principle according to the present invention is done and replacement, be all included in protection scope of the present invention.
Shown in Figure 3, the man-machine interactive system 300 of described adjustable user emotion comprises: face acquisition module 310, face recognition module 320, man-machine interface adjustment module 330, or/and man-machine interface display module 340.
Described face acquisition module 310 gathers the facial information of user.Described face acquisition module can be realized by camera, also can realize by realizing the operational blocks which partition system of image collecting function, device or equipment.What protection scope of the present invention was not limited to that the present embodiment enumerates realizes structure.Namely described facial information refers to facial expression.Facial expression is a kind of body language form completing fine information and link up.The face of people has tens of pieces of muscle, can produce extremely abundant expression, accurately passes on ten various different phychology and emotions.Facial expression can show the affirmation and negation, receive with refusal, actively with passiveness, strongly and the emotion such as slight.In general, showing joyful key position is mouth, cheek, eyebrow, volume; What performance was detested is nose, cheek, mouth; What performance was sad is eyebrow, volume, eyes and eyelid: what performance was frightened is eyes and eyelid.
Described face recognition module 320 is connected with described face acquisition module 310, identifies described facial information, determines the type of emotion belonging to the micro-expression of the face of user.Described face recognition module, according to the facial information read out, can be classified to the facial expression of the user read, and then understand the mood of user's current state.The institute that the mankind may be able to occur according to facial information by this step is in a bad mood and classifies, refinement, then by identifying the type of emotion determining expressed by the current facial information of user, such as: certainly, negative, receive, refusal, positive, passive, strong, slight etc.Protection scope of the present invention is not limited to the division of the type of emotion that the present embodiment is enumerated.
Described man-machine interface adjustment module 330 is connected with described face recognition module 320, according to the type of emotion belonging to the micro-expression of the face of described user, regulates the display state of man-machine interface.The object of described man-machine interface adjustment module is when user uses man-machine interface, according to the display state of the type of emotion adjustment man-machine interface of user, and then reaches the object regulating user emotion.
Described man-machine interface display module 340 is connected with described man-machine interface adjustment module 330, switches the display state of man-machine interface according to the regulating command of described man-machine interface adjustment module.
Further, described man-machine interface display module 340 comprises: template for displaying unit 341, or/and color displays unit 342.
Described template for displaying unit 341 comprises the interface corresponding from the different facial emotions of user and regulates indicating template; The indicating template of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate indicating template by described template for displaying unit under the control of described regulating command.Further, described interface regulates indicating template to comprise the constant indicating template of pattern, or/and the indicating template of pattern gradual change.Such as: the mood of user is happy when waiting front type mood, can the indicating template of the types such as corresponding employing layout is regular.When the mood of user is the negative type mood such as angry, correspondingly can adopt the indicating template of flexible layout, the type such as ingenious.
Described color displays unit 342 comprises the interface corresponding from the different facial emotions of user and regulates and show colour system; The display color of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate to show colour system by described color displays unit under the control of described regulating command.Further, described interface regulates display colour system to comprise the constant display color of color, or/and the display color of color gradient.Such as: the mood of user is happy when waiting front type mood, can the corresponding display color adopting routine.When the mood of user is the negative type mood such as angry, correspondingly can adopts and there is soft, the effect such as to releive display color.Display color can be single color, also can be the color of gradual change.
The present invention also provides a kind of human-computer interaction device of adjustable user emotion; the human-computer interaction device of described adjustable user emotion can realize the access method of mass data of the present invention; but the implement device of the access method of mass data of the present invention includes but not limited to the structure of the human-computer interaction device of the adjustable user emotion that the present embodiment is enumerated; the malformation of the prior art that every principle according to the present invention is done and replacement, be all included in protection scope of the present invention.
Shown in Figure 4, the human-computer interaction device 400 of described adjustable user emotion comprises: camera 410, man-machine interface 420, processor 430.The human-computer interaction device 400 of described adjustable user emotion, for having the equipment of man-machine interface, comprises mobile phone, Pad, desktop computer or notebook etc.
Described camera 410 gathers the facial information of user.Described camera also can realize by realizing the operational blocks which partition system of image collecting function, device or equipment.What protection scope of the present invention was not limited to that the present embodiment enumerates realizes structure.Namely described facial information refers to facial expression.Facial expression is a kind of body language form completing fine information and link up.The face of people has tens of pieces of muscle, can produce extremely abundant expression, accurately passes on ten various different phychology and emotions.Facial expression can show the affirmation and negation, receive with refusal, actively with passiveness, strongly and the emotion such as slight.In general, showing joyful key position is mouth, cheek, eyebrow, volume; What performance was detested is nose, cheek, mouth; What performance was sad is eyebrow, volume, eyes and eyelid: what performance was frightened is eyes and eyelid.
Described processor 430 is connected with described man-machine interface 420 respectively with described camera 410, comprising: face recognition module 431, man-machine interface adjustment module 432, man-machine interface display module 433.
Described face recognition module 431 is connected with described camera 410, identifies described facial information, determines the type of emotion belonging to the micro-expression of the face of user.Described face recognition module, according to the facial information read out, can be classified to the facial expression of the user read, and then understand the mood of user's current state.The institute that the mankind may be able to occur according to facial information by this step is in a bad mood and classifies, refinement, then by identifying the type of emotion determining expressed by the current facial information of user, such as: certainly, negative, receive, refusal, positive, passive, strong, slight etc.Protection scope of the present invention is not limited to the division of the type of emotion that the present embodiment is enumerated.
Described man-machine interface adjustment module 432 is connected with described man-machine interface 420 respectively with described face recognition module 431, according to the type of emotion belonging to the micro-expression of the face of described user, regulates the display state of described man-machine interface.The object of described man-machine interface adjustment module is when user uses man-machine interface, according to the display state of the type of emotion adjustment man-machine interface of user, and then reaches the object regulating user emotion.
Described man-machine interface display module 433 is connected with man-machine interface 420 respectively with described man-machine interface adjustment module 431, switches the display state of man-machine interface according to the regulating command of described man-machine interface adjustment module.Described man-machine interface display module 433 comprises: template for displaying unit 4331, or/and color displays unit 4332.
Described template for displaying unit 4331 comprises the interface corresponding from the different facial emotions of user and regulates indicating template; The indicating template of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate indicating template by described template for displaying unit under the control of described regulating command.Described interface regulates indicating template to comprise the constant indicating template of pattern, or/and the indicating template of pattern gradual change.Such as: the mood of user is happy when waiting front type mood, can the indicating template of the types such as corresponding employing layout is regular.When the mood of user is the negative type mood such as angry, correspondingly can adopt the indicating template of flexible layout, the type such as ingenious.
Described color displays unit 4332 comprises the interface corresponding from the different facial emotions of user and regulates and show colour system; The display color of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate to show colour system by described color displays unit under the control of described regulating command.Described interface regulates display colour system to comprise the constant display color of color, or/and the display color of color gradient.Such as: the mood of user is happy when waiting front type mood, can the corresponding display color adopting routine.When the mood of user is the negative type mood such as angry, correspondingly can adopts and there is soft, the effect such as to releive display color.Display color can be single color, also can be the color of gradual change.
The present invention by identifying that the micro-expression of face changes the contents such as the display color of man-machine interface, thus realizes the function regulating user emotion.The present invention is mainly through the micro-expression of face recognition technology identification user, judge mood when user uses, thus the content of man-machine interface is carried out to the switching of the aspects such as theme template or color, thus reach the color interface alternation of hommization, make user obtain the adjustment of mood at short notice, the positive effect in a front is played to user.
In sum, the present invention effectively overcomes various shortcoming of the prior art and tool high industrial utilization.
Above-described embodiment is illustrative principle of the present invention and effect thereof only, but not for limiting the present invention.Any person skilled in the art scholar all without prejudice under spirit of the present invention and category, can modify above-described embodiment or changes.Therefore, such as have in art usually know the knowledgeable do not depart from complete under disclosed spirit and technological thought all equivalence modify or change, must be contained by claim of the present invention.
Claims (10)
1. a man-machine interaction method for adjustable user emotion, is characterized in that, the man-machine interaction method of described adjustable user emotion comprises:
Gather the facial information of user;
Identify described facial information, determine the type of emotion belonging to the micro-expression of the face of user;
According to the type of emotion belonging to the micro-expression of the face of described user, regulate the display state of man-machine interface.
2. the man-machine interaction method of adjustable user emotion according to claim 1, is characterized in that, the implementation procedure of the display state of described adjustment man-machine interface comprises:
Switch the display state of man-machine interface according to the regulating command of man-machine interface, specifically comprise:
The interface corresponding from the different facial emotions of user is set and regulates indicating template; Under the control of described regulating command, switch to the interface corresponding with the facial emotions of user to regulate indicating template the indicating template of current man-machine interface; Or/and
Arrange the interface corresponding from the different facial emotions of user to regulate and show colour system; Under the control of described regulating command, switch to the interface corresponding with the facial emotions of user to regulate the display color of current man-machine interface show colour system.
3. the man-machine interaction method of adjustable user emotion according to claim 2, is characterized in that: described interface regulates indicating template to comprise the constant indicating template of pattern, or/and the indicating template of pattern gradual change; Described interface regulates display colour system to comprise the constant display color of color, or/and the display color of color gradient.
4. a man-machine interactive system for adjustable user emotion, is characterized in that, the man-machine interactive system of described adjustable user emotion comprises:
Face acquisition module, gathers the facial information of user;
Face recognition module, is connected with described face acquisition module, identifies described facial information, determines the type of emotion belonging to the micro-expression of the face of user;
Man-machine interface adjustment module, is connected with described face recognition module, according to the type of emotion belonging to the micro-expression of the face of described user, regulates the display state of man-machine interface.
5. the man-machine interactive system of adjustable user emotion according to claim 4, is characterized in that, the man-machine interactive system of described adjustable user emotion also comprises:
Man-machine interface display module, is connected with described man-machine interface adjustment module, switches the display state of man-machine interface according to the regulating command of described man-machine interface adjustment module;
Described man-machine interface display module comprises:
Template for displaying unit, comprises the interface corresponding from the different facial emotions of user and regulates indicating template; The indicating template of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate indicating template by described template for displaying unit under the control of described regulating command; Or/and
Color displays unit, comprises the interface corresponding from the different facial emotions of user and regulates and show colour system; The display color of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate to show colour system by described color displays unit under the control of described regulating command.
6. the man-machine interactive system of adjustable user emotion according to claim 5, is characterized in that: described interface regulates indicating template to comprise the constant indicating template of pattern, or/and the indicating template of pattern gradual change; Described interface regulates display colour system to comprise the constant display color of color, or/and the display color of color gradient.
7. a human-computer interaction device for adjustable user emotion, is characterized in that, the human-computer interaction device of described adjustable user emotion comprises:
Camera, gathers the facial information of user;
Man-machine interface;
Processor, is connected respectively with described man-machine interface with described camera, comprises:
Face recognition module, is connected with described camera, identifies described facial information, determines the type of emotion belonging to the micro-expression of the face of user;
Man-machine interface adjustment module, is connected with described man-machine interface respectively with described face recognition module, according to the type of emotion belonging to the micro-expression of the face of described user, regulates the display state of described man-machine interface.
8. the human-computer interaction device of adjustable user emotion according to claim 7, is characterized in that, described processor also comprises:
Man-machine interface display module, is connected with man-machine interface respectively with described man-machine interface adjustment module, switches the display state of man-machine interface according to the regulating command of described man-machine interface adjustment module;
Described man-machine interface display module comprises:
Template for displaying unit, comprises the interface corresponding from the different facial emotions of user and regulates indicating template; The indicating template of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate indicating template by described template for displaying unit under the control of described regulating command; Or/and
Color displays unit, comprises the interface corresponding from the different facial emotions of user and regulates and show colour system; The display color of current man-machine interface switches to the interface corresponding with the facial emotions of user to regulate to show colour system by described color displays unit under the control of described regulating command.
9. the human-computer interaction device of adjustable user emotion according to claim 8, is characterized in that: described interface regulates indicating template to comprise the constant indicating template of pattern, or/and the indicating template of pattern gradual change; Described interface regulates display colour system to comprise the constant display color of color, or/and the display color of color gradient.
10. the human-computer interaction device of the adjustable user emotion according to claim 7 to 9 any one, it is characterized in that: the human-computer interaction device of described adjustable user emotion is the equipment with man-machine interface, comprises mobile phone, Pad, desktop computer or notebook.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510697118.9A CN105279494A (en) | 2015-10-23 | 2015-10-23 | Human-computer interaction system, method and equipment capable of regulating user emotion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510697118.9A CN105279494A (en) | 2015-10-23 | 2015-10-23 | Human-computer interaction system, method and equipment capable of regulating user emotion |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105279494A true CN105279494A (en) | 2016-01-27 |
Family
ID=55148478
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510697118.9A Pending CN105279494A (en) | 2015-10-23 | 2015-10-23 | Human-computer interaction system, method and equipment capable of regulating user emotion |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105279494A (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106126017A (en) * | 2016-06-20 | 2016-11-16 | 北京小米移动软件有限公司 | Intelligent identification Method, device and terminal unit |
| CN106445349A (en) * | 2016-10-18 | 2017-02-22 | 珠海格力电器股份有限公司 | Method and device for adjusting system parameters of mobile terminal and electronic equipment |
| CN106419336A (en) * | 2016-09-29 | 2017-02-22 | 浙江农林大学 | LED mood display and excitation intelligent mirror and use method thereof |
| CN106708394A (en) * | 2016-12-23 | 2017-05-24 | 维沃移动通信有限公司 | Mobile terminal and system theme switching method thereof |
| CN106933477A (en) * | 2017-02-28 | 2017-07-07 | 上海华章信息科技有限公司 | A kind of intelligent terminal skin change method based on mood detection |
| CN107437052A (en) * | 2016-05-27 | 2017-12-05 | 深圳市珍爱网信息技术有限公司 | Blind date satisfaction computational methods and system based on micro- Expression Recognition |
| CN107436763A (en) * | 2017-07-04 | 2017-12-05 | 广东小天才科技有限公司 | A kind of method and wearable device for switching wearable device interface subject |
| CN108153423A (en) * | 2018-01-10 | 2018-06-12 | 重庆大学 | A kind of visual gesture Adaptable System towards human-computer interaction |
| CN108614987A (en) * | 2016-12-13 | 2018-10-02 | 深圳光启合众科技有限公司 | The method, apparatus and robot of data processing |
| CN110012326A (en) * | 2018-08-21 | 2019-07-12 | 永康市胜时电机有限公司 | Review the anti-irritated processing system of mode |
| CN110298242A (en) * | 2019-05-22 | 2019-10-01 | 深圳壹账通智能科技有限公司 | APP method for switching theme, device, equipment and storage medium based on research and development management |
| CN110377380A (en) * | 2019-06-21 | 2019-10-25 | 深圳壹账通智能科技有限公司 | Theme hue adjusting method, device, equipment and computer readable storage medium |
| WO2020015152A1 (en) * | 2018-07-18 | 2020-01-23 | 平安科技（深圳）有限公司 | Method and device for setting system theme, computer apparatus, and storage medium |
| CN111176503A (en) * | 2019-12-16 | 2020-05-19 | 珠海格力电器股份有限公司 | Interactive system setting method and device and storage medium |
| CN112568904A (en) * | 2019-09-30 | 2021-03-30 | 比亚迪股份有限公司 | Vehicle interaction method and device, computer equipment and storage medium |
| CN112686118A (en) * | 2020-12-24 | 2021-04-20 | 昆明理工大学 | Interaction model for adjusting user emotion based on adaptive interface |
| CN113687744A (en) * | 2021-08-19 | 2021-11-23 | 北京智精灵科技有限公司 | Man-machine interaction method and device for emotion adjustment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102868830A (en) * | 2012-09-26 | 2013-01-09 | 广东欧珀移动通信有限公司 | Switching control method and device of mobile terminal themes |
| CN103309449A (en) * | 2012-12-17 | 2013-09-18 | 广东欧珀移动通信有限公司 | Mobile terminal and method for automatically switching wall paper based on facial expression recognition |
| CN103425380A (en) * | 2012-05-14 | 2013-12-04 | 联想(北京)有限公司 | Information processing method and equipment |
| CN103888826A (en) * | 2012-12-20 | 2014-06-25 | 中山大学深圳研究院 | Television desktop system and desktop switching method based on android |
| CN104023125A (en) * | 2014-05-14 | 2014-09-03 | 上海卓悠网络科技有限公司 | Method and terminal capable of automatically switching system scenes according to user emotion |
-
2015
- 2015-10-23 CN CN201510697118.9A patent/CN105279494A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103425380A (en) * | 2012-05-14 | 2013-12-04 | 联想(北京)有限公司 | Information processing method and equipment |
| CN102868830A (en) * | 2012-09-26 | 2013-01-09 | 广东欧珀移动通信有限公司 | Switching control method and device of mobile terminal themes |
| CN103309449A (en) * | 2012-12-17 | 2013-09-18 | 广东欧珀移动通信有限公司 | Mobile terminal and method for automatically switching wall paper based on facial expression recognition |
| CN103888826A (en) * | 2012-12-20 | 2014-06-25 | 中山大学深圳研究院 | Television desktop system and desktop switching method based on android |
| CN104023125A (en) * | 2014-05-14 | 2014-09-03 | 上海卓悠网络科技有限公司 | Method and terminal capable of automatically switching system scenes according to user emotion |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107437052A (en) * | 2016-05-27 | 2017-12-05 | 深圳市珍爱网信息技术有限公司 | Blind date satisfaction computational methods and system based on micro- Expression Recognition |
| CN106126017A (en) * | 2016-06-20 | 2016-11-16 | 北京小米移动软件有限公司 | Intelligent identification Method, device and terminal unit |
| CN106419336A (en) * | 2016-09-29 | 2017-02-22 | 浙江农林大学 | LED mood display and excitation intelligent mirror and use method thereof |
| CN106445349A (en) * | 2016-10-18 | 2017-02-22 | 珠海格力电器股份有限公司 | Method and device for adjusting system parameters of mobile terminal and electronic equipment |
| CN108614987A (en) * | 2016-12-13 | 2018-10-02 | 深圳光启合众科技有限公司 | The method, apparatus and robot of data processing |
| CN106708394A (en) * | 2016-12-23 | 2017-05-24 | 维沃移动通信有限公司 | Mobile terminal and system theme switching method thereof |
| CN106933477A (en) * | 2017-02-28 | 2017-07-07 | 上海华章信息科技有限公司 | A kind of intelligent terminal skin change method based on mood detection |
| CN107436763A (en) * | 2017-07-04 | 2017-12-05 | 广东小天才科技有限公司 | A kind of method and wearable device for switching wearable device interface subject |
| CN108153423A (en) * | 2018-01-10 | 2018-06-12 | 重庆大学 | A kind of visual gesture Adaptable System towards human-computer interaction |
| WO2020015152A1 (en) * | 2018-07-18 | 2020-01-23 | 平安科技（深圳）有限公司 | Method and device for setting system theme, computer apparatus, and storage medium |
| CN110012326A (en) * | 2018-08-21 | 2019-07-12 | 永康市胜时电机有限公司 | Review the anti-irritated processing system of mode |
| CN110298242A (en) * | 2019-05-22 | 2019-10-01 | 深圳壹账通智能科技有限公司 | APP method for switching theme, device, equipment and storage medium based on research and development management |
| CN110377380A (en) * | 2019-06-21 | 2019-10-25 | 深圳壹账通智能科技有限公司 | Theme hue adjusting method, device, equipment and computer readable storage medium |
| CN112568904A (en) * | 2019-09-30 | 2021-03-30 | 比亚迪股份有限公司 | Vehicle interaction method and device, computer equipment and storage medium |
| CN111176503A (en) * | 2019-12-16 | 2020-05-19 | 珠海格力电器股份有限公司 | Interactive system setting method and device and storage medium |
| CN112686118A (en) * | 2020-12-24 | 2021-04-20 | 昆明理工大学 | Interaction model for adjusting user emotion based on adaptive interface |
| CN113687744A (en) * | 2021-08-19 | 2021-11-23 | 北京智精灵科技有限公司 | Man-machine interaction method and device for emotion adjustment |
| CN113687744B (en) * | 2021-08-19 | 2022-01-18 | 北京智精灵科技有限公司 | Man-machine interaction device for emotion adjustment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105279494A (en) | Human-computer interaction system, method and equipment capable of regulating user emotion | |
| CN104267902B (en) | A kind of application program interaction control method, device and terminal | |
| CN112654956A (en) | User interface for simulating depth effects | |
| Lee et al. | Towards augmented reality driven human-city interaction: Current research on mobile headsets and future challenges | |
| JP2019535055A (en) | Perform gesture-based operations | |
| CN107199571A (en) | Robot control system | |
| CN105760102B (en) | Terminal interaction control method and device and application program interaction control method | |
| CN107710132A (en) | It is used for the method and apparatus of the free space input of surface restraint control for applying | |
| CN109309878A (en) | The generation method and device of barrage | |
| CN104063039A (en) | Human-computer interaction method of wearable computer intelligent terminal | |
| CN105430269B (en) | A kind of photographic method and device applied to mobile terminal | |
| CN107450717A (en) | A kind of information processing method and Wearable | |
| CN109240510B (en) | Augmented reality man-machine interaction equipment based on sight tracking and control method | |
| JP2024518267A (en) | Asynchronous brain-computer interface in AR using steady-state motor visual evoked potentials | |
| CN109426342B (en) | Document reading method and device based on augmented reality | |
| CN106201323B (en) | Writing method and device based on touch screen | |
| CN108985215A (en) | A kind of image processing method, picture processing unit and terminal device | |
| CN104035544A (en) | Method for controlling electronic device and electronic device | |
| CN109246292A (en) | A kind of moving method and device of terminal desktop icon | |
| Zhang et al. | Mid-air gestures for in-vehicle media player: elicitation, segmentation, recognition, and eye-tracking testing | |
| Lee et al. | Towards augmented reality-driven human-city interaction: Current research and future challenges | |
| Kao et al. | An adaptive eye gaze tracker system in the integrated cloud computing and mobile device | |
| EP4152138A1 (en) | Method and apparatus for adjusting virtual face model, electronic device and storage medium | |
| Fu et al. | Research on application of cognitive-driven human-computer interaction | |
| CN111639705B (en) | Batch picture marking method, system, machine readable medium and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160127 |