WO2020103649A1 - Method for controlling output of audiovisual information from household appliance - Google Patents
Method for controlling output of audiovisual information from household applianceInfo
- Publication number
- WO2020103649A1 WO2020103649A1 PCT/CN2019/113631 CN2019113631W WO2020103649A1 WO 2020103649 A1 WO2020103649 A1 WO 2020103649A1 CN 2019113631 W CN2019113631 W CN 2019113631W WO 2020103649 A1 WO2020103649 A1 WO 2020103649A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- emotional state
- household appliance
- control method
- facial information
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000002996 emotional effect Effects 0.000 claims abstract description 53
- 230000001815 facial effect Effects 0.000 claims abstract description 49
- 238000005406 washing Methods 0.000 claims description 9
- 210000004709 eyebrow Anatomy 0.000 claims description 5
- 230000008451 emotion Effects 0.000 abstract description 7
- LQIAZOCLNBBZQK-UHFFFAOYSA-N 1-(1,2-Diphosphanylethyl)pyrrolidin-2-one Chemical compound PCC(P)N1CCCC1=O LQIAZOCLNBBZQK-UHFFFAOYSA-N 0.000 abstract description 3
- 238000012986 modification Methods 0.000 description 10
- 230000004048 modification Effects 0.000 description 10
- 239000003086 colorant Substances 0.000 description 3
- 206010011469 Crying Diseases 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000001035 drying Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 238000010412 laundry washing Methods 0.000 description 1
- 230000036651 mood Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Definitions
- the multiple pre-stored facial information and emotional states can be stored either on the control module, storage module or processing module of the home appliance, or on a cloud server or background server that is in communication with the home appliance on.
- the execution of step S200 can be performed on the home appliance, or on the cloud server or the background server.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A method for controlling output of audiovisual information from a household appliance aims to solve the problem in the prior art in which audiovisual information output from a household appliance is unable to change with emotions of a user. The control method comprises the following steps: acquiring facial information of a user (S100); determining an emotional state according to the facial information (S200); and causing a household appliance to output corresponding audiovisual information according to the determined emotional state (S300), wherein the audiovisual information comprises a color of light, images and audio data. A household appliance implementing the control method can output different audiovisual information according to emotional states of a user so as to share in the joy of the user, and calm or soothe the user, thereby providing a smarter and more customized household appliance.
Description
本发明属于家电控制技术领域，具体提供一种家用电器输出视听信息的控制方法。The invention belongs to the technical field of household appliance control, and specifically provides a control method for household appliances to output audiovisual information.
随着人们生活水平的提高，越来越多的家用电器走进了人们的生活，给人们的生活带来了极大的便利。人们经常使用的家用电器包括洗衣机、洗干一体机、冰箱、空调、微波炉、烤箱等。With the improvement of people's living standards, more and more household appliances have entered people's lives, bringing great convenience to people's lives. Household appliances that people often use include washing machines, washer-dryers, refrigerators, air conditioners, microwave ovens, and ovens.
随着科技的进步，家用电器也越来也智能化，大多数家用电器都能够输出相应的视听信息，例如开机动画、按键声音、操作指示灯光等。但是，目前仍没有一种家用电器可以根据用户的情绪变化输出不同的视听信息。With the advancement of technology, home appliances are becoming more and more intelligent. Most home appliances can output corresponding audio-visual information, such as boot animations, button sounds, and operation indicator lights. However, there is currently no home appliance that can output different audiovisual information according to the user's emotional changes.
相应地，本领域需要一种新的家用电器输出视听信息的控制方法来解决上述问题。Accordingly, there is a need in the art for a new control method for household appliances to output audiovisual information to solve the above problems.
发明内容Summary of the invention
为了解决现有技术中的上述问题，即为了解决现有的家用电器输出的视听信息不能随用户的情绪变化的问题，本发明提供了一种家用电器输出视听信息的控制方法，所述控制方法包括以下步骤：In order to solve the above-mentioned problems in the prior art, that is, to solve the problem that the audiovisual information output by the existing home appliances cannot change with the user's mood, the present invention provides a control method for the audiovisual information output by the home appliance, the control method It includes the following steps:
获取人脸的面部信息；Get facial information of human face;
根据所述面部信息确定情绪状态；Determine the emotional state according to the facial information;
根据确定的情绪状态使所述家用电器输出相应的视听信息。According to the determined emotional state, the household appliance outputs corresponding audio-visual information.
在上述控制方法的优选技术方案中，“获取人脸的面部信息”的步骤进一步包括：在检测到开机或启动的操作指令时，获取人脸的面部信息。In the preferred technical solution of the above control method, the step of “acquiring facial information of a human face” further includes: acquiring facial information of a human face when an operation instruction of turning on or starting is detected.
在上述控制方法的优选技术方案中，所述家用电器上设置有图像采集装置，“获取人脸的面部信息”的步骤进一步包括：通过所述图像采集装置获取所述面部信息。In a preferred technical solution of the above control method, an image acquisition device is provided on the household appliance, and the step of “acquiring facial information of a human face” further includes: acquiring the facial information through the image acquisition device.
在上述控制方法的优选技术方案中，“根据所述面部信息确定情绪状态”的步骤进一步包括：In a preferred technical solution of the above control method, the step of "determining the emotional state based on the facial information" further includes:
将获取的面部信息与预存的面部信息进行比对；Compare the acquired facial information with pre-stored facial information;
根据比对结果确定所述情绪状态；Determine the emotional state according to the comparison result;
其中，每一个所述预存的面部信息都对应一个所述情绪状态。Wherein, each of the pre-stored facial information corresponds to one of the emotional states.
在上述控制方法的优选技术方案中，所述视听信息包括借助所述家用电器上的光源显示的灯光颜色；“根据确定的情绪状态使所述家用电器输出相应的视听信息”的步骤进一步包括：根据确定的情绪状态使所述家用电器显示相应的灯光颜色。In a preferred technical solution of the above control method, the audiovisual information includes a light color displayed by a light source on the household appliance; the step of "making the household appliance output corresponding audiovisual information according to the determined emotional state" further includes: According to the determined emotional state, the home appliance displays a corresponding light color.
在上述控制方法的优选技术方案中，所述视听信息包括显示在所述家用电器的显示器上的图像；“根据确定的情绪状态使所述家用电器输出相应的视听信息”的步骤进一步包括：根据确定的情绪状态使所述家用电器显示相应的图像。In a preferred technical solution of the above control method, the audiovisual information includes an image displayed on the display of the household appliance; the step of "making the household appliance output corresponding audiovisual information according to the determined emotional state" further includes: The determined emotional state causes the household appliance to display a corresponding image.
在上述控制方法的优选技术方案中，所述视听信息包括借助所述家用电器上的扬声器播放的音频；“根据确定的情绪状态使所述家用电器输出相应的视听信息”的步骤进一步包括：根据确定的情绪状态使所述家用电器播放相应的音频。In a preferred technical solution of the above control method, the audiovisual information includes audio played through a speaker on the household appliance; the step of "making the household appliance output corresponding audiovisual information according to the determined emotional state" further includes: The determined emotional state causes the household appliance to play corresponding audio.
在上述控制方法的优选技术方案中，所述面部信息包括眼睛、眉毛和/或嘴巴的特征信息。In a preferred technical solution of the above control method, the facial information includes characteristic information of eyes, eyebrows, and / or mouth.
在上述控制方法的优选技术方案中，所述情绪状态包括喜悦、哀伤、生气和/或恼怒。In a preferred technical solution of the above control method, the emotional state includes joy, sadness, anger and / or anger.
在上述控制方法的优选技术方案中，所述家用电器是空调、洗衣机、洗干一体机或干衣机。In a preferred technical solution of the above control method, the household appliance is an air conditioner, a washing machine, an integrated washing and drying machine or a clothes dryer.
本领域技术人员能够理解的是，在本发明的优选技术方案中，通过使家用电器获取人脸的面部信息，并根据所述面部信息确定情绪状态，然后根据确定的情绪状态输出相应的视听信息，使得家用电器能够根据用户的情绪输出不同的视听信息。因此通过本发明的控制方法能够使家用电器通过输出视听信息的方式来分享用户的喜悦，平复用户的情绪，抚慰用户受伤的心灵，进而使得家用电器更加人性化和智能化。Those skilled in the art can understand that, in a preferred technical solution of the present invention, household appliances are used to acquire facial information of a human face, determine an emotional state according to the facial information, and then output corresponding audiovisual information according to the determined emotional state , So that household appliances can output different audiovisual information according to the user's emotions. Therefore, the control method of the present invention can enable household appliances to share the joy of users by outputting audiovisual information, calm the emotions of the users, soothe the hurt hearts of the users, and then make the household appliances more humanized and intelligent.
优选地，所述情绪状态包括喜悦、哀伤、生气和恼怒，所述视听信息包括借助家用电器上的光源显示的灯光颜色、显示在家用电器的显示器上的图像和借助家用电器上的扬声器播放的音频。Preferably, the emotional state includes joy, sorrow, anger and anger, and the audiovisual information includes the color of the light displayed by the light source on the home appliance, the image displayed on the display of the home appliance and the playback through the speaker on the home appliance Audio.
示例性地，当检测到用户的情绪是喜悦时，则使光源发出红色的灯光颜色，使显示器显示笑脸或播放喜悦的动画，使扬声器播放欢快的音乐。当检测到用户的情绪是哀伤时，则使光源发出橙黄色的灯光颜色，使显示器播放温馨的动画，使扬声器播放节奏缓慢且温馨的音乐。Exemplarily, when it is detected that the user's emotion is joy, the light source is made to emit a red light color, the display displays a smiling face or plays a joyful animation, and the speaker plays cheerful music. When it is detected that the user's emotion is sad, the light source emits an orange-yellow light color, the display plays a warm animation, and the speaker plays slow and warm music.
其中，显示器播放的动画可以是由用户自己录制并存储在家用电器上的动画；播放器播放的音频可以是由用户自己录制并存储在家用电器上的语音。Among them, the animation played by the display may be an animation recorded by the user and stored on the home appliance; the audio played by the player may be a voice recorded by the user and stored on the home appliance.
下面参照附图来描述本发明的优选实施方式，附图中：The following describes preferred embodiments of the present invention with reference to the accompanying drawings, in which:
图1是本发明的家用电器输出视听信息的控制方法的步骤流程图。FIG. 1 is a flowchart of steps of a control method for outputting audiovisual information of a home appliance according to the present invention.
本领域技术人员应当理解的是，本节实施方式仅仅用于解释本发明的技术原理，并非用于限制本发明的保护范围。例如，本发明的家用电器可以是诸如空调、洗衣机、洗干一体机、干衣机、微波炉等任意可行的家用电器，本领域技术人员可以根据需要对其作出调整，以便适应具体的应用场合，调整后的技术方案仍将落入本发明的保护范围。Those skilled in the art should understand that the embodiments in this section are only used to explain the technical principles of the present invention, and are not intended to limit the protection scope of the present invention. For example, the home appliance of the present invention may be any feasible home appliance such as an air conditioner, a washing machine, a washer-dryer, a clothes dryer, a microwave oven, etc., and those skilled in the art can adjust it as needed to adapt to specific applications The adjusted technical solution will still fall into the protection scope of the present invention.
需要说明的是，本发明所说的视听信息包括能够用眼睛看到的信息和/或能够用耳朵听到的信息。It should be noted that the audiovisual information mentioned in the present invention includes information that can be seen with eyes and / or information that can be heard with ears.
如图1所示，本发明的家用电器输出视听信息的控制方法主要包括：As shown in FIG. 1, the control method of the home appliance output audiovisual information of the present invention mainly includes:
步骤S100，获取人脸的面部信息；Step S100, acquiring facial information of a human face;
步骤S200，根据所述面部信息确定情绪状态；Step S200: Determine the emotional state according to the facial information;
步骤S300，根据确定的情绪状态使所述家用电器输出相应的视听信息；Step S300, causing the household appliance to output corresponding audio-visual information according to the determined emotional state;
步骤S400，检测当前输出的所述视听信息的修改操作；Step S400, detecting the modification operation of the currently outputted audiovisual information;
步骤S500，根据检测结果选择性地修改当前输出的所述视听信息；Step S500, selectively modify the currently output audiovisual information according to the detection result;
步骤S600，输出并存储修改之后的视听信息。In step S600, the modified audiovisual information is output and stored.
其中，步骤S400至步骤S600为可选的步骤。即，本发明的控制方法可以包括步骤S400至步骤S600，也可以不包括步骤S400至步骤S600。Among them, step S400 to step S600 are optional steps. That is, the control method of the present invention may include steps S400 to S600, or may not include steps S400 to S600.
具体地，在步骤S100中，当用户按下家用电器上的开机按钮时，家用电器因此检测到开机的操作指令，进而通过设置在家用电器上的图像采集装置获取用户人脸的面部信息。更具体地，通过拍摄图像的方式来获取用户人脸的面部信息。Specifically, in step S100, when the user presses the power-on button on the home appliance, the home appliance accordingly detects an operation instruction for power-on, and then acquires facial information of the user's face through the image acquisition device provided on the home appliance. More specifically, facial information of the user's face is acquired by taking an image.
本领域技术人员能够理解的是，所述图像采集装置可以是任意可行的且能够采集图像的装置，例如相机、摄像头、摄像机等。Those skilled in the art can understand that the image acquisition device may be any feasible device capable of acquiring images, such as a camera, a camera, a video camera, and the like.
作为步骤S100的替代技术方案，本领域技术人员可以根据需要，使家用电器在检测到启动的操作指令时再获取用户人脸的面部信息。具体地，在用户按下家用电器上的开机按钮和启动按钮时，家用电器因此检测到启动的操作指令，进而通过设置在家用电器上的图像采集装置获取用户人脸的面部信息。其中，启动指的是家用电器开始执行相应的操作，例如洗衣机开始执行衣物洗涤程序，空调开始执行制冷程序，微波炉开始执行加热程序等。As an alternative technical solution of step S100, a person skilled in the art may, according to need, enable the household appliance to acquire facial information of the user's face when detecting the activated operation instruction. Specifically, when the user presses the power-on button and the start button on the home appliance, the home appliance accordingly detects an operation instruction for start, and then acquires facial information of the user's face through the image acquisition device provided on the home appliance. Among them, start-up refers to that the household appliances start to perform corresponding operations, for example, the washing machine starts to perform the laundry washing procedure, the air conditioner starts to perform the cooling procedure, and the microwave oven starts to execute the heating procedure.
进一步，在本发明的优选实施例中，步骤S100中所说的面部信息包括用户的眼睛、嘴巴和眉毛的特征信息。此外，本领域技术人员也可以根据需要，使面部信息包括任意可行的信息，例如使面部信息包括眼睛、嘴巴、眨眼次数、眉毛、眉间距和鼻翼中至少一项的特征信息。Further, in a preferred embodiment of the present invention, the facial information in step S100 includes feature information of the user's eyes, mouth, and eyebrows. In addition, a person skilled in the art may also make the facial information include any feasible information as needed, for example, the facial information includes feature information of at least one of eyes, mouth, number of blinks, eyebrows, eyebrow spacing, and nose.
具体地，在步骤S200中，将获取的面部信息与预存的面部信息进行比对。其中，预存的面部信息为多个，并且每一个预存的面部信息都对应一个情绪状态。当获取的面部信息与预存的某一个面部信息相匹配时，则判定所获取的面部信息的情绪状态(即用户当前的情绪状态)是所述某一个面部信息对应的情绪状态。其中，所述情绪状态包括喜悦、哀伤、生气和恼怒。或者，本领域技术人员可以根据需，使情绪状态包括任意多种情绪状态，例如包括喜悦、快乐、哀伤、生气和恼怒中的至少一种情绪状态。Specifically, in step S200, the acquired facial information is compared with the pre-stored facial information. There are multiple pre-stored facial information, and each pre-stored facial information corresponds to an emotional state. When the acquired facial information matches a certain pre-stored facial information, it is determined that the acquired emotional state of the facial information (that is, the current emotional state of the user) is the emotional state corresponding to the certain facial information. Among them, the emotional state includes joy, sadness, anger and anger. Alternatively, a person skilled in the art may make the emotional state include any of a variety of emotional states, for example, including at least one emotional state of joy, joy, sadness, anger, and anger.
本领域技术人员能够理解的是，预存的多个面部信息和情绪状态既可以存储在家用电器的控制模块、存储模块或处理模块上，也可以存储在与家用电器通信连接的云端服务器或后台服务器上。本领域技 术人员还能够理解的是，步骤S200的执行既可以在家用电器上执行，也可以在云端服务器或后台服务器上执行。Those skilled in the art can understand that the multiple pre-stored facial information and emotional states can be stored either on the control module, storage module or processing module of the home appliance, or on a cloud server or background server that is in communication with the home appliance on. Those skilled in the art can also understand that the execution of step S200 can be performed on the home appliance, or on the cloud server or the background server.
此外，本领域技术人员还能够理解的是，预存的多个面部信息和情绪状态既可以是由家用电器的生产厂家或服务商进行存储，例如家用电器在出厂的时候就存储有多个面部信息和情绪状态。预存的多个面部信息和情绪状态还可以是由用户自己预先设置并存储在家用电器、云端服务器或后台服务器上。In addition, those skilled in the art can also understand that the pre-stored multiple facial information and emotional states can be stored by the manufacturer or service provider of the household appliance, for example, the household appliance stores multiple facial information when it leaves the factory And emotional state. The pre-stored multiple facial information and emotional states may also be preset by the user and stored on the home appliance, cloud server or background server.
具体地，在步骤S300中，根据步骤S200执行的结果使家用电器输出不同的视听信息。该视听信息是预先存储在家用电器上或者与家用电器通信连接的云端服务器或后台服务器上。进一步，该视听信息可以是由家用电器的生产厂家或服务商进行存储，例如家用电器在出厂的时候就存储有所述视听信息。该视听信息还可以是由用户自己预先设置并存储在家用电器、云端服务器或后台服务器上。Specifically, in step S300, the home appliance is caused to output different audiovisual information according to the result of step S200. The audiovisual information is pre-stored on the home appliance or a cloud server or a background server communicatively connected to the home appliance. Further, the audiovisual information may be stored by the manufacturer or service provider of the home appliance, for example, the home appliance stores the audiovisual information when it leaves the factory. The audiovisual information may also be preset by the user and stored on the home appliance, cloud server or background server.
在本发明的优选实施例中，步骤S300中所说的视听信息包括灯光颜色、图像和音频中的至少一种。In a preferred embodiment of the present invention, the audiovisual information in step S300 includes at least one of light color, image, and audio.
下面对步骤S300进行举例说明：The following is an example of step S300:
家用电器上设置有光源、显示器和扬声器。其中，光源为多个，多个光源的组合能够发出多种不同颜色的灯光。或者，本领域技术人员可以根据需要，将光源设置为一个，并使该一个光源能够发出多种不同颜色的灯光。或者，本领域技术人员还可以根据需要，为光源设置多个不同的滤镜，通过滤镜的切换来呈现出多种不同颜色的灯光。进一步，显示器至少为一个，其能够显示图像，该图像可以是任意可行的图像，例如表情、照片、文字或动画。其中，表情可以是静态或动态笑脸、哭脸或其它任意可行的表情。动画可以是动态的图画或者视频(该视频可以是由用户自己录制的)。更进一步，所述扬声器至少为一个，其能够播放音频。所述音频可以是任意可行的音频，例如，歌曲、纯音乐、用户自己录制的语音等。The home appliance is provided with a light source, a display and a speaker. Among them, there are multiple light sources, and the combination of multiple light sources can emit multiple lights of different colors. Or, a person skilled in the art may set one light source as needed, and enable the one light source to emit lights of different colors. Or, a person skilled in the art can also set a plurality of different filters for the light source according to needs, and present multiple lights of different colors through the switching of the filters. Further, there is at least one display, which can display an image, and the image may be any feasible image, such as an expression, a photo, a text, or an animation. The expression may be a static or dynamic smiling face, a crying face, or any other feasible expression. The animation may be a dynamic picture or a video (the video may be recorded by the user himself). Furthermore, there is at least one speaker, which can play audio. The audio may be any feasible audio, for example, songs, pure music, voices recorded by users themselves, and so on.
当步骤S200中确定的情绪状态是喜悦时，光源发出红色的灯光颜色，显示器显示笑脸，扬声器播放欢快的音乐(例如爵士乐)。When the emotional state determined in step S200 is joy, the light source emits a red light color, the display shows a smiling face, and the speaker plays cheerful music (for example, jazz).
当步骤S200中确定的情绪状态是哀伤时，光源发出橙黄色的灯光颜色，显示器显示哭脸，扬声器播放鼓励或激励的音乐。When the emotional state determined in step S200 is sad, the light source emits an orange-yellow light color, the display shows a crying face, and the speaker plays encouraging or motivating music.
当步骤S200中确定的情绪状态是生气时，光源发出蓝色的灯光颜色，显示器显示劝解的文字(例如莫生气，人生就像一场戏)，扬声器播放用户自己或其朋友、家人录制的劝解、开导的语音。When the emotional state determined in step S200 is angry, the light source emits a blue light color, the display shows the text of persuasion (for example, not angry, life is like a play), and the speaker plays the persuasion recorded by the user himself or his friends or family , Enlightened voice.
当步骤S200中确定的情绪状态是恼怒时，光源发出暗黄的灯光颜色，显示器显示委屈的表情，扬声器播放预存的笑话。When the emotional state determined in step S200 is annoyed, the light source emits a dark yellow light color, the display shows an aggrieved expression, and the speaker plays a pre-stored joke.
具体地，在步骤S400中，家用电器通过检测其上的修改操作按钮是否被用户触发，来判断用户是否需要对当前输出的视听信息进行修改。Specifically, in step S400, the home appliance determines whether the user needs to modify the currently output audio-visual information by detecting whether the modification operation button thereon is triggered by the user.
具体地，在步骤S500中，当在步骤S400中没有检测到修改操作时，则使家用电器继续输出当前的视听信息。当在步骤S400中检测到了修改操作时，则使家用电器的显示器将修改操作界面显示出来，供用户对当前输出的视听信息进行修改。Specifically, in step S500, when no modification operation is detected in step S400, the home appliance is caused to continue to output current audiovisual information. When a modification operation is detected in step S400, the display of the modification operation interface is displayed on the display of the home appliance for the user to modify the currently output audiovisual information.
本领域技术人员能够理解的是，步骤S500中允许视听信息的修改包括电源显示的灯光颜色的修改、显示器显示的图像的修改和扬声器播放的音频的修改中的至少一项。Those skilled in the art can understand that the allowed modification of the audiovisual information in step S500 includes at least one of the modification of the color of the light displayed by the power supply, the modification of the image displayed by the display, and the modification of the audio played by the speaker.
本领域技术人员还能够理解的是，步骤S500中对视听信息的修改不仅可以在家用电器上进行，还可以在与家用电器通信连接的手机、电脑、ipad等移动设备上进行。Those skilled in the art can also understand that the modification of the audiovisual information in step S500 can be performed not only on the home appliances, but also on mobile devices such as mobile phones, computers, and iPads that are communicatively connected to the home appliances.
此外，本领域技术人员可以根据需要，在家用电器上设置暂停操作键，当用户触发了该暂停操作键时，家用电器暂停当前视听信息的输出。例如关闭光源和扬声器，使显示器显示的图像保持在当前状态。In addition, a person skilled in the art may set a pause operation key on the home appliance as needed, and when the user triggers the pause operation key, the home appliance pauses the output of the current audiovisual information. For example, turn off the light source and the speaker to keep the image displayed on the display in the current state.
具体地，在步骤S600中，当在步骤S500中对视听信息进行了修改时，使家用电器输出修改之后的视听信息，并将修改之后的视听信息和与其对应的情绪状态进行保存。以便家用电器再次获取到相同的情绪状态时，能够直接输出修改之后的视听信息。Specifically, in step S600, when the audiovisual information is modified in step S500, the home appliance is caused to output the modified audiovisual information, and the modified audiovisual information and the emotional state corresponding thereto are saved. Therefore, when the household appliance acquires the same emotional state again, it can directly output the modified audiovisual information.
本领域技术人员能够理解的是，家用电器输出视听信息的持续时间可以是整个操作周期(例如洗衣机洗涤衣物的整个周期)，也可以是该周期内的任意时段(例如开机或启动之后的10S、30S、1min等)。Those skilled in the art can understand that the duration of the audiovisual information output by the household appliances may be the entire operation cycle (for example, the entire cycle of washing clothes by the washing machine), or may be any period of the cycle (for example, 10S, 10S 30S, 1min, etc.).
此外，在本发明另一个可行的实施例中，与上述实施例不同的是，本领域技术人员还可以根据需要，使用户可以通过与家用电器绑定的移动设备对家用电器预存的视听信息进行修改、设置。以空调为例说明：出差在外的丈夫可以对空调输出信息当中的音频进行修改，例如 将音频修改成丈夫录制的语音“空调不要开太低，睡觉记得盖毛毯，小心着凉哦”。在家的妻子听到该语音之后就能够感受到丈夫对自己的关心，仿佛丈夫就在自己身边。In addition, in another feasible embodiment of the present invention, unlike the above-mentioned embodiment, a person skilled in the art may also, according to need, enable a user to perform pre-stored audiovisual information on household appliances through a mobile device bound to the household appliance Modify, set. Take the air conditioner as an example: the husband who is on a business trip can modify the audio in the output information of the air conditioner, for example, modify the audio to the voice recorded by her husband, "Do not turn on the air conditioner too low, remember to cover the blankets when sleeping, be careful and cool." When the wife at home heard the voice, she could feel her husband's concern for herself, as if her husband were by his side.
基于上文的描述，本领域技术人员能够理解的是，本发明通过使家用电器获取人脸的面部信息，并根据所述面部信息确定情绪状态，然后根据确定的情绪状态输出相应的视听信息，使得家用电器能够根据用户的情绪输出不同的视听信息。通过本发明的控制方法能够使家用电器通过输出视听信息的方式来分享用户的喜悦，平复用户的情绪，抚慰用户受伤的心灵，进而使得家用电器更加人性化和智能化。Based on the above description, those skilled in the art can understand that the present invention obtains facial information of a human face by household appliances, determines the emotional state according to the facial information, and then outputs corresponding audio-visual information according to the determined emotional state, It enables household appliances to output different audiovisual information according to the user's emotions. The control method of the present invention can enable household appliances to share the joy of users by outputting audiovisual information, calm the emotions of the users, soothe the hurt hearts of the users, and then make the household appliances more humanized and intelligent.
最后需要说明的是，本发明的家用电器包括空调、洗衣机、洗干一体机、干衣机、微波炉、电视机等其它任意可行的家用电器。Finally, it should be noted that the household appliances of the present invention include air conditioners, washing machines, integrated washer-dryers, dryers, microwave ovens, televisions, and any other feasible household appliances.
至此，已经结合附图所示的优选实施方式描述了本发明的技术方案，但是，本领域技术人员容易理解的是，本发明的保护范围显然不局限于这些具体实施方式。在不偏离本发明的原理的前提下，本领域技术人员可以对相关技术特征作出等同的更改或替换，这些更改或替换之后的技术方案都将落入本发明的保护范围之内。So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings, but it is easily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or replacements to the related technical features, and the technical solutions after these changes or replacements will fall within the protection scope of the present invention.
Claims (10)
- 一种家用电器输出视听信息的控制方法，其特征在于，所述控制方法包括以下步骤：A control method for household appliances to output audiovisual information, characterized in that the control method includes the following steps:获取人脸的面部信息；Get facial information of human face;根据所述面部信息确定情绪状态；Determine the emotional state according to the facial information;根据确定的情绪状态使所述家用电器输出相应的视听信息。According to the determined emotional state, the household appliance outputs corresponding audio-visual information.
- 根据权利要求1所述的控制方法，其特征在于，“获取人脸的面部信息”的步骤进一步包括：The control method according to claim 1, wherein the step of "obtaining facial information of a human face" further comprises:在检测到开机或启动的操作指令时，获取人脸的面部信息。When the operation instruction of starting or starting is detected, the facial information of the face is acquired.
- 根据权利要求1所述的控制方法，其特征在于，所述家用电器上设置有图像采集装置，“获取人脸的面部信息”的步骤进一步包括：The control method according to claim 1, wherein the household electrical appliance is provided with an image acquisition device, and the step of "acquiring facial information of a human face" further includes:通过所述图像采集装置获取所述面部信息。Obtain the facial information through the image acquisition device.
- 根据权利要求1所述的控制方法，其特征在于，“根据所述面部信息确定情绪状态”的步骤进一步包括：The control method according to claim 1, wherein the step of "determining the emotional state based on the facial information" further comprises:将获取的面部信息与预存的面部信息进行比对；Compare the acquired facial information with pre-stored facial information;根据比对结果确定所述情绪状态；Determine the emotional state according to the comparison result;其中，每一个所述预存的面部信息都对应一个所述情绪状态。Wherein, each of the pre-stored facial information corresponds to one of the emotional states.
- 根据权利要求1所述的控制方法，其特征在于，所述视听信息包括借助所述家用电器上的光源显示的灯光颜色；The control method according to claim 1, wherein the audiovisual information includes a color of light displayed by a light source on the household appliance;“根据确定的情绪状态使所述家用电器输出相应的视听信息”的步骤进一步包括：The step of "making the household appliance output corresponding audio-visual information according to the determined emotional state" further includes:根据确定的情绪状态使所述家用电器显示相应的灯光颜色。According to the determined emotional state, the home appliance displays a corresponding light color.
- 根据权利要求1所述的控制方法，其特征在于，所述视听信息包括显示在所述家用电器的显示器上的图像；The control method according to claim 1, wherein the audiovisual information includes an image displayed on a display of the household appliance;“根据确定的情绪状态使所述家用电器输出相应的视听信息”的步骤进一步包括：The step of "making the household appliance output corresponding audio-visual information according to the determined emotional state" further includes:根据确定的情绪状态使所述家用电器显示相应的图像。The household appliance displays a corresponding image according to the determined emotional state.
- 根据权利要求1所述的控制方法，其特征在于，所述视听信息包括借助所述家用电器上的扬声器播放的音频；The control method according to claim 1, wherein the audiovisual information includes audio played by means of a speaker on the household appliance;“根据确定的情绪状态使所述家用电器输出相应的视听信息”的步骤进一步包括：The step of "making the household appliance output corresponding audio-visual information according to the determined emotional state" further includes:根据确定的情绪状态使所述家用电器播放相应的音频。According to the determined emotional state, the household appliance plays corresponding audio.
- 根据权利要求1至7中任一项所述的控制方法，其特征在于，所述面部信息包括眼睛、眉毛和/或嘴巴的特征信息。The control method according to any one of claims 1 to 7, wherein the facial information includes characteristic information of eyes, eyebrows, and / or mouth.
- 根据权利要求1至7中任一项所述的控制方法，其特征在于，所述情绪状态包括喜悦、哀伤、生气和/或恼怒。The control method according to any one of claims 1 to 7, wherein the emotional state includes joy, sadness, anger, and / or anger.
- 根据权利要求1至7中任一项所述的控制方法，其特征在于，所述家用电器是空调、洗衣机、洗干一体机或干衣机。The control method according to any one of claims 1 to 7, wherein the household appliance is an air conditioner, a washing machine, an integrated washer-dryer, or a clothes dryer.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811385118.5A CN111198506A (en) | 2018-11-20 | 2018-11-20 | Control method for outputting audio-visual information by household electrical appliance |
| CN201811385118.5 | 2018-11-20 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020103649A1 true WO2020103649A1 (en) | 2020-05-28 |
Family
ID=70744308
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/113631 WO2020103649A1 (en) | 2018-11-20 | 2019-10-28 | Method for controlling output of audiovisual information from household appliance |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111198506A (en) |
| WO (1) | WO2020103649A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114265319A (en) * | 2021-11-11 | 2022-04-01 | 珠海格力电器股份有限公司 | Control method, control device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110310237A1 (en) * | 2010-06-17 | 2011-12-22 | Institute For Information Industry | Facial Expression Recognition Systems and Methods and Computer Program Products Thereof |
| CN102467668A (en) * | 2010-11-16 | 2012-05-23 | 鸿富锦精密工业（深圳）有限公司 | Emotion detecting and soothing system and method |
| CN102880388A (en) * | 2012-09-06 | 2013-01-16 | 北京天宇朗通通信设备股份有限公司 | Music processing method, music processing device and mobile terminal |
| CN105050247A (en) * | 2015-06-24 | 2015-11-11 | 河北工业大学 | Light intelligent adjusting system and method based on expression model identification |
| CN107145326A (en) * | 2017-03-28 | 2017-09-08 | 浙江大学 | A kind of the music automatic playing system and method for collection of being expressed one's feelings based on target face |
| CN108197533A (en) * | 2017-12-19 | 2018-06-22 | 迈巨（深圳）科技有限公司 | A kind of man-machine interaction method based on user's expression, electronic equipment and storage medium |
| CN108197185A (en) * | 2017-12-26 | 2018-06-22 | 努比亚技术有限公司 | A kind of music recommends method, terminal and computer readable storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103902046B (en) * | 2014-04-10 | 2016-06-01 | 努比亚技术有限公司 | Intelligent prompt method and terminal |
| CN104679839B (en) * | 2015-02-10 | 2018-09-07 | 百度在线网络技术（北京）有限公司 | Information-pushing method and device |
| CN106341538B (en) * | 2016-08-31 | 2019-08-20 | 维沃移动通信有限公司 | A kind of method for pushing and mobile terminal of lyrics poster |
| CN108305640A (en) * | 2017-01-13 | 2018-07-20 | 深圳大森智能科技有限公司 | Intelligent robot active service method and device |
| CN107340947A (en) * | 2017-06-23 | 2017-11-10 | 珠海市魅族科技有限公司 | A kind of interface adjusting method and device, computer installation and storage medium |
-
2018
- 2018-11-20 CN CN201811385118.5A patent/CN111198506A/en active Pending
-
2019
- 2019-10-28 WO PCT/CN2019/113631 patent/WO2020103649A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110310237A1 (en) * | 2010-06-17 | 2011-12-22 | Institute For Information Industry | Facial Expression Recognition Systems and Methods and Computer Program Products Thereof |
| CN102467668A (en) * | 2010-11-16 | 2012-05-23 | 鸿富锦精密工业（深圳）有限公司 | Emotion detecting and soothing system and method |
| CN102880388A (en) * | 2012-09-06 | 2013-01-16 | 北京天宇朗通通信设备股份有限公司 | Music processing method, music processing device and mobile terminal |
| CN105050247A (en) * | 2015-06-24 | 2015-11-11 | 河北工业大学 | Light intelligent adjusting system and method based on expression model identification |
| CN107145326A (en) * | 2017-03-28 | 2017-09-08 | 浙江大学 | A kind of the music automatic playing system and method for collection of being expressed one's feelings based on target face |
| CN108197533A (en) * | 2017-12-19 | 2018-06-22 | 迈巨（深圳）科技有限公司 | A kind of man-machine interaction method based on user's expression, electronic equipment and storage medium |
| CN108197185A (en) * | 2017-12-26 | 2018-06-22 | 努比亚技术有限公司 | A kind of music recommends method, terminal and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111198506A (en) | 2020-05-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7130637B2 (en) | Focus session on voice interface device | |
| CN108111948A (en) | The visual output that server at speech interface equipment provides | |
| CN105451413B (en) | Lamp light control method, apparatus and system | |
| CN104820675B (en) | Photograph album display methods and device | |
| JP6385459B2 (en) | Control method and apparatus for audio reproduction | |
| CN106804076B (en) | A kind of lighting system of smart home | |
| JP5485913B2 (en) | System and method for automatically generating atmosphere suitable for mood and social setting in environment | |
| JP6504165B2 (en) | INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM | |
| CN108604180A (en) | The LED design language of visual effect for Voice User Interface | |
| JP5586436B2 (en) | Lifestyle collection device, user interface device, and lifestyle collection method | |
| CN105898364A (en) | Video playing processing method, device, terminal and system | |
| CN111869330B (en) | Rendering dynamic light scenes based on one or more light settings | |
| CN110413114A (en) | Interaction control method and device under video scene, server, readable storage medium storing program for executing | |
| US10797902B2 (en) | Control of network-connected devices in accordance with group preferences | |
| CN111123851A (en) | Method, device and system for controlling electric equipment according to user emotion | |
| JP2017144521A (en) | Information processing device, information processing method and program | |
| WO2020103649A1 (en) | Method for controlling output of audiovisual information from household appliance | |
| JP2014130467A (en) | Information processing device, information processing method, and computer program | |
| CN106230909A (en) | A kind of equipment room brightness linkage control method, device and equipment | |
| CN107660049A (en) | Environment lamp light control method and device | |
| CN107835458A (en) | Player method, device and the electronic equipment of content of multimedia | |
| CN108037699B (en) | Robot, control method of robot, and computer-readable storage medium | |
| CN111198505A (en) | Control method for outputting audio-visual information by household electrical appliance | |
| CN106411662A (en) | Method and device of configuring electronic equipment scenes | |
| CN109977303A (en) | Exchange method, device and the storage medium of multimedia messages |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19887331 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19887331 Country of ref document: EP Kind code of ref document: A1 |