CN115001891A - Intelligent household appliance control method and device based on hierarchical management - Google Patents

Intelligent household appliance control method and device based on hierarchical management Download PDF

Info

Publication number
CN115001891A
CN115001891A CN202210607104.3A CN202210607104A CN115001891A CN 115001891 A CN115001891 A CN 115001891A CN 202210607104 A CN202210607104 A CN 202210607104A CN 115001891 A CN115001891 A CN 115001891A
Authority
CN
China
Prior art keywords
voice
equipment
intelligent household
household appliance
execution
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210607104.3A
Other languages
Chinese (zh)
Other versions
CN115001891B (en
Inventor
陈峰峰
张新星
高向军
邓宏
杨培海
陈良
袁志琳
李晓彦
聂红雁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan Hongmei Intelligent Technology Co Ltd
Hefei Meiling Union Technology Co Ltd
Original Assignee
Sichuan Hongmei Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan Hongmei Intelligent Technology Co Ltd filed Critical Sichuan Hongmei Intelligent Technology Co Ltd
Priority to CN202210607104.3A priority Critical patent/CN115001891B/en
Publication of CN115001891A publication Critical patent/CN115001891A/en
Application granted granted Critical
Publication of CN115001891B publication Critical patent/CN115001891B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Automation & Control Theory (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The embodiment of the specification provides an intelligent household appliance control method based on hierarchical management, which comprises the following steps: for each awakening request, determining response voice equipment and feedback voice equipment; receiving a voice instruction, analyzing the voice instruction, and determining equipment skills required by executing the voice instruction according to an analysis result; judging whether the device skill has a corresponding execution device sequence; if yes, determining whether the optimal interactive equipment group where the response voice equipment is located contains the intelligent household appliances in the execution equipment sequence; if so, taking the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group as a target intelligent household appliance; and controlling the target intelligent household appliance to process, and controlling the feedback voice equipment to perform voice broadcast on the processing result. The invention automatically determines the appropriate target intelligent household appliance by considering the principle of searching nearby, required equipment skill and execution equipment sequence, and timely and accurately responds without inquiry.

Description

Intelligent household appliance control method and device based on hierarchical management
Technical Field
One or more embodiments of the present disclosure relate to the field of intelligent home appliance control, and in particular, to an intelligent home appliance control method and apparatus based on hierarchical management.
Background
The voice recognition technology is the most widely applied man-machine interaction technology, and a user initiates a voice instruction to control the voice device to execute corresponding operations, such as controlling an air conditioner to be turned on and off. The whole flow of voice interaction control comprises the following steps: voice awakening, voice instruction sending, equipment execution action, equipment voice feedback and the like.
In the field of control of intelligent home appliances, for example, when a plurality of intelligent home appliances are set in a home, a user is generally required to accurately speak the name of an execution device and the execution action, and when a plurality of intelligent home appliances of the same type are set in the home, for example, a plurality of hanging air conditioners are set in the home, at this time, the user is required to more accurately speak the name of a room and the execution device and the execution action, visible voice instructions are complex, and for a fuzzy user instruction, for example, "i'm is hot", there is no way to timely and accurately respond, or a plurality of inquiry conversations are required to determine the execution device, and then the execution device can only respond, and the user's demand cannot be timely and accurately responded.
Disclosure of Invention
One or more embodiments of the present specification describe an intelligent household appliance control method and apparatus based on hierarchical management.
In a first aspect, an embodiment of the present invention provides an intelligent household appliance control method based on hierarchical management, where voice devices are distributed in a full space of a home, the voice devices include intelligent household appliances, a voice module in the intelligent household appliance has voice pickup and voice feedback functions, and each voice device is in communication connection with a cloud platform for controlling the voice devices in the full space;
the method is performed by the cloud platform, the method comprising:
aiming at each awakening request, determining corresponding response voice equipment and feedback voice equipment; the response voice equipment is used for picking up a voice instruction of a user and sending the voice instruction to the voice equipment of the cloud platform; the feedback voice equipment is used for feeding back the processing result of the voice instruction to the user through voice;
receiving a voice instruction sent by the response voice equipment, analyzing the voice instruction, and determining equipment skills required by executing the voice instruction according to an analysis result;
judging whether the device skill has a corresponding execution device sequence; the execution equipment sequence is a sequence obtained by sequencing each intelligent household appliance with the equipment skills according to a preset execution priority, and is preset on an application program used for voice equipment control in the whole space by a user;
if the answer voice equipment has the corresponding execution equipment sequence, determining whether the optimal interaction equipment group where the answer voice equipment is located contains the intelligent household appliances in the execution equipment sequence; if so, taking the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group as a target intelligent household appliance; wherein the optimal interaction device group is a group formed by at least two voice devices which are determined in advance according to the position and the orientation of the user in the full space;
and controlling the target intelligent household appliance to perform corresponding processing, and controlling the feedback voice equipment to perform voice broadcast on a processing result.
In a second aspect, an embodiment of the present invention provides an intelligent household appliance control apparatus based on hierarchical management, where voice devices are distributed in a whole space of a home, where the voice devices include an intelligent household appliance, a voice module in the intelligent household appliance has voice pickup and voice feedback functions, and each voice device is in communication connection with a cloud platform for controlling the voice devices in the whole space;
the apparatus is located on the cloud platform, the apparatus comprising:
the first determining module is used for determining corresponding response voice equipment and feedback voice equipment aiming at each awakening request; the response voice equipment is used for picking up a voice instruction of a user and sending the voice instruction to the voice equipment of the cloud platform; the feedback voice equipment is used for feeding back the processing result of the voice instruction to the user through voice;
the second determining module is used for receiving the voice command sent by the response voice equipment, analyzing the voice command and determining equipment skills required by executing the voice command according to an analysis result;
the first judgment module is used for judging whether the equipment skill has a corresponding execution equipment sequence; the execution equipment sequence is a sequence obtained by sequencing each intelligent household appliance with the equipment skills according to a preset execution priority, and is preset on an application program used for voice equipment control in the whole space by a user;
the second judgment module is used for determining whether the optimal interaction equipment group where the response voice equipment is located contains the intelligent household appliances in the execution equipment sequence if the execution equipment sequence corresponds to the optimal interaction equipment group; if so, taking the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group as a target intelligent household appliance; wherein the optimal interaction device group is a group formed by at least two voice devices which are determined in advance according to the position and the orientation of the user in the full space;
and the first control module is used for controlling the target intelligent household appliance to perform corresponding processing and controlling the feedback voice equipment to perform voice broadcast on a processing result.
The intelligent household appliance control method and device based on hierarchical management provided by the embodiment of the specification have the following beneficial effects: the embodiment of the invention firstly determines corresponding response voice equipment and feedback voice equipment aiming at each awakening request, receives a voice instruction sent by the response voice equipment, analyzes the voice instruction, and determines equipment skills required by executing the voice instruction according to an analysis result; judging whether the device skill has a corresponding execution device sequence; if the answer voice equipment has the corresponding execution equipment sequence, determining whether the optimal interaction equipment group where the answer voice equipment is located contains the intelligent household appliances in the execution equipment sequence; if so, taking the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group as a target intelligent household appliance; and controlling the target intelligent household appliance to perform corresponding processing, and controlling the feedback voice equipment to perform voice broadcast on a processing result. In the embodiment of the invention, the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group is taken as the target intelligent household appliance, and the optimal interaction equipment group where the response voice equipment is located and the required equipment skills are considered in the process, so that the intelligent household appliance with the required equipment skills can be searched nearby a user, the near searching principle is met, the use experience of the user is ensured, the proper intelligent household appliance can be accurately matched, and the accurate control is realized. And moreover, an execution equipment sequence is also considered, and the intelligent household appliances with corresponding equipment skills are sorted according to the priority sequence in the execution equipment sequence, and the priority sequence is set by the user according to personal habits and preferences, so the personal habits and preferences of the user are also considered when the target intelligent household appliance is determined. Under the condition that the execution equipment is not specified in the voice command of the user, a proper target intelligent household appliance can be automatically determined by considering several factors of a nearby searching principle, required equipment skill and execution equipment sequence without complicated inquiry, so that timely and accurate response can be performed on a fuzzy voice command, and the user experience is greatly improved.
Drawings
In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present specification, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic flowchart of an intelligent household appliance control method based on hierarchical management in an embodiment of the present specification;
fig. 2 is a schematic diagram illustrating the distribution of intelligent appliances in a full space of a home according to an embodiment of the present invention;
FIG. 3a is a diagram of a voice terminal according to an embodiment of the present invention;
FIG. 3b is a diagram illustrating the distribution of smart homes and voice terminals within the full space of a home, in accordance with an embodiment of the present invention;
fig. 4 is a schematic diagram illustrating an example of an intelligent appliance control method according to an embodiment of the present disclosure;
fig. 5 is a block diagram illustrating an intelligent household appliance control device based on hierarchical management according to an embodiment of the present disclosure.
Detailed Description
The scheme provided by the specification is described in the following with reference to the attached drawings.
In a first aspect, an embodiment of the present invention provides an intelligent household appliance control method based on hierarchical management.
The applicable scenarios of the scheme provided by the embodiment of the present invention may include, but are not limited to, the following scenarios:
a plurality of voice devices including various intelligent home appliances are distributed in a home, and for example, referring to fig. 2, a washing machine, a refrigerator, two hanging air conditioners, a cabinet air conditioner, and two televisions are installed in the whole space of a home. The intelligent household appliances are provided with voice modules, and the voice modules in the intelligent household appliances can pick up voice instructions sent by users and send the voice instructions to the cloud platform. The voice module can also perform voice feedback under the control of the cloud platform, namely, the execution condition of some equipment is informed to the user in a voice broadcasting mode.
However, since intelligent home appliances are not installed in balconies, home-entry areas, toilets, and the like, the voice pickup function in these areas may be poor, and thus voice terminals may be installed in these areas. Referring to fig. 3a and 3b, voice terminals are arranged in the home area, the balcony, the restaurant, the study, the secondary toilet, the main toilet, the bedside of the main bed, the bedside of the child room, and the like. The voice terminal can pick up voice sent by a user and can also access the home local area network through WIFI. Because voice terminal's volume is very little, inconvenient installation public address module, therefore voice terminal does not have voice broadcast's function.
It can be understood that, because it is difficult for the optimal sound pickup range of each intelligent household appliance to cover all corners in a home, sometimes a situation that the voice command of the user cannot be responded to occurs, and therefore, the voice terminal is arranged in an area which cannot be covered by the intelligent household appliance in the home according to the embodiment of the present invention. Therefore, the optimal sound pickup range of each intelligent household appliance and each voice terminal can cover the whole space in a family.
Of course, the voice terminal can also have the function of light prompt. For example, when a voice terminal is awakened as a response voice device, the voice terminal can be prompted in a manner of breathing a lamp, when the voice terminal is used as the response voice device, the voice terminal used as the response voice device can be controlled to prompt in a manner of flashing green light for three times after the cloud platform controls the corresponding target intelligent household appliance to execute the command successfully, and when the cloud platform controls the corresponding target intelligent household appliance to execute the command unsuccessfully, the voice terminal used as the response voice device can be controlled to prompt in a manner of flashing yellow light for three times.
All voice devices (including all voice terminals and intelligent household appliances) in one family are in communication connection with the cloud platform, and therefore the cloud platform can control all the voice devices in the family. Of course, one application program may be installed on the mobile terminal of the user, and the control, configuration, and the like of each voice terminal in the home may be performed through the application program.
For example, when the user sends a wake-up word "long rainbow and small white" on a balcony, a voice terminal on the balcony is woken up, and the voice terminal prompts the user that the voice terminal is woken up by means of a breathing lamp. And then the user speaks to close the television of the master bedroom, and the voice terminal picks up the voice instruction and sends the voice instruction to the cloud platform. And after the cloud platform analyzes the voice command, the television of the master bedroom is controlled to be closed.
In conclusion, in one scene, voice devices are distributed in the whole space of one family, the voice devices comprise intelligent household appliances and voice terminals, and the union set of the optimal sound pickup ranges of the intelligent household appliances and the voice terminals can cover the whole space; the voice module in the intelligent household appliance has the functions of voice pickup and voice feedback, and the voice module of the voice terminal has the function of voice pickup; and the voice equipment is in communication connection with a cloud platform used for controlling the voice equipment in the whole space.
The method provided by the embodiment of the invention can be executed by a cloud platform, and besides the scenes, the method is also suitable for the scene that only intelligent household appliances exist in one family, and the voice module of the intelligent household appliance has a voice pickup function and a voice feedback function.
It can be understood that, if some optional embodiments of the present invention involve a voice terminal, the applicable scenarios of such specific embodiments are: voice equipment is distributed in the whole space of a family, the voice equipment comprises intelligent household appliances and voice terminals, and the union of the optimal pickup ranges of the intelligent household appliances and the voice terminals can cover the whole space; the voice module in the intelligent household appliance has the functions of voice pickup and voice feedback, and the voice module of the voice terminal has the function of voice pickup; and the voice equipment is in communication connection with a cloud platform used for controlling the voice equipment in the whole space. For example, at least two intelligent home appliances and at least two voice terminals are contained in one home.
It is understood that, if some optional embodiments of the present invention do not relate to a voice terminal, the scenario applicable to such an embodiment may be the scenario described in the above paragraph, and may of course also be the scenario: in a scene that only intelligent household appliances are contained in a household, a voice module in the intelligent household appliances has voice pickup and voice feedback functions.
Referring to fig. 1, a method provided by an embodiment of the present invention may include the following steps S100 to S500:
s100, determining corresponding response voice equipment and feedback voice equipment aiming at each awakening request; the response voice equipment is used for picking up a voice instruction of a user and sending the voice instruction to the voice equipment of the cloud platform; the feedback voice equipment is used for feeding back the processing result of the voice instruction to the user through voice;
it will be appreciated that the position of the user in the full space, the direction of the utterance when speaking, and hence the most suitable speech pickup device, will be different for each wake-up request. The responding voice device is determined for each wake-up request. That is to say, the purpose of determining the response voice device is to determine a voice device which is most suitable for picking up the voice command of the user, so that a clear voice command can be picked up, and thus, the cloud platform can analyze out an accurate command and perform accurate control, so that the probability of error control can be reduced.
For example, after the user issues the wake-up word "long rainbow and small white", that is, after the user initiates a wake-up request, the cloud platform determines a responding voice device in some way. And then the user sends a voice instruction to open the television in the living room, the response voice device picks up the voice instruction and sends the voice instruction to the cloud platform, and the cloud platform analyzes the voice instruction and further controls the television in the living room to be opened.
The answering voice equipment is used for picking up a voice instruction sent by a user and sending the voice instruction to the cloud platform.
It can be understood that, since the determined responding voice device may be a voice terminal, and the voice terminal does not have the function of voice broadcast, the execution condition of the voice command cannot be fed back, and therefore, an intelligent household appliance needs to be determined as a feedback voice device, that is, the intelligent household appliance informs the user of the execution condition of the voice command in a voice broadcast manner. Of course, if the determined response voice device is an intelligent home appliance, and the intelligent home appliance has a voice broadcasting function, the response voice device can be directly used as a feedback voice device at the same time, and the execution condition of the voice instruction is fed back to the user. Obviously, the function of the voice feedback device is to feed back the execution condition of the voice instruction to the user in a voice broadcasting mode.
The specific manner of determining the corresponding answering speech device and the feedback speech device is described in detail below, and is not described here.
S200, receiving a voice command sent by the response voice equipment, analyzing the voice command, and determining equipment skills required by executing the voice command according to an analysis result;
that is to say, after receiving the voice command sent by the response voice device, the cloud platform analyzes the voice command, so as to know what the user wants to do, and further know that the device skills of the intelligent household appliance are needed to achieve the purpose of the user.
For example, the voice command of the user is "i'm hot", and it is known through analysis that the intelligent household appliance needs to have the function of reducing the ambient temperature in order to execute the voice command, that is, the required device skill is to reduce the ambient temperature.
S300, judging whether the equipment skill has a corresponding execution equipment sequence;
the execution equipment sequence is a sequence obtained by sequencing each intelligent household appliance with the equipment skill according to a preset execution priority, and the execution equipment sequence is preset on an application program used for voice equipment control in the whole space by a user.
For example, a plurality of smart appliances in a home all have a certain device skill, e.g., one refrigerator, three air conditioners, and two televisions in a home all have a device skill to play music. The user can set a corresponding execution equipment sequence on the application program of the mobile terminal according to the equipment skill of playing music, and specifically, the refrigerator, the air conditioner and the television are sequenced according to the priority level, so that the execution equipment sequence is obtained. In the execution equipment sequence, the priorities of a living room television, a cabinet air conditioner in the living room, a hanging air conditioner in a main bed, a hanging air conditioner in a child room and a refrigerator are sequentially reduced.
It is understood that some device skills are only those of certain intelligent appliances, for example, the specific skills, for which case the corresponding execution device sequence need not be set.
S400, if the corresponding execution equipment sequence exists, determining whether the optimal interaction equipment group where the response voice equipment is located contains the intelligent household appliances in the execution equipment sequence; if so, taking the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group as a target intelligent household appliance;
wherein the optimal interactive device group is a group formed by at least two voice devices which are determined in advance according to the position and the orientation of the user in the full space.
It can be understood that if the required device skills have corresponding execution device sequences, the intelligent household appliance with the highest priority can be taken as the target intelligent household appliance, but in order to take the principle of selection nearby into consideration, the embodiment of the present invention further considers an optimal interaction device group where the response voice device is located, where the response voice device is located near the user, and each voice device in the optimal interaction device group is also located near the user. The embodiment of the invention judges whether the intelligent household appliances in the execution equipment sequence are contained in the optimal interaction equipment group, and if so, the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group is taken as the target intelligent household appliance.
For example, the answering voice device is a cabinet air conditioner in a living room, and the optimal interaction device group in which the answering voice device is located includes: aiming at the equipment skill of playing video, the corresponding execution equipment sequence is as follows: a television in a living room, a television in a main bedroom and a refrigerator (the television is sorted from high to low according to the priority). It can be seen that the best interactive device group only includes the television in the living room in the execution device sequence, and at this time, the television in the living room is used as the target intelligent household appliance.
For another example, the answering voice device is a cabinet air conditioner in a living room, and the optimal interaction device group in which the answering voice device is located includes: aiming at the equipment skill of playing music, the corresponding execution equipment sequence is as follows: a main-lying hanging type air conditioner, a living room television, a cabinet type air conditioner of a living room, a hanging type air conditioner of a child room and a refrigerator (which are sorted from high to low according to priority). As can be seen, the best interactive device group includes the living room tv and the cabinet air conditioner in the living room in the execution device sequence, and the priority of the living room tv is the highest among the living room tv and the cabinet air conditioner in the living room, so that the living room tv is used as the target intelligent appliance.
In specific implementation, in S400, if the required device skills have the corresponding execution device sequences, but the intelligent home appliances in the execution device sequences are not included in the optimal interaction device group where the response voice device is located, it is described that there is no intelligent home appliance with the required device skills in the optimal interaction device group, and at this time, the intelligent home appliance with the required device skills can be found in the full space, and the found intelligent home appliance with the required device skills is taken as the target intelligent home appliance.
In specific implementation, if it is determined through S300 that the required device skill does not have the corresponding execution device sequence, it may be that the user does not set the corresponding execution device sequence for the device skill on the application program, and there may be only one intelligent appliance having the device skill in the full space. And judging whether the intelligent household appliance with the required equipment skill exists in the optimal interaction equipment group where the response voice equipment is positioned or not by aiming at the condition that the required equipment skill does not have the corresponding execution equipment sequence. And if so, taking one intelligent household appliance with the required equipment skills in the optimal interaction equipment group as the target intelligent household appliance. And if no intelligent household appliance with the required device skills exists in the optimal interaction device group where the response voice device is located, searching the intelligent household appliance with the required device skills in the full space, and taking the searched intelligent household appliance with the required device skills as a target intelligent household appliance.
Therefore, for the device skills of a plurality of intelligent household appliances, the user can set a corresponding execution device sequence on the application program, and set the priority of each intelligent household appliance with the same device skill through the execution device sequence, so that when a target intelligent household appliance is selected, the priority of the intelligent household appliance is considered while considering the principle of proximity, that is, the intelligent household appliance with the highest priority is selected as the target intelligent household appliance as far as possible, and the use habit and the preference of the user are further met as far as possible.
Of course, in addition to the manner of setting the execution device sequence, the user may also set the corresponding priority execution device in the application. That is, before S300, the method provided in the embodiment of the present invention may further include the following steps:
s251, judging whether the equipment skill has corresponding preferred execution equipment;
the priority execution equipment is an intelligent household appliance preset by a user aiming at equipment skills on an application program used for voice equipment control in a full space.
S252, if the corresponding preferred execution equipment exists, judging whether the preferred execution equipment is located in the optimal interaction equipment group where the response voice equipment is located; if the optimal interaction equipment group is located, the optimal execution equipment is used as the target intelligent household appliance, the target intelligent household appliance is controlled to perform corresponding processing, and the feedback voice equipment is controlled to perform voice broadcast on a processing result;
and S253, if the device skill does not have the corresponding preferred execution device, executing the step of judging whether the device skill has the corresponding execution device sequence.
For example, intelligent home appliances having the facility ability to play music include a home-use wall air conditioner, a living room television, a cabinet air conditioner in a living room, a child's room wall air conditioner, a refrigerator, and the like, and a user sets the living room television as a preferred execution facility in an application program. When a user initiates a wake-up request in a living room, the user sends a voice command to play a song XXX, and at the moment, because the corresponding optimal interaction device group comprises a living room television, a cabinet air conditioner of the living room and a voice terminal of a balcony, although the cabinet air conditioner of the living room also has a music playing function, because the user sets the living room television as an optimal execution device and the living room television is positioned in the optimal interaction device group, the living room television is taken as a target intelligent household appliance, namely, the living room television plays the song XXX.
If a device skill can be implemented by only one intelligent home appliance, for example, a specific skill can be executed by only a specific intelligent home appliance, for the device skill, the user may or may not set the only intelligent home appliance as the preferred execution device on the application program.
If it is determined that the required device skill does not have the corresponding preferred execution device, as determined in S251, it indicates that the user may not set the corresponding preferred execution device for the device skill on the application program, and also that the device skill is the specific skill, and only one intelligent home appliance has the device skill. If it is determined that the required device skills do not have a corresponding preferred performing device, step S300 may be performed, i.e. determining whether there is a corresponding performing device sequence.
If the required equipment skill has the corresponding preferred execution equipment, but the preferred execution equipment is not in the optimal interaction equipment group where the response voice equipment is located, in order to ensure better interaction experience, an intelligent household appliance with the required equipment skill is continuously searched in the optimal interaction equipment group to serve as a target intelligent household appliance. Of course, it may be determined whether the required device skill has a corresponding execution device sequence, i.e., S300, for this case.
It will be appreciated that the required device skills are first determined to have a corresponding preferred performing device, and then determined to have a corresponding sequence of performing devices without having a preferred performing device. This sequence is used because the setup process of the preferred execution device on the application program is relatively simple, while the setup process of the execution device sequence on the application program is somewhat more complicated. For one device skill, the corresponding preferred execution device and execution device sequence may be set simultaneously. Of course, after the corresponding preferred execution device is set, the corresponding execution device sequence is not set; of course, the corresponding preferred execution device may not be set, and the corresponding execution device sequence may be directly set. Of course, neither a preferred execution device nor an execution device sequence may be set. The method for determining the target intelligent household appliance based on the execution equipment sequence not only considers the preference and habit of the user, but also considers the principle of searching nearby, and can bring better use experience to the user while breaking the original habit and preference of the user.
It can be understood that, if it is determined that the required device skill does not have the corresponding preferred execution device through S251, it is determined that the required device skill does not have the corresponding execution device sequence through S300, at this time, the target intelligent appliance matched with the device skill may be determined according to the intelligent appliance having the device skill in the optimal interaction device group where the response voice device is located; controlling the target intelligent household appliance to perform corresponding processing according to the analysis result; and controlling the feedback voice equipment to carry out voice broadcast on the processing result.
And S500, controlling the target intelligent household appliance to perform corresponding processing, and controlling the feedback voice equipment to perform voice broadcast on a processing result.
It can be understood that after the target intelligent household appliance is determined, the cloud platform can control the target intelligent household appliance to perform corresponding processing on the voice instruction, and after the processing is completed, the feedback voice device is controlled to inform a user of a processing result in a voice broadcasting mode.
In an actual scene, a user specifies an execution device in a voice instruction, and the specified execution device also has required device skills, so that the cloud platform can directly use the specified execution device as a target intelligent household appliance.
That is to say, before S300 (in the case that the foregoing S251 to S253 are included in the embodiment, it should be before S251), the method provided in the embodiment of the present invention may further include:
s231, determining whether the voice instruction contains specified execution equipment;
s232, if the specified execution equipment is not included, executing the step of judging whether the equipment skill has a corresponding execution equipment sequence;
s233, if the designated execution equipment is included, judging whether the designated execution equipment has the equipment skill; if the equipment skill is met, the designated execution equipment is used as a target intelligent household appliance, the target intelligent household appliance is controlled to perform corresponding processing, and the feedback voice equipment is controlled to perform voice broadcast on a processing result; and if the equipment skill is not available, controlling the feedback voice equipment to remind the user of the error of the specified execution equipment in a voice broadcasting mode.
That is, first, it is determined whether the voice command includes a specified execution device, for example, the voice command issued by the user is "turn off the living room television", and the voice command includes the specified execution device "living room television", so that the living room television can be directly used as the target smart home appliance, and then the turning off of the living room television is controlled.
It will be appreciated that if the specified execution device is included in the voice command but does not have the required device skills, it indicates that the voice command issued by the user has an error, and the error may be prompted by the feedback voice device.
It can be understood that, if it is found that the voice command does not have the designated execution device through the judgment, at this time, S300 or S251 may be executed, that is, the target intelligent household appliance is determined by the priority execution device or the execution device sequence, and it can be seen that although the voice command does not have the designated execution device at this time, the cloud platform may still determine an intelligent household appliance that meets the preference and habit of the user and also meets the principle of searching in the near future as the target intelligent household appliance by itself, and does not need to perform multiple queries.
It can be seen that, in the present invention, the priority of the designated execution device of the user is the highest, then the priority execution device set by the user is followed, then the execution device sequence set by the user is followed, and in the execution device sequence, there are a plurality of intelligent home appliances arranged according to the order of priority. This is a hierarchical management approach. Based on the hierarchical management mode, whether the user specifies the execution device in the voice command or not can determine a target intelligent household appliance without going through a complicated inquiry process. And when the target intelligent household appliance is determined based on the preferred execution device or the execution device sequence, the optimal interaction device group where the response voice device is located is also considered, and the required device skill is also considered. The personal preferences and habits of the user can be taken into account because of the manner in which the device or sequence of devices is executed based on preferences. Because the optimal interaction equipment group and the required equipment skills are considered, the intelligent household appliances with the required equipment skills can be searched nearby the user, namely, the near searching principle is met, the use experience of the user is ensured, the appropriate intelligent household appliances can be accurately matched, and the accurate control is realized.
The following describes the process of determining the answering voice device for each wake-up request.
S110, receiving notification information sent by the decision device, wherein the notification information is used for notifying the response voice device determined by the decision device to the cloud platform, and the decision device is an intelligent household appliance in the voice devices.
That is, the responding speech device is determined by the decision device, and the decision device informs the cloud platform after determining the responding speech device, so that the cloud platform can know which speech device is used as the responding speech device. The decision-making equipment is one of the intelligent household appliances in the family, and only one decision-making equipment is arranged in the whole space of the whole family, and the decision-making equipment is determined in advance.
When each voice device picks up a preset awakening word sent by a user, calculating a corresponding score value, and judging whether the score value is higher than a score value threshold value corresponding to the voice device; if yes, generating the election participation request according to the score value of the voice equipment, and sending the election participation request to decision equipment; and the decision equipment selects one voice equipment from the voice equipment sending the election participation request as the response voice equipment according to the score value in each election participation request.
For example, based on fig. 3b, after the user sends a preset wake-up word "long rainbow and small white" in the living room, that is, after the user initiates a wake-up request, 7 voice devices in the household, the living room, the restaurant, the balcony, the kitchen, and the laundry all pick up the preset wake-up word sent by the user, and then the 7 voice devices calculate their respective score values, thereby determining whether their score values are higher than their score value threshold. I.e., each speech device has a corresponding score value threshold. After the judgment, the score values of only 5 voice devices in the house, the living room, the dining room and the balcony are higher than the respective score value threshold values, so that only the 5 voice devices send election participation requests to the decision device. After receiving the election participation request sent by the 5 voice devices, the decision device selects one voice device from the 5 voice devices sending the election participation request as a response voice device.
Further, the determination process of the score value threshold of each voice device comprises the following steps:
a1, the cloud platform acquires the historical credit value of each voice device in the full space;
a2, the cloud platform determines rule data of the voice equipment selected as response voice equipment according to the historical score value of each voice equipment, and sets a corresponding score value threshold value for the voice equipment according to the rule data;
a3, the cloud platform sends the score value threshold value of each voice device to the voice device;
as can be seen, the score value threshold for each voice device is determined for the cloud platform.
The historical score value of one voice device is the score value of the voice device after the voice device picks up a wakeup word each time in a preset historical time period, the score value is used for representing the probability of a user waking up the voice device, and the rule data of one voice device is the corresponding historical score value interval when the voice device is elected as a response voice device in the preset historical time period.
It will be appreciated that the score value of a speech device may reflect the probability that the user will wake up the speech device, i.e., the higher the score value of a speech device, the higher the probability that the user will wake up the speech device. The historical score value is a score value calculated each time a speech device picks up a wakeup word in a historical period, for example, a score value is calculated for each wakeup request when a television in a living room picks up 100 wakeup words in the past month, and the total score value is 100. According to the 100 scoring values, the historical scoring value when the voice equipment is selected as the response voice equipment is screened out, and then the historical scoring interval when the voice equipment is selected as the response voice equipment can be determined according to the screened historical scoring value, so that the rule data can be obtained. Then, a corresponding score value threshold is determined according to a history score interval corresponding to a voice device, for example, the history score interval when a voice device is selected as a response voice device is [70, 100], the score value threshold set for the voice device according to the history score interval is 60, that is, the score value of the voice device is only higher than 60 to participate in election, otherwise, no opportunity to participate in election exists. And finally, the cloud platform sends the score value threshold value set for each voice device to the corresponding voice device.
Furthermore, when each voice device picks up a preset awakening word sent by the user, the corresponding score value is calculated, and then the score value is compared with the score value threshold value of the voice device. When the pickup angle of a piece of speech equipment is within a preset range, the speech equipment can calculate the corresponding score value by adopting a first calculation formula, wherein the first calculation formula comprises:
when r is in the first range, P2 ═ a × s + b/| r-90
When r is in the second range, P2 ═ b ═ s-a | -r-90 | + c
Wherein P2 is the score value; s is the pickup sound intensity; r is the pickup angle; the first range is: r is greater than or equal to 60 and less than 80, or r is greater than 100 and less than or equal to 120; the second range is: r is 80 or more and 100 or less; a and b are preset weights, a is larger than b, c is 10 a + b/10, and the preset range is the union of the first range and the second range.
Wherein, when r is within the first range, the greater the sound pickup intensity, the greater P2; the closer the sound pickup angle is to 90, the larger P2 is, so the sound pickup intensity is high and the wake-up score of the voice apparatus with the sound pickup angle close to 90 is relatively high. Further, when r is within the first range, the weight of the sound intensity of the collected sound is a, and a is greater than b, indicating that the sound intensity of the collected sound is more focused at this time, that is, the sound intensity of the collected sound is more important in this case.
When r is within the second range, the sound pickup intensity is higher, P2 is higher, the sound pickup angle is closer, and P2 is higher, so that the score of the voice device with the sound pickup angle close to 90 is higher. When r is within the second range, the weight of the sound pickup angle is a, and a is greater than b, which indicates that the sound pickup angle is more concerned at this time, that is, in this case, the sound pickup angle follows as important.
Further, in order to ensure that the score when the sound intensity of the picked sound is the same and r is in the second range should be larger than the score when r is in the first range, in the embodiment of the present invention, a parameter c is added to the calculation formula when r is in the second range, and c is 10 × a + b/10, which can ensure that the score when r is in the second range is larger than the score when r is in the first range under the condition that the sound intensity of the picked sound is the same.
Where c 10 a + b/10 is calculated to ensure that b s-a | r-90| and c is equal to or greater than a s + b/| r-90| when r is 100 and the sound intensity is 0. On the basis of the c value, when r is in any value in the second range, the awakening score of the r in the second range can be ensured to be larger than the awakening score of the r in the first range under the condition that the sound intensity of the picked sound is the same.
In practice, when the sound pickup angle is out of the preset range, for example, the sound pickup angle is smaller than 60 or larger than 120, which indicates that the sound pickup angle of the voice device is not the optimal sound pickup angle, but P2 ═ a × s + b/| r-90| may be used to calculate the corresponding score value.
In a specific implementation, before receiving the notification information sent by the decision device in S110, the cloud platform may further perform the following processing, that is, the method may further include:
b1, determining the corresponding optimal interactive equipment group according to the position of the user in the full space;
b2, determining whether the optimal interaction device group has a corresponding preferred answering device; the preferred response equipment is an intelligent household appliance preset by the user on the application program aiming at the optimal interaction equipment group;
b3, if the preferred answering machine is corresponding, determining whether the corresponding credit value of the preferred answering machine is higher than a preset credit value; if the value is higher than the preset score value, the preferred response equipment is used as the response voice equipment; if the value is less than or equal to the preset score value, executing a step of receiving notification information sent by the decision-making equipment;
b4, if the answer equipment does not have the corresponding preference answer equipment, executing the step of receiving the notification information sent by the decision equipment.
That is, the user may set a preferred answering machine for each optimal set of interacting devices on the application of the mobile terminal. For each awakening request, the cloud platform determines a corresponding optimal interaction device group according to the position of the user, and then judges whether an optimal response device is set for the optimal interaction device group. If a preferred responder device is set, a score value for the preferred responder device is then calculated and compared to a preset score value. If the score value is higher than the preset score value, the sound intensity picked by the preferred answering equipment is not very low, and the sound picking requirement can be met, and at the moment, the preferred answering equipment is used as answering voice equipment; wherein the preset score value may be lower than the respective score value threshold of the preferred answering machines.
However, if the score value of the preferred answering machine is less than or equal to the preset score value, the intensity of the sound picked up by the preferred answering machine is low, and the sound pickup requirement cannot be met. It is therefore desirable to employ responsive speech devices as determined by the decision-making device. Of course, if no corresponding preferred answering machine is set for this optimal group of interacting devices, the answering speech device determined by the decision device needs to be employed.
It will be appreciated that the preferred answering device of an optimal set of interacting devices is a voice device, preferably an intelligent appliance, in the optimal set of interacting devices.
It can be seen that in accordance with the above, a responsive voice device can be determined for each wake-up request.
In a specific implementation, for each wake-up request, determining a corresponding feedback voice device may include at least one of:
(1.1) if the response voice equipment is an intelligent household appliance, the response voice equipment is also used as the feedback voice equipment;
(1.2) if the response voice equipment is a voice terminal, taking an intelligent household appliance in the optimal interaction equipment group where the voice response equipment is located as the feedback voice equipment.
That is to say, if the answering voice device is an intelligent household appliance, the answering voice device can also be used as a feedback voice device, and at this time, the answering voice device and the feedback voice device are the same device. If the response voice equipment is a voice terminal, one intelligent household appliance can be selected from the best interaction equipment group as a feedback voice terminal, and the response voice equipment and the feedback voice equipment are different equipment at the moment.
The following describes a process of determining an optimal interaction device group by the cloud platform:
c1, the cloud platform acquires the position and the orientation of a user sending a preset awakening word in the full space in a historical awakening task;
c2, acquiring the sound intensity of the preset awakening words picked up by each voice device, and selecting a first voice device from each voice device according to the sound intensity; the sound intensity picked up by each first voice device is higher than the sound intensity picked up by other voice devices, and the maximum difference value between the sound intensities picked up by each first voice device is within a preset difference value range;
c3, acquiring the sound pickup angle of each first voice device, and selecting a second voice device of which the sound pickup angle is within the optimal sound pickup angle range from the first voice devices according to the sound pickup angle of each first voice device;
c4, forming each second speech device into an optimal set of interaction devices for the position and orientation of the user.
For example, the user is in the middle of the living room and the dining room and facing the balcony to make "rainbow and white", and at this time, the sound intensity picked up by the 5 voice devices in the family, the living room and the dining room is slightly higher than that of the voice devices in the laundry and the kitchen, and the sound intensity picked up by the 5 voice devices in the family, the living room and the dining room is much higher than that of the voice devices in the study room, the bedroom and the bathroom. And screening out the first voice equipment according to the sound intensity picked up by each voice equipment. Since the user stands in the middle of the living room and the restaurant, the sound intensity picked up by 5 voice devices in the home, the living room and the restaurant is almost the same, and the 5 voice devices are the voice devices with the maximum sound intensity among all the voice devices, so the 5 voice devices are taken as the first voice devices.
Further, since the user faces the balcony, 3 voice devices in the living room and the balcony face the sound emission direction of the user, and two voice devices in the home-entry restaurant and the restaurant face away from the sound emission direction of the user, the sound pickup angles of the 3 voice devices in the living room and the balcony are in the optimal sound pickup angle range, and the sound pickup angles of the two voice devices in the home-entry restaurant and the balcony are not in the optimal sound pickup angle range, 3 voice devices in the living room and the balcony are used as second voice devices, and the 3 second voice devices form an optimal interaction device group. Of course, if the user is facing the direction of the restaurant, the restaurant and the two voice devices of the user form an optimal set of interactive devices.
It can be seen that an optimal interaction device group can be corresponded according to the position and orientation of the user, and actually, the user can be corresponded to the optimal interaction device group when the user is at a certain position, for example, when the user is sitting on a couch in a living room to watch television, the corresponding optimal interaction device group is an optimal interaction device group formed by three voice devices in the living room and a balcony.
In practice, when a user is at different positions and orientations in the full space of a home, multiple optimal interaction device groups can be formed for multiple wake-up requests, and stored, and the optimal interaction device groups can be directly used subsequently.
The embodiment of the invention provides an optimal interaction device group. The optimal interactive device group is a virtual space group automatically divided according to past experience. The optimal interaction device group is a device group determined according to the position and orientation of the user, and each voice device in the optimal interaction device group can be located in the same physical space or in a plurality of physical spaces. For example, when the user stands in the middle of the living room and the dining room and sends a wake-up request towards the balcony, the three devices, namely the cabinet air conditioner and the television in the living room and the voice terminal on the balcony, are divided into an optimal interaction device group, and then the target intelligent household appliance can be determined by using the optimal interaction device group. The group of preferred interactive devices is a virtual space group in which there are at least two voice devices, and there is no need to divide them into a group if there is only one voice device.
In specific implementation, before S300 (if the embodiment includes steps S251 to S253, it should be before S251), the embodiment of the present invention may further include the following steps:
d1, judging whether the equipment skill belongs to the universal skill;
because there are multiple types of intelligent household appliances in the whole space of a family, different intelligent household appliances have their own exclusive skills, for example, a television has equipment skills of playing videos, displaying menus and the like, a refrigerator has equipment skills of food material management and food material state inquiry, an air conditioner has equipment skills of adjusting temperature and humidity, and a washing machine has equipment skills of washing, drying and the like. There is a strong association between the executed instructions and the device.
Besides the respective exclusive skills, each intelligent household appliance also has some general skills, for example, each intelligent household appliance has a device skill for information query (for example, weather query, stock query, encyclopedia query, news query, date query, etc.), and also has a device skill for alarm clock reminding. The same feedback can be obtained from the user's interaction with any intelligent appliance.
Of course, each intelligent appliance also has public skills. Such as after-market service, scene control, etc., device skills. Public skills can provide public service and situational control for products. Although each intelligent household appliance has the device skills of after-sales service and scene control, the after-sales and scene control of different intelligent household appliances are different.
As can be seen, there are multiple types of device skills: general skills, exclusive skills, public skills. Aiming at the general skills, all intelligent household appliances can obtain the same result aiming at the same voice command. Aiming at public skills, different results can be obtained by each intelligent household appliance aiming at the same voice command. Aiming at the exclusive skill, each intelligent household appliance can only execute the voice instruction matched with the exclusive skill. The required device skills are here mainly divided into two categories: general skills and non-general skills, wherein the non-general skills comprise exclusive skills and public skills.
d2, if not belonging to the general skills, executing the step of judging whether the equipment skills have corresponding execution equipment sequences;
it is understood that if the embodiment includes steps S251 to S253, the step S251 is executed if the d2 does not belong to the general skills.
It will be appreciated that if the device skills required to execute the voice commands are not generic, it is necessary to determine a target intelligent appliance capable of executing the voice commands that matches the device skills required to execute the voice commands, i.e. the target intelligent appliance has the required device skills.
For example, in one scenario, a user says "rainbow and white" in a living room, a television in the living room is determined as a voice response device, the television in the living room says "yes", then, the user says "play ideal shining china" in the living room, the television in the living room picks up the voice, the voice is sent to a cloud platform, the cloud platform analyzes the voice to know that required device skills are playing videos, the analysis finds that a preferred execution device set by the user for the device skills is a living room television, and a living room television is arranged in an optimal interaction device group where the voice response device is located, so that the living room television is used as a target intelligent household appliance, and the cloud platform controls the television in the living room to play the video of ideal shining china.
d3, if the answer voice equipment belongs to the general skills, determining whether the answer voice equipment is an intelligent household appliance or a voice terminal; if the intelligent household appliance is the intelligent household appliance, the response voice equipment is used as the target intelligent household appliance, the target intelligent household appliance is controlled to perform corresponding processing, and the feedback voice equipment is controlled to perform voice broadcast on a processing result; if the voice terminal is the voice terminal, one intelligent household appliance in the optimal interaction equipment group where the response voice equipment is located is used as the target intelligent household appliance, the target intelligent household appliance is controlled to perform corresponding processing, and the feedback voice equipment is controlled to perform voice broadcasting on a processing result.
Therefore, if the required equipment skill is general skill and the answering voice equipment is an intelligent household appliance, the intelligent household appliance can be directly used as a target intelligent household appliance. And if the response voice equipment is a voice terminal, randomly selecting an intelligent household appliance as a target intelligent household appliance from the optimal interaction equipment group where the response voice terminal is located.
That is, if the device skills are general skills, the current responding voice device is taken as the target intelligent household appliance, which is the simplest way, but when the responding voice device is a voice terminal, since the voice terminal is only voice pickup, one intelligent household appliance in the optimal interaction device group where the responding voice device is located is taken as the target intelligent household appliance.
For example, referring to fig. 4, a user sends a 'long rainbow and small white' message on a balcony, a voice terminal on the balcony is determined as a response voice device, after the user says 'how the weather is', the response voice device picks up the voice and sends the voice to a cloud platform, the cloud platform determines that the weather query is a general instruction, and at this time, because the response voice device is the voice terminal, a television in an optimal interaction device group where the response voice device is located is selected as a target intelligent household appliance and a feedback voice terminal, the weather is queried through the target intelligent household appliance, and the user is informed of the current weather through the television in a voice broadcast mode.
It can be understood that in order to pick up the voice commands sent by the user at each corner in the whole space of a family, a plurality of voice terminals can be arranged, so that the union of the optimal pickup ranges of the intelligent household appliances and the voice terminals can cover the whole space, and the problem that the user commands are not responded because the user commands are not picked up can be avoided or greatly reduced. And each voice terminal is connected with the cloud platform, so that control for each voice terminal in the whole space of a family can be formed.
The intelligent household appliance control method provided by the embodiment of the invention comprises the steps of firstly determining corresponding response voice equipment and feedback voice equipment according to each awakening request, receiving a voice instruction sent by the response voice equipment, analyzing the voice instruction, and determining equipment skills required by executing the voice instruction according to an analysis result; judging whether the device skill has a corresponding execution device sequence; if the answer voice equipment has the corresponding execution equipment sequence, determining whether the optimal interaction equipment group where the answer voice equipment is located contains the intelligent household appliances in the execution equipment sequence; if so, taking the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group as a target intelligent household appliance; and controlling the target intelligent household appliance to perform corresponding processing, and controlling the feedback voice equipment to perform voice broadcast on a processing result. In the embodiment of the invention, the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group is taken as the target intelligent household appliance, and the optimal interaction equipment group where the response voice equipment is located and the required equipment skills are considered in the process, so that the intelligent household appliance with the required equipment skills can be searched nearby a user, the near searching principle is met, the use experience of the user is ensured, the proper intelligent household appliance can be accurately matched, and the accurate control is realized. And moreover, an execution equipment sequence is also considered, and the intelligent household appliances with corresponding equipment skills are sorted according to the priority sequence in the execution equipment sequence, and the priority sequence is set by the user according to personal habits and preferences, so the personal habits and preferences of the user are also considered when the target intelligent household appliance is determined. Under the condition that the execution equipment is not specified in the voice command of the user, a proper target intelligent household appliance can be automatically determined by considering several factors of a nearby searching principle, required equipment skill and execution equipment sequence without complicated inquiry, so that timely and accurate response can be performed on a fuzzy voice command, and the user experience is greatly improved.
In a second aspect, an embodiment of the present invention provides an intelligent household appliance control apparatus based on hierarchical management, where voice devices are distributed in a whole space of a home, where the voice devices include an intelligent household appliance, a voice module in the intelligent household appliance has voice pickup and voice feedback functions, and each of the voice devices is in communication connection with a cloud platform for controlling the voice devices in the whole space.
The apparatus is located on the cloud platform, see fig. 5, the apparatus comprising:
the first determining module is used for determining corresponding response voice equipment and feedback voice equipment aiming at each awakening request; the response voice equipment is used for picking up a voice instruction of a user and sending the voice instruction to the voice equipment of the cloud platform; the feedback voice equipment is used for feeding back the processing result of the voice instruction to the user through voice;
the second determining module is used for receiving the voice command sent by the response voice equipment, analyzing the voice command and determining equipment skills required by executing the voice command according to an analysis result;
the first judgment module is used for judging whether the equipment skill has a corresponding execution equipment sequence; the execution equipment sequence is a sequence obtained by sequencing each intelligent household appliance with the equipment skills according to a preset execution priority, and is preset on an application program used for voice equipment control in the whole space by a user;
the second judgment module is used for determining whether the optimal interaction equipment group where the response voice equipment is located contains the intelligent household appliances in the execution equipment sequence if the execution equipment sequence corresponds to the optimal interaction equipment group; if so, taking the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group as a target intelligent household appliance; wherein the optimal interaction device group is a group formed by at least two voice devices which are determined in advance according to the position and the orientation of the user in the full space;
and the first control module is used for controlling the target intelligent household appliance to perform corresponding processing and controlling the feedback voice equipment to perform voice broadcast on a processing result.
It is understood that the apparatus provided by the second aspect and the method provided by the first aspect are corresponding, and for the explanation, example, and beneficial effects and the like of the related contents in this aspect, reference may be made to the related contents in the first aspect, and details are not described here.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
Those skilled in the art will recognize that, in one or more of the examples described above, the functions described in this disclosure may be implemented in hardware, software, hardware, or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium.
The above-mentioned embodiments, objects, technical solutions and advantages of the present invention are further described in detail, it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the present invention should be included in the scope of the present invention.

Claims (10)

1. An intelligent household appliance control method based on hierarchical management is characterized in that voice equipment is distributed in the whole space of a family, the voice equipment comprises intelligent household appliances, voice modules in the intelligent household appliances have voice pickup and voice feedback functions, and each voice equipment is in communication connection with a cloud platform used for controlling the voice equipment in the whole space; the method is performed by the cloud platform, the method comprising:
aiming at each awakening request, determining corresponding response voice equipment and feedback voice equipment; the response voice equipment is used for picking up a voice instruction of a user and sending the voice instruction to the voice equipment of the cloud platform; the feedback voice equipment is used for feeding back the processing result of the voice instruction to the user through voice;
receiving a voice instruction sent by the response voice equipment, analyzing the voice instruction, and determining equipment skills required by executing the voice instruction according to an analysis result;
judging whether the device skill has a corresponding execution device sequence; the execution equipment sequence is a sequence obtained by sequencing each intelligent household appliance with the equipment skills according to a preset execution priority, and is preset on an application program used for voice equipment control in the whole space by a user;
if the corresponding execution equipment sequence exists, determining whether the optimal interaction equipment group where the response voice equipment is located contains the intelligent household appliances in the execution equipment sequence; if so, taking the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group as a target intelligent household appliance; wherein the optimal interaction device group is a group formed by at least two voice devices which are determined in advance according to the position and the orientation of the user in the full space;
and controlling the target intelligent household appliance to perform corresponding processing, and controlling the feedback voice equipment to perform voice broadcast on a processing result.
2. The method of claim 1, wherein prior to determining whether the device skill has a corresponding executing device sequence, the method further comprises:
judging whether the equipment skill has corresponding preferred execution equipment or not, wherein the preferred execution equipment is an intelligent household appliance preset by a user for the equipment skill on an application program used for voice equipment control in the full space;
if the preferred execution equipment is corresponding to the voice response equipment, judging whether the preferred execution equipment is located in the optimal interaction equipment group where the voice response equipment is located; if the optimal interaction equipment group is located, the optimal execution equipment is used as the target intelligent household appliance, the target intelligent household appliance is controlled to perform corresponding processing, and the feedback voice equipment is controlled to perform voice broadcast on a processing result;
if the device skill does not have the corresponding preferred execution device, executing the step of judging whether the device skill has the corresponding execution device sequence;
if the equipment skill does not have the corresponding preferred execution equipment and execution equipment sequence, determining a target intelligent household appliance matched with the equipment skill according to the intelligent household appliance with the equipment skill in the optimal interaction equipment group where the response voice equipment is located; controlling the target intelligent household appliance to perform corresponding processing according to the analysis result; and controlling the feedback voice equipment to carry out voice broadcast on the processing result.
3. The method of claim 1, wherein prior to determining whether the device skill has a corresponding executing device sequence, the method further comprises:
determining whether the voice instruction contains a specified execution device;
if the specified execution equipment is not included, executing the step of judging whether the equipment skill has a corresponding execution equipment sequence;
if the specified execution equipment is included, judging whether the specified execution equipment has the equipment skill; if the equipment skill is met, the designated execution equipment is used as a target intelligent household appliance, the target intelligent household appliance is controlled to perform corresponding processing, and the feedback voice equipment is controlled to perform voice broadcast on a processing result; and if the equipment skill is not available, controlling the feedback voice equipment to remind the user of the error of the specified execution equipment in a voice broadcasting mode.
4. The method of claim 1, wherein determining a corresponding responding voice device for each wake-up request comprises:
receiving notification information sent by a decision device, wherein the notification information is used for notifying a response voice device determined by the decision device to a cloud platform, and the decision device is an intelligent household appliance in the voice devices;
when each voice device picks up a preset awakening word sent by a user, calculating a corresponding score value, and judging whether the score value is higher than a score value threshold corresponding to the voice device; if yes, generating the election participation request according to the score value of the voice equipment, and sending the election participation request to decision equipment; the decision equipment selects one voice equipment from the voice equipment sending the election participation request as the response voice equipment according to the score value in each election participation request;
wherein each voice device has a corresponding score value threshold, and the determination process of the score value threshold comprises the following steps: the cloud platform acquires a historical score value of each voice device in the whole space; the cloud platform determines rule data of the voice equipment selected as response voice equipment according to the historical score value of each voice equipment, and sets a corresponding score value threshold value for the voice equipment according to the rule data; sending the score value threshold of each voice device to the voice device; the historical score value of one voice device is the score value of the voice device after the voice device picks up a wake-up word each time in a preset historical time period, the score value is used for representing the probability of a user waking up the voice device, and the rule data of one voice device is the corresponding historical score value interval when the voice device is elected as a response voice device in the preset historical time period.
5. The method of claim 4, wherein when the pickup angle of a speech device is within a predetermined range, the speech device calculates the corresponding score value using a first calculation formula, the first calculation formula comprising:
when r is in the first range, P2 ═ a × s + b/| r-90
When r is in the second range, P2 ═ b ═ s-a | -r-90 | + c
Wherein P2 is the score value; s is the pickup sound intensity; r is the pickup angle; the first range is: r is greater than or equal to 60 and less than 80, or r is greater than 100 and less than or equal to 120; the second range is: r is 80 or more and 100 or less; a and b are preset weights, a is larger than b, c is 10 a + b/10, and the preset range is the union of the first range and the second range.
6. The method of claim 1, wherein the voice device further comprises voice terminals, and a union of optimal pickup ranges of the intelligent appliances and the voice terminals can cover the full space; the voice module of the voice terminal has a voice pickup function;
correspondingly, for each wake-up request, determining a corresponding feedback voice device, including:
if the response voice equipment is an intelligent household appliance, the response voice equipment is also used as the feedback voice equipment; and if the response voice equipment is a voice terminal, taking an intelligent household appliance in the optimal interaction equipment group where the voice response equipment is located as the feedback voice equipment.
7. The method of claim 1, wherein the determining of the optimal set of interacting devices comprises:
the cloud platform acquires the position and the orientation of a user sending a preset awakening word in the whole space in a historical awakening task; acquiring the sound intensity of the preset awakening words picked up by each voice device, and selecting a first voice device from each voice device according to the sound intensity; the sound intensity picked up by each first voice device is higher than the sound intensity picked up by other voice devices, and the maximum difference value between the sound intensities picked up by each first voice device is within a preset difference value range; acquiring the pickup angle of each first voice device, and selecting a second voice device of which the pickup angle is within the optimal pickup angle range from the first voice devices according to the pickup angle of each first voice device; forming each of the second speech devices into an optimal set of interaction devices for the location and the orientation of the user.
8. The method of claim 6, wherein prior to determining whether the device skill has a corresponding executing device sequence, the method further comprises:
determining whether the device skill belongs to a general skill;
if the skill does not belong to the general skill, the step of judging whether the equipment skill has a corresponding execution equipment sequence is executed;
if the answer voice equipment belongs to the general skills, determining whether the answer voice equipment is an intelligent household appliance or a voice terminal; if the intelligent household appliance is the intelligent household appliance, the response voice equipment is used as the target intelligent household appliance, the target intelligent household appliance is controlled to perform corresponding processing, and the feedback voice equipment is controlled to perform voice broadcast on a processing result; if the intelligent household appliance is the voice terminal, one intelligent household appliance in the optimal interaction equipment group where the response voice equipment is located is used as the target intelligent household appliance, the target intelligent household appliance is controlled to perform corresponding processing, and the feedback voice equipment is controlled to perform voice broadcast on a processing result.
9. The method of claim 4, wherein before receiving the notification information sent by the decision device, the method further comprises:
determining a corresponding optimal interaction equipment group according to the position of the user in the full space;
determining whether the optimal group of interacting devices has a corresponding preferred responder device; the preferred response equipment is an intelligent household appliance preset by the user on the application program aiming at the optimal interaction equipment group;
if the preferred answering equipment is provided, determining whether the score value corresponding to the preferred answering equipment is higher than a preset score value; if the value is higher than the preset score value, the preferred response equipment is used as the response voice equipment; if the value is less than or equal to the preset score value, executing a step of receiving notification information sent by the decision-making equipment;
and if the answer equipment does not have the corresponding preferred answer equipment, executing the step of receiving the notification information sent by the decision equipment.
10. An intelligent household appliance control device based on hierarchical management is characterized in that voice equipment is distributed in the whole space of a family, the voice equipment comprises intelligent household appliances, voice modules in the intelligent household appliances have voice pickup and voice feedback functions, and each voice equipment is in communication connection with a cloud platform used for controlling the voice equipment in the whole space;
the apparatus is located on the cloud platform, the apparatus comprising:
the first determining module is used for determining corresponding response voice equipment and feedback voice equipment aiming at each awakening request; the response voice equipment is used for picking up a voice instruction of a user and sending the voice instruction to the voice equipment of the cloud platform; the feedback voice equipment is used for feeding back the processing result of the voice instruction to the user through voice;
the second determining module is used for receiving the voice command sent by the response voice equipment, analyzing the voice command and determining equipment skills required by executing the voice command according to an analysis result;
the first judgment module is used for judging whether the equipment skill has a corresponding execution equipment sequence; the execution equipment sequence is a sequence obtained by sequencing each intelligent household appliance with the equipment skills according to a preset execution priority, and is preset on an application program used for voice equipment control in the whole space by a user;
the second judgment module is used for determining whether the optimal interaction equipment group where the response voice equipment is located contains the intelligent household appliances in the execution equipment sequence if the execution equipment sequence corresponds to the optimal interaction equipment group; if so, taking the intelligent household appliance with the highest execution priority in the execution equipment sequence contained in the optimal interaction equipment group as a target intelligent household appliance; wherein the optimal interaction device group is a group formed by at least two voice devices which are determined in advance according to the position and the orientation of the user in the full space;
and the first control module is used for controlling the target intelligent household appliance to perform corresponding processing and controlling the feedback voice equipment to perform voice broadcast on a processing result.
CN202210607104.3A 2022-05-31 2022-05-31 Intelligent household appliance control method and device based on hierarchical management Active CN115001891B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210607104.3A CN115001891B (en) 2022-05-31 2022-05-31 Intelligent household appliance control method and device based on hierarchical management

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210607104.3A CN115001891B (en) 2022-05-31 2022-05-31 Intelligent household appliance control method and device based on hierarchical management

Publications (2)

Publication Number Publication Date
CN115001891A true CN115001891A (en) 2022-09-02
CN115001891B CN115001891B (en) 2023-05-19

Family

ID=83031104

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210607104.3A Active CN115001891B (en) 2022-05-31 2022-05-31 Intelligent household appliance control method and device based on hierarchical management

Country Status (1)

Country Link
CN (1) CN115001891B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109410943A (en) * 2018-12-10 2019-03-01 珠海格力电器股份有限公司 Voice control method and system of equipment and intelligent terminal
CN109637548A (en) * 2018-12-29 2019-04-16 苏州思必驰信息科技有限公司 Voice interactive method and device based on Application on Voiceprint Recognition
CN111143061A (en) * 2019-12-18 2020-05-12 海尔优家智能科技（北京）有限公司 Multi-device linkage control method and device and storage medium
EP3690877A1 (en) * 2019-01-31 2020-08-05 Beijing Xiaomi Intelligent Technology Co., Ltd. Method and apparatus for controlling device
CN113096658A (en) * 2021-03-31 2021-07-09 歌尔股份有限公司 Terminal equipment, awakening method and device thereof and computer readable storage medium
CN114005431A (en) * 2021-10-15 2022-02-01 深圳Tcl新技术有限公司 Configuration method, device and equipment of voice system and readable storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109410943A (en) * 2018-12-10 2019-03-01 珠海格力电器股份有限公司 Voice control method and system of equipment and intelligent terminal
CN109637548A (en) * 2018-12-29 2019-04-16 苏州思必驰信息科技有限公司 Voice interactive method and device based on Application on Voiceprint Recognition
EP3690877A1 (en) * 2019-01-31 2020-08-05 Beijing Xiaomi Intelligent Technology Co., Ltd. Method and apparatus for controlling device
US20200251101A1 (en) * 2019-01-31 2020-08-06 Beijing Xiaomi Intelligent Technology Co., Ltd. Method and apparatus for controlling device
CN111508483A (en) * 2019-01-31 2020-08-07 北京小米智能科技有限公司 Equipment control method and device
CN111143061A (en) * 2019-12-18 2020-05-12 海尔优家智能科技（北京）有限公司 Multi-device linkage control method and device and storage medium
CN113096658A (en) * 2021-03-31 2021-07-09 歌尔股份有限公司 Terminal equipment, awakening method and device thereof and computer readable storage medium
CN114005431A (en) * 2021-10-15 2022-02-01 深圳Tcl新技术有限公司 Configuration method, device and equipment of voice system and readable storage medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
DRAGAN MARKOVIC , DRAGAN CVETKOVIC , DEJAN ZIVKOVIC, RANKO POPOVIC: ""RETRACTED: Challenges of information and communication technology in energy efficient smart homes"", 《RENEWABLE AND SUSTAINABLE ENERGY REVIEWS》 *
戴林: ""基于嵌入式的智能家居控制***的研究与实现"", 《中国优秀硕士学位论文全文数据库 (基础科学辑)》 *

Also Published As

Publication number Publication date
CN115001891B (en) 2023-05-19

Similar Documents

Publication Publication Date Title
CN105700389B (en) Intelligent home natural language control method
CN110211580B (en) Multi-intelligent-device response method, device, system and storage medium
JP7104357B2 (en) Equipment control system
WO2020211465A1 (en) Smart home device control method, medium, mobile terminal, and apparatus
WO2020199673A1 (en) Method and device for controlling household appliance, and household appliance
WO2020252703A1 (en) Device control method and apparatus, server and storage medium
CN114120996A (en) Voice interaction method and device
WO2021082131A1 (en) Air conditioning device, and temperature control method and apparatus
WO2020224265A1 (en) Voice control method and apparatus
CN114067798A (en) Server, intelligent equipment and intelligent voice control method
CN110632854A (en) Voice control method and device, voice control node and system and storage medium
CN113395193B (en) Equipment control method and device, computer equipment and storage medium
CN114220442A (en) Control method of intelligent home system and intelligent home system
CN114898750B (en) Intelligent household appliance control method, device, system and equipment based on cooperative response
CN114999484A (en) Election method and system of interactive voice equipment
CN115001891A (en) Intelligent household appliance control method and device based on hierarchical management
CN115019793A (en) Awakening method, device, system, medium and equipment based on cooperative error correction
CN111756603B (en) Control method and device of intelligent home system, electronic equipment and readable medium
WO2022268136A1 (en) Terminal device and server for voice control
CN112286116A (en) Intelligent home management system based on big data
CN115001890A (en) Intelligent household appliance control method and device based on response-free
CN115834271A (en) Server, intelligent device and intelligent device control method
CN114879527A (en) Intelligent household appliance control method and device based on intelligent grouping and skill matching
CN113703337B (en) Household appliance control method and system based on Internet of things and storage medium
CN113357754A (en) Method and device for displaying running state, storage medium and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20230908

Address after: 621050 No. 303 Jiuzhou Road, Fucheng District, Mianyang, Sichuan.

Patentee after: SICHUAN HONGMEI INTELLIGENT TECHNOLOGY Co.,Ltd.

Patentee after: Hefei Meiling Union Technology Co.,Ltd.

Address before: 621050 No. 303 Jiuzhou Road, Fucheng District, Mianyang, Sichuan.

Patentee before: SICHUAN HONGMEI INTELLIGENT TECHNOLOGY Co.,Ltd.