CN111654420A - Method and device for controlling household equipment, computer equipment and storage medium - Google Patents

Method and device for controlling household equipment, computer equipment and storage medium Download PDF

Info

Publication number
CN111654420A
CN111654420A CN202010418143.XA CN202010418143A CN111654420A CN 111654420 A CN111654420 A CN 111654420A CN 202010418143 A CN202010418143 A CN 202010418143A CN 111654420 A CN111654420 A CN 111654420A
Authority
CN
China
Prior art keywords
equipment
household
home
working mode
voice control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010418143.XA
Other languages
Chinese (zh)
Inventor
王彬
贾巨涛
宋德超
李�瑞
赵文静
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gree Electric Appliances Inc of Zhuhai
Zhuhai Lianyun Technology Co Ltd
Original Assignee
Gree Electric Appliances Inc of Zhuhai
Zhuhai Lianyun Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gree Electric Appliances Inc of Zhuhai, Zhuhai Lianyun Technology Co Ltd filed Critical Gree Electric Appliances Inc of Zhuhai
Priority to CN202010418143.XA priority Critical patent/CN111654420A/en
Publication of CN111654420A publication Critical patent/CN111654420A/en
Priority to PCT/CN2020/140005 priority patent/WO2021232797A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2816Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/282Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The application relates to the technical field of computers, and provides a method and a device for controlling household equipment, computer equipment and a storage medium, which are used for improving the efficiency of controlling the household equipment. The method comprises the following steps: obtaining a voice control instruction; the voice control instruction is used for indicating to start a working mode; determining first household equipment which is in an open state and has a time interval between a starting time and a current time smaller than or equal to a preset time length in an equipment information set, wherein the equipment information set comprises equipment information of at least one household equipment in the open state, and the equipment information comprises equipment starting time; determining that the first household equipment has a working mode corresponding to the voice control instruction according to the voice control instruction; and controlling the first household equipment to execute a working mode corresponding to the voice control instruction.

Description

Method and device for controlling household equipment, computer equipment and storage medium
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for controlling a home device, a computer device, and a storage medium.
Background
With the progress of science and technology, more and more household devices can be wirelessly controlled through the control device, and the control device can control the household devices by receiving voice control instructions input by a user. However, when the control device can control a plurality of home devices, the user needs to instruct the home device executing the voice control instruction to the control device, that is, the control device needs to receive an instruction for specifying the home device, and then the home device can be controlled, so that the control device is not efficient in controlling the home device.
Disclosure of Invention
The embodiment of the application provides a method and a device for controlling household equipment, computer equipment and a storage medium, which are used for improving the efficiency of controlling the household equipment.
In a first aspect, a method for controlling a home device is provided, the method including:
obtaining a voice control instruction; the voice control instruction is used for indicating to start a working mode;
determining first household equipment which is in an open state and has a time interval between a starting time and a current time smaller than or equal to a preset time length in an equipment information set, wherein the equipment information set comprises equipment information of at least one household equipment in the open state, and the equipment information comprises equipment starting time;
determining that the first household equipment has a working mode corresponding to the voice control instruction according to the voice control instruction;
and controlling the first household equipment to execute a working mode corresponding to the voice control instruction.
In the embodiment of the application, in the started home equipment, the time interval between the starting time and the current time is less than or equal to the preset time length of the first home equipment, and if the first home equipment has the working mode corresponding to the voice control instruction, the first home equipment is controlled to execute the working mode corresponding to the voice control instruction, that is, the equipment can determine the home equipment for executing the specified working mode under the condition that the user does not specify the home equipment, so that the efficiency of controlling the home equipment is improved. And when the user controls the household equipment, the household equipment does not need to be designated, and the household equipment can be controlled, so that the use experience of the user is improved. In addition, the home equipment executing the working mode in the embodiment of the application is the home equipment which is turned on recently, so that the situation that a certain home equipment runs for a long time is avoided, and the working time and the load of each home equipment can be balanced by the mode. In addition, a general user prefers the recently started device, and when the voice control instruction is executed, the voice control instruction is executed through the recently started device, that is, the recently started device belongs to the device preferred by the user, so that the user experience is favorably improved.
Optionally, the controlling the first home equipment to execute the working mode corresponding to the voice control instruction includes:
displaying a control confirmation interface; the control confirmation interface is used for prompting whether the first household equipment executes the working mode or not;
and responding to the confirmation operation of the user on the control confirmation interface, and controlling the first household equipment to execute the working mode corresponding to the voice control instruction.
In the embodiment of the application, after the first household device is determined, whether the first household device executes the working mode corresponding to the voice control instruction or not can be confirmed to the user, and after the user confirms that the first household device executes the working mode corresponding to the voice control instruction, the first household device is controlled, that is, the device executing the working mode can be confirmed by the user, so that the household device executing the specified working mode can better meet the user requirements, and the user experience is improved.
Optionally, the method further includes:
if the first household equipment is determined not to have the working mode corresponding to the voice control instruction, determining second household equipment which has the working mode and is in an opening state in the equipment information set;
and controlling the second household equipment to execute the working mode.
In the embodiment of the application, if the first household equipment does not have the working mode corresponding to the voice control instruction, the second household equipment with the working mode can be controlled to execute the working mode, the user can determine the second household equipment executing the working mode for the user in time without repeatedly issuing the instruction, the timeliness of determining the household equipment is improved, and the efficiency of controlling the household equipment is improved to a certain extent.
Optionally, in the device information set, determining a second home device having the working mode includes:
determining a plurality of candidate household devices with the working modes in a device information set;
and determining a second household device with the minimum time interval between the starting time and the current time in the plurality of candidate household devices.
In the embodiment of the application, in a plurality of candidate home devices with working modes, the home device recently started by a user can be used as the second home device for executing the working modes, and the use habit of the common home device is that the home device is directly controlled after being opened, so that compared with the mode of randomly selecting the home device or selecting the home device according to the distance, in the embodiment of the application, the second home device determined according to the starting time of the home device better meets the user requirement, and the determined home device has higher accuracy.
Optionally, the method further includes:
when first household equipment is started, acquiring equipment information of the first household equipment, and writing the equipment information of the first household equipment into an equipment information set;
and when the first household equipment is closed, deleting the equipment information of the first household equipment in the equipment information set, or updating the opening state of the first household equipment in the equipment information set to be a closed state.
In the embodiment of the application, the household equipment in the starting state is updated and written into the equipment information set in real time, and when the household equipment is in the closing state, the household equipment can be deleted in the equipment information set in time, or the state of the household equipment is updated, so that when the household equipment executing the working mode is determined, the household equipment which can be inquired in the equipment information set is the household equipment which can normally run, the condition that the determined household equipment is abnormal and the household equipment cannot execute the specified working mode is avoided, the condition that the voice control instruction of a user cannot respond is reduced, and the use experience of the user is improved.
Optionally, when the first home device is started, acquiring the device information of the first home device, and before writing the device information of the first home device into the device information set, the method includes:
receiving a starting instruction for first household equipment, or receiving a connection request of the first household equipment, or receiving equipment information of the first household equipment, which is sent by the first household equipment, and then determining that the first household equipment is started.
In the embodiment of the application, the home equipment can be determined to be in the open state through various methods, so that the situation that the home equipment is not detected to be in the open state due to factors such as abnormal communication data transmission is reduced, the accuracy of detecting whether the home equipment is in the open state is improved, and the timeliness of determining that the home equipment is in the open state is improved.
Optionally, the device information set further includes priorities of the home devices, where the priority of the home device refers to a priority of the control device for selecting a home device from the multiple home devices to execute a working mode; and the number of the first and second groups,
in the device information set, determining a first household device with a time interval between a starting time and a current time less than or equal to a preset time length, includes:
in the equipment information set, determining a plurality of target household equipment with priorities meeting preset priority conditions;
and determining the first household equipment with the minimum time interval between the starting time and the current time in the plurality of target household equipment.
In the embodiment of the application, if the device information set further includes the priority of each piece of home equipment, when determining the home equipment executing the designated working mode, the plurality of target home equipment may be determined according to the priority, and then the first home equipment is determined according to the starting time of the home equipment, that is, in the home equipment with high control frequency, a newly started home equipment is determined, so that the determined first home equipment is the home equipment frequently used by the user, and the accuracy of the determined first home equipment is improved to a certain extent.
Optionally, determining that the first home device has the working mode corresponding to the voice control instruction according to the voice control instruction includes:
converting the voice control instruction into a text;
extracting key words in the text;
and obtaining a working mode corresponding to the voice control instruction according to the keyword.
In the embodiment of the application, the working mode corresponding to the voice control instruction can be determined by analyzing the voice control instruction of the user, and compared with a mode that the user manually inputs the control instruction, the mode for obtaining the designated working mode is more intelligent, and the user can obtain the control instruction of the user by performing manual operation, so that the user is not limited by the position of the user in the process of obtaining the designated working mode, and the use experience of the user is improved.
In a second aspect, an apparatus for controlling a household device is provided, including:
a transceiver module: the voice control instruction is obtained; the voice control instruction is used for indicating to start a working mode; controlling the first household equipment to execute a working mode corresponding to the voice control instruction;
a processing module: the first household equipment is used for determining that a time interval between starting time and current time is less than or equal to preset duration in an equipment information set, wherein the equipment information set comprises equipment information of at least one household equipment in an opening state, and the equipment information comprises equipment starting time; and determining that the first household equipment has a working mode corresponding to the voice control instruction according to the voice control instruction.
Optionally, the apparatus further comprises a display module, wherein:
the display module: the control confirmation interface is used for displaying; the control confirmation interface is used for prompting whether the first household equipment executes the working mode or not;
the processing module is specifically configured to: and responding to the confirmation operation of the user on the control confirmation interface, and controlling the first household equipment to execute the working mode corresponding to the voice control instruction.
Optionally, the processing module is further configured to: if the first home equipment is determined not to have the working mode corresponding to the voice control instruction, determining second home equipment having the working mode in the equipment information set; and controlling the second household equipment to execute the working mode.
Optionally, the processing module is specifically configured to: determining a plurality of candidate household devices with the working modes in a device information set; and determining a second household device with the minimum time interval between the starting time and the current time in the plurality of candidate household devices.
Optionally, the transceiver module is further configured to: when first household equipment is started, acquiring equipment information of the first household equipment;
the processing module is further configured to: and writing the equipment information of the first household equipment into an equipment information set.
Optionally, the transceiver module is further configured to: when first household equipment is started, acquiring equipment information of the first household equipment, and receiving a starting instruction for the first household equipment, or receiving a connection request of the first household equipment, or receiving the equipment information of the first household equipment, which is sent by the first household equipment, before writing the equipment information of the first household equipment into an equipment information set;
the processing module is further configured to: and determining the starting of the first household equipment.
Optionally, the device information set further includes priorities of the home devices, where the priority of the home device refers to a priority of the control device for selecting a home device from the multiple home devices to execute a working mode, and the processing module is specifically configured to:
in the equipment information set, determining a plurality of target household equipment with priorities meeting preset priority conditions; and determining a first household device with the minimum time interval between the starting time and the current time in the plurality of target household devices.
Optionally, the processing module is specifically configured to:
converting the voice control instruction into a text; extracting key words in the text; and obtaining a working mode corresponding to the voice control instruction according to the keyword.
In a third aspect, a computer device is provided, comprising:
a memory for storing program instructions;
a processor for calling the program instructions stored in the memory and executing the method of any of the first aspect according to the obtained program instructions.
In a fourth aspect, there is provided a computer-readable storage medium having stored thereon computer-executable instructions for causing a computer to perform the method of any of the first aspects.
Drawings
Fig. 1 is an application scenario of a method for controlling home devices according to an embodiment of the present application;
fig. 2 is an interaction schematic diagram of a method for controlling home equipment according to an embodiment of the present application;
fig. 3 is a first flowchart illustrating a method for controlling home equipment according to an embodiment of the present application;
fig. 4 is a flowchart illustrating a second method for controlling home devices according to an embodiment of the present application;
fig. 5 is a third schematic flowchart of a method for controlling home equipment according to an embodiment of the present application;
fig. 6 is a fourth schematic flowchart of a method for controlling home equipment according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an apparatus for controlling home devices according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
In addition, in the embodiments of the present application, "at least one" means one or more, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone, wherein A and B can be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" or similar expressions refer to any combination of these items, including any combination of the singular or plural items. For example, at least one (one) of a, b, or c, may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or multiple.
In order to improve the efficiency of controlling the household equipment, the application provides a method for controlling the household equipment. The following describes an application scenario related to the method.
Referring to fig. 1, an application scenario of the method for controlling a home device is shown. The application scene includes a control device 101, a first home device 102, a second home device 103, and a third home device 104. The control device 101 may be in communication with the first household device 102, the second household device 103, and the third household device 104. The communication mode between the devices may be wired communication or wireless communication, for example, wired communication is performed by connecting a network cable or a data cable; the wireless communication is, for example, communication via bluetooth or a wireless lan, and the like, and is not particularly limited.
The control device 101 generally refers to a device that can control the home device to execute a corresponding working mode, such as a voice control device or a terminal device, or may be a client in the terminal device, and the like, and is not limited in particular. Terminal devices such as mobile phones, desktop computers or tablet computers, etc. The client in the terminal device is, for example, an application installed in the terminal device, a web page accessible by the terminal device, or a third-party platform accessible by the terminal device, such as a voice assistant in the terminal device. Home appliances generally refer to devices that can be controlled by the control device 101, such as air conditioners, electric heaters, smart kitchen devices, or electric fans.
It should be noted that, in the embodiment of the present application, the first home equipment 102, the second home equipment 103, and the third home equipment 104 are taken as examples for description, and in an actual application scenario, the number of the home equipment may be arbitrary, and is not particularly limited. In the embodiment of the present application, the control device 101 is taken as an example for description, and in an actual application scenario, the number of the control devices may be multiple, and is not limited specifically. When the number of the control equipment is multiple, the control equipment can communicate with each other, and each control equipment can control the household equipment.
The following illustrates the interaction between devices:
the control device 101 may obtain device information of each home device in the on state, and establish a device information set.
When a user wants to control the home devices, a voice control instruction may be sent to the control device 101, or the voice control instruction may be forwarded to the control device 101 through a terminal device or the like, and after receiving the voice control instruction, the control device 101 determines the first home device 102 whose time interval between the start time and the current time in the device information set is less than or equal to a preset time length. The control device 101 determines whether the first household device 102 can execute the working mode corresponding to the voice control instruction. If the first home equipment 102 can execute the working mode, the control equipment 101 controls the first home equipment 102 to execute the working mode.
In the embodiment of the application, the control device 101 does not need to receive the instruction for specifying the home equipment executing the working mode, and can determine the home equipment executing the working mode, so that the interaction process of the instruction is reduced, and the efficiency of controlling the home equipment by the control device 101 is improved. Moreover, the control device 101 can determine that one household device executes the working mode, and the user does not need to designate the household device executing the working mode when designating the working mode at each time, so that the intelligence degree of the control device 101 is improved, and the use experience of the user is improved.
Based on the application scenario in fig. 1, a method for controlling home devices in the embodiment of the present application is described below.
Please refer to fig. 2, which is a schematic diagram of an interaction process among the control device 101, the first home device 102, the second home device 103, and the third home device 104 according to the embodiment of the present application.
S201, the control device 101 writes the obtained device information into a device information set.
When the control device 101 determines that the home device is in the on state, the control device 101 may obtain the device information of the home device in the on state, and write the device information of the home device in the on state into the device information set.
The method for the control device 101 to determine that the home device is in the on state may be that the control device 101 determines that the home device is powered on, or may be that the home device and the control device 101 have established a communication connection, or may be that the home device is operating in a certain operating mode, or the like.
The device information of the home device may include the starting time of the home device, and may further include one or more of information such as a unique identifier of the home device, a location of the home device, a priority of the home device, or all operating modes of the home device. The unique identifier may be represented by one or more of information such as a name of the home device or a model of the home device.
The location of the home device refers to a current location of the home device, and may be, for example, a name of a room where the home device is located, or may be a relative location of the home device with respect to a reference location, where the relative location is, for example, a relative distance and/or a relative angle.
As an embodiment, the control device 101 may determine, according to a start time of the home device, a function mode, and a location of the home device, the home device that executes a working mode corresponding to the voice control instruction. For example, the voice control command is "heating in the living room at 26 ℃", and the control device 101 may control the home devices located in the living room to execute the working mode corresponding to the voice control command according to the locations of the home devices.
Further, when the position of the home device is specifically a relative angle of the home device with respect to the user, the control device 101 determines a home device and the like whose relative angle with respect to the user satisfies the angle condition from the plurality of home devices whose starting time and function mode satisfy the condition. The angle condition may be, for example, that the relative angle is minimum or that the relative angle is maximum. For example, the control device 101 may determine the angle condition based on health information of the user. For example, the recent health state of the user is good, the control device 101 may determine that the angle condition is the minimum relative angle, otherwise, the recent health state of the user is poor, and the control device 101 may determine that the angle condition is the maximum relative angle, so as to avoid that the home equipment is over against the user and causes adverse effects on the user.
The priority of the home devices refers to a priority of the plurality of home devices selected by the control device 101 to execute the operation mode. The priority may be determined according to the control frequency of the home devices, for example, the control frequency of the home devices is controlled, and the higher the control frequency is, the higher the priority of the home devices is. Or, the priority may be determined according to the conformity degree between the usage environment of the home equipment and the current external environment, for example, the more the usage environment of the home equipment conforms to the current environment, the higher the priority of the home equipment is; or, the priority may be determined according to the preference degree of the user for the home devices, for example, the higher the preference degree of the user is, the higher the priority of the home devices is, and the like.
The use environment of the household equipment refers to an environment in which the household equipment is frequently used. The current external environment refers to the external environment where the household equipment is currently located. For example, the usage environment of the electric heater is winter, and then when the current environment is in winter, the priority of the electric heater is higher.
The user's preference for the home equipment may be set in the control device 101 by the user; or the number of times that the user opens each home device in the current time period may be determined, for example, the more the user opens each home device in the current time period, the higher the preference degree, and the like.
The working modes of the household equipment may include one-stage or multi-stage working modes, and each stage of working modes has a parent-child relationship, for example, the one-stage working mode may be understood as a parent working mode, the one-stage working mode may include a plurality of two-stage working modes, and the two-stage working mode may be understood as a child working mode. If the working mode of the household equipment comprises a secondary working mode, when the primary working mode is appointed, a preset secondary working mode in a plurality of secondary working modes can be executed under the appointed primary working mode.
For example, the primary operation mode of the air conditioner may include a refrigeration mode, an air purification mode, and the like, and the refrigeration mode of the air conditioner includes a plurality of secondary operation modes, such as a plurality of secondary operation modes, including a plurality of operation modes, such as a plurality of operation modes, including a; the air purification mode comprises a plurality of two-stage working modes such as top-speed purification and standard purification. When the cooling mode is designated, the air conditioner may be operated at the default 26 ℃ in the cooling mode.
The device information set may be stored in a table structure, a tree structure or a knowledge graph structure, and the specific storage form is not limited. The device information set may be stored in the control device 101, or may be stored in a third-party database accessible by the control device 101, or may be stored in a cloud database accessible by the control device 101, and the like, and the specific storage location is not limited.
The following description takes a table-structured device information set as an example, please refer to table 1, which is a storage form of the device information set.
TABLE 1
Figure BDA0002495800740000111
The step S201 is illustrated by taking the first home device 102, the second home device 103, and the third home device 104 as an example.
S2.1, the control device 101 determines that the first household device 102 is in an open state, obtains device information of the first household device 102, and writes the device information of the first household device 102 into a device information set.
Please refer to fig. 3, which is a flowchart illustrating a process of writing the device information of the first home device 102.
S301, the control device 101 determines that the first home device 102 is in an on state.
There are various methods for the control device 101 to determine that the first household device 102 is in the on state, and three of them are taken as examples and described below.
The first determination method comprises the following steps:
if the control device 101 receives a start instruction for the first home device 102, it determines that the first home device 102 is started.
Specifically, when the user needs to open the first home device 102, the user may send an open instruction for the first home device 102 to the control device 101. The opening instruction can be understood as adjusting the household equipment from the closed state to the open state. The start instruction received by the control device 101 may be a voice start instruction sent by the user to the control device 101, or may be a manual operation instruction performed by the user on the control device 101, or may be a start instruction generated by the terminal device according to the operation by the user operating the terminal device, and the start instruction is sent to the control device 101, and the like, which is not limited specifically.
After receiving a turn-on instruction for the first home device 102 from the user, the control device 101 generates instruction information for controlling the turn-on of the first home device 102. The control device 101 sends instruction information to the first home device 102, and the first home device 102 enters an open state after receiving the instruction information sent by the control device 101. Therefore, after the control device 101 receives an on instruction for the first home device 102 from the user, it may be determined that the first home device 102 is in the on state.
It should be noted that the start instruction for the first home device 102 received by the control device 101 from the user is different from the voice control instruction received by the control device 101, where the start instruction is used to instruct the first home device 102 to enter the start state, and the entering of the first home device 102 into the start state does not indicate that the home device is in the working mode, that is, the home device may not work in the start state. And the voice control instruction is used for appointing a working mode so that the household equipment can operate in the appointed working mode.
Taking the example that the opening instruction is an instruction sent by the user through voice, for example, the user may say "open the air conditioner" when the user needs to open the air conditioner. The control apparatus 101 obtains an "air conditioner on" instruction from a user, and generates instruction information for controlling the air conditioner on. The control apparatus 101 transmits instruction information to the air conditioner, and the air conditioner receives the instruction information from the control apparatus 101. And the air conditioner enters a standby state according to the instruction information. After the control device 101 obtains the "turn on air conditioner" instruction from the user, it may be determined that the air conditioner is in the on state.
And a second determination method comprises the following steps:
the control device 101 determines that the first home device 102 is activated if it receives the connection request of the first home device 102.
Specifically, after being turned on, the first home device 102 may establish a communication connection with the control device 101, so that the control device 101 may control the first home device 102, and the first home device 102 may transmit information to the control device 101.
The first home device 102 transmits a connection request for establishing a communication connection to the control device 101 after being turned on. The control device 101 receives the connection request sent by the first home device 102, and establishes a communication connection with the first home device 102 according to the received connection request. Therefore, after the control device 101 receives the connection request sent by the first household device 102, it may be determined that the first household device 102 is started.
The third determination method comprises the following steps:
if the control device 101 receives the device information of the first home device 102 sent by the first home device 102, it is determined that the first home device 102 is started.
Specifically, after the first household device 102 is powered on, or after the first household device is in communication connection with the control device 101, the power-on time or the communication connection time with the control device 101 may be determined as the household device start time of the first household device 102, and the household device start time may be written into the storage device of the first household device 102. After the first home device 102 is powered on or after the communication connection with the control device 101 is established, the first home device 102 acquires its own device information. After obtaining the device information of the first home device 102, the first home device 102 may send the device information of the first home device 102 to the control device 101.
The control device 101 may determine the household device starting time of the first household device 102 according to the received device information of the first household device 102. Therefore, when the control device 101 receives the device information of the first home device 102 sent by the first home device 102, it may be determined that the first home device 102 is started.
S302, the control device 101 writes the device information of the first household device 102 into the device information set.
The method for determining that the home equipment is in the on state according to the control equipment 101 is different, and the method for the control equipment 101 to obtain the equipment information of the home equipment is also different. After obtaining the device information of each home device, the control device 101 may write the device information of the home device into the device information set.
Two methods for the control device 101 to obtain the device information of the home device are described below as an example.
The first method comprises the following steps:
if the control device 101 determines that the first home device 102 is activated, it requests the first home device 102 for device information of the first home device 102.
Specifically, after determining that the first home device 102 is started, the control device 101 may send a request instruction for requesting device information of the first home device 102 to the first home device 102. The first home equipment 102 receives the request instruction sent by the control equipment 101, and acquires the equipment information of the first home equipment 102 according to the request instruction. The first household equipment 102 sends the equipment information of the first household equipment 102 to the control equipment 101, and the control equipment 101 receives the equipment information of the first household equipment 102 sent by the first household equipment 102. The control device 101 may be periodic, aperiodic, or only send the request instruction to the first household device 102 when determining that the first household device 102 is started, and the like, and is not limited in particular.
As an embodiment, according to both the first determining method and the second determining method for determining the start of the first home device 102 described above, the first obtaining method may be used to obtain the device information of the first home device 102, or update the device information of the first home device 102 in the device information set.
The third determining method for determining the start of the first home device 102 may adopt the first obtaining method, and update the device information of the first home device 102 in the device information set.
And the second method comprises the following steps:
the control device 101 receives the device information of the first home device 102 sent by the first home device 102.
Specifically, after being turned on, the first home device 102 may send the device information of the first home device 102 to the control device 101. The control device 101 receives the device information of the first home device 102 sent by the first home device 102. The first household device 102 may send the device information of the first household device 102 to the control device 101 periodically, aperiodically, or only when being turned on, and the like, and is not limited in particular.
The first determining method, the second determining method, and the third determining method for determining the start of the first home device 102 may all adopt the second obtaining method to obtain the device information of the first home device 102, or update the device information of the first home device 102 in the device information set.
In a possible embodiment, if the control device 101 determines that the first household device 102 is in the off state, the control device 101 may delete the device information of the first household device 102 in the device information set.
Specifically, if the control device 101 determines that the communication connection with the first household device 102 is disconnected, the control device 101 determines that the first household device 102 is in a closed state; or, the control device 101 sends a request instruction to the first household device 102 periodically or aperiodically, if the device information of the first household device 102 fed back by the first household device 102 is not received within a preset time period, the control device 101 determines that the first household device 102 is in a closed state, and so on, and the manner that the control device 101 determines that the household device is in the closed state is not limited.
After the control device 101 determines that the home devices are in the closed state, the control device 101 determines the device information of the first home device 102 in the device information set, and deletes the device information of the first home device 102, so that the home devices in the device information set are all kept as home devices in the open state.
In a possible embodiment, if the control device 101 determines that the first household device 102 is in the off state, the control device 101 may update the device information of the first household device 102 in the device information set.
Specifically, the device information of the first household device 102 may further include state information of the first household device 102, such as an on state and an off state. For example, when the control device 101 determines that the first household device 102 is in an on state, the control device 101 updates the state information in the device information of the first household device 102 to "on"; when the control device 101 determines that the first home device 102 is in the off state, the control device 101 updates the state information in the device information of the first home device 102 to "off".
The method for determining that the first home device 102 is in the closed state by the control device 101 may refer to the content of the method for obtaining that the home device is in the open state, which is not described herein again. After the control device 101 determines that the home devices are in the off state, the control device 101 updates the state information in the device information of the first home device 102. Therefore, the control device 101 can accurately determine the home devices in the on state according to the state information in the device information set.
S2.2, the control device 101 determines that the second household device 103 is in an open state, obtains the device information of the second household device 103, and writes the device information of the second household device 103 into a device information set.
The method for determining that the second home device 103 is in the on state by the control device 101 may refer to the method for determining that the first home device 102 is in the on state in step S2.1, which is not described herein again. The way in which the control device 101 writes the device information of the second home device 103 may refer to the way in which the device information of the first home device 102 is written in step S2.1, and is not described herein again.
S2.3, the control device 101 determines that the third household device 104 is in an open state, obtains device information of the third household device 104, and writes the device information of the third household device 104 into a device information set.
The method for determining that the third home device 104 is in the on state by the control device 101 may refer to the method for determining that the first home device 102 is in the on state in step S2.1, which is not described herein again. The way in which the control device 101 writes the device information of the third home device 104 may refer to the way in which the device information of the first home device 102 is written in step S2.1, and is not described herein again.
As an example, S2.1, S2.2 and S2.3 may perform only one or two of the steps, without specific limitation.
It should be noted that the execution order of S2.1, S2.2 and S2.3 may be arbitrary and is not particularly limited.
S202, the control device 101 obtains a voice control instruction.
When the user needs to control the household equipment, the user can send out a voice control instruction. The control apparatus 101 receives a voice control instruction from a user.
S203, the control device 101 determines the working mode corresponding to the voice control instruction.
After the control device 101 obtains the voice control command, it may recognize the voice control command and determine the working mode corresponding to the voice control command. Referring to fig. 4, a flowchart of determining a working mode corresponding to the voice control command for the control device 101 is shown.
The following describes a process in which the control apparatus 101 determines an operation mode corresponding to a voice control instruction.
S401, the control apparatus 101 converts the voice control instruction into a text.
Specifically, after the control device 101 obtains the voice control command, the voice control command may be preprocessed, for example, the voice control command is input into a high-pass filter to increase the high frequency portion of the voice control command, so as to compensate the high frequency portion of the voice control command that is suppressed by the user pronunciation manner.
After the control device 101 obtains the pre-processed voice control instruction, the control device 101 may perform framing processing on the pre-processed voice control instruction to obtain a plurality of voice frames. Each speech frame may include N sampling points for sampling speech control instructions. The length of each speech frame may be a preset length, or may be a length determined according to the size of N, the length of the speech control instruction, the sampling frequency, and the like.
After the control device 101 obtains the plurality of speech frames, a mel-scale frequency cepstral coefficients (MFCCs) may be determined for each of the plurality of speech frames, and the MFCC coefficients may be used to characterize the speech control instructions. The control device 101 determines a feature matrix for the speech control instructions based on the MFCC coefficients for each speech frame.
The control device 101 combines each voice frame in the multiple voice frames according to the obtained feature matrix of the voice control instruction, and obtains a text, i.e., multiple words, corresponding to each combined voice frame, so that the control device 101 obtains the text corresponding to the voice control instruction and a word set corresponding to the text, and completes the conversion of the text by the voice control instruction.
S402, the control device 101 extracts keywords in the text.
There are various methods for extracting the keywords in the text by the control device 101, and two of them are described below as examples.
The first extraction method comprises the following steps:
the control device 101 determines the importance degree of each word in the text based on the statistical characteristics of each word in the text, and determines a word whose importance degree satisfies a preset importance degree requirement as a keyword.
Specifically, the statistical characteristic of each word in the text may be determined according to one or more of the number of times each word in the text appears in the word set, specifically, the word frequency (TF), or the weight of each word in the text. The following description will take as an example the determination of the statistical properties of words according to word frequency and weight.
After the control device 101 obtains the text corresponding to the voice control instruction and the word set corresponding to the text, the control device 101 may determine the number of times that different words in the word set appear in the word set, and obtain each word TF in the word set. The control apparatus 101 determines a weight of each term in the term set according to a pre-stored term Inverse Document Frequency (IDF) list. The IDF of a word represents the degree of commonness of the word, with the greater the IDF of a word, the less the weight of the word.
For example, words such as "is", "is" or "is" are common words in a text, and then the IDF of these words is larger, so that the weight of the words is smaller; the words such as "heating", "cooling" or "air purification" are the words that are less common in a text, and the IDF of these words is smaller, and the weight of the words is larger.
The control apparatus 101 multiplies the TD of each word in the word set by the weight to obtain the degree of importance of each word. The control apparatus 101 compares the importance degree of each word with a preset threshold value, and obtains words whose importance degree is greater than the preset threshold value. The control apparatus 101 determines words having a degree of importance greater than a preset threshold as keywords. When a plurality of words with the importance degree greater than the preset threshold value exist, the control device 101 determines a plurality of keywords;
alternatively, the control device 101 compares the importance degrees of every two words in the word set to obtain the importance degree ranking of each word in the word set. The control apparatus 101 determines words that are ranked before a preset serial number as keywords. The number of the keywords may be one or more, for example, when the preset serial number is 1, if one word is determined by the control device 101 to be arranged before the preset serial number, then one keyword is determined by the control device 101; when the preset serial number is not 1, the control device 101 determines that a plurality of words are arranged before the preset serial number, and then the control device 101 determines that a plurality of keywords are present.
The second extraction method comprises the following steps:
the control device 101 determines the score of each word in the text based on a word graph model constructed from each word in the text, and determines a word whose score meets a preset score requirement as a keyword.
Specifically, the word graph model is composed of a plurality of nodes and edges between the nodes, and the edges of the word graph model include coefficients such as weights. The scores of the nodes of the word graph model can be determined according to the coefficients of the edges of the word graph model connected with the nodes of the word graph model.
The control device 101 establishes a node of a word graph model by each word in the word set, establishes an edge of the word graph model by a co-occurrence relationship between words, and the control device 101 obtains the word graph model corresponding to the text. The co-occurrence relationship between the words represents the relationship that two words appear in each text at the same time, and the weight of the edge in the word graph model is determined according to the number of times that the two words appear at the same time. The control apparatus 101 determines a score for each word based on the co-occurrence relationship between the words associated with each word.
The co-occurrence relationship between the words may be obtained in advance according to a usage scenario of the word graph model, for example, in a scenario of controlling the home device, the control device 101 may obtain a large amount of control instruction texts for the home device through network resources, and determine the number of times that every two words in each text occur at the same time, that is, the co-occurrence relationship between the words; alternatively, the control device 101 may directly obtain, through the network resource, a co-occurrence relationship between words related to a scene that controls the home device, and the like. Thus, the control apparatus 101 can determine the weight of the edge between two words according to the co-occurrence relationship between the words.
For example, the text is "please heat 26 degrees celsius", and the word set includes three words of "please heat", "heat", and "26 degrees celsius". The control device 101 establishes nodes of a word graph model according to three words of 'please', 'heat production' and '26 degrees centigrade'. The control apparatus 101 determines the weights of "please" and "heat" and the weights of "please" and "26 degrees celsius" and the weights of "heat" and "26 degrees celsius" according to the co-occurrence relationship between words, and establishes edges between words. The number of times "please" and "heat" occur simultaneously, and the number of times "please" and "26 degrees celsius" occur simultaneously, is relatively small compared to the number of times "heat" and "26 degrees celsius" occur simultaneously, and thus is weighted less. Accordingly, the score of "please" determined by the control device 101 is small, and the scores of "heat" and "26 degrees celsius" are high.
The control device 101 determines a word whose score satisfies a preset score requirement as a keyword. The method for the control device 101 to determine that the score meets the preset score requirement is the same as the method for the control device 101 to determine that the importance degree meets the preset importance degree requirement in the first method, and details are not repeated here.
And S403, the control equipment 101 obtains a working mode corresponding to the voice control instruction according to the keyword.
After the control apparatus 101 obtains the keyword, the keyword may be input into the trained recognition model. The control device 101 may determine the working mode corresponding to the voice control instruction according to the output of the trained recognition model.
The trained recognition model may be a recognition model obtained by the control device 101 through training based on a sample training set, where the sample training set may be each sample keyword obtained through manual labeling, or may be each sample keyword obtained through automatic labeling by a labeling program, or may be each sample keyword obtained through direct downloading on a network resource, and so on.
Alternatively, the trained recognition model may be obtained from other devices or network resources, and is not limited in particular.
For example, the voice control instruction sent by the user is "please open the heating mode", the control device 101 converts the voice control instruction into a text "please open the heating mode", and obtains words "please", "open", and "heating mode" corresponding to the text. The control device 101 obtains a word set containing each word. The control apparatus 101 determines the keywords in the word set as "on" and "heating mode". The control apparatus 101 inputs the keywords "on" and "heating mode" into the trained recognition model. The trained recognition model recognizes the keyword, and the intention of outputting the voice control instruction is to operate in a heating mode. The control device 101 determines the working mode corresponding to the voice control instruction to be the heating mode according to the output of the trained recognition model.
And S204, the control device 101 determines, in the device information set, the first home devices 102 which are in an open state and have a time interval between the starting time and the current time smaller than or equal to a preset time length.
As an embodiment, if the device information set includes both the device information of the home device in the on state and the device information of the home device in the off state, the device information of the home device should include the state information. The control device 101 may determine, in the device information set, a plurality of home devices to be determined whose state information indicates an on state. After obtaining the plurality of home devices to be determined, the control device 101 may determine, from the plurality of home devices to be determined, a first home device 102 whose time interval between the starting time and the current time is less than or equal to a preset time length.
As an example, if the device information set only includes the device information of the home devices in the on state, the control device 101 may determine, in the device information set, the first home device 102 whose time interval between the starting time and the current time is less than or equal to the preset time length.
After the control device 101 obtains the voice control instruction, a time interval between the starting time and the current time may be determined according to the starting time of each home device in the device information set. After the control device 101 obtains the time interval between the starting time and the current time of each home device, the first home device 102 with the time interval less than or equal to the preset time length is determined. In this embodiment, for example, a time interval between the starting time of the first household device 102 and the current time is less than or equal to a preset time length.
Referring to fig. 5, a flowchart of the first home equipment 102 for determining that a time interval between the starting time and the current time is less than or equal to a preset time duration for the control equipment 101 is shown. The following describes a process of the first household device 102 in which the control device 101 determines that the time interval between the starting time and the current time is less than or equal to the preset time.
S501, the control device 101 determines a plurality of target household devices in the device information set, wherein the priority of the target household devices meets a preset priority condition.
If the device information set includes the priority of each piece of home equipment, the control device 101 may determine, according to the priority of each piece of home equipment in the device information set, a plurality of target home equipment whose priority satisfies a preset priority condition.
The method for the control device 101 to determine that the priority satisfies the preset priority condition may be that the control device 101 determines that the priority is within a preset priority range, or may be that the control device 101 determines that the priority is greater than a preset priority threshold, and so on.
For example, with continued reference to table 1, if the voice control instruction issued by the user is "turn on the heating mode", the control apparatus 101 determines that the operation mode corresponding to the voice control instruction is "heating mode". If the preset priority condition is that the priority is greater than the preset priority threshold and the priority threshold is 1, the control device 101 determines the air conditioner and the air purifier in the device information set according to the priority of each household device.
S502, the control device 101 determines the first home device 102 with the minimum time interval between the starting time and the current time in the multiple target home devices.
After the control device 101 obtains the multiple target home devices, the control device 101 may determine a time interval between the starting time and the current time according to the starting time of each target home device in the multiple target home devices in the device information set. After obtaining the time interval corresponding to each target home device in the multiple target home devices, the control device 101 compares the time intervals to determine the first home device 102 with the smallest time interval, that is, the first home device 102 that is recently turned on by the user.
For example, with continued reference to table 1, if the voice control instruction issued by the user is "turn on the heating mode", the control apparatus 101 determines that the operation mode corresponding to the voice control instruction is "heating mode". After the control device 101 determines the air conditioner and the air purifier according to the priority of each household device, the control device 101 determines the time interval between the starting time of the air conditioner and the starting time of the air purifier and the current time according to the starting time. If the current time is 12:00, the control device 101 determines that the household device with the minimum time interval between the starting time and the current time is an air conditioner.
As an example, only one of the steps of S501 and S502 may be performed.
Specifically, the control device 101 may determine, directly in the device information set, the first home device 102 with the highest priority; alternatively, the control device 101 may determine, directly in the device information set, the first home device 102 with the smallest time interval between the starting time and the current time, and so on.
S205, the control device 101 determines whether the first household device 102 has a working mode corresponding to the voice control instruction.
After the control device 101 determines the first home devices 102, all the operating modes of the first home devices 102 may be determined according to the device information of the first home devices 102 in the device information set. The control device 101 determines whether the operating mode corresponding to the voice control instruction is included in all the operating modes of the first home device 102. If all the working modes of the first home equipment 102 include the working mode corresponding to the voice control instruction, the control equipment 101 determines that the first home equipment 102 has the working mode corresponding to the voice control instruction; if the working modes corresponding to the voice control instruction are not included in all the working modes possessed by the first home equipment 102, the control equipment 101 determines that the first home equipment 102 does not possess the working mode corresponding to the voice control instruction.
For example, please continue to refer to table 1, if the voice control instruction sent by the user is "turn on the heating mode", and the control device 101 determines that the working mode corresponding to the voice control instruction is "heating mode", then the control device 101 determines the air conditioner in the device information set according to the starting time of the home device. If the control equipment 101 determines that the working mode of the air conditioner comprises a heating mode according to the equipment information set, the air conditioner has the working mode corresponding to the voice control instruction; if the working mode of the air conditioner does not comprise the heating mode, the air conditioner does not have the working mode corresponding to the voice control instruction.
S206, if the first home device 102 has the working mode corresponding to the voice control instruction, the control device 101 controls the first home device 102 to execute the working mode corresponding to the voice control instruction.
If the control device 101 determines that the first home device 102 has the working mode corresponding to the voice control instruction, the control device 101 generates instruction information according to the working mode corresponding to the voice control instruction and the first home device 102. The instruction information is used for controlling the first home equipment 102 to execute a working mode corresponding to the voice control instruction. After generating the instruction information, the control device 101 transmits the instruction information to the first home devices 102. After receiving the instruction information, the first home device 102 executes the content indicated by the instruction information, that is, executes the working mode corresponding to the voice control instruction.
For example, with continued reference to table 1, if the voice control instruction issued by the user is "turn on the heating mode", the control apparatus 101 determines that the operation mode corresponding to the voice control instruction is "heating mode". If the control device 101 determines air conditioning according to the device information set. The control device 101 determines that the operation mode of the air conditioner includes the "heating mode" according to the device information set, and then the control device 101 generates instruction information for controlling the air conditioner to operate in the heating mode and transmits the instruction information to the air conditioner. The air conditioner operates in a heating mode after receiving the instruction information.
In one possible embodiment, if the control device 101 determines that the first home device 102 has the working mode corresponding to the voice control instruction, the control device 101 may display a control confirmation interface on a display interface of the control device 101, or the control device 101 may issue a voice control confirmation prompt, or the like, for confirming to the user whether the working mode corresponding to the voice control instruction is executed by the first home device 102.
If the user performs a confirmation operation on the display control interface of the control device 101, or the user sends a voice confirmation instruction, or the user does not operate the control device 101 within a preset time period, and so on, the control device 101 determines that the operation mode corresponding to the voice control instruction performed by the first household device 102 is responded to the confirmation operation of the user, that is, the control device 101 determines that the operation mode corresponds to the voice control instruction performed by the first household device 102.
If the user performs a cancel operation on the display control interface of the control device 101, or the user sends a voice cancel instruction, and the like, the control device 101 re-determines the home equipment that performs the working mode corresponding to the voice control instruction, or the control device 101 determines the home equipment that performs the working mode corresponding to the voice control instruction in response to a selection operation of the user, or the control device 101 ends the control process, and the like.
In a possible embodiment, after the control device 101 controls the first home device 102 to execute the working mode corresponding to the voice control instruction, the control device 101 may record the number of times of controlling the first home device 102; alternatively, the control apparatus 101 may record the usage habit of the user after responding to the confirmation operation of the user, and the like. The control times are times for controlling the household equipment to execute the working mode by the control equipment 101 under the voice control instruction.
The control device 101 may adjust the priority of each household device in the device information set according to the record. For example, according to the recorded number of times of controlling the first home device 102, if the number of times of controlling the first home device 102 reaches a preset number of times threshold within a preset time period, the value of the priority of the device information of the first home device 102 in the device information set is incremented by 1.
For another example, the usage habit of the user may be expressed as a correspondence between the number of times the user controls the first home device 102 and the environment when the user controls the first home device 102, then the control device 101 may determine the current environment, and adjust the priority of the device information of the first home device 102 in the device information set according to the current environment and the correspondence between the number of times the user controls the first home device 102 and the environment when the user controls the first home device 102, and if the number of times the user controls the air conditioner in the third quarter is greater than the preset number of times, then the control device 101 determines that the current time is in the third quarter, adjust the priority of the air conditioner in the device information set to the highest level; if the number of times of controlling the air conditioners by the user in the second quarter is less than the preset number of times, the control device 101 determines that the air conditioners in the device information set are currently in the second quarter, adjusts the priority of the air conditioners in the device information set to the lowest level, and so on.
S207, if the first home device 102 does not have the working mode corresponding to the voice control instruction, the control device 101 determines the second home device 103 that has the working mode corresponding to the voice control instruction and is in the on state.
If the control device 101 determines that the first home device 102 does not have the working mode corresponding to the voice control instruction, the control device 101 determines the second home device 103 which has the working mode corresponding to the voice control instruction and is in the on state according to the working mode of each home device in the device information set.
The method for determining the home device in the on state by the control device 101 may refer to the content described in step S204, and is not described herein again.
Referring to fig. 6, a flowchart of determining the second home device 103 having the working mode corresponding to the voice control instruction for the control device 101 is shown. The following describes a process in which the control device 101 determines the second home device 103 having the operation mode corresponding to the voice control instruction.
S601, the control device 101 determines a plurality of candidate home devices having the working modes corresponding to the voice control commands in the device information set.
The control device 101 determines all the operating modes of each household device except the first household device 102 in the device information set. The control device 101 determines whether the working mode corresponding to the voice control instruction is included in all the working modes of each household device. If the control device 101 determines that all the working modes of each piece of home equipment include the working mode corresponding to the voice control instruction, the control device 101 takes the home equipment of which the working mode includes the working mode corresponding to the voice control instruction as candidate home equipment; if the control device 101 determines that the working mode corresponding to the voice control instruction is not included in all the working modes of each piece of home equipment, the control device 101 determines that no home equipment having the working mode corresponding to the voice control instruction exists in the equipment information set.
For example, with continued reference to table 1, if the voice control command issued by the user is "turn on the air purification mode", the control apparatus 101 determines that the operation mode corresponding to the voice control command is "air purification mode". The control device 101 determines the air conditioner from the device information set. Since the air conditioner does not have the "air purification mode", the control device 101 determines all the operation modes of the other home devices except the air conditioner in the device information set, and determines whether the "air purification mode" is included in all the operation modes of the other home devices. The operation mode of the air purifier of the control device 101 includes "air purification mode", and then the control device 101 regards the air purifier as a candidate home device.
S602, the control device 101 determines the first home device 102 with the smallest time interval between the starting time and the current time in the multiple candidate home devices.
After the control device 101 obtains the multiple candidate home devices, the second home device 102 with the smallest time interval between the starting time and the current time may be determined in the multiple candidate home devices, and the specific determination manner may refer to the method for determining the first home device 102 in step S203, which is not described herein again.
And S208, the control device 101 controls the second household device 103 to execute the working mode corresponding to the voice control instruction.
After determining the second home device 103, the control device 101 may generate instruction information according to the working mode corresponding to the voice control instruction and the second home device 103. The instruction information is used for controlling the second home equipment 103 to execute the working mode corresponding to the voice control instruction. After generating the instruction information, the control device 101 transmits the instruction information to the second home devices 103. After receiving the instruction information, the second home equipment 103 executes the content indicated by the instruction information, that is, executes the working mode corresponding to the voice control instruction.
S209, if the control device 101 determines that there is no home device having the working mode corresponding to the voice control instruction in the device information set, it issues a prompt.
If the control device 101 determines that there is no home device having the working mode corresponding to the voice control instruction in the device information set, the control device 101 may send a prompt to prompt the user that there is no home device that can execute the working mode corresponding to the voice control instruction in the home devices currently in the on state.
The prompting mode of the control device 101 may be one or more of an audio prompting mode, a video prompting mode, or a light information prompting mode. The audio prompting mode is voice prompting or buzzer prompting. Video cues such as text cues. The light information presentation method outputs light information by means of blinking of a Light Emitting Diode (LED), color conversion, or the like.
As an example, steps S201, S204, and S206-S208 are optional.
Based on the same inventive concept, the embodiment of the present application provides a device for controlling a home device, which is equivalent to the control device 101 discussed above and can implement the corresponding function of the method for controlling a home device. Referring to fig. 7, the apparatus includes a transceiver module 701 and a processing module 702, wherein:
the transceiver module 701: the voice control instruction is obtained; the voice control instruction is used for indicating the starting of a working mode;
the processing module 702: the first household equipment is used for determining that the time interval between the starting time and the current time is less than or equal to the preset time length in the equipment information set; controlling the first household equipment to execute a working mode corresponding to the voice control instruction, wherein the equipment information set comprises equipment information of at least one household equipment in an opening state, and the equipment information comprises equipment starting time; and determining that the first household equipment has a working mode corresponding to the voice control instruction according to the voice control instruction.
In a possible embodiment, the apparatus further comprises a display module, wherein:
a display module: the control confirmation interface is used for displaying; the control confirmation interface is used for prompting whether the first household equipment executes the working mode or not;
the processing module 702 is specifically configured to: and responding to the confirmation operation of the user on the control confirmation interface, and controlling the first household equipment to execute the working mode corresponding to the voice control instruction.
In a possible embodiment, the processing module 702 is further configured to: if the first household equipment is determined not to have the working mode corresponding to the voice control instruction, determining second household equipment which has the working mode and is in an opening state in the equipment information set; and controlling the second household equipment to execute the working mode.
In a possible embodiment, the processing module 702 is specifically configured to: determining a plurality of candidate household devices with working modes in a device information set; and determining a second household device with the minimum time interval between the starting time and the current time in the plurality of candidate household devices.
In a possible embodiment, the transceiver module 701 is further configured to: when the first household equipment is started, acquiring equipment information of the first household equipment;
the processing module 702 is further configured to: writing the equipment information of the first household equipment into an equipment information set; and when the first household equipment is closed, deleting the equipment information of the first household equipment in the equipment information set, or updating the opening state of the first household equipment in the equipment information set to be the closing state.
In a possible embodiment, the transceiver module 701 is further configured to: when the first household equipment is started, acquiring equipment information of the first household equipment, and receiving a starting instruction for the first household equipment, or receiving a connection request of the first household equipment, or receiving the equipment information of the first household equipment, which is sent by the first household equipment, before writing the equipment information of the first household equipment into the equipment information set;
the processing module 702 is further configured to: and determining the starting of the first household equipment.
In a possible embodiment, the device information set further includes a priority of each household device, where the priority of a household device refers to a priority of the control device for selecting a household device to execute an operating mode from the plurality of household devices,
the processing module 702 is specifically configured to: in the equipment information set, determining a plurality of target household equipment with priorities meeting preset priority conditions; and determining a first household device with the minimum time interval between the starting time and the current time in the plurality of target household devices.
In a possible embodiment, the processing module 702 is specifically configured to: converting the voice control instruction into a text; extracting key words in the text; and obtaining a working mode corresponding to the voice control instruction according to the keyword.
Based on the same inventive concept, an embodiment of the present application provides a computer device, which can implement the functions corresponding to the foregoing method for controlling a home device, where the computer device is equivalent to the control device 101 discussed above, please refer to fig. 8, and the computer device includes:
at least one processor 801 and a memory 802 connected to the at least one processor 801, in this embodiment, a specific connection medium between the processor 801 and the memory 802 is not limited in this application, and fig. 8 illustrates an example in which the processor 801 and the memory 802 are connected by a bus 800. The bus 800 is shown in fig. 8 by a thick line, and the connection between other components is merely illustrative and not intended to be limiting. The bus 800 may be divided into an address bus, a data bus, a control bus, etc., and is shown in fig. 8 with only one thick line for ease of illustration, but does not represent only one bus or type of bus. Alternatively, the processor 801 may also be referred to as the controller 801, without limitation to name a few.
In the embodiment of the present application, the memory 802 stores instructions executable by the at least one processor 801, and the at least one processor 801 may execute the method for controlling the home device discussed above by executing the instructions stored in the memory 802. And, the processor 801 may implement the functions of each module in the apparatus for controlling home devices shown in fig. 7.
The processor 801 is a control center of the device, and various interfaces and lines can be used to connect various parts of the whole device, and various functions of the device and process data by executing or executing instructions stored in the memory 802 and calling data stored in the memory 802.
In one possible embodiment, the processor 801 may include one or more processing units, and the processor 801 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, and the like, and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 801. In some embodiments, the processor 801 and the memory 802 may be implemented on the same chip, or in some embodiments, they may be implemented separately on separate chips.
The processor 801 may be a general-purpose processor, such as a Central Processing Unit (CPU), a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof, configured to implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present application.
Memory 802, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. The Memory 802 may include at least one type of storage medium, and may include, for example, a flash Memory, a hard disk, a multimedia card, a card-type Memory, a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Programmable Read Only Memory (PROM), a Read Only Memory (ROM), a charged Erasable Programmable Read Only Memory (EEPROM), a magnetic Memory, a magnetic disk, an optical disk, and so on. The memory 802 is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited to such. The memory 802 in the embodiments of the present application may also be circuitry or any other device capable of performing a storage function for storing program instructions and/or data.
Based on the same inventive concept, embodiments of the present application further provide a computer-readable storage medium, which stores computer-executable instructions, and when the computer-executable instructions are executed on a computer, the computer is caused to execute the method for controlling a home device discussed above.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims (11)

1. A method for controlling household equipment is characterized by comprising the following steps:
obtaining a voice control instruction; the voice control instruction is used for indicating to start a working mode;
determining first household equipment which is in an open state and has a time interval between a starting time and a current time smaller than or equal to a preset time length in an equipment information set, wherein the equipment information set comprises equipment information of at least one household equipment in the open state, and the equipment information comprises equipment starting time;
determining that the first household equipment has a working mode corresponding to the voice control instruction according to the voice control instruction;
and controlling the first household equipment to execute a working mode corresponding to the voice control instruction.
2. The method according to claim 1, wherein controlling the first household device to execute the working mode corresponding to the voice control instruction comprises:
displaying a control confirmation interface; the control confirmation interface is used for prompting whether the first household equipment executes the working mode or not;
and responding to the confirmation operation of the user on the control confirmation interface, and controlling the first household equipment to execute the working mode corresponding to the voice control instruction.
3. The method of claim 1, further comprising:
if the first household equipment is determined not to have the working mode corresponding to the voice control instruction, determining second household equipment which has the working mode and is in an opening state in the equipment information set;
and controlling the second household equipment to execute the working mode.
4. The method according to claim 3, wherein determining a second home device with the working mode in the device information set comprises:
determining a plurality of candidate household devices with the working modes in a device information set;
and determining a second household device with the minimum time interval between the starting time and the current time in the plurality of candidate household devices.
5. The method of claim 1, further comprising:
when first household equipment is started, acquiring equipment information of the first household equipment, and writing the equipment information of the first household equipment into an equipment information set;
and when the first household equipment is closed, deleting the equipment information of the first household equipment in the equipment information set, or updating the opening state of the first household equipment in the equipment information set to be a closed state.
6. The method according to claim 5, wherein before acquiring the device information of the first home device and writing the device information of the first home device into the device information set when the first home device is started, the method comprises:
receiving a starting instruction for first household equipment, or receiving a connection request of the first household equipment, or receiving equipment information of the first household equipment, which is sent by the first household equipment, and then determining that the first household equipment is started.
7. The method according to claim 1, wherein the device information set further includes a priority of each household device, wherein the priority of a household device refers to a priority of a control device for selecting a household device from a plurality of household devices to execute a working mode; and the number of the first and second groups,
in the device information set, determining a first household device with a time interval between a starting time and a current time less than or equal to a preset time length, includes:
in the equipment information set, determining a plurality of target household equipment with priorities meeting preset priority conditions;
and determining the first household equipment with the minimum time interval between the starting time and the current time in the plurality of target household equipment.
8. The method according to claim 1, wherein determining that the first home device has the working mode corresponding to the voice control instruction according to the voice control instruction comprises:
converting the voice control instruction into a text;
extracting key words in the text;
and obtaining a working mode corresponding to the voice control instruction according to the keyword.
9. An apparatus for controlling home appliances, comprising:
a transceiver module: the voice control instruction is obtained; the voice control instruction is used for indicating to start a working mode;
a processing module: the first household equipment is used for determining that the time interval between the starting time and the current time is less than or equal to the preset time length in the equipment information set; controlling the first household equipment to execute a working mode corresponding to the voice control instruction; the equipment information set comprises equipment information of at least one piece of household equipment in an opening state, and the equipment information comprises equipment starting time; and determining that the first household equipment has a working mode corresponding to the voice control instruction according to the voice control instruction.
10. A computer device, comprising:
a memory for storing program instructions;
a processor for calling the program instructions stored in the memory and executing the method according to any one of claims 1 to 8 according to the obtained program instructions.
11. A computer-readable storage medium having stored thereon computer-executable instructions for causing a computer to perform the method of any one of claims 1-8.
CN202010418143.XA 2020-05-18 2020-05-18 Method and device for controlling household equipment, computer equipment and storage medium Pending CN111654420A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010418143.XA CN111654420A (en) 2020-05-18 2020-05-18 Method and device for controlling household equipment, computer equipment and storage medium
PCT/CN2020/140005 WO2021232797A1 (en) 2020-05-18 2020-12-28 Method and apparatus for controlling home device, and computer device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010418143.XA CN111654420A (en) 2020-05-18 2020-05-18 Method and device for controlling household equipment, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
CN111654420A true CN111654420A (en) 2020-09-11

Family

ID=72352294

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010418143.XA Pending CN111654420A (en) 2020-05-18 2020-05-18 Method and device for controlling household equipment, computer equipment and storage medium

Country Status (2)

Country Link
CN (1) CN111654420A (en)
WO (1) WO2021232797A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112151035A (en) * 2020-10-14 2020-12-29 珠海格力电器股份有限公司 Voice control method and device, electronic equipment and readable storage medium
WO2021232797A1 (en) * 2020-05-18 2021-11-25 珠海格力电器股份有限公司 Method and apparatus for controlling home device, and computer device and storage medium
CN115348122A (en) * 2021-05-13 2022-11-15 博泰车联网科技(上海)股份有限公司 Calendar interaction method and system, voice loudspeaker box and storage medium

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114020189B (en) * 2022-01-05 2022-04-19 浙江口碑网络技术有限公司 Easy-to-check mode starting method and device and electronic equipment
CN114859749B (en) * 2022-06-27 2023-03-10 忆月启函(盐城)科技有限公司 Intelligent home management method and system based on Internet of things
CN115134182B (en) * 2022-06-29 2023-07-07 歌尔科技有限公司 Voice control method and device of household equipment, wearable equipment and storage medium
CN116226816B (en) * 2023-05-10 2023-08-18 深圳由莱智能电子有限公司 Method for controlling working mode of dehairing instrument and related device

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140167931A1 (en) * 2012-12-18 2014-06-19 Samsung Electronics Co., Ltd. Method and apparatus for controlling a home device remotely in a home network system
CN104134339A (en) * 2014-08-08 2014-11-05 广东欧珀移动通信有限公司 Speech remote-control method and device
CN105204356A (en) * 2015-09-17 2015-12-30 小米科技有限责任公司 Application display method, device and terminal
CN105223826A (en) * 2015-09-29 2016-01-06 小米科技有限责任公司 Home equipment control method, Apparatus and system
CN105491114A (en) * 2015-11-25 2016-04-13 小米科技有限责任公司 Method, apparatus and system for switching controlled device
CN106201543A (en) * 2016-07-20 2016-12-07 青岛海信电器股份有限公司 The display packing of notification message and smart machine in smart machine
CN107248943A (en) * 2017-07-06 2017-10-13 海信集团有限公司 Apparatus control method and device
CN107894717A (en) * 2017-09-30 2018-04-10 珠海格力电器股份有限公司 Equipment control method and device, storage medium and terminal
CN108604448A (en) * 2015-11-06 2018-09-28 谷歌有限责任公司 Cross-device voice commands
CN108710305A (en) * 2018-05-24 2018-10-26 广东美的制冷设备有限公司 The control interface methods of exhibiting and device of household appliance
CN108873719A (en) * 2018-07-25 2018-11-23 珠海格力电器股份有限公司 Control method and device of intelligent household equipment, main control equipment and intelligent door system
CN110286601A (en) * 2019-07-01 2019-09-27 珠海格力电器股份有限公司 Method and device for controlling intelligent household equipment, control equipment and storage medium
CN110647044A (en) * 2019-09-09 2020-01-03 珠海格力电器股份有限公司 Household appliance control method and device, electronic device and readable storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105137789A (en) * 2015-08-28 2015-12-09 青岛海尔科技有限公司 Control method and device of intelligent IoT electrical appliances, and related devices
KR20190117055A (en) * 2018-04-06 2019-10-16 내셔널라이팅(주) Voice control system based on body sensing
CN111654420A (en) * 2020-05-18 2020-09-11 珠海格力电器股份有限公司 Method and device for controlling household equipment, computer equipment and storage medium

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140167931A1 (en) * 2012-12-18 2014-06-19 Samsung Electronics Co., Ltd. Method and apparatus for controlling a home device remotely in a home network system
CN104134339A (en) * 2014-08-08 2014-11-05 广东欧珀移动通信有限公司 Speech remote-control method and device
CN105204356A (en) * 2015-09-17 2015-12-30 小米科技有限责任公司 Application display method, device and terminal
CN105223826A (en) * 2015-09-29 2016-01-06 小米科技有限责任公司 Home equipment control method, Apparatus and system
CN108604448A (en) * 2015-11-06 2018-09-28 谷歌有限责任公司 Cross-device voice commands
CN105491114A (en) * 2015-11-25 2016-04-13 小米科技有限责任公司 Method, apparatus and system for switching controlled device
CN106201543A (en) * 2016-07-20 2016-12-07 青岛海信电器股份有限公司 The display packing of notification message and smart machine in smart machine
CN107248943A (en) * 2017-07-06 2017-10-13 海信集团有限公司 Apparatus control method and device
CN107894717A (en) * 2017-09-30 2018-04-10 珠海格力电器股份有限公司 Equipment control method and device, storage medium and terminal
CN108710305A (en) * 2018-05-24 2018-10-26 广东美的制冷设备有限公司 The control interface methods of exhibiting and device of household appliance
CN108873719A (en) * 2018-07-25 2018-11-23 珠海格力电器股份有限公司 Control method and device of intelligent household equipment, main control equipment and intelligent door system
CN110286601A (en) * 2019-07-01 2019-09-27 珠海格力电器股份有限公司 Method and device for controlling intelligent household equipment, control equipment and storage medium
CN110647044A (en) * 2019-09-09 2020-01-03 珠海格力电器股份有限公司 Household appliance control method and device, electronic device and readable storage medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021232797A1 (en) * 2020-05-18 2021-11-25 珠海格力电器股份有限公司 Method and apparatus for controlling home device, and computer device and storage medium
CN112151035A (en) * 2020-10-14 2020-12-29 珠海格力电器股份有限公司 Voice control method and device, electronic equipment and readable storage medium
CN112151035B (en) * 2020-10-14 2023-08-11 珠海格力电器股份有限公司 Voice control method and device, electronic equipment and readable storage medium
CN115348122A (en) * 2021-05-13 2022-11-15 博泰车联网科技(上海)股份有限公司 Calendar interaction method and system, voice loudspeaker box and storage medium

Also Published As

Publication number Publication date
WO2021232797A1 (en) 2021-11-25
WO2021232797A9 (en) 2021-12-30

Similar Documents

Publication Publication Date Title
CN111654420A (en) Method and device for controlling household equipment, computer equipment and storage medium
WO2021000791A1 (en) Method and apparatus for controlling smart home appliance, control device and storage medium
CN107895574B (en) Processing voice commands based on device topology
US10185534B2 (en) Control method, controller, and recording medium
US9825773B2 (en) Device control by speech commands with microphone and camera to acquire line-of-sight information
WO2019101083A1 (en) Voice data processing method, voice-based interactive device, and storage medium
JP2018190413A (en) Method and system for processing user command to adjust and provide operation of device and content provision range by grasping presentation method of user speech
JP2019519009A (en) Business customization device, method, system and storage medium based on data source
KR20160132748A (en) Electronic apparatus and the controlling method thereof
WO2020228030A1 (en) Device recommendation method and apparatus, electronic device, and storage medium
CN111367188A (en) Smart home control method and device, electronic equipment and computer storage medium
CN111965985A (en) Intelligent household equipment control method and device, electronic equipment and storage medium
US20230385377A1 (en) Device, method, and computer program for performing actions on iot devices
CN107742520A (en) Sound control method, apparatus and system
CN117499457B (en) Method and system for cloud management of intelligent equipment
US11930230B2 (en) Hub device, multi-device system including the hub device and plurality of devices, and operating method of the hub device and multi-device system
WO2023221357A1 (en) Device control method and related apparatus
CN107222383B (en) Conversation management method and system
KR20210001905A (en) Electronic apparatus and control method thereof
KR102487078B1 (en) The hub device, multi device system comprising the hub device and a plurality of devices and method operating the same
CN111883126A (en) Data processing mode selection method and device and electronic equipment
GB2567067A (en) Processing voice commands based on device topology
CN114822529A (en) Method and device for voice control of air conditioner, air conditioner and storage medium
CN110967976A (en) Control method and device of intelligent home system
CN114117023A (en) Interaction method, interaction device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200911

RJ01 Rejection of invention patent application after publication