CN110085233B - Voice control method and device, electronic equipment and computer readable storage medium - Google Patents
Voice control method and device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN110085233B CN110085233B CN201910279446.5A CN201910279446A CN110085233B CN 110085233 B CN110085233 B CN 110085233B CN 201910279446 A CN201910279446 A CN 201910279446A CN 110085233 B CN110085233 B CN 110085233B
- Authority
- CN
- China
- Prior art keywords
- voice
- information
- equipment
- sound source
- acquisition equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000004891 communication Methods 0.000 description 12
- 238000005057 refrigeration Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 4
- 230000006698 induction Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/18—Methods or devices for transmitting, conducting or directing sound
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/021—Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Automation & Control Theory (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a voice control method, which comprises the following steps: determining a target voice acquisition device closest to a sound source according to the distance information between each of the plurality of voice acquisition devices and the sound source; controlling the target voice acquisition equipment to continue to acquire voice information; and responding to the voice information acquired by the target voice acquisition equipment. The invention also discloses a voice control device, electronic equipment and a computer readable storage medium. The invention realizes that the user can carry out voice control at any position, has convenient operation, ensures the accuracy of the voice control by taking the equipment closest to the position of the user as a control inlet, and realizes real full-house intelligent control.
Description
Technical Field
The present invention relates to the field of home control technologies, and in particular, to a voice control method and apparatus, an electronic device, and a computer-readable storage medium.
Background
Nowadays, intelligent control technology is more and more mature, especially intelligent voice control, and the intelligent voice control has been widely applied to intelligent control of household equipment. Aiming at the increasing number of intelligent electronic equipment in the existing families, the existing voice control method has one-to-one control, namely, household equipment with a microphone is used as a voice control inlet of the household equipment, and collected voice information can only control the household equipment; or an intelligent household appliance voice control system is formed, a fixed household appliance with a microphone is selected as a voice control inlet, and a user can control other household appliances in the intelligent household appliance system through the voice control inlet, so that the user can control the household appliance without going to the position of the household appliance.
However, the existing control methods have at least the following technical problems:
the user must go to appointed place and input voice command and just can control intelligent electronic equipment, and the operation is not convenient, has not realized real full house intelligent control yet.
Disclosure of Invention
The embodiment of the application provides a voice control method and device, electronic equipment and a computer readable storage medium, and solves the technical problems that operation is not convenient and fast in a voice control system of an intelligent household appliance, and whole-house intelligent control cannot be really realized.
The embodiment of the application provides a voice control method, which comprises the following steps:
determining a target voice acquisition device closest to a sound source according to the distance information between each of the plurality of voice acquisition devices and the sound source;
controlling the target voice acquisition equipment to continue to acquire voice information;
and responding to the voice information acquired by the target voice acquisition equipment.
Preferably, after determining the target voice collecting device closest to the sound source, the method further comprises:
and controlling other voice acquisition equipment except the target voice acquisition equipment in the plurality of voice acquisition equipment to continuously determine the distance information between each voice acquisition equipment and the sound source.
Preferably, after continuing the step of determining distance information between each and the sound source, the voice control method further includes:
and when the voice acquisition equipment closest to the sound source is determined to be other voice acquisition equipment except the target voice acquisition equipment, updating the other voice acquisition equipment into the target voice acquisition equipment.
Preferably, the voice control method further includes:
after receiving the distance information between each voice acquisition equipment and the sound source uploaded by the plurality of voice acquisition equipment, executing the step of determining the target voice acquisition equipment closest to the sound source according to the distance information between each voice acquisition equipment and the sound source, wherein the distance information is determined according to the awakening words when the voice acquisition equipment receives the awakening words.
Preferably, the step of determining a target voice collecting device closest to the sound source according to the distance information between each of the plurality of voice collecting devices and the sound source includes:
acquiring awakening state information, and determining equipment in an awakening state according to the awakening state information, wherein the awakening state information is sent by voice acquisition equipment when the voice acquisition equipment receives an awakening word;
and determining the target voice acquisition equipment closest to the sound source according to the distance information uploaded by the equipment in the awakening state.
Preferably, the step of responding to the voice information collected by the target voice collecting device comprises:
analyzing the voice information acquired by the target voice acquisition equipment, and determining controlled equipment corresponding to the voice information;
and sending the voice information to the controlled equipment so that the controlled equipment can respond to the voice information.
Preferably, the step of responding to the voice information collected by the target voice collecting device comprises:
acquiring a control instruction corresponding to the voice information; analyzing the voice information acquired by the target voice acquisition equipment, and determining a control instruction and controlled equipment corresponding to the voice information;
and sending the control instruction to the controlled equipment.
In order to achieve the above object, the present invention further provides a voice control method, including:
when the equipment collects voice information of a user, determining distance information between the equipment and a sound source according to the voice information, and sending the distance information to a voice control device, wherein the equipment comprises a plurality of microphones which form a microphone array;
and sending the collected voice information to the voice control device.
Preferably, when the device collects the voice information of the user, the step of determining the distance information between the device and the sound source of the sound source according to the voice information and sending the distance information to the voice control device includes:
when the collected voice information comprises a wake-up word, determining distance information between the equipment and a sound source according to the wake-up word;
and sending the distance information to the voice control device.
Preferably, after the step of sending the distance information to the voice control apparatus, the voice control method further includes:
and when the collected voice information comprises voice control information, executing the step of sending the collected voice information to the voice control device.
The invention also provides a voice control device, which comprises a memory, a processor and a program which is stored on the memory and can be run on the processor, wherein the processor realizes the steps of the voice control method when executing the program.
The invention also provides an electronic device, which comprises a memory, a processor and a program stored on the memory and capable of running on the processor, wherein the processor realizes the steps of the voice control method when executing the program.
Furthermore, the present invention also provides a computer-readable storage medium having a program stored thereon, which when executed by a processor implements the steps of the voice control method described above.
One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:
in the embodiment, a target voice collecting device closest to a sound source is determined according to the distance information between each of the plurality of voice collecting devices and the sound source; controlling the target voice acquisition equipment to continue to acquire voice information; the response the speech information that target pronunciation collection equipment gathered, when realizing that a plurality of equipment gather speech information, only one pronunciation entry is as control entry, and this control entry is nearest apart from user's position, arranges a plurality of equipment collection speech information in the family like this, and the user can all carry out speech control in optional position, and the simple operation, and regard as control entry with the equipment nearest apart from user's position, guarantee speech control's accuracy, realize real intelligent control in whole room.
Drawings
FIG. 1 is a schematic diagram of an apparatus in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating a first embodiment of a voice control method according to the present invention;
FIG. 3 is a flowchart illustrating a second embodiment of a speech control method according to the present invention;
FIG. 4 is a schematic flow chart of a step S10 in the third embodiment of the speech control method according to the present invention;
FIG. 5 is a flowchart illustrating a further detailed step S30 in the fourth embodiment of the speech control method according to the present invention;
fig. 6 is a flowchart illustrating a voice control method according to a fifth embodiment of the present invention.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: determining a target voice acquisition device closest to a sound source according to the distance information between each of the plurality of voice acquisition devices and the sound source; controlling the target voice acquisition equipment to continue to acquire voice information; and responding to the voice information acquired by the target voice acquisition equipment.
As shown in fig. 1, fig. 1 is a schematic device structure diagram of a hardware operating environment according to an embodiment of the present invention.
The device of the embodiment of the invention can be electronic equipment, a server, a PC and the like, wherein the electronic equipment can be household appliances such as an air conditioner, a dehumidifier, a refrigerator, an induction cooker and the like.
As shown in fig. 1, the apparatus may include: a controller 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the controller 1001 described above.
Those skilled in the art will appreciate that the configuration of the device shown in fig. 1 is not intended to be limiting of the device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a voice control program.
In the server shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the controller 1001 may be configured to call the voice control program stored in the memory 1005 and perform the following operations:
determining a target voice acquisition device closest to a sound source according to the distance information between each of the plurality of voice acquisition devices and the sound source;
controlling the target voice acquisition equipment to continue to acquire voice information;
responding the voice information collected by the target voice collecting equipment
Further, the controller 1001 may call the voice control program stored in the memory 1005, and also perform the following operations:
and controlling other voice acquisition equipment except the target voice acquisition equipment in the plurality of voice acquisition equipment to continuously determine the distance information between each voice acquisition equipment and the sound source.
Further, the controller 1001 may call the voice control program stored in the memory 1005, and also perform the following operations:
and when the voice acquisition equipment closest to the sound source is determined to be other voice acquisition equipment except the target voice acquisition equipment, updating the other voice acquisition equipment into the target voice acquisition equipment.
Further, the controller 1001 may call the voice control program stored in the memory 1005, and also perform the following operations:
after receiving the distance information between each voice acquisition equipment and the sound source uploaded by the plurality of voice acquisition equipment, executing the step of determining the target voice acquisition equipment closest to the sound source according to the distance information between each voice acquisition equipment and the sound source, wherein the distance information is determined according to the awakening words when the voice acquisition equipment receives the awakening words.
Further, the controller 1001 may call the voice control program stored in the memory 1005, and also perform the following operations:
acquiring awakening state information, and determining equipment in an awakening state according to the awakening state information, wherein the awakening state information is sent by voice acquisition equipment when the voice acquisition equipment receives an awakening word;
and determining the target voice acquisition equipment closest to the sound source according to the distance information uploaded by the equipment in the awakening state.
Further, the controller 1001 may call the voice control program stored in the memory 1005, and also perform the following operations:
analyzing the voice information acquired by the target voice acquisition equipment, and determining controlled equipment corresponding to the voice information;
and sending the voice information to the controlled equipment so that the controlled equipment can respond to the voice information.
Further, the controller 1001 may call the voice control program stored in the memory 1005, and also perform the following operations:
acquiring a control instruction corresponding to the voice information; analyzing the voice information acquired by the target voice acquisition equipment, and determining a control instruction and controlled equipment corresponding to the voice information;
and sending the control instruction to the controlled equipment.
Further, the controller 1001 may call the voice control program stored in the memory 1005, and also perform the following operations:
when the equipment collects voice information of a user, determining distance information between the equipment and a sound source according to the voice information, and sending the distance information to a voice control device, wherein the equipment comprises a plurality of microphones which form a microphone array;
and sending the collected voice information to the voice control device.
Further, the controller 1001 may call the voice control program stored in the memory 1005, and also perform the following operations:
when the collected voice information comprises a wake-up word, determining distance information between the equipment and a sound source according to the wake-up word;
and sending the distance information to the voice control device.
Further, the controller 1001 may call the voice control program stored in the memory 1005, and also perform the following operations:
and when the collected voice information comprises voice control information, executing the step of sending the collected voice information to the voice control device.
In addition, the embodiment of the invention relates to electronic equipment, such as an air conditioner, a washing machine, a water heater, an induction cooker, a refrigerator and the like. The apparatus may specifically include: a controller, e.g. a CPU, a network interface, a user interface, a memory, a communication bus. Wherein the communication bus is used for realizing connection communication among the components. The user interface may comprise a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface may also comprise a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory may alternatively be a storage device separate from the aforementioned controller 1001.
Each equipment is provided with a plurality of microphones which are sequentially arranged to form a microphone array for acquiring the voice information of the action space of the equipment, wherein the voice information acquired based on the microphone array is used for carrying out sound source positioning and determining the angle position information of a user, and the accuracy of the user angle information acquired by the positioning mode is high.
It is understood that the device is connected to the server via a wireless or local area network, and data transmission between the device and the server is possible. If the device can upload the collected voice information or the distance information between the device and the sound source to the server, the server can also issue the voice information or the control instruction corresponding to the voice information to the corresponding controlled device.
Referring to fig. 2, the present invention provides a first embodiment of a voice control method, specifically, the voice control method includes the following steps:
step S10, determining a target voice collecting device closest to the sound source according to the distance information between each of the plurality of voice collecting devices and the sound source;
step S20, controlling the target voice collecting equipment to continue collecting voice information;
and step S30, responding to the voice information collected by the target voice collecting equipment.
The execution main body of the embodiment may be a server, a PC, an electronic device, or the like, where the server may be a cloud server, or may be a local server. If the execution main body is a server, the server is in communication connection with each electronic device in a family through a local area network or wirelessly, wherein the electronic device has a voice acquisition function, namely the electronic device is the voice acquisition device. The server receives the distance information, the server can determine the voice acquisition equipment closest to the sound source according to the distance information, the determined voice acquisition equipment closest to the sound source is used as target voice acquisition equipment, namely, the target voice acquisition equipment is used as a main control input interface in the voice control process, and the server only responds to the voice information acquired through the main control input interface. And the server determines the target voice acquisition equipment closest to the sound source by comparing the distance information between the voice acquisition equipment and the sound source.
If the execution main body is an electronic device, the electronic device is in communication connection with other electronic devices, wherein the electronic device has a voice acquisition function, that is, the electronic device is the voice acquisition device. After the voice information is collected by each voice collecting device, the distance information between each voice collecting device and the sound source is determined according to the collected voice information, the distance information between each voice collecting device and the sound source is further sent to the electronic device, after the electronic device receives the distance information between each other electronic device and the sound source, the voice collecting device closest to the sound source is determined according to each distance information, and then the determined voice collecting device closest to the sound source is used as the target voice collecting device.
The sound source is sent by the user, the target voice collecting device closest to the sound source is the target voice collecting device closest to the user, the device closest to the user is used as the target voice collecting device, collected voice information is guaranteed to be more accurate, and collected noise is prevented from being used as voice control information. Wherein the distance information includes a distance value between the device and a sound source, and may further include an angle value between the device and the sound source.
Further, the manner of triggering the voice collecting device to send the distance information between each voice collecting device and the sound source at least includes the following two manners:
a first step of: the program runs on the server: after receiving the distance information between each voice acquisition equipment and the sound source uploaded by the plurality of voice acquisition equipment, determining the target voice acquisition equipment closest to the sound source according to the distance information between each voice acquisition equipment and the sound source, wherein the distance information is determined according to the awakening words when the voice acquisition equipment receives the awakening words.
Specifically, before voice control, a user sends a wakeup word to the device, when receiving the wakeup word, the voice acquisition device uploads distance information between the voice acquisition device and a sound source, which is determined according to the wakeup word, and at this time, the voice acquisition device is in a wakened state. Based on that the awakening word is also a voice message, the voice acquisition equipment can determine the position of a sound source according to the voice message, further obtain the distance information between the equipment and the sound source, and send the distance information determined based on the awakening word to a server. And the server determines the target voice acquisition equipment closest to the sound source according to the distance information so as to take the target voice acquisition equipment as a main control input interface.
It can be understood that the wake-up word is a preset voice for the voice acquisition device to recognize the voice control, for example, the wake-up word of the voice acquisition device system is set to be a, after the user sends out the wake-up word a, the voice acquisition device can recognize that the user is about to perform the voice control, and at this time, the voice acquisition device is in a wake-up state.
The method comprises the steps that when a user performs voice control, voice information is sent to equipment, at the moment, a target voice acquisition device acquires the voice information and uploads the voice information to a server, and the server only responds to the voice information uploaded by the target voice acquisition device after receiving the voice information uploaded by the target voice acquisition device.
In this embodiment, a user wakes up a voice acquisition device by a wake-up word, and meanwhile, the voice acquisition device acquires distance information between the voice acquisition device and a sound source of the user by the wake-up word and uploads the distance information to a server, so that the server determines a target voice acquisition device closest to the sound source according to the distance information between each of the voice acquisition devices and the sound source, and after the target voice acquisition device is determined, when the user sends a voice control instruction to the voice acquisition device, the voice information acquired by the target voice acquisition device is uploaded to the server and responded by the server. Based on the fact that the target voice acquisition equipment is determined, the server can be set to interact with the voice acquisition equipment, and after the target voice acquisition equipment is determined, a master control command is sent to the target voice acquisition equipment, so that only the target voice acquisition equipment executes voice information acquisition operation; or all the voice acquisition equipment can acquire voice information and upload the voice information to the server, and the server only responds to the voice information acquired by the target voice acquisition equipment.
It can be understood that the interval duration between the wakeup word and the voice message is less than or equal to the preset duration, and if the device receives the wakeup word and does not receive the voice message within the preset duration, the device enters a sleep state, and the voice message can be collected only after the device needs to be awakened again, and at this time, the target voice collecting device needs to be determined again.
II): the program runs on the server: the method comprises the steps that before voice control is carried out by a user, a wake-up word is sent to voice collection equipment, the voice collection equipment is in a wake-up state after receiving the wake-up word, when the user carries out voice control, voice information is sent to the voice collection equipment, after the voice collection equipment receives the voice information, the distance information between the voice collection equipment and a sound source is determined according to the voice information, the distance information and the corresponding voice information are uploaded to a server at the moment, when the server receives the distance information and the voice information between the voice collection equipment and the sound source uploaded by the voice collection equipment, the target voice collection equipment closest to the sound source is determined according to the distance information between the voice collection equipment and the sound source, and after the target voice collection equipment is determined, only corresponding voice information is set in response to the target voice collection.
According to the embodiment, the distance information between the voice acquisition equipment and the sound source is determined through the voice information which is sent by the user and is actually used for control, the distance information is uploaded to the server, the server determines the target voice acquisition equipment which is closest to the sound source according to the distance information, and responds according to the voice information corresponding to the target voice acquisition equipment, so that the target voice acquisition equipment determined by the server is ensured to be the equipment which is closest to the actual distance of the user, the user is prevented from moving the position after sending the awakening word, and the target voice acquisition equipment is not necessarily the voice acquisition equipment which is closest to the sound source.
It can be understood that the voice acquisition equipment determines the distance information between the equipment and the sound source according to the voice information or the awakening words in a microphone array sound source positioning mode, based on the microphone array sound source positioning, noise can be effectively filtered, non-voice control instructions can be effectively distinguished, and the positioning accuracy is higher.
In the embodiment, a target voice collecting device closest to a sound source is determined according to the distance information between each of the plurality of voice collecting devices and the sound source; controlling the target voice acquisition equipment to continue to acquire voice information; the response the speech information that target pronunciation collection equipment gathered, when realizing that a plurality of equipment gather speech information, only one pronunciation entry is as control entry, and this control entry is nearest apart from user's position, arranges a plurality of equipment collection speech information in the family like this, and the user can all carry out speech control in optional position, and the simple operation, and regard as control entry with the equipment nearest apart from user's position, guarantee speech control's accuracy, realize real intelligent control in whole room.
Referring to fig. 3, a second embodiment of the voice control method provided by the present invention, which is based on the first embodiment, after determining the target voice collecting device closest to the sound source, the method further includes:
and step S40, controlling other voice collecting devices except the target voice collecting device among the plurality of voice collecting devices, and continuing to determine distance information between each voice collecting device and the sound source.
In this embodiment, in order to prevent the distance information between the target voice collecting device and the user from changing when the user moves, when the target voice collecting device is continuously used to collect the user voice control information, the accuracy of the obtained voice control information is not high, so after the target voice collecting device is determined, other voice collecting devices except the target voice collecting device in the plurality of voice collecting devices are controlled to continuously collect the voice information of the user, and the distance information between each voice collecting device and the sound source is continuously determined.
Further, after continuing the step of determining distance information between each and the sound source, the voice control method further includes:
and step S50, when the voice collecting device closest to the sound source is determined to be other voice collecting devices except the target voice collecting device, updating the other voice collecting devices to the target voice collecting device.
In the process that the plurality of voice collecting devices continue to collect the voice information of the user and continue to determine the distance information between each voice collecting device and the sound source, since the user may move at any time, after the movement, the distance between the target voice collecting device and the sound source changes, and similarly, the distances between the other voice collecting devices except the target voice collecting device and the sound source also change. Comparing the distance information acquired by each voice acquisition device in real time or at regular time, when determining that the voice acquisition device closest to the sound source is other voice acquisition devices except the target voice acquisition device, showing that the distance between the voice acquisition device and other voice acquisition devices is closer after the user moves, at the moment, updating the other voice acquisition devices to be the target voice acquisition device, taking the other voice acquisition devices as a master control inlet, controlling the other voice acquisition devices to continuously acquire voice information, and responding to the voice information acquired by the other voice acquisition devices.
This embodiment is after confirming the nearest target pronunciation collection equipment of distance with the sound source, control in a plurality of pronunciation collection equipment except other pronunciation collection equipment of target pronunciation collection equipment, continue confirm separately with distance information between the sound source, be convenient for when distance information between a plurality of pronunciation collection equipment and the sound source changes, in time change the master control entry that is used for gathering user's speech information, improve speech control's accuracy.
Referring to fig. 4, a third embodiment of the voice control method provided by the present invention, which is based on the first and/or second embodiments, wherein the step of determining the target voice collecting device closest to the sound source according to the distance information between each of the plurality of voice collecting devices and the sound source includes:
step S11, acquiring awakening state information, and determining equipment in an awakening state according to the awakening state information, wherein the awakening state information is sent out by voice acquisition equipment when the voice acquisition equipment receives an awakening word;
and step S12, determining the target voice acquisition equipment closest to the sound source according to the distance information uploaded by the equipment in the awakening state.
When the voice acquisition equipment receives the awakening words sent by the user, the voice acquisition equipment sends out own awakening state information for other electronic equipment in the local area network to obtain. Specifically, the wake-up state information may be sent to a target device corresponding to the preset address according to the preset address, or may be broadcasted to a local area network in a broadcast manner, so that a server or other electronic devices in the local area network capture the wake-up state information. When acquiring the awakening state information, determining the voice acquisition equipment in the awakening state according to the awakening state information, wherein the awakening state information comprises an awakening identifier and an equipment identifier, determining the corresponding voice acquisition equipment according to the equipment identifier, and determining the voice acquisition equipment in the awakened state according to the awakening identifier.
After the voice acquisition equipment in the awakening state is determined, the target voice acquisition equipment closest to the sound source is determined according to the distance information between each of the plurality of voice acquisition equipment and the sound source, which is sent by the voice acquisition equipment in the awakening state. Since each voice collecting device in a home is in communication connection or is connected with a server, each voice collecting device can send the distance information to the voice collecting device or to the server, for the distance information sent by the voice collecting device which is not wakened up, the distance information between the voice collecting device and a sound source which is not determined according to the voice information of a user may exist, such as noise existing indoors, the distance information between the voice collecting device and the sound source which is determined according to the noise by the voice collecting device which is not wakened up is invalid information, and the distance information cannot be used as the position information of the sound source controlled by voice, the target voice collecting device which is closest to the sound source is determined according to the distance information between the voice collecting device and the sound source which is sent by the voice collecting device in a wakening up state, and the analyzed distance information between the voice collecting device and the sound source is ensured to be used for controlling according to the voice information sent by the user The determined distance information improves the judgment accuracy of the target voice acquisition equipment, and meanwhile, the noise acquired by other equipment is reduced and analyzed by the server or the electronic equipment, so that the accuracy of voice control is improved.
Referring to fig. 5, a fourth embodiment of the voice control method provided by the present invention is based on the first, second, and third embodiments, and the step of responding to the voice information acquired by the target voice acquisition device includes:
step S31, analyzing the voice information collected by the target voice collecting device, and determining the controlled device corresponding to the voice information;
step S32, sending the voice message to the controlled device, so that the controlled device can respond to the voice message.
The voice information comprises identification parameters of controlled equipment and controlled parameters of the controlled equipment, after the voice information of the target voice acquisition equipment is obtained, the voice information is analyzed to obtain the identification parameters, the corresponding controlled equipment is determined according to the identification parameters, if the voice information comprises ' bedroom air conditioner, refrigeration starting and 20 ℃, the ' bedroom air conditioner ' is the identification parameters of the controlled equipment, and when the voice information is analyzed, the identification parameters of the bedroom air conditioner are extracted, and the bedroom air conditioner is determined to be the controlled equipment. After the controlled equipment is determined, the voice information is sent to the controlled equipment, the controlled equipment receives the voice information, recognizes and analyzes the voice information, and then responds to the controlled parameters in the voice information, if the voice information is sent to a bedroom air conditioner, the bedroom air conditioner recognizes and respectively recognizes the voice information, extracts the controlled parameters 'start refrigeration and 20 ℃' in the voice information, starts refrigeration by the bedroom air conditioner, and operates according to the operating parameters corresponding to the target temperature of 20 ℃, so that the intelligent voice control of the whole house is realized.
It can be understood that, in the above embodiment, the voice information is sent to the controlled device, the controlled device performs analysis and recognition on the voice information, and then the voice information is responded according to the analysis and recognition result.
In another embodiment, in order to simplify the program control of the controlled device, the controlled device may directly respond to the control instruction, and the step of responding to the voice information collected by the target voice collecting device as described includes:
acquiring a control instruction corresponding to the voice information; analyzing the voice information acquired by the target voice acquisition equipment, and determining a control instruction and controlled equipment corresponding to the voice information;
and sending the control instruction to the controlled equipment.
When receiving voice information sent by target voice acquisition equipment, analyzing the voice information, extracting identification parameters and controlled parameters in the voice information, determining controlled equipment according to the identification parameters, converting the controlled parameters into control instructions of the controlled parameters, and further sending the control instructions to the controlled equipment, so that the controlled equipment directly executes commands corresponding to the control instructions after receiving the control instructions. If the voice information comprises 'bedroom air conditioner, refrigeration starting and 20 ℃, the' bedroom air conditioner 'is a recognition parameter, and' refrigeration starting and 20 ℃ are controlled parameters, the server converts the controlled parameters into a 20 ℃ refrigeration instruction and sends the 20 ℃ refrigeration instruction to the bedroom air conditioner, and the bedroom air conditioner is directly started and operated after receiving the 20 ℃ refrigeration instruction.
Referring to fig. 6, a fifth embodiment of the voice control method provided in the present invention is implemented in an electronic device, where the electronic device has a voice collecting function, and therefore the electronic device terminal is also a voice collecting device, and specifically the voice control method in this embodiment includes the following steps:
step S60, when the device collects the voice information of the user, the device determines the distance information between the device and the sound source of the sound source according to the voice information, and sends the distance information to the voice control device, wherein the device comprises a plurality of microphones which form a microphone array;
and step S70, sending the collected voice information to the voice control device.
The equipment is electronic equipment and can comprise one or more of an air conditioner, a refrigerator, a microwave oven and the like. The equipment is used for acquiring voice information and specifically comprises a plurality of microphones, and the plurality of microphones form a microphone array. The device collects voice information through a microphone array, a plurality of microphones simultaneously acquire a plurality of voice information, a sound source positioning method is carried out based on the microphone array positioning method, and after the device preprocesses, down-samples and filters the plurality of voice information, the device calculates in Fourier transform and other modes to obtain information such as angles and distances of sound sources. After the equipment calculates the distance information between the equipment and the sound source, the distance information is sent to a voice control device, wherein the voice control device comprises electronic equipment or a server, and the voice control device determines the target voice acquisition equipment closest to the sound source according to the distance information between the equipment and the sound source, and then the target voice acquisition equipment sends the acquired voice information to the voice control device.
Based on microphone array carries out sound localization, the distance information that acquires between equipment and the sound source is for confirming the sound position according to information such as sound intensity, and this embodiment positioning mode can filter the noise, and the speech information of user that can more accurate discernment, and then realizes more accurate location.
In addition, the equipment determines the distance information between each equipment and the sound source according to the sound sent by the user, wherein the specific sound can be the voice information for controlling the electronic equipment by the user, for example, after the user sends the controlled voice information, the equipment directly determines the distance information between the equipment and the sound source according to the voice information; or the sound may also be a wake-up word for a user to wake up a voice collecting device, that is, when the voice collecting device collects voice information of the user, the step of determining distance information between the device of the sound source and the sound source according to the voice information and sending the distance information to the voice control device includes:
when the collected voice information comprises a wake-up word, determining distance information between the equipment and a sound source according to the wake-up word;
and sending the distance information to the voice control device.
It can be understood that the wake-up word is a preset voice for the voice acquisition device to recognize the voice control, for example, the wake-up word of the voice acquisition device system is set to be a, after the user sends out the wake-up word a, the voice acquisition device can recognize that the user is about to perform the voice control, and at this time, the voice acquisition device is in a wake-up state.
Further, after the step of sending the distance information to the voice control apparatus, the voice control method further includes:
and when the collected voice information comprises voice control information, executing the step of sending the collected voice information to the voice control device.
Namely, after the equipment determines the distance information between the equipment and the sound source through the awakening words, the distance information is sent to the voice control device, and the voice control device determines the target voice acquisition equipment closest to the sound source according to the distance information. After a user sends out a wake-up word, voice information for control is sent to the awakened equipment, and after the awakened equipment receives the voice information, the voice information is directly sent to a voice control device so that the voice control device can respond to the voice information; or after the target voice acquisition equipment is determined, when the user sends voice information for control, the awakened target voice acquisition equipment is controlled to acquire the voice information, and then the voice information is sent to the voice control device.
The device of the embodiment acquires voice information of a user, determines distance information between the device and a sound source according to the voice information, and sends the distance information to a voice control device, wherein the device comprises a plurality of microphones which form a microphone array; and sending the collected voice information to enable the voice control device to respond according to the voice information corresponding to the target voice collection equipment. The equipment through each position adopts speech information, realizes that whole room optional position carries out speech control, judges the target pronunciation collection equipment nearest with the sound source distance through the speech control device simultaneously, and only responds the speech information of target pronunciation collection equipment realizes single input port input speech control, prevents that the condition of interference from appearing in a plurality of speech information, realizes real whole room intelligence speech control.
In addition, the present invention further provides a voice control method, where the voice control method is executed at a controlled device, where the controlled device may also have a voice acquisition function, and may be the above-mentioned voice acquisition device, and specifically, the voice control method includes:
and when the voice information is received, responding to the voice information.
Or responding to the control instruction when receiving the control instruction. The voice information or the control instruction is sent by a voice control device, and the voice control device may be a server or an electronic device.
Specifically, the voice information sent by the voice control device is control information, specifically, the control information of the controlled device is determined according to the voice information collected by the target voice collecting device, when the device receives the voice information, the device is determined to be the controlled device, and the controlled device responds according to the voice information or the controlled device responds according to the control instruction. And the specific equipment operates according to the controlled parameters corresponding to the voice information or operates according to the controlled parameters corresponding to the control instruction.
The invention also provides a voice control device, which comprises a memory, a processor and a program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the steps of the voice control method.
Optionally, the voice control device includes one of a cloud server, a local server, and a control device of the electronic device.
The invention also provides an electronic device, which comprises a memory, a processor and a program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the steps of the voice control method.
Preferably, the device is an electronic device. The electronic devices include air conditioners, refrigerators, washing machines, induction cookers, and the like.
Furthermore, the present invention also provides a computer-readable storage medium having stored thereon a program which, when executed by a processor, implements the steps of the voice control method as described above.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (11)
1. A voice control method, characterized in that the voice control method comprises the steps of:
determining a target voice acquisition device closest to a sound source according to the distance information between each of the plurality of voice acquisition devices and the sound source;
controlling other voice acquisition equipment except the target voice acquisition equipment in the plurality of voice acquisition equipment, continuously determining the distance information between each voice acquisition equipment and the sound source, and comparing the distance information of each voice acquisition equipment in real time or at regular time;
when the voice acquisition equipment closest to the sound source is determined to be other voice acquisition equipment except the target voice acquisition equipment, updating the other voice acquisition equipment to the target voice acquisition equipment;
controlling the target voice acquisition equipment to continue to acquire voice information;
and responding to the voice information acquired by the target voice acquisition equipment.
2. The voice control method of claim 1, further comprising:
after receiving the distance information between each voice acquisition equipment and the sound source uploaded by the plurality of voice acquisition equipment, executing the step of determining the target voice acquisition equipment closest to the sound source according to the distance information between each voice acquisition equipment and the sound source, wherein the distance information is determined according to the awakening words when the voice acquisition equipment receives the awakening words.
3. The voice control method according to claim 2, wherein the step of determining the target voice collecting device closest to the sound source based on the information on the distance between each of the plurality of voice collecting devices and the sound source comprises:
acquiring awakening state information, and determining equipment in an awakening state according to the awakening state information, wherein the awakening state information is sent by voice acquisition equipment when the voice acquisition equipment receives an awakening word;
and determining the target voice acquisition equipment closest to the sound source according to the distance information uploaded by the equipment in the awakening state.
4. The voice control method according to any one of claims 1 to 3, wherein the step of responding to the voice information collected by the target voice collecting device comprises:
analyzing the voice information acquired by the target voice acquisition equipment, and determining controlled equipment corresponding to the voice information;
and sending the voice information to the controlled equipment so that the controlled equipment can respond to the voice information.
5. The voice control method according to any one of claims 1 to 3, wherein the step of responding to the voice information collected by the target voice collecting device comprises:
acquiring a control instruction corresponding to the voice information; analyzing the voice information acquired by the target voice acquisition equipment, and determining a control instruction and controlled equipment corresponding to the voice information;
and sending the control instruction to the controlled equipment.
6. A voice control method, characterized in that the voice control method comprises the steps of:
when equipment acquires voice information of a user, determining distance information between the equipment and a sound source according to the voice information, and sending the distance information to a voice control device, wherein the equipment comprises a plurality of microphones which form a microphone array, after the voice control device receives the distance information, determining target voice acquisition equipment which is closest to the sound source, controlling the target voice acquisition equipment to continuously acquire the voice information, and controlling other voice acquisition equipment except the target voice acquisition equipment to continuously determine respective distance information between the target voice acquisition equipment and the sound;
and sending the collected voice information to the voice control device.
7. The voice control method according to claim 6, wherein the step of determining distance information between the device of the sound source and the sound source based on the voice information when the device collects the voice information of the user, and transmitting the distance information to the voice control apparatus comprises:
when the collected voice information comprises a wake-up word, determining distance information between the equipment and a sound source according to the wake-up word;
and sending the distance information to the voice control device.
8. The voice control method of claim 7, wherein after the step of transmitting the distance information to the voice control apparatus, the voice control method further comprises:
and when the collected voice information comprises voice control information, executing the step of sending the collected voice information to the voice control device.
9. A voice control apparatus, comprising a memory, a processor and a program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of the voice control method according to any one of claims 1 to 8.
10. An electronic device comprising a memory, a processor, and a program stored on the memory and executable on the processor, wherein the processor implements the steps of the voice control method of any of claims 1-8 when executing the program.
11. A computer-readable storage medium, having stored thereon a program which, when being executed by a processor, carries out the steps of the speech control method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910279446.5A CN110085233B (en) | 2019-04-08 | 2019-04-08 | Voice control method and device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910279446.5A CN110085233B (en) | 2019-04-08 | 2019-04-08 | Voice control method and device, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110085233A CN110085233A (en) | 2019-08-02 |
| CN110085233B true CN110085233B (en) | 2021-02-09 |
Family
ID=67414583
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910279446.5A Active CN110085233B (en) | 2019-04-08 | 2019-04-08 | Voice control method and device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110085233B (en) |
Families Citing this family (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112413836A (en) * | 2019-08-20 | 2021-02-26 | 广东美的制冷设备有限公司 | Air conditioner, air conditioner control method and device and readable storage medium |
| CN110459220A (en) * | 2019-08-26 | 2019-11-15 | 杭州涂鸦信息技术有限公司 | A kind of voice awakening method and system and readable storage medium storing program for executing, computer |
| CN112634884A (en) * | 2019-09-23 | 2021-04-09 | 北京声智科技有限公司 | Method of controlling output audio, method of outputting audio, apparatus, electronic device, and computer-readable storage medium |
| CN110691016B (en) * | 2019-09-29 | 2021-08-31 | 歌尔股份有限公司 | Interactive method realized based on audio equipment and audio equipment |
| CN110673096B (en) * | 2019-09-30 | 2022-02-01 | 北京地平线机器人技术研发有限公司 | Voice positioning method and device, computer readable storage medium and electronic equipment |
| CN110910880B (en) * | 2019-11-29 | 2022-05-10 | 广东美的厨房电器制造有限公司 | Voice control method, system, device and storage medium |
| CN113014460B (en) * | 2019-12-20 | 2023-03-14 | 佛山市云米电器科技有限公司 | Voice processing method, home master control device, voice system and storage medium |
| CN113129888A (en) * | 2020-01-10 | 2021-07-16 | 阿里巴巴集团控股有限公司 | Equipment awakening method, device and equipment |
| CN111413881B (en) * | 2020-03-31 | 2023-08-22 | 佛山市云米电器科技有限公司 | Acquisition system, intelligent air outlet system and hybrid control method thereof |
| CN111583925B (en) * | 2020-04-29 | 2024-02-06 | 深圳创维－Rgb电子有限公司 | Equipment control method, intelligent equipment and storage medium |
| CN111667825A (en) * | 2020-05-21 | 2020-09-15 | 四川虹美智能科技有限公司 | Voice control method, cloud platform and voice equipment |
| CN111640433A (en) * | 2020-06-01 | 2020-09-08 | 珠海格力电器股份有限公司 | Voice interaction method, storage medium, electronic equipment and intelligent home system |
| CN111786860B (en) * | 2020-06-29 | 2022-04-01 | 广东美的制冷设备有限公司 | Household appliance, control method thereof and computer readable storage medium |
| CN111812588B (en) * | 2020-07-20 | 2023-08-18 | 百度在线网络技术（北京）有限公司 | Multi-device voice wake-up implementation method and device, electronic device and medium |
| CN112037787A (en) * | 2020-10-20 | 2020-12-04 | 北京小米松果电子有限公司 | Wake-up control method, device and computer readable storage medium |
| CN112767931A (en) * | 2020-12-10 | 2021-05-07 | 广东美的白色家电技术创新中心有限公司 | Voice interaction method and device |
| CN113132193B (en) * | 2021-04-13 | 2023-01-06 | Oppo广东移动通信有限公司 | Control method and device of intelligent device, electronic device and storage medium |
| CN114546304B (en) * | 2022-02-09 | 2023-11-28 | 青岛海尔科技有限公司 | Printing method, printing device, electronic equipment and storage medium |
| CN114996531A (en) * | 2022-05-17 | 2022-09-02 | 珠海格力电器股份有限公司 | Article position prompting method and device, electronic equipment and storage medium |
| CN115273850A (en) * | 2022-09-28 | 2022-11-01 | 科大讯飞股份有限公司 | Autonomous mobile equipment voice control method and system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5240832B2 (en) * | 2008-06-04 | 2013-07-17 | Ｎｅｃカシオモバイルコミュニケーションズ株式会社 | Sound input device, sound input method and program |
| CN105788599B (en) * | 2016-04-14 | 2019-08-06 | 北京小米移动软件有限公司 | Method of speech processing, router and intelligent sound control system |
| CN108231075A (en) * | 2017-12-29 | 2018-06-29 | 北京视觉世界科技有限公司 | Control method, device, equipment and the storage medium of cleaning equipment |
| CN109192205B (en) * | 2018-09-12 | 2021-05-04 | 深圳市酷搏创新科技有限公司 | Intelligent voice interaction system and control method thereof |
-
2019
- 2019-04-08 CN CN201910279446.5A patent/CN110085233B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110085233A (en) | 2019-08-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110085233B (en) | Voice control method and device, electronic equipment and computer readable storage medium | |
| CN107622652B (en) | Voice control method of household appliance system and household appliance control system | |
| WO2019091171A1 (en) | Voice control method, device, system, and electronic apparatus for smart home appliance | |
| CN107622767B (en) | Voice control method of household appliance system and household appliance control system | |
| US9431014B2 (en) | Intelligent placement of appliance response to voice command | |
| CN108091331B (en) | Intelligent household system based on voice control and control method thereof | |
| CN106707788B (en) | A kind of intelligent home voice control identifying system and method | |
| CN106225174B (en) | Air conditioner control method and system and air conditioner | |
| CN204832803U (en) | Smart home systems based on wireless sensor network | |
| CN105045140A (en) | Method and device for intelligently controlling controlled equipment | |
| CN110767225B (en) | Voice interaction method, device and system | |
| CN109450747B (en) | Method and device for awakening smart home equipment and computer storage medium | |
| CN108375911B (en) | Equipment control method and device, storage medium and equipment | |
| CN112838967B (en) | Main control equipment, intelligent home and control device, control system and control method thereof | |
| CN112908321A (en) | Device control method, device, storage medium, and electronic apparatus | |
| CN114120996A (en) | Voice interaction method and device | |
| CN110493092B (en) | Universal remote control based on far-field voice and IOT (input/output) and household appliance remote control method | |
| CN112002316A (en) | Electric appliance control method and device, storage medium and terminal | |
| CN110703628A (en) | Intelligent household system and control method | |
| CN113852657A (en) | Intelligent home local control method and system based on edge calculation | |
| CN110361978B (en) | Intelligent equipment control method, device and system based on Internet of things operating system | |
| CN106128458A (en) | A kind of home voice control system based on speech recognition technology and method | |
| CN105259779A (en) | Tooth-controlled smart home | |
| CN115019793A (en) | Awakening method, device, system, medium and equipment based on cooperative error correction | |
| CN111183416B (en) | Household electrical appliance system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |