CN110136704B

CN110136704B - Robot voice control method and device, robot and medium

Info

Publication number: CN110136704B
Application number: CN201910265960.3A
Authority: CN
Inventors: 刘帅; 刘洋; 肖福建
Original assignee: Beijing Rockrobo Technology Co Ltd
Current assignee: Beijing Stone Innovation Technology Co ltd
Priority date: 2019-04-03
Filing date: 2019-04-03
Publication date: 2021-12-28
Anticipated expiration: 2039-04-03
Also published as: CN110136704A

Abstract

The embodiment of the disclosure provides a robot voice control method, a device, a robot and a medium, wherein the robot voice control method comprises the following steps: receiving a control voice instruction; matching the control voice command with a storage command of the robot local database; and if the matching is successful, executing the control type voice instruction content. According to the embodiment of the disclosure, when a voice instruction is received, the voice recognition system of the robot is firstly enabled to be in an activated state, and the robot is controlled to turn to the direction of the voice source, so that the robot is enabled to be in a standby state. And then receiving a control command for controlling execution operation within a certain time, performing semantic matching on the control command from a local database and a cloud of the robot and a prestored instruction, and executing an expected action according to a matching result. The method and the device can be operated accurately according to the indication, improve the recognition rate of the voice command input by the user, can work accurately according to the voice command of the user, and increase the interestingness of man-machine interaction.

Description

Robot voice control method and device, robot and medium

Technical Field

The present disclosure relates to the field of control technologies, and in particular, to a robot voice control method, apparatus, robot, and medium.

Background

With the development of technology, various robots having a voice recognition system have appeared, such as floor sweeping robots, floor mopping robots, dust collectors, weed trimmers, and the like. The robots can receive voice instructions input by a user through the voice recognition system to execute the operation indicated by the voice instructions, so that not only is labor saved, but also labor cost is saved.

In the voice control process, a common execution method is that a robot receives a voice signal, then identifies the semantics of the voice signal, and finally performs corresponding actions according to the semantic content, but the semantic analysis process causes low execution efficiency, and sometimes fails to accurately acquire the semantic meaning, thereby causing execution errors, and bringing great trouble to the voice control.

Disclosure of Invention

In view of this, the embodiments of the present disclosure provide a method and an apparatus for controlling a robot by voice, a robot, and a storage medium, so that the robot can accurately match a voice database and accurately execute a voice control command.

In a first aspect, an embodiment of the present disclosure provides a robot voice control method, where the method includes:

receiving a control voice instruction;

matching the control voice command with a robot local database storage command;

and if the matching is successful, executing the control type voice instruction content.

In some possible implementations, after executing the content of the control-class voice instruction if the matching is successful, the method includes:

if the matching is unsuccessful, detecting whether the robot is connected to a cloud end;

and if the control type voice command is not connected to the cloud, recovering to the state before the control type voice command is received.

In some possible implementations, the recovering to the state before receiving the control-type voice command if the control-type voice command is not connected to the cloud includes:

if the control type voice command is connected to the cloud end, matching the control type voice command with the cloud end database;

and if the matching is unsuccessful, recovering to the state before the control voice command is received.

In some possible implementations, before receiving the control-class voice instruction, the method includes:

receiving a wake-up voice instruction;

and identifying the sound source direction of the awakening voice instruction and enabling the robot to turn to the sound source direction.

In some possible implementations, the recognizing a sound source direction of the wake-up voice command and steering the robot to the sound source direction includes:

identifying the sound source direction of the awakening voice instruction;

turning the robot to the sound source direction without stopping the operation of the driving motor;

stopping the operation of the drive motor.

In some possible implementations, the state before the control-like voice instruction includes: a rest state or a cleaning state.

In a second aspect, an embodiment of the present disclosure provides a robot voice control apparatus, including:

the first receiving unit is used for receiving a control voice instruction;

the first matching unit is used for matching the control voice instruction with the robot local database storage instruction;

and the first execution unit is used for executing the control type voice instruction content if the matching is successful.

In some possible implementations, the method further includes:

the detection unit is used for detecting whether the robot is connected to the cloud end or not if the matching is unsuccessful;

and the first recovery unit is used for recovering to the state before the control voice instruction is received if the first recovery unit is not connected to the cloud.

In some possible implementations, the method further includes:

the second matching unit is used for matching the control voice instruction with the cloud database if the control voice instruction is connected to a cloud;

and the second execution unit is used for executing the control type voice instruction content if the matching is successful.

In some possible implementations, the method further includes:

and the second recovery unit is used for recovering to the state before the control voice instruction is received if the matching is unsuccessful.

In some possible implementations, the method further includes:

the second receiving unit is used for receiving the awakening voice instruction;

and the recognition unit is used for recognizing the sound source direction of the awakening voice instruction and enabling the robot to turn to the sound source direction.

In some possible implementations, the identification unit is further configured to:

identifying the sound source direction of the awakening voice instruction;

stopping the operation of the drive motor.

In a third aspect, the disclosed embodiments provide a robot voice control device, comprising a processor and a memory, wherein the memory stores computer program instructions executable by the processor, and the processor implements the method steps as described in any one of the above when executing the computer program instructions.

In a fourth aspect, embodiments of the present disclosure provide a robot including an apparatus as in any one of the above.

In a fifth aspect, embodiments of the present disclosure provide a non-transitory computer readable storage medium storing computer program instructions which, when invoked and executed by a processor, implement the method steps as recited in any of the above.

Compared with the prior art, the method has the following technical effects:

according to the embodiment of the disclosure, when a voice instruction is received, the voice recognition system of the robot is firstly enabled to be in an activated state, and the robot is controlled to turn to the direction of the voice source, so that the robot is enabled to be in a standby state. And then receiving a control command for controlling execution operation within a certain time, performing semantic matching on the control command from a local database and a cloud of the robot and a prestored instruction, and executing an expected action according to a matching result. The method and the device can be operated accurately according to the indication, improve the recognition rate of the voice command input by the user, can work accurately according to the voice command of the user, and increase the interestingness of man-machine interaction.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present disclosure, and other drawings can be obtained according to the drawings without creative efforts for those skilled in the art.

Fig. 1 is a schematic view of an application scenario provided in the present disclosure;

fig. 2 is a top view of a robot structure provided by an embodiment of the present disclosure;

fig. 3 is a bottom view of a robot structure provided by an embodiment of the present disclosure;

fig. 4 is a front view of a robot structure provided by an embodiment of the present disclosure;

fig. 5 is a perspective view of a robot structure provided by an embodiment of the present disclosure;

fig. 6 is a block diagram of a robot structure provided in an embodiment of the present disclosure;

fig. 7 is a schematic flowchart of a robot voice control method according to an embodiment of the disclosure;

fig. 8 is a schematic flowchart of a robot voice control method according to another embodiment of the present disclosure;

fig. 9 is a schematic structural diagram of a robot voice control device according to an embodiment of the present disclosure;

fig. 10 is a schematic structural diagram of a robot voice control device according to another embodiment of the present disclosure;

fig. 11 is an electronic structural schematic diagram of a robot provided in the embodiment of the present disclosure.

Detailed Description

To make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are some, but not all embodiments of the present disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.

It should be understood that although the terms first, second, third, etc. may be used to describe … … in embodiments of the present disclosure, these … … should not be limited to these terms. These terms are used only to distinguish … … from each other. For example, the first … … can also be referred to as the second … … and, similarly, the second … … can also be referred to as the first … … without departing from the scope of embodiments of the present disclosure.

To describe the behavior of the robot more clearly, the following directional definitions are made:

as shown in fig. 5, the robot 100 may travel over the ground through various combinations of movements relative to the following three mutually perpendicular axes defined by the body 110: a front-back axis X, a lateral axis Y, and a central vertical axis Z. The forward driving direction along the forward-rearward axis X is denoted as "forward", and the rearward driving direction along the forward-rearward axis X is denoted as "rearward". The transverse axis Y extends substantially along the axis defined by the center points of the drive wheel modules 141 between the right and left wheels of the robot.

The robot 100 may rotate about the Y-axis. "pitch up" when the forward portion of the robot 100 is tilted up and the backward portion is tilted down, and "pitch down" when the forward portion of the robot 100 is tilted down and the backward portion is tilted up. In addition, the robot 100 may rotate about the Z-axis. In the forward direction of the robot, the robot 100 is tilted to the right of the X axis as "right turn", and the robot 100 is tilted to the left of the X axis as "left turn".

Referring to fig. 1, a possible application scenario provided by the embodiment of the present disclosure includes a robot, such as a sweeping robot, a mopping robot, a dust collector, a weeding machine, and the like. In some embodiments, the robot may be a robot, in particular a sweeping robot, a mopping robot. In implementation, the robot may be provided with a voice recognition system to receive a voice command sent by a user, and rotate according to the voice command in the direction of the arrow to respond to the voice command of the user. The robot may also be provided with a voice output device to output a prompt voice. In other embodiments, the robot may be provided with a touch-sensitive display to receive operation instructions input by a user. The robot can also be provided with wireless communication modules such as WIFI module, bluetooth module to be connected with intelligent terminal, and receive the operating instruction that the user utilized intelligent terminal to transmit through wireless communication module.

The structure of the relevant robot is described below, as shown in fig. 2-5:

the robot 100 includes a robot body 110, a sensing system 120, a control system, a drive system 140, a cleaning system, an energy system, and a human-machine interaction system 170. As shown in fig. 2.

The machine body 110 includes a forward portion 111 and a rearward portion 112 having an approximately circular shape (circular front to rear), and may have other shapes including, but not limited to, an approximately D-shape with a front to rear circle.

As shown in fig. 4, the sensing system 120 includes a position determining device 121 located above the machine body 110, a bumper 122 located at the forward portion 111 of the machine body 110, a cliff sensor 123, and an ultrasonic sensor, an infrared sensor, a magnetometer, an accelerometer, a gyroscope, a odometer, etc., and provides various position information and motion state information of the machine to the control system 130. The position determining device 121 includes, but is not limited to, a camera, a laser distance measuring device (LDS). The following describes how position determination is performed by taking a laser distance measuring device of the triangulation method as an example. The basic principle of the triangulation method is based on the geometric relation of similar triangles, and is not described herein.

The laser ranging device includes a light emitting unit and a light receiving unit. The light emitting unit may include a light source that emits light, and the light source may include a light emitting element, such as an infrared or visible Light Emitting Diode (LED) that emits infrared light or visible light. Preferably, the light source may be a light emitting element that emits a laser beam. In the present embodiment, a Laser Diode (LD) is taken as an example of the light source. In particular, a light source using a laser beam may make the measurement more accurate than other lights due to the monochromatic, directional, and collimation characteristics of the laser beam. For example, infrared or visible light emitted by a Light Emitting Diode (LED) is affected by ambient environmental factors (e.g., color or texture of an object) as compared to a laser beam, and may be reduced in measurement accuracy. The Laser Diode (LD) may be a spot laser for measuring two-dimensional position information of an obstacle, or a line laser for measuring three-dimensional position information of an obstacle within a certain range.

The light receiving unit may include an image sensor on which a light spot reflected or scattered by an obstacle is formed. The image sensor may be a set of a plurality of unit pixels of a single row or a plurality of rows. These light receiving elements can convert optical signals into electrical signals. The image sensor may be a Complementary Metal Oxide Semiconductor (CMOS) sensor or a Charge Coupled Device (CCD) sensor, and is preferably a Complementary Metal Oxide Semiconductor (CMOS) sensor due to cost advantages. Also, the light receiving unit may include a light receiving lens assembly. Light reflected or scattered by the obstruction may travel through a light receiving lens assembly to form an image on the image sensor. The light receiving lens assembly may comprise a single or multiple lenses.

The base may support the light emitting unit and the light receiving unit, which are disposed on the base and spaced apart from each other by a certain distance. In order to measure the obstacle situation in the 360 degree direction around the robot, the base may be rotatably disposed on the main body 110, or the base itself may be rotated without rotating the emitted light, the received light by providing a rotating element. The rotating angular speed of the rotating element can be obtained by arranging the optical coupling element and the coded disc, the optical coupling element senses tooth gaps on the coded disc, and instantaneous angular speed can be obtained by dividing the sliding time of the tooth gap distance and the tooth gap distance value. The higher the density of the tooth notches on the coded disc is, the higher the measurement accuracy and precision are correspondingly, but the structure is more precise, and the calculated amount is higher; on the contrary, the smaller the density of the tooth defects is, the lower the accuracy and precision of measurement are, but the structure can be relatively simple, the calculation amount is smaller, and the cost can be reduced.

The data processing device, e.g. DSP, connected to the light receiving unit records and transmits the obstacle distance values at all angles in the direction of 0 degrees with respect to the robot to the data processing unit in the control system 130, e.g. Application Processor (AP) comprising CPU running a particle filter based positioning algorithm to obtain the current position of the robot and to map it according to this position for navigation. The positioning algorithm preferably uses instant positioning and mapping (SLAM).

Although the laser distance measuring device based on the triangulation method can measure the distance value at an infinite distance beyond a certain distance in principle, in practice, the realization of the long-distance measurement, for example, more than 6 meters, is difficult, mainly because of the size limitation of the pixel unit on the sensor of the light receiving unit, and at the same time, the laser distance measuring device is also influenced by the photoelectric conversion speed of the sensor, the data transmission speed between the sensor and the connected DSP, and the calculation speed of the DSP. The measured value obtained by the laser ranging device under the influence of temperature can also have variation which cannot be tolerated by a system, mainly because the angle between incident light and emergent light is changed due to thermal expansion deformation of a structure between the light emitting unit and the light receiving unit, and the light emitting unit and the light receiving unit can also have the temperature drift problem. After the laser ranging device is used for a long time, the measurement result is also seriously influenced by deformation caused by accumulation of various factors such as temperature change, vibration and the like. The accuracy of the measuring result directly determines the accuracy of the map drawing, and is the basis for further strategy implementation of the robot, and is particularly important.

As shown in fig. 3, the forward portion 111 of the machine body 110 may carry a bumper 122, the bumper 122 detecting one or more events in the travel path of the robot 100 via a sensor system, such as an infrared sensor, as the drive wheel module 141 propels the robot across the floor during cleaning, and the robot may control the drive wheel module 141 to cause the robot to respond to the events, such as moving away from an obstacle, by detecting the events, such as an obstacle, a wall, by the bumper 122.

The control system 130 is disposed on a circuit board in the machine body 110, and includes a non-transitory memory, such as a hard disk, a flash memory, and a random access memory, a communication computing processor, such as a central processing unit, and an application processor, and the application processor uses a positioning algorithm, such as SLAM, to map an instant map of the environment where the robot is located according to the obstacle information fed back by the laser ranging device. And the current working state of the sweeper is comprehensively judged by combining distance information and speed information fed back by the buffer 122, the cliff sensor 123, the ultrasonic sensor, the infrared sensor, the magnetometer, the accelerometer, the gyroscope, the odometer and other sensing devices, for example, when the sweeper passes a threshold, a carpet is arranged at the cliff, the upper part or the lower part of the sweeper is clamped, a dust box is full, the sweeper is taken up and the like, and a specific next-step action strategy is provided according to different conditions, so that the robot can work more according with the requirements of an owner, and better user experience is achieved. Further, the control system 130 can plan the most efficient and reasonable cleaning path and cleaning mode based on map information drawn by the SLAM, thereby greatly improving the cleaning efficiency of the robot.

The drive system 140 may steer the robot 100 across the ground based on drive commands having distance and angle information, such as x, y, and theta components. The drive system 140 includes a drive wheel module 141, and the drive wheel module 141 can control both the left and right wheels, and in order to more precisely control the motion of the machine, it is preferable that the drive wheel module 141 includes a left drive wheel module and a right drive wheel module, respectively. The left and right drive wheel modules are opposed along a transverse axis defined by the body 110. In order for the robot to be able to move more stably or with greater mobility over the ground, the robot may include one or more driven wheels 142, including but not limited to universal wheels. The driving wheel module comprises a traveling wheel, a driving motor and a control circuit for controlling the driving motor, and can also be connected with a circuit for measuring driving current and a milemeter. The driving wheel module 141 may be detachably coupled to the main body 110 to facilitate disassembly and maintenance. The drive wheel may have a biased drop-type suspension system movably secured, e.g., rotatably attached, to the robot body 110 and receiving a spring bias biased downward and away from the robot body 110. The spring bias allows the drive wheels to maintain contact and traction with the floor with a certain landing force while the cleaning elements of the robot 100 also contact the floor 10 with a certain pressure.

The cleaning system may be a dry cleaning system and/or a wet cleaning system. As a dry cleaning system, the main cleaning function is derived from the sweeping system 151 constituted by the roll brush, the dust box, the blower, the air outlet, and the connecting members therebetween. The rolling brush with certain interference with the ground sweeps the garbage on the ground and winds the garbage to the front of a dust suction opening between the rolling brush and the dust box, and then the garbage is sucked into the dust box by air which is generated by the fan and passes through the dust box and has suction force. The dust removal capability of the sweeper can be represented by the sweeping efficiency DPU (dust pick up efficiency), which is influenced by the structure and the material of the rolling brush, the wind power utilization rate of an air duct formed by a dust suction port, a dust box, a fan, an air outlet and connecting parts among the dust suction port, the dust box, the fan, the air outlet and the dust box, the type and the power of the fan, and is a responsible system design problem. Compared with the common plug-in dust collector, the improvement of the dust removal capability is more significant for the cleaning robot with limited energy. Because the improvement of the dust removal capability directly and effectively reduces the energy requirement, namely the machine which can clean the ground of 80 square meters by charging once can be developed into the machine which can clean 100 square meters or more by charging once. And the service life of the battery, which reduces the number of times of charging, is also greatly increased, so that the frequency of replacing the battery by the user is also increased. More intuitively and importantly, the improvement of the dust removal capability is the most obvious and important user experience, and the user can directly draw a conclusion whether the sweeping/wiping is clean. The dry cleaning system may also include an edge brush 152 having an axis of rotation that is angled relative to the floor for moving debris into the roller brush area of the cleaning system.

Energy systems include rechargeable batteries, such as nickel metal hydride batteries and lithium batteries. The charging battery can be connected with a charging control circuit, a battery pack charging temperature detection circuit and a battery under-voltage monitoring circuit, and the charging control circuit, the battery pack charging temperature detection circuit and the battery under-voltage monitoring circuit are connected with the single chip microcomputer control circuit. The host computer is connected with the charging pile through the charging electrode arranged on the side or the lower part of the machine body for charging. If dust is attached to the exposed charging electrode, the plastic body around the electrode is melted and deformed due to the accumulation effect of electric charge in the charging process, even the electrode itself is deformed, and normal charging cannot be continued.

The human-computer interaction system 170 comprises keys on a panel of the host computer, and the keys are used for a user to select functions; the machine control system can further comprise a display screen and/or an indicator light and/or a loudspeaker, wherein the display screen, the indicator light and the loudspeaker show the current state or function selection item of the machine to a user; and a mobile phone client program can be further included. For the path navigation type cleaning equipment, a map of the environment where the equipment is located and the position of a machine can be displayed for a user at a mobile phone client, and richer and more humanized function items can be provided for the user.

Figure 6 is a block diagram of a sweeping robot according to the present disclosure.

The sweeping robot according to the current embodiment may include: a microphone array unit for recognizing a user's voice, a communication unit for communicating with a remote control device or other devices, a moving unit for driving the main body, a cleaning unit, and a memory unit for storing information. An input unit (a key of the sweeping robot, etc.), an object detection sensor, a charging unit, a microphone array unit, a direction detection unit, a position detection unit, a communication unit, a driving unit, and a memory unit may be connected to the control unit to transmit or receive predetermined information to or from the control unit.

The microphone array unit may compare the voice input through the receiving unit with information stored in the memory unit to determine whether the input voice corresponds to a specific command. If it is determined that the input voice corresponds to a specific command, the corresponding command is transmitted to the control unit. If the detected speech cannot be compared to the information stored in the memory unit, the detected speech may be treated as noise to ignore the detected speech.

For example, the detected voice corresponds to the word "come, go", and there is a word control command (come) corresponding to the word stored in the information of the memory unit. In this case, a corresponding command may be transmitted to the control unit.

The direction detecting unit may detect the direction of the voice by using a time difference or a level of the voice input to the plurality of receiving units. The direction detection unit transmits the detected direction of the voice to the control unit. The control unit may determine the moving path by using the voice direction detected by the direction detecting unit.

The position detection unit may detect coordinates of the subject within predetermined map information. In one embodiment, the information detected by the camera and the map information stored in the memory unit may be compared with each other to detect the current position of the subject. The position detection unit may use a Global Positioning System (GPS) in addition to the camera.

In a broad sense, the position detection unit may detect whether the main body is disposed at a specific position. For example, the position detection unit may include a unit for detecting whether the main body is disposed on the charging pile.

For example, in the method for detecting whether the main body is disposed on the charging pile, whether the main body is disposed at the charging position may be detected according to whether power is input into the charging unit. For another example, whether the main body is disposed at the charging position may be detected by a charging position detecting unit disposed on the main body or the charging pile.

The communication unit may transmit/receive predetermined information to/from a remote control device or other devices. The communication unit may update map information of the sweeping robot.

The driving unit may operate the moving unit and the cleaning unit. The driving unit may move the moving unit along the moving path determined by the control unit.

The memory unit stores therein predetermined information related to the operation of the sweeping robot. For example, map information of an area where the sweeping robot is arranged, control command information corresponding to a voice recognized by the microphone array unit, direction angle information detected by the direction detection unit, position information detected by the position detection unit, and obstacle information detected by the object detection sensor may be stored in the memory unit.

The control unit may receive information detected by the receiving unit, the camera, and the object detection sensor. The control unit may recognize a voice of the user, detect a direction in which the voice occurs, and detect a position of the sweeping robot based on the transmitted information. Further, the control unit may also operate the moving unit and the cleaning unit.

As shown in fig. 7, when the robot in the application scenario of fig. 1 is applied, the user controls the robot to execute the relevant control instruction through a voice instruction. The embodiment of the disclosure provides a robot voice control method, which comprises the following steps:

step S702: and receiving a control voice instruction.

Controlling voice instructions: for instructing operations, i.e. instructing the control robot to perform operations. The operation may be an operation of a custom setting, or may be a default setting of the system, for example: cleaning operations, mopping operations, weeding operations, and the like. In a specific embodiment, the control-type voice command may be set by a user or by default, for example: the control-type voice command can be user-defined 'sweeping', 'mopping' or 'cleaning sanitation'. The control type voice instruction (control type voice instruction) is stored in the robot or a cloud end connected with the robot in advance. For convenience of description, the following description will be given by taking the control-type voice command as "cleaning hygiene".

The determination of whether the control-type voice instruction for instructing the operation is received may be a determination within a preset time period, for example, 1 minute, 2 minutes, and the like, and the time period may be preset by the touch device. According to the situation monitored in the preset time range, the following two situations are respectively executed.

In the first case, if it is determined that the control-type voice command is received, the robot executes an operation instructed by the control-type voice command.

For example, a control command of "clean hygiene" is monitored within 1 minute, and the robot performs cleaning in a predetermined direction or position according to the user's command until another wake-up-like voice control command is received.

In the second case, if the control-type voice command is not received, the robot returns to the original direction and continues to execute the original operation.

For example, a control command of "clean hygiene" is not monitored within 1 minute, and the robot cleans according to the original cleaning direction or position until a voice control command of wake-up type is received again.

Step S704: and matching the control voice command with the robot local database storage command.

Generally, a robot has its own storage device, such as its own memory, cache or external memory (a usb disk or a removable storage disk), and all voice commands (including voice commands of wake-up class, control class, etc.) are stored in the storage disk database in a manner of group, for example, wake-up class voice commands, "turn on voice", "power on", "go", etc. The control type voice instruction comprises the steps of sweeping, mopping, planning to go to a living room, cleaning and sanitation and the like. After receiving the voice command, the robot firstly selects to search and match with the self storage database, wherein the matching can be fuzzy matching or precise matching, and returns a command of whether the matching is successful or not.

Step S706: and if the matching is successful, executing the control type voice instruction content.

step S708: and if the matching is unsuccessful, detecting whether the robot is connected to the cloud.

The matching is unsuccessful, that is, the local database does not store the corresponding voice command, and at this time, the voice command can be analyzed from other channels, and one way is to match the voice command stored in the cloud. Therefore, it is necessary to detect whether the robot can be connected to the internet, confirm that the voice command is not executed if the robot cannot be connected to the internet, and perform secondary matching if the robot can be connected to the internet.

Step S710: and if the control type voice command is not connected to the cloud, recovering to the state before the control type voice command is received.

In some possible implementations, the state before the control-like voice instruction includes: a rest state or a cleaning state. The stationary state is an inactive state or a standby state, and the cleaning state is a state in which a cleaning operation is being performed.

Step S712: and if the control type voice command is connected to the cloud, matching the control type voice command with the cloud database.

All voice commands (including voice commands of wake-up class, control class, etc.) need to be stored in the cloud in a manner of group, for example, the voice commands of wake-up class, "turn on voice", "power on", "go", "come here", "go here", etc. The control type voice instruction comprises the steps of sweeping, mopping, planning to go to a living room, cleaning and sanitation and the like. After the robot is connected to the cloud, the robot searches and matches the cloud database, wherein the matching can be fuzzy matching or precise matching, and returns a matching success or failure instruction.

Step S714: and if the matching is successful, executing the control type voice instruction content.

Step S716: and if the matching is unsuccessful, recovering to the state before the control voice command is received.

According to the embodiment of the disclosure, when the voice control instruction is received, semantic matching can be performed on the pre-stored instruction from the robot local database, the cloud end and the control instruction, and expected actions can be executed according to matching results. The method and the device can be operated accurately according to the indication, improve the recognition rate of the voice command input by the user, can work accurately according to the voice command of the user, and increase the interestingness of man-machine interaction.

In another embodiment, as shown in fig. 8, applied to the robot in the application scenario of fig. 1, the user controls the robot to execute the relevant control command through a voice command. The embodiment of the disclosure provides a robot voice control method, which comprises the following steps:

step S800: and receiving a wake-up voice instruction.

Generally, a speech recognition system of a robot may have a sleep state and an active state. For example, when the robot is in a working state or an unused state, the voice recognition system is in a dormant state, and in the dormant state, the voice recognition system hardly occupies too much resources of the robot and does not recognize other voice instructions except the wake-up voice instruction.

If the voice recognition system in the dormant state receives the awakening voice command, the voice recognition system is switched from the dormant state to the activated state. In the active state, the speech recognition system may recognize speech instructions, such as control-like speech instructions, configured in the speech recognition system.

Specifically, the wake-up voice command: for waking up the speech recognition system, i.e. for indicating that the speech recognition system is in an active state. In implementation, if the speech recognition system is in the dormant state, when the robot receives the first speech command, the speech recognition system is switched from the dormant state to the activated state. If the voice recognition system is in the activated state, the voice recognition system may be controlled to continue to be in the activated state, or no operation may be performed. In a specific embodiment, the wake-up voice command may be set by a user or by default, for example: the wake-up voice command can be user-defined "turn on voice", "power on", "go to", and the like. For convenience of description, the following description will take the wake-up voice command as "coming" as an example.

Step S801: and identifying the sound source direction of the awakening voice instruction and enabling the robot to turn to the sound source direction.

After the robot has received a wake-up type activation instruction such as "come", the robot detects the direction of the voice by the direction detection unit, for example, by using the time difference or level of the voice input to the plurality of receiving units. The direction detection unit transmits the detected direction of the voice to the control unit. The control unit may control the driving system by using the voice direction detected by the direction detecting unit to make the robot perform a pivot rotation or the like so that the robot forward direction is turned toward the user's sound source direction. The man-machine interaction is similar to that after a dry and alive person is called by a person, the person stops working in the hand and turns to a conversation state, so that the man-machine interaction is more humanized.

In some possible implementations, the recognizing a sound source direction of the wake-up voice command and turning the robot to the sound source direction specifically includes the following method steps:

step S8011: identifying the sound source direction of the awakening voice instruction;

step S8013: turning the robot to the sound source direction without stopping the operation of the driving motor;

after the robot has received a wake-up type activation instruction such as "come", the robot detects the direction of the voice by the direction detection unit, for example, by using the time difference or level of the voice input to the plurality of receiving units. The direction detection unit transmits the detected direction of the voice to the control unit. The control unit may control the driving system by using the voice direction detected by the direction detecting unit to make the robot perform a pivot rotation or the like so that the robot forward direction is turned toward the user's sound source direction. In the process, the robot does not stop working, and the cleaning motor is still in a starting state.

Step S8015: stopping the operation of the drive motor.

After the robot rotates to the sound source direction, the robot only reserves the voice recognition system in the activated state for all the driving systems, and at the moment, the robot is in a complete standby state, and whether a control command is sent out is detected in real time.

Step S802: and receiving a control voice instruction.

Step S804: and matching the control voice command with the robot local database storage command.

Step S806: and if the matching is successful, executing the control type voice instruction content.

step S808: and if the matching is unsuccessful, detecting whether the robot is connected to the cloud.

Step S810: and if the control type voice command is not connected to the cloud, recovering to the state before the control type voice command is received.

Step S812: and if the control type voice command is connected to the cloud, matching the control type voice command with the cloud database.

Step S814: and if the matching is successful, executing the control type voice instruction content.

Step S816: and if the matching is unsuccessful, recovering to the state before the control voice command is received.

In another embodiment, as shown in fig. 9, in conjunction with the robot applied to the application scenario of fig. 1, an embodiment of the present disclosure provides a robot voice control apparatus, which includes a first receiving unit 902, a second matching unit 903, a first matching unit 904, a second executing unit 905, a first executing unit 906, a detecting unit 908, a second restoring unit 909, and a first restoring unit 910, which are described as follows. The apparatus shown in fig. 9 can execute the method of the embodiment shown in fig. 7, and reference may be made to the related description of the embodiment shown in fig. 7 for a part of this embodiment that is not described in detail. The implementation process and technical effect of the technical solution are described in the embodiment shown in fig. 7, and are not described herein again.

A first receiving unit 902, configured to receive a control-class voice instruction;

a first matching unit 904, configured to match the control-class voice instruction with the robot local database storage instruction;

a first executing unit 906, configured to execute the control-class voice instruction content if the matching is successful.

In some possible implementations, the method further includes:

a detecting unit 908, configured to detect whether the robot is connected to a cloud if the matching is unsuccessful;

a first recovering unit 910, configured to recover to a state before the control-class voice command is received if the cloud is not connected.

In some possible implementations, the method further includes:

a second matching unit 903, configured to match the control-type voice instruction with the cloud database if the control-type voice instruction is connected to a cloud;

and a second execution unit 905, configured to execute the control-class voice instruction content if the matching is successful.

In some possible implementations, the method further includes:

and a second restoring unit 909, configured to restore to the state before the control-class voice instruction is received if the matching is unsuccessful.

In another embodiment, as shown in fig. 10, in conjunction with the robot applied to the application scenario of fig. 1, the disclosed embodiment provides a robot voice control apparatus, which includes a recognition unit 1000, a second receiving unit 1001, a first receiving unit 1002, a second matching unit 1003, a first matching unit 1004, a second executing unit 1005, a first executing unit 1006, a detecting unit 1008, a second restoring unit 1009, and a first restoring unit 1010, each of which is described below. The apparatus shown in fig. 10 can perform the method of the embodiment shown in fig. 8, and reference may be made to the related description of the embodiment shown in fig. 8 for a part of this embodiment that is not described in detail. The implementation process and technical effect of the technical solution refer to the description in the embodiment shown in fig. 8, and are not described herein again.

A first receiving unit 1002, configured to receive a control-class voice instruction;

a first matching unit 1004, configured to match the control-class voice instruction with the robot local database storage instruction;

a first executing unit 1006, configured to execute the control-class voice instruction content if the matching is successful.

In some possible implementations, the method further includes:

a detecting unit 1008, configured to detect whether the robot is connected to a cloud if the matching is unsuccessful;

a first recovering unit 1010, configured to recover to a state before the control-class voice command is received if the cloud is not connected.

In some possible implementations, the method further includes:

a second matching unit 1003, configured to match the control-type voice instruction with the cloud database if the control-type voice instruction is connected to a cloud;

and a second execution unit 1005, configured to execute the control-class voice instruction content if the matching is successful.

In some possible implementations, the method further includes:

a second recovering unit 1009, configured to recover to a state before the control-class voice instruction is received if the matching is unsuccessful.

In some possible implementations, the method further includes:

a second receiving unit 1001, configured to receive a wake-up voice instruction;

the recognition unit 1000 is configured to recognize a sound source direction of the wake-up voice command and steer the robot to the sound source direction.

In some possible implementations, the identification unit 1000 is further configured to:

identifying the sound source direction of the awakening voice instruction;

stopping the operation of the drive motor.

An embodiment of the present disclosure provides a robot including the robot voice control device as described above.

The disclosed embodiment provides a robot, comprising a processor and a memory, wherein the memory stores computer program instructions capable of being executed by the processor, and the processor executes the computer program instructions to realize the method steps of any one of the foregoing embodiments.

The disclosed embodiments provide a non-transitory computer readable storage medium storing computer program instructions which, when invoked and executed by a processor, implement the method steps of any of the preceding embodiments.

As shown in fig. 11, robot 1100 may include a processing device (e.g., central processor, graphics processor, etc.) 1101 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)1102 or a program loaded from storage device 1108 into a Random Access Memory (RAM) 1103. In the RAM 1103, various programs and data necessary for the operation of the electronic robot 1100 are also stored. The processing device 1101, the ROM 1102, and the RAM 1103 are connected to each other by a bus 1104. An input/output (I/O) interface 1105 is also connected to bus 1104.

Generally, the following devices may be connected to the I/O interface 1105: input devices 1106 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 1107 including, for example, Liquid Crystal Displays (LCDs), speakers, vibrators, and the like; storage devices 1108, including, for example, magnetic tape, hard disk, etc.; and a communication device 1109. The communication means 1109 can allow the electronic robot 1100 to perform wireless or wired communication with other robots to exchange data. While fig. 7 illustrates an electronic robot 1100 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such embodiments, the computer program may be downloaded and installed from a network via the communication device 1109, or installed from the storage device 1108, or installed from the ROM 1102. The computer program, when executed by the processing device 1101, performs the above-described functions defined in the methods of the embodiments of the present disclosure.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

The computer readable medium may be embodied in the robot; or may be separate and not assembled into the robot.

Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of a unit does not in some cases constitute a limitation of the unit itself, for example, the first retrieving unit may also be described as a "unit for retrieving at least two internet protocol addresses".

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Finally, it should be noted that: the above examples are only intended to illustrate the technical solutions of the present disclosure, not to limit them; although the present disclosure has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present disclosure.

Claims

1. A cleaning robot voice control method, characterized in that the method comprises:

receiving a wake-up voice instruction; the awakening voice instruction switches the voice recognition system from a dormant state to an activated state;

recognizing the sound source direction of the awakening voice instruction and enabling the robot to turn to the sound source direction; wherein the cleaning robot recognizes a sound source direction of the wake-up-like voice instruction by detecting a direction of a voice using a time difference or a level of the voice input to a plurality of receiving units;

judging whether a control voice instruction is received or not within a preset time period;

matching the control voice command with a robot local database storage command;

if the matching is successful, executing the control type voice instruction content;

the recognizing a sound source direction of the wake-up voice command and steering the robot to the sound source direction includes:

identifying the sound source direction of the awakening voice instruction;

enabling the advancing direction of the robot to turn to the sound source direction without stopping the operation of the cleaning motor;

stopping the operation of the cleaning motor.

2. The method according to claim 1, wherein after executing the control-class voice instruction content if the matching is successful, the method comprises:

3. The method of claim 2, wherein recovering to the state before receiving the control-class voice command if the control-class voice command is not connected to the cloud comprises:

4. The method according to claim 3, wherein after executing the control-class voice instruction content if the matching is successful, the method comprises:

5. The method of claim 1, wherein the state prior to the control-like voice instruction comprises: a rest state or a cleaning state.

6. A voice control device for a cleaning robot, comprising:

the second receiving unit is used for receiving the awakening voice instruction; the awakening voice instruction switches the voice recognition system from a dormant state to an activated state;

the recognition unit is used for recognizing the sound source direction of the awakening voice instruction and enabling the robot to turn to the sound source direction; the method comprises the following steps: identifying the sound source direction of the awakening voice instruction; enabling the advancing direction of the robot to turn to the sound source direction without stopping the operation of the cleaning motor; stopping the operation of the cleaning motor; wherein the cleaning robot recognizes a sound source direction of the wake-up-like voice instruction by detecting a direction of a voice using a time difference or a level of the voice input to a plurality of receiving units;

the first receiving unit is used for judging whether to receive a control voice instruction or not within a preset time period;

7. The apparatus of claim 6, further comprising:

8. The apparatus of claim 7, further comprising:

9. The apparatus of claim 8, further comprising:

10. The apparatus of claim 6, wherein the identification unit is further configured to:

identifying the sound source direction of the awakening voice instruction;

stopping the operation of the drive motor.

11. The apparatus of claim 10, wherein the state prior to the control-like voice instruction comprises: a rest state or a cleaning state.

12. A robotic speech control device comprising a processor and a memory, said memory storing computer program instructions executable by said processor, said processor implementing the method steps of any of claims 1-5 when executing said computer program instructions.

13. A robot comprising a device according to any of claims 6-11.

14. A non-transitory computer readable storage medium having stored thereon computer program instructions which, when invoked and executed by a processor, perform the method steps of any of claims 1-5.