WO2020103259A1 - Learning accompanying robot system and method for realizing voice interaction/man-robot conversation - Google Patents

Learning accompanying robot system and method for realizing voice interaction/man-robot conversation

Info

Publication number
WO2020103259A1
WO2020103259A1 PCT/CN2018/122318 CN2018122318W WO2020103259A1 WO 2020103259 A1 WO2020103259 A1 WO 2020103259A1 CN 2018122318 W CN2018122318 W CN 2018122318W WO 2020103259 A1 WO2020103259 A1 WO 2020103259A1
Authority
WO
WIPO (PCT)
Prior art keywords
module
robot
signal
voice
audio
Prior art date
Application number
PCT/CN2018/122318
Other languages
French (fr)
Chinese (zh)
Inventor
欧阳田
周波
郭小龙
唐海龙
Original Assignee
深圳市宏图物联科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市宏图物联科技有限公司 filed Critical 深圳市宏图物联科技有限公司
Publication of WO2020103259A1 publication Critical patent/WO2020103259A1/en

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for
    • B25J11/0005—Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1602—Programme controls characterised by the control system, structure, architecture
    • B25J9/161—Hardware, e.g. neural networks, fuzzy logic, interfaces, processor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1679—Programme controls characterised by the tasks executed
    • B25J9/1689—Teleoperation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the invention relates to teaching electronic products, and more particularly to a learning companion robot system and method for realizing voice interaction / man-machine conversation.
  • robot technology is a system integration and application that is based on automation technology and computer technology and organically integrates various modern information technologies.
  • the breakthrough of artificial intelligence technology has fundamentally provided the necessary support for the improvement of robot technology research and broadened the path of robot applications. It has widely covered defense, aerospace, industrial production, education services and other fields.
  • Technological innovation is robot technology The era of research and the development of today's society. With the improvement of people's living standards and the improvement of cultural quality, humans have entered the era of science and technology, small robots have entered thousands of households with people's lives, the cultivation of Chinese culture and literacy starts from children, and early education robots play a broad field. Strengthen children's memory, cultivate children's interest, and gradually replace the teacher's lesson preparation, lecture, teaching, training, etc.
  • the invention provides a learning companion robot system and method for realizing voice interaction / man-machine communication, which uses voice technology, human and robot voice interaction, connects to a cloud platform database, and selects and searches content required by consumers through large database technology; It solves the shortcomings in the prior art that the early education equipment has single knowledge, little knowledge, no update of knowledge, and lack of interaction with people.
  • the present invention provides a method for realizing voice interaction / human-machine communication of a schoolmate robot, which includes the following steps: (S1) The user issues instructions to the schoolmate robot through the main silicon wheat board / button, and the schoolmate robot uses audio
  • the module transfers the dialogue content to the motherboard baseband chip module, and performs a text search on its speech semantics through the motherboard baseband chip module; (S2) the content of the text search in the step (S1) through the baseband signal encoding synthesis, and through the WIFI network signal / base station
  • the signal is transmitted to the cloud platform knowledge base, and the corresponding content is retrieved from the cloud platform knowledge base; (S3) the content retrieved in step (S2) is encoded and decoded through the baseband signal, and transmitted to the audio through the WIFI network signal / base station signal
  • the module performs voice restoration and audio restoration; (S4) Play the content restored in step (S3) through the sound output module to realize human-machine voice interaction.
  • step (S1) When the instruction issued by the user in step (S1) is to make a call, it includes the following steps: (S1A) Install a SIM card in the SIM interface of the schoolmate robot; (S2A) The user sends the schoolmate robot through the main silicon wheat board / button The instruction to call the phone, the partner robot sends the instruction to the baseband chip module of the main board through the audio module, and searches the phonebook for its speech semantics through the baseband chip module of the main board; (S3A) searched in the dialing step (S2A) If the call is successful, go to step (S4A).
  • step (S2A) If the call is not successful, return to step (S2A); (S4A) match the received signal of the other party, encode and synthesize the user's voice through the baseband signal, and transmit it through the base station signal To the other party; (S5A) The other party's voice is transmitted to the baseband signal encoding and decoding through the base station signal, and the voice is restored through the audio module, and the restored content is played out through the sound output module to make the call.
  • step (S1) When the instruction issued by the user in step (S1) is to receive a call, it includes the following steps: (S1A) Install the SIM card in the SIM interface of the schoolmate robot; (S2A) The user dials the card number of the schoolmate robot through the mobile phone and passes the base station signal Transmit the signal to the schoolmate robot; (S3A) Receive the signal through the button on the schoolmate robot, then enter step (S4A), if the signal is rejected, return to step (S2A); (S4A) will receive The signal is encoded and decoded by the baseband signal, and then the voice is restored, and the voice signal is played through the speaker of the learning partner robot; (S5A) The user voice input through the learning partner robot is encoded and synthesized by the baseband signal and transmitted to the base station signal and transmitted to the mobile phone The receiving end realizes receiving calls.
  • the invention also discloses a learning companion robot system, which includes a learning companion robot and a control module installed in and electrically connected to the learning companion robot.
  • the control module includes a main board module, a braid light guide plate module, a charging board module, an expression board module, and buttons Board module, voice interaction silicon microphone module and sound output module; expression board module is used to control the dynamic changes of the eye expression of the schoolmate robot; the braid light guide plate module is connected to the expression board module, which is used to meet the colorful transformation of the schoolmate robot's braid ;
  • the charging board module is used to provide working power to the school partner robot;
  • the button board module is connected to the button of the school partner robot, which is used to provide instructions to the school partner robot;
  • the main board module is responsible for the operation of the school partner robot and the data of each module Processing and communication, including chip module, memory module, power management module, audio module, charging circuit module, key board interface and RGB expression board interface; charging circuit module and power management module are connected to the charging board module; key board interface connection To
  • the chip module includes a motherboard baseband chip module, an RF code chip module and a WIFI chip module; the RF code chip module and the WIFI chip module are both bidirectionally connected to the motherboard baseband chip module.
  • the audio module includes an audio circuit module, an audio power amplifier module and a voice recognition module; the audio circuit module is used to convert audio into an audio electrical signal; the audio power amplifier module is used to restore the voice digital signal, method and play through the speaker of the robot Out; voice recognition module is used to convert audio electrical signals into text digital electrical signals.
  • the charging circuit module includes a data transmission interface and a power supply interface.
  • the data transmission interface is electrically connected to the data transmission interface of the schoolmate robot
  • the power supply interface is electrically connected to the power supply interface of the schoolmate robot.
  • the power management module is provided with a TF card interface and a SIM card interface, and the SIM card interface is connected to the motherboard baseband chip module.
  • the motherboard baseband chip module is a baseband chip
  • the RF code chip module is an RF chip
  • the WIFI chip module is a WIFI chip
  • the memory module is an EMMC Flash memory, which includes 4GB ROM memory and 512MB DDR2 memory
  • the power management module is a power management chip .
  • the audio circuit module is provided with a main silicon wheat and a noise reduction wheat, the main silicon wheat and the noise reduction wheat are respectively connected to the main silicon wheat board and the noise reduction wheat board of the school partner robot; the audio power amplifier module is connected to the school partner through the speaker interface Robot horn.
  • the present invention combines a plurality of functional circuits through the setting of the control circuit to control the operation of the schoolmate robot, so that it can remotely chat with the schoolmate robot through the mobile phone, and can use the mobile phone to select the relevant content to be played Function.
  • control circuit Multiple functional circuits of the present invention are integrated in the control circuit, and the control circuit is installed in the school companion robot, which makes the school companion robot more compact in structure, smaller in size, compact in layout of each internal module, securely fixed, drop-resistant, and dirt-proof , Ergonomic design is more in line with children's consumer groups.
  • the present invention can directly retrieve data through the cloud platform knowledge base, integrating scientific and technical knowledge in many fields such as mathematics, physics, chemistry, biology, machinery, electronics, computer hardware, software, artificial intelligence, etc.
  • the fun of it effectively stimulates students' interest in learning, breaks through the previous learning methods, makes children more interested in learning, and reduces children's addiction to games, TV, etc., and cultivates children's good living habits and learning habits.
  • FIG. 1 is a framework diagram of a learning companion robot system of the present invention.
  • FIG. 2 is a schematic diagram of the voice interaction of the learning companion robot system of the present invention.
  • FIG. 3 is a principle diagram of the learning companion robot system of the present invention making a call.
  • FIG. 4 is a principle diagram of the learning companion robot system of the present invention receiving a call.
  • FIG. 5 is a schematic diagram of the network of the learning companion robot system of the present invention and the on-demand of the APP knowledge base.
  • FIG. 6 is a schematic diagram of the frame structure of the main board module of the learning companion robot system of the present invention.
  • FIG. 7 is a block diagram of the circuit structure of the control module of the learning companion robot system of the present invention.
  • FIG. 8 is a circuit schematic diagram of the key board module of the learning companion robot system of the present invention.
  • FIG. 9 is a circuit schematic diagram of the braided light guide plate module of the learning companion robot system of the present invention.
  • FIG. 10 is a circuit schematic diagram of the expression board module of the learning companion robot system of the present invention.
  • FIG. 11 is a circuit schematic diagram of a voice interaction silicon wheatboard module of a learning companion robot system of the present invention.
  • the present invention provides a method for implementing voice interaction / human-machine communication of a schoolmate robot, which includes the following steps: (S1) The user issues instructions to the schoolmate robot through the main silicon wheat board / button , The partner robot transfers the dialogue content to the mainboard baseband chip module through the audio module, and performs a text search on its speech semantics through the mainboard baseband chip module; (S2) the content of the text search in the step (S1) through the baseband signal encoding synthesis, and Transmit to the cloud platform knowledge base through the WIFI network signal / base station signal, and retrieve the corresponding content in the cloud platform knowledge base; (S3) encode and decode the content retrieved in step (S2) through the baseband signal and pass the WIFI network signal / The base station signal is transmitted to the audio module for voice restoration and audio restoration; (S4) The content restored in step (S3) is played through the sound output module to realize human-machine voice interaction.
  • S1 The user issues instructions to the schoolmate robot through the main silicon wheat board / button ,
  • step (S1) When the instruction issued by the user in step (S1) is to make a call, it includes the following steps: (S1A) Install a SIM card in the SIM interface of the schoolmate robot; (S2A) The user sends the schoolmate robot through the main silicon wheat board / button The instruction to call the phone, the partner robot sends the instruction to the baseband chip module of the main board through the audio module, and searches the phonebook for its speech semantics through the baseband chip module of the main board; (S3A) searched in the dialing step (S2A) If the call is successful, go to step (S4A).
  • step (S2A) If the call is not successful, return to step (S2A); (S4A) match the received signal of the other party, encode and synthesize the user's voice through the baseband signal, and transmit it through the base station signal To the other party; (S5A) The other party's voice is transmitted to the baseband signal encoding and decoding through the base station signal, and the voice is restored through the audio module, and the restored content is played out through the sound output module to make the call.
  • step (S1) When the instruction issued by the user in step (S1) is to receive a call, it includes the following steps: (S1A) Install the SIM card in the SIM interface of the schoolmate robot; (S2A) The user dials the card number of the schoolmate robot through the mobile phone and passes the base station signal Transmit the signal to the schoolmate robot; (S3A) Receive the signal through the button on the schoolmate robot, then enter step (S4A), if the signal is rejected, return to step (S2A); (S4A) will receive The signal is encoded and decoded by the baseband signal, and then the voice is restored, and the voice signal is played through the speaker of the learning partner robot; (S5A) The user voice input through the learning partner robot is encoded and synthesized by the baseband signal and transmitted to the base station signal and transmitted to the mobile phone The receiving end, to receive calls.
  • the invention also discloses a learning companion robot system, which includes a learning companion robot and a control module installed in and electrically connected to the learning companion robot.
  • the control module includes a main board module, a braid light guide plate module, a charging board module, an expression board module, and buttons Board module, voice interaction silicon microphone module and sound output module; expression board module is used to control the dynamic changes of the eye expression of the schoolmate robot; the braid light guide plate module is connected to the expression board module, which is used to meet the colorful transformation of the schoolmate robot's braid ;
  • the charging board module is used to provide working power to the school partner robot;
  • the button board module is connected to the button of the school partner robot, which is used to provide instructions to the school partner robot;
  • the main board module is responsible for the operation of the school partner robot and the data of each module Processing and communication, including chip module, memory module, power management module, audio module, charging circuit module, key board interface and RGB expression board interface; charging circuit module and power management module are connected to the charging board module; key board interface connection To
  • the chip module includes a motherboard baseband chip module, an RF code chip module and a WIFI chip module; the RF code chip module and the WIFI chip module are both bidirectionally connected to the motherboard baseband chip module.
  • the audio module includes an audio circuit module, an audio power amplifier module and a voice recognition module; the audio circuit module is used to convert audio into an audio electrical signal; the audio power amplifier module is used to restore the voice digital signal, method and play through the speaker of the robot Out; voice recognition module is used to convert audio electrical signals into text digital electrical signals.
  • the charging circuit module includes a data transmission interface and a power supply interface.
  • the data transmission interface is electrically connected to the data transmission interface of the schoolmate robot
  • the power supply interface is electrically connected to the power supply interface of the schoolmate robot.
  • the power management module is provided with a TF card interface and a SIM card interface, and the SIM card interface is connected to the motherboard baseband chip module.
  • the motherboard baseband chip module is the baseband chip AI
  • the RF code chip module is the RF chip RF
  • the WIFI chip module is the WIFI chip WIFI
  • the memory module is the EMMC Flash memory, which includes 4GB ROM memory and 512MB DDR2 memory
  • the power management module is Power management chip PMIC.
  • the audio circuit module is provided with a main silicon wheat and a noise reduction wheat, the main silicon wheat and the noise reduction wheat are respectively connected to the main silicon wheat board and the noise reduction wheat board of the school partner robot; the audio power amplifier module is connected to the school partner through the speaker interface Robot horn.
  • the invention realizes the learning companion robot networking and the APP knowledge base on-demand principle: using a mobile phone to connect to the network, opening the APP software on the mobile phone, and entering the SN serial number of the robot or scanning the robot in the device management of the APP SN serial number two-dimensional code, bind the robot to the robot's mobile phone APP, after binding, click the device WIFI on the APP home interface, enter the WIFI name and password in the menu and connect to the network, the APP automatically generates a network hotspot to connect the robot and robot Read and save the WIFI name and password through the network hotspot, the WIFI network signal is NG, the transmission fails, and the network connection fails, then reconnect to the network; the WIFI network signal is OK, after the network connection is successful, the WIFI user and password are automatically saved, unchanged in the network environment In the case, the robot automatically connects to the network after it is turned on.
  • the robot Receive the baseband signal code sent by the APP platform, the robot decodes the audio and voice, and restores the sound through the speaker.
  • the principle of learning voice interaction of a companion robot is as follows: the robot picks up human voice through voice interaction technology and converts it into semantic text.
  • the robot searches the keyword by recognizing the voice semantic text and extracting the voice semantics.
  • the searched keywords are converted into baseband signals; after the baseband signals are synthesized, the robot preferentially transmits via WIFI signals (if there is no WIFI, select the baseband data signal network provided by the 2G / 3G mobile phone SIM phone card or mobile phone flow card, and transmit them through the base station signal), which will be synthesized
  • the baseband signal is sent to the cloud platform knowledge base, and the matching related content is searched.
  • the cloud platform server transmits the relevant information to the robot.
  • the robot preferentially uses the WIFI network to receive information.
  • the baseband data signal network of the mobile phone card is selected to receive the cloud.
  • Platform information after receiving the signal, the robot encodes and decodes the baseband signal, restores the voice or audio, and plays the restored sound through the speaker on the robot.
  • the principle of learning to accompany a robot to make a phone call is as follows: the robot uses voice interaction technology, and the user speaks the name or phone number of the person being dialed. After the robot picks up the voice, it is converted into semantic text. Keyword search for extracting speech semantic text, the robot searches the phone number in the SIM card phone book inside the robot, or the robot directly dials the phone number directly spoken by the person through voice interaction.
  • the robot After the mobile phone party receives and matches the signal, the robot will pick up the user's voice Converted to baseband signals, encoded and synthesized, the baseband data signal network provided by the SIM phone card is transmitted through the base station signal, and the opponent's mobile phone receives the robot's speech voice signal; the opponent's mobile phone user's voice signal is transmitted through the base station signal, and the robot receives its After the baseband signal is encoded, the decoding will restore the voice, and the voice will be played through the speaker to realize the call between the robot and the mobile phone user.
  • the principle of learning to accompany the robot to receive a call in the present invention is: after the mobile phone dials the robot SIM card number, presses the robot middle button to receive, the robot phone call function is turned on, the baseband coded signal of the mobile phone is transmitted through the base station signal, the robot Receive the baseband signal encoding of the other party's mobile phone, decode it through the robot's baseband module, restore the sound, restore the sound of the other party's mobile phone through the speaker, and press the key to connect to the other party's mobile phone, the user can speak to the robot, and the robot will convert the user's voice Become the baseband signal coding, and the relevant baseband signal coding and synthesis, through the base station signal transmission, to achieve remote communication with other mobile phone users.
  • the learning companion robot system of the present invention uses an Android system to achieve operation.
  • the mainboard module uses a baseband main system chip.
  • the module is the central processor of the robot, manages the system memory, installs the Android software operating system, and the system provides power through the power management module MT6323GA. 4900MAH polymer lithium ion battery is selected.
  • the battery supplies power to the robot through the power management module and provides stable power for the baseband main system module, audio circuit module, memory module, WIFI module, etc.
  • the charging circuit module of the present invention includes a charging circuit, an Android motherboard charging socket and a Micro USB interface.
  • the robot charges the battery through the charging board and the charging circuit of the motherboard after the robot is connected to the USB charging line; the robot passes through the main audio module
  • the silicon wheat board of the silicon wheat and the silicon wheat board of the noise reduction silicon wheat receive the user's voice, convert the sound into an audio electrical signal through the audio circuit module, and the audio recognition module converts the audio electrical signal into a text digital electrical signal;
  • the memory module EMMC Flash (4GB ROM + 512MB DDR2) provides data space for motherboard baseband chip module operation.
  • the frame structure of the motherboard module of the present invention includes: a TF card holder 1-1, which is inserted with a TF card; a SIM card holder 1-2, which is inserted with a SIM card; a motherboard fixing hole 1-3; Stupid holes 1-4.
  • Main components are installed on the frame structure of the motherboard module to achieve the above functions.
  • the mobile phone SIM card or mobile phone flow card is inserted, the robot picks up the human voice through the main silicon wheat board and the noise reduction and noise reduction silicon wheat board, and the audio circuit module converts the human voice into voice and audio blur Electric signal, human voice and audio fuzzy electric signal are converted into text digital signal after being processed by the baseband chip of the motherboard, and the processed text digital signal is synthesized into the baseband communication code through the RF chip.
  • the 26M crystal oscillator triggers the signal according to a certain frequency, and the RF chip
  • the synthesized baseband communication signal is sent (TX) to the finite element chip (FEM).
  • the finite element chip decomposes the baseband signal into several continuous and stable wireless signals, which are sent out through the wireless communication antenna, and the wireless signals are transferred through the signal of the communication base station.
  • the cloud platform server After receiving the robot-related wireless signal, the cloud platform server searches for related content, feeds the relevant content back to the robot through the wireless signal, the robot wireless communication antenna receives the cloud platform feedback signal, and sends the wireless signal through the finite element chip (FEM) Integrate into a complete wireless signal, RX (RX means receive) wireless signal to the RF chip, the RF chip restores the signal to a baseband communication signal, and the baseband chip MT6572AX converts the baseband communication signal into a baseband signal into a text digital signal, text digital The signal is converted into an audio signal.
  • the audio power amplifier restores and amplifies the voice digital signal and plays it through the speaker to realize the voice interaction between the human and the robot; or the wireless signal of the robot is relayed through the signal of the communication base station and received by another mobile phone.
  • the related wireless signals of the robot, the wireless signals transmitted by the mobile phone are transferred through the base station communication, and the wireless communication antenna of the robot is received. In the same way as above, the received signal is restored to voice or audio and played through the robot's speaker.
  • the robot prefers or selects the WIFI network for wireless communication regardless of whether a mobile phone SIM card or a mobile phone flow card is inserted.
  • the robot picks up through the main silicon wheat board and the noise reduction and noise reduction silicon wheat board.
  • the human voice, the audio circuit module converts the human voice into a voice and audio fuzzy electrical signal.
  • the human voice and audio fuzzy electrical signal undergoes signal processing through the motherboard baseband chip and is converted into a text digital signal through WIFI + Bluetooth + GPS + FM
  • the WIFI chip module composed of one chip synthesizes the processed text data signal into baseband communication coding.
  • TCXO is a quartz crystal oscillator that reduces the amount of change in the oscillation frequency caused by the change in ambient temperature through an additional temperature compensation circuit.
  • the baseband communication signal of the WIFI module contract is sent to the nearby server through the WIFI antenna.
  • the cloud platform server receives the robot-related wireless signal, it searches and queries related content, and feeds back the baseband communication signal of the related content to the robot.
  • the WIFI antenna of the robot receives the signal fed back by the cloud platform, and the WIFI module converts the baseband communication signal fed back by the cloud platform.
  • the baseband communication signal converts the baseband communication signal into a baseband signal into a text digital signal through a motherboard baseband chip.
  • the audio power amplifier restores and amplifies the voice digital signal and plays it through the speaker to realize the voice interaction between human and robot.
  • the baseboard chip of the main board transmits the LED lamp change signal of the expression board to the expression board and braid lamp board of the schoolmate robot.
  • the expression board contains two rows of 8 RGB LED lights in parallel, and the LED lights pass through the RGB breathing lights.
  • the driver IC implements seven transformations to meet the dynamic transformation of eye expressions.
  • the expression board also includes a light guide board interface; the braid lamp board contains an RGB lamp and interface.
  • the braid lamp board is connected to the RGB breathing lamp driver IC on the expression board to meet intelligent voice
  • the dreadlocks of the companion robot are colorfully changed.
  • the LED of the expression board changes the style of the expression light and the RGB color of the LED according to the program to form a changing expression of the robot.
  • the braid light changes according to the RGB color of the LED of the expression board.
  • the robot braid provides colorful light color changes.
  • the expression board performs the corresponding expression change. After the robot has not worked for 5 minutes, the robot reaches the sleep state, the change of the expression board and the braid lamp board stops, LED Turn off the lights, the robot sleeps as a whole to save energy.
  • the expression board is a combination of the LED array group, the change of LED on and off and the change of RGB color to form the expression change of the robot, and has the function of charging indication. As shown in FIG. 10, the circuit in part A controls the expression change of the left eye of the robot, and the circuit in part B controls the expression change of the right eye of the robot.
  • the robot of the invention controls the playing rhythm of the robot through the switch buttons.
  • the button board of the learning partner robot includes 5 switches and a button board interface. The user can control the intelligent voice learning partner robot through the button board, and the functions of the switches from left to right are in turn. For previous song / wake up (left button), volume up button (left middle button), pause / play (short press) / connect to network (long press) (middle button), volume down button (right middle button), down One song / network playback stops (right button).
  • the switch button board includes a switch button board substrate 4-1 and a button switch 4-2.
  • the switch button board substrate is a rectangular substrate, and there are card slot holes to limit the switch button board substrate.
  • the charging circuit module of the present invention also includes the charging strategy and overcharging protection strategy of the mainboard module; the present invention also includes an auxiliary circuit board charging board module and a lithium battery charging management system.
  • the auxiliary circuit board charging board module includes a charging treasure IC; lithium battery charging management The system has battery fuel metering and four-segment LED charging instructions; the auxiliary circuit board charging board module also contains 2 Micro USB ports, battery sockets, Android motherboard power sockets and toggle switches. The toggle switches control the power of the whole machine.
  • the Micro USB interface on the side of the movable switch is responsible for charging power supply and data transmission.
  • the intelligent voice learning robot can be charged and refreshed through the Micro USB interface; the charging circuit module uses a fixed baffle USB interface with a PC material with an opening to achieve fixed charging The purpose of the board.

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • Automation & Control Theory (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Toys (AREA)

Abstract

A method for realizing voice interaction/man-robot conversation of a learning accompanying robot, comprising the following steps: a user gives an instruction to the learning accompanying robot by means of a main silicon microphone board/a button, and the learning accompanying robot transmits conversation content to a mainboard baseband chip module by means of an audio module, and performs text searching for the voice semantics of the conversation content by means of the mainboard baseband chip module; the content of the foregoing text searching is synthesized by means of a baseband signal code, and is transmitted to a cloud platform repository by means of a WiFi network signal/a base station signal, and the corresponding content is invoked from the cloud platform repository; the content is decoded by means of the baseband signal code, and is transmitted to the audio module by means of the WiFi network signal/the base station signal so as to perform voice reproduction and audio reproduction; and the reproduced content is played by means of a sound output module, so that man-robot voice interaction is realized. By using a voice technology, the present application realizes man-robot voice interaction, connects a cloud platform database, and selectively searches for the content required by a consumer by means of a large database technology.

Description

实现语音交互/人机通话的学习陪伴机器人***及其方法Learning companion robot system and method for realizing voice interaction / man-machine conversation 技术领域Technical field
本发明涉及教学电子产品，更特别地涉及一种实现语音交互/人机通话的学习陪伴机器人***及其方法。The invention relates to teaching electronic products, and more particularly to a learning companion robot system and method for realizing voice interaction / man-machine conversation.
背景技术Background technique
随着人工智能技术的发展，机器人技术是一种是以自动化技术和计算机技术为主体、有机融合各种现代信息技术的***集成和应用。人工智能技术的突破，从根本上为提升机器人技术研究提供了必要的支持，为机器人的应用范围拓宽了道路，己广泛涵盖国防、航空航天、工业生产，教育服务等领域，科技革新是机器人技术研究的时代和当今社会发展。随着国民生活水平提高及文化素质的提升，人类己广泛的进入科技时代，小型机器人己进入千家万户伴随着人们生活，培养国人文化及素养从小孩抓起，早教机器人发挥着广大的领域，加强小孩的记忆，培养小孩的兴趣，逐步代替老师的备课、讲课、授课、训练等。With the development of artificial intelligence technology, robot technology is a system integration and application that is based on automation technology and computer technology and organically integrates various modern information technologies. The breakthrough of artificial intelligence technology has fundamentally provided the necessary support for the improvement of robot technology research and broadened the path of robot applications. It has widely covered defense, aerospace, industrial production, education services and other fields. Technological innovation is robot technology The era of research and the development of today's society. With the improvement of people's living standards and the improvement of cultural quality, humans have entered the era of science and technology, small robots have entered thousands of households with people's lives, the cultivation of Chinese culture and literacy starts from children, and early education robots play a broad field. Strengthen children's memory, cultivate children's interest, and gradually replace the teacher's lesson preparation, lecture, teaching, training, etc.
目前市场上现有的早教设备大部分功能比较单一，智能播放本机内部预存的内容，获取的知识量少，消费者只能获取简单的知识，并且无法进行知识的更新，并且还缺乏机器与人的互动。另外，用于儿童早教学习的智能语音学伴机器人技术刚刚起步，市场上已有相关产品体积比较大，重量比较重，不耐摔，不方便携带和提拿，年龄较小的儿童使用时非常不方便。At present, most of the early education devices on the market have a single function, and intelligently play the content stored in the machine. The amount of knowledge acquired is small. Consumers can only obtain simple knowledge, and they cannot update knowledge. Human interaction. In addition, the intelligent voice learning robot technology used for early childhood education and learning has just started. The related products on the market are relatively large in size, heavy in weight, not resistant to falling, inconvenient to carry and carry. inconvenient.
综上，故有必要研发一种实现语音交互/人机通话的学习陪伴机器人***及其方法。In summary, it is necessary to develop a learning companion robot system and method for realizing voice interaction / human-machine communication.
发明内容Summary of the invention
本发明提供一种实现语音交互/人机通话的学***台数据库，通过大数据库技术，选择搜索消费者需要的内容；解决了现有技术中早教设备知识单一、知识少、知识没有更新、缺乏与人互动的缺 点。The invention provides a learning companion robot system and method for realizing voice interaction / man-machine communication, which uses voice technology, human and robot voice interaction, connects to a cloud platform database, and selects and searches content required by consumers through large database technology; It solves the shortcomings in the prior art that the early education equipment has single knowledge, little knowledge, no update of knowledge, and lack of interaction with people.
为实现上述目的，本发明是通过如下技术方案实现的。To achieve the above objectives, the present invention is achieved by the following technical solutions.
首先，本发明提供了一种实现学伴机器人的语音交互/人机通话的方法，其包括如下步骤：(S1)用户通过主硅麦板/按键对学伴机器人下达指令，学伴机器人通过音频模块将对话内容输送至主板基带芯片模块，并通过主板基带芯片模块对其语音语义进行文字搜索；(S2)通过基带信号编码合成步骤(S1)中文字搜索的内容，并通过WIFI网络信号/基站信号传输至云平台知识库，并在云平台知识库中调取对应的内容；(S3)将步骤(S2)中调取的内容通过基带信号编码解码，通过WIFI网络信号/基站信号传输至音频模块进行语音还原和音频还原；(S4)通过声音输出模块将步骤(S3)还原后的内容播放出来，实现人机语音交互。First of all, the present invention provides a method for realizing voice interaction / human-machine communication of a schoolmate robot, which includes the following steps: (S1) The user issues instructions to the schoolmate robot through the main silicon wheat board / button, and the schoolmate robot uses audio The module transfers the dialogue content to the motherboard baseband chip module, and performs a text search on its speech semantics through the motherboard baseband chip module; (S2) the content of the text search in the step (S1) through the baseband signal encoding synthesis, and through the WIFI network signal / base station The signal is transmitted to the cloud platform knowledge base, and the corresponding content is retrieved from the cloud platform knowledge base; (S3) the content retrieved in step (S2) is encoded and decoded through the baseband signal, and transmitted to the audio through the WIFI network signal / base station signal The module performs voice restoration and audio restoration; (S4) Play the content restored in step (S3) through the sound output module to realize human-machine voice interaction.
当步骤(S1)中用户下达的指令为拨打电话时，其包括如下步骤：(S1A)在学伴机器人的SIM接口内安装SIM卡；(S2A)用户通过主硅麦板/按键对学伴机器人发出拨打电话的指令，学伴机器人通过音频模块将该指令输送至主板基带芯片模块，并通过主板基带芯片模块对其语音语义在电话簿中进行文字搜索；(S3A)拨打步骤(S2A)中搜索到的电话，如拨打成功，则进入步骤(S4A)，如未拨打成功，则返回至步骤(S2A)；(S4A)与对方接收信号匹配，将用户语音通过基带信号编码合成，并通过基站信号传输至对方；(S5A)对方的语音通过基站信号传输至基带信号编码解码，并通过音频模块进行语音还原，通过声音输出模块将还原后的内容播放出来，实现拨打电话。When the instruction issued by the user in step (S1) is to make a call, it includes the following steps: (S1A) Install a SIM card in the SIM interface of the schoolmate robot; (S2A) The user sends the schoolmate robot through the main silicon wheat board / button The instruction to call the phone, the partner robot sends the instruction to the baseband chip module of the main board through the audio module, and searches the phonebook for its speech semantics through the baseband chip module of the main board; (S3A) searched in the dialing step (S2A) If the call is successful, go to step (S4A). If the call is not successful, return to step (S2A); (S4A) match the received signal of the other party, encode and synthesize the user's voice through the baseband signal, and transmit it through the base station signal To the other party; (S5A) The other party's voice is transmitted to the baseband signal encoding and decoding through the base station signal, and the voice is restored through the audio module, and the restored content is played out through the sound output module to make the call.
当步骤(S1)中用户下达的指令为接收电话时，其包括如下步骤：(S1A)在学伴机器人的SIM接口内安装SIM卡；(S2A)用户通过手机拨打学伴机器人的***，通过基站信号传输将信号传送至学伴机器人；(S3A)通过学伴机器人上的按键接收该信号，则进入步骤(S4A)，如拒收该信号，则返回至步骤(S2A)；(S4A)将接收到的信号通过基带信号编码解码，再语音还原，通过学伴机器人的喇叭将语音信号播放出来；(S5A)通过学伴机器人输入的用户语音则通过基带信号编码合成，并发射至基站信号传输至手机接收端， 实现接收电话。When the instruction issued by the user in step (S1) is to receive a call, it includes the following steps: (S1A) Install the SIM card in the SIM interface of the schoolmate robot; (S2A) The user dials the card number of the schoolmate robot through the mobile phone and passes the base station signal Transmit the signal to the schoolmate robot; (S3A) Receive the signal through the button on the schoolmate robot, then enter step (S4A), if the signal is rejected, return to step (S2A); (S4A) will receive The signal is encoded and decoded by the baseband signal, and then the voice is restored, and the voice signal is played through the speaker of the learning partner robot; (S5A) The user voice input through the learning partner robot is encoded and synthesized by the baseband signal and transmitted to the base station signal and transmitted to the mobile phone The receiving end realizes receiving calls.
本发明还公开一种学习陪伴机器人***，其包括学伴机器人和安装在学伴机器人内并与其电连接的控制模块，控制模块包括主板模块、辫子导光板模块、充电板模块、表情板模块、按键板模块、语音交互硅麦模块和声音输出模块；表情板模块用于控制学伴机器人眼睛表情的动态变化；辫子导光板模块与表情板模块连接，其用于满足学伴机器人的辫子炫彩变换；充电板模块用于给学伴机器人提供工作电源；按键板模块连接至学伴机器人的按键，其用于给学伴机器人提供指令；主板模块用于负责学伴机器人的运行和各模块的数据处理及通讯，其包括芯片模块、存储器模块、电源管理模块、音频模块、充电电路模块、按键板接口和RGB表情板接口；充电电路模块、电源管理模块均连接至充电板模块；按键板接口连接至按键板模块；RGB表情板接口连接至表情板模块；音频模块、声音输出模块分别连接至语音交互硅麦模块。The invention also discloses a learning companion robot system, which includes a learning companion robot and a control module installed in and electrically connected to the learning companion robot. The control module includes a main board module, a braid light guide plate module, a charging board module, an expression board module, and buttons Board module, voice interaction silicon microphone module and sound output module; expression board module is used to control the dynamic changes of the eye expression of the schoolmate robot; the braid light guide plate module is connected to the expression board module, which is used to meet the colorful transformation of the schoolmate robot's braid ; The charging board module is used to provide working power to the school partner robot; the button board module is connected to the button of the school partner robot, which is used to provide instructions to the school partner robot; the main board module is responsible for the operation of the school partner robot and the data of each module Processing and communication, including chip module, memory module, power management module, audio module, charging circuit module, key board interface and RGB expression board interface; charging circuit module and power management module are connected to the charging board module; key board interface connection To the key board module; the RGB expression board interface is connected to the expression board module; the audio module and the sound output module are respectively connected to the voice interaction silicon microphone module.
其中，芯片模块包括主板基带芯片模块、RF调码芯片模块和WIFI芯片模块；RF调码芯片模块、WIFI芯片模块均双向连接至主板基带芯片模块。Among them, the chip module includes a motherboard baseband chip module, an RF code chip module and a WIFI chip module; the RF code chip module and the WIFI chip module are both bidirectionally connected to the motherboard baseband chip module.
其中，音频模块包括音频电路模块、音频功放模块和语音识别模块；音频电路模块用于将音频转化为音频电信号；音频功放模块用于将语音数字信号还原、方法并通过学伴机器人的喇叭播放出来；语音识别模块用于将音频电信号转化为文本数字电信号。Among them, the audio module includes an audio circuit module, an audio power amplifier module and a voice recognition module; the audio circuit module is used to convert audio into an audio electrical signal; the audio power amplifier module is used to restore the voice digital signal, method and play through the speaker of the robot Out; voice recognition module is used to convert audio electrical signals into text digital electrical signals.
其中，充电电路模块包括数据传输接口和电源接口，数据传输接口电连接至学伴机器人的数据传输接口，电源接口电连接至学伴机器人的电源接口。Wherein, the charging circuit module includes a data transmission interface and a power supply interface. The data transmission interface is electrically connected to the data transmission interface of the schoolmate robot, and the power supply interface is electrically connected to the power supply interface of the schoolmate robot.
其中，电源管理模块上设有TF卡接口和SIM卡接口，且SIM卡接口连接至主板基带芯片模块。Among them, the power management module is provided with a TF card interface and a SIM card interface, and the SIM card interface is connected to the motherboard baseband chip module.
其中，主板基带芯片模块为基带芯片，RF调码芯片模块为RF芯片，WIFI芯片模块为WIFI芯片；存储器模块为EMMC Flash存储器，其包括4GB ROM存储器和512MB DDR2存储器；电源管理模块为电源管理芯片。Among them, the motherboard baseband chip module is a baseband chip, the RF code chip module is an RF chip, and the WIFI chip module is a WIFI chip; the memory module is an EMMC Flash memory, which includes 4GB ROM memory and 512MB DDR2 memory; the power management module is a power management chip .
其中，音频电路模块上设有主硅麦和降噪麦，主硅麦、降噪麦 分别连接至学伴机器人的主硅麦板和降噪麦板；音频功放模块通过喇叭接口连接至学伴机器人的喇叭。Among them, the audio circuit module is provided with a main silicon wheat and a noise reduction wheat, the main silicon wheat and the noise reduction wheat are respectively connected to the main silicon wheat board and the noise reduction wheat board of the school partner robot; the audio power amplifier module is connected to the school partner through the speaker interface Robot horn.
综上所述，本发明的有益效果在于：In summary, the beneficial effects of the present invention are:
1)本发明通过控制电路的设置，将多个功能电路组合，用于控制学伴机器人的运行，使其能通过手机远程与学伴机器人进行聊天通话，并可采用手机选择需要播放的相关内容的功能。1) The present invention combines a plurality of functional circuits through the setting of the control circuit to control the operation of the schoolmate robot, so that it can remotely chat with the schoolmate robot through the mobile phone, and can use the mobile phone to select the relevant content to be played Function.
2)本发明多个功能电路集成在控制电路内，控制电路安装在学伴机器人内，使得学伴机器人的结构更加紧凑，体积更小，内部各个模组布局紧凑，固定牢靠，耐摔，防脏，人机工程设计更加符合儿童消费群体使用。2) Multiple functional circuits of the present invention are integrated in the control circuit, and the control circuit is installed in the school companion robot, which makes the school companion robot more compact in structure, smaller in size, compact in layout of each internal module, securely fixed, drop-resistant, and dirt-proof , Ergonomic design is more in line with children's consumer groups.
3)本发明可直接通过云平台知识库调取数据，集成了数学、物理、化学、生物、机械、电子、计算机硬件、软件、人工智能等众多领域的科学与技术知识，使其具有很高的趣味性，有效激发学生对学习的兴趣，突破以往的学习方式，使孩子对学习更加感兴趣，也减少孩子沉迷于游戏、电视等，培养孩子良好的生活习惯和学习习惯。3) The present invention can directly retrieve data through the cloud platform knowledge base, integrating scientific and technical knowledge in many fields such as mathematics, physics, chemistry, biology, machinery, electronics, computer hardware, software, artificial intelligence, etc. The fun of it effectively stimulates students' interest in learning, breaks through the previous learning methods, makes children more interested in learning, and reduces children's addiction to games, TV, etc., and cultivates children's good living habits and learning habits.
附图说明BRIEF DESCRIPTION
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, without paying any creative work, other drawings can be obtained based on these drawings.
图1为本发明学习陪伴机器人***的框架图。FIG. 1 is a framework diagram of a learning companion robot system of the present invention.
图2为本发明学习陪伴机器人***语音交互的原理图。2 is a schematic diagram of the voice interaction of the learning companion robot system of the present invention.
图3为本发明学习陪伴机器人***拨打电话的原理图。FIG. 3 is a principle diagram of the learning companion robot system of the present invention making a call.
图4为本发明学习陪伴机器人***接收电话的原理图。FIG. 4 is a principle diagram of the learning companion robot system of the present invention receiving a call.
图5为本发明学习陪伴机器人***连网和APP知识库点播的原理图。FIG. 5 is a schematic diagram of the network of the learning companion robot system of the present invention and the on-demand of the APP knowledge base.
图6为本发明学习陪伴机器人***主板模块的框架结构示意图。6 is a schematic diagram of the frame structure of the main board module of the learning companion robot system of the present invention.
图7为本发明学习陪伴机器人***控制模块的电路结构框图。7 is a block diagram of the circuit structure of the control module of the learning companion robot system of the present invention.
图8为本发明学习陪伴机器人***按键板模块的电路原理图。8 is a circuit schematic diagram of the key board module of the learning companion robot system of the present invention.
图9为本发明学习陪伴机器人***辫子导光板模块的电路原理图。9 is a circuit schematic diagram of the braided light guide plate module of the learning companion robot system of the present invention.
图10为本发明学习陪伴机器人***表情板模块的电路原理图。10 is a circuit schematic diagram of the expression board module of the learning companion robot system of the present invention.
图11为本发明学习陪伴机器人***语音交互硅麦板模块的电路原理图。FIG. 11 is a circuit schematic diagram of a voice interaction silicon wheatboard module of a learning companion robot system of the present invention.
具体实施方式detailed description
下面通过具体的实施例对本发明进行详细说明，但这些例举性实施方式的用途和目的仅用来例举本发明，并非对本发明的实际保护范围构成任何形式的任何限定，更非将本发明的保护范围局限于此。The present invention will be described in detail below through specific examples, but the purpose and purpose of these exemplary embodiments are only used to exemplify the present invention, and do not constitute any limitation on the actual protection scope of the present invention in any form, let alone the present invention. The scope of protection is limited to this.
为了有助于和澄清随后的实施例的描述，在对本发明的具体实施方式进行详细说明之前，对部分术语进行解释，下列的解释应用于本说明书以及权利要求书。In order to help and clarify the description of the subsequent embodiments, before describing the specific embodiments of the present invention in detail, some terms are explained, and the following explanations apply to this specification and claims.
本发明中出现的英文词语均为代码，不代表其它任何意义。The English words appearing in the present invention are codes and do not represent any other meaning.
如图1-11所示，本发明提供了一种实现学伴机器人的语音交互/人机通话的方法，其包括如下步骤：(S1)用户通过主硅麦板/按键对学伴机器人下达指令，学伴机器人通过音频模块将对话内容输送至主板基带芯片模块，并通过主板基带芯片模块对其语音语义进行文字搜索；(S2)通过基带信号编码合成步骤(S1)中文字搜索的内容，并通过WIFI网络信号/基站信号传输至云平台知识库，并在云平台知识库中调取对应的内容；(S3)将步骤(S2)中调取的内容通过基带信号编码解码，通过WIFI网络信号/基站信号传输至音频模块进行语音还原和音频还原；(S4)通过声音输出模块将步骤(S3)还原后的内容播放出来，实现人机语音交互。As shown in FIGS. 1-11, the present invention provides a method for implementing voice interaction / human-machine communication of a schoolmate robot, which includes the following steps: (S1) The user issues instructions to the schoolmate robot through the main silicon wheat board / button , The partner robot transfers the dialogue content to the mainboard baseband chip module through the audio module, and performs a text search on its speech semantics through the mainboard baseband chip module; (S2) the content of the text search in the step (S1) through the baseband signal encoding synthesis, and Transmit to the cloud platform knowledge base through the WIFI network signal / base station signal, and retrieve the corresponding content in the cloud platform knowledge base; (S3) encode and decode the content retrieved in step (S2) through the baseband signal and pass the WIFI network signal / The base station signal is transmitted to the audio module for voice restoration and audio restoration; (S4) The content restored in step (S3) is played through the sound output module to realize human-machine voice interaction.
当步骤(S1)中用户下达的指令为拨打电话时，其包括如下步骤：(S1A)在学伴机器人的SIM接口内安装SIM卡；(S2A)用户通过主硅麦板/按键对学伴机器人发出拨打电话的指令，学伴机器人通过音频模块将该指令输送至主板基带芯片模块，并通过主板基带芯片模块对其语音语义在电话簿中进行文字搜索；(S3A)拨打步骤(S2A)中搜索到的电话，如拨打成功，则进入步骤(S4A)，如未拨打成功，则返回至步骤(S2A)；(S4A)与对方接收信号匹配，将用户语音通过基带信号编码合成，并通过基站信号传输至对方；(S5A)对方的 语音通过基站信号传输至基带信号编码解码，并通过音频模块进行语音还原，通过声音输出模块将还原后的内容播放出来，实现拨打电话。When the instruction issued by the user in step (S1) is to make a call, it includes the following steps: (S1A) Install a SIM card in the SIM interface of the schoolmate robot; (S2A) The user sends the schoolmate robot through the main silicon wheat board / button The instruction to call the phone, the partner robot sends the instruction to the baseband chip module of the main board through the audio module, and searches the phonebook for its speech semantics through the baseband chip module of the main board; (S3A) searched in the dialing step (S2A) If the call is successful, go to step (S4A). If the call is not successful, return to step (S2A); (S4A) match the received signal of the other party, encode and synthesize the user's voice through the baseband signal, and transmit it through the base station signal To the other party; (S5A) The other party's voice is transmitted to the baseband signal encoding and decoding through the base station signal, and the voice is restored through the audio module, and the restored content is played out through the sound output module to make the call.
当步骤(S1)中用户下达的指令为接收电话时，其包括如下步骤：(S1A)在学伴机器人的SIM接口内安装SIM卡；(S2A)用户通过手机拨打学伴机器人的***，通过基站信号传输将信号传送至学伴机器人；(S3A)通过学伴机器人上的按键接收该信号，则进入步骤(S4A)，如拒收该信号，则返回至步骤(S2A)；(S4A)将接收到的信号通过基带信号编码解码，再语音还原，通过学伴机器人的喇叭将语音信号播放出来；(S5A)通过学伴机器人输入的用户语音则通过基带信号编码合成，并发射至基站信号传输至手机接收端，实现接收电话。When the instruction issued by the user in step (S1) is to receive a call, it includes the following steps: (S1A) Install the SIM card in the SIM interface of the schoolmate robot; (S2A) The user dials the card number of the schoolmate robot through the mobile phone and passes the base station signal Transmit the signal to the schoolmate robot; (S3A) Receive the signal through the button on the schoolmate robot, then enter step (S4A), if the signal is rejected, return to step (S2A); (S4A) will receive The signal is encoded and decoded by the baseband signal, and then the voice is restored, and the voice signal is played through the speaker of the learning partner robot; (S5A) The user voice input through the learning partner robot is encoded and synthesized by the baseband signal and transmitted to the base station signal and transmitted to the mobile phone The receiving end, to receive calls.
本发明还公开一种学习陪伴机器人***，其包括学伴机器人和安装在学伴机器人内并与其电连接的控制模块，控制模块包括主板模块、辫子导光板模块、充电板模块、表情板模块、按键板模块、语音交互硅麦模块和声音输出模块；表情板模块用于控制学伴机器人眼睛表情的动态变化；辫子导光板模块与表情板模块连接，其用于满足学伴机器人的辫子炫彩变换；充电板模块用于给学伴机器人提供工作电源；按键板模块连接至学伴机器人的按键，其用于给学伴机器人提供指令；主板模块用于负责学伴机器人的运行和各模块的数据处理及通讯，其包括芯片模块、存储器模块、电源管理模块、音频模块、充电电路模块、按键板接口和RGB表情板接口；充电电路模块、电源管理模块均连接至充电板模块；按键板接口连接至按键板模块；RGB表情板接口连接至表情板模块；音频模块、声音输出模块分别连接至语音交互硅麦模块。The invention also discloses a learning companion robot system, which includes a learning companion robot and a control module installed in and electrically connected to the learning companion robot. The control module includes a main board module, a braid light guide plate module, a charging board module, an expression board module, and buttons Board module, voice interaction silicon microphone module and sound output module; expression board module is used to control the dynamic changes of the eye expression of the schoolmate robot; the braid light guide plate module is connected to the expression board module, which is used to meet the colorful transformation of the schoolmate robot's braid ; The charging board module is used to provide working power to the school partner robot; the button board module is connected to the button of the school partner robot, which is used to provide instructions to the school partner robot; the main board module is responsible for the operation of the school partner robot and the data of each module Processing and communication, including chip module, memory module, power management module, audio module, charging circuit module, key board interface and RGB expression board interface; charging circuit module and power management module are connected to the charging board module; key board interface connection To the key board module; the RGB expression board interface is connected to the expression board module; the audio module and the sound output module are respectively connected to the voice interaction silicon microphone module.
其中，芯片模块包括主板基带芯片模块、RF调码芯片模块和WIFI芯片模块；RF调码芯片模块、WIFI芯片模块均双向连接至主板基带芯片模块。Among them, the chip module includes a motherboard baseband chip module, an RF code chip module and a WIFI chip module; the RF code chip module and the WIFI chip module are both bidirectionally connected to the motherboard baseband chip module.
其中，音频模块包括音频电路模块、音频功放模块和语音识别模块；音频电路模块用于将音频转化为音频电信号；音频功放模块用于将语音数字信号还原、方法并通过学伴机器人的喇叭播放出来；语音识别模块用于将音频电信号转化为文本数字电信号。Among them, the audio module includes an audio circuit module, an audio power amplifier module and a voice recognition module; the audio circuit module is used to convert audio into an audio electrical signal; the audio power amplifier module is used to restore the voice digital signal, method and play through the speaker of the robot Out; voice recognition module is used to convert audio electrical signals into text digital electrical signals.
其中，充电电路模块包括数据传输接口和电源接口，数据传输接口电连接至学伴机器人的数据传输接口，电源接口电连接至学伴机器人的电源接口。Wherein, the charging circuit module includes a data transmission interface and a power supply interface. The data transmission interface is electrically connected to the data transmission interface of the schoolmate robot, and the power supply interface is electrically connected to the power supply interface of the schoolmate robot.
其中，电源管理模块上设有TF卡接口和SIM卡接口，且SIM卡接口连接至主板基带芯片模块。Among them, the power management module is provided with a TF card interface and a SIM card interface, and the SIM card interface is connected to the motherboard baseband chip module.
其中，主板基带芯片模块为基带芯片AI，RF调码芯片模块为RF芯片RF，WIFI芯片模块为WIFI芯片WIFI；存储器模块为EMMC Flash存储器，其包括4GB ROM存储器和512MB DDR2存储器；电源管理模块为电源管理芯片PMIC。Among them, the motherboard baseband chip module is the baseband chip AI, the RF code chip module is the RF chip RF, and the WIFI chip module is the WIFI chip WIFI; the memory module is the EMMC Flash memory, which includes 4GB ROM memory and 512MB DDR2 memory; the power management module is Power management chip PMIC.
其中，音频电路模块上设有主硅麦和降噪麦，主硅麦、降噪麦分别连接至学伴机器人的主硅麦板和降噪麦板；音频功放模块通过喇叭接口连接至学伴机器人的喇叭。Among them, the audio circuit module is provided with a main silicon wheat and a noise reduction wheat, the main silicon wheat and the noise reduction wheat are respectively connected to the main silicon wheat board and the noise reduction wheat board of the school partner robot; the audio power amplifier module is connected to the school partner through the speaker interface Robot horn.
如下详细介绍本发明学习陪伴机器人在具体运行时的相关工作原理。The related working principles of the learning companion robot of the present invention during specific operation are described in detail as follows.
如图5所示，本发明实现学***台发送的基带信号编码，机器人解码后将音频和语音还原，通过喇叭将声音还原播放出来。As shown in FIG. 5, the invention realizes the learning companion robot networking and the APP knowledge base on-demand principle: using a mobile phone to connect to the network, opening the APP software on the mobile phone, and entering the SN serial number of the robot or scanning the robot in the device management of the APP SN serial number two-dimensional code, bind the robot to the robot's mobile phone APP, after binding, click the device WIFI on the APP home interface, enter the WIFI name and password in the menu and connect to the network, the APP automatically generates a network hotspot to connect the robot and robot Read and save the WIFI name and password through the network hotspot, the WIFI network signal is NG, the transmission fails, and the network connection fails, then reconnect to the network; the WIFI network signal is OK, after the network connection is successful, the WIFI user and password are automatically saved, unchanged in the network environment In the case, the robot automatically connects to the network after it is turned on. After the network connection is successful, you can order the content on the APP, such as nursery rhymes, stories, music, English, etc., or you can click the voice intercom on the APP to communicate with the robot. The robot Receive the baseband signal code sent by the APP platform, the robot decodes the audio and voice, and restores the sound through the speaker.
如图2所示，本发明学***台知识库，搜索到相配的相关内容，云平台服务器将相关信息传输给机器人，机器人优先使用WIFI网络接收信息，无WIFI网络时则选择手机卡的基带数据信号网络接收云平台信息；机器人接收到信号后，对基带信号编码解码，将语音或者音频还原，通过机器人上的喇叭播放还原的声音。As shown in FIG. 2, the principle of learning voice interaction of a companion robot according to the present invention is as follows: the robot picks up human voice through voice interaction technology and converts it into semantic text. The robot searches the keyword by recognizing the voice semantic text and extracting the voice semantics. The searched keywords are converted into baseband signals; after the baseband signals are synthesized, the robot preferentially transmits via WIFI signals (if there is no WIFI, select the baseband data signal network provided by the 2G / 3G mobile phone SIM phone card or mobile phone flow card, and transmit them through the base station signal), which will be synthesized The baseband signal is sent to the cloud platform knowledge base, and the matching related content is searched. The cloud platform server transmits the relevant information to the robot. The robot preferentially uses the WIFI network to receive information. When there is no WIFI network, the baseband data signal network of the mobile phone card is selected to receive the cloud. Platform information; after receiving the signal, the robot encodes and decodes the baseband signal, restores the voice or audio, and plays the restored sound through the speaker on the robot.
如图3所示，本发明学习陪伴机器人拨打电话的原理为：机器人通过语音交互技术，用户语音说出被拨打电话人的名字或电话号码，机器人通过语音拾取后，转化为语义文字，机器人并萃取语音语义文字的关键词搜索，机器人在机器人内部SIM卡电话簿中搜索电话号码，或者机器人通过语音交互直接人说的电话号码直接拨号，手机对方接收并信号匹配后，机器人将拾取用户的语音转化为基带信号，将基带信号编码合成后，通过SIM电话卡提供的基带数据信号网络，通过基站信号传输，对方手机接收机器人的讲话语音信号；对方手机用户的语音信号通过基站信号传输，机器人接收其基带信号编码后，解码将语音还原，通过喇叭将语音播放，实现机器人与手机用户之间通话。As shown in FIG. 3, the principle of learning to accompany a robot to make a phone call is as follows: the robot uses voice interaction technology, and the user speaks the name or phone number of the person being dialed. After the robot picks up the voice, it is converted into semantic text. Keyword search for extracting speech semantic text, the robot searches the phone number in the SIM card phone book inside the robot, or the robot directly dials the phone number directly spoken by the person through voice interaction. After the mobile phone party receives and matches the signal, the robot will pick up the user's voice Converted to baseband signals, encoded and synthesized, the baseband data signal network provided by the SIM phone card is transmitted through the base station signal, and the opponent's mobile phone receives the robot's speech voice signal; the opponent's mobile phone user's voice signal is transmitted through the base station signal, and the robot receives its After the baseband signal is encoded, the decoding will restore the voice, and the voice will be played through the speaker to realize the call between the robot and the mobile phone user.
如图4所示，本发明学习陪伴机器人接收电话的原理为：手机拨打机器人SIM***后，将机器人中间键按下接收后，机器人电话通话功能开启，手机的基带编码信号通过基站信号传输，机器人接收对方手机语音基带信号编码，通过机器人的基带模块进行解码，将声音还原，通过喇叭还原播放对方手机的声音，同时按键接通对方手机电话后，用户可以通过对机器人说话，机器人将用户语音转化成为基带信号编码，并将相关基带信号编码合成，通过基站信号传输，实现与其他手机用户通话远程交流。As shown in FIG. 4, the principle of learning to accompany the robot to receive a call in the present invention is: after the mobile phone dials the robot SIM card number, presses the robot middle button to receive, the robot phone call function is turned on, the baseband coded signal of the mobile phone is transmitted through the base station signal, the robot Receive the baseband signal encoding of the other party's mobile phone, decode it through the robot's baseband module, restore the sound, restore the sound of the other party's mobile phone through the speaker, and press the key to connect to the other party's mobile phone, the user can speak to the robot, and the robot will convert the user's voice Become the baseband signal coding, and the relevant baseband signal coding and synthesis, through the base station signal transmission, to achieve remote communication with other mobile phone users.
本发明学习陪伴机器人***采用安卓***来实现运行，主板模块采用基带主***芯片，该模块是机器人的中央处理器，管理***存储器，安装安卓软件操作***，***通过电源管理模块MT6323GA提供电源，产品选用4900MAH聚合物锂离子电池，电池通过电源管理模块为机器人供电，为基带主***模块、音频电路模块、存储器模块、 WIFI模块等提供稳定电源。The learning companion robot system of the present invention uses an Android system to achieve operation. The mainboard module uses a baseband main system chip. The module is the central processor of the robot, manages the system memory, installs the Android software operating system, and the system provides power through the power management module MT6323GA. 4900MAH polymer lithium ion battery is selected. The battery supplies power to the robot through the power management module and provides stable power for the baseband main system module, audio circuit module, memory module, WIFI module, etc.
本发明充电电路模块包含充电电路、安卓主板充电插座和Micro USB接口，电池电量不足时，机器人接上USB充电线后，机器人通过充电板和主板的充电电路给电池充电；机器人通过音频模块的主硅麦的硅麦板和降噪硅麦的硅麦板接收用户的语音，通过音频电路模块将声音转化为音频电信号，音频识别模块将音频电信号转化为文本数字电信号；存储器模块EMMC Flash(4GB ROM+512MB DDR2)为主板基带芯片模块运算提供数据空间。The charging circuit module of the present invention includes a charging circuit, an Android motherboard charging socket and a Micro USB interface. When the battery power is insufficient, the robot charges the battery through the charging board and the charging circuit of the motherboard after the robot is connected to the USB charging line; the robot passes through the main audio module The silicon wheat board of the silicon wheat and the silicon wheat board of the noise reduction silicon wheat receive the user's voice, convert the sound into an audio electrical signal through the audio circuit module, and the audio recognition module converts the audio electrical signal into a text digital electrical signal; the memory module EMMC Flash (4GB ROM + 512MB DDR2) provides data space for motherboard baseband chip module operation.
本发明学习陪伴机器人上网存在三种情况：1、在没有WIFI网络的环境下，机器人***手机电话SIM卡或者手机流量卡，机器人使用2G/3G无线信号实现网络通讯；2、在有WIFI网络的环境下，机器人插有手机电话SIM卡或者手机流量卡，机器人优先选用WIFI网络进行无线通讯；3、在有WIFI网络的环境下，机器人没有插有手机电话SIM卡或者手机流量卡，机器人选用WIFI网络通讯。There are three situations for learning to accompany the robot on the Internet: 1. In an environment without a WIFI network, the robot inserts a mobile phone SIM card or a mobile phone flow card, and the robot uses 2G / 3G wireless signals to achieve network communication; 2. When there is a WIFI network In the environment, the robot has a mobile phone SIM card or mobile phone flow card, and the robot prefers WIFI network for wireless communication; 3. In the environment with WIFI network, the robot does not have a mobile phone SIM card or mobile phone flow card, the robot chooses WIFI Network communication.
如图6所示，本发明主板模块的框架结构包括：TF卡座1-1，其插有TF卡；SIM卡座1-2，其插有SIM卡；主板固定孔位1-3；防呆孔1-4。在主板模块的框架结构上安装主要零器件，以实现上述功能。As shown in FIG. 6, the frame structure of the motherboard module of the present invention includes: a TF card holder 1-1, which is inserted with a TF card; a SIM card holder 1-2, which is inserted with a SIM card; a motherboard fixing hole 1-3; Stupid holes 1-4. Main components are installed on the frame structure of the motherboard module to achieve the above functions.
本发明在没有WIFI的环境下，***手机电话SIM卡或者手机流量卡，机器人通过主硅麦板和降音降噪硅麦板拾取人的声音，音频电路模块将人的声音转化为语音音频模糊电信号，人的语音音频模糊电信号经过主板基带芯片进行信号处理后转化成文本数字信号，通过RF芯片将处理后的文本数字信号合成基带通信编码，26M晶振按照一定频率触发信号，将RF芯片合成的基带通讯信号发送(TX)给有限元芯片(FEM)，有限元芯片(FEM)将基带信号分解成若干连续而稳定的无线信号，通过无线通讯天线发出，无线信号通过通讯基站的信号中转，云平台服务器接收到机器人相关无线信号后，搜索查询相关内容，将相关内容通过无线信号的方式，反馈给机器人，机器人无线通讯天线接收云平台反馈信号，通过有限元芯片(FEM)将无线信号整合成完整的无线信号，RX(RX表示接收)无线信号给RF芯片，RF芯片将信号还原成基带通讯信号，通过主板基带芯片MT6572AX将基带通讯信号转化为基带信号转化为文本数字信号，文 本数字信号转化为音频信号，经过音频电路，音频功放将语音数字信号还原、放大，通过喇叭播放出来，实现人与机器人的语音交互；或者机器人的无线信号通过通讯基站的信号中转，另外的手机接收到机器人的相关无线信号，手机发射出来的无线信号通过基站通讯中转，机器人的无线通讯天线接收，与上同理，将接收到的信号还原成语音或音频通过机器人的喇叭播放。In the environment without WIFI, the mobile phone SIM card or mobile phone flow card is inserted, the robot picks up the human voice through the main silicon wheat board and the noise reduction and noise reduction silicon wheat board, and the audio circuit module converts the human voice into voice and audio blur Electric signal, human voice and audio fuzzy electric signal are converted into text digital signal after being processed by the baseband chip of the motherboard, and the processed text digital signal is synthesized into the baseband communication code through the RF chip. The 26M crystal oscillator triggers the signal according to a certain frequency, and the RF chip The synthesized baseband communication signal is sent (TX) to the finite element chip (FEM). The finite element chip (FEM) decomposes the baseband signal into several continuous and stable wireless signals, which are sent out through the wireless communication antenna, and the wireless signals are transferred through the signal of the communication base station. After receiving the robot-related wireless signal, the cloud platform server searches for related content, feeds the relevant content back to the robot through the wireless signal, the robot wireless communication antenna receives the cloud platform feedback signal, and sends the wireless signal through the finite element chip (FEM) Integrate into a complete wireless signal, RX (RX means receive) wireless signal to the RF chip, the RF chip restores the signal to a baseband communication signal, and the baseband chip MT6572AX converts the baseband communication signal into a baseband signal into a text digital signal, text digital The signal is converted into an audio signal. After the audio circuit, the audio power amplifier restores and amplifies the voice digital signal and plays it through the speaker to realize the voice interaction between the human and the robot; or the wireless signal of the robot is relayed through the signal of the communication base station and received by another mobile phone. The related wireless signals of the robot, the wireless signals transmitted by the mobile phone are transferred through the base station communication, and the wireless communication antenna of the robot is received. In the same way as above, the received signal is restored to voice or audio and played through the robot's speaker.
本发明在有WIFI网络的环境下，机器人无论是否插有手机电话SIM卡或者手机流量卡，机器人优先选用或选用WIFI网络进行无线通讯，机器人通过主硅麦板和降音降噪硅麦板拾取人的声音，音频电路模块将人的声音转化为语音音频模糊电信号，人的语音音频模糊电信号经过主板基带芯片进行信号处理后转化成文本数字信号，通过WIFI+Bluetooth+GPS+FM四合一芯片组成的WIFI芯片模块将处理后的文本数据信号合成基带通讯编码，TCXO(TCXO是通过附加的温度补偿电路使由周围温度变化产生的振荡频率变化量削减的一种石英晶体振荡器)按照一定的频率出发信号，将WIFI模块合同的基带通讯信号通过WIFI天线发送给附近的服务器，云平台服务器接收到机器人相关无线信号后，搜索查询相关内容，将相关内容的基带通讯信号反馈给机器人，机器人的WIFI天线接收云平台反馈的信号，WIFI模块将云平台反馈的基带通讯信号，基带通讯信号通过主板基带芯片将基带通讯信号转化为基带信号转化为文本数字信号，文本数字信号转化为音频信号，经过音频电路，音频功放将语音数字信号还原、放大，通过喇叭播放出来，实现人与机器人的语音交互。In the environment of the invention with a WIFI network, the robot prefers or selects the WIFI network for wireless communication regardless of whether a mobile phone SIM card or a mobile phone flow card is inserted. The robot picks up through the main silicon wheat board and the noise reduction and noise reduction silicon wheat board The human voice, the audio circuit module converts the human voice into a voice and audio fuzzy electrical signal. The human voice and audio fuzzy electrical signal undergoes signal processing through the motherboard baseband chip and is converted into a text digital signal through WIFI + Bluetooth + GPS + FM The WIFI chip module composed of one chip synthesizes the processed text data signal into baseband communication coding. TCXO (TCXO is a quartz crystal oscillator that reduces the amount of change in the oscillation frequency caused by the change in ambient temperature through an additional temperature compensation circuit). Starting from a certain frequency, the baseband communication signal of the WIFI module contract is sent to the nearby server through the WIFI antenna. After the cloud platform server receives the robot-related wireless signal, it searches and queries related content, and feeds back the baseband communication signal of the related content to the robot. The WIFI antenna of the robot receives the signal fed back by the cloud platform, and the WIFI module converts the baseband communication signal fed back by the cloud platform. The baseband communication signal converts the baseband communication signal into a baseband signal into a text digital signal through a motherboard baseband chip. After the audio circuit, the audio power amplifier restores and amplifies the voice digital signal and plays it through the speaker to realize the voice interaction between human and robot.
在机器人播放的同时，主板基带芯片将表情板的LED灯变化信号传送给学伴机器人的表情板和辫子灯板，表情板包含两排并列的8个RGB的LED灯，LED灯通过RGB呼吸灯驱动IC，实现七种变换，满足眼睛表情的动态变换，表情板还包含导光板接口；辫子灯板包含一个RGB灯和接口，辫子灯板连接表情板上的RGB呼吸灯驱动IC，满足智能语音学伴机器人的辫子炫彩变换，表情板的LED根据程序进行表情灯的样式变换和LED的RGB颜色的变化，形成机器人的变化表情，辫子灯根据表情板的LED的RGB颜色变化而变化，为机器人辫子提供炫彩的灯光颜色变化，在机器人在工作时，表情板进行相 对应的表情变换，机器人未工作时间达到5分钟后，机器人达到休眠状态，表情板和辫子灯板的变化停止，LED关灯，机器人整体休眠节约能量。表情板是LED阵列组、LED亮灭变化及RGB颜色的变化组合组成机器人的表情变化，具有充电指示作用。如图10所示，图中A部分电路控制学伴机器人左眼的表情变化，B部分电路控制学伴机器人右眼的表情变化。While the robot is playing, the baseboard chip of the main board transmits the LED lamp change signal of the expression board to the expression board and braid lamp board of the schoolmate robot. The expression board contains two rows of 8 RGB LED lights in parallel, and the LED lights pass through the RGB breathing lights. The driver IC implements seven transformations to meet the dynamic transformation of eye expressions. The expression board also includes a light guide board interface; the braid lamp board contains an RGB lamp and interface. The braid lamp board is connected to the RGB breathing lamp driver IC on the expression board to meet intelligent voice The dreadlocks of the companion robot are colorfully changed. The LED of the expression board changes the style of the expression light and the RGB color of the LED according to the program to form a changing expression of the robot. The braid light changes according to the RGB color of the LED of the expression board. The robot braid provides colorful light color changes. When the robot is working, the expression board performs the corresponding expression change. After the robot has not worked for 5 minutes, the robot reaches the sleep state, the change of the expression board and the braid lamp board stops, LED Turn off the lights, the robot sleeps as a whole to save energy. The expression board is a combination of the LED array group, the change of LED on and off and the change of RGB color to form the expression change of the robot, and has the function of charging indication. As shown in FIG. 10, the circuit in part A controls the expression change of the left eye of the robot, and the circuit in part B controls the expression change of the right eye of the robot.
本发明机器人播放时通过开关按键控制机器人播放节奏，学伴机器人的按键板包含5个开关、1个按键板接口，通过按键板用户可以控制智能语音学伴机器人，从左到右开关的功能依次为上一首/唤醒(左键)、音量放大键(左中间键)、暂停/播放(短按)/连接网络(长按)(中间键)、音量减小键(右中间键)、下一首/网络播放停止(右键)。开关按键板包括开关按键板基板4-1和按钮开关4-2，开关按键板基板为长方形基板，并有卡槽孔位对开关按键板基板进行限位。The robot of the invention controls the playing rhythm of the robot through the switch buttons. The button board of the learning partner robot includes 5 switches and a button board interface. The user can control the intelligent voice learning partner robot through the button board, and the functions of the switches from left to right are in turn. For previous song / wake up (left button), volume up button (left middle button), pause / play (short press) / connect to network (long press) (middle button), volume down button (right middle button), down One song / network playback stops (right button). The switch button board includes a switch button board substrate 4-1 and a button switch 4-2. The switch button board substrate is a rectangular substrate, and there are card slot holes to limit the switch button board substrate.
本发明充电电路模块还包含主板模块的充电策略与过充保护策略；本发明还包括辅助电路板充电板模块和锂电池充电管理***，辅助电路板充电板模块包含充电宝IC；锂电池充电管理***具有电池电量计量和四段LED充电指示；辅助电路板充电板模块还包含2个Micro USB接口、电池插座、安卓主板供电插座和拨动开关，拨动开关控制整机的电源通断，拨动开关一侧的Micro USB接口负责充电供电和数据传输，可以通过Micro USB接口对智能语音学伴机器人进行充电和刷新程序；充电电路模块采用带开口的PC材料的挡板固定USB接口达到固定充电板的目的。The charging circuit module of the present invention also includes the charging strategy and overcharging protection strategy of the mainboard module; the present invention also includes an auxiliary circuit board charging board module and a lithium battery charging management system. The auxiliary circuit board charging board module includes a charging treasure IC; lithium battery charging management The system has battery fuel metering and four-segment LED charging instructions; the auxiliary circuit board charging board module also contains 2 Micro USB ports, battery sockets, Android motherboard power sockets and toggle switches. The toggle switches control the power of the whole machine. The Micro USB interface on the side of the movable switch is responsible for charging power supply and data transmission. The intelligent voice learning robot can be charged and refreshed through the Micro USB interface; the charging circuit module uses a fixed baffle USB interface with a PC material with an opening to achieve fixed charging The purpose of the board.
应当理解，这些实施例的用途仅用于说明本发明而非意欲限制本发明的保护范围。此外，也应理解，在阅读了本发明的技术内容之后，本领域技术人员可以对本发明作各种改动、修改和/或变型，所有的这些等价形式同样落于本申请所附权利要求书所限定的保护范围之内。It should be understood that the purpose of these embodiments is only to illustrate the present invention and is not intended to limit the protection scope of the present invention. In addition, it should also be understood that, after reading the technical content of the present invention, those skilled in the art may make various changes, modifications, and / or variations to the present invention, and all these equivalent forms also fall within the appended claims of the present application. Within the limited scope of protection.

Claims (10)

  1. 一种实现学伴机器人的语音交互/人机通话的方法，其特征在于，其包括如下步骤：A method for realizing voice interaction / human-machine communication of a learning partner robot is characterized in that it includes the following steps:
    (S1)用户通过主硅麦板/按键对学伴机器人下达指令，学伴机器人通过音频模块将对话内容输送至主板基带芯片模块，并通过主板基带芯片模块对其语音语义进行文字搜索；(S1) The user gives instructions to the schoolmate robot through the main silicon wheat board / button, and the schoolmate robot sends the dialogue content to the mainboard baseband chip module through the audio module, and performs a text search for its voice semantics through the mainboard baseband chip module;
    (S2)通过基带信号编码合成步骤(S1)中文字搜索的内容，并通过WIFI网络信号/基站信号传输至云平台知识库，并在云平台知识库中调取对应的内容；(S2) The content searched by text in the step (S1) of baseband signal encoding and synthesis, and transmitted to the cloud platform knowledge base through the WIFI network signal / base station signal, and the corresponding content is retrieved from the cloud platform knowledge base;
    (S3)将步骤(S2)中调取的内容通过基带信号编码解码，通过WIFI网络信号/基站信号传输至音频模块进行语音还原和音频还原；(S3) encode and decode the content retrieved in step (S2) through the baseband signal and transmit it to the audio module through the WIFI network signal / base station signal for voice restoration and audio restoration;
    (S4)通过声音输出模块将步骤(S3)还原后的内容播放出来，实现人机语音交互。(S4) Play the content restored in step (S3) through the sound output module to realize human-machine voice interaction.
  2. 如权利要求1所述的方法，其特征在于，当步骤(S1)中用户下达的指令为拨打电话时，其包括如下步骤：The method according to claim 1, wherein when the instruction issued by the user in step (S1) is to make a call, it includes the following steps:
    (S1A)在学伴机器人的SIM接口内安装SIM卡；(S1A) Install a SIM card in the SIM interface of the Xueban robot;
    (S2A)用户通过主硅麦板/按键对学伴机器人发出拨打电话的指令，学伴机器人通过音频模块将该指令输送至主板基带芯片模块，并通过主板基带芯片模块对其语音语义在电话簿中进行文字搜索；(S2A) The user sends a command to the schoolmate robot through the main silicon wheat board / button to make a call. The schoolmate robot sends the instruction to the mainboard baseband chip module through the audio module, and the voice semantics of the mainboard baseband chip module are in the phone book Text search in China;
    (S3A)拨打步骤(S2A)中搜索到的电话，如拨打成功，则进入步骤(S4A)，如未拨打成功，则返回至步骤(S2A)；(S3A) Dial the phone number searched in step (S2A). If the call is successful, proceed to step (S4A). If the call is not successful, return to step (S2A);
    (S4A)与对方接收信号匹配，将用户语音通过基带信号编码合成，并通过基站信号传输至对方；(S4A) Match the received signal of the other party, encode and synthesize the user's voice through the baseband signal, and transmit it to the other party through the base station signal;
    (S5A)对方的语音通过基站信号传输至基带信号编码解码，并通过音频模块进行语音还原，通过声音输出模块将还原后的内容播放出来，实现拨打电话。(S5A) The voice of the other party is transmitted to the baseband signal encoding and decoding through the base station signal, and the voice is restored through the audio module, and the restored content is played out through the sound output module to make a call.
  3. 如权利要求1所述的方法，其特征在于，当步骤(S1)中用户下达的指令为接收电话时，其包括如下步骤：The method according to claim 1, wherein when the instruction issued by the user in step (S1) is to receive a call, it includes the following steps:
    (S1A)在学伴机器人的SIM接口内安装SIM卡；(S1A) Install a SIM card in the SIM interface of the Xueban robot;
    (S2A)用户通过手机拨打学伴机器人的***，通过基站信号传输将信号传送至学伴机器人；(S2A) The user dials the card number of the schoolmate robot through a mobile phone, and transmits the signal to the schoolmate robot through base station signal transmission;
    (S3A)通过学伴机器人上的按键接收该信号，则进入步骤(S4A)，如拒收该信号，则返回至步骤(S2A)；(S3A) Receive the signal through the button on the schoolmate robot, then enter step (S4A), if the signal is rejected, return to step (S2A);
    (S4A)将接收到的信号通过基带信号编码解码，再语音还原，通过学伴机器人的喇叭将语音信号播放出来；(S4A) Encode and decode the received signal through the baseband signal, then restore the voice, and play the voice signal through the speaker of the robot
    (S5A)通过学伴机器人输入的用户语音则通过基带信号编码合成，并发射至基站信号传输至手机接收端，实现接收电话。(S5A) The user's voice input through the learning partner robot is coded and synthesized by the baseband signal, and then transmitted to the base station, and the signal is transmitted to the receiving end of the mobile phone to realize receiving the phone.
  4. 一种使用如权利要求1-3中任一项所述方法的学习陪伴机器人***，其包括学伴机器人和安装在学伴机器人内并与其电连接的控制模块，其特征在于，控制模块包括主板模块、辫子导光板模块、充电板模块、表情板模块、按键板模块、语音交互硅麦模块和声音输出模块；表情板模块用于控制学伴机器人眼睛表情的动态变化；辫子导光板模块与表情板模块连接，其用于满足学伴机器人的辫子炫彩变换；充电板模块用于给学伴机器人提供工作电源；按键板模块连接至学伴机器人的按键，其用于给学伴机器人提供指令；A learning companion robot system using the method according to any one of claims 1-3, comprising a learning companion robot and a control module installed in and electrically connected to the learning companion robot, characterized in that the control module includes a motherboard module , Braid light guide plate module, charging board module, expression board module, key board module, voice interaction silicon microphone module and sound output module; expression board module is used to control the dynamic changes of the eye expression of the schoolmate robot; braid light guide board module and expression board Module connection, which is used to meet the colorful transformation of the braid of the school partner robot; the charging board module is used to provide working power to the school partner robot; the key board module is connected to the buttons of the school partner robot, which is used to provide instructions to the school partner robot;
    主板模块用于负责学伴机器人的运行和各模块的数据处理及通讯，其包括芯片模块、存储器模块、电源管理模块、音频模块、充电电路模块、按键板接口和RGB表情板接口；充电电路模块、电源管理模块均连接至充电板模块；按键板接口连接至按键板模块；RGB表情板接口连接至表情板模块；音频模块、声音输出模块分别连接至语音交互硅麦模块。The motherboard module is responsible for the operation of the learning partner robot and the data processing and communication of each module. It includes a chip module, a memory module, a power management module, an audio module, a charging circuit module, a key board interface, and an RGB expression board interface; a charging circuit module The power management module is connected to the charging board module; the key board interface is connected to the key board module; the RGB expression board interface is connected to the expression board module; the audio module and the sound output module are respectively connected to the voice interaction silicon microphone module.
  5. 根据权利要求4所述的学习陪伴机器人***，其特征在于，芯片模块包括主板基带芯片模块、RF调码芯片模块和WIFI芯片模块；RF调码芯片模块、WIFI芯片模块均双向连接至主板基带芯片模块。The learning companion robot system according to claim 4, wherein the chip module includes a motherboard baseband chip module, an RF code chip module and a WIFI chip module; the RF code chip module and the WIFI chip module are both bidirectionally connected to the motherboard baseband chip Module.
  6. 根据权利要求5所述的学习陪伴机器人***，其特征在于，音频模块包括音频电路模块、音频功放模块和语音识别模块；音频电路模块用于将音频转化为音频电信号；音频功放模块用于将语音数字信号还原、方法并通过学伴机器人的喇叭播放出来；语音识别模块用于将音频电信号转化为文本数字电信号。The learning companion robot system according to claim 5, wherein the audio module includes an audio circuit module, an audio power amplifier module and a voice recognition module; the audio circuit module is used to convert audio into audio electrical signals; and the audio power amplifier module is used to convert The voice digital signal is restored and played out through the speaker of the learning partner robot; the voice recognition module is used to convert the audio electrical signal into a text digital electrical signal.
  7. 根据权利要求6所述的学习陪伴机器人***，其特征在于，充电电路模块包括数据传输接口和电源接口，数据传输接口电连接至学伴机器人的数据传输接口，电源接口电连接至学伴机器人的电源接口。The learning companion robot system according to claim 6, wherein the charging circuit module includes a data transmission interface and a power interface, the data transmission interface is electrically connected to the data transmission interface of the academic partner robot, and the power interface is electrically connected to the Power interface.
  8. 根据权利要求7所述的学习陪伴机器人***，其特征在于，电源管理模块上设有TF卡接口和SIM卡接口，且SIM卡接口连接至主板基带芯片模块。The learning companion robot system according to claim 7, wherein the power management module is provided with a TF card interface and a SIM card interface, and the SIM card interface is connected to the baseband chip module of the main board.
  9. 根据权利要求8所述的学习陪伴机器人***，其特征在于，主板基带芯片模块为基带芯片，RF调码芯片模块为RF芯片，WIFI芯片模块为WIFI 芯片；存储器模块为EMMC Flash存储器，其包括4GB ROM存储器和512MB DDR2存储器；电源管理模块为电源管理芯片。The learning companion robot system according to claim 8, wherein the mainboard baseband chip module is a baseband chip, the RF code chip module is an RF chip, and the WIFI chip module is a WIFI chip; the memory module is an EMMC Flash memory, which includes 4GB ROM memory and 512MB DDR2 memory; power management module is a power management chip.
  10. 根据权利要求9所述的学习陪伴机器人***，其特征在于，音频电路模块上设有主硅麦和降噪麦，主硅麦、降噪麦分别连接至学伴机器人的主硅麦板和降噪麦板；音频功放模块通过喇叭接口连接至学伴机器人的喇叭。The learning companion robot system according to claim 9, wherein the audio circuit module is provided with a main silicon wheat and a noise reduction wheat, and the main silicon wheat and the noise reduction wheat are respectively connected to the main silicon wheat board and the noise reduction wheat of the school companion robot Noise microphone board; the audio power amplifier module is connected to the speaker of the Xueban robot through the speaker interface.
PCT/CN2018/122318 2018-11-21 2018-12-20 Learning accompanying robot system and method for realizing voice interaction/man-robot conversation WO2020103259A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811393328.9 2018-11-21
CN201811393328.9A CN109318241B (en) 2018-11-21 2018-11-21 Learning accompanying robot system for realizing voice interaction/man-machine conversation and method thereof

Publications (1)

Publication Number Publication Date
WO2020103259A1 true WO2020103259A1 (en) 2020-05-28

Family

ID=65257831

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/122318 WO2020103259A1 (en) 2018-11-21 2018-12-20 Learning accompanying robot system and method for realizing voice interaction/man-robot conversation

Country Status (2)

Country Link
CN (1) CN109318241B (en)
WO (1) WO2020103259A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109741645A (en) * 2019-03-15 2019-05-10 山东顺势教育科技有限公司 The guidance of AI robot and interactive conversation tutoring system
CN110815243A (en) * 2019-11-14 2020-02-21 深圳市博悦生活用品有限公司 Intelligent voice bilingual early education robot

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202975737U (en) * 2012-11-16 2013-06-05 中山大学 Smart home voice housekeeper robot
CN105126355A (en) * 2015-08-06 2015-12-09 上海元趣信息技术有限公司 Child companion robot and child companioning system
CN105791546A (en) * 2016-02-18 2016-07-20 安徽声讯信息技术有限公司 Sound recording and character transferring device operated and controlled by mobile phone screen
CN105936047A (en) * 2016-07-06 2016-09-14 厦门快商通科技股份有限公司 Brain imitation robot controlling and studying system
WO2016190676A1 (en) * 2015-05-26 2016-12-01 주식회사 프레도 Robot, smart block toy, and robot control system using same

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101334066B1 (en) * 2008-02-11 2013-11-29 이점식 Self-evolving Artificial Intelligent cyber robot system and offer method
CN105511260B (en) * 2015-10-16 2018-08-21 深圳市天博智科技有限公司 Humanoid robot and its exchange method and system are accompanied in a kind of children education
WO2018023507A1 (en) * 2016-08-03 2018-02-08 李仁涛 Multi-functional learning machine
CN207824899U (en) * 2018-01-09 2018-09-07 温岭市浩轩宜家智能科技有限公司 A kind of artificial intelligence study company robot system
CN209699113U (en) * 2018-11-21 2019-11-29 深圳市宏图物联科技有限公司 Robot system is accompanied in the study of a kind of interactive voice and man-machine call

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202975737U (en) * 2012-11-16 2013-06-05 中山大学 Smart home voice housekeeper robot
WO2016190676A1 (en) * 2015-05-26 2016-12-01 주식회사 프레도 Robot, smart block toy, and robot control system using same
CN105126355A (en) * 2015-08-06 2015-12-09 上海元趣信息技术有限公司 Child companion robot and child companioning system
CN105791546A (en) * 2016-02-18 2016-07-20 安徽声讯信息技术有限公司 Sound recording and character transferring device operated and controlled by mobile phone screen
CN105936047A (en) * 2016-07-06 2016-09-14 厦门快商通科技股份有限公司 Brain imitation robot controlling and studying system

Also Published As

Publication number Publication date
CN109318241A (en) 2019-02-12
CN109318241B (en) 2024-04-12

Similar Documents

Publication Publication Date Title
CN208507180U (en) A kind of portable intelligent interactive voice control equipment
CN108564949A (en) A kind of TWS earphones, Wrist belt-type AI voice interaction devices and system
CN110795528A (en) Data query method and device, electronic equipment and storage medium
CN110503959B (en) Voice recognition data distribution method and device, computer equipment and storage medium
CN101246687A (en) Intelligent voice interaction system and method thereof
US20090275408A1 (en) Programmable interactive talking device
CN109005480A (en) Information processing method and related product
WO2020103259A1 (en) Learning accompanying robot system and method for realizing voice interaction/man-robot conversation
CN104601202A (en) Method and terminal for realizing file search based on Bluetooth technology as well as Bluetooth device
CN109067965A (en) Interpretation method, translating equipment, wearable device and storage medium
CN114579819A (en) Information sorting method and electronic equipment
CN111182139A (en) Bluetooth sound box mobile phone control system based on Internet of things
WO2018023508A1 (en) Smart watch system and smart watch
CN207367592U (en) The midi signal conversion equipment of electronic keyboard
CN203968292U (en) A kind of blue Tooth remote controller
CN212117406U (en) Voice control cosmetic mirror
CN201118925Y (en) A microphone four sound control Kara OK song name
CN209699113U (en) Robot system is accompanied in the study of a kind of interactive voice and man-machine call
CN218634162U (en) Resonance sound box with display function
CN2938320Y (en) Audioplayer of selecting tune and programme by speech order
CN103179157A (en) Intelligent network robot and control method
CN213844755U (en) AI intelligence is painted originally and is read machine
CN213880086U (en) Split type TV remote controller
CN209517115U (en) 5G smartwatch
CN203139602U (en) Game machine combined with action device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18940923

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 30.09.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 18940923

Country of ref document: EP

Kind code of ref document: A1