CN109318241A - Realize that robot system and method are accompanied in interactive voice/man-machine call study - Google Patents
Realize that robot system and method are accompanied in interactive voice/man-machine call study Download PDFInfo
- Publication number
- CN109318241A CN109318241A CN201811393328.9A CN201811393328A CN109318241A CN 109318241 A CN109318241 A CN 109318241A CN 201811393328 A CN201811393328 A CN 201811393328A CN 109318241 A CN109318241 A CN 109318241A
- Authority
- CN
- China
- Prior art keywords
- module
- robot
- signal
- audio
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 21
- 238000000034 method Methods 0.000 title claims abstract description 17
- 241000209140 Triticum Species 0.000 claims abstract description 40
- 235000021307 Triticum Nutrition 0.000 claims abstract description 40
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 claims abstract description 31
- 229910052710 silicon Inorganic materials 0.000 claims abstract description 31
- 239000010703 silicon Substances 0.000 claims abstract description 31
- 230000009467 reduction Effects 0.000 claims abstract description 30
- 230000003993 interaction Effects 0.000 claims abstract description 5
- 238000004891 communication Methods 0.000 claims description 22
- 230000005540 biological transmission Effects 0.000 claims description 9
- 230000008859 change Effects 0.000 claims description 8
- 230000015572 biosynthetic process Effects 0.000 claims description 7
- 238000003786 synthesis reaction Methods 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 6
- 230000009466 transformation Effects 0.000 claims description 6
- 230000008054 signal transmission Effects 0.000 claims description 4
- 238000003860 storage Methods 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 18
- 238000010586 diagram Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 5
- 238000012546 transfer Methods 0.000 description 5
- 239000000758 substrate Substances 0.000 description 4
- 238000013473 artificial intelligence Methods 0.000 description 3
- 230000005611 electricity Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 229910052744 lithium Inorganic materials 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000009776 industrial production Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 229910001416 lithium ion Inorganic materials 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000010355 oscillation Effects 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 239000010453 quartz Substances 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N silicon dioxide Inorganic materials O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
- B25J11/0005—Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1602—Programme controls characterised by the control system, structure, architecture
- B25J9/161—Hardware, e.g. neural networks, fuzzy logic, interfaces, processor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1679—Programme controls characterised by the tasks executed
- B25J9/1689—Teleoperation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Automation & Control Theory (AREA)
- General Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Toys (AREA)
Abstract
The present invention discloses a kind of interactive voice/man-machine call method realized and learned with robot, include the following steps: that user assigns instruction to companion robot is learned by main silicon wheat plate/key, it learns and conversation content is delivered to by mainboard baseband chip module by audio-frequency module with robot, text search is carried out to its voice semanteme by mainboard baseband chip module;The content of above-mentioned text search is synthesized by baseband signal coding, and cloud platform knowledge base is transmitted to by WIFI network signal/base station signal, and corresponding content is transferred in cloud platform knowledge base, and it is transmitted to audio-frequency module by WIFI network signal/base station signal and carries out voice restoration and audio reduction by baseband signal coding and decoding;The content after reduction is played back by sound output module, realizes man machine language's interaction.The present invention uses voice technology, and people interacts with robot voice, connects cloud platform database, passes through large database concept technology, the content of selection search consumer's needs.
Description
Technical field
The present invention relates to teaching electronic products, relate more particularly to a kind of realize that interactive voice/man-machine call study is accompanied
With robot system and its method.
Background technique
With the development of artificial intelligence technology, robot technology is that one is based on automatic technology and computer technology
The system integration and application of body, the various modern information technologies that organically blend.The breakthrough of artificial intelligence technology is fundamentally promotion
Robot technology research provides necessary support, has widened road for the application range of robot, oneself covers national defence, boat extensively
Empty space flight, industrial production, the fields such as education services, science and technology innovation are epoch and the current social development of robot technology research.
As national life level improves and the promotion of cultural quality, oneself widely enters Technology Times to the mankind, small scale robot oneself into
Enter huge numbers of families to live along with people, cultivates state's humanism and attainment is picked up from child, early education machine human hair is waved vast
The memory of child is reinforced in field, cultivates the interest of child, gradually instead of the preparing lessons of teacher, teach, give lessons, train.
Existing early education equipment major part function is relatively simple currently on the market, and intelligence broadcasting native internal prestores interior
Hold, the knowledge quantity of acquisition is few, and consumer can only obtain simple knowledge, and can not carry out the update of knowledge, and also lack
Machine is interacted with people's.In addition, the intelligent sound for children's early teaching and learning is at the early-stage with robot technology, in the market
There is Related product volume bigger, weight ratio is heavier, intolerant to falling, it has not been convenient to carry and lift, when young children use
It is very inconvenient.
To sum up, therefore it is necessary to research and develop a kind of to realize that robot system and its side are accompanied in interactive voice/man-machine call study
Method.
Summary of the invention
The present invention provide it is a kind of realize interactive voice/man-machine call study accompany robot system and method, adopt
With voice technology, people interacts with robot voice, connects cloud platform database, passes through large database concept technology, selection search consumption
The content that person needs;Solve in the prior art that early education equipment knowledge is single, knowledge is few, knowledge does not update, it is mutual with people to lack
Dynamic disadvantage.
To achieve the above object, the present invention is achieved through the following technical solutions.
Firstly, the present invention provides a kind of interactive voice/man-machine call methods realized and learned with robot comprising such as
Lower step: (S1) user assigns instruction to companion robot is learned by main silicon wheat plate/key, and learning will by audio-frequency module with robot
Conversation content is delivered to mainboard baseband chip module, and carries out text to its voice semanteme by mainboard baseband chip module and search
Rope;(S2) by the content of text search in baseband signal coding synthesis step (S1), and pass through WIFI network signal/base station letter
Number it is transmitted to cloud platform knowledge base, and transfers corresponding content in cloud platform knowledge base;(S3) it will transfer in step (S2)
Content is transmitted to audio-frequency module by WIFI network signal/base station signal and carries out voice restoration by baseband signal coding and decoding
It is restored with audio;(S4) content after step (S3) reduction is played back by sound output module, realizes that man machine language hands over
Mutually.
When the instruction that user assigns in step (S1) is to make a phone call comprising following steps: (S1A) is being learned with machine
SIM card is installed in the SIM interface of people;(S2A) user issues the finger made a phone call to companion robot is learned by main silicon wheat plate/key
It enables, learns and the instruction is delivered to by mainboard baseband chip module by audio-frequency module with robot, and pass through mainboard baseband chip mould
Block carries out text search to its voice semanteme in the phonebook;(S3A) phone searched in step (S2A) is dialed, is such as dialed
Success, then enter step (S4A), does not such as dial success, is then back to step (S2A);(S4A) Signal Matching is received with other side,
User speech is encoded by baseband signal and is synthesized, and other side is transmitted to by base station signal;(S5A) voice of other side passes through base
Signal of standing is transmitted to baseband signal coding and decoding, and carries out voice restoration by audio-frequency module, will also by sound output module
Content after original plays back, and realization is made a phone call.
When the instruction that user assigns in step (S1) is to receive phone comprising following steps: (S1A) is being learned with machine
SIM card is installed in the SIM interface of people;(S2A) user dials the card number learned with robot by mobile phone, is transmitted by base station signal
Transmit signals to robot;(S3A) signal is received with the key in robot by learning, then enters step (S4A),
As rejected the signal, then step (S2A) is back to;(S4A) signal received is passed through into baseband signal coding and decoding, then voice
Reduction, the loudspeaker by learning companion robot play back voice signal;(S5A) by learning the user speech with robot input
It is then encoded and is synthesized by baseband signal, be concurrently incident upon base station signal and be transmitted to mobile phone receiving end, realize and receive phone.
Invention additionally discloses a kind of study to accompany robot system comprising learns with robot and is mounted on robot
Control module that is interior and being connected electrically, control module include mainboard module, plait light guide plate module, charging plate module, expression
Plate module, key sheet module, interactive voice silicon wheat module and sound output module;Expression plate module is learned for controlling with robot
The dynamic change of eye expression;Plait light guide plate module is connect with expression plate module, is used to meet the plait learned with robot
Colorful transformation;The plate module that charges is used to provide working power with robot to;Key sheet module, which is connected to, to be learned with robot
Key is used to provide instruction with robot to;Mainboard module is learned for being responsible for the operation of robot and the number of each module
According to processing and communication comprising chip module, power management module, audio-frequency module, charging circuit module, is pressed at memory module
Keypad interface and RGB expression plate interface;Charging circuit module, power management module are connected to charging plate module;Keypad connects
Mouth is connected to key sheet module;RGB expression plate interface is connected to expression plate module;Audio-frequency module, sound output module connect respectively
It is connected to interactive voice silicon wheat module.
Wherein, chip module includes mainboard baseband chip module, RF tune code chip module and WIFI chip module;RF tune code
Chip module, WIFI chip module are bidirectionally connected to mainboard baseband chip module.
Wherein, audio-frequency module includes audio circuit module, audio frequency power amplifier module and speech recognition module;Audio circuit module
For translating audio into as audio electrical signal;Audio frequency power amplifier module is used for voice digital signal reduction, method and passes through companion
The loudspeaker of robot play back;Speech recognition module is used to convert textual number electric signal for audio electrical signal.
Wherein, charging circuit module includes data transmission interface and power interface, and data transmission interface, which is electrically connected to, learns companion
The data transmission interface of robot, power interface are electrically connected to the power interface learned with robot.
Wherein, power management module is equipped with TF card interface and SIM card interface, and SIM card interface is connected to mainboard base band
Chip module.
Wherein, mainboard baseband chip module is baseband chip, and RF tune code chip module is RF chip, and WIFI chip module is
WIFI chip;Memory module is EMMC flash storage comprising 4GB ROM memory and 512MB DDR2 memory;
Power management module is power management chip.
Wherein, audio circuit module is equipped with main silicon wheat and noise reduction wheat, and main silicon wheat, noise reduction wheat are respectively connected to learn with machine
The main silicon wheat plate and noise reduction wheat plate of people;Audio frequency power amplifier module is connected to the loudspeaker learned with robot by horn interface.
In conclusion the beneficial effects of the present invention are:
1) present invention is combined multiple functional circuits by the setting of control circuit, for controlling the fortune learned with robot
Row passes through mobile phone remote and learns with robot progress chat session, and the handset-selected correlation for needing to play can be used
The function of content.
2) the multiple functional circuits of the present invention are integrated in control circuit, and control circuit is mounted in companion robot, so that
The structure for learning companion robot is more compact, and volume is smaller, internal each mould group compact layout, fixed, resistance to fall, and prevents dirty, people
Machine engineering design is more in line with colony of children consumer use.
3) present invention can directly pass through cloud platform knowledge base called data, be integrated with mathematics, physics, chemistry, biology, machine
The science and technology knowledge of the various fields such as tool, electronics, computer hardware, software, artificial intelligence, makes it have very high entertaining
Property, it effectively excites student to break through previous mode of learning to the interest of study, keeps child interested in learning, also reduce
Child indulges in game, TV etc., the good living habit of culture child and study habit.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the frame diagram that robot system is accompanied in present invention study.
Fig. 2 is the schematic diagram that the interaction of robot system voice is accompanied in present invention study.
Fig. 3 is the schematic diagram that present invention study accompanies robot system to make a phone call.
Fig. 4 is the schematic diagram that robot system reception phone is accompanied in present invention study.
Fig. 5 is the schematic diagram that robot system networking and APP knowledge base program request are accompanied in present invention study.
Fig. 6 is the circuit theory schematic diagram that robot system board module is accompanied in present invention study.
Fig. 7 is the circuit structure block diagram that robot system control module is accompanied in present invention study.
Fig. 8 is the circuit diagram that robot system key sheet module is accompanied in present invention study.
Fig. 9 is the circuit diagram that robot system plait light guide plate module is accompanied in present invention study.
Figure 10 is the circuit diagram that robot system expression plate module is accompanied in present invention study.
Figure 11 is the circuit diagram that robot system voice interaction silicon wheat plate module is accompanied in present invention study.
Specific embodiment
Below by specific embodiment, the present invention is described in detail, but the purposes of these exemplary embodiments and
Purpose is only used to enumerate the present invention, not constitutes any type of any restriction to real protection scope of the invention, more non-to incite somebody to action
Protection scope of the present invention is confined to this.
In order to facilitate and clarify the description of subsequent embodiment, carried out specifically to a specific embodiment of the invention
Before bright, part term is explained, following explanation is applied to this specification and claims.
The English word occurred in the present invention is code, do not represent it is other in all senses.
As shown in figs. 1-11, the present invention provides it is a kind of realize learn with robot interactive voice/man-machine call method,
It includes the following steps: that (S1) user assigns instruction to companion robot is learned by main silicon wheat plate/key, learns and passes through sound with robot
Conversation content is delivered to mainboard baseband chip module by frequency module, and is carried out by mainboard baseband chip module to its voice semanteme
Text search;(S2) by baseband signal coding synthesis step (S1) in text search content, and by WIFI network signal/
Base station signal is transmitted to cloud platform knowledge base, and corresponding content is transferred in cloud platform knowledge base;It (S3) will be in step (S2)
The content transferred is transmitted to audio-frequency module by WIFI network signal/base station signal and carries out language by baseband signal coding and decoding
Sound reduction and audio reduction;(S4) content after step (S3) reduction is played back by sound output module, is realized man-machine
Interactive voice.
When the instruction that user assigns in step (S1) is to make a phone call comprising following steps: (S1A) is being learned with machine
SIM card is installed in the SIM interface of people;(S2A) user issues the finger made a phone call to companion robot is learned by main silicon wheat plate/key
It enables, learns and the instruction is delivered to by mainboard baseband chip module by audio-frequency module with robot, and pass through mainboard baseband chip mould
Block carries out text search to its voice semanteme in the phonebook;(S3A) phone searched in step (S2A) is dialed, is such as dialed
Success, then enter step (S4A), does not such as dial success, is then back to step (S2A);(S4A) Signal Matching is received with other side,
User speech is encoded by baseband signal and is synthesized, and other side is transmitted to by base station signal;(S5A) voice of other side passes through base
Signal of standing is transmitted to baseband signal coding and decoding, and carries out voice restoration by audio-frequency module, will also by sound output module
Content after original plays back, and realization is made a phone call.
When the instruction that user assigns in step (S1) is to receive phone comprising following steps: (S1A) is being learned with machine
SIM card is installed in the SIM interface of people;(S2A) user dials the card number learned with robot by mobile phone, is transmitted by base station signal
Transmit signals to robot;(S3A) signal is received with the key in robot by learning, then enters step (S4A),
As rejected the signal, then step (S2A) is back to;(S4A) signal received is passed through into baseband signal coding and decoding, then voice
Reduction, the loudspeaker by learning companion robot play back voice signal;(S5A) by learning the user speech with robot input
It is then encoded and is synthesized by baseband signal, be concurrently incident upon base station signal and be transmitted to mobile phone receiving end, realize and receive phone.
Invention additionally discloses a kind of study to accompany robot system comprising learns with robot and is mounted on robot
Control module that is interior and being connected electrically, control module include mainboard module, plait light guide plate module, charging plate module, expression
Plate module, key sheet module, interactive voice silicon wheat module and sound output module;Expression plate module is learned for controlling with robot
The dynamic change of eye expression;Plait light guide plate module is connect with expression plate module, is used to meet the plait learned with robot
Colorful transformation;The plate module that charges is used to provide working power with robot to;Key sheet module, which is connected to, to be learned with robot
Key is used to provide instruction with robot to;Mainboard module is learned for being responsible for the operation of robot and the number of each module
According to processing and communication comprising chip module, power management module, audio-frequency module, charging circuit module, is pressed at memory module
Keypad interface and RGB expression plate interface;Charging circuit module, power management module are connected to charging plate module;Keypad connects
Mouth is connected to key sheet module;RGB expression plate interface is connected to expression plate module;Audio-frequency module, sound output module connect respectively
It is connected to interactive voice silicon wheat module.
Wherein, chip module includes mainboard baseband chip module, RF tune code chip module and WIFI chip module;RF tune code
Chip module, WIFI chip module are bidirectionally connected to mainboard baseband chip module.
Wherein, audio-frequency module includes audio circuit module, audio frequency power amplifier module and speech recognition module;Audio circuit module
For translating audio into as audio electrical signal;Audio frequency power amplifier module is used for voice digital signal reduction, method and passes through companion
The loudspeaker of robot play back;Speech recognition module is used to convert textual number electric signal for audio electrical signal.
Wherein, charging circuit module includes data transmission interface and power interface, and data transmission interface, which is electrically connected to, learns companion
The data transmission interface of robot, power interface are electrically connected to the power interface learned with robot.
Wherein, power management module is equipped with TF card interface and SIM card interface, and SIM card interface is connected to mainboard base band
Chip module.
Wherein, mainboard baseband chip module is baseband chip AI, and RF tune code chip module is RF chip RF, WIFI chip dies
Block is WIFI chips W IFI;Memory module is EMMC flash storage comprising 4GB ROM memory and 512MB DDR2
Memory;Power management module is power management chip PMIC.
Wherein, audio circuit module is equipped with main silicon wheat and noise reduction wheat, and main silicon wheat, noise reduction wheat are respectively connected to learn with machine
The main silicon wheat plate and noise reduction wheat plate of people;Audio frequency power amplifier module is connected to the loudspeaker learned with robot by horn interface.
Present invention study is discussed in detail as follows and accompanies related work principle of the robot in carrying out practically.
As shown in figure 5, the present invention realizes that robot networking and APP knowledge base program request principle are accompanied in study are as follows: use one
Mobile phone connects network, and APP software is opened on mobile phone, and SN sequence number or the scanning of robot are inputted in the equipment management of APP
Robot SN sequence number two dimensional code binds the cell phone application of robot and robot, after binding, clicks setting for APP home interface
Standby WIFI connects network after inputting WIFI title and password in a menu, and APP automatic generating network hot spot connects robot, machine
Device people reads WIFI title and password by network hotspot and saves, WIFI network signal NG, sends failure, network connection failure
Then reconnect network;WIFI network signal OK, after being connected to the network successfully, WIFI user and password are automatically saved, in network rings
In the constant situation in border, network is connected automatically after robot booting, it then can be with the content on program request APP, such as after being connected to the network successfully
The contents such as nursery rhymes, story, music, English, or may be implemented to be led to robot by clicking the speech talkback on APP
Words, robot receive the baseband signal coding that APP platform is sent and pass through loudspeaker by audio and voice restoration after robot decoding
Sound-reducing is played back.
As shown in Fig. 2, the present invention learns to accompany machine person speech interaction principle are as follows: robot passes through interactive voice technology,
After the voice pickup of people, it is converted into semantic text, robot passes through identification voice semanteme text and extracts the pass of voice semanteme
Keyword search, converts baseband signal for the keyword of search;After baseband signal synthesis, robot is preferentially passed by WIFI signal
It is defeated that (the base-band data signal network for just selecting 2G/3G mobile phone SIM phonecard or mobile data traffic card to provide without WIFI, passes through
Base station signal transmission), the baseband signal of synthesis is sent to cloud platform knowledge base, searches the related content of matching, cloud platform
Relevant information is transferred to robot by server, and robot preferentially uses WIFI network to receive information, and when no WIFI network is then selected
The base-band data signal network for selecting mobile phone card receives cloud platform information;After robot receives signal, baseband signal is encoded and is solved
Code restores voice or audio, and the sound of reduction is played by the loudspeaker in robot.
As shown in figure 3, the present invention learns the principle for accompanying robot to make a phone call are as follows: robot passes through interactive voice skill
Art, user speech says the name or telephone number for being made a phone call people, after robot is picked up by voice, is converted into semantic text
Electricity is searched in robot interior SIM card telephone directory by word, robot and the keyword search for extracting voice semanteme text, robot
The telephone number dial-in direct that words number or robot are said by the direct people of interactive voice, mobile phone other side receives and signal
After matching, the voice for picking up user is converted baseband signal by robot, after baseband signal coding synthesis, passes through SIM phonecard
The base-band data signal network of offer, is transmitted by base station signal, the spoken sounds signal of other side handset receiver device people;Other side
The voice signal of mobile phone user is transmitted by base station signal, after robot receives its baseband signal coding, is decoded voice restoration,
Voice is played by loudspeaker, realizes and converses between robot and mobile phone user.
As shown in figure 4, the present invention learns the principle for accompanying robot to receive phone are as follows: mobile phone dials robot SIM card number
Afterwards, after key pressing among robot being received, robot telephone relation function is opened, and the baseband coding signal of mobile phone passes through base station
Signal transmission, robot receive other side's mobile phone speech baseband signal coding, are decoded by the baseband module of robot, by sound
After sound reduction restores the sound for playing other side's mobile phone by loudspeaker, while key connects other side's mobile portable phone, user can pass through
It speaks to robot, user speech is transformed into baseband signal and encoded by robot, and associated base-band Signal coding is synthesized, and is led to
Base station signal transmission is crossed, is realized and other mobile phone users call remote communication.
The present invention learns that robot system is accompanied to realize operation using Android system, and mainboard module uses base band main system
Chip, the module are the central processing units of robot, and management system memory installs Android operation system of software, and system passes through
Power management module MT6323GA provides power supply, and product selects 4900MAH polymer Li-ion battery, and battery passes through power management
Module is robot power supply, provides stabilization for base band main system module, audio circuit module, memory module, WIFI module etc.
Power supply.
Charging circuit module of the present invention includes charging circuit, Android mainboard charging socket and Micro USB interface, battery electricity
When amount is insufficient, after robot connects USB charging cable, robot is charged the battery by the charging circuit of charging panel and mainboard;Machine
Device people receives the voice of user by the silicon wheat plate of the main silicon wheat of audio-frequency module and the silicon wheat plate of noise reduction silicon wheat, passes through voicefrequency circuit
Sound is converted audio electrical signal by module, and audio electrical signal is converted textual number electric signal by audio identification module;Storage
Device module EMMC Flash (4GB ROM+512MB DDR2) provides data space for mainboard baseband chip module arithmetic.
The present invention learns the online of company robot, and there are three kinds of situations: 1, no WIFI network in the environment of, robot
It is inserted into mobile portable phone SIM card or mobile data traffic card, robot realizes network communication using 2G/3G wireless signal;2, having
In the environment of WIFI network, robot is inserted with mobile portable phone SIM card or mobile data traffic card, robot preferentially select WIFI network
It communicates wirelessly;3, in the environment of having WIFI network, robot is not inserted with mobile portable phone SIM card or mobile data traffic
Card, robot select WIFI network communication.
As shown in fig. 6, the frame structure of mainboard module of the present invention includes: TF card seat 1-1, it is inserted with TF card;SIM card holder 1-
2, it is inserted with SIM card;Mainboard fixed hole position 1-3;Fool proof hole 1-4.Main zero device is installed in the frame structure of mainboard module,
To realize above-mentioned function.
The present invention is inserted into mobile portable phone SIM card or mobile data traffic card, robot passes through master in the environment of no WIFI
Silicon wheat plate and flat noise reduction silicon wheat plate pick up the sound of people, and the sound of people is converted the fuzzy electricity of speech audio by audio circuit module
Signal, the speech audio of people obscure electric signal and are converted to textual number signal after mainboard baseband chip carries out signal processing,
Treated textual number signal is synthesized into baseband communication coding by RF chip, 26M crystal oscillator according to certain frequency trigger signal,
The base band communication signal that RF chip is synthesized sends (TX) to limited element chip (FEM), and limited element chip (FEM) is by baseband signal
Several continuous and stable wireless signals are resolved into, are issued by wireless communication antenna, the letter that wireless signal passes through communication base station
Number transfer, after cloud platform server receives robot related wireless signal, search inquiry related content passes through related content
The mode of wireless signal, feeds back to robot, and robot wireless communication antenna receives cloud platform feedback signal, passes through finite element core
Wireless signal is integrated into complete wireless signal by piece (FEM), and RX (RX indicates to receive) wireless signal gives RF chip, and RF chip will
Signals revivification converts baseband signal for base band communication signal by mainboard baseband chip MT6572AX and turns at base band communication signal
Textual number signal is turned to, textual number signal is converted into audio signal, and by voicefrequency circuit, audio frequency power amplifier believes speech digit
Number reduction, amplification, played back by loudspeaker, realize people and robot interactive voice;Or the wireless signal of robot is logical
The signal transfer of communication base station is crossed, mobile phone in addition receives the related wireless signal of robot, and handset emissions come out wireless
By base station communication transfer, the wireless communication antenna of robot receives signal, with it is upper similarly, the signals revivification Chinese idiom that will be received
Sound or audio are played by the loudspeaker of robot.
For the present invention in the environment of having WIFI network, robot is regardless of whether be inserted with mobile portable phone SIM card or mobile phone stream
Amount card, robot preferentially selects or WIFI network is selected to communicate wirelessly, and robot passes through main silicon wheat plate and flat noise reduction silicon
Wheat plate picks up the sound of people, and audio circuit module converts speech audio for the sound of people and obscures electric signal, the speech audio of people
Fuzzy electric signal is converted to textual number signal after mainboard baseband chip carries out signal processing, passes through WIFI+Bluetooth
By treated, text data signal synthesizes base band communication coding to the WIFI chip module of+GPS+FM four-in-one chip composition,
(TCXO is to make to change the frequency of oscillation variable quantity generated is cut down one by ambient temperature by additional temperature-compensation circuit to TCXO
Kind quartz oscillator) according to certain frequency starting signal, the base band communication signal of WIFI module contract is passed through into WIFI
Antenna is sent to neighbouring server, and after cloud platform server receives robot related wireless signal, search inquiry phase is inside the Pass
Holding, the base band communication signal of related content is fed back into robot, the WIFI antenna of robot receives the signal of cloud platform feedback,
The base band communication signal that WIFI module feeds back cloud platform, base band communication signal pass through mainboard baseband chip for base band communication signal
It is converted into baseband signal and is converted into textual number signal, textual number signal is converted into audio signal, by voicefrequency circuit, audio
Voice digital signal is restored, is amplified by power amplifier, is played back by loudspeaker, realizes the interactive voice of people and robot.
While robot plays, mainboard baseband chip sends the LED light variable signal of expression plate to machine
The expression plate and plait lamp plate of people, expression plate include the LED light of two rows of 8 RGB arranged side by side, and LED light is driven by RGB breath light
IC realizes seven kinds of transformation, meets the dynamic mapping of eye expression, and expression plate also includes guide-lighting plate interface;Plait lamp plate includes one
A RGB lamp and interface, plait lamp plate connect the RGB breath light on expression plate and drive IC, meet intelligent sound with robot
The transformation of plait colorful, the LED of expression plate carry out the variation of the pattern transformation of expression lamp and the RGB color of LED according to program, are formed
The variation expression of robot, plait lamp change according to the RGB color of the LED of expression plate and are changed, provide and dazzle for robot plait
Color light color variation, robot at work, expression plate carries out corresponding expression synthesis, robot non-working time
Reach after five minutes, robot reaches dormant state, and the variation of expression plate and plait lamp plate stops, and LED turns off the light, and robot is whole
Energy is saved in suspend mode.Expression plate is that the variation group of LED array group, LED light on and off variation and RGB color is combined into the expression of robot
Variation has charging instruction effect.As shown in Figure 10, expression shape change of the part A circuit control with robot left eye, B in figure
The expression shape change with robot right eye is learned in partial circuit control.
Robot is controlled by switch key when robot of the present invention plays and plays rhythm, learns the keypad packet with robot
Containing 5 switches, 1 key plate interface, intelligent sound can control with robot by keypad user, from left to right switch
Function be followed successively by one head/wake-up (left button), volume enlargement key (left linkage), pause/broadcasting (short-press)/connection network
(long-pressing) (middle key), volume down key (right middle key), next/netcast stop (right button).Switch key plate includes
Switch key plate substrate 4-1 and button switch 4-2, switch key plate substrate is rectangular substrate, and has card slot hole location to switch
Keypad substrate is limited.
Charging circuit module of the present invention also includes the charging strategy of mainboard module and overcharges Preservation tactics;The invention also includes
Auxiliary circuit board charging plate module and lithium battery charging management system, auxiliary circuit board charging plate module includes charger baby IC;Lithium
Battery charging management system has battery electric quantity metering and four sections of LED charging instructions;Auxiliary circuit board charging plate module also includes 2
A Micro USB interface, battery socket, Android main board power supply socket and toggle switch, the power supply that toggle switch controls complete machine are logical
Disconnected, the Micro USB interface of toggle switch side is responsible for charging and data transmission, can pass through Micro USB interface pair
Intelligent sound carries out charging and refurbishing procedure with robot;Charging circuit module uses the baffle of the PC material with opening to fix
USB interface achievees the purpose that fixed charging panel.
It should be appreciated that the purposes of these embodiments is merely to illustrate the present invention and is not intended to limit protection model of the invention
It encloses.In addition, it should also be understood that, after reading the technical contents of the present invention, those skilled in the art can make the present invention each
Kind change, modification and/or variation, all these equivalent forms equally fall within guarantor defined by the application the appended claims
Within the scope of shield.
Claims (10)
1. a kind of realize the interactive voice/man-machine call method learned with robot, which is characterized in that it includes the following steps:
(S1) user assigns instruction to companion robot is learned by main silicon wheat plate/key, and learning will be right by audio-frequency module with robot
Content transport is talked about to mainboard baseband chip module, and text search is carried out to its voice semanteme by mainboard baseband chip module;
(S2) by the content of text search in baseband signal coding synthesis step (S1), and pass through WIFI network signal/base station
Signal is transmitted to cloud platform knowledge base, and corresponding content is transferred in cloud platform knowledge base;
(S3) content transferred in step (S2) is passed through into WIFI network signal/base station signal by baseband signal coding and decoding
It is transmitted to audio-frequency module and carries out voice restoration and audio reduction;
(S4) content after step (S3) reduction is played back by sound output module, realizes man machine language's interaction.
2. the method as described in claim 1, which is characterized in that when the instruction that user assigns in step (S1) is to make a phone call
When comprising following steps:
(S1A) SIM card is installed in the SIM interface for learning companion robot;
(S2A) user learns by main silicon wheat plate/key to the instruction made a phone call with robot sending is learned and passes through sound with robot
The instruction is delivered to mainboard baseband chip module by frequency module, and passes through mainboard baseband chip module to its voice semanteme in phone
Text search is carried out in book;
(S3A) phone searched in step (S2A) is dialed, success is such as dialed, then enters step (S4A), does not such as dial success,
Then it is back to step (S2A);
(S4A) Signal Matching is received with other side, user speech is encoded by baseband signal and is synthesized, and transmitted by base station signal
To other side;
(S5A) voice of other side is transmitted to baseband signal coding and decoding by base station signal, and carries out voice by audio-frequency module
Reduction, is played back the content after reduction by sound output module, realization is made a phone call.
3. the method as described in claim 1, which is characterized in that when the instruction that user assigns in step (S1) is to receive phone
When comprising following steps:
(S1A) SIM card is installed in the SIM interface for learning companion robot;
(S2A) user dials the card number learned with robot by mobile phone, transmits signals to machine by base station signal transmission
Device people;
(S3A) signal is received with the key in robot by learning, then enters step (S4A), such as rejects the signal, then return
To step (S2A);
(S4A) by the signal received by baseband signal coding and decoding, then voice restoration, the loudspeaker by learning companion robot will
Voice signal plays back;
(S5A) it is then synthesized by baseband signal coding by learning the user speech inputted with robot, is concurrently incident upon base station signal
It is transmitted to mobile phone receiving end, realizes and receives phone.
4. robot system is accompanied in a kind of study using such as any one of claim 1-3 the method comprising learn with machine
Device people and being mounted on learns in robot and the control module that is connected electrically, which is characterized in that control module includes mainboard mould
Block, plait light guide plate module, charging plate module, expression plate module, key sheet module, interactive voice silicon wheat module and sound output
Module;Expression plate module is used to control the dynamic change learned with robot eyes expression;Plait light guide plate module and expression template die
Block connection is used to meet the plait colorful transformation learned with robot;The plate module that charges is used to provide work with robot to
Power supply;Key sheet module is connected to the key learned with robot, is used to provide instruction with robot to;
Mainboard module is for being responsible for learning with the operation of robot and the data processing and communication of each module comprising chip module,
Memory module, power management module, audio-frequency module, charging circuit module, key plate interface and RGB expression plate interface;Charging
Circuit module, power management module are connected to charging plate module;Key plate interface is connected to key sheet module;RGB expression plate
Interface is connected to expression plate module;Audio-frequency module, sound output module are respectively connected to interactive voice silicon wheat module.
5. robot system is accompanied in study according to claim 4, which is characterized in that chip module includes mainboard base band core
Piece module, RF tune code chip module and WIFI chip module;RF tune code chip module, WIFI chip module are bidirectionally connected to master
Plate baseband chip module.
6. robot system is accompanied in study according to claim 5, which is characterized in that audio-frequency module includes voicefrequency circuit mould
Block, audio frequency power amplifier module and speech recognition module;Audio circuit module is for translating audio into as audio electrical signal;Audio frequency power amplifier
Module is used to play back on voice digital signal reduction, method and the loudspeaker by learning companion robot;Speech recognition module is used
In converting textual number electric signal for audio electrical signal.
7. robot system is accompanied in study according to claim 6, which is characterized in that charging circuit module includes that data pass
Defeated interface and power interface, data transmission interface are electrically connected to the data transmission interface learned with robot, power interface electrical connection
To the power interface learned with robot.
8. robot system is accompanied in study according to claim 7, which is characterized in that power management module is equipped with TF card
Interface and SIM card interface, and SIM card interface is connected to mainboard baseband chip module.
9. robot system is accompanied in study according to claim 8, which is characterized in that mainboard baseband chip module is base band
Chip, RF tune code chip module are RF chip, and WIFI chip module is WIFI chip;Memory module is EMMC Flash storage
Device comprising 4GB ROM memory and 512MB DDR2 memory;Power management module is power management chip.
10. robot system is accompanied in study according to claim 9, which is characterized in that audio circuit module is equipped with master
Silicon wheat and noise reduction wheat, main silicon wheat, noise reduction wheat are respectively connected to learn the main silicon wheat plate and noise reduction wheat plate with robot;Audio frequency power amplifier mould
Block is connected to the loudspeaker learned with robot by horn interface.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811393328.9A CN109318241B (en) | 2018-11-21 | 2018-11-21 | Learning accompanying robot system for realizing voice interaction/man-machine conversation and method thereof |
PCT/CN2018/122318 WO2020103259A1 (en) | 2018-11-21 | 2018-12-20 | Learning accompanying robot system and method for realizing voice interaction/man-robot conversation |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811393328.9A CN109318241B (en) | 2018-11-21 | 2018-11-21 | Learning accompanying robot system for realizing voice interaction/man-machine conversation and method thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109318241A true CN109318241A (en) | 2019-02-12 |
CN109318241B CN109318241B (en) | 2024-04-12 |
Family
ID=65257831
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811393328.9A Active CN109318241B (en) | 2018-11-21 | 2018-11-21 | Learning accompanying robot system for realizing voice interaction/man-machine conversation and method thereof |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN109318241B (en) |
WO (1) | WO2020103259A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109741645A (en) * | 2019-03-15 | 2019-05-10 | 山东顺势教育科技有限公司 | The guidance of AI robot and interactive conversation tutoring system |
CN110815243A (en) * | 2019-11-14 | 2020-02-21 | 深圳市博悦生活用品有限公司 | Intelligent voice bilingual early education robot |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20090086805A (en) * | 2008-02-11 | 2009-08-14 | 이점식 | Self-evolving artificial intelligent cyber robot system |
CN105126355A (en) * | 2015-08-06 | 2015-12-09 | 上海元趣信息技术有限公司 | Child companion robot and child companioning system |
CN105511260A (en) * | 2015-10-16 | 2016-04-20 | 深圳市天博智科技有限公司 | Preschool education accompany robot, and interaction method and system therefor |
WO2018023507A1 (en) * | 2016-08-03 | 2018-02-08 | 李仁涛 | Multi-functional learning machine |
CN207824899U (en) * | 2018-01-09 | 2018-09-07 | 温岭市浩轩宜家智能科技有限公司 | A kind of artificial intelligence study company robot system |
CN209699113U (en) * | 2018-11-21 | 2019-11-29 | 深圳市宏图物联科技有限公司 | Robot system is accompanied in the study of a kind of interactive voice and man-machine call |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN202975737U (en) * | 2012-11-16 | 2013-06-05 | 中山大学 | Smart home voice housekeeper robot |
WO2016190676A1 (en) * | 2015-05-26 | 2016-12-01 | 주식회사 프레도 | Robot, smart block toy, and robot control system using same |
CN105791546A (en) * | 2016-02-18 | 2016-07-20 | 安徽声讯信息技术有限公司 | Sound recording and character transferring device operated and controlled by mobile phone screen |
CN105936047B (en) * | 2016-07-06 | 2018-05-04 | 厦门快商通科技股份有限公司 | Fang Nao robots control and learning system |
-
2018
- 2018-11-21 CN CN201811393328.9A patent/CN109318241B/en active Active
- 2018-12-20 WO PCT/CN2018/122318 patent/WO2020103259A1/en active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20090086805A (en) * | 2008-02-11 | 2009-08-14 | 이점식 | Self-evolving artificial intelligent cyber robot system |
CN105126355A (en) * | 2015-08-06 | 2015-12-09 | 上海元趣信息技术有限公司 | Child companion robot and child companioning system |
CN105511260A (en) * | 2015-10-16 | 2016-04-20 | 深圳市天博智科技有限公司 | Preschool education accompany robot, and interaction method and system therefor |
WO2018023507A1 (en) * | 2016-08-03 | 2018-02-08 | 李仁涛 | Multi-functional learning machine |
CN207824899U (en) * | 2018-01-09 | 2018-09-07 | 温岭市浩轩宜家智能科技有限公司 | A kind of artificial intelligence study company robot system |
CN209699113U (en) * | 2018-11-21 | 2019-11-29 | 深圳市宏图物联科技有限公司 | Robot system is accompanied in the study of a kind of interactive voice and man-machine call |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109741645A (en) * | 2019-03-15 | 2019-05-10 | 山东顺势教育科技有限公司 | The guidance of AI robot and interactive conversation tutoring system |
CN110815243A (en) * | 2019-11-14 | 2020-02-21 | 深圳市博悦生活用品有限公司 | Intelligent voice bilingual early education robot |
Also Published As
Publication number | Publication date |
---|---|
WO2020103259A1 (en) | 2020-05-28 |
CN109318241B (en) | 2024-04-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN208507180U (en) | A kind of portable intelligent interactive voice control equipment | |
CN110795528B (en) | Data query method and device, electronic equipment and storage medium | |
CN102196207B (en) | Method, device and system for controlling television by using voice | |
CN108564949A (en) | A kind of TWS earphones, Wrist belt-type AI voice interaction devices and system | |
CN109344291A (en) | A kind of video generation method and device | |
US20090275408A1 (en) | Programmable interactive talking device | |
CN106200886A (en) | A kind of intelligent movable toy manipulated alternately based on language and toy using method | |
CN106297780A (en) | A kind of voice interactive method and system and Intelligent voice broadcasting terminal | |
CN107308657A (en) | A kind of novel interactive intelligent toy system | |
CN109318241A (en) | Realize that robot system and method are accompanied in interactive voice/man-machine call study | |
CN208691406U (en) | Far field speech collecting system for smart television | |
CN111241815A (en) | Text increment method and device and terminal equipment | |
CN209699113U (en) | Robot system is accompanied in the study of a kind of interactive voice and man-machine call | |
CN105975220A (en) | Voice printing assisting device and voice printing system | |
CN207367592U (en) | The midi signal conversion equipment of electronic keyboard | |
CN206896812U (en) | The control system of Intelligent doll | |
CN208163654U (en) | A kind of intelligent terminal machine people for children's early teaching and learning | |
CN112767934A (en) | Massage equipment control method, related device and computer storage medium | |
CN205318508U (en) | Wireless polling system of intelligence | |
CN2938320Y (en) | Audioplayer of selecting tune and programme by speech order | |
CN109741645A (en) | The guidance of AI robot and interactive conversation tutoring system | |
CN203942634U (en) | A kind of sound system with human motion monitoring function and acoustics | |
CN206594843U (en) | A kind of talking pen of ringing a bell of wifi connections | |
CN103179157A (en) | Intelligent network robot and control method | |
CN206672636U (en) | Intelligent robot with high in clouds interactive function |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |