CN106227347B - The means of communication, equipment and communication system towards intelligent robot - Google Patents
The means of communication, equipment and communication system towards intelligent robot Download PDFInfo
- Publication number
- CN106227347B CN106227347B CN201610597245.6A CN201610597245A CN106227347B CN 106227347 B CN106227347 B CN 106227347B CN 201610597245 A CN201610597245 A CN 201610597245A CN 106227347 B CN106227347 B CN 106227347B
- Authority
- CN
- China
- Prior art keywords
- user
- expression
- voice
- movement
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/10—Multimedia information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/56—Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Telephonic Communication Services (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
It the invention discloses a kind of means of communication towards intelligent robot, dials end equipment and answers end equipment and communication system, belong to field of communication technology, improve information and convey efficiency and user's communication experience.The means of communication include: to dial end equipment to obtain movement, voice and the expression information for making a phone call user；The movement, voice and expression information are sent to by server and answer end equipment.It answers end equipment and receives movement, voice and the expression information for dialing end equipment transmission by server；In conjunction with the movement, voice and expression information, end subscriber is answered in generation movement, the multi-modal output information of voice and expression and output.
Description
Technical field
The present invention relates to fields of communication technology, specifically, are related to a kind of means of communication towards intelligent robot, dial
End equipment and answer end equipment and communication system.
Background technique
With the continuous development of information technology, computer technology and artificial intelligence technology, intelligent robot has been entered into
It lives closely bound up field to medical treatment, health care, family, amusement and service industry etc. and people.People are for intelligence machine
The requirement of people is also higher and higher, and intelligent robot is needed to have more functions to provide more helps for human lives.
According to psychologic the study found that the mankind say that the information of a word is conveyed, 7% by content of text, and 38% passes through
The intonation tone, and 55% passes through expression, limb action.And in traditional telephonic communication experience, both call sides can only pass through language
Sound, intonation express oneself, and most information (55%) is lost, other side can not receive, the efficiency for causing information to be conveyed
Very low, Experience Degree is not high.
Therefore, need one kind can be improved information convey efficiency, improve user's communication experience towards intelligent robot
The means of communication, dial end equipment and answer end equipment and communication system.
Summary of the invention
The purpose of the present invention is to provide a kind of means of communication towards intelligent robot, dials end equipment and answer end and set
Standby and communication system improves information and conveys efficiency and user's communication experience.
The present invention provides a kind of means of communication towards intelligent robot, this method comprises:
It dials end equipment and obtains movement, voice and the expression information for making a phone call user；
The movement, voice and expression information are sent to by server and answer end equipment.
Include: in acquisition movement, voice and the expression information the step of
The end equipment of dialing catches clothes, optical tracking system, movement gloves or camera acquisition and dials electricity by the way that inertia is dynamic
Talk about the action message of user；
The end equipment of dialing obtains the expression information for making a phone call user by camera.
The present invention also provides a kind of means of communication towards intelligent robot, the intelligent robot can carry out multi-modal table
It reaches, this method comprises:
It answers end equipment and receives movement, voice and the expression information for dialing end equipment transmission by server；
In conjunction with the movement, voice and expression information, generation movement, the multi-modal output information of voice and expression and defeated
Answered end subscriber out.
Generation movement, voice and expression multi-modal output information and export to answer end subscriber the step of in include:
The action message is parsed, generates action command, and according to the action command, export corresponding actions；
The expression information is parsed, generates expression output order, according to the expression output order, output phase answers expression.
End equipment is dialed towards intelligent robot the present invention also provides a kind of, which includes:
Module is obtained, is used to obtain movement, voice and the expression information for making a phone call user；
Sending module is used to being sent to and answering end equipment the movement, voice and expression information by server.
The acquisition module includes:
Acquisition submodule is acted, is used to obtain by dynamic clothes, optical tracking system, movement gloves or the camera of catching of inertia
Make a phone call the action message of user；
Expression acquisition submodule is used to obtain the expression information for making a phone call user by camera.
The present invention also provides a kind of to answer end equipment towards intelligent robot, and the intelligent robot can carry out multi-modal
Expression, the equipment include:
Receiving module is used to receive movement, voice and the expression information for dialing end equipment transmission by server；
Output module is used in conjunction with the movement, voice and expression information, generation movement, voice and expression it is more
Mode output information is simultaneously exported to being answered end subscriber.
The output module includes:
Output sub-module is acted, is used to parse the action message, generates action command, and refer to according to the movement
It enables, exports corresponding actions；
Expression output sub-module is used to parse the expression information, generates expression output order, defeated according to the expression
It instructs out, output phase answers expression.
The present invention also provides a kind of communication system towards intelligent robot, which includes:
It is described to dial end equipment and described answer end equipment.
The means of communication provided in an embodiment of the present invention towards intelligent robot dial end equipment and answer end equipment and logical
News system, by answering dialing end acquisition and make a phone call the multi-modal informations such as movement, voice and expression of user and be sent to
End carries out the multi-modal expression of the information such as the movement, voice and expression to the user that receives calls, and realizes the electricity of multi-modal mode
Words communication.Relative to traditional telephone communication mode that can only express oneself by voice, intonation, the present invention is realizing call
While, by the expression of correspondent, limb action is transmitted and is expressed, and enriches the information mode of communication of telephonic communication and interior
Hold, improves the reception and registration efficiency of information, and user can be brought similar to the impression of face-to-face exchange, make the friendship of user and phone
Mutual process more personalizes, and improves the communication experience of user.
Other features and advantages of the present invention will be illustrated in the following description, also, partial becomes from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention can be by specification, right
Specifically noted structure is achieved and obtained in claim and attached drawing.
Detailed description of the invention
It, below will be to required in embodiment description for the clearer technical solution illustrated in the embodiment of the present invention
Attached drawing does simple introduction:
Fig. 1 is provided in an embodiment of the present invention to dial end communication method flow schematic diagram towards intelligent robot；
Fig. 2 is provided in an embodiment of the present invention to answer end communication method flow schematic diagram towards intelligent robot；
Fig. 3 is the schematic diagram provided in an embodiment of the present invention that dial end equipment towards intelligent robot；
Fig. 4 is the schematic diagram of the acquisition module provided in an embodiment of the present invention towards intelligent robot；
Fig. 5 is the schematic diagram provided in an embodiment of the present invention that answer end equipment towards intelligent robot；
Fig. 6 is the schematic diagram of the output module provided in an embodiment of the present invention towards intelligent robot；
Fig. 7 is the schematic diagram of the communication system provided in an embodiment of the present invention towards intelligent robot.
Specific embodiment
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and examples, how to apply to the present invention whereby
Technological means solves technical problem, and the realization process for reaching technical effect can fully understand and implement.It needs to illustrate
As long as not constituting conflict, each feature in each embodiment and each embodiment in the present invention can be combined with each other,
It is within the scope of the present invention to be formed by technical solution.
In traditional telephonic communication mode, the both sides of call intelligence expresses oneself by voice, intonation, and merely with
The carrier that sound is transmitted as information, entrained by information content be extremely limited.For this problem, the present invention provides
It is a kind of towards intelligent robot dial end communication method and it is corresponding answer end communication method, dial end equipment and answer end and set
Standby and communication system improves the user experience made a phone call to enrich the information mode of communication of telephonic communication.
The means of communication towards intelligent robot provided in an embodiment of the present invention suitable for telephone call end, such as Fig. 1 institute
Show, this method comprises: step 101 and step 102.
In a step 101, it dials end equipment and obtains movement, voice and the expression information for making a phone call user.End is dialed to set
The voice for making a phone call user, expression and limb action are obtained for by the acquisition of multi-modal information, in its of the invention
In his embodiment, the multi-modal information for dialing end equipment acquisition can also can be expressed including other dials end subscriber call shape
The information of state, such as make a phone call environmental information locating for user etc..
Further, in this step, dial end equipment by inertia it is dynamic catch clothes, optical tracking system, movement gloves or
The modes such as camera obtain the action message for making a phone call user, the identification for action message, and bottom line is to identify use
The gesture motion track at family.It dials end equipment and obtains the expression information for making a phone call user by camera.
In one embodiment of the invention, in a step 101, it dials end equipment and identifies the use made a phone call first
Then family acquires the multi-modal information of the user identified.Locating scene is often very multiple when dialing electricity due to user
Miscellaneous, therefore, it is necessary to distinguish the user made a phone call and locating scene, for the user's carry out table made a phone call
Feelings, movement and the acquisition of sound.
It catches and acts in the movement acquisition mode that gloves etc. need information collecting device using inertia is dynamic, it is natural to wear
With the dynamic object caught clothes or act gloves of inertia as the user made a phone call.And passing through optical tracking system and camera shooting
It is first-class to be carried out in by way of movement is acquired with expression image recognition, then it should will make a phone call the image and scene image of user
It distinguishes.
In one embodiment, it can be identified in scene by distance and make a phone call user, distance is dialed into end and is set
Standby nearest user is as making a phone call user.For example, there are multiple personages in the scene currently made a phone call, it is logical to dial end equipment
It crosses and discriminance analysis is carried out to the image of optical tracking system or camera acquisition, know that distance dials the nearest personage of end equipment
Image act the image information for making a phone call user and expression is acquired as making a phone call user.
In one embodiment, it can be identified in scene by user characteristics and make a phone call user, that is, dialed end and set
It is standby to be stored with the characteristic information for making a phone call user, when the user makes a phone call, dials end equipment and pass through the multi-modal of acquisition
Information identifies the characteristic information of the user, and then using the user as user is made a phone call, acts for the user, table
The acquisition of feelings and voice.For example, the characteristic information for making a phone call user can be often to dial electricity under a kind of application scenario
The facial characteristics of the user of words, when the user is made a phone call by dialing end equipment, dialing end equipment can be known by face
, do not confirm and navigate to the user made a phone call, it is distinguished with other personages that may be present in scene, and then acquire
The multi-modal information for making a phone call user filters out in scene other people multi-modal information.
Or under a kind of application scenario, the characteristic information for making a phone call user can be the use often made a phone call
The sound characteristic at family, when the user is made a phone call by dialing end equipment, dial end equipment can by voice recognition, in conjunction with
Picture confirms and navigates to the user made a phone call, it is distinguished with other personages that may be present in scene, Jin Erke
To filter out other sound and the image information in scene, sound, movement and the expression of making a phone call user are acquired.
Certainly, the number for making a phone call user is not limited to one, often there is that need to carry out more people total dialing end
With the application scenario of call, under this situation, the user that makes a phone call be it is multiple, for multiple identifications for making a phone call user
Equally it can also assert that multiple users in certain distance are to make a phone call use by the knowledge above by distance otherwise
Family.Alternatively, can also be special for the identity of the user often to make a phone call jointly by knowing otherwise above by identity characteristic
Sign is recorded, and when making a phone call, regards as making a phone call user if identifying multiple user.It is multiple to make a phone call use
The identification at family can certainly be confirmed such as user's active to mode end sets the corresponding setting of progress is dialed by other.
When movement and the expression information of multiple users at end is dialed in acquisition, acoustic information and movement expression information are carried out
The user that corresponding acquisition, i.e. identification are currently being spoken, then carries out while adopting to the sound of the user, movement and expression information
Collection, after the user currently to speak switches to other people, identified again, then to the sound of the user after switching, movement and
Expression information is carried out while being acquired.
The identity characteristic for dialing end equipment combination user can also record the habits information of user made a phone call, example accordingly
It such as records user and often makes a phone call the prompting that can be made a phone call at the time point to whom, Huo Zhezhi at what time
It connected and dials the end equipment turn on automatically phone often dialed.
For another example, the habit that dialing end equipment record has user to make a phone call is not like or the inconvenient progress when making a phone call
Movement then dials end equipment and makes a phone call acquisition and transmission of the Shi Zeke without action message in the user.
Certainly, the acquisition of user action and expression can be configured to carry out by user to end equipment is dialed
Customized opening and closing, to realize secret protection to a certain extent.Dialing end equipment can also be by for beating
The identification of phone scene and the state recognition for making a phone call user, confirmation is some to be not suitable for carrying out movement and expression transmission expression
Scene and situation, when in this kind of scene and in the case of when, the acquisition for expression and movement is automatically closed, using traditional
Acquire the talking mode that sound is conveyed.
In one embodiment of the invention, the multi-modal information for dialing end equipment acquisition can also include making a phone call
Environmental information locating for user, making a phone call environmental information locating for user is also to be acquired by dialing end equipment, for example, can be with
Gone out by image recognition and makes a phone call place or weather etc. information locating for user.The environmental information of acquisition is sent to and is connect
Listen end that can further enrich the content that telephonic communication is transmitted.
In a step 102, movement, voice and expression information are sent to by server and answer end equipment.In this step
In, dial end equipment by the description acquired in a step 101 make a phone call the movement of user's communication state, voice, expression and
The multi-modal informations such as environmental information, to server, answer end by network transmission to transmit these information to for server,
Complete the information exchanging process of telephonic communication.
The means of communication towards intelligent robot provided in an embodiment of the present invention suitable for telephone receiving end, such as Fig. 2 institute
Show, this method comprises: step 201 and step 202.
In step 201, it answers end equipment and the movement for dialing end equipment transmission, voice and expression letter is received by server
Breath.Answer end equipment by network received from server in a step 102 by dial end upload description make a phone call user
The multi-modal informations such as movement, voice, expression and the environmental information of talking state complete the information exchanging process of telephonic communication.
Then in step 202, in conjunction with movement, voice and expression information, generation movement, voice and expression it is multi-modal
Output information is simultaneously exported to end subscriber is answered, i.e., is passed through based on the received information for dialing end acquisition in step 201 multi-modal
The way of output express to the user for answering end, complete entire communication process.
In this step, of particular note is that answering end equipment must be the machine that can carry out multi-modal expression
People, that is, multi-modal output information and output can be generated by itself software and hardware by answering end equipment.
It further, include: movement output step, expression output step and sound output step in step 102.Movement
Analyzing step parses action message, generates action command, and according to action command, export corresponding actions.Expression output step
Rapid i.e. parsing expression information, generates expression output order, according to expression output order, output phase answers expression.Sound exports step
Acoustic information is parsed, sound output order is generated, according to sound output order, exports corresponding sound.
In embodiments of the present invention, make a phone call the multi-modal information of user is with movement, voice, expression and environment
Etc. the information modes that combine export.Wherein, the output of action message by the limbs of robot or can be passed through
The display interface of robot realizes, praises during making a phone call to answering end subscriber for example, dialing end subscriber
Say: " you are made stick！" and thumb up, it dials end equipment and collects the voice messaging and the movement thumbed up letter
Breath answers after end equipment receives above- mentioned information, parses to corresponding action message, generate driving robot and pass through limbs
Carry out the action command of the movement, robot drives itself limbs to answering end according to the instruction while exporting voice messaging
User thumbs up.
Alternatively, answering after end equipment receives above- mentioned information, corresponding action message is parsed, driving itself is generated
Display interface shows the picture for movement of thumbing up or the action command of animation, and then robot passes through itself interface defeated
The picture thumbed up or animation are shown to answering end subscriber while voice messaging out.
It is similar for the way of output of expression information and the way of output of action message, it again may be by robot itself
Display interface and facial expression hardware realization expression.In example as above, end subscriber is dialed during making a phone call to answering
End subscriber carries out compliment and says: " you are made stick！" and thumb up while make happy expression, answer end equipment reception
To after above- mentioned information, corresponding expression information is parsed, driving robot is generated by facial expression hardware and shows the table
The expression output order of feelings, robot drive while exporting voice messaging and limb action according to the expression output order
Itself facial expression hardware makes the happy expression for raising eyebrow and showing smiling face, likewise, can also show boundary by itself
Face shows the picture or animation of happy expression, is not repeating herein.
With dial that end equipment is similar, end equipment is answered in specific embodiment and is carrying out multi-modal information expression
When, it is also desirable to receiving calls, user is identified, to determine the position for the user that receives calls, thus specifically being moved
Work and expression can make multi-modal output process not by the shadow for answering end ring border when exporting in face of the user to receive calls
It rings, gives the experience of face-to-face exchange, the interactive process of user and phone is made more to personalize.For receiving calls user's
Identification method with to dial end equipment similar for the identification method for making a phone call user, it can pass through distance or identity characteristic
Etc. modes identified.Example as above, robot recognizes receive calls user after, can confirm the position for the user that receives calls,
The position at robot place towards the user that receives calls when output is thumbed up and acted, to realize to answering electricity
The movement output effect that words user thumbs up.
For in the embodiment of above-mentioned telephone call end communication method, dial end there are more people to converse jointly application feelings
Scape answers end equipment and is carrying out multi-modal output table since the acoustic information of user is corresponding acquisition with movement expression information
Up to when, then export the movement and expression corresponding to it while exporting voice, after dialing the user that speaks of end switching, answer
End equipment is to dial the voice of the user of end acquisition after exporting switching while exporting its corresponding movement and expression.
For in the embodiment of above-mentioned telephone call end communication method, dial end equipment acquisition make a phone call user institute
The environmental information at place, expression output can be carried out by itself display interface or voice by answering end equipment.For example, making a phone call
User location Founder is being rained, and is dialed end equipment and is collected to be sent to by server after the environmental information and answers end equipment,
End equipment is answered according to the rainy environmental information, the addition patter of rain can be synthesized in voice messaging and is exported, so that answering
Telephone subscriber hears rainy sound while hearing the sound for making a phone call user, makes a phone call user institute to recognize
The ambient conditions at place.Or it dials end equipment and can pass through itself display interface while exporting other multi-modal informations
Rain this ambient conditions text or image expression output, further enrich the content that telephonic communication is transmitted.
The means of communication towards intelligent robot suitable for telephone call end that aforementioned present invention provides are logical in phone
During news, for the method for the acquisition acquisition and transmission of information.Equally, the face provided by the invention suitable for telephone receiving end
It is during telephonic communication, for the method for reception and the output of information to the means of communication of intelligent robot.Actual
In application mode, if the both devices of telephonic communication can be carried out the expression of multi-modal data, such as the both sides to make a phone call are
For phone robot, (phone robot is to increase the sensing that various robot scenes need on the basis of existing smart phone
Device, camera etc. can realize the relevant some experience of robot on mobile phone, and the appearance of mobile phone can also change adult
Shape, but volume is still similar with mobile phone), then both call sides can be obtained using the acquisition of above- mentioned information provided by the invention simultaneously
With the method for the method and reception and output for information of transmission, to realize two-way multi-modal communication on telephone.
If an only method, apparatus can carry out multi-modal data expression, the side with corresponding function then can be using this
The method of reception and the output of the above- mentioned information that invention provides, without a side then corresponding application present invention offer of corresponding function
Above- mentioned information acquisition obtain and send method, realize unidirectional multi-modal communication on telephone.
The embodiment of the present invention also provide it is a kind of dial end equipment towards intelligent robot, set as shown in figure 3, this dials end
Standby includes: to obtain module 1 and sending module 2.
Wherein, module 1 is obtained for obtaining the movement for making a phone call user, voice and expression information.
Sending module 2 is used to act, voice and expression information are sent to by server and answer end equipment.
Further, as shown in figure 4, obtaining module 1 includes: movement acquisition submodule 11 and expression acquisition submodule 12.
Wherein, movement acquisition submodule 11 is used to catch clothes, optical tracking system, movement gloves or camera by the way that inertia is dynamic
Obtain the action message for making a phone call user.
Expression acquisition submodule 12 is used to obtain the expression information for making a phone call user by camera.
Specific embodiment provided in an embodiment of the present invention that dial end equipment towards intelligent robot is at above-mentioned
Being illustrated suitable for the means of communication towards intelligent robot at telephone call end provided is provided, it is no longer superfluous herein
It states.
The embodiment of the present invention also provide it is a kind of answer end equipment towards intelligent robot, set as shown in figure 5, this answers end
Standby includes: receiving module 3 and output module 4.
Wherein, receiving module 3 is used to receive movement, voice and the expression information for dialing end equipment transmission by server.
Movement, voice and expression information of the output module 4 for combination, generation movement, voice and expression it is multi-modal defeated
It information and exports out to being answered end subscriber.
Further, as shown in fig. 6, output module 4 includes: movement output sub-module 41 and expression output sub-module 42.
Wherein, movement output sub-module 41 is for parsing action message, generates action command, and according to action command,
Export corresponding actions.
For expression output sub-module 42 for parsing expression information, generation expression output order is defeated according to expression output order
Corresponding expression out.
Specific embodiment provided in an embodiment of the present invention that answer end equipment towards intelligent robot is at above-mentioned
Being illustrated suitable for the means of communication towards intelligent robot at telephone receiving end provided is provided, it is no longer superfluous herein
It states.
The embodiment of the present invention also provides a kind of communication system towards intelligent robot, as shown in fig. 7, the communication system packet
It includes: it is above-mentioned to dial end equipment and answer end equipment, it dials end equipment and passes through network to the collected multi-modal electricity of server transport
Information is talked about, the multi-modal phone information that end equipment receives server transport by network is answered.
The means of communication provided in an embodiment of the present invention towards intelligent robot dial end equipment and answer end equipment and logical
News system, by answering dialing end acquisition and make a phone call the multi-modal informations such as movement, voice and expression of user and be sent to
End carries out the multi-modal expression of the information such as the movement, voice and expression to the user that receives calls, and realizes the electricity of multi-modal mode
Words communication.Relative to traditional telephone communication mode that can only express oneself by voice, intonation, the present invention is realizing call
While, by the expression of correspondent, limb action is transmitted and is expressed, and enriches the information mode of communication of telephonic communication and interior
Hold, improves the reception and registration efficiency of information, and user can be brought similar to the impression of face-to-face exchange, make the friendship of user and phone
Mutual process more personalizes, and improves the communication experience of user.
While it is disclosed that embodiment content as above but described only to facilitate understanding the present invention and adopting
Embodiment is not intended to limit the invention.Any those skilled in the art to which this invention pertains are not departing from this
Under the premise of the disclosed spirit and scope of invention, any modification and change can be made in the implementing form and in details,
But scope of patent protection of the invention, still should be subject to the scope of the claims as defined in the appended claims.
Claims (9)
1. a kind of means of communication towards intelligent robot characterized by comprising
Dial end equipment by the acquisition of multi-modal information and by user distance or user characteristics identify one in scene or
Multiple users made a phone call acquire movement, voice and expression information that the one or more identified makes a phone call user,
Wherein, to it is multiple make a phone call user's acquisition movement, voice and expression information when, currently the user that is speaking is simultaneously right for identification
Movement, voice and the expression information of the user is carried out while being acquired, and after active user switches other people, is used after again identifying that switching
Movement, voice and the expression information at family, wherein the acquisition of user action and expression can to dial end equipment customized by described
Setting opens and closes；
The movement, voice and expression information that the one or more identified makes a phone call user are sent by server
To answering end equipment.
2. the means of communication according to claim 1, which is characterized in that acquisition movement, voice and the expression information the step of
In include:
The end equipment of dialing catches clothes, optical tracking system, movement gloves or camera acquisition and makes a phone call use by the way that inertia is dynamic
The action message at family；
The end equipment of dialing obtains the expression information for making a phone call user by camera.
3. a kind of means of communication towards intelligent robot, the intelligent robot can carry out multi-modal expression, which is characterized in that
Include:
It answers end equipment and dials what end equipment was sent according to the means of communication as claimed in claim 1 or 2 by server reception
The one or more identified makes a phone call movement, voice and the expression information of user；
End equipment is answered by the acquisition of multi-modal information and by answering electricity in user distance or user characteristics identification scene
User is talked about, in conjunction with the movement, voice and expression information, generation movement, the multi-modal output information of voice and expression and defeated
Answered end subscriber out, wherein when receiving multiple movements for making a phone call user, voice and expression information, cut dialing end
After changing the user to speak, movement, voice and the expression information for holding the user of acquisition are dialed after answering end equipment output switching.
4. the means of communication according to claim 3, which is characterized in that in the multi-modal defeated of generation movement, voice and expression
Information and output, which were given in the step of answering end subscriber, out includes:
The action message is parsed, generates action command, and according to the action command, export corresponding actions；
The expression information is parsed, generates expression output order, according to the expression output order, output phase answers expression.
5. a kind of dial end equipment towards intelligent robot characterized by comprising
Module is obtained, is used to identify one in scene by the acquisition of multi-modal information and by user distance or user characteristics
A or multiple users made a phone call acquire movement, voice and expression that the one or more identified makes a phone call user
Information, wherein to it is multiple make a phone call user's acquisition movement, voice and expression information when, the current use spoken of identification
Family and the movement to the user, voice and expression information are carried out while being acquired, and after active user switches other people, are again identified that and are cut
Change movement, voice and the expression information of rear user, wherein the acquisition of user action and expression can dial end equipment by described
Customized setting opens and closes；
Sending module, the one or more for being used to have identified make a phone call the movement, voice and the expression letter of user
Breath is sent to by server answers end equipment.
6. according to claim 5 dial end equipment, which is characterized in that the acquisition module includes:
Acquisition submodule is acted, is used to catch clothes, optical tracking system, movement gloves or camera acquisition by the way that inertia is dynamic and dial
The action message of telephone subscriber；
Expression acquisition submodule is used to obtain the expression information for making a phone call user by camera.
7. a kind of answer end equipment towards intelligent robot, the intelligent robot can carry out multi-modal expression, and feature exists
In, comprising:
Receiving module is used to received by server according to the knowledge such as described in claim 5 or 6 for dialing end equipment transmission
Not Chu one or more make a phone call movement, voice and the expression information of user；
Output module is used to pass through the acquisition of multi-modal information and identifies connecing in scene by user distance or user characteristics
Answer a call user, in conjunction with the movement, voice and expression information, the multi-modal output information of generation movement, voice and expression
And end subscriber is answered in output, wherein when receiving multiple movements for making a phone call user, voice and expression information, is being dialed
After the user that end switching is spoken, movement, voice and the expression information for holding the user of acquisition are dialed after answering end equipment output switching.
8. according to claim 7 answer end equipment, which is characterized in that the output module includes:
Output sub-module is acted, is used to parse the action message, generates action command, and according to the action command,
Export corresponding actions；
Expression output sub-module is used to parse the expression information, generates expression output order, is referred to according to expression output
It enables, output phase answers expression.
9. a kind of communication system towards intelligent robot characterized by comprising
It is such as described in claim 5 or 6 to dial end equipment and answer end equipment as claimed in claim 7 or 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610597245.6A CN106227347B (en) | 2016-07-26 | 2016-07-26 | The means of communication, equipment and communication system towards intelligent robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610597245.6A CN106227347B (en) | 2016-07-26 | 2016-07-26 | The means of communication, equipment and communication system towards intelligent robot |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106227347A CN106227347A (en) | 2016-12-14 |
| CN106227347B true CN106227347B (en) | 2019-05-21 |
Family
ID=57532884
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610597245.6A Active CN106227347B (en) | 2016-07-26 | 2016-07-26 | The means of communication, equipment and communication system towards intelligent robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106227347B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109890030B (en) * | 2018-12-20 | 2022-05-06 | 广东乐心医疗电子股份有限公司 | Method for establishing first communication |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007136167A1 (en) * | 2006-05-24 | 2007-11-29 | Simlab Co., Ltd. | Communication system among toy robots using messenger and toy robot linked with the same |
| CN101474481A (en) * | 2009-01-12 | 2009-07-08 | 北京科技大学 | Emotional robot system |
| CN101808047A (en) * | 2010-02-10 | 2010-08-18 | 深圳先进技术研究院 | Instant messaging partner robot and instant messaging method with messaging partner |
| CN201611889U (en) * | 2010-02-10 | 2010-10-20 | 深圳先进技术研究院 | Instant messaging partner robot |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001277166A (en) * | 2000-03-31 | 2001-10-09 | Sony Corp | Robot and behaivoir determining method therefor |
-
2016
- 2016-07-26 CN CN201610597245.6A patent/CN106227347B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007136167A1 (en) * | 2006-05-24 | 2007-11-29 | Simlab Co., Ltd. | Communication system among toy robots using messenger and toy robot linked with the same |
| CN101474481A (en) * | 2009-01-12 | 2009-07-08 | 北京科技大学 | Emotional robot system |
| CN101808047A (en) * | 2010-02-10 | 2010-08-18 | 深圳先进技术研究院 | Instant messaging partner robot and instant messaging method with messaging partner |
| CN201611889U (en) * | 2010-02-10 | 2010-10-20 | 深圳先进技术研究院 | Instant messaging partner robot |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106227347A (en) | 2016-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110381485A (en) | Bluetooth communication method, TWS bluetooth headset and terminal | |
| CN110113483A (en) | Use the powerful method of the increasing of electronic equipment and relevant apparatus | |
| CN111294463B (en) | Intelligent response method and system | |
| CN110086985A (en) | A kind of method for recording and electronic equipment of time-lapse photography | |
| CN101350845B (en) | Method for simulating talking scene of mobile phone visible telephone | |
| CN109831622A (en) | A kind of image pickup method and electronic equipment | |
| KR20050102079A (en) | Avatar database for mobile video communications | |
| CN110087012A (en) | A kind of control method and electronic equipment of camera | |
| CN109842712A (en) | Method, apparatus, computer equipment and the storage medium that message registration generates | |
| WO2011050682A1 (en) | Method and device for realizing videophone | |
| CN105872444A (en) | Method, device and system for video call | |
| CN114115674B (en) | Method for positioning sound recording and document content, electronic equipment and storage medium | |
| CN109286725A (en) | Interpretation method and terminal | |
| CN105939250A (en) | Audio processing method and apparatus | |
| CN107623830B (en) | A kind of video call method and electronic equipment | |
| CN103415003A (en) | Virtual figure communication system | |
| CN113194203A (en) | Communication system, answering and dialing method and communication system for hearing-impaired people | |
| EP3174052A1 (en) | Method and device for realizing voice message visualization service | |
| CN110570847A (en) | Man-machine interaction system and method for multi-person scene | |
| CN106954099A (en) | First terminal shows the method and system of the screen interface of second terminal | |
| CN106227347B (en) | The means of communication, equipment and communication system towards intelligent robot | |
| CN202078740U (en) | Intelligent toy with monitoring function | |
| CN110536029A (en) | A kind of exchange method, network side equipment, terminal device, storage medium and system | |
| CN111835923B (en) | Mobile voice interactive dialogue system based on artificial intelligence | |
| CN108900652A (en) | A kind of intelligence generates the method and device of address list |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |