CN101808047A - Instant messaging partner robot and instant messaging method with messaging partner - Google Patents

Instant messaging partner robot and instant messaging method with messaging partner Download PDF

Info

Publication number
CN101808047A
CN101808047A CN 201010113117 CN201010113117A CN101808047A CN 101808047 A CN101808047 A CN 101808047A CN 201010113117 CN201010113117 CN 201010113117 CN 201010113117 A CN201010113117 A CN 201010113117A CN 101808047 A CN101808047 A CN 101808047A
Authority
CN
China
Prior art keywords
local
information
instant messaging
robot
behavior
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 201010113117
Other languages
Chinese (zh)
Inventor
毕亚雷
胡晓伟
程俊
刘伟
沈玲玲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Institute of Advanced Technology of CAS
Original Assignee
Shenzhen Institute of Advanced Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Institute of Advanced Technology of CAS filed Critical Shenzhen Institute of Advanced Technology of CAS
Priority to CN 201010113117 priority Critical patent/CN101808047A/en
Publication of CN101808047A publication Critical patent/CN101808047A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Transfer Between Computers (AREA)

Abstract

The invention disclose an instant messaging partner robot, which comprises a robot entity bearing each component of a robot, an information input device, an information processing module, a behavior expression device, and an instant messaging module. The information input device is used for inputting the local behavior information of a user; the information processing module is used for processing the local behavior information so as to acquire a local behavior instruction and/or local messaging information, and processing the remote messaging information so as to acquire a local behavior instruction; the behavior expression device is used for performing corresponding local behavior expression according to the local behavior instruction; and the instant messaging module is used for receiving the remote messaging information from a communication terminal, transmitting the remote messaging information to the information processing module, acquiring the local messaging information and outputting the local messaging information through a communication terminal. In addition, the invention also relates to an instant messaging method by using the robot. The instant messaging partner robot can realize real behavior virtualization, virtual behavior actualization and personalized instant messaging service, improve user experience, and increase the value of the instant messaging.

Description

Instant messaging partner robot and have the instant communication method of partner
[technical field]
The present invention relates to a kind of communication device, especially a kind of instant communication device.
The invention still further relates to a kind of means of communication, especially a kind of instant communication method.
[background technology]
Instant messaging (Instant Messenger is called for short IM) is meant that two people or many people use network instant transmission message language, archives, voice and Video show. Messenger, NET Messenger Service, Jabber, ICQ and QQ, imo: the Internet office, juyouchina, Gmail Talk, Fetion, Big Formica fusca bigant, extensive and profound in meaning instant messaging, kilowatt instantaneous communication system or the like.Instant messaging utilizes network to realize the instant interchange and interaction of the information of literal, voice, video, file, time and the Financial cost of linking up both sides have effectively been saved, not only become people's tool of communications, also become people and carry out the platform that ecommerce, work, study etc. exchange.
The development of existing instant messaging is confined to constantly improve the expanded function of instant messaging itself always, as provide voice/video to chat, transmit file, transmission Email, many people chat, online perception or the like, these have just enriched the form of online chatting, do not consider IM user's demand from the angle of operating side.
[summary of the invention]
The objective of the invention is to, a kind of robot that can be used as the instant messaging companion is provided, realize that real behavior is virtual on the one hand, it is mutual that assisted user carries out instant messaging, realize local the deduction and remote transmission during information of same that the user is sent, realize virtual behavior realization on the other hand, the multimedia information stream of receiving remote and the corresponding information of deducing.
Another object of the present invention is to provide a kind of instant communication method with local companion.
In order to realize above-mentioned purpose, technical scheme of the present invention is as follows:
The invention provides a kind of instant messaging partner robot, comprise the robot entity of carrying robot each parts, also comprise: message input device is used to import user's local behavioural information; Message processing module is used for described local behavioural information handled obtaining local behavior command and/or local communication information, telecommunication information is handled obtaining local behavior command; The behavior expression device is used for carrying out corresponding local behavior according to described local behavior command and expresses; And the instant messaging module, be used to receive from the telecommunication information of communicating terminal and with described telecommunication information and pass to message processing module, receive local communication information and send by communication terminal.
Preferably, described behavior expression device is carried out corresponding local behavior expression and instant messaging module according to described local behavior command and local communication information is sent synchronously by communication terminal is carried out.
Preferably, described instant messaging module be described instant messaging partner robot built-in or external.
Preferably, described communicating terminal is an immediate communication tool.
Preferably, described message input device comprises more than one in image input device, audio input device and the character inputting device.
Preferably, described image input device comprises more than one in the following equipment: camera head, the facial expression image or the human action image that are used to catch the user; And memory device, be used to preserve the file that comprises image, as the image input source.
Preferably, described audio input device comprises more than one in the following equipment: microphone is used to obtain voice or music; Telephone communication device is used to obtain call voice; And memory device, be used to preserve the file that comprises sound, as the sound input source.
Preferably, described character inputting device comprises more than one in the following equipment: keyboard or handwriting input device are used for input characters; Conversion equipment is used for obtaining literal and input characters according to voice; And memory device, be used to preserve the file that comprises literal, as the literal input source.
Preferably, described message processing module comprises more than one in graphics processing unit, sound processing unit and the word processing unit.
Preferably, described graphics processing unit comprises more than one in the following processing unit: face identification unit, be used to discern user's facial expression, and obtain express one's feelings relevant local behavior command and/or local communication information; The action recognition unit is used to discern user's human action, obtains moving relevant local behavior command and/or local communication information; The picture processing unit is used to analyze image content, obtains image content relevant local behavior command and/or local communication information; And virtual expression processing unit, be used to handle virtual expression, obtain express one's feelings relevant local behavior command and/or local communication information.
Preferably, described message processing module comprises modular converter, and the facial expression image or the human action image transitions that are used for the user are virtual expression.
Preferably, described sound processing unit comprises more than one in the following processing unit: acoustic recognition unit is used to discern user's voice; Audio Processing Unit is used for the analyzing speech content, obtains voice content relevant local behavior command and/or local communication information; And the music unit, be used to resolve music file and broadcast.
Preferably, described word processing unit comprises more than one in the following processing unit: semantic recognition unit, be used to analyze the semantic information of literal, and obtain literal relevant behavior command and/or local communication information; And the phonetic synthesis unit, be used for text conversion is become voice, play for robot.
Preferably, described behavior expression device comprises more than one in mechanical movement assembly, luminescence component, voice output assembly and the display unit.
Preferably, described mechanical movement assembly comprises: but be located at the robot head folding eyes and face, be located in rotating eyeball in the eyes, the four limbs that can brandish and the rotatable base more than one.
Preferably, described luminescence component comprises the LED lamp of sparkling and adjustable brightness joint.
Preferably, described voice output assembly is audio amplifier or earphone.
Preferably, the instant messaging partner robot also comprises study module, is used for collecting user profile in user's use, obtains being more suitable for the behavior expression pattern and the telecommunication information pattern of user's use habit.
The present invention also provides a kind of instant communication method with partner, comprising: information input step, input user's local behavioural information; The information processing step handles to obtain local behavior command and/or local communication information to described local behavioural information, telecommunication information is handled obtaining local behavior command; Step is expressed in behavior, carries out corresponding behavior in this locality according to described local behavior command and expresses; And the instant messaging step, receive telecommunication information from communicating terminal, receive local communication information and send by communication terminal.
Preferably, described behavior is expressed in the step in the behavior expression of being correlated with in this locality according to described local behavior command and the instant messaging step local communication information sent synchronously by communication terminal and is carried out.
Preferably, described communicating terminal is an immediate communication tool.
Preferably, the local behavioural information of importing in the described information input step comprises image, sound and/or literal, described image comprises user's facial expression image, human action image and/or virtual expression, and described sound comprises user speech, call voice and/or music.
Preferably, described information processing step comprises switch process, is virtual expression with user's facial expression image or human action image transitions.
Preferably, described local behavior is expressed and is comprised mechanical movement, luminous, voice output and/or demonstration.
Preferably, the instant communication method with partner also comprises learning procedure, collects user profile in user's use, obtains being more suitable for the behavior expression pattern and the telecommunication information pattern of user's use habit.
Because adopt above-mentioned technical scheme, beneficial effect of the present invention comprises:
The present invention provides partner for instant messaging, realize that real behavior is virtual on the one hand, it is mutual that assisted user carries out instant messaging, realize local the deduction and remote transmission during information of same that the user is sent, realize virtual behavior realization on the other hand, the multimedia information stream of receiving remote and the corresponding information of deducing, and by the information service of robot autonomous study realization personalized network, thereby, promoted user experience, be the instant messaging increment.
The present invention provides local to local, local extremely long-range and long-range to local multichannel interactive intelligent platform for instant messaging, open up the function of the multiple user side of instant messaging, included but not limited to chat robots, robot pet, robot prompting or the like.
By the conversion of different information flows, to literal, literal to voice etc., increased the convenience of robot partner use as voice.
In addition, by the study of partner robot self, in use constantly collect user profile, as user's voice, speech habits, motor habit etc., the occupation mode that the service of robot is close to the users has more strengthened user experience.
[description of drawings]
Below in conjunction with accompanying drawing,, will make technical scheme of the present invention and other beneficial effects apparent by detailed description to preferred embodiment of the present invention.
In the accompanying drawing,
Fig. 1 is the theory diagram of instant messaging partner robot of the present invention;
Fig. 2 is the more detailed theory diagram of instant messaging partner robot of the present invention;
Fig. 3 is the instant communication method flow chart with partner of the present invention.
[embodiment]
Reach technological means and the effect that predetermined purpose is taked for further setting forth the present invention, see also following about detailed description of the present invention and accompanying drawing, believe purpose of the present invention, feature and characteristics, should obtain thus going deep into and concrete understanding, yet drawings and embodiments only provide reference and explanation usefulness, are not to be used for the present invention is limited.
" this locality " among the present invention is meant the position at user place, and " long-range " is meant the position at the object place, strange land that the user exchanges by instant messaging.
As shown in Figure 1, instant messaging partner robot of the present invention comprises the robot entity of each parts of carrying robot, also comprises message input device 10, message processing module 20, behavior expression device 30 and instant messaging module 40.
Message input device 10 is used to import user's local behavioural information; 20 pairs of local behavioural informations of message processing module are handled and are obtained local behavior command and local communication information, telecommunication information are handled obtaining local behavior command; Behavior expression device 30 is carried out corresponding behavior according to local behavior command and is expressed; Instant messaging module 40 receives from the telecommunication information of communication terminal and passes to message processing module, and local communication information is sent by communication terminal; The behavior expression device is carried out local behavior expression and instant messaging module according to local behavior command and local communication information is sent synchronously by communication terminal is carried out; Communication module 40 can be internal or external; Communicating terminal then comprises immediate communication tools such as MSN, QQ.
On the one hand, realized that real behavior is virtual, it is mutual that the robot assisted user carries out instant messaging, realize local the deduction and remote transmission during information of same that the user is sent, just, it is local behavioural information that the behavior that the user takes place in this locality is gathered by robot, and robot is converted to local behavioural information local behavior command again and expresses in this locality enforcement behavior, and robot also converts local behavioural information to local communication information and sends by communicating terminal simultaneously; Realize virtual behavior realization on the other hand, the multimedia information stream of robot receiving remote and the corresponding information of deducing, just, robot receives telecommunication information from communicating terminal, is converted to local behavior command and expresses in this locality enforcement behavior.
Local behavioural information comprises image, sound or literal.Message input device 10 comprises more than one in image input device 102, audio input device 104 and the character inputting device 106.
Image input device 102 comprises more than one in picture pick-up device and the memory device.Picture pick-up device is used to catch user's facial expression image or human action image.Preserve the file that comprises image in the memory device,,, offer message processing module, such as smiling face's picture, dancing video etc. as the image input source as picture, video etc.
Audio input device 104 comprises more than one in microphone, telephone communication device and the memory device.Microphone is used to obtain voice or music, as user's word or dancing accompaniment music; Telephone communication device is used to obtain call voice, and promptly this robot can be used for telephonic communication, and obtains voice in the telephonic communication process; Preserve the file that comprises sound in the memory device, as the sound input source, as user recording or music, can be the user file for the recording that guarantees to instruct the consistency of input to do user recording.
Character inputting device 106 comprises more than one in keyboard or handwriting input device, conversion equipment and the memory device.Keyboard or handwriting input device are the means of the input characters of routine; Conversion equipment is a kind of equipment that utilizes voice to the input characters of literal (speech to text) technology, can convert user's voice to literal; Preserve the file that comprises image in the memory device, this document can be used as the literal input source.
Above-mentioned image, sound or literal are except being used for local the expression, and also the processing through message processing module 20 forms local communication information, sends to far-end by the instant messaging module.
Image, sound or literal can be independent appearance, also can occur together.Local behavioural information is included in image, sound or the literal, and message processing module 20 is used for image, sound or literal handled and obtains the indication robot and implement the local behavior command of appointment behavior and robot by the local communication information of communicating terminal to long-range transmission.Message processing module 20 comprises more than one in graphics processing unit 202, sound processing unit 204 and the word processing unit 206.
Graphics processing unit 202 comprises more than one in face identification unit, action recognition unit, picture processing unit and the virtual expression processing unit.Face identification unit is used to discern people's facial expression, obtain making robot make corresponding expression local behavior command and will be to the local communication information of long-range transmission, smiling face as the user is caught by camera, just can be converted into the action command that robot realizes the smiling face and sends laugh, simultaneously smiling face's associated picture (comprising real image and virtual image) be sent by instant communication terminal.The action recognition unit is used to discern human action, obtain instruction that robot is acted accordingly, making the action of waving such as the user is caught by camera, process action recognition module is identified as waves, just can be converted into the instruction of waving of robot, the associated picture (comprising real image and virtual image) of will waving simultaneously to move sends by instant communication terminal.The picture processing unit is used to analyze image content, and picture can be static or dynamic image, as user picture or GIF animation etc., obtains making the local behavior command of robot and to the local communication information of long-range transmission.Virtual expression processing unit is used to handle virtual expression, obtain making robot to make the instruction of corresponding expression, the associated picture of will expressing one's feelings simultaneously sends by instant communication terminal, and virtual expression is widely used on the network, can replace more literal expression, vivid.
Sound processing unit 204 comprises more than one in acoustic recognition unit and the music unit.Acoustic recognition unit is used to discern the user; Audio Processing Unit is used for the analyzing speech content, obtains making robot to make the local behavior command relevant with voice content, simultaneously relevant information is sent by instant communication terminal; The music unit is used to resolve the music file playing back music.
Word processing unit 206 comprises more than one in semantic recognition unit and the phonetic synthesis unit.Semantic recognition unit is used to analyze the semantic information of literal, obtains making robot to make the instruction of respective behavior, simultaneously relevant information is sent by instant communication terminal; The phonetic synthesis unit adopts literal to voice (text tospeech) technology text conversion to be become voice, reads aloud for robot.
In addition, also comprise modular converter 208, the facial expression image or the human action image transitions that are used for the user are virtual expression.
The behavior of robot is expressed and can be showed by action or sound and light program.Such as wave, rotation, face folding, eyes light-emitting flash and sounding etc.As shown in Figure 2, the behavior of robot is expressed assembly 30 and is installed in mechanical movement assembly 302, luminescence component 304, voice output assembly 306 and the display unit 308 on the machine human body more than one.
But mechanical movement assembly 302 comprises eyes and the face of being located at the robot head folding, is located at rotating eyeball, the four limbs that can brandish and rotatable base in the eyes.The folding of eyes can realize blinking, the folding of face can cooperate robot to read aloud.
Luminescence component 304 comprises the LED lamp of sparkling and adjustable brightness joint.The LED lamp can be installed on the eyes of robot, and makes the expression effect of robot more lively by brightness regulation and flicker effect.
Voice output assembly 306 is audio amplifier or earphone.
Display unit 308 is a display, can be used for showing virtual expression, literal, image etc.
Robot of the present invention can also realize all multi-functional, as independent chat, robot pet etc.Independent chat is exactly mutual between user and the robot, and the user is to robot input voice or literal, even local behavioural information such as action, and the processed back of these local behavioural informations is expressed by robot, reaches mutual purpose.And the behavior expression device of robot is made abundant expression, action and sounding etc. according to the local information of user's input and the telecommunication information that receives, and makes it can be used as pet.
By being connected to network, this robot can realize multiple teleinformatic deduction function, and as mail reminder, Network Transmission by triggering sound or action, luminous etc., realizes prompting function to the information of robot.
Further, robot also comprises study module 50, is used for collecting user profile in user's use, obtains being more suitable for the behavior expression pattern of user's use habit, the remote information communication mode and the personalized network information service.
As shown in Figure 3, be the instant communication method flow chart with partner of the present invention.This method comprises the steps:
S10: information input, input user's local behavioural information.Local behavioural information comprises image, sound or literal.The file of preserving in the user's that image such as picture pick-up device capture facial expression image or human action image or the memory device that comprises image is as picture, video etc.Voice that sound such as microphone obtain or music, user's word or dancing accompaniment music; The call voice that telephone communication device obtains; The file of preserving in the memory device that comprises sound, as user recording or music, can be the user file for the recording that guarantees to instruct the consistency of input to do user recording.Literal such as document, mail etc.
S20: information processing, described local behavioural information handled obtaining local behavior command and/or local communication information, telecommunication information is handled obtaining local behavior command.The processing that information processing relates to image, sound and literal etc. generates instruction, and generates the local communication information that is used to send to far-end.Specifically comprise recognition of face, action recognition, the generation of virtual expression, picture processing etc.
S30: behavior is expressed, and carries out corresponding behavior in this locality according to described local behavior command and expresses.The behavior of robot is expressed and can be showed by action or sound and light program.Such as wave, rotation, face folding, eyes light-emitting flash and sounding etc.Wait by driving device assembly, luminescence component, sounding component and display unit and to realize.
S40: instant messaging, receive telecommunication information from communicating terminal, receive local communication information and send by communication terminal.
Preferably, among behavior expression of being correlated with in this locality according to described local behavior command among the step S30 and the step S40 local communication information sent synchronously by communication terminal and carry out.
Used communicating terminal is an immediate communication tool among the S40, as MSN, QQ etc.
The local behavioural information of importing among the step S10 comprises image, sound and/or literal, and described image comprises user's facial expression image, human action image and/or virtual expression, and described sound comprises user speech, call voice and/or music.
Step 20 further comprises switch process, is virtual expression with user's facial expression image or human action image transitions.
Local behavior is expressed and is comprised mechanical movement, luminous, voice output and/or demonstration.
Further, also comprise S50: learning procedure, in user's use, collect user profile, obtain being more suitable for the behavior expression pattern of user's use habit, the telecommunication information pattern and the personalized network information service.
Embodiment 1:
Local and remote instant messaging amusement robot is an input, also is output, produces, transmits and express corresponding information.Local side instant messaging amusement robot obtains facial image by intelligent video camera head, and image is carried out in data processing module analyzes and generate the mood signal, then simultaneously to local and remote robot generation behavior command.Local and remote robot gives expression to corresponding mood and expression by the combination of action, sound, light.When using QQ to chat, local user has done an as cross as two sticks expression, on the one hand such as the user, local robot will identify expression, eyes throws open, and the LED of eyes etc. can also glimmer in unexpected blast, and face opens and send the sound of " "; Simultaneously, local robot sends out over a virtual anger expression by QQ to the other side and shows on telecreen, and long-range robot can make angry expression and action after grasping angry expression information pouncing on.
Embodiment 2:
The long-distance user sends the virtual expression signal of laughing by immediate communication tool to this locality, and local robot can catch this virtual expression signal automatically, and eyes is little to be closed, and the LED of eyes does not stop flicker, and face opens and send the laugh of " breathe out, breathe out ".
Embodiment 3:
When using immediate communication tool, the local user is to sad virtual expression of long-range transmission.Long-distance user's robot is after capturing this virtual expression, and eyes can slowly be closed, eyes LED brightness deterioration, face send " toot " sound.
Embodiment 4:
When the user said " login QQ chat " to robot, robot produced behavior command by speech recognition.Camera is taken pedestrian's face identification of going forward side by side simultaneously.If determining the user be owner, bundle by people's face information and identity information, robot will be automatically for owner logins the QQ chatroom, and does not need to import by keyboard user's number and password.By the binding of recognition of face and identity information, robot can also help owner to carry out other register, such as the login mailbox.
Embodiment 5:
The user sets the time and the content of incident in outlook.Robot can extract the time and the content of incident, and in time reminds the user.Such as event setup is to be owner's birthday on June 6th, 2009, and on the same day, robot will be automatically for owner sings the song that happy birthday to you, and with expression and dance movement.
Combine with specific sight, such as the happy farm of QQ, robot can regularly remind owner to remove to pluck dish.Can plant vegetables, receive dish certain period of time head of a secret society people, steal dish etc. through preestablishing.For another example, when receiving new mail, robot can read the address and the subject content of new mail by the Text-to-speech technology, can also pass through the Speech-to-text technology, realizes the function of writing mail by voice.
Embodiment 6:
By the robot learning technology, user's operating habit is learnt by the use information of collection, storage, analysis user by this robot, and some relevant services are provided automatically.With client's shopping online is example, and this robot can write down owner's shopping history, and it is sent to server, and server surpasses to be calculated and cloud computing, and can carry out relevant search automatically at the client's behavioural habits that calculate, and becomes owner's shopping consultant.Be example with the phonetic entry again, even user's pronunciation is nonstandard, such as the Hunan dialect, robot also can identify corresponding semanteme by study, and can make the pronunciation of Hunan dialect.
The above embodiment has only expressed several execution mode of the present invention, and it describes comparatively concrete and detailed, but can not therefore be interpreted as the restriction to claim of the present invention.Should be pointed out that for the person of ordinary skill of the art without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection range of patent of the present invention should be as the criterion with claims.

Claims (25)

1. an instant messaging partner robot comprises the robot entity that carries each parts of robot, it is characterized in that, also comprises:
Message input device is used to import user's local behavioural information;
Message processing module is used for described local behavioural information handled obtaining local behavior command and/or local communication information, telecommunication information is handled obtaining local behavior command;
The behavior expression device is used for carrying out corresponding local behavior according to described local behavior command and expresses; And
The instant messaging module is used to receive from the telecommunication information of communicating terminal and with described telecommunication information and passes to message processing module, obtains local communication information and sends by communication terminal.
2. instant messaging partner robot as claimed in claim 1, it is characterized in that described behavior expression device is carried out corresponding local behavior expression and instant messaging module according to described local behavior command and local communication information is sent synchronously by communication terminal carried out.
3. instant messaging partner robot as claimed in claim 1 or 2 is characterized in that, described instant messaging module be described instant messaging partner robot built-in or external.
4. instant messaging partner robot as claimed in claim 1 or 2 is characterized in that described communicating terminal is an immediate communication tool.
5. instant messaging partner robot as claimed in claim 1 or 2 is characterized in that described message input device comprises more than one in image input device, audio input device and the character inputting device.
6. instant messaging partner robot as claimed in claim 5 is characterized in that, described image input device comprises more than one in the following equipment:
Camera head, the facial expression image or the human action image that are used to catch the user; And
Memory device is used to preserve the file that comprises image, as the image input source.
7. instant messaging partner robot as claimed in claim 5 is characterized in that, described audio input device comprises more than one in the following equipment:
Microphone is used to obtain voice or music;
Telephone communication device is used to obtain call voice; And
Memory device is used to preserve the file that comprises sound, as the sound input source.
8. instant messaging partner robot as claimed in claim 5 is characterized in that, described character inputting device comprises more than one in the following equipment:
Keyboard or handwriting input device are used for input characters;
Conversion equipment is used for obtaining literal and input characters according to voice; And
Memory device is used to preserve the file that comprises literal, as the literal input source.
9. instant messaging partner robot as claimed in claim 1 or 2 is characterized in that, described message processing module comprises more than one in graphics processing unit, sound processing unit and the word processing unit.
10. instant messaging partner robot as claimed in claim 9 is characterized in that, described graphics processing unit comprises more than one in the following processing unit:
Face identification unit is used to discern user's facial expression, obtains express one's feelings relevant local behavior command and/or local communication information;
The action recognition unit is used to discern user's human action, obtains moving relevant local behavior command and/or local communication information;
The picture processing unit is used to analyze image content, obtains image content relevant local behavior command and/or local communication information; And
Virtual expression processing unit is used to handle virtual expression, obtains express one's feelings relevant local behavior command and/or local communication information.
11. instant messaging partner robot as claimed in claim 1 or 2 is characterized in that described message processing module comprises modular converter, the facial expression image or the human action image transitions that are used for the user are virtual expression.
12. instant messaging partner robot as claimed in claim 9 is characterized in that, described sound processing unit comprises more than one in the following processing unit:
Acoustic recognition unit is used to discern user's voice;
Audio Processing Unit is used for the analyzing speech content, obtains voice content relevant local behavior command and/or local communication information; And
The music unit is used to resolve music file and broadcast.
13. instant messaging partner robot as claimed in claim 9 is characterized in that, described word processing unit comprises more than one in the following processing unit:
Semantic recognition unit is used to analyze the semantic information of literal, obtains literal relevant behavior command and/or local communication information; And
The phonetic synthesis unit is used for text conversion is become voice, plays for robot.
14. instant messaging partner robot as claimed in claim 1 or 2 is characterized in that, described behavior expression device comprises more than one in mechanical movement assembly, luminescence component, voice output assembly and the display unit.
15. instant messaging partner robot as claimed in claim 14 is characterized in that, described mechanical movement assembly comprises:
But be located at the robot head folding eyes and face, be located in rotating eyeball in the eyes, the four limbs that can brandish and the rotatable base more than one.
16. instant messaging partner robot as claimed in claim 14 is characterized in that, described luminescence component comprises the LED lamp of sparkling and adjustable brightness joint.
17. instant messaging partner robot as claimed in claim 14 is characterized in that, described voice output assembly is audio amplifier or earphone.
18. instant messaging partner robot as claimed in claim 1 or 2, it is characterized in that, also comprise study module, be used for collecting user profile in user's use, obtain being more suitable for the behavior expression pattern of user's use habit, the telecommunication information pattern and the personalized network information service.
19. the instant communication method with partner comprises:
The information input step, input user's local behavioural information;
The information processing step handles to obtain local behavior command and/or local communication information to described local behavioural information; Telecommunication information handled obtain local behavior command;
Step is expressed in behavior, carries out corresponding behavior in this locality according to described local behavior command and expresses; And
The instant messaging step receives the telecommunication information from communicating terminal; Receive local communication information and send by communication terminal.
20. the instant communication method with partner as claimed in claim 19, it is characterized in that described behavior is expressed in the step in the behavior expression of being correlated with in this locality according to described local behavior command and the instant messaging step local communication information sent synchronously by communication terminal and carried out.
21., it is characterized in that described communicating terminal is an immediate communication tool as claim 19 or 20 described instant communication methods with partner.
22. as claim 19 or 20 described instant communication methods with partner, it is characterized in that, the local behavioural information of importing in the described information input step comprises image, sound and/or literal, described image comprises user's facial expression image, human action image and/or virtual expression, and described sound comprises user speech, call voice and/or music.
23. the instant communication method with partner as claimed in claim 22 is characterized in that, described information processing step comprises switch process, is virtual expression with user's facial expression image or human action image transitions.
24., it is characterized in that described local behavior is expressed and comprised mechanical movement, luminous, voice output and/or demonstration as claim 19 or 20 described instant communication methods with partner.
25. as claim 19 or 20 described instant communication methods with partner, it is characterized in that, also comprise learning procedure, in user's use, collect user profile, obtain being more suitable for the behavior expression pattern of user's use habit, the telecommunication information pattern and the personalized network information service.
CN 201010113117 2010-02-10 2010-02-10 Instant messaging partner robot and instant messaging method with messaging partner Pending CN101808047A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010113117 CN101808047A (en) 2010-02-10 2010-02-10 Instant messaging partner robot and instant messaging method with messaging partner

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010113117 CN101808047A (en) 2010-02-10 2010-02-10 Instant messaging partner robot and instant messaging method with messaging partner

Publications (1)

Publication Number Publication Date
CN101808047A true CN101808047A (en) 2010-08-18

Family

ID=42609669

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010113117 Pending CN101808047A (en) 2010-02-10 2010-02-10 Instant messaging partner robot and instant messaging method with messaging partner

Country Status (1)

Country Link
CN (1) CN101808047A (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102779144A (en) * 2012-03-20 2012-11-14 北京捷通华声语音技术有限公司 Method and device for controlling and inquiring through handwriting
CN103763179A (en) * 2014-01-07 2014-04-30 深圳市中科睿成智能科技有限公司 Micro-interaction device, micro-interaction system and micro-interaction method
CN103914005A (en) * 2012-12-31 2014-07-09 北京新媒传信科技有限公司 Robot control method and terminal
CN103986857A (en) * 2014-04-24 2014-08-13 华国洋 Wireless camera
CN104994013A (en) * 2015-08-11 2015-10-21 苏州乐聚一堂电子科技有限公司 Chat robot and chat system
CN105005614A (en) * 2015-07-17 2015-10-28 深圳狗尾草智能科技有限公司 Robot lover social system and interaction method thereof
CN105024922A (en) * 2015-07-22 2015-11-04 苏州乐聚一堂电子科技有限公司 Chatting robot and chatting system
CN105072143A (en) * 2015-07-02 2015-11-18 百度在线网络技术(北京)有限公司 Interaction system for intelligent robot and client based on artificial intelligence
CN105126355A (en) * 2015-08-06 2015-12-09 上海元趣信息技术有限公司 Child companion robot and child companioning system
CN105187768A (en) * 2015-07-29 2015-12-23 苏州乐聚一堂电子科技有限公司 Chatting robot and chatting system
CN105656954A (en) * 2014-11-11 2016-06-08 沈阳新松机器人自动化股份有限公司 Intelligent community system based on Internet and robot
CN105874405A (en) * 2013-12-11 2016-08-17 Lg电子株式会社 Smart home appliances, operating method of thereof, and voice recognition system using the smart home appliances
CN106227347A (en) * 2016-07-26 2016-12-14 北京光年无限科技有限公司 The means of communication, equipment and communication system towards intelligent robot
CN106453228A (en) * 2016-08-02 2017-02-22 北京光年无限科技有限公司 User login method and system used for intelligent robot
CN106919251A (en) * 2017-01-09 2017-07-04 重庆邮电大学 A kind of collaborative virtual learning environment natural interactive method based on multi-modal emotion recognition
CN106933354A (en) * 2017-02-16 2017-07-07 落地创意(武汉)科技有限公司 A kind of 3D printing interaction wall interactive approach and system
CN107316516A (en) * 2017-07-12 2017-11-03 马永怡 A kind of e-learning course delivery platform
CN107731227A (en) * 2017-10-27 2018-02-23 国网天津市电力公司 A kind of information interaction system and its information interacting method based on big data cloud computing
CN108260045A (en) * 2017-12-18 2018-07-06 佛山市创思特音响有限公司 A kind of sound system for recording user's use habit
CN108809808A (en) * 2018-06-06 2018-11-13 出门问问信息科技有限公司 Information processing method, device, equipment and storage medium
CN109623837A (en) * 2018-12-20 2019-04-16 北京子歌人工智能科技有限公司 A kind of partner robot based on artificial intelligence
CN109761126A (en) * 2019-01-31 2019-05-17 深圳桥通物联科技有限公司 The method that the speech recognition and content that passenger talks in lift car are shown
CN110213062A (en) * 2019-05-24 2019-09-06 北京小米移动软件有限公司 Handle the method and device of message

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1461464A (en) * 2001-04-20 2003-12-10 索尼公司 Language processor
CN1516078A (en) * 2003-01-09 2004-07-28 春水堂科技娱乐股份有限公司 Virtual portrait production system
CN1835828A (en) * 2003-08-12 2006-09-20 株式会社国际电气通信基础技术研究所 Communication robot control system
JP4276624B2 (en) * 2002-12-10 2009-06-10 本田技研工業株式会社 Robot control apparatus, robot control method, and robot control program
CN101474481A (en) * 2009-01-12 2009-07-08 北京科技大学 Emotional robot system
CN101527688A (en) * 2008-03-05 2009-09-09 吴迪 Network chatting pet, system and implementation method
CN201304244Y (en) * 2008-11-14 2009-09-09 成都绿芽科技发展有限公司 Multifunctional robot

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1461464A (en) * 2001-04-20 2003-12-10 索尼公司 Language processor
JP4276624B2 (en) * 2002-12-10 2009-06-10 本田技研工業株式会社 Robot control apparatus, robot control method, and robot control program
CN1516078A (en) * 2003-01-09 2004-07-28 春水堂科技娱乐股份有限公司 Virtual portrait production system
CN1835828A (en) * 2003-08-12 2006-09-20 株式会社国际电气通信基础技术研究所 Communication robot control system
CN101527688A (en) * 2008-03-05 2009-09-09 吴迪 Network chatting pet, system and implementation method
CN201304244Y (en) * 2008-11-14 2009-09-09 成都绿芽科技发展有限公司 Multifunctional robot
CN101474481A (en) * 2009-01-12 2009-07-08 北京科技大学 Emotional robot system

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102779144A (en) * 2012-03-20 2012-11-14 北京捷通华声语音技术有限公司 Method and device for controlling and inquiring through handwriting
CN103914005A (en) * 2012-12-31 2014-07-09 北京新媒传信科技有限公司 Robot control method and terminal
US10269344B2 (en) 2013-12-11 2019-04-23 Lg Electronics Inc. Smart home appliances, operating method of thereof, and voice recognition system using the smart home appliances
CN105874405A (en) * 2013-12-11 2016-08-17 Lg电子株式会社 Smart home appliances, operating method of thereof, and voice recognition system using the smart home appliances
CN103763179A (en) * 2014-01-07 2014-04-30 深圳市中科睿成智能科技有限公司 Micro-interaction device, micro-interaction system and micro-interaction method
CN103986857A (en) * 2014-04-24 2014-08-13 华国洋 Wireless camera
CN105656954A (en) * 2014-11-11 2016-06-08 沈阳新松机器人自动化股份有限公司 Intelligent community system based on Internet and robot
CN105072143B (en) * 2015-07-02 2018-11-20 百度在线网络技术(北京)有限公司 The interactive system of intelligent robot and client based on artificial intelligence
CN105072143A (en) * 2015-07-02 2015-11-18 百度在线网络技术(北京)有限公司 Interaction system for intelligent robot and client based on artificial intelligence
CN105005614A (en) * 2015-07-17 2015-10-28 深圳狗尾草智能科技有限公司 Robot lover social system and interaction method thereof
CN105024922A (en) * 2015-07-22 2015-11-04 苏州乐聚一堂电子科技有限公司 Chatting robot and chatting system
CN105187768A (en) * 2015-07-29 2015-12-23 苏州乐聚一堂电子科技有限公司 Chatting robot and chatting system
CN105126355A (en) * 2015-08-06 2015-12-09 上海元趣信息技术有限公司 Child companion robot and child companioning system
CN104994013A (en) * 2015-08-11 2015-10-21 苏州乐聚一堂电子科技有限公司 Chat robot and chat system
CN106227347A (en) * 2016-07-26 2016-12-14 北京光年无限科技有限公司 The means of communication, equipment and communication system towards intelligent robot
CN106227347B (en) * 2016-07-26 2019-05-21 北京光年无限科技有限公司 The means of communication, equipment and communication system towards intelligent robot
CN106453228A (en) * 2016-08-02 2017-02-22 北京光年无限科技有限公司 User login method and system used for intelligent robot
CN106453228B (en) * 2016-08-02 2019-12-24 北京光年无限科技有限公司 User login method and system for intelligent robot
CN106919251A (en) * 2017-01-09 2017-07-04 重庆邮电大学 A kind of collaborative virtual learning environment natural interactive method based on multi-modal emotion recognition
CN106933354A (en) * 2017-02-16 2017-07-07 落地创意(武汉)科技有限公司 A kind of 3D printing interaction wall interactive approach and system
CN107316516A (en) * 2017-07-12 2017-11-03 马永怡 A kind of e-learning course delivery platform
CN107731227A (en) * 2017-10-27 2018-02-23 国网天津市电力公司 A kind of information interaction system and its information interacting method based on big data cloud computing
CN108260045A (en) * 2017-12-18 2018-07-06 佛山市创思特音响有限公司 A kind of sound system for recording user's use habit
CN108809808A (en) * 2018-06-06 2018-11-13 出门问问信息科技有限公司 Information processing method, device, equipment and storage medium
CN109623837A (en) * 2018-12-20 2019-04-16 北京子歌人工智能科技有限公司 A kind of partner robot based on artificial intelligence
CN109761126A (en) * 2019-01-31 2019-05-17 深圳桥通物联科技有限公司 The method that the speech recognition and content that passenger talks in lift car are shown
CN110213062A (en) * 2019-05-24 2019-09-06 北京小米移动软件有限公司 Handle the method and device of message

Similar Documents

Publication Publication Date Title
CN101808047A (en) Instant messaging partner robot and instant messaging method with messaging partner
CN201611889U (en) Instant messaging partner robot
CN111833418B (en) Animation interaction method, device, equipment and storage medium
TWI430189B (en) System, apparatus and method for message simulation
CN105917404B (en) For realizing the method, apparatus and system of personal digital assistant
US11468894B2 (en) System and method for personalizing dialogue based on user's appearances
CN105224073B (en) A kind of point based on Voice command reads wrist-watch and its reading method
CN110413841A (en) Polymorphic exchange method, device, system, electronic equipment and storage medium
CN110188177A (en) Talk with generation method and device
JP2020034895A (en) Responding method and device
CN102568023A (en) Real-time animation for an expressive avatar
JP6400445B2 (en) Conversation analyzer, conversation analysis system, conversation analysis method, and conversation analysis program
CN105446953A (en) Intelligent robot and virtual 3D interactive system and method
CN1427626A (en) Virtual television telephone device
WO2020228208A1 (en) User smart device and emoticon processing method therefor
KR20100129122A (en) Animation system for reproducing text base data by animation
KR101738142B1 (en) System for generating digital life based on emotion and controlling method therefore
CN117523088A (en) Personalized three-dimensional digital human holographic interaction forming system and method
CN112382287A (en) Voice interaction method and device, electronic equipment and storage medium
CN116311456A (en) Personalized virtual human expression generating method based on multi-mode interaction information
KR20170135598A (en) System and Method for Voice Conversation using Synthesized Virtual Voice of a Designated Person
CN110910898B (en) Voice information processing method and device
CN114882861A (en) Voice generation method, device, equipment, medium and product
JP2021086415A (en) Virtual person interaction system, video generation method, and video generation program
CN112492400B (en) Interaction method, device, equipment, communication method and shooting method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20100818