CN105744471A

CN105744471A - Voice communication method and system for intelligent hardware and terminal

Info

Publication number: CN105744471A
Application number: CN201610214180.2A
Authority: CN
Inventors: 冯瑞军; 程翰; 马智; 杨文旭
Original assignee: Beijing Polycis Technology Co Ltd
Current assignee: Beijing Polycis Technology Co Ltd
Priority date: 2016-04-07
Filing date: 2016-04-07
Publication date: 2016-07-06
Anticipated expiration: 2036-04-07
Also published as: CN105744471B

Abstract

The invention discloses a voice communication method and system for intelligent hardware and a terminal. The method comprises the steps that the intelligent hardware receives a message channel selected by a user, receives first voice data input by the user in the message channel and sends the first voice data, identification information of the intelligent hardware and the identification information of the message channel to a server according to a confirmation instruction of the user; the server determines account information of a plurality of application programs corresponding to the message channel of the intelligent hardware according to the identification information of the intelligent hardware and the identification information of the message channel; and the server sends the first voice data to the terminal where the corresponding application program is located based on the account information of the corresponding application program, the terminal receives the first voice data sent by the server and sends second voice data to the corresponding intelligent hardware. By adopting the method, the voice communication user demand of the intelligent hardware with a plurality of terminals in a scene with relatively strong social property is satisfied, and the user experience of the user to the intelligent hardware is improved.

Description

The method and system of voice communication are carried out between Intelligent hardware and terminal

Technical field

The present invention relates to Intelligent hardware and technology of Internet of things field, particularly relate to the method and system carrying out voice communication between a kind of Intelligent hardware and terminal.

Background technology

Along with communication technology, computer technology, network technology, control technology fast development, the Intelligent hardware such as intelligent toy, wearable device, intelligent home device, intelligent appliance is popularized gradually.Usual Intelligent hardware and application A PP (APPlication) co-ordination in terminal (such as, mobile phone or panel computer).But, owing to hardware display screen is less and user's input is less with output interface button operation, the speech message interactive interface causing Intelligent hardware becomes complex with control, and the APP in Intelligent hardware with terminal carries out in the process of interactive voice, usual Intelligent hardware simultaneously can only and an App between realize speech message communication, this will weaken the speech message function of Intelligent hardware, it is impossible to meeting the business demand of speech message in the scene that social attribute is strong, Consumer's Experience is had a greatly reduced quality.

Summary of the invention

The purpose of the present invention is intended to solve at least to a certain extent one of above-mentioned technical problem.

For this, a kind of method that first purpose of the present invention is in that to propose to carry out voice communication between Intelligent hardware and terminal.The method achieve Intelligent hardware voice communication simultaneously and between multiple terminal, meet Intelligent hardware and multiple terminals in the scene that social attribute is stronger and carry out the user's request of voice communication, improve user's user experience to Intelligent hardware.

Second purpose of the present invention is in that the system proposing to carry out voice communication between a kind of Intelligent hardware and terminal.

To achieve these goals, the method carrying out voice communication between Intelligent hardware and the terminal of first aspect present invention embodiment, including: Intelligent hardware receives the message channel that user selects, and receives the first speech data of described user input under described message channel；When described Intelligent hardware receives the confirmation instruction that described user sends described first speech data, described first speech data, the identification information of described Intelligent hardware and the identification information of described message channel are sent to service end by described Intelligent hardware；Described service end determines the account information of the multiple application programs corresponding to described message channel of described Intelligent hardware according to the identification information of described Intelligent hardware and the identification information of described message channel；And described service end sends described first speech data based on the account information of corresponding application program to the terminal at corresponding application program place；Described terminal receives described first speech data that described service end sends, and receive the second speech data of user's input and the described Intelligent hardware of user's selection, and send the account information of the application program of described second speech data, correspondence and the identification information of described Intelligent hardware to described service end；

Described service end determines the identification information of the message channel of described Intelligent hardware according to the corresponding account information of application program and the identification information of described Intelligent hardware, and sends the identification information of the message channel of described second speech data and described Intelligent hardware to described Intelligent hardware；Described Intelligent hardware receives the described second speech data that described service end sends, and at the message channel described second speech data of broadcasting of described Intelligent hardware.

The method carrying out voice communication between Intelligent hardware and terminal according to embodiments of the present invention, the first speech data is inputted at corresponding message channel at Intelligent hardware, and when the first speech data is sent to service end, service end obtains the account information of multiple application programs corresponding to this message channel, and based on the account information of corresponding application program, first speech data is sent the terminal to corresponding application program place, and the second speech data of user's typing is sent to corresponding Intelligent hardware by terminal.Hereby it is achieved that the voice communication that Intelligent hardware is simultaneously and between multiple terminal, meet Intelligent hardware and multiple terminals in the scene that social attribute is stronger and carry out the user's request of voice communication, improve user's user experience to Intelligent hardware.

According to one embodiment of present invention, it is characterised in that described service end includes first server and second server, wherein,

The identification information of described first speech data, the identification information of described Intelligent hardware and described message channel that the described first server described Intelligent hardware of reception sends, and described first speech data, the identification information of described Intelligent hardware and the identification information of described message channel are forwarded to described second server；

The described second server corresponding relation according to the identification information of the identification information of the Intelligent hardware pre-saved, the account information of application program and message channel, determine and the account information of the multiple application programs corresponding to the described message channel of described Intelligent hardware, and the account information of determined multiple application programs is sent to described first server；

The account information of multiple application programs that described first server returns based on described second server, sends described first speech data to the terminal at corresponding application program place respectively.

According to one embodiment of present invention, described service end determines the account information of the multiple application programs corresponding to described message channel of described Intelligent hardware according to the identification information of described Intelligent hardware and the identification information of described message channel, including:

Described service end is based on the corresponding relation of the identification information of the identification information of the Intelligent hardware pre-saved, the account information of application program and message channel, it is determined that with the account information of the multiple application programs corresponding to the identification information of the identification information of described Intelligent hardware and described message channel.

According to one embodiment of present invention, before described Intelligent hardware receives the message channel that user selects, described method also includes:

Service end receives and preserves the corresponding relation of the identification information of the account information of application program, the identification information of Intelligent hardware and message channel that terminal sends.

According to one embodiment of present invention, before described service end sends described first speech data based on the account information of corresponding application program to the terminal at corresponding application program place, described method also includes:

Described service end judges whether corresponding application program connects described service end；

If it is, described service end sends described first speech data to the terminal at corresponding application program place；

If it is not, then the first speech data described in described service end buffer memory, and when monitoring corresponding application program and being connected with service end foundation, described voice service is sent the terminal to corresponding application program place.

To achieve these goals, the system of voice communication is carried out between Intelligent hardware and the terminal of second aspect present invention embodiment, including: described system includes Intelligent hardware, service end and multiple terminal, wherein, described Intelligent hardware, for receiving the message channel that user selects, and under described message channel, receive the first speech data of described user input, and when receiving the confirmation instruction that described user sends described first speech data, by described first speech data, the identification information of described Intelligent hardware and the identification information of described message channel send to service end, and receive the second speech data that described service end sends, and at the message channel described second speech data of broadcasting of described Intelligent hardware；Described service end, the account information of multiple application programs corresponding to the described message channel of described Intelligent hardware is determined for the identification information of the identification information according to described Intelligent hardware Yu described message channel, and the account information based on corresponding application program sends described first speech data to the terminal at corresponding application program place, and receive the second speech data that described terminal sends, the account information of corresponding application program and the identification information of described message channel, and the identification information of the message channel of described Intelligent hardware is determined according to the corresponding account information of application program and the identification information of described Intelligent hardware, and the identification information of the message channel of described second speech data and described Intelligent hardware is sent to described Intelligent hardware；Described terminal, for receiving described first speech data that described service end sends, and receive the second speech data of user's input and the described Intelligent hardware of user's selection, and send the account information of the application program of described second speech data, correspondence and the identification information of described Intelligent hardware to described service end.

The system of voice communication is carried out between Intelligent hardware and terminal according to embodiments of the present invention, the first speech data is inputted at corresponding message channel at Intelligent hardware, and when the first speech data is sent to service end, service end obtains the account information of multiple application programs corresponding to this message channel, and based on the account information of corresponding application program, first speech data is sent the terminal to corresponding application program place, and the second speech data of user's typing is sent to corresponding Intelligent hardware by terminal.Hereby it is achieved that the voice communication that Intelligent hardware is simultaneously and between multiple terminal, meet Intelligent hardware and multiple terminals in the scene that social attribute is stronger and carry out the user's request of voice communication, improve user's user experience to Intelligent hardware.

According to one embodiment of present invention, described service end includes first server and second server, wherein, described first server, for receiving described first speech data that described Intelligent hardware sends, the identification information of described Intelligent hardware and the identification information of described message channel, and by described first speech data, the identification information of described Intelligent hardware and the identification information of described message channel are forwarded to described second server, and receive the account information of multiple application programs that described second server returns, and send described first speech data to the terminal at corresponding application program place respectively；

Described second server, corresponding relation for the identification information according to the identification information of Intelligent hardware pre-saved, the account information of application program and message channel, determine and the account information of the multiple application programs corresponding to the described message channel of described Intelligent hardware, and the account information of determined multiple application programs is sent to described first server.

According to one embodiment of present invention, described service end, specifically for:

Corresponding relation based on the identification information of the identification information of the Intelligent hardware pre-saved, the account information of application program and message channel, it is determined that with the account information of the multiple application programs corresponding to the identification information of the identification information of described Intelligent hardware and described message channel.

According to one embodiment of present invention, described service end, it is additionally operable to:

Receive and preserve the corresponding relation of the identification information of the account information of application program, the identification information of Intelligent hardware and message channel that terminal sends.

Judge whether the application program of correspondence connects described service end；

If it is, send described first speech data to the terminal at corresponding application program place；

If it is not, then the first speech data described in buffer memory, and when monitoring corresponding application program and being connected with service end foundation, described voice service is sent the terminal to corresponding application program place.

Aspect and advantage that the present invention adds will part provide in the following description, and part will become apparent from the description below, or is recognized by the practice of the present invention.

Accompanying drawing explanation

The present invention above-mentioned and/or that add aspect and advantage will be apparent from easy to understand from the following description of the accompanying drawings of embodiments, wherein,

Fig. 1 is the flow chart of the method carrying out voice communication according to an embodiment of the invention between Intelligent hardware and terminal；

Fig. 2 is the exemplary plot of the button of Intelligent hardware and display screen；

Fig. 3 is the flow chart of the method carrying out voice communication in accordance with another embodiment of the present invention between Intelligent hardware and terminal；

Fig. 4 is the flow chart of Intelligent hardware networking；

Fig. 5 is the flow chart of terminal binding Intelligent hardware；

Fig. 6 is the flow chart that terminal arranges the message channel of Intelligent hardware；And

Fig. 7 is that user 1 carries out the interaction diagrams of voice communication by the mobile terminal of Intelligent hardware Yu user 2；

Fig. 8 is that user 1 carries out the mutual schematic diagram of voice communication by the Intelligent hardware 2 of Intelligent hardware 1 with user 2；

Fig. 9 is the structural representation of the system carrying out voice communication according to an embodiment of the invention between Intelligent hardware and terminal；

Figure 10 is the structural representation of the system carrying out voice communication in accordance with another embodiment of the present invention between Intelligent hardware and terminal.

Detailed description of the invention

Being described below in detail embodiments of the invention, the example of described embodiment is shown in the drawings, and wherein same or similar label represents same or similar element or has the element of same or like function from start to finish.The embodiment described below with reference to accompanying drawing is illustrative of, it is intended to is used for explaining the present invention, and is not considered as limiting the invention.

Below with reference to the accompanying drawings the method and system carrying out voice communication between the Intelligent hardware of the embodiment of the present invention and terminal are described.

Fig. 1 is the flow chart of the method carrying out voice communication according to an embodiment of the invention between Intelligent hardware and terminal.

As it is shown in figure 1, the method carrying out voice communication between this Intelligent hardware and terminal may include that

S11, Intelligent hardware receives the message channel that user selects, and receives the first speech data of user's input under message channel.

In one embodiment of the invention, Intelligent hardware can have the equipment of various model intelligent chip for such as intelligent toy, wearable device, intelligent home device, intelligent appliance etc..Such as, the intelligent chip in Intelligent hardware is the CC3200 chip of Texas Instrument TI.

Wherein it is desired to be understood by, above-mentioned CC3200 chip is merely for example purpose, and embodiments of the invention are not limited to this.

Such as, the button of Intelligent hardware and the exemplary plot of display screen, as shown in Figure 2, in the process using Intelligent hardware, user can pass through switching channel button and freely switch message channel, if the user while the record button clicked when showing message channel 1 in the display interface of Intelligent hardware in Intelligent hardware, Intelligent hardware receives the record command of user, and receives the user's the first speech data in 1 time input of message channel.

S12, when Intelligent hardware receives the confirmation instruction that user sends the first speech data, the first speech data, the identification information of Intelligent hardware and the identification information of message channel are sent to service end by Intelligent hardware.

Again for the Intelligent hardware shown in Fig. 2, after user terminates recording, if user clicks the transmission message keys on Intelligent hardware, accordingly, Intelligent hardware can determine that user have input the confirmation instruction sending the first speech data, now, the first speech data, the identification information of Intelligent hardware and the identification information (message channel numbering) of message channel are sent to service end by Intelligent hardware.

S13, service end determines the account information of the multiple application programs corresponding to message channel of Intelligent hardware according to the identification information of Intelligent hardware and the identification information of message channel.

Wherein it is desired to illustrate, application program described in this embodiment is the application program that can control Intelligent hardware, and this application program is arranged in terminal.

Wherein, terminal can be the hardware device that smart mobile phone, panel computer, computer etc. have various operating system.

Wherein it is desired to illustrate, the account information of the application program in this embodiment refers to the user using this application program, when using this application program, the account information registered, this account information refers to the identification information that can uniquely identify each user, for example, it may be user name.

Specifically, service end is after receiving the first speech data, the identification information of Intelligent hardware and the identification information of message channel that Intelligent hardware sends, service end is based on the corresponding relation of the identification information of the identification information of the Intelligent hardware pre-saved, the account information of application program and message channel, it is determined that with the account information of the multiple application programs corresponding to the identification information of the identification information of Intelligent hardware and message channel.

Wherein it is desired to illustrate, above-mentioned corresponding relation is to be pre-configured with by the message channel of terminal combined with intelligent hardware, and the process of the follow-up message channel that terminal configures Intelligent hardware describes in detail.

It should be understood that the corresponding relation of each Intelligent hardware can be preserved to different corresponding tables by service end for different Intelligent hardware.

Such as, service end can preserve the corresponding relation of the identification information of the message channel of Intelligent hardware 1 and the account information of application program in mapping table 1, mapping table 2 preserves the identification information of the message channel of Intelligent hardware 2 and the corresponding relation of the account information of application program, wherein, the identification information of a message channel in corresponding relation can be corresponding with the account information of multiple application programs, meanwhile, the account information of an application program also can be corresponding with the identification information of multiple message channels of an Intelligent hardware.

S14, service end sends the first speech data based on the account information of corresponding application program to the terminal at corresponding application program place.

Such as, service end is after receiving the first speech data of Intelligent hardware transmission, message channel 1, corresponding relation based on the identification information of the identification information of the Intelligent hardware pre-saved, the account information of application program and message channel, the account information determining the application program of message channel 1 correspondence is account 1, account 2 and account 3, then, the first speech data is sent the terminal to the terminal at account 1 place, the terminal at account 2 place and account 3 place by service end respectively.

Wherein, it it is the first speech data of which Intelligent hardware transmission in order to facilitate user to know, title and first speech data of Intelligent hardware are sent to terminal by service end, the user interface of level of application corresponding in terminal shows the title of the first speech data that service end sends and Intelligent hardware, and terminal can play this first speech data according to the play instruction of user.

S15, the first speech data that terminal reception service end sends, and receive the second speech data of user's input and the Intelligent hardware of user's selection, and the account information of the application program of second speech data, correspondence and the identification information of Intelligent hardware is sent to service end.

Specifically, after corresponding terminal receives the first speech data that service end sends, if the terminal of correspondence receives user's typing second speech data under the message channel corresponding with Intelligent hardware, and when receiving the confirmation instruction that user sends second speech data, the identification information of second speech data, account information and message channel is sent to service end by terminal.

S16, service end determines the identification information of the message channel of Intelligent hardware according to the corresponding account information of application program and the identification information of Intelligent hardware, and sends the identification information of the message channel of second speech data and Intelligent hardware to Intelligent hardware.

nullIllustrate with above-mentioned example again，Terminal (user 1) at account 1 place、After the terminal (user 2) at account 2 place and the terminal (user 3) at account 3 place receive the speech data that Intelligent hardware sends，The user using counterpart terminal can respond the speech data that Intelligent hardware sends according to demand，Assume user 1 one section of speech data (i.e. second speech data) of typing upon receipt，And receive the Intelligent hardware that user selects，When receiving the transmission control that user 1 clicks in Application Program Interface，The terminal at account 1 place is by second speech data、The identification information of account information and Intelligent hardware sends to service end，Service end determines the identification information of the message channel of this Intelligent hardware according to the identification information of account information and Intelligent hardware，And the identification information of the message channel based on this Intelligent hardware，Second speech data is sent to this Intelligent hardware，Intelligent hardware plays second speech data in corresponding message channel，The user using corresponding Intelligent hardware can get the second speech data that user 1 sends.Hereby it is achieved that the voice communication that Intelligent hardware is simultaneously and between multiple terminal, meet Intelligent hardware and multiple terminals in the scene that social attribute is stronger and carry out the user's request of voice communication, improve user's user experience to Intelligent hardware.

S17, Intelligent hardware receives the second speech data that service end sends, and at the message channel broadcasting second speech data of Intelligent hardware.

It is to be appreciated that in one embodiment of the invention, a terminal also is able to realize voice communication between multiple Intelligent hardware.

Based on the basis of above-described embodiment, so that the user of corresponding application program place terminal can quickly receive Intelligent hardware sends first speech data of coming.Service end judges corresponding application program whether Connection Service end；If it is, service end directly sends the first speech data to the terminal at corresponding application program place；

If it is not, then service end buffer memory the first speech data, and when monitoring corresponding application program and being connected with service end foundation, voice service is sent the terminal to corresponding application program place.

Fig. 3 is the flow chart of the method carrying out voice communication in accordance with another embodiment of the present invention between Intelligent hardware and terminal, service end in this embodiment includes two servers, first server and second server, below with first server for message server, second server is address book server is that the example process to carrying out voice communication between Intelligent hardware and terminal is introduced, as it is shown on figure 3, the method carrying out voice communication between this Intelligent hardware and terminal includes:

S31, Intelligent hardware receives the message channel that user selects, and receives the first speech data of user's input under message channel.

Such as, the exemplary plot of Intelligent hardware, as shown in Figure 2, in the process using Intelligent hardware, user can pass through switching channel button and freely switch message channel, if the user while the record button clicked when showing message channel 1 in the display interface of Intelligent hardware in Intelligent hardware, Intelligent hardware receives the record command of user, and receives the user's the first speech data in 1 time input of message channel.

S32, when Intelligent hardware receives the confirmation instruction that user sends the first speech data, the first speech data, the identification information of Intelligent hardware and the identification information of message channel are sent to message server by Intelligent hardware.

Again for the Intelligent hardware shown in Fig. 2, after user terminates recording, if user clicks the transmission message keys on Intelligent hardware, accordingly, Intelligent hardware can determine that user have input the confirmation instruction sending the first speech data, now, the first speech data, the identification information of Intelligent hardware and the identification information (message channel numbering) of message channel are sent to message server by Intelligent hardware.

S33, the identification information of the first speech data, the identification information of Intelligent hardware and message channel that message server reception Intelligent hardware sends, and the identification information of Intelligent hardware and the identification information of message channel are forwarded to address book server.

S34, the address book server corresponding relation according to the identification information of the identification information of the Intelligent hardware pre-saved, the account information of application program and message channel, determine and the account information of the multiple application programs corresponding to the message channel of Intelligent hardware, and the account information of determined multiple application programs is sent to message server.

Wherein it is desired to illustrate, application program described in this embodiment is the application program being arranged in terminal.

Specifically, address book server is after receiving the first speech data, the identification information of Intelligent hardware and the identification information of message channel that Intelligent hardware sends, address book server is based on the corresponding relation of the identification information of the identification information of the Intelligent hardware pre-saved, the account information of application program and message channel, it is determined that with the account information of the multiple application programs corresponding to the identification information of the identification information of Intelligent hardware and message channel.

S35, the account information of multiple application programs that message server returns based on address book server, send the first speech data to the terminal at corresponding application program place respectively.

Such as, service end is after receiving the first speech data of Intelligent hardware transmission, message channel 1, corresponding relation based on the identification information of the identification information of the Intelligent hardware pre-saved, the account information of application program and message channel, the account information determining the application program of message channel 1 correspondence is account 1, account 2 and account 3, then, the first speech data is respectively sent to the terminal at the terminal at account 1 place, the terminal at account 2 place and account 3 place by service end.

S36, terminal receives the first speech data that Intelligent hardware sends, and receive the second speech data of user's input and the Intelligent hardware of user's selection, and send the account information of the application program of second speech data, correspondence and the identification information of Intelligent hardware to message server.

S37, message server receives the account information of the application program of the second speech data of terminal transmission, correspondence and the identification information of Intelligent hardware, and the corresponding account information of application program and the identification information of Intelligent hardware are forwarded to address book server.

S38, the address book server corresponding relation according to the identification information of the identification information of the Intelligent hardware pre-saved, the account information of application program and message channel, determine the identification information of message channel with Intelligent hardware, and the identification information of the message channel of determined Intelligent hardware is sent to message server.

S39, the identification information of the message channel of the Intelligent hardware that message server returns based on address book server, the identification information of the message channel of second speech data and Intelligent hardware is sent to Intelligent hardware.

S40, Intelligent hardware receives the second speech data that service end sends, and at the message channel broadcasting second speech data of Intelligent hardware.

To sum up, can be seen that, this embodiment achieves Intelligent hardware voice communication simultaneously and between multiple terminal, meet Intelligent hardware and multiple terminals in the scene that social attribute is stronger and carry out the user's request of voice communication, improve user's user experience to Intelligent hardware.

This embodiment by messaging with preservation correspondence setting on a different server, can reduce pressure above-mentioned two process processed by a server, decrease the operating pressure of server, it is ensured that the stability of service operation.

Under normal circumstances, for a new Intelligent hardware, so that new Intelligent hardware can get involved network, terminal needs to configure network configuration information for this new Intelligent hardware, so that Intelligent hardware is according to the network insertion network configured.

It is described in detail below in conjunction with Fig. 4 process that Intelligent hardware is networked, it should be noted that service end includes two servers, first server and second server in this embodiment, below with first server for message server, second server is address book server is example.

S401, the application A PP of mobile terminal connects Intelligent hardware.

That is, between mobile terminal with Intelligent hardware, foundation is connected.

Such as, the APP of mobile terminal can find Intelligent hardware by SmartConfig, and inputs service set SSID and the password thereof of wireless router in the configuration interface of APP.

S402, network configuration information is sent to Intelligent hardware according to the operation of user by the APP of mobile terminal.

Specifically, after user inputs service set SSID and the password thereof of wireless router in the configuration interface of APP, mobile terminal is after the confirmation instruction receiving the network configuration information that user sends, and network configuration information is sent to Intelligent hardware by mobile terminal.

S403, Intelligent hardware receives the network configuration information that mobile terminal sends, and connects network by network configuration information.

S404, the identification information of self and the account information of application program are sent to address book server by Intelligent hardware.

S405, address book server preserves the account information of application program and the configuration information of Intelligent hardware according to the information received.

Thus, complete Intelligent hardware networking, and complete at address book server preservation configuration information.

In configured the process of message channel of Intelligent hardware by terminal, the message channel of Intelligent hardware all can be configured by not all terminal, and the terminal only setting up binding relationship with Intelligent hardware can be arranged.Wherein it is desired to be understood by, terminal is provided with the application program controlling Intelligent hardware.

It is described below in conjunction with in the Fig. 5 process to terminal binding Intelligent hardware, it should be noted that service end includes two servers, first server and second server in this embodiment, below with first server for message server, second server is address book server is example.

S501, terminal searching Intelligent hardware, and receive the binding instruction of the binding Intelligent hardware of user's input.

Specifically, after terminal searching to Intelligent hardware, Intelligent hardware sends the identification information of terminal hardware to terminal.

S502, whether terminal judges and Intelligent hardware are bound, if it is, perform step S503, if it is not, then perform step S504.

S503, shows the information bound in the user interface of terminal.

S504, terminal sends bind request to address book server.

Wherein, bind request includes the account information of application program in terminal and the identification information of Intelligent hardware.

S505, address book server receives the bind request that terminal sends, and preserves the binding corresponding relation of the account information of application program and the identification information of Intelligent hardware.

S506, address book server returns the confirmation instruction of binding success to terminal.

Thus, complete the binding of terminal and Intelligent hardware, facilitate user subsequently through with terminal control Intelligent hardware, or carry out voice communication with Intelligent hardware, improve user experience.

For binding the terminal of Intelligent hardware, the process of the message channel that terminal arranges Intelligent hardware below in conjunction with Fig. 6 is described, it should be noted that, in this embodiment, service end includes two servers, first server and second server, below with first server for message server, second server is address book server is example.

S601, terminal searching Intelligent hardware, and be connected with Intelligent hardware foundation.

S602, Intelligent hardware sends the identification information of Intelligent hardware to terminal.

S603, terminal receives the configuration-direct of the configuration Intelligent hardware of user's input, and sends configuring request to communication server.

Wherein, configuring request comprises the account information of application program in terminal and the identification information of Intelligent hardware.

S604, server is based on configuring request, it is judged that there is configuration relation between account information and the identification information of Intelligent hardware of application program, and returns the message channel list of Intelligent hardware to terminal.

Wherein it is desired to be understood by, if server judges to be absent between the account information of application program and the identification information of Intelligent hardware configuration relation, then server returns failed information.

S605, shows Intelligent hardware SMS channel list in terminal.

Specifically, the configuration interface of terminal is shown the message channel list of Intelligent hardware.

S606, the account of an available application program is configured in message channel by terminal.

Specifically, after showing message channel list in configuration interface, for each message channel in message channel list, user can configure for it according to demand.

S607, configuration information is sent to address book server by terminal.

Wherein, configuration information comprises the corresponding relation of the identification information of the account information of application program, the identification information of Intelligent hardware and message channel.

S608, address book server preserves the configuration information that terminal sends.

After address book server receives configuration information, if saving the relation table of the corresponding relation of the identification information of the account information, the identification information of Intelligent hardware and the message channel that comprise application program in address book server, then the corresponding relation in this relation table is updated by address book server according to the configuration information being newly received.

Additionally, it will be appreciated that, if the relation table of the corresponding relation of the identification information of the identification information of the account information being absent from communication server comprising application program, Intelligent hardware and message channel, then one relation table of server Intelligent Establishment, and the configuration information received is preserved to this relation table.

In order to facilitate user to be confirmed whether configuration successful, address book server is after preserving configuration information, it is also possible to return the information of configuration successful to the terminal at application program place, to point out user successfully to configure the message channel of Intelligent hardware.

In one embodiment of the invention, after Intelligent hardware accesses network, if after Intelligent hardware receives the inquiry request of the account information checking message channel that user sends, service end-apparatus obtains the account information of the multiple reference programs corresponding with this message channel according to the identification information of the message channel checked in request, and returns the account information of corresponding multiple application programs to Intelligent hardware.

Owing to the display screen of Intelligent hardware is less, Directory service end can return Query Result to Intelligent hardware in the form of speech.

Such as, according to the inquiry request of Intelligent hardware, service end determines that the account information of the corresponding application program of message channel 2 is user 2 and user 3, Query Result is converted to the speech data of correspondence by service end, and speech data is back to Intelligent hardware, and play the voice of " user 2 of message channel 2 correspondence and user 3 ".

Be described below in conjunction with Fig. 7 process that user 1 is carried out voice communication by Intelligent hardware and user 2, wherein, the mobile terminal that user 2 uses such as smart mobile phone be provided with application program, this application program can and Intelligent hardware between carry out voice communication.Wherein it is desired to illustrate, in this embodiment, service end includes two servers, first server and second server, and below with first server for message server, second server is address book server is example.

S701, Intelligent hardware receives the message channel that user 1 chooses, and receives the first speech data of user's input under the message channel that user 1 chooses.

S702, Intelligent hardware receives user 1 and sends the determination instruction of the first speech data, and based on confirming that instruction sends to message server to the first speech data, the identification information of Intelligent hardware and the identification information of message channel.

S703, the identification information of the Intelligent hardware received and the identification information of message channel are sent to address book server by message server.

S704, address book server is based on the corresponding relation of the account information of the identification information of the Intelligent hardware pre-saved, the identification information of message channel and application program, it is determined that the account information of the application program corresponding with the identification information of message channel.

S705, address book server returns the account information of corresponding application program to message server.

S706, the account information of the application program that message server returns according to address book server, send PUSH message to the mobile terminal at user 2 place.

S707, the mobile terminal of user 2 downloads the first speech data described in user 1 based on PUSH message from message server, and first speech data of speech play user 1 after the download is complete.

It is to be appreciated that after the mobile terminal of user 2 obtains the first speech data that user 1 is sent by Intelligent hardware, user 2 can input corresponding second speech data under the message channel corresponding with Intelligent hardware, to respond the first speech data.Terminal is after receiving user 2 and clicking the determination instruction sending second speech data, terminal can be passed through the identification information of the account information of application program that second speech data, user use by network and Intelligent hardware and send to service end, and the message server in service end and address book server can determine the identification information of message channel with this Intelligent hardware according to the identification information of account information and Intelligent hardware.Then message server sends the identification information of the message channel of second speech data and this Intelligent hardware to this Intelligent hardware, the Intelligent hardware of user 1 receives the second speech data that message server sends, and plays second speech data in the message channel of the Intelligent hardware of user 1.Thus, user 1 is completed by the voice communication between Intelligent hardware and the mobile terminal of user 2.

In some cases, it sometimes appear that user 1 uses Intelligent hardware to carry out the sight of voice communication with the user 2 using terminal such as personal computer, Intelligent hardware is used to be described with the process using terminal to carry out voice communication user 1 below in conjunction with Fig. 8.Wherein it is desired to illustrate, in this embodiment, service end includes two servers, first server and second server, and below with first server for message server, second server is address book server is that example is described.

S801, user 1 selects the message channel corresponding with user 2 by Intelligent hardware, and inputs the first speech data under this message communicating.

S802, Intelligent hardware receives the confirmation instruction of the first speech data that user 1 sends, and sends the identification information of Intelligent hardware, the identification information of message channel and the first speech data to message server based on this confirmation instruction.

S803, the identification information of the identification information of Intelligent hardware, message channel is sent to address list server by message server.

S804, address book server obtains the identification information of message channel in the terminal of user 2 according to the identification information of the identification information of Intelligent hardware, message channel, and sends the identification information of message channel in terminal to message server.

Wherein it is desired to illustrate, Directory service has pre-saved the identification information of the message channel of the identification information of terminal, terminal, the identification information of Intelligent hardware, Intelligent hardware message channel identification information between corresponding relation.

S805, message server sends sending out notice to terminal.

S806, terminal receives sending out notice, and audibly points out user 2, so that user 2 is operated by terminal and obtains the first speech data that user 1 sends from message server, and plays the first speech data that user 1 sends.

It is to be appreciated that after the terminal of user 2 obtains the first speech data that user 1 is sent by Intelligent hardware, user 2 can input corresponding second speech data under the message channel corresponding with Intelligent hardware, to respond the first speech data.Terminal is after receiving user 2 and clicking the determination instruction sending second speech data, terminal can be passed through the identification information of the account information of application program that second speech data, user use by network and Intelligent hardware and send to service end, and the message server in service end and address book server can determine the identification information of message channel with this Intelligent hardware according to the identification information of account information and Intelligent hardware.Then message server sends the identification information of the message channel of second speech data and this Intelligent hardware to this Intelligent hardware, the Intelligent hardware of user 1 receives the second speech data that message server sends, and plays second speech data in the message channel of the Intelligent hardware of user 1.Thus, user 1 is completed by the voice communication between Intelligent hardware and the mobile terminal of user 2.

In order to realize above-described embodiment, the invention allows for the system carrying out voice communication between a kind of Intelligent hardware and terminal.

Fig. 9 is the structural representation of the system carrying out voice communication according to an embodiment of the invention between Intelligent hardware and terminal.

As it is shown in figure 9, the system carrying out voice communication between this Intelligent hardware and terminal can include Intelligent hardware 10, service end 20 and multiple terminal 30, wherein,

Intelligent hardware 10 is for receiving the message channel that user selects, and under message channel, receive the first speech data of user's input, and when receiving the confirmation instruction that user sends the first speech data, first speech data, the identification information of Intelligent hardware 10 and the identification information of message channel are sent to service end 20, and receive the second speech data that service end 20 sends, and at the message channel broadcasting second speech data of Intelligent hardware 10.

In one embodiment of the invention, Intelligent hardware 10 can have the equipment of various model intelligent chip for such as intelligent toy, wearable device, intelligent home device, intelligent appliance etc..Such as, the CC3200 chip that intelligent chip is Texas Instrument TI in Intelligent hardware 10.

Service end 20 is used for determining the account information of the multiple application programs corresponding to the message channel of Intelligent hardware 10 according to the identification information of Intelligent hardware 10 and the identification information of message channel, and the account information based on corresponding application program sends the first speech data to the terminal 30 at corresponding application program place, and receive the second speech data that terminal 30 sends, the account information of corresponding application program and the identification information of message channel, and the identification information of the message channel of Intelligent hardware 10 is determined according to the corresponding account information of application program and the identification information of Intelligent hardware 10, and the identification information of the message channel of second speech data and Intelligent hardware 10 is sent to Intelligent hardware 10.

Wherein it is desired to illustrate, application program described in this embodiment is the application program that can control Intelligent hardware 10, and this application program is arranged in terminal 30.

Wherein, terminal 30 can be the hardware device that smart mobile phone, panel computer, computer etc. have various operating system.

In one embodiment of the invention, service end 20 is after receiving the first speech data, the identification information of Intelligent hardware 10 and the identification information of message channel that Intelligent hardware 10 sends, service end 20 is based on the corresponding relation of the identification information of the identification information of Intelligent hardware 10 pre-saved, the account information of application program and message channel, it is determined that with the account information of the multiple application programs corresponding to the identification information of the identification information of Intelligent hardware 10 and message channel.

Terminal 30 is for receiving the first speech data that service end 20 sends, and receive the second speech data of user's input and the Intelligent hardware 10 of user's selection, and send the account information of the application program of second speech data, correspondence and the identification information of Intelligent hardware 10 to service end 20.

In one embodiment of the invention, service end 20 is additionally operable to: receive and preserve the corresponding relation of the identification information of the account information of application program, the identification information of Intelligent hardware 10 and message channel that terminal 30 sends.

Carry out the system of voice communication it should be noted that the explanation of the aforementioned embodiment of the method to carrying out voice communication between Intelligent hardware and terminal is also applied between the Intelligent hardware of this embodiment and terminal, repeat no more herein.

The system of voice communication is carried out between Intelligent hardware and terminal according to embodiments of the present invention, the first speech data is inputted at corresponding message channel at Intelligent hardware, and when the first speech data is sent to service end, service end obtains the account information of multiple application programs corresponding to this message channel, and based on the account information of corresponding application program, the first speech data is sent the terminal to corresponding application program place.Hereby it is achieved that the voice communication that Intelligent hardware is simultaneously and between multiple terminal, meet Intelligent hardware and multiple terminals in the scene that social attribute is stronger and carry out the user's request of voice communication, improve user's user experience to Intelligent hardware.

Based on the basis of above-described embodiment, so that the user of corresponding application program place terminal can quickly receive Intelligent hardware 10 sends first speech data of coming.Service end 20 judges corresponding application program whether Connection Service end 20；If it is, service end 20 directly sends the first speech data to the terminal 30 at corresponding application program place；

If it is not, then service end 20 buffer memory the first speech data, and when monitoring corresponding application program and being connected with service end 20 foundation, voice service is sent the terminal 30 to corresponding application program place.

Figure 10 is the structural representation of the system carrying out voice communication in accordance with another embodiment of the present invention between Intelligent hardware and terminal, the system carrying out voice communication between this Intelligent hardware and terminal can include Intelligent hardware 10, service end 20 and multiple terminal 30, wherein, service end 20 includes two servers, first server 210 and second server 220, wherein

The identification information of the first speech data, the identification information of Intelligent hardware 10 and message channel that first server 210 sends for receiving Intelligent hardware 10, and the first speech data, the identification information of Intelligent hardware 10 and the identification information of message channel are forwarded to second server, and the account information of multiple application programs of reception second server return, and send the first speech data to the terminal 30 at corresponding application program place respectively.

The corresponding relation of the identification information of the identification information of Intelligent hardware 10, the account information of application program and message channel that second server 220 pre-saves for basis, determine and the account information of the multiple application programs corresponding to the message channel of Intelligent hardware 10, and the account information of determined multiple application programs is sent to first server.

In the description of this specification, specific features, structure, material or feature that the description of reference term " embodiment ", " some embodiments ", " example ", " concrete example " or " some examples " etc. means in conjunction with this embodiment or example describe are contained at least one embodiment or the example of the present invention.In this manual, the schematic representation of above-mentioned term is necessarily directed to identical embodiment or example.And, the specific features of description, structure, material or feature can combine in one or more embodiments in office or example in an appropriate manner.Additionally, when not conflicting, the feature of the different embodiments described in this specification or example and different embodiment or example can be carried out combining and combining by those skilled in the art.

Additionally, term " first ", " second " are only for descriptive purposes, and it is not intended that indicate or imply relative importance or the implicit quantity indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can express or implicitly include at least one this feature.In describing the invention, " multiple " are meant that at least two, for instance two, three etc., unless otherwise expressly limited specifically.

Describe in flow chart or in this any process described otherwise above or method and be construed as, represent and include the module of code of executable instruction of one or more step for realizing specific logical function or process, fragment or part, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press order that is shown or that discuss, including according to involved function by basic mode simultaneously or in the opposite order, performing function, this should be understood by embodiments of the invention person of ordinary skill in the field.

Represent in flow charts or in this logic described otherwise above and/or step, such as, it is considered the sequencing list of executable instruction for realizing logic function, may be embodied in any computer-readable medium, use for instruction execution system, device or equipment (such as computer based system, including the system of processor or other can from instruction execution system, device or equipment instruction fetch the system performing instruction), or use in conjunction with these instruction execution systems, device or equipment.For the purpose of this specification, " computer-readable medium " can be any can comprise, store, communicate, propagate or transmission procedure is for instruction execution system, device or equipment or the device that uses in conjunction with these instruction execution systems, device or equipment.The example more specifically (non-exhaustive list) of computer-readable medium includes following: have the electrical connection section (electronic installation) of one or more wiring, portable computer diskette box (magnetic device), random access memory (RAM), read only memory (ROM), erasable edit read only memory (EPROM or flash memory), fiber device, and portable optic disk read only memory (CDROM).Additionally, computer-readable medium can even is that the paper that can print described program thereon or other suitable media, because can such as by paper or other media be carried out optical scanning, then carry out editing, interpreting or be processed to electronically obtain described program with other suitable methods if desired, be then stored in computer storage.

Should be appreciated that each several part of the present invention can realize with hardware, software, firmware or their combination.In the above-described embodiment, multiple steps or method can realize with the storage software or firmware in memory and by suitable instruction execution system execution.Such as, if realized with hardware, the same in another embodiment, can realize by any one in following technology well known in the art or their combination: there is the discrete logic of logic gates for data signal realizes logic function, there is the special IC of suitable combination logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA) etc..

Those skilled in the art are appreciated that realizing all or part of step that above-described embodiment method carries can be by the hardware that program carrys out instruction relevant and complete, described program can be stored in a kind of computer-readable recording medium, this program upon execution, including the step one or a combination set of of embodiment of the method.

Additionally, each functional unit in each embodiment of the present invention can be integrated in a processing module, it is also possible to be that unit is individually physically present, it is also possible to two or more unit are integrated in a module.Above-mentioned integrated module both can adopt the form of hardware to realize, it would however also be possible to employ the form of software function module realizes.If described integrated module is using the form realization of software function module and as independent production marketing or use, it is also possible to be stored in a computer read/write memory medium.

Storage medium mentioned above can be read only memory, disk or CD etc..Although above it has been shown and described that embodiments of the invention, it is understandable that, above-described embodiment is illustrative of, it is impossible to be interpreted as limitation of the present invention, and above-described embodiment can be changed, revises, replace and modification by those of ordinary skill in the art within the scope of the invention.

Claims

1. the method carrying out voice communication between Intelligent hardware and terminal, it is characterised in that comprise the following steps:

Intelligent hardware receives the message channel that user selects, and receives the first speech data of described user input under described message channel；

When described Intelligent hardware receives the confirmation instruction that described user sends described first speech data, described first speech data, the identification information of described Intelligent hardware and the identification information of described message channel are sent to service end by described Intelligent hardware；

Described service end determines the account information of the multiple application programs corresponding to described message channel of described Intelligent hardware according to the identification information of described Intelligent hardware and the identification information of described message channel；

Described service end sends described first speech data based on the account information of corresponding application program to the terminal at corresponding application program place；

Described terminal receives described first speech data that described service end sends, and receive the second speech data of user's input and the described Intelligent hardware of user's selection, and send the account information of the application program of described second speech data, correspondence and the identification information of described Intelligent hardware to described service end；

Described service end determines the identification information of the message channel of described Intelligent hardware according to the corresponding account information of application program and the identification information of described Intelligent hardware, and sends the identification information of the message channel of described second speech data and described Intelligent hardware to described Intelligent hardware；

Described Intelligent hardware receives the described second speech data that described service end sends, and at the message channel described second speech data of broadcasting of described Intelligent hardware.

2. the method carrying out voice communication between Intelligent hardware and terminal as claimed in claim 1, it is characterised in that described service end includes first server and second server, wherein,

3. the method carrying out voice communication between Intelligent hardware and terminal as claimed in claim 1, it is characterized in that, described service end determines the account information of the multiple application programs corresponding to described message channel of described Intelligent hardware according to the identification information of described Intelligent hardware and the identification information of described message channel, including:

4. the method carrying out voice communication between Intelligent hardware and the terminal as described in any one of claim 1-3, it is characterised in that before described Intelligent hardware receives the message channel that user selects, described method also includes:

5. the method carrying out voice communication between Intelligent hardware and terminal as claimed in claim 4, it is characterized in that, before described service end sends described first speech data based on the account information of corresponding application program to the terminal at corresponding application program place, described method also includes:

6. the system carrying out voice communication between Intelligent hardware and terminal, it is characterised in that described system includes Intelligent hardware, service end and multiple terminal, wherein,

Described Intelligent hardware, for receiving the message channel that user selects, and under described message channel, receive the first speech data of described user input, and when receiving the confirmation instruction that described user sends described first speech data, described first speech data, the identification information of described Intelligent hardware and the identification information of described message channel are sent to service end, and receive the second speech data that described service end sends, and at the message channel described second speech data of broadcasting of described Intelligent hardware；

Described service end, the account information of multiple application programs corresponding to the described message channel of described Intelligent hardware is determined for the identification information of the identification information according to described Intelligent hardware Yu described message channel, and the account information based on corresponding application program sends described first speech data to the terminal at corresponding application program place, and receive the second speech data that described terminal sends, the account information of corresponding application program and the identification information of described message channel, and the identification information of the message channel of described Intelligent hardware is determined according to the corresponding account information of application program and the identification information of described Intelligent hardware, and the identification information of the message channel of described second speech data and described Intelligent hardware is sent to described Intelligent hardware；

Described terminal, for receiving described first speech data that described service end sends, and receive the second speech data of user's input and the described Intelligent hardware of user's selection, and send the account information of the application program of described second speech data, correspondence and the identification information of described Intelligent hardware to described service end.

7. carry out the system of voice communication as claimed in claim 6 between Intelligent hardware and terminal, it is characterised in that described service end includes first server and second server, wherein,

Described first server, for receiving the identification information of described first speech data, the identification information of described Intelligent hardware and described message channel that described Intelligent hardware sends, and described first speech data, the identification information of described Intelligent hardware and the identification information of described message channel are forwarded to described second server, and receive the account information of multiple application programs that described second server returns, and send described first speech data to the terminal at corresponding application program place respectively；

8. carry out the system of voice communication as claimed in claim 6 between Intelligent hardware and terminal, it is characterised in that described service end, specifically for:

9. carry out the system of voice communication between Intelligent hardware and the terminal as described in any one of claim 6-8, it is characterised in that described service end, be additionally operable to:

10. carry out the system of voice communication as claimed in claim 9 between Intelligent hardware and terminal, it is characterised in that described service end, be additionally operable to: