The application is the applying date is on May 24th, 2012, and application number is: 201210166588.9, and denomination of invention is: based on the divisional application of the phonetic controller of mobile terminal and sound control method thereof。
Summary of the invention
The problem that this invention address that is to provide a kind of phonetic controller based on mobile terminal and sound control method thereof, can start according to arbitrarily a word that user says and apply accordingly and obtain result, without fixing voice command words must be used, thus simplifying the control to mobile terminal, easy to use, improve the experience effect of user。
For solving the problems referred to above, the invention provides a kind of speech control system based on mobile terminal, including: mobile terminal, information processor and server, wherein: mobile terminal, it is used for obtaining voice messaging, and the voice messaging of acquisition is sent to information processor, receive the service request information that information processor sends, and judge whether to scan in this locality, if it is, the service feedback information that search is corresponding with described service request information;Otherwise, described service request information is sent to server, receives the service feedback information that server sends;After obtaining described service feedback information, perform the application operating corresponding with described service feedback information;Information processor, connect described mobile terminal, for described voice messaging being sequentially carried out identifying processing, text conversion process and semantic dissection process, obtaining the service request information corresponding with described voice messaging, and described service request information is sent to mobile terminal;Server, connects described mobile terminal, for according to described service request information, searching for the service feedback information corresponding with described service request information, and described service feedback information is sent to mobile terminal。
Alternatively, described mobile terminal includes: voice input module, is used for obtaining voice messaging;First communication module, connects described information processor, for the voice messaging of acquisition is sent to information processor, and receives the service request information that information processor sends;Judge module, connects described first communication module, according to described service request information, it may be judged whether scan in this locality, when being, described service request information is sent to search module;Otherwise, described service request information is sent to second communication module;Locally stored module, is used for storing service feedback information;Search module, connects described judge module and described locally stored module, for searching for the service feedback information corresponding with described service request information from locally stored module;Second communication module, connects described judge module and described server, for described service request information is sent to server, and receives the service feedback information that server sends;Perform module, connect described search module and described second communication module, for performing the application operating corresponding with described service feedback information。
Alternatively, described mobile terminal also includes: local answer module, connects described first communication module, and when voice messaging described in described information processor None-identified, the described local module that replies carries out local answer。
Alternatively, described execution module includes: multiple application memory unit, for storing different classes of application operating;Priority allocation unit, connects described application memory unit, for distributing priority for each described application memory unit;Call control unit, connect described application memory unit, described priority allocation unit, described search module and described second communication module, for the application operating that the service feedback information obtaining the application operating being currently executing and receive is corresponding, call the application operating that the service feedback information received is corresponding, and judge that the priority of application operating corresponding to the service feedback information that receives is whether more than the priority of the application operating being currently executing according to precedence information, if it is, close the application operating being currently executing;Otherwise, the application operating being currently executing is maintained。
Alternatively, described mobile terminal also includes: prompting module, connects described execution module, for described application operating carries out voice reminder or display alarm。
Alternatively, described mobile terminal also includes: alert requests module, connect described second communication module and prompting module, for obtaining the alert requests information corresponding with described service request information, described alert requests information is sent to server by second communication module and receives, by second communication module, the prompting feedback information that server sends, and described prompting feedback information is sent to prompting module;Described server is according to described alert requests information, it is thus achieved that the prompting feedback information corresponding with described alert requests information;Described prompting feedback information is carried out voice reminder or display alarm by described prompting module。
Alternatively, described information processor includes: third communication module, connects described mobile terminal, is used for receiving described voice messaging, and service request information is sent to mobile terminal;Sound identification module, connects described third communication module, for being identified described voice messaging processing, and the voice messaging after being identified;Text conversion module, connects described sound identification module, for the voice messaging after identifying is carried out text conversion process, obtains the text message corresponding with described voice messaging;Semantic meaning analysis module, connect described text conversion module and described third communication module, for described text message being carried out semantic dissection process, obtaining the service request information corresponding with described voice messaging, and described service request information is sent to third communication module。
Alternatively, described sound identification module includes: freely say sound bank, is used for storing and multiple freely says voice;Matching unit, connect described third communication module, described freely say sound bank and described text conversion module, for sound bank finding the voice matched with described voice messaging from freely saying, and the voice found is sent to text conversion module as the voice messaging after identifying。
Alternatively, described freely say that sound bank includes: multiple voice units of freely saying, each described voice messaging freely saying that voice unit is corresponding different classes of;Described sound identification module also includes: priority arranges unit, connect and described freely say voice unit and matching unit, for described freely saying that voice unit arranges priority for each, described matching unit finds the voice matched with described voice messaging according to priority order from high to low from freely saying voice unit。
Alternatively, described sound identification module also includes: chat sound bank, matching connection unit, for storing chat voice, when matching unit cannot freely say sound bank finds the voice matched with described voice messaging time, continue sound bank to be found the voice matched with described voice messaging chatting。
Alternatively, described semantic meaning analysis module includes: sentence pattern dissects unit, connects described text conversion module, for the information after text conversion process is carried out sentence pattern analysis, obtains the sentence pattern information that described information is corresponding;Cutting unit, connects described sentence pattern and dissects unit, for according to described sentence pattern information, the information after text conversion process being divided into multiple semanteme;Indexing unit, connects described cutting unit, and being used for described semantic marker is meaningful semanteme or meaningless semanteme;Removal unit, connects described indexing unit, is used for removing described meaningless semanteme;Service request memory element, is used for storing service request information;Converting unit, connect described removal unit, described service request memory element and described third communication module, for meaningful semanteme is changed, obtain the service request information corresponding with meaningful semanteme, and described service request information is sent to third communication module。
Alternatively, described server includes: fourth communication module, connects described mobile terminal, is used for receiving described service request information, and service feedback information is sent to mobile terminal;Multiple information providing module, for providing the service feedback information of multiple classification;Analysis module, connects described fourth communication module, for judging the classification of described service request information;Retrieval module, connect described analysis module, described information providing module and described fourth communication module, for retrieving the service feedback information corresponding with described service request information in the information providing module corresponding with described classification, and the service feedback information retrieved is sent to fourth communication module。
Alternatively, described mobile terminal is connected by any one communication mode in 2G, 3G or 4G with described information processor。
Alternatively, described mobile terminal is connected by any one communication mode in 2G, 3G or 4G with described server。
Alternatively, described mobile terminal includes: mobile unit, mobile phone or computer。
Alternatively, described service request information includes: navigates, make a phone call, send short messages, check or changes address list, open or close radio, inquiry or book flight, inquiry or predetermined hotel, inquires about or book a train ticket, inquiring about or buy or dump stock, point of interest search, inquiry weather, schedule and prompting, the one listened in music, perimeter query and chat or combination in any。
In order to solve the problems referred to above, present invention also offers a kind of sound control method based on mobile terminal, including: obtain voice messaging;Described voice messaging is sequentially carried out identifying processing, text conversion process and semantic dissection process, obtains the service request information corresponding with described voice messaging;Search for the service feedback information corresponding with described service request information, and perform the application operating corresponding with described service feedback information。
Alternatively, described semantic dissection process includes: the information after text conversion process is carried out sentence pattern analysis, obtains the sentence pattern information that described information is corresponding;According to described sentence pattern information, the information after text conversion process is divided into multiple semanteme;It is meaningful semanteme or meaningless semanteme by described semantic marker, and removes described meaningless semanteme;Meaningful semanteme is changed, obtains the service request information corresponding with meaningful semanteme。
Alternatively, described service request information includes: navigates, make a phone call, send short messages, check or changes address list, open or close radio, inquiry or book flight, inquiry or predetermined hotel, inquires about or book a train ticket, inquiring about or buy or dump stock, point of interest search, inquiry weather, schedule and prompting, the one listened in music, perimeter query and chat or combination in any。
Alternatively, the described sound control method based on mobile terminal also includes: while performing described application operating, described application operating carries out voice reminder or display alarm。
Alternatively, the described sound control method based on mobile terminal also includes: after obtaining the service request information corresponding with described voice messaging, obtain the alert requests information corresponding with described service request information, and the prompting feedback information that search is corresponding with described alert requests information, and described prompting feedback information is carried out voice reminder or display alarm。
Alternatively, the described sound control method based on mobile terminal also includes: when voice messaging described in None-identified, carries out local answer。
Alternatively, perform the application operating corresponding with described service feedback information to include: application operating is classified, and arranges priority for every class application operating;Obtain the application operating that the application operating being currently executing is corresponding with the service feedback information received, call the application operating that the service feedback information received is corresponding, and judge that the priority of application operating corresponding to the service feedback information that receives is whether more than the priority of the application operating being currently executing according to precedence information, if it is, close the application operating being currently executing;Otherwise, the application operating being currently executing is maintained。
Alternatively, described application operating includes: guidance operation, and the priority of described guidance operation is the highest。
Compared with prior art, technical solution of the present invention has the advantage that after obtaining voice messaging, voice messaging can be sequentially carried out identifying processing, text conversion process and semantic dissection process, such that it is able to obtain the service request information corresponding with described voice messaging, and then after searching the service feedback information corresponding with described service request information, just can perform the application operating corresponding with described service feedback information, end user just can start, without using fixing voice command words, the result that the corresponding application operating of mobile terminal is wanted with acquisition, but can arbitrarily say and in short start corresponding application operating and obtain result, while providing the user more safer driving service, improve the experience effect of user。Additionally, the Voice command to mobile terminal can also be realized timely and accurately even for the user being unfamiliar with mobile terminal operation。
Detailed description of the invention
Understandable for enabling the above-mentioned purpose of the present invention, feature and advantage to become apparent from, below in conjunction with accompanying drawing, the specific embodiment of the present invention is described in detail。
Elaborating a lot of detail in the following description so that fully understanding the present invention, but the present invention can also adopt other to be different from alternate manner described here to be implemented, therefore the present invention is not by the restriction of following public specific embodiment。
Just as described in the background section, mostly the control of mobile terminal is manually to complete by prior art, thus the safety that have impact in mobile terminal use procedure, Consumer's Experience weak effect。Although proposing the technology of Voice command mobile terminal in prior art, but user must flow through fixing several voice command words and could realize the simple operations to mobile terminal。As: when car machine user wants to navigate to People's Square, it is necessary to first start man machine language's interactive function, then must first talk about " navigation " to start navigation application, then must say that " People's Square " arranges destination to plan navigation way again。And for example: when cellphone subscriber wants to listen a certain song, it is necessary to first start man machine language's interactive function, then must first talk about " listening music " to start music application, then must put off until some time later concrete song title to play music。Therefore, user can not use application by the mode freely said, voice operating process is very loaded down with trivial details, Consumer's Experience weak effect。Additionally, fixing voice command words for be unfamiliar with the operation of car machine people inconvenience especially。
For drawbacks described above, inventor provide a kind of speech control system based on mobile terminal and sound control method thereof, it is after obtaining voice messaging, voice messaging can be sequentially carried out identifying processing, text conversion process and semantic dissection process, such that it is able to obtain the service request information corresponding with described voice messaging, and then after searching the service feedback information corresponding with described service request information, just can perform the application operating corresponding with described service feedback information, end user just can start, without using fixing voice command words, the result that the corresponding application operating of mobile terminal is wanted with acquisition, but can arbitrarily say and in short start corresponding application operating and obtain result, while providing the user more safer driving service, improve the experience effect of user。Additionally, the Voice command to mobile terminal can also be realized timely and accurately even for the user being unfamiliar with mobile terminal operation。
It is described in detail below in conjunction with accompanying drawing。
With reference to shown in Fig. 1, present embodiments provide for a kind of speech control system based on mobile terminal, including: mobile terminal 100, information processor 200 and server 300, wherein:
Mobile terminal 100, is used for obtaining voice messaging, and the voice messaging of acquisition is sent to information processor 200, receive the service request information that information processor 200 sends, and judge whether to scan in this locality, if it is, the service feedback information that search is corresponding with described service request information;Otherwise, described service request information is sent to server 300, receives the service feedback information that server 300 sends;After obtaining described service feedback information, perform the application operating corresponding with described service feedback information;
Information processor 200, connect described mobile terminal 100, for described voice messaging being sequentially carried out identifying processing, text conversion process and semantic dissection process, obtaining the service request information corresponding with described voice messaging, and described service request information is sent to mobile terminal 100;
Server 300, connects described mobile terminal 100, for according to described service request information, searching for the service feedback information corresponding with described service request information, and described service feedback information is sent to mobile terminal 100。
Described mobile terminal 100 may include that mobile unit, mobile phone or computer etc., and any one moves device。For simplicity, illustrate for mobile unit for described mobile terminal 100 below, but it is not intended to protection scope of the present invention。
Can be connected by any one communication mode in 2G, 3G or 4G between described mobile terminal 100 with described information processor 200。
Can be connected by any one communication mode in 2G, 3G or 4G between described mobile terminal 100 with described server 300。
Specifically, the communication mode between communication mode and described mobile terminal 100 and the described server 300 between described mobile terminal 100 and described information processor 200 can be identical, it is also possible to different。
Described service request information may include that navigation, makes a phone call, sends short messages, checks or change address list, opens or closes radio, inquiry or book flight, inquiry or predetermined hotel, inquire about or book a train ticket, inquiring about or buy or dump stock, point of interest search, inquiry weather, schedule and prompting, the one listened in music, perimeter query and chat or combination in any。That is, the speech control system that the present embodiment provides can make user's voice that freely optionally input is relevant to any of the above-described service request information, it is possible to realizes the demand that user is corresponding。
With reference to shown in Fig. 2, described mobile terminal 100 may include that
Voice input module 110, is used for obtaining voice messaging;
First communication module 120, connects described information processor 200, for the voice messaging of acquisition is sent to information processor 200, and receives the service request information that information processor 200 sends;
Judge module 130, connects described first communication module 120, according to described service request information, it may be judged whether scan in this locality, when being, described service request information is sent to search module 140;Otherwise, described service request information is sent to second communication module 160;
Locally stored module 150, is used for storing service feedback information;
Search module 140, connects described judge module 130 and described locally stored module 150, for searching for the service feedback information corresponding with described service request information from locally stored module 150;
Second communication module 160, connects described judge module 130 and described server 300, for described service request information is sent to server 300, and receives the service feedback information that server 300 sends;
Perform module 170, connect described search module 140 and described second communication module 160, for performing the application operating corresponding with described service feedback information。
Described voice input module 110 can be mike。
Described first communication module 120 and second communication module 160 can be any one communicators adopting 2G, 3G or 4G communication mode, and first communication module 120 can realize the information transmission between mobile terminal 100 and information processor 200, second communication module 160 can realize the information transmission between mobile terminal 100 and server 300。
Described locally stored module 150 can be internal or external any memorizer, wherein can store the service feedback information corresponding with partial service solicited message。As: address list, schedule, message registration, note record, navigation record etc.。
Owing to Flight Information, hotel information, train ticket information, stock information, Weather information etc. are real-time change, and its required memory space is very big, therefore cannot be stored in locally stored module 150, can only be provided by server 300。
When the service feedback information corresponding with described service request information is provided by locally stored module 150, only local search need to be carried out in the mobile terminal 100, otherwise, it is necessary to scan in the server 300。Described judge module 130 is exactly for judging the position of search。Specifically, in described judge module 130, storage has the service request information kind relation with corresponding searching position, after obtaining described service request information from first communication module 120, first judge the kind of service request information, and then the relation according to the service request information kind stored with corresponding searching position, obtaining service feedback information corresponding to described service request information should be provided by local search module 150 or be provided by server 300;When being provided by local search module 150, then described service request information is sent to search module 140, when being provided by server 300, then described service request information is sent to second communication module 160, then is sent to server 300 by second communication module 160。
Described search module 140 receives described service request information from judge module 130, and searches for the service feedback information corresponding with described service request information from locally stored module 150, and the service feedback information searched is sent to execution module 170。
Described execution module 170 both can receive the service feedback information provided by local search module 150 from search module 140, the service feedback information provided by server 300 can also be provided from second communication module 160, after receiving described service feedback information, described execution module 170 is responsible for performing corresponding application operating。
Preferably, in conjunction with reference to shown in Fig. 3, described execution module 170 may include that
Multiple application memory unit 171, for storing different classes of application operating;
Priority allocation unit 173, connects described application memory unit 171, for distributing priority for each described application memory unit 171;
Call control unit 175, connect described application memory unit 171, described priority allocation unit 173, described search module 140 and described second communication module 160, for the application operating that the service feedback information obtaining the application operating being currently executing and receive is corresponding, call the application operating that the service feedback information received is corresponding, and judge that the priority of application operating corresponding to the service feedback information that receives is whether more than the priority of the application operating being currently executing according to precedence information, if it is, close the application operating being currently executing;Otherwise, the application operating being currently executing is maintained。
In described application memory unit 171 classification of application operating of storage may include that navigation, make a phone call, send short messages, check or change address list, open or close radio, inquiry or book flight, inquiry or predetermined hotel, inquire about or book a train ticket, inquiring about or buy or dump stock, point of interest search, inquiry weather, schedule and prompting, listen in music, perimeter query and chat any one。
Application memory unit 171 can be divided into plural priority by described priority allocation unit 173, as: two, three or five etc.。For simplicity, all of application memory unit 171 is divided into two priority by the present embodiment, wherein: the application memory unit 171 of navigation application operation correspondence is high priority, other application memory unit 172 is low priority, such that it is able to provide the user navigation information always, ensure safety and the convenience driven, improve the experience effect of user。
Described control unit 175 of calling is while calling the application operating that the service feedback information performing to receive is corresponding, can also judge that the priority of application operating corresponding to the service feedback information that receives is whether more than the priority of the application operating being currently executing according to precedence information, thus judging whether to close the application operating being currently executing。Specifically, when the priority ratio of the application operating being currently executing is relatively low, then close the application operating being currently executing, process the efficiency of application operating corresponding to the service feedback information just received with raising。As: the application operating being currently executing is navigation, application operating corresponding to the service feedback information that receives is for listening music, then owing to listening the priority priority lower than navigation of music, therefore calling control unit 175 while performing to listen the application operating of music, navigation application is still opened。And for example: the application operating being currently executing is for listening to the radio, application operating corresponding to the service feedback information that receives is for listening music, then owing to listening the priority of music to be not more than the priority listened to the radio, therefore call control unit 175 while performing to listen the application operating of music, close radio。
It should be noted that, in other embodiments of the invention, each application memory unit can not be carried out priority setting by described execution module, only it is carried out the application operating that the service feedback information that receives is corresponding, namely it does not include priority allocation unit, calling control unit is also only call the application operating that the service feedback information performing to receive is corresponding, and does not carry out judgement and the subsequent treatment of priority。
Preferably, described mobile terminal 100 can also include: local answer module 181, connects described first communication module 120, and when voice messaging described in described information processor 200 None-identified, the described local module 181 that replies carries out local answer。Specifically, described local answer can be voice response or word answer, as: " awfully sorry; currently without signal, temporarily can not to provide service for you ", or " I does not hear; please say a little slower ", or " whether you are need to start navigation " etc., to improve Consumer's Experience effect。Further, it is also possible to replied module 181 by this locality and be actively directly connected to call center, call center be supplied to the service that user wants。
Preferably, described mobile terminal 100 can also include: prompting module 183, connect described execution module 170 (specifically can connect perform calling control unit 175 in module 170), while execution module 170 performs described application operating, by prompting module 183, described application operating is carried out voice reminder or display alarm, such that it is able to improve the experience effect of user further。
Preferably, described mobile terminal 100 can also include: alert requests module 185, connect described second communication module 160 and prompting module 183, for obtaining the alert requests information corresponding with described service request information, described alert requests information is sent to server 300 by second communication module 160 and receives, by second communication module 160, the prompting feedback information that server 300 sends, and described prompting feedback information is sent to prompting module 183;Described server 300 is according to described alert requests information, it is thus achieved that the prompting feedback information corresponding with described alert requests information;Described prompting feedback information is carried out voice reminder or display alarm by described prompting module 183。As: user says " I thinks the Zhongshan Tomb in Nanjing ", then perform module 170 while providing guidance path, the traffic information " XX section compare at present block up " of the local Weather information " currently raining in Nanjing; please take in a reef " in Nanjing or guidance path process can also be provided, with the voice message more intimate to user, these information are based on the information that the voice content of user is additionally provided outside providing the result that user directly goes for。
In conjunction with reference to shown in Fig. 4, described information processor 200 may include that
Third communication module 210, connects described mobile terminal 100, is used for receiving described voice messaging, and service request information is sent to mobile terminal 100;
Sound identification module 220, connects described third communication module 210, for being identified described voice messaging processing, and the voice messaging after being identified;
Text conversion module 230, connects described sound identification module 220, for the voice messaging after identifying is carried out text conversion process, obtains the text message corresponding with described voice messaging;
Semantic meaning analysis module 240, connect described text conversion module 230 and described third communication module 210, for described text message being carried out semantic dissection process, obtaining the service request information corresponding with described voice messaging, and described service request information is sent to third communication module 210。
Described information processor 200 can adopt cloud service device。
Specifically, third communication module 210 connects first communication module 110。
In conjunction with reference to shown in Fig. 5, described sound identification module 220 may include that
Freely say sound bank 221, be used for storing and multiple freely say voice;
Matching unit 225, connect described third communication module 210, described freely say sound bank 221 and described text conversion module 230, for sound bank 221 finding the voice matched with described voice messaging from freely saying, and the voice found is sent to text conversion module 230 as the voice messaging after identifying。
Preferably, described freely say that sound bank 221 may include that multiple voice unit 229 of freely saying, each described voice messaging freely saying that voice unit 229 is corresponding different classes of;Described sound identification module 220 can also include: priority arranges unit 223, connect and described freely say voice unit 229 and matching unit 225, for described freely saying that voice unit 229 arranges priority for each, described matching unit 225 finds the voice matched with described voice messaging according to priority order from high to low from freely saying voice unit 229。
Preferably, described sound identification module 220 can also include: chats sound bank 227, matching connection unit 225, for storing chat voice, when matching unit 225 cannot find the voice matched with described voice messaging in freely saying sound bank 221, continue in chatting sound bank 227, find the voice matched with described voice messaging。
Sound bank in sound identification module 220 is divided into by the present embodiment freely to be said sound bank 221 and chats sound bank 227, and the memory capacity chatting sound bank 227 can more than the memory capacity freely saying sound bank 221。Described freely say that sound bank 221 is sound bank that is independent specific and that arrange for application conventional on car machine。Each described freely say a voice unit 229 corresponding classification respectively freely say voice, described classification may include that navigation, makes a phone call, sends short messages, checks or change address list, opens or closes radio, inquiry or book flight, inquiry or predetermined hotel, inquire about or book a train ticket, inquiring about or buy or dump stock, point of interest search, inquiry weather, schedule and prompting, listen in music, perimeter query and chat any one。
It is described that freely to say why sound bank 221 is independently arranged be use application conventional on car to facilitate car owner to pass through interactive voice, avoid carrying out speech recognition and speech analysis in substantial amounts of sound bank and waste the too much time making processing speed slow, therefore use intelligent and velocity ratio is very fast。Described chat sound bank 227 contains large-scale voice entry information, such as chat message, encyclopaedia information etc., this sound bank is primarily to and meets some man-machine interactions that user carries out outside using the application of car machine, such as carries out some situational dialogues " you are much for this year " " what is your name " " you are very clever " etc with car machine。Comparatively speaking, sound bank 227 is chatted owing to scope is relatively big, content is more, it is thus possible to be less than intelligence or processing speed is more relatively slow。
In conjunction with reference to shown in Fig. 6, described semantic meaning analysis module 240 may include that
Sentence pattern dissects unit 241, connects described text conversion module 230, for the information after text conversion process is carried out sentence pattern analysis, obtains the sentence pattern information that described information is corresponding;
Cutting unit 242, connects described sentence pattern and dissects unit 241, for according to described sentence pattern information, the information after text conversion process being divided into multiple semanteme;
Indexing unit 243, connects described cutting unit 242, and being used for described semantic marker is meaningful semanteme or meaningless semanteme;
Removal unit 244, connects described indexing unit 243, is used for removing described meaningless semanteme;
Service request memory element 245, is used for storing service request information;
Converting unit 246, connect described removal unit 244, described service request memory element 245 and described third communication module 210, for meaningful semanteme is changed, obtain the service request information corresponding with meaningful semanteme, and described service request information is sent to third communication module 210。
It should be noted that in other embodiments of the invention, described speech analysis module 240 can also adopt other structures, and it is not intended to protection scope of the present invention。
In conjunction with reference to shown in Fig. 7, described server 300 may include that
Fourth communication module 310, connects described mobile terminal 100, is used for receiving described service request information, and service feedback information is sent to mobile terminal 100;
Multiple information providing module 340, for providing the service feedback information of multiple classification;
Analysis module 320, connects described fourth communication module 310, for judging the classification of described service request information;
Retrieval module 330, connect described analysis module 320, described information providing module 340 and described fourth communication module 310, for retrieving the service feedback information corresponding with described service request information in the information providing module 340 corresponding with described classification, and the service feedback information retrieved is sent to fourth communication module 310。
Specifically, described fourth communication module 310 connects second communication module 160。
Described information providing module 340 can be call center, network or information service firm etc., the classification of the service feedback information of its offer may include that navigation, inquiry or book flight, inquiry or predetermined hotel, inquire about or book a train ticket, inquiring about or buy or dump stock, point of interest search, inquiry weather, listen in music, perimeter query and chat any one。
Below to inquire about flight, the present embodiment work process based on the speech control system of mobile unit is described:
1) voice messaging in " the inquiry Shanghai day after tomorrow to Pekinese's flight " or " listing Shanghai to Pekinese's flight, the time is the day after tomorrow " that voice input module 110 receives that user sends;
2) above-mentioned voice messaging is sent to sound identification module 220 by first communication module 120 and third communication module 210 by voice input module 110;
3) voice messaging received is identified processing by sound identification module 220, and the voice messaging after identifying is sent to text conversion module 230;
4) voice messaging after identifying is carried out text conversion by text conversion module 230, and the text message after conversion is sent to semantic meaning analysis module 240;
5) text message is carried out semantic parsing by semantic meaning analysis module 240, obtains the service request information of " inquiry " " day after tomorrow " " departure place is Shanghai, destination is Pekinese's flight ";
6) above-mentioned service request information is sent to judge module 130 by third communication module 210 and first communication module 110 by speech analysis module 240;
7) judge module 130 is according to the service request information received, judge that inquiry flight needs to be provided the information of correspondence by server 300, it is judged that described service request information is sent to analysis module 320 by second communication module 160 and fourth communication module 310 by module 130;
8) analysis module 320 judges the classification of described service request information, and described service request information and its classification information are sent to retrieval module 330;
9) retrieval module 330 retrieves the service feedback information corresponding with described service request information in the information providing module 340 corresponding with described classification, and by fourth communication module 310 and second communication module 160, the service feedback information retrieved is sent to execution module 170;Described service feedback information and the day after tomorrow all Flight Informations from Shanghai to Pekinese;
10) performing module 170 and receive described all Flight Informations, described Flight Information being carried out speech play or/and text importing, thus completing the inquiry of flight。
After obtaining Flight Information, user can carry out flight reservation according to described Flight Information, and its process is similar to flight inquiring, does not repeat them here。
The present embodiment carries out man machine language alternately by the mode freely said, and can realize the seamless jump between different application。
Correspondingly, with reference to shown in Fig. 8, present embodiment additionally provides a kind of sound control method based on mobile terminal, including:
Step S1, obtains voice messaging;
Step S2, is sequentially carried out identifying processing, text conversion process and semantic dissection process, obtains the service request information corresponding with described voice messaging described voice messaging;
Step S3, searches for the service feedback information corresponding with described service request information, and performs the application operating corresponding with described service feedback information。
Described mobile terminal may include that mobile unit, mobile phone or computer etc., and any one moves device。
Specifically, described service request information includes: navigates, make a phone call, send short messages, check or changes address list, open or close radio, inquiry or book flight, inquiry or predetermined hotel, inquires about or book a train ticket, inquiring about or buy or dump stock, point of interest search, inquiry weather, schedule and prompting, the one listened in music, perimeter query and chat or combination in any。
When being identified processing, can arrange for application conventional on mobile terminal and specifically freely say sound bank, other application are arranged chat sound bank, thus when identifying processing, can first scan for freely saying in sound bank, finally avoid carrying out speech recognition and speech analysis in substantial amounts of sound bank and waste the too much time making processing speed slow, therefore use intelligent and velocity ratio is very fast。
Described text conversion process is known for those skilled in the art, does not repeat them here。
Specifically, in conjunction with reference to shown in Fig. 9, described semantic dissection process may include that
Step S11, carries out sentence pattern analysis to the information after text conversion process, obtains the sentence pattern information that described information is corresponding;
Step S12, according to described sentence pattern information, is divided into multiple semanteme by the information after text conversion process;
Step S13, is meaningful semanteme or meaningless semanteme by described semantic marker, and removes described meaningless semanteme;
Step S14, changes meaningful semanteme, obtains the service request information corresponding with meaningful semanteme。
In an object lesson, the service request information of " being navigated; INTRM intermediate point is Xujiahui, destination is People's Square " can will be obtained after the identified process of voice messaging of " through Xujiahui to People's Square how to get to ", text conversion process and semantic dissection process。
In another object lesson, the service request information of " sending short messages; contact number is the Shanghai China Telecom number of Zhang San, and short message content will go to Beijing for me tomorrow " can be obtained after the identified process of voice messaging of " number to Zhang San Shanghai China Telecom of sending short messages; I will go to Beijing tomorrow ", text conversion process and semantic dissection process。
Preferably, can also include based on the sound control method of mobile terminal described in the present embodiment: step S4, while performing described application operating, described application operating be carried out voice reminder or display alarm。
Preferably, can also include based on the sound control method of mobile terminal described in the present embodiment: after obtaining the service request information corresponding with described voice messaging, obtain the alert requests information corresponding with described service request information, and the prompting feedback information that search is corresponding with described alert requests information, and described prompting feedback information is carried out voice reminder or display alarm。
Additionally, when voice messaging described in None-identified, it is possible to carry out local answer, do not repeat them here。
Specifically, in conjunction with reference to, shown in Figure 10, performing the application operating corresponding with described service feedback information and may include that
Step S21, classifies to application operating, and arranges priority for every class application operating;
Step S22, obtains the application operating that the application operating being currently executing is corresponding with the service feedback information received, calls the application operating that the service feedback information received is corresponding;
According to precedence information, step S23, judges that the priority of application operating corresponding to the service feedback information that receives is whether more than the priority of the application operating being currently executing, if it is, perform step S24;Otherwise, step S25 is performed;
Step S24, closes the application operating being currently executing;
Step S25, maintains the application operating being currently executing。
The classification of described application operating may include that navigation, makes a phone call, sends short messages, checks or change address list, opens or closes radio, inquiry or book flight, inquiry or predetermined hotel, inquire about or book a train ticket, inquiring about or buy or dump stock, point of interest search, inquiry weather, schedule and prompting, listen in music, perimeter query and chat any one。
When arranging priority for every class application operating, it is possible to all of application operating is divided into plural priority, as: two, three or five etc.。For simplicity, all of application operating is divided into two priority by the present embodiment, wherein: navigation application operation is high priority, other application operating is low priority, such that it is able to provide the user navigation information always, ensure safety and the convenience driven, improve the experience effect of user。
Sound control method described in the present embodiment can adopt aforesaid phonetic controller to realize, do not repeat them here, its equally possible user of guarantee just can start the corresponding application operating of mobile terminal to obtain the result wanted without using fixing voice command words, but can arbitrarily say and in short start corresponding application operating and obtain result, while providing the user more safer driving service, improve the experience effect of user。Additionally, the Voice command to mobile terminal can also be realized timely and accurately even for the user being unfamiliar with mobile terminal operation。
Although the present invention discloses as above with preferred embodiment, but the present invention is not limited to this。Any those skilled in the art, without departing from the spirit and scope of the present invention, all can make various changes or modifications, and therefore protection scope of the present invention should be as the criterion with claim limited range。