WO2016192258A1 - Prompt method for voice use, and terminal device - Google Patents

Prompt method for voice use, and terminal device Download PDF

Info

Publication number
WO2016192258A1
WO2016192258A1 PCT/CN2015/090954 CN2015090954W WO2016192258A1 WO 2016192258 A1 WO2016192258 A1 WO 2016192258A1 CN 2015090954 W CN2015090954 W CN 2015090954W WO 2016192258 A1 WO2016192258 A1 WO 2016192258A1
Authority
WO
WIPO (PCT)
Prior art keywords
voice
terminal device
behavior information
operation behavior
user
Prior art date
Application number
PCT/CN2015/090954
Other languages
French (fr)
Chinese (zh)
Inventor
安顺钰
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2016192258A1 publication Critical patent/WO2016192258A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725—Cordless telephones

Definitions

  • This application relates to, but is not limited to, the field of communication technology.
  • the related art voice control is usually provided in a stand-alone manner, and the interface displays voice commands that can be supported, and does not have a GUI (Graphical User Interface) operation.
  • This method is not applicable to the system-level VUI (Virtual User Interface) and GUI fusion system, thus limiting the use of voice control, thereby reducing the user experience.
  • This document provides a prompting method for voice use and a terminal device, which is intended to trigger a voice usage prompt for the same operation purpose according to the user's operation behavior, thereby guiding the user to use voice control.
  • a prompting method for voice use, the prompting method for using the voice includes:
  • a voice usage prompt is displayed at the terminal device.
  • the step of comparing the operation behavior information with a predetermined rule includes:
  • the step of displaying the voice usage prompt on the terminal device when the operation behavior information meets the predetermined rule includes:
  • the terminal device displays a voice conversation panel to prompt the user to launch the application by voice.
  • the step of displaying the voice usage prompt on the terminal device when the operation behavior information meets the predetermined rule includes:
  • the terminal device displays a voice conversation panel to prompt the user to dial a call by voice.
  • the step of displaying the voice usage prompt on the terminal device when the operation behavior information meets the predetermined rule includes:
  • the key point in the operation behavior information is the SMS interface editing, determining that the corresponding expected operation purpose is to edit the short message
  • the terminal device displays a voice conversation panel to prompt the user to edit the text message by voice.
  • the step of displaying the voice usage prompt on the terminal device when the operation behavior information meets the predetermined rule includes:
  • the terminal device displays a voice dialogue panel to prompt the user to take a picture by voice control.
  • a terminal device comprising:
  • the monitoring module is configured to: monitor operation behavior information of the user in the terminal device;
  • the comparison processing module is configured to: compare the operation behavior information with a predetermined rule
  • the display module is configured to: when the operation behavior information meets the predetermined rule, display a voice usage prompt at the terminal device.
  • the comparison processing module includes:
  • An extracting unit configured to: extract a key point in the operation behavior information
  • the obtaining unit is configured to: recall a pre-stored predetermined rule, and obtain a correspondence between a key point in the operation behavior information and an intended operation purpose;
  • the determining unit is configured to: determine whether a key point in the operation behavior information corresponds to the expected operation purpose.
  • the display module includes:
  • the first determining unit is configured to: when the key point in the operation behavior information is that the main interface turns pages, determine that the corresponding expected operation purpose is to find an application;
  • the first display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to start the application by voice.
  • the display module includes:
  • the second determining unit is configured to: when the key point in the operation behavior information is dial dialing, determine that the corresponding expected operation purpose is to call the contact;
  • the second display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to dial the call by voice.
  • the display module includes:
  • the third determining unit is configured to: when the key point in the operation behavior information is an SMS interface editing, determine that the corresponding expected operation purpose is to edit the short message;
  • the third display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to edit the short message by voice.
  • the display module includes:
  • the fourth determining unit is configured to: when the key point in the operation behavior information is a photographing interface, determine that the corresponding expected operation purpose is photographing;
  • the fourth display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to take a photo by voice control.
  • a computer readable storage medium storing computer executable instructions, the computer being executable
  • the line instructions are used to perform the method of any of the above.
  • the method for prompting voice usage and the terminal device provided by the embodiment of the present invention compare the operation behavior information with a predetermined rule by monitoring user operation behavior information of the terminal device, where the operation behavior information meets the predetermined rule At the time, the voice usage prompt is displayed on the terminal device. In this way, according to the user's operation behavior, a voice usage prompt for achieving the same operation purpose can be triggered, thereby guiding the user to use voice control. In addition, the voice usage prompt is displayed when the user needs it, and is not displayed when it is not needed, thus significantly improving the user experience.
  • FIG. 1 is a schematic flow chart of an embodiment of a prompting method for voice use according to the present invention
  • FIG. 2 is a schematic diagram of a refinement process of step S102 in FIG. 1;
  • FIG. 3 is a schematic flow chart of the refinement of the first embodiment of step S103 of FIG. 1;
  • step S103 in FIG. 1 is a schematic flow chart of the second embodiment of step S103 in FIG. 1;
  • FIG. 5 is a schematic diagram showing the refinement process of the third embodiment of step S103 in FIG. 1;
  • FIG. 6 is a schematic diagram of a refinement process of the fourth embodiment of step S103 in FIG. 1;
  • FIG. 7 is a schematic diagram of functional modules of an embodiment of a terminal device according to the present invention.
  • FIG. 8 is a schematic diagram of a refinement function module of the comparison processing module in FIG. 7;
  • FIG. 9 is a schematic diagram of a refinement function module of the first embodiment of the display module of FIG. 7;
  • FIG. 10 is a schematic diagram of a refinement function module of the second embodiment of the display module of FIG. 7;
  • FIG. 11 is a schematic diagram of a refinement function module of the third embodiment of the display module of FIG. 7;
  • FIG. 12 is a schematic diagram of a refinement function module of the fourth embodiment of the display module of FIG. 7.
  • the embodiment of the present invention provides a prompting method for voice use.
  • the prompting method for using the voice includes the following steps:
  • Step S101 monitoring user operation behavior information of the terminal device
  • the terminal device is a mobile phone with a touch screen, a tablet computer, a television, an inquiry machine, and the like.
  • the operation behavior information is the tap operation information of the user on the touch screen.
  • Step S102 comparing the operation behavior information with a predetermined rule
  • the step S102 includes:
  • Step S1021 extracting key points in the operation behavior information
  • the terminal device extracts a key point in the operation behavior information, where the key point is a feature point representing the operation behavior, for example, when the user scans the screen multiple times in the main interface, the extracted key point is the main interface.
  • the key point is a feature point representing the operation behavior
  • the terminal device extracts a key point in the operation behavior information, where the key point is a feature point representing the operation behavior, for example, when the user scans the screen multiple times in the main interface, the extracted key point is the main interface.
  • the key point extracted is the dial dial dial dialing, at which point the user can be inferred to call the contact
  • the key point to be extracted is to edit the short message.
  • the user is editing the short message; when the user is in the photographing interface, when the user's avatar can be detected within a certain distance, the key point extracted is photographing. At this point, it can be inferred that the user is taking a picture; when the user enters the listening to the song application and inputs through letters or in the input box, the key point to be extracted is to find a singer or song, and at this time, it can be inferred that the user is listening to the song or the like. It can be understood that it is not limited to the above several embodiments, and can be reasonably set according to actual needs.
  • Step S1022 recalling a pre-stored predetermined rule, and acquiring a correspondence between a key point in the operation behavior information and an intended operation purpose;
  • Step S1023 Determine whether a key point in the operation behavior information corresponds to the expected operation purpose.
  • the predetermined rule is pre-stored in the terminal device, and the predetermined rule specifies a correspondence between the user's touch operation and the intended operation purpose, for example, when the key point acquired is the main interface page turning, the corresponding expectation The purpose of the operation is to find an application; when the key point of the extraction is dial dialing, the corresponding expected operation purpose is to call the contact; when the extracted key point is the short message interface for editing, the corresponding intended operation purpose is to edit the short message.
  • the key point of extraction is to take a photo
  • the corresponding intended operation is to take a photo; when the key point is to find a singer or song, the corresponding expectation The purpose of the operation is to listen to the song.
  • Step S103 When the operation behavior information meets the predetermined rule, the voice usage prompt is displayed on the terminal device.
  • the terminal device when the terminal device determines that the operation behavior information meets a predetermined rule, the terminal device displays the voice usage prompt information in a form of a dialog box or a dialog panel on the display screen.
  • the terminal device When the user touches the voice use prompt information, the terminal device enters a voice control guiding process that meets the user's operation purpose, and can wake up the voice engine if necessary.
  • the terminal device displays a voice prompt such as “whether or not to edit the short message” on the display screen.
  • the display screen displays a voice such as “You can start voice input text message”.
  • Guide prompts when the user taps the voice usage prompt information, the voice message editing can be performed. Taking the page flip operation of the main interface as an example, the terminal device will prompt a voice prompt such as “Is looking for an application” on the display screen.
  • the user can search for a destination application such as “WeChat” through a voice form.
  • the method for prompting voice usage compares the operation behavior information with a predetermined rule by monitoring user operation behavior information of the terminal device, and when the operation behavior information meets the predetermined rule, The terminal device displays a voice usage prompt.
  • a voice usage prompt for achieving the same operation purpose can be triggered, thereby guiding the user to use voice control.
  • the voice usage prompt is displayed when the user needs it, and is not displayed when it is not needed, thus significantly improving the user experience.
  • the step S103 includes:
  • Step S1031 When a key point in the operation behavior information is that the main interface turns pages, determining that the corresponding expected operation purpose is to find an application;
  • the corresponding expected operation purpose is to find an application.
  • step S1032 the terminal device displays a voice dialogue panel to prompt the user to start the application by voice.
  • the terminal device displays a voice dialogue panel on the display screen, prompting the user to start the application by voice.
  • the step S103 includes:
  • Step S1033 when the key point in the operation behavior information is dialing dialing, determining that the corresponding expected operation purpose is to call the contact;
  • the corresponding expected operation purpose is to call the contact.
  • step S1034 the terminal device displays a voice conversation panel to prompt the user to dial the call by voice.
  • the terminal device displays a voice dialogue panel on the display screen, prompting the user to dial the call by voice.
  • the step S103 includes:
  • Step S1035 when the key point in the operation behavior information is the editing of the short message interface, determining that the corresponding expected operation purpose is to edit the short message;
  • the corresponding expected operation purpose is to edit the short message.
  • step S1036 the terminal device displays a voice dialogue panel to prompt the user to edit the short message by voice.
  • the terminal device displays a voice dialogue panel on the display screen, prompting the user to edit the short message by voice.
  • the step S103 includes:
  • Step S1037 when the key point in the operation behavior information is a photographing interface, determining that the corresponding expected operation purpose is photographing;
  • the key point is the camera interface, and the camera is the front camera.
  • the corresponding expected operation purpose is to take a photo.
  • it is also possible to determine that the corresponding intended operation purpose is to take a picture under the scene in which the rear camera captures the scene.
  • step S1038 the terminal device displays a voice dialogue panel to prompt the user to take a picture by voice control.
  • the terminal device displays a voice dialogue panel on the display screen, prompting the user to take a picture by voice control.
  • the terminal device can estimate the operation purpose of the user according to the existing touch operation habits of the user, thereby gradually helping the user establish the habit of voice control.
  • the voice dialogue panel is displayed when the user needs it, and is not displayed when it is not needed, thus significantly improving the user experience.
  • the embodiment of the present invention further provides a terminal device 1.
  • the terminal device 1 includes:
  • the monitoring module 101 is configured to: monitor operation behavior information of the user in the terminal device 1;
  • the terminal device 1 is a mobile phone with a touch screen, a tablet computer, a television, an inquiry machine, and the like.
  • the operation behavior information is the tap operation information of the user on the touch screen.
  • the comparison processing module 102 is configured to: compare the operation behavior information with a predetermined rule
  • the comparison processing module 102 includes:
  • the extracting unit 1021 is configured to: extract key points in the operation behavior information
  • the terminal device 1 extracts key points in the operation behavior information, where the key point is a feature point representing the operation behavior, for example, when the user scans the screen multiple times in the main interface, the key point extracted is the main point.
  • the page is turned over. At this point, it can be inferred that the user is looking for an application.
  • the key point of the extraction is dial dialing. At this point, it can be inferred that the user is calling the contact;
  • the SMS interface is edited, the key point extracted is the short edit.
  • the user is editing the short message; when the user is in the camera interface, when the user's avatar can be detected within a certain distance, the key point to be extracted is to take a picture. At this time, it can be inferred that the user is taking a picture; when the user enters to listen When the song application is input through letters or in the input box, the key point is to find the singer or song. At this point, it can be inferred that the user is listening to the song. It can be understood that it is not limited to the above several embodiments, and can be reasonably set according to actual needs.
  • the obtaining unit 1022 is configured to: call out a pre-stored predetermined rule, and obtain a correspondence between a key point in the operation behavior information and an intended operation target;
  • the determining unit 1023 is configured to: determine whether a key point in the operation behavior information corresponds to the expected operation purpose.
  • the predetermined rule is pre-stored in the terminal device 1.
  • the predetermined rule specifies a correspondence between the user's touch operation and the intended operation purpose, for example, when the key point acquired is the main interface page turning, the corresponding The intended operation purpose is to find the application; when the key point of the extraction is dial dialing, the corresponding expected operation purpose is to call the contact; when the extracted key point is the short message interface for editing, the corresponding expected operation purpose is to edit SMS; when the key point is to take a photo, the corresponding intended operation is to take a photo; when the key point is to find a singer or song, the corresponding intended operation is to listen to the song.
  • the display module 103 is configured to display a voice usage prompt on the terminal device 1 when the operation behavior information conforms to the predetermined rule.
  • the terminal device 1 when the terminal device 1 determines that the operation behavior information meets a predetermined rule, the terminal device 1 displays the voice usage prompt information in the form of a dialog box or a dialog panel on the display screen.
  • the terminal device 1 When the user touches the voice use prompt information, the terminal device 1 enters a voice control guiding process that meets the user's operation purpose, and can wake up the voice engine if necessary. Taking the editing of the short message interface as an example, the terminal device 1 displays a voice prompt such as “whether or not to edit the short message” on the display screen. When the user touches the voice use prompt information, the display screen displays “You can start voice input text message”. Voice guidance prompts, when the user taps the voice usage prompt information, the voice message editing can be performed. Taking the page flip operation of the main interface as an example, the terminal device 1 will prompt a voice prompt such as “whether to find an application” on the display screen. When the user touches the voice use prompt information, the user can search for the destination application such as “WeChat” through the voice form.
  • the terminal device 1 provided by the embodiment of the present invention compares the operation behavior information with a predetermined rule by monitoring the operation behavior information of the user in the terminal device 1, and when the operation behavior information meets the predetermined rule, The terminal device 1 displays a voice use prompt. In this way, according to the user's operation behavior, a voice usage prompt for achieving the same operation purpose can be triggered, thereby guiding the user to use voice control. In addition, the voice usage prompt is displayed when the user needs it, and is not displayed when it is not needed, thus significantly improving the user experience.
  • the display module 103 includes:
  • the first determining unit 1031 is configured to: when the key point in the operation behavior information is that the main interface turns pages, determine that the corresponding expected operation purpose is to find an application;
  • the corresponding expected operation purpose is to find an application.
  • the first display unit 1032 is configured to: the terminal device 1 displays a voice dialogue panel to prompt the user to start the application by voice.
  • the terminal device 1 displays a voice dialogue panel on the display screen, prompting the user to start the application by voice.
  • the display module 103 includes:
  • the second determining unit 1033 is configured to: when the key point in the operation behavior information is dial dialing, determine that the corresponding expected operation purpose is to call the contact;
  • the corresponding expected operation purpose is to call the contact.
  • the second display unit 1034 is configured to: the terminal device 1 displays a voice dialogue panel to prompt the user to dial a call by voice.
  • the terminal device 1 displays a voice dialogue panel on the display screen to prompt the user to dial a call through voice.
  • the display module 103 includes:
  • the third determining unit 1035 is configured to: when the key point in the operation behavior information is the short message interface editing, determine that the corresponding expected operation purpose is to edit the short message;
  • the corresponding expected operation purpose is to edit the short message.
  • the third display unit 1036 is configured to: the terminal device 1 displays a voice dialogue panel to prompt the user to edit the short message by voice.
  • the terminal device 1 displays a voice dialogue panel on the display screen, prompting the user to edit the short message by voice.
  • the display module 103 includes:
  • the fourth determining unit 1037 is configured to: when the key point in the operation behavior information is a photographing interface, determine that the corresponding intended operation purpose is photographing;
  • the key point is the camera interface, and the camera is the front camera.
  • the corresponding expected operation purpose is to take a photo.
  • it is also possible to determine that the corresponding intended operation purpose is to take a picture under the scene in which the rear camera captures the scene.
  • the fourth display unit 1038 is configured to: the terminal device 1 displays a voice dialogue panel to prompt the user to take a photo by voice control.
  • the terminal device 1 displays a voice dialogue panel on the display screen, prompting the user to take a picture by voice control.
  • the terminal device 1 can estimate the operation purpose of the user according to the existing touch operation habits of the user, thereby gradually helping the user establish the habit of voice control.
  • the voice dialogue panel is displayed when the user needs it, and is not displayed when it is not needed, thus significantly improving the user experience.
  • all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve.
  • the devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.
  • the device/function module/functional unit in the above embodiment When the device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium.
  • the above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.
  • the method for prompting voice usage and the terminal device provided by the embodiment of the present invention compare the operation behavior information with a predetermined rule by monitoring user operation behavior information of the terminal device, where the operation behavior information meets the predetermined rule At the time, the voice usage prompt is displayed on the terminal device. In this way, according to the user's operation behavior, a voice usage prompt for achieving the same operation purpose can be triggered, thereby guiding the user to use voice control. In addition, the voice usage prompt is displayed when the user needs it, and is not displayed when it is not needed, which significantly improves the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

Disclosed are a prompt method for voice use, and a terminal device, the method comprising: monitoring operation behaviour information about a user on a terminal device; comparing the operation behaviour information with a predetermined rule; and when the operation behaviour information meets the predetermined rule, displaying a voice use prompt on the terminal device.

Description

语音使用的提示方法以及终端设备Prompt method for voice use and terminal device 技术领域Technical field
本申请涉及但不限于通讯技术领域。This application relates to, but is not limited to, the field of communication technology.
背景技术Background technique
相关技术的语音控制通常以独立应用的方式提供，而且界面上显示的都是可以支持的语音命令，并没有GUI(Graphical User Interface，图形用户界面)操作。这种方式并不适用于***级的VUI(Virtual User Interface,虚拟用户界面)和GUI的融合***，因此，限制了语音控制的使用范围，从而降低用户体验。The related art voice control is usually provided in a stand-alone manner, and the interface displays voice commands that can be supported, and does not have a GUI (Graphical User Interface) operation. This method is not applicable to the system-level VUI (Virtual User Interface) and GUI fusion system, thus limiting the use of voice control, thereby reducing the user experience.
上述内容仅用于辅助理解本申请的技术方案，并不代表承认上述内容是现有技术。The above content is only used to assist in understanding the technical solutions of the present application, and does not constitute an admission that the above is prior art.
发明内容Summary of the invention
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.
本文提供一种语音使用的提示方法以及终端设备，旨在根据用户的操作行为，触发达到相同操作目的语音使用提示，从而引导用户使用语音控制。This document provides a prompting method for voice use and a terminal device, which is intended to trigger a voice usage prompt for the same operation purpose according to the user's operation behavior, thereby guiding the user to use voice control.
一种语音使用的提示方法，所述语音使用的提示方法包括：A prompting method for voice use, the prompting method for using the voice includes:
监控用户在终端设备的操作行为信息；Monitoring user operation information of the terminal device;
将所述操作行为信息与预定规则进行比对；Comparing the operational behavior information with a predetermined rule;
在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示。When the operation behavior information conforms to the predetermined rule, a voice usage prompt is displayed at the terminal device.
可选地，所述将所述操作行为信息与预定规则进行比对的步骤包括：Optionally, the step of comparing the operation behavior information with a predetermined rule includes:
提取所述操作行为信息中的关键点；Extracting key points in the operation behavior information;
调出预存的预定规则，获取所述操作行为信息中的关键点与预期操作目 的之间的对应关系；Recalling the pre-stored predetermined rule to obtain the key points and expected operation items in the operation behavior information Correspondence between
判断所述操作行为信息中的关键点是否对应所述预期操作目的。Determining whether a key point in the operation behavior information corresponds to the intended operation purpose.
可选地，所述在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示的步骤包括：Optionally, the step of displaying the voice usage prompt on the terminal device when the operation behavior information meets the predetermined rule includes:
当所述操作行为信息中的关键点是主界面翻页时，判定对应的预期操作目的为寻找应用；When the key point in the operation behavior information is that the main interface turns pages, it is determined that the corresponding expected operation purpose is to find an application;
终端设备显示语音对话面板，以提示用户通过语音启动应用。The terminal device displays a voice conversation panel to prompt the user to launch the application by voice.
可选地，所述在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示的步骤包括：Optionally, the step of displaying the voice usage prompt on the terminal device when the operation behavior information meets the predetermined rule includes:
当所述操作行为信息中的关键点是拨号盘拨号时，判定对应的预期操作目的为呼叫联系人；When the key point in the operation behavior information is dial dialing, it is determined that the corresponding expected operation purpose is to call the contact;
终端设备显示语音对话面板，以提示用户通过语音拨号呼叫。The terminal device displays a voice conversation panel to prompt the user to dial a call by voice.
可选地，所述在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示的步骤包括：Optionally, the step of displaying the voice usage prompt on the terminal device when the operation behavior information meets the predetermined rule includes:
当所述操作行为信息中的关键点是短信界面编辑时，判定对应的预期操作目的为编辑短信；When the key point in the operation behavior information is the SMS interface editing, determining that the corresponding expected operation purpose is to edit the short message;
终端设备显示语音对话面板，以提示用户通过语音编辑短信。The terminal device displays a voice conversation panel to prompt the user to edit the text message by voice.
可选地，所述在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示的步骤包括：Optionally, the step of displaying the voice usage prompt on the terminal device when the operation behavior information meets the predetermined rule includes:
当所述操作行为信息中的关键点是拍照界面时，判定对应的预期操作目的为拍照；When the key point in the operation behavior information is a photographing interface, determining that the corresponding expected operation purpose is photographing;
终端设备显示语音对话面板，以提示用户通过语音控制拍照。The terminal device displays a voice dialogue panel to prompt the user to take a picture by voice control.
一种终端设备，所述终端设备包括：A terminal device, the terminal device comprising:
监控模块，设置为：监控用户在终端设备的操作行为信息；The monitoring module is configured to: monitor operation behavior information of the user in the terminal device;
比对处理模块，设置为：将所述操作行为信息与预定规则进行比对；The comparison processing module is configured to: compare the operation behavior information with a predetermined rule;
显示模块，设置为：在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示。 The display module is configured to: when the operation behavior information meets the predetermined rule, display a voice usage prompt at the terminal device.
可选地，所述比对处理模块包括：Optionally, the comparison processing module includes:
提取单元，设置为：提取所述操作行为信息中的关键点；An extracting unit, configured to: extract a key point in the operation behavior information;
获取单元，设置为：调出预存的预定规则，获取所述操作行为信息中的关键点与预期操作目的之间的对应关系；The obtaining unit is configured to: recall a pre-stored predetermined rule, and obtain a correspondence between a key point in the operation behavior information and an intended operation purpose;
判断单元，设置为：判断所述操作行为信息中的关键点是否对应所述预期操作目的。The determining unit is configured to: determine whether a key point in the operation behavior information corresponds to the expected operation purpose.
可选地，所述显示模块包括：Optionally, the display module includes:
第一判定单元，设置为：当所述操作行为信息中的关键点是主界面翻页时，判定对应的预期操作目的为寻找应用；The first determining unit is configured to: when the key point in the operation behavior information is that the main interface turns pages, determine that the corresponding expected operation purpose is to find an application;
第一显示单元，设置为：终端设备显示语音对话面板，以提示用户通过语音启动应用。The first display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to start the application by voice.
可选地，所述显示模块包括：Optionally, the display module includes:
第二判定单元，设置为：当所述操作行为信息中的关键点是拨号盘拨号时，判定对应的预期操作目的为呼叫联系人；The second determining unit is configured to: when the key point in the operation behavior information is dial dialing, determine that the corresponding expected operation purpose is to call the contact;
第二显示单元，设置为：终端设备显示语音对话面板，以提示用户通过语音拨号呼叫。The second display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to dial the call by voice.
可选地，所述显示模块包括：Optionally, the display module includes:
第三判定单元，设置为：当所述操作行为信息中的关键点是短信界面编辑时，判定对应的预期操作目的为编辑短信；The third determining unit is configured to: when the key point in the operation behavior information is an SMS interface editing, determine that the corresponding expected operation purpose is to edit the short message;
第三显示单元，设置为：终端设备显示语音对话面板，以提示用户通过语音编辑短信。The third display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to edit the short message by voice.
可选地，所述显示模块包括：Optionally, the display module includes:
第四判定单元，设置为：当所述操作行为信息中的关键点是拍照界面时，判定对应的预期操作目的为拍照；The fourth determining unit is configured to: when the key point in the operation behavior information is a photographing interface, determine that the corresponding expected operation purpose is photographing;
第四显示单元，设置为：终端设备显示语音对话面板，以提示用户通过语音控制拍照。The fourth display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to take a photo by voice control.
一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执 行指令用于执行上述任一项的方法。A computer readable storage medium storing computer executable instructions, the computer being executable The line instructions are used to perform the method of any of the above.
本发明实施例提供的语音使用的提示方法以及终端设备，通过监控用户在终端设备的操作行为信息，将所述操作行为信息与预定规则进行比对，在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示。这样，可以根据用户的操作行为，触发达到相同操作目的语音使用提示，从而引导用户使用语音控制。此外，语音使用提示在用户需要时才进行显示，不需要时则不会显示，如此，显著提高了用户体验感。The method for prompting voice usage and the terminal device provided by the embodiment of the present invention compare the operation behavior information with a predetermined rule by monitoring user operation behavior information of the terminal device, where the operation behavior information meets the predetermined rule At the time, the voice usage prompt is displayed on the terminal device. In this way, according to the user's operation behavior, a voice usage prompt for achieving the same operation purpose can be triggered, thereby guiding the user to use voice control. In addition, the voice usage prompt is displayed when the user needs it, and is not displayed when it is not needed, thus significantly improving the user experience.
在阅读并理解了附图和详细描述后，可以明白其他方面。Other aspects will be apparent upon reading and understanding the drawings and detailed description.
附图概述BRIEF abstract
图1为本发明语音使用的提示方法一实施例的流程示意图；1 is a schematic flow chart of an embodiment of a prompting method for voice use according to the present invention;
图2为图1中步骤S102的细化流程示意图；2 is a schematic diagram of a refinement process of step S102 in FIG. 1;
图3为图1中步骤S103第一实施例的细化流程示意图；3 is a schematic flow chart of the refinement of the first embodiment of step S103 of FIG. 1;
图4为图1中步骤S103第二实施例的细化流程示意图；4 is a schematic flow chart of the second embodiment of step S103 in FIG. 1;
图5为图1中步骤S103第三实施例的细化流程示意图；FIG. 5 is a schematic diagram showing the refinement process of the third embodiment of step S103 in FIG. 1;
图6为图1中步骤S103第四实施例的细化流程示意图；6 is a schematic diagram of a refinement process of the fourth embodiment of step S103 in FIG. 1;
图7为本发明终端设备一实施例的功能模块示意图；FIG. 7 is a schematic diagram of functional modules of an embodiment of a terminal device according to the present invention; FIG.
图8为图7中比对处理模块的细化功能模块示意图；8 is a schematic diagram of a refinement function module of the comparison processing module in FIG. 7;
图9为图7中显示模块第一实施例的细化功能模块示意图；9 is a schematic diagram of a refinement function module of the first embodiment of the display module of FIG. 7;
图10为图7中显示模块第二实施例的细化功能模块示意图；10 is a schematic diagram of a refinement function module of the second embodiment of the display module of FIG. 7;
图11为图7中显示模块第三实施例的细化功能模块示意图；11 is a schematic diagram of a refinement function module of the third embodiment of the display module of FIG. 7;
图12为图7中显示模块第四实施例的细化功能模块示意图。FIG. 12 is a schematic diagram of a refinement function module of the fourth embodiment of the display module of FIG. 7.
本发明的实施方式 Embodiments of the invention
本发明实施例提供一种语音使用的提示方法，参照图1，在一实施例中，所述语音使用的提示方法包括以下步骤：The embodiment of the present invention provides a prompting method for voice use. Referring to FIG. 1 , in an embodiment, the prompting method for using the voice includes the following steps:
步骤S101，监控用户在终端设备的操作行为信息；Step S101, monitoring user operation behavior information of the terminal device;
本实施例中，终端设备为具有触摸屏的手机、平板电脑、电视、查询机等。本实施例中，操作行为信息为用户在触摸屏上的点触操作信息。In this embodiment, the terminal device is a mobile phone with a touch screen, a tablet computer, a television, an inquiry machine, and the like. In this embodiment, the operation behavior information is the tap operation information of the user on the touch screen.
步骤S102，将所述操作行为信息与预定规则进行比对；Step S102, comparing the operation behavior information with a predetermined rule;
参照图2，所述步骤S102包括：Referring to FIG. 2, the step S102 includes:
步骤S1021，提取所述操作行为信息中的关键点；Step S1021, extracting key points in the operation behavior information;
本实施例中，终端设备提取操作行为信息中的关键点，所述关键点为代表操作行为的特征点，如：当用户在主界面连续多次滑动屏幕时，提取的关键点则是主界面翻页，此时可以推测用户在寻找应用；当用户在拨号盘界面点击拨号盘上的数字时，提取的关键点则是拨号盘拨号，此时可以推测用户在呼叫联系人；当用户在短信界面进行编辑时，提取的关键点则是编辑短信，此时可以推测用户在编辑短信；当用户在拍照界面时，在一定距离内可以监测到用户的头像时，提取的关键点则是拍照，此时可以推测用户在拍照；当用户进入听歌应用程序并通过字母或在输入框输入时，提取的关键点则是寻找歌手或歌曲，此时可以推测用户在听歌等。可以理解的是，并不局限于以上几个实施例，可以根据实际需要合理设置。In this embodiment, the terminal device extracts a key point in the operation behavior information, where the key point is a feature point representing the operation behavior, for example, when the user scans the screen multiple times in the main interface, the extracted key point is the main interface. Turning the page, you can speculate that the user is looking for the application; when the user clicks the number on the dial pad on the dialpad interface, the key point extracted is the dial dial dialing, at which point the user can be inferred to call the contact; when the user is in the text message When the interface is edited, the key point to be extracted is to edit the short message. At this time, it can be inferred that the user is editing the short message; when the user is in the photographing interface, when the user's avatar can be detected within a certain distance, the key point extracted is photographing. At this point, it can be inferred that the user is taking a picture; when the user enters the listening to the song application and inputs through letters or in the input box, the key point to be extracted is to find a singer or song, and at this time, it can be inferred that the user is listening to the song or the like. It can be understood that it is not limited to the above several embodiments, and can be reasonably set according to actual needs.
步骤S1022，调出预存的预定规则，获取所述操作行为信息中的关键点与预期操作目的之间的对应关系；Step S1022, recalling a pre-stored predetermined rule, and acquiring a correspondence between a key point in the operation behavior information and an intended operation purpose;
步骤S1023，判断所述操作行为信息中的关键点是否对应所述预期操作目的。Step S1023: Determine whether a key point in the operation behavior information corresponds to the expected operation purpose.
本实施例中，预定规则预存于终端设备内，该预定规则规定了用户的点触操作与预期操作目的之间的对应关系，如：当获取的关键点是主界面翻页时，对应的预期操作目的则是寻找应用；当提取的关键点是拨号盘拨号时，对应的预期操作目的则是呼叫联系人；当提取的关键点是短信界面进行编辑时，对应的预期操作目的则是编辑短信；当提取的关键点是拍照时，对应的预期操作目的则是拍照；当提取的关键点是寻找歌手或歌曲时，对应的预期 操作目的则是听歌。In this embodiment, the predetermined rule is pre-stored in the terminal device, and the predetermined rule specifies a correspondence between the user's touch operation and the intended operation purpose, for example, when the key point acquired is the main interface page turning, the corresponding expectation The purpose of the operation is to find an application; when the key point of the extraction is dial dialing, the corresponding expected operation purpose is to call the contact; when the extracted key point is the short message interface for editing, the corresponding intended operation purpose is to edit the short message. When the key point of extraction is to take a photo, the corresponding intended operation is to take a photo; when the key point is to find a singer or song, the corresponding expectation The purpose of the operation is to listen to the song.
步骤S103，在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示。Step S103: When the operation behavior information meets the predetermined rule, the voice usage prompt is displayed on the terminal device.
本实施例中，终端设备判断所述操作行为信息符合预定规则时，终端设备则会在显示屏以对话框或对话面板的形式显示语音使用提示信息。In this embodiment, when the terminal device determines that the operation behavior information meets a predetermined rule, the terminal device displays the voice usage prompt information in a form of a dialog box or a dialog panel on the display screen.
当用户点触语音使用提示信息时，终端设备则会进入符合用户操作目的的语音控制引导过程，必要时可以唤醒语音引擎。以短信界面进行编辑为例，终端设备会在显示屏显示如“是否编辑短信”的语音提示，当用户点触语音使用提示信息时，显示屏显示如“您可以开始语音输入短信了”的语音引导提示，当用户点触语音使用提示信息时，即可进行语音短信编辑。以主界面翻页操作为例，终端设备会在显示屏提示如“是否寻找应用”的语音提示，当用户点触语音使用提示信息时，可以通过语音形式搜索“微信”等目的应用。When the user touches the voice use prompt information, the terminal device enters a voice control guiding process that meets the user's operation purpose, and can wake up the voice engine if necessary. Taking the editing of the short message interface as an example, the terminal device displays a voice prompt such as “whether or not to edit the short message” on the display screen. When the user touches the voice use prompt message, the display screen displays a voice such as “You can start voice input text message”. Guide prompts, when the user taps the voice usage prompt information, the voice message editing can be performed. Taking the page flip operation of the main interface as an example, the terminal device will prompt a voice prompt such as “Is looking for an application” on the display screen. When the user touches the voice use prompt information, the user can search for a destination application such as “WeChat” through a voice form.
本发明实施例提供的语音使用的提示方法，通过监控用户在终端设备的操作行为信息，将所述操作行为信息与预定规则进行比对，在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示。这样，可以根据用户的操作行为，触发达到相同操作目的语音使用提示，从而引导用户使用语音控制。此外，语音使用提示在用户需要时才进行显示，不需要时则不会显示，如此，显著提高了用户体验感。The method for prompting voice usage provided by the embodiment of the present invention compares the operation behavior information with a predetermined rule by monitoring user operation behavior information of the terminal device, and when the operation behavior information meets the predetermined rule, The terminal device displays a voice usage prompt. In this way, according to the user's operation behavior, a voice usage prompt for achieving the same operation purpose can be triggered, thereby guiding the user to use voice control. In addition, the voice usage prompt is displayed when the user needs it, and is not displayed when it is not needed, thus significantly improving the user experience.
在第一实施例中，如图3所示，在上述图1的实施例的基础上，本实施例中，所述步骤S103包括：In the first embodiment, as shown in FIG. 3, on the basis of the foregoing embodiment of FIG. 1, in the embodiment, the step S103 includes:
步骤S1031，当所述操作行为信息中的关键点是主界面翻页时，判定对应的预期操作目的为寻找应用；Step S1031: When a key point in the operation behavior information is that the main interface turns pages, determining that the corresponding expected operation purpose is to find an application;
本实施例中，当终端获取用户操作行为信息中的关键点是主界面翻页时，则判定对应的预期操作目的则是寻找应用。In this embodiment, when the key point in the user's operation behavior information is that the main interface turns pages, then the corresponding expected operation purpose is to find an application.
步骤S1032，终端设备显示语音对话面板，以提示用户通过语音启动应用。 In step S1032, the terminal device displays a voice dialogue panel to prompt the user to start the application by voice.
本实施例中，终端设备在显示屏上显示语音对话面板，提示用户通过语音启动应用。In this embodiment, the terminal device displays a voice dialogue panel on the display screen, prompting the user to start the application by voice.
在第二实施例中，如图4所示，在上述图1的实施例的基础上，本实施例中，所述步骤S103包括：In the second embodiment, as shown in FIG. 4, on the basis of the foregoing embodiment of FIG. 1, in the embodiment, the step S103 includes:
步骤S1033，当所述操作行为信息中的关键点是拨号盘拨号时，判定对应的预期操作目的为呼叫联系人；Step S1033, when the key point in the operation behavior information is dialing dialing, determining that the corresponding expected operation purpose is to call the contact;
本实施例中，当终端获取用户操作行为信息中的关键点是拨号盘拨号时，则判定对应的预期操作目的则是呼叫联系人。In this embodiment, when the key point in the user acquiring the user operation behavior information is the dial dialing, the corresponding expected operation purpose is to call the contact.
步骤S1034，终端设备显示语音对话面板，以提示用户通过语音拨号呼叫。In step S1034, the terminal device displays a voice conversation panel to prompt the user to dial the call by voice.
本实施例中，终端设备在显示屏上显示语音对话面板，提示用户通过语音拨号呼叫。In this embodiment, the terminal device displays a voice dialogue panel on the display screen, prompting the user to dial the call by voice.
在第三实施例中，如图5所示，在上述图1的实施例的基础上，本实施例中，所述步骤S103包括：In the third embodiment, as shown in FIG. 5, on the basis of the foregoing embodiment of FIG. 1, in the embodiment, the step S103 includes:
步骤S1035，当所述操作行为信息中的关键点是短信界面编辑时，判定对应的预期操作目的为编辑短信；Step S1035, when the key point in the operation behavior information is the editing of the short message interface, determining that the corresponding expected operation purpose is to edit the short message;
本实施例中，当终端获取用户操作行为信息中的关键点是短信界面编辑时，则判定对应的预期操作目的则是编辑短信。In this embodiment, when the key point in the user's operation behavior information is the short message interface editing, the corresponding expected operation purpose is to edit the short message.
步骤S1036，终端设备显示语音对话面板，以提示用户通过语音编辑短信。In step S1036, the terminal device displays a voice dialogue panel to prompt the user to edit the short message by voice.
本实施例中，终端设备在显示屏上显示语音对话面板，提示用户通过语音编辑短信。In this embodiment, the terminal device displays a voice dialogue panel on the display screen, prompting the user to edit the short message by voice.
在第四实施例中，如图6所示，在上述图1的实施例的基础上，本实施例中，所述步骤S103包括： In the fourth embodiment, as shown in FIG. 6, on the basis of the foregoing embodiment of FIG. 1, in the embodiment, the step S103 includes:
步骤S1037，当所述操作行为信息中的关键点是拍照界面时，判定对应的预期操作目的为拍照；Step S1037, when the key point in the operation behavior information is a photographing interface, determining that the corresponding expected operation purpose is photographing;
本实施例中，当终端获取用户操作行为信息中的关键点是拍照界面，摄像头是前置摄像头，在一定距离内可以监测到用户的头像时，则判定对应的预期操作目的则是拍照。当然，也可以在后置摄像头拍摄景物的场景下，判定对应的预期操作目的则是拍照。In this embodiment, when the terminal obtains the user operation behavior information, the key point is the camera interface, and the camera is the front camera. When the user's avatar can be detected within a certain distance, the corresponding expected operation purpose is to take a photo. Of course, it is also possible to determine that the corresponding intended operation purpose is to take a picture under the scene in which the rear camera captures the scene.
步骤S1038，终端设备显示语音对话面板，以提示用户通过语音控制拍照。In step S1038, the terminal device displays a voice dialogue panel to prompt the user to take a picture by voice control.
本实施例中，终端设备在显示屏上显示语音对话面板，提示用户通过语音控制拍照。In this embodiment, the terminal device displays a voice dialogue panel on the display screen, prompting the user to take a picture by voice control.
这样，终端设备可以依据用户已有的触控操作习惯，推测用户的操作目的，从而逐步帮助用户建立语音控制的习惯。此外，当语音对话面板在用户需要时才进行显示，不需要时则不会显示，这样，显著提高了用户体验感。In this way, the terminal device can estimate the operation purpose of the user according to the existing touch operation habits of the user, thereby gradually helping the user establish the habit of voice control. In addition, the voice dialogue panel is displayed when the user needs it, and is not displayed when it is not needed, thus significantly improving the user experience.
本发明实施例还提供一种终端设备1，参照图7，在一实施例中，所述终端设备1包括：The embodiment of the present invention further provides a terminal device 1. Referring to FIG. 7, in an embodiment, the terminal device 1 includes:
监控模块101，设置为：监控用户在终端设备1的操作行为信息；The monitoring module 101 is configured to: monitor operation behavior information of the user in the terminal device 1;
本实施例中，终端设备1为具有触摸屏的手机、平板电脑、电视、查询机等。本实施例中，操作行为信息为用户在触摸屏上的点触操作信息。In this embodiment, the terminal device 1 is a mobile phone with a touch screen, a tablet computer, a television, an inquiry machine, and the like. In this embodiment, the operation behavior information is the tap operation information of the user on the touch screen.
比对处理模块102，设置为：将所述操作行为信息与预定规则进行比对；The comparison processing module 102 is configured to: compare the operation behavior information with a predetermined rule;
参照图8，所述比对处理模块102包括：Referring to FIG. 8, the comparison processing module 102 includes:
提取单元1021，设置为：提取所述操作行为信息中的关键点；The extracting unit 1021 is configured to: extract key points in the operation behavior information;
本实施例中，终端设备1提取操作行为信息中的关键点，所述关键点为代表操作行为的特征点，如：当用户在主界面连续多次滑动屏幕时，提取的关键点则是主界面翻页，此时可以推测用户在寻找应用；当用户在拨号盘界面点击拨号盘上的数字时，提取的关键点则是拨号盘拨号，此时可以推测用户在呼叫联系人；当用户在短信界面进行编辑时，提取的关键点则是编辑短 信，此时可以推测用户在编辑短信；当用户在拍照界面时，在一定距离内可以监测到用户的头像时，提取的关键点则是拍照，此时可以推测用户在拍照；当用户进入听歌应用程序并通过字母或在输入框输入时，提取的关键点则是寻找歌手或歌曲，此时可以推测用户在听歌等。可以理解的是，并不局限于以上几个实施例，可以根据实际需要合理设置。In this embodiment, the terminal device 1 extracts key points in the operation behavior information, where the key point is a feature point representing the operation behavior, for example, when the user scans the screen multiple times in the main interface, the key point extracted is the main point. The page is turned over. At this point, it can be inferred that the user is looking for an application. When the user clicks on the number on the dial pad, the key point of the extraction is dial dialing. At this point, it can be inferred that the user is calling the contact; When the SMS interface is edited, the key point extracted is the short edit. At this point, it can be inferred that the user is editing the short message; when the user is in the camera interface, when the user's avatar can be detected within a certain distance, the key point to be extracted is to take a picture. At this time, it can be inferred that the user is taking a picture; when the user enters to listen When the song application is input through letters or in the input box, the key point is to find the singer or song. At this point, it can be inferred that the user is listening to the song. It can be understood that it is not limited to the above several embodiments, and can be reasonably set according to actual needs.
获取单元1022，设置为：调出预存的预定规则，获取所述操作行为信息中的关键点与预期操作目的之间的对应关系；The obtaining unit 1022 is configured to: call out a pre-stored predetermined rule, and obtain a correspondence between a key point in the operation behavior information and an intended operation target;
判断单元1023，设置为：判断所述操作行为信息中的关键点是否对应所述预期操作目的。The determining unit 1023 is configured to: determine whether a key point in the operation behavior information corresponds to the expected operation purpose.
本实施例中，预定规则预存于终端设备1内，该预定规则规定了用户的点触操作与预期操作目的之间的对应关系，如：当获取的关键点是主界面翻页时，对应的预期操作目的则是寻找应用；当提取的关键点是拨号盘拨号时，对应的预期操作目的则是呼叫联系人；当提取的关键点是短信界面进行编辑时，对应的预期操作目的则是编辑短信；当提取的关键点是拍照时，对应的预期操作目的则是拍照；当提取的关键点是寻找歌手或歌曲时，对应的预期操作目的则是听歌。In this embodiment, the predetermined rule is pre-stored in the terminal device 1. The predetermined rule specifies a correspondence between the user's touch operation and the intended operation purpose, for example, when the key point acquired is the main interface page turning, the corresponding The intended operation purpose is to find the application; when the key point of the extraction is dial dialing, the corresponding expected operation purpose is to call the contact; when the extracted key point is the short message interface for editing, the corresponding expected operation purpose is to edit SMS; when the key point is to take a photo, the corresponding intended operation is to take a photo; when the key point is to find a singer or song, the corresponding intended operation is to listen to the song.
显示模块103，设置为：在所述操作行为信息符合所述预定规则时，在所述终端设备1显示语音使用提示。The display module 103 is configured to display a voice usage prompt on the terminal device 1 when the operation behavior information conforms to the predetermined rule.
本实施例中，终端设备1判断所述操作行为信息符合预定规则时，终端设备1则会在显示屏以对话框或对话面板的形式显示语音使用提示信息。In this embodiment, when the terminal device 1 determines that the operation behavior information meets a predetermined rule, the terminal device 1 displays the voice usage prompt information in the form of a dialog box or a dialog panel on the display screen.
当用户点触语音使用提示信息时，终端设备1则会进入符合用户操作目的的语音控制引导过程，必要时可以唤醒语音引擎。以短信界面进行编辑为例，终端设备1会在显示屏显示如“是否编辑短信”的语音提示，当用户点触语音使用提示信息时，显示屏显示如“您可以开始语音输入短信了”的语音引导提示，当用户点触语音使用提示信息时，即可进行语音短信编辑。以主界面翻页操作为例，终端设备1会在显示屏提示如“是否寻找应用”的语音提示，当用户点触语音使用提示信息时，可以通过语音形式搜索“微信”等目的应用。 When the user touches the voice use prompt information, the terminal device 1 enters a voice control guiding process that meets the user's operation purpose, and can wake up the voice engine if necessary. Taking the editing of the short message interface as an example, the terminal device 1 displays a voice prompt such as “whether or not to edit the short message” on the display screen. When the user touches the voice use prompt information, the display screen displays “You can start voice input text message”. Voice guidance prompts, when the user taps the voice usage prompt information, the voice message editing can be performed. Taking the page flip operation of the main interface as an example, the terminal device 1 will prompt a voice prompt such as “whether to find an application” on the display screen. When the user touches the voice use prompt information, the user can search for the destination application such as “WeChat” through the voice form.
本发明实施例提供的终端设备1，通过监控用户在终端设备1的操作行为信息，将所述操作行为信息与预定规则进行比对，在所述操作行为信息符合所述预定规则时，在所述终端设备1显示语音使用提示。这样，可以根据用户的操作行为，触发达到相同操作目的语音使用提示，从而引导用户使用语音控制。此外，语音使用提示在用户需要时才进行显示，不需要时则不会显示，如此，显著提高了用户体验感。The terminal device 1 provided by the embodiment of the present invention compares the operation behavior information with a predetermined rule by monitoring the operation behavior information of the user in the terminal device 1, and when the operation behavior information meets the predetermined rule, The terminal device 1 displays a voice use prompt. In this way, according to the user's operation behavior, a voice usage prompt for achieving the same operation purpose can be triggered, thereby guiding the user to use voice control. In addition, the voice usage prompt is displayed when the user needs it, and is not displayed when it is not needed, thus significantly improving the user experience.
在第一实施例中，如图9所示，在上述图7的实施例的基础上，所述显示模块103包括：In the first embodiment, as shown in FIG. 9, on the basis of the above embodiment of FIG. 7, the display module 103 includes:
第一判定单元1031，设置为：当所述操作行为信息中的关键点是主界面翻页时，判定对应的预期操作目的为寻找应用；The first determining unit 1031 is configured to: when the key point in the operation behavior information is that the main interface turns pages, determine that the corresponding expected operation purpose is to find an application;
本实施例中，当终端获取用户操作行为信息中的关键点是主界面翻页时，则判定对应的预期操作目的则是寻找应用。In this embodiment, when the key point in the user's operation behavior information is that the main interface turns pages, then the corresponding expected operation purpose is to find an application.
第一显示单元1032，设置为：终端设备1显示语音对话面板，以提示用户通过语音启动应用。The first display unit 1032 is configured to: the terminal device 1 displays a voice dialogue panel to prompt the user to start the application by voice.
本实施例中，终端设备1在显示屏上显示语音对话面板，提示用户通过语音启动应用。In this embodiment, the terminal device 1 displays a voice dialogue panel on the display screen, prompting the user to start the application by voice.
在第二实施例中，如图10所示，在上述图7的实施例的基础上，所述显示模块103包括：In the second embodiment, as shown in FIG. 10, on the basis of the foregoing embodiment of FIG. 7, the display module 103 includes:
第二判定单元1033，设置为：当所述操作行为信息中的关键点是拨号盘拨号时，判定对应的预期操作目的为呼叫联系人；The second determining unit 1033 is configured to: when the key point in the operation behavior information is dial dialing, determine that the corresponding expected operation purpose is to call the contact;
本实施例中，当终端获取用户操作行为信息中的关键点是拨号盘拨号时，则判定对应的预期操作目的则是呼叫联系人。In this embodiment, when the key point in the user acquiring the user operation behavior information is the dial dialing, the corresponding expected operation purpose is to call the contact.
第二显示单元1034，设置为：终端设备1显示语音对话面板，以提示用户通过语音拨号呼叫。The second display unit 1034 is configured to: the terminal device 1 displays a voice dialogue panel to prompt the user to dial a call by voice.
本实施例中，终端设备1在显示屏上显示语音对话面板，提示用户通过语音拨号呼叫。 In this embodiment, the terminal device 1 displays a voice dialogue panel on the display screen to prompt the user to dial a call through voice.
在第三实施例中，如图11所示，在上述图7的实施例的基础上，所述显示模块103包括：In the third embodiment, as shown in FIG. 11, on the basis of the above embodiment of FIG. 7, the display module 103 includes:
第三判定单元1035，设置为：当所述操作行为信息中的关键点是短信界面编辑时，判定对应的预期操作目的为编辑短信；The third determining unit 1035 is configured to: when the key point in the operation behavior information is the short message interface editing, determine that the corresponding expected operation purpose is to edit the short message;
本实施例中，当终端获取用户操作行为信息中的关键点是短信界面编辑时，则判定对应的预期操作目的则是编辑短信。In this embodiment, when the key point in the user's operation behavior information is the short message interface editing, the corresponding expected operation purpose is to edit the short message.
第三显示单元1036，设置为：终端设备1显示语音对话面板，以提示用户通过语音编辑短信。The third display unit 1036 is configured to: the terminal device 1 displays a voice dialogue panel to prompt the user to edit the short message by voice.
本实施例中，终端设备1在显示屏上显示语音对话面板，提示用户通过语音编辑短信。In this embodiment, the terminal device 1 displays a voice dialogue panel on the display screen, prompting the user to edit the short message by voice.
在第四实施例中，如图12所示，在上述图7的实施例的基础上，所述显示模块103包括：In the fourth embodiment, as shown in FIG. 12, on the basis of the above embodiment of FIG. 7, the display module 103 includes:
第四判定单元1037，设置为：当所述操作行为信息中的关键点是拍照界面时，判定对应的预期操作目的为拍照；The fourth determining unit 1037 is configured to: when the key point in the operation behavior information is a photographing interface, determine that the corresponding intended operation purpose is photographing;
本实施例中，当终端获取用户操作行为信息中的关键点是拍照界面，摄像头是前置摄像头，在一定距离内可以监测到用户的头像时，则判定对应的预期操作目的则是拍照。当然，也可以在后置摄像头拍摄景物的场景下，判定对应的预期操作目的则是拍照。In this embodiment, when the terminal obtains the user operation behavior information, the key point is the camera interface, and the camera is the front camera. When the user's avatar can be detected within a certain distance, the corresponding expected operation purpose is to take a photo. Of course, it is also possible to determine that the corresponding intended operation purpose is to take a picture under the scene in which the rear camera captures the scene.
第四显示单元1038，设置为：终端设备1显示语音对话面板，以提示用户通过语音控制拍照。The fourth display unit 1038 is configured to: the terminal device 1 displays a voice dialogue panel to prompt the user to take a photo by voice control.
本实施例中，终端设备1在显示屏上显示语音对话面板，提示用户通过语音控制拍照。In this embodiment, the terminal device 1 displays a voice dialogue panel on the display screen, prompting the user to take a picture by voice control.
这样，终端设备1可以依据用户已有的触控操作习惯，推测用户的操作目的，从而逐步帮助用户建立语音控制的习惯。此外，当语音对话面板在用户需要时才进行显示，不需要时则不会显示，这样，显著提高了用户体验感。 In this way, the terminal device 1 can estimate the operation purpose of the user according to the existing touch operation habits of the user, thereby gradually helping the user establish the habit of voice control. In addition, the voice dialogue panel is displayed when the user needs it, and is not displayed when it is not needed, thus significantly improving the user experience.
本领域普通技术人员可以理解上述实施例的全部或部分步骤可以使用计算机程序流程来实现，所述计算机程序可以存储于一计算机可读存储介质中，所述计算机程序在相应的硬件平台上(如***、设备、装置、器件等)执行，在执行时，包括方法实施例的步骤之一或其组合。One of ordinary skill in the art will appreciate that all or a portion of the steps of the above-described embodiments can be implemented using a computer program flow, which can be stored in a computer readable storage medium, such as on a corresponding hardware platform (eg, The system, device, device, device, etc. are executed, and when executed, include one or a combination of the steps of the method embodiments.
可选地，上述实施例的全部或部分步骤也可以使用集成电路来实现，这些步骤可以被分别制作成一个个集成电路模块，或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。Alternatively, all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve.
上述实施例中的装置/功能模块/功能单元可以采用通用的计算装置来实现，它们可以集中在单个的计算装置上，也可以分布在多个计算装置所组成的网络上。The devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.
上述实施例中的装置/功能模块/功能单元以软件功能模块的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。上述提到的计算机可读取存储介质可以是只读存储器，磁盘或光盘等。When the device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. The above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.
工业实用性Industrial applicability
本发明实施例提供的语音使用的提示方法以及终端设备，通过监控用户在终端设备的操作行为信息，将所述操作行为信息与预定规则进行比对，在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示。这样，可以根据用户的操作行为，触发达到相同操作目的语音使用提示，从而引导用户使用语音控制。此外，语音使用提示在用户需要时才进行显示，不需要时则不会显示，显著提高了用户体验感。 The method for prompting voice usage and the terminal device provided by the embodiment of the present invention compare the operation behavior information with a predetermined rule by monitoring user operation behavior information of the terminal device, where the operation behavior information meets the predetermined rule At the time, the voice usage prompt is displayed on the terminal device. In this way, according to the user's operation behavior, a voice usage prompt for achieving the same operation purpose can be triggered, thereby guiding the user to use voice control. In addition, the voice usage prompt is displayed when the user needs it, and is not displayed when it is not needed, which significantly improves the user experience.

Claims (13)

  1. 一种语音使用的提示方法，包括：A prompting method for voice use, including:
    监控用户在终端设备的操作行为信息；Monitoring user operation information of the terminal device;
    将所述操作行为信息与预定规则进行比对；Comparing the operational behavior information with a predetermined rule;
    在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示。When the operation behavior information conforms to the predetermined rule, a voice usage prompt is displayed at the terminal device.
  2. 如权利要求1所述的语音使用的提示方法，其中，所述将所述操作行为信息与预定规则进行比对的步骤包括：The prompting method for voice use according to claim 1, wherein the step of comparing the operation behavior information with a predetermined rule comprises:
    提取所述操作行为信息中的关键点；Extracting key points in the operation behavior information;
    调出预存的预定规则，获取所述操作行为信息中的关键点与预期操作目的之间的对应关系；Retrieving a pre-stored predetermined rule to obtain a correspondence between a key point in the operation behavior information and an intended operation purpose;
    判断所述操作行为信息中的关键点是否对应所述预期操作目的。Determining whether a key point in the operation behavior information corresponds to the intended operation purpose.
  3. 如权利要求2所述的语音使用的提示方法，其中，所述在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示的步骤包括：The method for prompting the use of voice according to claim 2, wherein the step of displaying the voice usage prompt at the terminal device when the operation behavior information conforms to the predetermined rule comprises:
    当所述操作行为信息中的关键点是主界面翻页时，判定对应的预期操作目的为寻找应用；When the key point in the operation behavior information is that the main interface turns pages, it is determined that the corresponding expected operation purpose is to find an application;
    终端设备显示语音对话面板，以提示用户通过语音启动应用。The terminal device displays a voice conversation panel to prompt the user to launch the application by voice.
  4. 如权利要求2所述的语音使用的提示方法，其中，所述在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示的步骤包括：The method for prompting the use of voice according to claim 2, wherein the step of displaying the voice usage prompt at the terminal device when the operation behavior information conforms to the predetermined rule comprises:
    当所述操作行为信息中的关键点是拨号盘拨号时，判定对应的预期操作目的为呼叫联系人；When the key point in the operation behavior information is dial dialing, it is determined that the corresponding expected operation purpose is to call the contact;
    终端设备显示语音对话面板，以提示用户通过语音拨号呼叫。The terminal device displays a voice conversation panel to prompt the user to dial a call by voice.
  5. 如权利要求2所述的语音使用的提示方法，其中，所述在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示的步骤包括： The method for prompting the use of voice according to claim 2, wherein the step of displaying the voice usage prompt at the terminal device when the operation behavior information conforms to the predetermined rule comprises:
    当所述操作行为信息中的关键点是短信界面编辑时，判定对应的预期操作目的为编辑短信；When the key point in the operation behavior information is the SMS interface editing, determining that the corresponding expected operation purpose is to edit the short message;
    终端设备显示语音对话面板，以提示用户通过语音编辑短信。The terminal device displays a voice conversation panel to prompt the user to edit the text message by voice.
  6. 如权利要求2所述的语音使用的提示方法，其中，所述在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示的步骤包括：The method for prompting the use of voice according to claim 2, wherein the step of displaying the voice usage prompt at the terminal device when the operation behavior information conforms to the predetermined rule comprises:
    当所述操作行为信息中的关键点是拍照界面时，判定对应的预期操作目的为拍照；When the key point in the operation behavior information is a photographing interface, determining that the corresponding expected operation purpose is photographing;
    终端设备显示语音对话面板，以提示用户通过语音控制拍照。The terminal device displays a voice dialogue panel to prompt the user to take a picture by voice control.
  7. 一种终端设备，所述终端设备包括：A terminal device, the terminal device comprising:
    监控模块，设置为：监控用户在终端设备的操作行为信息；The monitoring module is configured to: monitor operation behavior information of the user in the terminal device;
    比对处理模块，设置为：将所述操作行为信息与预定规则进行比对；The comparison processing module is configured to: compare the operation behavior information with a predetermined rule;
    显示模块，设置为：在所述操作行为信息符合所述预定规则时，在所述终端设备显示语音使用提示。The display module is configured to: when the operation behavior information meets the predetermined rule, display a voice usage prompt at the terminal device.
  8. 如权利要求7所述的终端设备，其中，所述比对处理模块包括：The terminal device of claim 7, wherein the comparison processing module comprises:
    提取单元，设置为：提取所述操作行为信息中的关键点；An extracting unit, configured to: extract a key point in the operation behavior information;
    获取单元，设置为：调出预存的预定规则，获取所述操作行为信息中的关键点与预期操作目的之间的对应关系；The obtaining unit is configured to: recall a pre-stored predetermined rule, and obtain a correspondence between a key point in the operation behavior information and an intended operation purpose;
    判断单元，设置为：判断所述操作行为信息中的关键点是否对应所述预期操作目的。The determining unit is configured to: determine whether a key point in the operation behavior information corresponds to the expected operation purpose.
  9. 如权利要求8所述的终端设备，其中，所述显示模块包括：The terminal device according to claim 8, wherein the display module comprises:
    第一判定单元，设置为：当所述操作行为信息中的关键点是主界面翻页时，判定对应的预期操作目的为寻找应用；The first determining unit is configured to: when the key point in the operation behavior information is that the main interface turns pages, determine that the corresponding expected operation purpose is to find an application;
    第一显示单元，设置为：终端设备显示语音对话面板，以提示用户通过语音启动应用。The first display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to start the application by voice.
  10. 如权利要求8所述的终端设备，其中，所述显示模块包括：The terminal device according to claim 8, wherein the display module comprises:
    第二判定单元，设置为：当所述操作行为信息中的关键点是拨号盘拨号 时，判定对应的预期操作目的为呼叫联系人；a second determining unit, configured to: when the key point in the operation behavior information is a dial dial At the time of determining the corresponding expected operation purpose is to call the contact;
    第二显示单元，设置为：终端设备显示语音对话面板，以提示用户通过语音拨号呼叫。The second display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to dial the call by voice.
  11. 如权利要求7所述的终端设备，其中，所述显示模块包括：The terminal device of claim 7, wherein the display module comprises:
    第三判定单元，设置为：当所述操作行为信息中的关键点是短信界面编辑时，判定对应的预期操作目的为编辑短信；The third determining unit is configured to: when the key point in the operation behavior information is an SMS interface editing, determine that the corresponding expected operation purpose is to edit the short message;
    第三显示单元，设置为：终端设备显示语音对话面板，以提示用户通过语音编辑短信。The third display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to edit the short message by voice.
  12. 如权利要求8所述的终端设备，其中，所述显示模块包括：The terminal device according to claim 8, wherein the display module comprises:
    第四判定单元，设置为：当所述操作行为信息中的关键点是拍照界面时，判定对应的预期操作目的为拍照；The fourth determining unit is configured to: when the key point in the operation behavior information is a photographing interface, determine that the corresponding expected operation purpose is photographing;
    第四显示单元，设置为：终端设备显示语音对话面板，以提示用户通过语音控制拍照。The fourth display unit is configured to: the terminal device displays a voice dialogue panel to prompt the user to take a photo by voice control.
  13. 一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行权利要求1-6任一项的方法。 A computer readable storage medium storing computer executable instructions for performing the method of any of claims 1-6.
PCT/CN2015/090954 2015-06-05 2015-09-28 Prompt method for voice use, and terminal device WO2016192258A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510308853.6A CN106302972A (en) 2015-06-05 2015-06-05 The reminding method of voice use and terminal unit
CN201510308853.6 2015-06-05

Publications (1)

Publication Number Publication Date
WO2016192258A1 true WO2016192258A1 (en) 2016-12-08

Family

ID=57440155

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/090954 WO2016192258A1 (en) 2015-06-05 2015-09-28 Prompt method for voice use, and terminal device

Country Status (2)

Country Link
CN (1) CN106302972A (en)
WO (1) WO2016192258A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107491300A (en) * 2017-07-13 2017-12-19 深圳市金立通信设备有限公司 The reminding method and its terminal of a kind of intelligent function
CN108134877A (en) * 2017-12-21 2018-06-08 西安钛克韦尔信息科技有限公司 A kind of voice interactive method and mobile terminal
CN108520748B (en) 2018-02-01 2020-03-03 百度在线网络技术（北京）有限公司 Intelligent device function guiding method and system
CN110120964B (en) * 2018-02-07 2022-07-08 北京三快在线科技有限公司 User behavior monitoring method and device and computing equipment
CN109378001A (en) * 2018-12-27 2019-02-22 北京猎户星空科技有限公司 A kind of voice interactive method, device, electronic equipment and readable storage medium storing program for executing
CN110221685A (en) * 2019-04-26 2019-09-10 百度在线网络技术（北京）有限公司 Interact bootstrap technique, device, equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020120455A1 (en) * 2001-02-15 2002-08-29 Koichi Nakata Method and apparatus for speech input guidance
CN103187054A (en) * 2011-12-30 2013-07-03 三星电子株式会社 Electronic apparatus and method for controlling the same by voice input
CN103227865A (en) * 2013-04-10 2013-07-31 深圳市金立通信设备有限公司 Display method of voice recognition interface and mobile terminal
CN103634455A (en) * 2012-08-22 2014-03-12 百度在线网络技术（北京）有限公司 Annotation-based voice command prompting method and mobile terminal

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013022222A2 (en) * 2011-08-05 2013-02-14 Samsung Electronics Co., Ltd. Method for controlling electronic apparatus based on motion recognition, and electronic apparatus applying the same
CN104090708B (en) * 2014-01-23 2016-04-13 腾讯科技（深圳）有限公司 The control method of portable intelligent terminal and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020120455A1 (en) * 2001-02-15 2002-08-29 Koichi Nakata Method and apparatus for speech input guidance
CN103187054A (en) * 2011-12-30 2013-07-03 三星电子株式会社 Electronic apparatus and method for controlling the same by voice input
CN103634455A (en) * 2012-08-22 2014-03-12 百度在线网络技术（北京）有限公司 Annotation-based voice command prompting method and mobile terminal
CN103227865A (en) * 2013-04-10 2013-07-31 深圳市金立通信设备有限公司 Display method of voice recognition interface and mobile terminal

Also Published As

Publication number Publication date
CN106302972A (en) 2017-01-04

Similar Documents

Publication Publication Date Title
WO2016192258A1 (en) Prompt method for voice use, and terminal device
US10162489B2 (en) Multimedia segment analysis in a mobile terminal and control method thereof
JP6321296B2 (en) Text input method, apparatus, program, and recording medium
WO2018058749A1 (en) Content sharing method and device
CN107832036B (en) Voice control method, device and computer readable storage medium
CN106469054B (en) Notification message control method and device and terminal
CN107767864B (en) Method and device for sharing information based on voice and mobile terminal
CN106406867B (en) Screen reading method and device based on android system
CN105100366A (en) Method, device and system for confirming harassment telephone number
CN103886025B (en) The display methods and device of picture in webpage
WO2016082513A1 (en) Method and device for prompting call request
JP7166294B2 (en) Audio processing method, device and storage medium
WO2016110217A1 (en) Method, apparatus, terminal and storage medium for saving number during call
US9172795B1 (en) Phone call context setting
CN105511777B (en) Session display method and device on touch display screen
WO2016065814A1 (en) Information selection method and device
CN105068976A (en) Ticket information exhibition method and device
KR20200097444A (en) Electronic device for providing graphic data based on voice and operating method thereof
CN105447109A (en) Key word searching method and apparatus
CN106331328B (en) Information prompting method and device
CN105550235A (en) Information acquisition method and information acquisition apparatuses
CN104636164A (en) Generating method and device for starting page
EP3261324A1 (en) Method and device for application switching
KR101584887B1 (en) Method and system of supporting multitasking of speech recognition service in in communication device
CN108881766B (en) Video processing method, device, terminal and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15893909

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15893909

Country of ref document: EP

Kind code of ref document: A1