CN114690992B - Prompting method, prompting device and computer storage medium - Google Patents

Prompting method, prompting device and computer storage medium Download PDF

Info

Publication number
CN114690992B
CN114690992B CN202110117883.4A CN202110117883A CN114690992B CN 114690992 B CN114690992 B CN 114690992B CN 202110117883 A CN202110117883 A CN 202110117883A CN 114690992 B CN114690992 B CN 114690992B
Authority
CN
China
Prior art keywords
prompt
preset
operation object
information
touch
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110117883.4A
Other languages
Chinese (zh)
Other versions
CN114690992A (en
Inventor
时红仁
姜顺豹
高健
王鹏
孙中全
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Qwik Smart Technology Co Ltd
Original Assignee
Shanghai Qwik Smart Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Qwik Smart Technology Co Ltd filed Critical Shanghai Qwik Smart Technology Co Ltd
Priority to CN202310756068.1A priority Critical patent/CN116680033A/en
Publication of CN114690992A publication Critical patent/CN114690992A/en
Application granted granted Critical
Publication of CN114690992B publication Critical patent/CN114690992B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G06F9/453—Help systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The application discloses a prompting method, a prompting device and a computer storage medium, wherein the prompting method comprises the following steps: acquiring input operation information, wherein the operation information comprises at least one item of touch operation information, voice operation information and shot image information of a first operation object; identifying the first operation object based on the operation information; and presenting a first operation prompt related to the first operation object under the condition that the operation information meets a preset condition. According to the prompting method, the prompting device and the computer storage medium, when the input operation information is determined to meet the preset condition, the prompting message for operating the operation object is automatically presented, so that a user can quickly obtain the operation instruction for the operation object, the operation is simple and convenient, and the user experience is improved.

Description

Prompting method, prompting device and computer storage medium
Technical Field
The present invention relates to the field of information processing technologies, and in particular, to a prompting method, a prompting device, and a computer storage medium.
Background
Along with the rapid development of terminal technology, the functions of the vehicle-mounted system are more and more diversified, and meanwhile, the functions of the vehicle-mounted system are more and more configured correspondingly. In the scene of using the vehicle-mounted system, when the user is confused about the use of the vehicle-mounted system or cannot obtain a response, the user searches or searches for the help documents of the vehicle-mounted system by networking, but the method is complex in operation, and the user experience is seriously affected because the user is difficult to find the needed help.
The foregoing description is provided for general background information and does not necessarily constitute prior art.
Disclosure of Invention
The invention aims to provide a prompting method, a prompting device and a computer storage medium, which have the advantages that when a user hopes to obtain help prompts for an operation object according to input operation information, prompting information for operating the operation object is automatically presented, so that the user can quickly obtain operation instructions for the operation object, the operation is simple and convenient, and the user experience is improved.
Another object of the present invention is to provide a prompting method, an electronic device, and a computer storage medium, which are advantageous in that operation information can be input in a variety of different ways.
It is another object of the present invention to provide a prompting method, an electronic device and a computer storage medium, which are advantageous in that an operation prompt for an operation object can be presented in different manners.
Another object of the present invention is to provide a prompting method, an electronic device, and a computer storage medium, which are advantageous in that corresponding operation prompts can be presented even if an operation object is not activated or is not used for a long time.
Other advantages and features of the present invention will become more fully apparent from the following detailed description, and may be learned by the practice of the invention as set forth hereinafter.
According to an aspect of the present invention, there is provided a method for prompting the aforementioned objects and other objects and advantages, the method comprising the steps of:
acquiring input operation information, wherein the operation information comprises at least one item of touch operation information, voice operation information and shot image information of a first operation object;
identifying the first operation object based on the operation information; and
and under the condition that the operation information meets the preset condition, presenting a first operation prompt related to the first operation object.
According to one embodiment of the invention, the presenting a first operation prompt related to the first operation object includes at least one of the following ways:
displaying a document or text containing a first operation prompt related to the first operation object;
displaying a small video or page containing a first operation prompt related to the first operation object;
displaying a hung window containing a help key, wherein the help key is used for triggering and displaying a first operation prompt related to the first operation object; and
and broadcasting a voice containing a first operation prompt related to the first operation object.
According to one embodiment of the invention, the method further comprises the steps of:
and displaying a second operation prompt related to the second operation object under the condition that the second operation object meeting the prompt condition exists in the current operation interface.
Correspondingly, the invention provides a prompting device for executing the method, which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor executes the computer program to realize the following steps: acquiring input operation information, wherein the operation information comprises at least one item of touch operation information, voice operation information and shot image information of a first operation object; identifying the first operation object based on the operation information; and presenting a first operation prompt related to the first operation object under the condition that the operation information meets a preset condition.
Accordingly, the present invention provides a computer storage medium storing a computer program which, when executed by a processor, implements the steps of the prompting method described above.
Drawings
Fig. 1 is a schematic flow chart of a prompting method according to an embodiment of the present invention;
Fig. 2 is a schematic diagram of an application scenario of a prompting method according to an embodiment of the present invention;
fig. 3 is a second application scenario diagram of a prompting method according to an embodiment of the present invention;
fig. 4 is a third application scenario diagram of a prompting method according to an embodiment of the present invention;
fig. 5 is a schematic diagram of an application scenario of a prompting method in an embodiment of the present invention;
fig. 6 is a schematic diagram of an application scenario of a prompting method in an embodiment of the present invention;
fig. 7 is a schematic diagram of an application scenario of a prompting method in an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a prompting device according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the accompanying claims.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the element defined by the phrase "comprising one … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element, and furthermore, elements having the same name in different embodiments of the present application may have the same meaning or may have different meanings, a particular meaning of which is to be determined by its interpretation in this particular embodiment or by further combining the context of this particular embodiment.
It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope herein. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context. Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes," and/or "including" specify the presence of stated features, steps, operations, elements, components, items, categories, and/or groups, but do not preclude the presence, presence or addition of one or more other features, steps, operations, elements, components, items, categories, and/or groups. The terms "or" and/or "as used herein are to be construed as inclusive, or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a, A is as follows; b, a step of preparing a composite material; c, performing operation; a and B; a and C; b and C; A. b and C). An exception to this definition will occur only when a combination of elements, functions, steps or operations are in some way inherently mutually exclusive.
It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily occurring in sequence, but may be performed alternately or alternately with other steps or at least a portion of the other steps or stages.
It should be noted that, in this document, step numbers such as S101 and S102 are used for the purpose of more clearly and briefly describing the corresponding content, and not to constitute a substantial limitation on the sequence, and those skilled in the art may execute S102 first and then S101 when implementing the present invention, which is within the scope of protection of the present application.
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
In the following description, suffixes such as "module", "component", or "unit" for representing elements are used only for facilitating the description of the present application, and are not of specific significance per se. Thus, "module," "component," or "unit" may be used in combination.
Referring to fig. 1, a flow chart of a prompting method provided by an embodiment of the present invention is shown, where the prompting method may be suitable for a situation of operation help prompting, the prompting method may be implemented by a prompting device provided by an embodiment of the present invention, the prompting device may be implemented in a software and/or hardware manner, the prompting device may be a vehicle-mounted terminal, such as a vehicle, etc., and in this embodiment, the prompting method is shown as applied to the vehicle, and the prompting method includes the following steps:
step S101: acquiring input operation information, wherein the operation information comprises at least one item of touch operation information, voice operation information and shot image information of a first operation object;
the operation object may be a button, an icon, a check box, a drop-down list, or other controls displayed on an operation interface of the vehicle, or may be various switch buttons, an indicator light, or the like in the vehicle. The vehicle machine CAN acquire touch operation information of the first operation object through a CAN bus and the like, acquire voice operation information of the first operation object through a voice acquisition device such as a microphone and acquire shooting image information of the first operation object through communication connection established with external equipment such as a smart phone and the like. It may be understood that the obtaining the input touch operation information may be obtaining the touch operation information based on an input device such as a touch screen of a vehicle, and the corresponding touch operation may be operations such as clicking, pressing, touching, etc. of different fingers of the user on the touch screen, for example, when the user clicks on the touch screen with a finger, the touch operation may be a finger clicking operation; when the user presses a finger on the touch screen, the touch operation may be a finger pressing operation. Optionally, the touch operation information may include a touch duration of a touch operation and/or a touch number of times of the touch operation, taking the first operation object as a virtual key as an example, and if the user uses a finger to continuously press the virtual key, the duration of the continuous pressing is the touch duration of the touch operation; if the user clicks the virtual key by using a finger, the number of times of clicking the virtual key in a preset time is the number of times of touch operation. In addition, the touch operation information may also include a touch track and/or a touch pattern and/or a type of touch operation, such as a single click, a double click, a multiple click, etc. divided according to a click type.
Here, before the acquiring the input operation information, the method may further include: and starting a prompt mode, and executing the step of acquiring the input operation information. It should be noted that, the vehicle machine may be provided with a user interface for controlling whether to turn on the prompt mode, and the user interface may be provided with an on key and an off key or an integral control key, or may also be provided with a voice recognition module. Specifically, when the user interface is only provided with an opening key and a closing key, and when the user touches the opening key, the prompting mode is started in the same way that the vehicle machine receives a prompting mode starting instruction; when the user touches the close key, the prompt mode is closed when the vehicle machine receives a prompt mode close instruction. When the user interface is only provided with the voice recognition module, the voice recognition module recognizes the voice signal of the user so as to recognize whether a prompt mode starting instruction exists in the voice signal of the user, so that the prompt mode is started when the voice instruction of the prompt mode starting instruction is received, and further operation information input by the user is acquired. Here, the vehicle may also have a switch for turning on or off the prompt mode.
Step S102: identifying the first operation object based on the operation information;
it should be noted that, for the touch operation information, the vehicle may directly determine the first operation object according to the touch operation information, that is, the vehicle may directly determine the touch object corresponding to the touch operation information as the first operation object. For example, a control (e.g., a voice input control) or an area (e.g., a video display area) corresponding to a touch point in the touch operation information may be determined as the first operation object. For the voice operation information and the photographed image information, the vehicle may need to be further recognized to acquire the first operation object. In one embodiment, the identifying the first operation object based on the operation information includes at least one of: intercepting a target image in the shot image information, matching the target image with a preset image in a first database to determine a preset image with highest matching degree, and determining a preset operation object associated with the preset image as the first operation object based on the preset image; wherein, the first database stores different preset operation objects and associated preset images; the target keyword in the shot image information is identified, the target keyword is matched with a first preset keyword in a second database, so that a first preset keyword with highest matching degree is determined, and a preset operation object associated with the first preset keyword is determined to be the first operation object based on the first preset keyword; the second database stores different preset operation objects and associated first preset keywords. The first preset keyword is used for indicating the name or function of the first operation object. It can be understood that if the captured image information includes an image or a keyword of a certain operation object, the image or the keyword may be acquired first, and then the first operation object is determined according to the operation object associated with the image or the keyword. For example, assume that a user uses a smart phone to photograph an air-conditioning temperature button, and the obtained photographed image information is transmitted to a car machine, and then the car machine matches the obtained image of the air-conditioning temperature button in a first database based on the photographed image information, thereby determining that the first operation object is the air-conditioning temperature button. Moreover, assume that the user uses the smart phone to photograph a button displayed with a "+" sign, and transmits the obtained photographed image information to the car machine, and the car machine obtains a first preset keyword "raise" by matching in the second database based on the photographed image information, so as to determine that the first operation object is volume. Thus, the first operation object is determined based on the image or the keyword in the shot image information, the operation is convenient, and the accuracy is high.
In addition, if there are a plurality of pieces of operation information acquired, a certain piece of operation information may be preferentially identified based on a preset priority level to obtain the first operation object, without considering other operation information. For example, it is assumed that the vehicle acquires the voice operation information immediately after the vehicle acquires the touch operation information, and at this time, the touch operation object may be directly determined as the first operation object without continuing to acquire the first operation object according to the voice operation information. If there are a plurality of first operation objects identified based on the operation information, a prompt message may be output to select the actually required first operation object by the user, or a corresponding operation prompt may be presented for each first operation object.
Step S103: and under the condition that the operation information meets the preset condition, presenting a first operation prompt related to the first operation object.
Here, the preset condition may be set according to actual situation requirements according to the difference of the operation information. In one embodiment, the preset conditions include at least one of the following conditions: the touch duration of the touch operation meets a first duration preset condition; the touch times of the touch operation meet the times preset conditions; the number of times of continuous recognition failure of the input voice operation information meets the preset number of times condition; and detecting that the input time interval between the touch operation information and the voice operation information is smaller than a preset duration threshold value, and recognizing that the voice operation information contains a second preset keyword. The touch duration of the touch operation meeting the first time preset condition may be that the touch duration of the touch operation is greater than a preset duration threshold, for example, the touch duration is greater than 3 seconds, 5 seconds, 8 seconds, or the like; the number of times of touch operation meeting the preset condition may be that the number of times of touch operation is greater than a preset number of times threshold, for example, the number of times of touch is greater than 2 times, 3 times, and so on. It can be appreciated that, when the manner in which the user performs voice control on a certain operation object is not known, correct voice operation information may not be continuously input, thereby causing failure in continuously recognizing the input voice operation information by the vehicle. If the vehicle detects that the number of times of continuous recognition failure of the input voice operation information meets the preset number of times, for example, the number of times of continuous recognition failure of the voice operation information input by the user is larger than a preset number of times threshold, the vehicle can be considered to provide a help prompt for the user to operate the operated object. Here, when the vehicle detects that the input time interval between the touch operation information and the voice operation information is smaller than the preset time threshold and the voice operation information includes the second preset keyword, it is indicated that the user needs to control how to request help to a certain operation object, and at this time, a help prompt for operating the operation object needs to be provided for the user. It should be noted that, the second preset keyword may be a query word or a specific word, for example, it is recognized that the voice operation information includes words such as "what" or "what", or it is recognized that the voice operation information includes words such as "meaning", "use", "will not", "help", etc. Therefore, the operation information is detected through the set various different preset conditions to judge whether the first operation prompt related to the first operation object needs to be presented or not, the operation information is flexible and convenient, and the user experience is further improved.
Here, the operation prompt is used to prompt the user how to correctly operate the operation object, taking the first operation object as an air conditioner as an example, and the first operation prompt may be how to control the temperature, the air volume and the like of the air conditioner by voice. It should be noted that, after the vehicle machine presents the first operation prompt related to the first operation object, the vehicle machine may further display an effect prompt after the first operation object is operated, where the effect prompt is used to prompt the user about an effect corresponding to the first operation object after the corresponding operation is performed on the first operation object, for example, if the first operation object is a switch button of a certain function, when the operation information is how to open the function, the effect prompt may be what effects corresponding to the function after the function is opened, for example, what other functions may be closed.
In an embodiment, the presenting a first operation prompt related to the first operation object includes the following steps: identifying at least one functional keyword related to the first operation object in the voice operation information; searching a preset third database based on the at least one functional keyword, and acquiring and presenting a first operation prompt related to the first operation object; wherein the third database stores at least one functional keyword of a different first operation object and an associated first operation prompt. It should be noted that, when the vehicle machine only obtains the input voice operation information, that is, when the user controls the operation object through voice, the voice operation information may be first subjected to voice recognition to identify at least one functional keyword related to the first operation object in the voice operation information; then, the vehicle searches at least one functional keyword of different first operation objects stored in a third database and the associated first operation prompts, and acquires and presents the first operation prompts related to the first operation objects. For example, assuming that the voice operation information is "how the angle of the rearview mirror is adjusted", the vehicle recognizes that the first operation object is the rearview mirror based on the voice operation information, and at least one function keyword related to the first operation object includes "angle" and "adjustment", and then matches the corresponding first operation prompt in the third database to obtain "rotate the door inner knob leftwards or rightwards". Therefore, the function keywords related to the operation object are identified, and the operation prompt related to the operation object is acquired based on the function keywords, so that the operation is convenient and fast, and the accuracy is high.
It will be appreciated that the third database may be updated as needed, such as updating the function keywords and/or the first operation prompts associated with the first operation object, etc. In one embodiment, the third database may be updated based on the following steps: obtaining an update instruction for updating the third database, wherein the update instruction comprises an update configuration node and an update configuration file, the update configuration node is used for indicating one of a first operation object, a function keyword and a first operation prompt to be updated, and the update configuration file comprises at least one of the first operation object, the function keyword and the first operation prompt to be updated, which are associated with the update configuration node; and replacing or adding the update configuration file at an update configuration node based on the update instruction so as to replace or add at least one of the first operation object to be updated, the function keyword and the first operation prompt in the third database. For example, assuming that the third database only stores two functional keywords of lowering and raising the temperature of the air conditioner, and two keywords of hot air and cold air need to be updated to the third database currently, after the vehicle obtains an update instruction including an adding configuration node and an adding configuration file, the configuration node is two keywords of hot air and cold air, and the configuration file is a json file, by adding the configuration file on the configuration node, a voice prompt for automatically adding skills corresponding to the two keywords of cold air and hot air can be realized. Therefore, the operation object, the function keyword, the operation prompt and the like can be updated quickly and conveniently, and the user experience is further improved.
In an embodiment, the presenting the first operation prompt related to the first operation object includes at least one of the following manners:
determining a display position and/or a display area size of the first operation prompt based on an input adjustment instruction or a change of an operation interface so as to present the first operation prompt related to the first operation object;
determining a background transparency of the first operational prompt so as to present the first operational prompt with respect to the first operational object; and
the first operational prompt is presented at an electronic device with respect to the first operational object.
After presenting the first operation prompt related to the first operation object, the vehicle may display the first operation prompt related to the first operation object, and at this time, the user may manually input an adjustment instruction (for example, drag, stretch, shrink, etc.) to adjust a display position and/or a display area of the first operation prompt, so as to display the first operation prompt at the determined display position and/or display area of the first operation prompt. Of course, if the operation interface changes, the display position and/or the size of the display area of the first operation prompt may be changed correspondingly, for example, when the display position of the first operation prompt is always in the blank area of the operation interface, or when the area of the blank area of the changed current operation interface is smaller than the area of the blank area of the previous operation interface, the display area of the first operation prompt may be reduced correspondingly. In practical application, for different operation interfaces, the display position of the first operation prompt may be preset, and when the operation interfaces are switched, the first operation prompt is displayed at a corresponding preset position. For example, assuming that the current operation interface is a multimedia playing interface, the first operation prompt may be displayed at a lower left corner of the operation interface, and if the user switches the current operation interface from the multimedia playing interface to the main interface, the first operation prompt may be displayed at a lower right corner of the operation interface. In addition, when the operation interface is switched, the first operation prompt may be always displayed in a blank area of the operation interface. The blank area of the operation interface can be acquired by the following modes: firstly, performing screen capturing on an operation interface, then identifying which areas in the operation interface have characters through an optical character recognition technology, identifying which areas in the operation interface have pictures through an image recognition technology, and further determining the areas without the characters and the pictures in the operation interface as blank areas; the other mode is that based on a control tree corresponding to the operation interface, a control for displaying pictures and characters in the control tree and a display area of the control in the operation interface are obtained, then the control currently displaying the pictures and the characters is obtained from the control, and further the display area corresponding to the control not currently displaying the pictures and the characters in the operation interface is determined to be a blank area.
In addition, the background transparency of the first operation prompt can be set to be semitransparent or completely transparent, so as to reduce the shielding of the first operation prompt to the content displayed on the operation interface as much as possible. Alternatively, the vehicle may also transmit the first operation prompt related to the first operation object to an electronic device (such as, but not limited to, a mobile phone, a tablet computer, a smart speaker, etc.) so that the first operation prompt related to the first operation object is presented by the electronic device. In practical application, the first operation prompt related to the first operation object may be displayed in a blank area, a corner area or a preset area near the first operation object of the current operation interface. The blank area may refer to an area in which no object such as a text or an image is displayed in the current operation interface, and the corner area may refer to an upper left corner area, a lower left corner area, an upper right corner area, a lower right corner area, a bottom area, or a top area of the current operation interface or the touch screen. The preset area near the first operation object may be a left area, a right area, an upper area, a lower area, or the like of the first operation object, and the size of the preset area may be preset, or may be adaptively adjusted according to the first operation prompt. Therefore, the first operation prompt related to the first operation object is presented in different modes, so that the user can be effectively prompted, shielding of the operation interface can be avoided or reduced as much as possible, prompt information can be continuously displayed when the user turns pages, the operation interface is not shielded, other operations are conveniently performed by the user, and the user experience is further improved.
In an embodiment, the presenting a first operation prompt related to the first operation object includes at least one of the following modes:
displaying a document or text containing a first operation prompt related to the first operation object;
displaying a small video or page containing a first operation prompt related to the first operation object;
displaying a hung window containing a help key, wherein the help key is used for triggering and displaying a first operation prompt related to the first operation object; and
and broadcasting a voice containing a first operation prompt related to the first operation object.
Here, the document, text, window, small video, page, or the like may be displayed on the vehicle in full screen or half screen, for example, the page containing the first operation prompt related to the first operation object may be displayed on the vehicle in full screen, or the page containing the first operation prompt related to the first operation object may be displayed on the left half of the vehicle. The window may be directly displayed above the first operation object or at other positions, and other keys such as a close key and an update key may be further included in the window. In addition, the window may display the help prompt contained therein when triggered to minimize the shielding of the operation interface, for example, the window may display a circular button on the operation interface when not triggered, and display the help prompt contained therein after the user clicks the circular button. When the user clicks the help button, the vehicle machine displays a first operation prompt related to the first operation object. Meanwhile, the vehicle can broadcast the voice containing the first operation prompt about the first operation object through voice playing equipment such as a loudspeaker in the vehicle. Therefore, the first operation prompts related to the first operation object are presented in different modes, so that the user can be effectively prompted, and the user experience is further improved.
In an embodiment, the method may further comprise the step of: and displaying a second operation prompt related to the second operation object under the condition that the second operation object meeting the prompt condition exists in the current operation interface. Here, the prompting condition may include at least one of the second operation object not being activated, the second operation object not being used, and the second duration preset condition being satisfied. Wherein, the second operation object is not activated, which may mean that the second operation object is not used, such as not clicked, etc. The second operation object not being used reaching the second time length preset condition may mean that the second operation object not being used is longer than a preset time length threshold, for example, the second operation object not being used is longer than 10 days, 30 days, or the like. It can be understood that when the second operation object meeting the prompt condition exists in the current operation interface, the user is prompted to operate the second operation object by displaying a second operation prompt related to the second operation object, so that the user is familiar with different operation objects, knows the operation object which is not used, and can effectively improve the viscosity of the user. For example, if a virtual key is provided in the current operation interface, the function of the virtual key is to automatically adjust the brightness of the screen of the vehicle according to the brightness of the light in the vehicle, and if the virtual key is not activated by the user all the time, the intelligent voice assistant may prompt the user to use the automatic dimming function, such as "whether to try to use the automatic dimming function" or not.
In an embodiment, the method may further comprise the step of: and closing the first operation prompt related to the first operation object after detecting the preset closing prompt operation. Here, the detection of the preset closing prompt operation may be detection of ending of the touch operation, detection of a short press operation on the first operation prompt or the effect prompt, detection of clicking an area outside the first operation prompt or the effect prompt in the current operation interface, and the like. Therefore, after the preset closing prompt operation is detected, the first operation prompt related to the first operation object is closed in time, so that a user can conveniently execute other operations, and the user experience is further improved.
In an embodiment, the first operation prompt includes a prompt message about whether manual assistance is needed, and after the presenting of the first operation prompt related to the first operation object, the method further includes the following steps: in the event that manual assistance is determined to be needed, a transition is made to a manual service mode to obtain assistance. Here, after presenting the first operation prompt related to the first operation object, if the vehicle detects that the user selects to need manual assistance for the first operation prompt, the vehicle transitions to the manual service mode to acquire assistance. In addition, if the user does not select to need manual assistance for the first operation prompt, but the user still cannot correctly operate the first operation object, for example, the voice operation information input by the user fails, or complaints or gas generation and the like generated by the user are detected, at this time, the user can be directly judged to need manual assistance, so that assistance is provided for the user in time, and the user experience is improved.
In summary, in the prompting method provided in the foregoing embodiment, when it is determined that the user wishes to obtain the help prompt for the operation object according to the input operation information, the prompting message for operating the operation object is automatically presented, so that the user can quickly obtain the operation instruction for the operation object, the operation is simple and convenient, and the user experience is improved.
Based on the same inventive concept as the previous embodiments, the present embodiment describes the technical solution of the previous embodiments in detail through different application scenarios.
Scene one, presume that the user is using the music application of the car machine to play songs at present, if the user wants to switch songs at present and wants to switch songs by voice, the user can press the "next" key for a long time, a hanging window containing a help key is displayed above the "next" key, see fig. 2 in particular; when the user clicks the help button, the car machine will display a help page for quickly cutting songs in voice, such as directly speaking "next", "previous", etc., see fig. 3.
Scene two, presume that users use the music application of the car machine to broadcast songs at present, if users are clicking "next" after pressing the button at present, because feel the manual operation is troublesome, users input the pronunciation "how to switch over to next song" again at this moment, see figure 4 specifically; the car machine knows that the user has the requirement of rapidly switching songs according to the operation of clicking the next button on the music playing interface by the user and the voice, and can display a help page of how to rapidly switch songs by the voice at the moment, and particularly please refer to fig. 3 again.
Scene three, presume how to switch the visual angle when the user inputs voice to the car machine many times, "see fig. 5 in particular, but because the voice is not the control voice for switching the visual angle, the car machine may not be able to successfully recognize, but after the voice input by the user is continuously recognized twice or many times, the car machine may extract keywords" navigation "," switching "," visual angle "and the like in the voice input by the user, and further learn how the user may not know how to switch the visual angle by voice according to the keywords, at this time, the car machine may display a help page how to switch the visual angle by voice, see fig. 6 in particular.
In the fourth scenario, assuming that the user is currently playing a song by using the music application of the car player, and the car player detects that the cyclic playing key in the current music playing interface is not used all the time, a text window can be displayed below the cyclic playing key, and contents such as "clicking the key to realize cyclic playing of the current song" are displayed in the text window, see fig. 7 specifically.
A fifth scene is that a user can not use a certain button or a certain function on the vehicle, and at the moment, the user uses the mobile phone to sweep the button or the function, and the mobile phone displays a prompt function and a help video; or when a certain lamp on the vehicle is flashing, the vehicle scans one sweep, and the vehicle displays a prompt function and a help video. Here, the mobile phone is used for sweeping an operation object needing to obtain help, the help is displayed on the screen of the mobile phone in real time, and a user does not need to check help information on the mobile phone; further, after the operation object is scanned and identified, the identified operation object may be highlighted, then literally prompted, then audibly prompted, then more video prompted, helping to prompt the ability to go from simplified to complex rather than immediate video. Therefore, the help searching time of the user is reduced, searching is not needed, and the voice and the operation context are naturally changed according to the compliance with the human habit; the related help content is obtained faster and more accurately, so that the operation of a user becomes simple and easy to understand.
Scene six, if the user continuously inputs 3 times of voices to identify failure, the voice is possibly nonstandard or too much interference, the user does not know what reason, and the user should prompt "do not feel frightened a little at this time, we can contact with you later, and inform the operation failure reason"; the user repeats an operation a plurality of times, but does not start complaining and generating gas, and gives a help prompt after background recognition in time, namely, whether manual online help is needed or not for you.
The method comprises the steps that after a certain operation object has a new voice skill, a background server calls a teaching management module, a teaching prompt of the skill, namely, an operation prompt of the operation object is generated according to the new online skill, the prompt comprises information { tts broadcast words, whether the voice instruction is broadcast and simultaneously executed for demonstration to a user, a prompter on a screen to a meter, which scenes schedule the teaching instruction, and priority }, the priority of the newly generated information is higher, when the user logs in a vehicle machine system, the vehicle machine pulls up the latest teaching list from the background server, has the latest teaching content, namely, the information set above, and schedules the information under the condition of conforming to the scene, so that the dynamic configuration teaching instruction is realized, the dynamic configuration teaching instruction can be dynamically upgraded along with the upgrading of the background online voice skill library, and the user experience is greatly improved.
Based on the same inventive concept as the previous embodiments, an embodiment of the present invention provides a prompting device, as shown in fig. 8, including: a processor 110 and a memory 111 for storing a computer program capable of running on the processor 110; the number of the processors 110 illustrated in fig. 8 is not used to refer to one number of the processors 110, but is merely used to refer to a positional relationship of the processors 110 relative to other devices, and in practical applications, the number of the processors 110 may be one or more; likewise, the memory 111 illustrated in fig. 8 is also used in the same sense, that is, only to refer to the positional relationship of the memory 111 with respect to other devices, and in practical applications, the number of the memories 111 may be one or more.
Wherein the processor 110 is configured to execute the computer program by performing the steps of:
acquiring input operation information, wherein the operation information comprises at least one item of touch operation information, voice operation information and shot image information of a first operation object;
identifying the first operation object based on the operation information; and
and under the condition that the operation information meets the preset condition, presenting a first operation prompt related to the first operation object.
Therefore, when the input operation information is determined to meet the preset condition, the prompt message for operating the operation object is automatically presented, so that the user can quickly obtain the operation instruction for the operation object, the operation is simple and convenient, and the use experience of the user is improved.
In one embodiment, the processor 110 is configured to execute the computer program by performing the steps of:
intercepting a target image in the shot image information, matching the target image with a preset image in a first database to determine a preset image with highest matching degree, and determining a preset operation object associated with the preset image as the first operation object based on the preset image; wherein, the first database stores different preset operation objects and associated preset images; and
identifying a target keyword in the shot image information, matching the target keyword with a first preset keyword in a second database to determine a first preset keyword with highest matching degree, and determining a preset operation object associated with the first preset keyword as the first operation object based on the first preset keyword; the second database stores different preset operation objects and associated first preset keywords.
Thus, the first operation object is determined based on the image or the keyword in the shot image information, the operation is convenient, and the accuracy is high.
In one embodiment, the touch operation information includes a touch duration of the touch operation and/or a touch number of times of the touch operation.
In one embodiment, the preset conditions include at least one of the following conditions:
the touch duration of the touch operation meets a first duration preset condition;
the touch times of the touch operation meet the times preset conditions;
the number of times of continuous recognition failure of the input voice operation information meets the preset number of times condition; and
detecting that the input time interval between the touch operation information and the voice operation information is smaller than a preset duration threshold value, and recognizing that the voice operation information contains a second preset keyword.
Therefore, the operation information is detected through the set various different preset conditions to judge whether the first operation prompt related to the first operation object needs to be presented or not, the operation information is flexible and convenient, and the user experience is further improved.
In one embodiment, the processor 110 is configured to execute the computer program by performing the steps of:
Identifying at least one functional keyword related to the first operation object in the voice operation information; and
retrieving a preset third database based on the at least one functional keyword, and acquiring and presenting a first operation prompt related to the first operation object; wherein the third database stores at least one functional keyword of a different first operation object and an associated first operation prompt.
Therefore, the function keywords related to the operation object are identified, and the operation prompt related to the operation object is acquired based on the function keywords, so that the operation is convenient and fast, and the accuracy is high.
In one embodiment, the processor 110 is configured to execute the computer program by performing the steps of:
obtaining an update instruction for updating the third database, wherein the update instruction comprises an update configuration node and an update configuration file, the update configuration node is used for indicating one of a first operation object, a function keyword and a first operation prompt to be updated, and the update configuration file comprises at least one of the first operation object, the function keyword and the first operation prompt to be updated, which are associated with the update configuration node;
And replacing or adding the update configuration file at an update configuration node based on the update instruction so as to replace or add at least one of the first operation object to be updated, the function keyword and the first operation prompt in the third database.
Therefore, the operation object, the function keyword, the operation prompt and the like can be updated quickly and conveniently, and the user experience is further improved.
In one embodiment, the processor 110 is configured to execute the computer program by performing the steps of:
determining a display position and/or a display area size of the first operation prompt based on an input adjustment instruction or a change of an operation interface so as to present the first operation prompt related to the first operation object;
determining a background transparency of the first operational prompt so as to present the first operational prompt with respect to the first operational object; and
the first operational prompt is presented at an electronic device with respect to the first operational object.
Therefore, the first operation prompt related to the first operation object is presented in different modes, so that the user can be effectively prompted, shielding of an operation interface can be avoided or reduced as much as possible, other operations can be conveniently performed by the user, and the use experience of the user is further improved.
In one embodiment, the processor 110 is configured to execute the computer program by performing the steps of:
displaying a document or text containing a first operation prompt related to the first operation object;
displaying a small video or page containing a first operation prompt related to the first operation object;
displaying a hung window containing a help key, wherein the help key is used for triggering and displaying a first operation prompt related to the first operation object; and
and broadcasting a voice containing a first operation prompt related to the first operation object.
Therefore, the first operation prompts related to the first operation object are presented in different modes, so that the user can be effectively prompted, and the user experience is further improved.
In one embodiment, the processor 110 is configured to execute the computer program by performing the steps of: and displaying a second operation prompt related to the second operation object under the condition that the second operation object meeting the prompt condition exists in the current operation interface.
Therefore, the viscosity of the user can be effectively improved.
In one embodiment, the prompting condition includes at least one of the second operation object not being activated, the second operation object not being used being longer than a second duration preset condition.
In one embodiment, the processor 110 is configured to execute the computer program by performing the steps of: and closing the first operation prompt related to the first operation object under the condition that the preset closing prompt operation is detected.
Therefore, after the preset closing prompt operation is detected, the first operation prompt related to the first operation object is closed in time, so that a user can conveniently execute other operations, and the user experience is further improved.
In one embodiment, the first operation prompt includes a prompt message indicating whether manual assistance is required, and the processor 110 is configured to execute the following steps when executing the computer program: in the event that manual assistance is determined to be needed, a transition is made to a manual service mode to obtain assistance.
Therefore, help can be provided for the user in time, and the user experience is improved.
The prompting device may further include: at least one network interface 112. The various components of the prompting device are coupled together by a bus system 113. It is understood that the bus system 113 is used to enable connected communications between these components. The bus system 113 includes a power bus, a control bus, and a status signal bus in addition to the data bus. But for clarity of illustration the various buses are labeled in fig. 8 as bus system 113.
The memory 111 may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. Wherein the nonvolatile Memory may be Read Only Memory (ROM), programmable Read Only Memory (PROM, programmable Read-Only Memory), erasable programmable Read Only Memory (EPROM, erasable Programmable Read-Only Memory), electrically erasable programmable Read Only Memory (EEPROM, electrically Erasable Programmable Read-Only Memory), magnetic random access Memory (FRAM, ferromagnetic random access Memory), flash Memory (Flash Memory), magnetic surface Memory, optical disk, or compact disk Read Only Memory (CD-ROM, compact Disc Read-Only Memory); the magnetic surface memory may be a disk memory or a tape memory. The volatile memory may be random access memory (RAM, random Access Memory), which acts as external cache memory. By way of example, and not limitation, many forms of RAM are available, such as static random access memory (SRAM, static Random Access Memory), synchronous static random access memory (SSRAM, synchronous Static Random Access Memory), dynamic random access memory (DRAM, dynamic Random Access Memory), synchronous dynamic random access memory (SDRAM, synchronous Dynamic Random Access Memory), double data rate synchronous dynamic random access memory (ddr SDRAM, double Data Rate Synchronous Dynamic Random Access Memory), enhanced synchronous dynamic random access memory (ESDRAM, enhanced Synchronous Dynamic Random Access Memory), synchronous link dynamic random access memory (SLDRAM, syncLink Dynamic Random Access Memory), direct memory bus random access memory (DRRAM, direct Rambus Random Access Memory). The memory 111 described in embodiments of the present invention is intended to comprise, without being limited to, these and any other suitable types of memory.
The memory 111 in the embodiment of the present invention is used to store various types of data to support the operation of the reminder device. Examples of such data include: any computer program for operating on the prompting device, such as an operating system and application programs; contact data; telephone book data; a message; a picture; video, etc. The operating system includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, for implementing various basic services and processing hardware-based tasks. The application programs may include various application programs such as a Media Player (Media Player), a Browser (Browser), etc. for implementing various application services. Here, a program for implementing the method of the embodiment of the present invention may be included in an application program.
Based on the same inventive concept as the previous embodiments, the present embodiment further provides a computer storage medium in which a computer program is stored, where the computer storage medium may be a Memory such as a magnetic random access Memory (FRAM, ferromagnetic random access Memory), a Read Only Memory (ROM), a programmable Read Only Memory (PROM, programmable Read-Only Memory), an erasable programmable Read Only Memory (EPROM, erasable Programmable Read-Only Memory), an electrically erasable programmable Read Only Memory (EEPROM, electrically Erasable Programmable Read-Only Memory), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a compact disk Read Only Memory (CD-ROM, compact Disc Read-Only Memory); but may be a variety of devices including one or any combination of the above-described memories, such as a mobile phone, computer, tablet device, personal digital assistant, or the like.
Wherein the computer program, when executed by the processor, performs the steps of:
acquiring input operation information, wherein the operation information comprises at least one item of touch operation information, voice operation information and shot image information of a first operation object;
identifying the first operation object based on the operation information; and
and under the condition that the operation information meets the preset condition, presenting a first operation prompt related to the first operation object.
Therefore, when the input operation information is determined to meet the preset condition, the prompt message for operating the operation object is automatically presented, so that the user can quickly obtain the operation instruction for the operation object, the operation is simple and convenient, and the use experience of the user is improved.
In one embodiment, the computer program, when executed by a processor, performs the steps of:
intercepting a target image in the shot image information, matching the target image with a preset image in a first database to determine a preset image with highest matching degree, and determining a preset operation object associated with the preset image as the first operation object based on the preset image; wherein, the first database stores different preset operation objects and associated preset images; and
Identifying a target keyword in the shot image information, matching the target keyword with a first preset keyword in a second database to determine a first preset keyword with highest matching degree, and determining a preset operation object associated with the first preset keyword as the first operation object based on the first preset keyword; the second database stores different preset operation objects and associated first preset keywords.
Thus, the first operation object is determined based on the image or the keyword in the shot image information, the operation is convenient, and the accuracy is high.
In one embodiment, the touch operation information includes a touch duration of the touch operation and/or a touch number of times of the touch operation.
In one embodiment, the preset conditions include at least one of the following conditions:
the touch duration of the touch operation meets a first duration preset condition;
the touch times of the touch operation meet the times preset conditions;
the number of times of continuous recognition failure of the input voice operation information meets the preset number of times condition; and
detecting that the input time interval between the touch operation information and the voice operation information is smaller than a preset duration threshold value, and recognizing that the voice operation information contains a second preset keyword.
Therefore, the operation information is detected through the set various different preset conditions to judge whether the first operation prompt related to the first operation object needs to be presented or not, the operation information is flexible and convenient, and the user experience is further improved.
In one embodiment, the computer program, when executed by a processor, performs the steps of:
identifying at least one functional keyword related to the first operation object in the voice operation information; and
retrieving a preset third database based on the at least one functional keyword, and acquiring and presenting a first operation prompt related to the first operation object; wherein the third database stores at least one functional keyword of a different first operation object and an associated first operation prompt.
Therefore, the function keywords related to the operation object are identified, and the operation prompt related to the operation object is acquired based on the function keywords, so that the operation is convenient and fast, and the accuracy is high.
In one embodiment, the computer program, when executed by a processor, performs the steps of:
obtaining an update instruction for updating the third database, wherein the update instruction comprises an update configuration node and an update configuration file, the update configuration node is used for indicating one of a first operation object, a function keyword and a first operation prompt to be updated, and the update configuration file comprises at least one of the first operation object, the function keyword and the first operation prompt to be updated, which are associated with the update configuration node;
And replacing or adding the update configuration file at an update configuration node based on the update instruction so as to replace or add at least one of the first operation object to be updated, the function keyword and the first operation prompt in the third database.
Therefore, the operation object, the function keyword, the operation prompt and the like can be updated quickly and conveniently, and the user experience is further improved.
In one embodiment, the computer program, when executed by a processor, performs the steps of:
determining a display position and/or a display area size of the first operation prompt based on an input adjustment instruction or a change of an operation interface so as to present the first operation prompt related to the first operation object;
determining a background transparency of the first operational prompt so as to present the first operational prompt with respect to the first operational object; and
the first operational prompt is presented at an electronic device with respect to the first operational object.
Therefore, the first operation prompt related to the first operation object is presented in different modes, so that the user can be effectively prompted, shielding of an operation interface can be avoided or reduced as much as possible, other operations can be conveniently performed by the user, and the use experience of the user is further improved.
In one embodiment, the computer program, when executed by a processor, performs the steps of:
displaying a document or text containing a first operation prompt related to the first operation object;
displaying a small video or page containing a first operation prompt related to the first operation object;
displaying a hung window containing a help key, wherein the help key is used for triggering and displaying a first operation prompt related to the first operation object; and
and broadcasting a voice containing a first operation prompt related to the first operation object.
Therefore, the first operation prompts related to the first operation object are presented in different modes, so that the user can be effectively prompted, and the user experience is further improved.
In one embodiment, the computer program, when executed by a processor, performs the steps of: and displaying a second operation prompt related to the second operation object under the condition that the second operation object meeting the prompt condition exists in the current operation interface.
Therefore, the viscosity of the user can be effectively improved.
In one embodiment, the prompting condition includes at least one of the second operation object not being activated, the second operation object not being used being longer than a second duration preset condition.
In one embodiment, the computer program, when executed by a processor, performs the steps of: and closing the first operation prompt related to the first operation object under the condition that the preset closing prompt operation is detected.
Therefore, after the preset closing prompt operation is detected, the first operation prompt related to the first operation object is closed in time, so that a user can conveniently execute other operations, and the user experience is further improved.
In an embodiment, the first operation prompt comprises a prompt message whether manual assistance is required, and the computer program, when executed by the processor, performs the steps of: in the event that manual assistance is determined to be needed, a transition is made to a manual service mode to obtain assistance.
Therefore, help can be provided for the user in time, and the user experience is improved.
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
In this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a list of elements is included, and may include other elements not expressly listed.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (13)

1. A method of prompting, the method comprising the steps of:
acquiring input operation information, wherein the operation information comprises at least one item of touch operation information, voice operation information and shot image information of a first operation object;
identifying the first operation object based on the operation information; and
presenting a first operation prompt related to the first operation object under the condition that the operation information meets a preset condition;
wherein the identifying the first operation object based on the operation information includes at least one of:
intercepting a target image in the shot image information, matching the target image with a preset image in a first database to determine a preset image with highest matching degree, and determining a preset operation object associated with the preset image as the first operation object based on the preset image; wherein, the first database stores different preset operation objects and associated preset images; and
Identifying a target keyword in the shot image information, matching the target keyword with a first preset keyword in a second database to determine a first preset keyword with highest matching degree, and determining a preset operation object associated with the first preset keyword as the first operation object based on the first preset keyword; the second database stores different preset operation objects and associated first preset keywords.
2. The method of claim 1, wherein the touch operation information includes a touch duration of a touch operation and/or a touch number of touch operations.
3. The method of any one of claims 1 to 2, the preset conditions comprising at least one of the following conditions:
the touch duration of the touch operation meets a first duration preset condition;
the touch times of the touch operation meet the times preset conditions;
the number of times of continuous recognition failure of the input voice operation information meets the preset number of times condition; and
detecting that the input time interval between the touch operation information and the voice operation information is smaller than a preset duration threshold value, and recognizing that the voice operation information contains a second preset keyword.
4. The method of claim 1, said presenting a first operation prompt regarding said first operation object, comprising the steps of:
identifying at least one functional keyword related to the first operation object in the voice operation information; and
retrieving a preset third database based on the at least one functional keyword, and acquiring and presenting a first operation prompt related to the first operation object; wherein the third database stores at least one functional keyword of a different first operation object and an associated first operation prompt.
5. The method of claim 4, the third database being updated based on:
obtaining an update instruction for updating the third database, wherein the update instruction comprises an update configuration node and an update configuration file, the update configuration node is used for indicating one of a first operation object, a function keyword and a first operation prompt to be updated, and the update configuration file comprises at least one of the first operation object, the function keyword and the first operation prompt to be updated, which are associated with the update configuration node;
and replacing or adding the update configuration file at an update configuration node based on the update instruction so as to replace or add at least one of the first operation object to be updated, the function keyword and the first operation prompt in the third database.
6. The method of claim 1, the presenting a first operational prompt regarding the first operational object comprising at least one of:
determining a display position and/or a display area size of the first operation prompt based on an input adjustment instruction or a change of an operation interface so as to present the first operation prompt related to the first operation object;
determining a background transparency of the first operational prompt so as to present the first operational prompt with respect to the first operational object; and
the first operational prompt is presented at an electronic device with respect to the first operational object.
7. The method of claim 1, the presenting a first operational prompt regarding the first operational object comprising at least one of:
displaying a document or text containing a first operation prompt related to the first operation object;
displaying a small video or page containing a first operation prompt related to the first operation object;
displaying a hung window containing a help key, wherein the help key is used for triggering and displaying a first operation prompt related to the first operation object; and
And broadcasting a voice containing a first operation prompt related to the first operation object.
8. The method of claim 1, further comprising the step of:
and displaying a second operation prompt related to the second operation object under the condition that the second operation object meeting the prompt condition exists in the current operation interface.
9. The method of claim 8, the hint condition comprising at least one of the second operand not being activated, the second operand not being used for a second duration preset condition.
10. The method of claim 1, further comprising the step of:
and closing the first operation prompt related to the first operation object under the condition that the preset closing prompt operation is detected.
11. The method of claim 1, wherein the first operation prompt includes a prompt message indicating whether manual assistance is required, and further comprising, after presenting the first operation prompt regarding the first operation object, the steps of:
in the event that manual assistance is determined to be needed, a transition is made to a manual service mode to obtain assistance.
12. A reminder device, comprising: a memory configured to store one or more computer programs; and a processor coupled to the memory and configured to execute the one or more computer programs to cause the electronic device to perform the steps of the method of any of claims 1-11.
13. A computer storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the prompting method according to any one of claims 1 to 11.
CN202110117883.4A 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium Active CN114690992B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310756068.1A CN116680033A (en) 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011637673X 2020-12-31
CN202011637673 2020-12-31

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202310756068.1A Division CN116680033A (en) 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium

Publications (2)

Publication Number Publication Date
CN114690992A CN114690992A (en) 2022-07-01
CN114690992B true CN114690992B (en) 2023-06-27

Family

ID=82135578

Family Applications (4)

Application Number Title Priority Date Filing Date
CN202310756068.1A Pending CN116680033A (en) 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium
CN202110117883.4A Active CN114690992B (en) 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium
CN202110123503.8A Active CN114691261B (en) 2020-12-31 2021-01-28 Prompting method, prompting device, electronic equipment and computer storage medium
CN202110296429.XA Active CN114764363B (en) 2020-12-31 2021-03-19 Prompting method, prompting device and computer storage medium

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202310756068.1A Pending CN116680033A (en) 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium

Family Applications After (2)

Application Number Title Priority Date Filing Date
CN202110123503.8A Active CN114691261B (en) 2020-12-31 2021-01-28 Prompting method, prompting device, electronic equipment and computer storage medium
CN202110296429.XA Active CN114764363B (en) 2020-12-31 2021-03-19 Prompting method, prompting device and computer storage medium

Country Status (1)

Country Link
CN (4) CN116680033A (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116185190B (en) * 2023-02-09 2024-05-10 江苏泽景汽车电子股份有限公司 Information display control method and device and electronic equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019020008A1 (en) * 2017-07-26 2019-01-31 维沃移动通信有限公司 Missed call prompt method, and mobile terminal
CN112017646A (en) * 2020-08-21 2020-12-01 博泰车联网(南京)有限公司 Voice processing method and device and computer storage medium

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101159703A (en) * 2007-10-09 2008-04-09 施侃晟 Bidirectional interdynamic search method for generating instant communication effect
TWI438675B (en) * 2010-04-30 2014-05-21 Ibm Method, device and computer program product for providing a context-aware help content
CN106020597A (en) * 2016-05-12 2016-10-12 北京金山安全软件有限公司 Method and device for displaying information and electronic equipment
CN108037885A (en) * 2017-11-27 2018-05-15 维沃移动通信有限公司 A kind of operation indicating method and mobile terminal
CN110544473B (en) * 2018-05-28 2022-11-08 百度在线网络技术（北京）有限公司 Voice interaction method and device
CN109656512A (en) * 2018-12-20 2019-04-19 Oppo广东移动通信有限公司 Exchange method, device, storage medium and terminal based on voice assistant
CN110072140B (en) * 2019-03-22 2021-05-28 厦门理工学院 Video information prompting method, device, equipment and storage medium
CN111506245A (en) * 2020-04-27 2020-08-07 北京小米松果电子有限公司 Terminal control method and device
CN111664861B (en) * 2020-06-02 2023-02-28 阿波罗智联(北京)科技有限公司 Navigation prompting method, device, equipment and readable storage medium
CN111580724B (en) * 2020-06-28 2021-12-10 腾讯科技（深圳）有限公司 Information interaction method, equipment and storage medium
CN112148408A (en) * 2020-09-27 2020-12-29 深圳壹账通智能科技有限公司 Barrier-free mode implementation method and device based on image processing and storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019020008A1 (en) * 2017-07-26 2019-01-31 维沃移动通信有限公司 Missed call prompt method, and mobile terminal
CN112017646A (en) * 2020-08-21 2020-12-01 博泰车联网(南京)有限公司 Voice processing method and device and computer storage medium

Also Published As

Publication number Publication date
CN114764363B (en) 2023-11-24
CN116680033A (en) 2023-09-01
CN114691261A (en) 2022-07-01
CN114764363A (en) 2022-07-19
CN114691261B (en) 2024-07-05
CN114690992A (en) 2022-07-01

Similar Documents

Publication Publication Date Title
US10825456B2 (en) Method and apparatus for performing preset operation mode using voice recognition
JP7065740B2 (en) Application function information display method, device, and terminal device
US9129011B2 (en) Mobile terminal and control method thereof
KR20140045060A (en) Mobile terminal and method for controlling thereof
KR20140089751A (en) Method for intelligent searching service using circumstance recognition and the terminal thereof
CN106202223A (en) Content collection method, device and for collecting the device of content in application program
CN108829686A (en) Translation information display methods, device, equipment and storage medium
CN109657236A (en) Guidance information acquisition methods, device, electronic device and storage medium
CN104461348A (en) Method and device for selecting information
CN111813301B (en) Content playing method and device, electronic equipment and readable storage medium
CN108763104A (en) The method, apparatus and storage medium of pre-read file page
CN112102841A (en) Audio editing method and device for audio editing
RU2734780C1 (en) Method of presenting information, device and storage medium for information therefor
CN114690992B (en) Prompting method, prompting device and computer storage medium
CN104063424B (en) Web page picture shows method and demonstration device
US20220208156A1 (en) Method for generating song melody and electronic device
CN106919642A (en) A kind of cross-language search method and apparatus, a kind of device for cross-language search
CN109977390A (en) A kind of method and device generating text
CN111814492A (en) Translation method, terminal and computer storage medium
CN108628461A (en) A kind of input method and device, a kind of method and apparatus of update dictionary
CN103927334B (en) Webpage acquisition methods and device
WO2016077681A1 (en) System and method for voice and icon tagging
CN104660819B (en) Mobile device and the method for accessing file in mobile device
CN112380871A (en) Semantic recognition method, apparatus, and medium
CN108614831A (en) Semantic primitive display methods and device, the device shown for semantic primitive

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant