CN115988131A - Prompting method and device and electronic equipment - Google Patents

Prompting method and device and electronic equipment Download PDF

Info

Publication number
CN115988131A
CN115988131A CN202211701999.3A CN202211701999A CN115988131A CN 115988131 A CN115988131 A CN 115988131A CN 202211701999 A CN202211701999 A CN 202211701999A CN 115988131 A CN115988131 A CN 115988131A
Authority
CN
China
Prior art keywords
information
audio
audio signal
audio information
prompt
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211701999.3A
Other languages
Chinese (zh)
Inventor
邓清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN202211701999.3A priority Critical patent/CN115988131A/en
Publication of CN115988131A publication Critical patent/CN115988131A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a prompting method, a prompting device and electronic equipment, and belongs to the technical field of audio. The method comprises the following steps: acquiring first audio information, wherein the first audio information comprises audio information of a first audio signal, and the first audio signal is an audio signal in a collected environment; and under the condition that the first sound effect information corresponding to the first audio information is matched with the target sound effect information, displaying first prompt information corresponding to the first audio information, wherein the first prompt information is used for prompting that a first audio signal exists in the environment.

Description

Prompting method and device and electronic equipment
Technical Field
The application belongs to the technical field of audio, and particularly relates to a prompting method, a prompting device and electronic equipment.
Background
At present, how to more conveniently acquire sound information in an environment is a group with hearing disabilities or a group who cannot directly acquire sound information from the environment, such as a group using an earphone to listen to songs or make a call, and the like, and key elements of quality life are acquired in digital generation.
However, in the related art, the electronic device for assisting hearing-impaired people or people who cannot directly obtain sound information from the environment can only perform alarm prompting in a vibration mode when the current environment is a dangerous scene, and therefore, the prompting mode is single.
Disclosure of Invention
The embodiment of the application aims to provide a prompting method, a prompting device and electronic equipment, which can remind a user in a richer prompting mode.
In a first aspect, an embodiment of the present application provides a prompting method, where the method includes: acquiring first audio information, wherein the first audio information comprises audio information of a first audio signal, and the first audio signal is an audio signal in a collected environment; and under the condition that the first sound effect information corresponding to the first audio information is matched with the target sound effect information, displaying first prompt information corresponding to the first audio information, wherein the first prompt information is used for prompting that the first audio signal exists in the environment.
In a second aspect, an embodiment of the present application provides an audio information display apparatus, including: the device comprises an acquisition module and a display module; the acquisition module is used for acquiring first audio information, wherein the first audio information comprises audio information of a first audio signal, and the first audio signal is an acquired audio signal in the environment; the display module is used for displaying first prompt information corresponding to the first audio information under the condition that the first audio information corresponding to the first audio information acquired by the acquisition module is matched with the target audio information, and the first prompt information is used for prompting that a first audio signal exists in the environment.
In a third aspect, embodiments of the present application provide an electronic device, which includes a processor and a memory, where the memory stores a program or instructions executable on the processor, and the program or instructions, when executed by the processor, implement the steps of the method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor, implement the steps of the method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.
In a sixth aspect, embodiments of the present application provide a computer program product, stored on a storage medium, for execution by at least one processor to implement the method according to the first aspect.
In the embodiment of the application, the electronic equipment acquires first audio information, wherein the first audio information comprises audio information of a first audio signal, and the first audio signal is an acquired audio signal in an environment; and under the condition that the first sound effect information corresponding to the first audio information is matched with the target sound effect information, displaying first prompt information corresponding to the first audio information, wherein the first prompt information is used for prompting that the first audio signal exists in the environment. Because the electronic equipment can advance the prompt message corresponding to the sound effect information corresponding to various audio signals, no matter what environment the user is in, the audio signals in the environment can be collected, the sound effect information corresponding to the audio information of the audio signals is matched with the target sound effect information, the first prompt message corresponding to the first audio information is displayed, and therefore the user can be prompted about what sound exists in the current environment. Therefore, the voice prompt can be performed on the user in a richer prompt mode in more scenes.
Drawings
Fig. 1 is a schematic diagram of a prompting method provided in an embodiment of the present application;
fig. 2 is one of schematic diagrams of an example of an interface of a mobile phone according to an embodiment of the present disclosure;
fig. 3 is a second schematic diagram of an example of an interface of a mobile phone according to an embodiment of the present disclosure;
fig. 4 is a third schematic diagram of an example of an interface of a mobile phone according to an embodiment of the present disclosure;
fig. 5 is a fourth schematic diagram of an example of an interface of a mobile phone according to an embodiment of the present application;
fig. 6 (a) is a fifth schematic view of an example interface of a mobile phone according to an embodiment of the present application;
fig. 6 (b) is a sixth schematic view of an example interface of a mobile phone according to an embodiment of the present application;
fig. 7 (a) is a seventh schematic diagram of an example of an interface of a mobile phone according to an embodiment of the present application;
fig. 7 (b) is an eighth schematic diagram of an example of an interface of a mobile phone according to an embodiment of the present application;
fig. 8 (a) is a ninth schematic diagram of an example of an interface of a mobile phone according to an embodiment of the present application;
fig. 8 (b) is a tenth schematic diagram of an example of an interface of a mobile phone according to an embodiment of the present application;
fig. 9 is an eleventh schematic diagram of an example of an interface of a mobile phone according to an embodiment of the present application;
fig. 10 is a twelfth schematic diagram of an example of an interface of a mobile phone according to an embodiment of the present application;
fig. 11 is a thirteen schematic diagrams of an example of an interface of a mobile phone according to an embodiment of the present disclosure;
fig. 12 is a fourteenth schematic diagram of an example of an interface of a mobile phone according to an embodiment of the present application;
fig. 13 is a flowchart of a prompting method provided in an embodiment of the present application;
fig. 14 is a schematic structural diagram of an audio information display device according to an embodiment of the present application;
fig. 15 is a schematic hardware structure diagram of an electronic device according to an embodiment of the present application;
fig. 16 is a second hardware structure schematic diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived from the embodiments in the present application by a person skilled in the art, are within the scope of protection of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/", and generally means that the former and latter related objects are in an "or" relationship.
At present, the hearing-impaired population has 2780 thousands in China, but the acquisition of sound information is always a difficult problem in life. Therefore, how to obtain sound information without hindrance is a key element for hearing-impaired people to obtain quality life in the digital era.
With the promulgation of mobile communication terminal barrier-free technical requirements, WCAG3.0 and the like, a solution is urgently needed for the digital gap problem of the hearing-impaired population. Therefore, under such a background, it is highly desirable to construct an effective and systematic detection and feedback scheme on an electronic device to help the hearing impaired people to smoothly acquire sound information in various scenes.
However, the existing products for helping hearing-impaired people to acquire sound information in the market are too single in view and the details transmitted by the sound content are not rich enough. Most products consider the scene of obstacle avoidance and conversation, but only provide detection of known sound types in the scene of obstacle avoidance, but cannot enable users to acquire the direction and the variation trend of a detected sound source, cannot accurately judge actions to be taken next, and simultaneously lacks reminding or self-defined complement for unknown sound types, so that equipment cannot perform customized and diversified identification according to the environment and habits of the users, and the users have the risk of losing information reminding in a specific scene.
In order to solve the above problem, an embodiment of the present application provides a prompting method, where audio signals existing in a surrounding environment are collected and audio information of the audio signals is matched with preset sound effect information, so that prompting information corresponding to the audio signals can be displayed, that is, what kind of sound the audio signals existing in a current environment are prompted to a user, so that the user can make better judgment and action according to the prompting information, and even for a hearing-impaired group who cannot hear the audio signals, sound information in different scenes can be obtained.
The following describes in detail the audio information display provided by the embodiments of the present application through specific embodiments and application scenarios thereof with reference to the accompanying drawings.
An embodiment of the present application provides a prompting method, and fig. 1 shows a flowchart of the prompting method provided in the embodiment of the present application, where the method can be applied to an electronic device. As shown in fig. 1, the prompting method provided in the embodiment of the present application may include steps 201 and 202 described below.
Step 201, the electronic device acquires first audio information.
In an embodiment of the present application, the first audio information includes audio information of a first audio signal, and the first audio signal is an audio signal in a captured environment.
Optionally, in this embodiment of the application, if a user needs to acquire what kind of sound exists in the surrounding environment, an audio signal, for example, a first audio signal, in the surrounding environment may be acquired through the electronic device, and the first audio signal is analyzed, and then the first audio information is acquired, so that the first sound effect information in the first audio information may be acquired.
Optionally, in this embodiment, the electronic device may obtain the first audio information after the decibel value of the first audio signal exceeds the preset decibel value.
Step 202, under the condition that the first sound effect information corresponding to the first audio information is matched with the target sound effect information, the electronic equipment displays first prompt information corresponding to the first audio information.
In the embodiment of the application, the first prompt message is used for prompting the existence of the first audio signal in the environment.
Optionally, in this embodiment of the application, the first sound effect information is used to indicate what kind of sound the first audio signal is; for example: what content sounds or what type of sound.
Optionally, in this embodiment of the present application, the electronic device may match the first sound effect information with the target sound effect information, and display first prompt information corresponding to the first audio information when the matching is successful.
Optionally, in this embodiment of the application, the electronic device may match the first sound effect information with preset sound effect information in a local preset sound effect library, for example: the first sound information is matched with first preset sound information in a local preset sound library, and under the condition that the first sound information is matched with the first preset sound information, namely, the first preset sound information with the similarity larger than a preset threshold value with the first sound information exists in the local preset sound library, so that the electronic equipment can display first prompt information corresponding to the first preset sound information.
Exemplarily, the electronic device may match a tone of the first sound effect information with a tone of first preset sound effect information, and if a similarity between the tone of the first sound effect information and the tone of the first preset sound effect information is greater than a preset threshold, display first prompt information corresponding to the first preset sound effect information; or, matching the vibration amplitude of the first sound effect information with the vibration amplitude of the first preset sound effect information, and if the similarity between the vibration amplitude of the first sound effect information and the vibration amplitude of the first preset sound effect information is greater than a preset threshold value, displaying first prompt information corresponding to the first preset sound effect information.
Optionally, in this embodiment of the application, when a user needs to acquire sound information in a surrounding environment, the user may collect, through the sound visualization dashboard, audio signals in an environment around the user or around the electronic device, and analyze, identify, or judge the collected audio signals in the environment, by opening the sound visualization dashboard, so that first audio information of the first audio signal may be displayed on the sound visualization dashboard. After the sound visualization instrument panel is started, the sound visualization instrument panel can be displayed on the desktop of the electronic equipment in a default suspension window mode, after the fact that the decibel value of the received first audio signal exceeds the preset decibel value is detected, the sound visualization instrument panel can be automatically unfolded to be the instrument panel of detailed sound information, and under the condition that a user does not need to use the sound visualization instrument panel, the sound visualization instrument panel can be folded to be in a suspension state by clicking the unfolding or clicking the blank area.
For example, as shown in fig. 2, in the case that the electronic device acquires the first sound effect information and the first sound effect information matches the target sound effect information, the electronic device may display an interface 10 of the sound visualization instrument panel on the desktop, and display first prompt information corresponding to the target sound effect information in the interface 10, for example, display: is on fire!
The embodiment of the application provides a prompting method, wherein electronic equipment acquires first audio information, the first audio information comprises audio information of a first audio signal, and the first audio signal is an audio signal in a collected environment; and under the condition that the first sound effect information corresponding to the first audio information is matched with the target sound effect information, displaying first prompt information corresponding to the first audio information, wherein the first prompt information is used for prompting that the first audio signal exists in the environment. Because the electronic equipment can advance the prompt message corresponding to the sound effect information corresponding to various audio signals, no matter what environment the user is in, the audio signals in the environment can be collected, the sound effect information corresponding to the audio information of the audio signals is matched with the target sound effect information, the first prompt message corresponding to the first audio information is displayed, and therefore the user can be prompted about what sound exists in the current environment. Therefore, the voice prompt can be performed on the user in a richer prompt mode in more scenes.
Alternatively, in this embodiment of the application, "displaying the first prompt information corresponding to the first audio information" in step 202 may be specifically implemented in step 202a described below.
Step 202a, the electronic device displays first prompt information corresponding to the first audio information at a first position of a display interface of the electronic device according to the azimuth information corresponding to the first audio information.
In the embodiment of the application, the first position is a mapping position of the position information on the display interface.
Wherein the bearing information is used to indicate a bearing of the first audio signal relative to the electronic device.
Optionally, in this embodiment of the application, the first prompt information includes at least one of the following: sound wave change images of the audio signals, preset text information and preset identification images.
Optionally, in this embodiment of the application, the first prompt information specifically includes a sound wave variation image of the first audio signal; the first audio information further includes decibel information; wherein, the peak value of the wave of the sound wave change image changes along with the change of the decibel information.
Illustratively, as shown in fig. 3, the electronic device may acquire and resolve the orientation of the first audio signal relative to the electronic device based on the detection of the gyroscope.
For example, as shown in fig. 4, if the first audio signal comes from a direction parallel to the electronic device and not more than 45 degrees horizontally from the electronic device, the electronic device may display a first prompt message at the edge of the interface 10 according to the orientation information, for example: displaying a sound wave variation image of a current audio signal; further, the electronic device may represent the decibel value of the first audio signal by the peak value of the sound wave variation image, and the farther the fixed point of the peak value is from the position of the arc edge of the sound visualization instrument panel (i.e., the higher the peak height), the larger the decibel value representing the first audio signal is, i.e., the larger the volume of the first audio signal is.
For example, as shown in fig. 5, if the first audio signal is from a direction perpendicular to the electronic device and not more than 45 degrees perpendicular to the electronic device, the electronic device may display the direction information on the interface 10
Displays first prompt information, for example: displaying a sound wave change image of the current audio signal, and meanwhile, the electronic equipment can express a decibel value of the first audio signal through the distance between the dynamic circular diffusion edge and the center; further, the electronic device may indicate that the orientation information of the first audio signal is by displaying a non-circumferential ring outside the dynamic circle: perpendicular to the angle range of the front screen of the electronic device, the electronic device may display the existence of the outer circumference ring outside the dynamic circle to indicate that the direction information of the first audio signal is: and the included angle range is vertical to the back screen of the mobile phone.
In the embodiment of the application, the electronic device can display the audio signal at the corresponding position according to the acquired azimuth information of the audio signal, so that a user can accurately judge the source direction of the audio signal and can perform corresponding actions according to the source direction of the audio signal.
Optionally, in this embodiment of the present application, before the step 201, the prompting method provided in this embodiment of the present application further includes a step 11 described below, after the step 201, the prompting method provided in this embodiment of the present application further includes a step 12 described below, and the step 202 "displaying the first prompting information corresponding to the first audio information" may be specifically implemented by a step 202b described below.
And step 11, displaying the floating window by the electronic equipment.
Optionally, in this embodiment of the application, before the electronic device acquires the first audio information, the electronic device may display a floating window on a desktop, where the floating window may be used to display prompt information and the like corresponding to the acquired first audio information.
And step 12, under the condition that the decibel value of the first audio information is larger than the target value, the electronic equipment expands the floating window.
Optionally, in this embodiment of the application, when the floating window is in the expanded state, the display form of the floating window may be a floating form or a tiled form, and specifically, the display form may be confirmed according to an actual use situation, and this embodiment of the application is not limited herein.
Optionally, in this embodiment of the application, when the electronic device acquires the first audio information and a decibel value of the first audio information is greater than a target value, the electronic device expands a floating window, and displays first prompt information corresponding to the first audio information in the floating window.
Step 202b, the electronic device displays first prompt information corresponding to the first audio information in the expanded floating window.
The step 202 of displaying, by the electronic device, the first prompt information corresponding to the first preset sound effect information in the expanded floating window may be specifically implemented by the following steps 202b1 and 202b 2.
Step 202b1, the electronic device converts the first audio information into first text information.
Optionally, in this embodiment, the electronic device may convert the first audio information into the first text information when the first audio information is acquired, so that the first text information may be matched with a preset keyword, where the preset keyword may be a default keyword in a system or a keyword set by a user.
Step 202b2, under the condition that the first text information is matched with the preset keywords, the electronic equipment is at the exhibition
And displaying first prompt information corresponding to preset keywords in the opened floating window, wherein the preset keywords correspond to the first 5 preset sound effect information.
Optionally, in this embodiment of the application, after the electronic device acquires the first text information, the first text information may be matched with a preset keyword, and when the similarity between the first text information and the preset keyword is greater than a preset similarity value, it is determined that the first text information is matched with the preset keyword, and the electronic device is shown
And displaying 0 first prompt information corresponding to the first preset sound effect and the preset keywords by the electronic equipment in the opened suspension window.
Optionally, in this embodiment of the application, when a user needs to be reminded when some specific keywords are obtained, the user may delete or add the keywords in my keywords.
Illustratively, as shown in fig. 6 (a), a keyword and a keyword corresponding to the keyword are set on the user demand
In the case of displaying information, the electronic device may display an interface 11 of a sound visualization instrument panel on a desktop, the interface 5 is a setting interface, and may display keywords stored in the electronic device and set the keywords or the keywords
Prompt information corresponding to the words; the user can click the add mark in the interface 11 to add the keyword of the requirement, as shown in fig. 6 (b), add: an identity card; and setting: the reminding information corresponding to the certificate, for example:
and displaying the identity card, and clicking and confirming by a user after the setting is finished so as to finish the addition of the key words and the corresponding prompt information.
In this embodiment, the user may also set that some audio signals are present in the audio signals acquired by the electronic device
In the case of the keyword required by the user, the prompted information is such that the user can still obtain the corresponding prompt by acquiring the keyword even in the case that the user cannot hear the sound of the surrounding environment, and thus, the sound information required by the user is not missed.
Optionally, the prompting method provided in the embodiment of the present application further includes the following steps 301 and 302. Step 5, step 301, in which the first sound effect information corresponding to the first audio information is not matched with the target sound effect information
In this case, the electronic device issues the second audio signal and the request information in the first application.
In the embodiment of the application, the second audio signal is an audio signal in an environment, the request information is used for requesting to acquire second sound effect information, and the second sound effect information is sound effect information corresponding to the second audio signal.
Optionally, in this embodiment of the application, the second audio signal is the same as the first audio signal, or the second audio signal includes a part of the audio signal of the first audio signal.
Optionally, in this embodiment of the application, when the first sound effect information corresponding to the first audio information is not matched with the target sound effect information, that is, when the electronic device does not determine what kind of sound the first sound effect information is, the electronic device may automatically start the recording function to store the first audio signal, and then the user may issue the completed first audio signal and the request information in the first application program, or may cut the first audio signal, and issue the cut audio signal and the cut request information in the first application program.
For example, in a case where the electronic device does not determine what sound the first sound effect information is, the electronic device may automatically turn on the recording function and provide the user with: options to mark and call for help. If the user does any operation to stop recording, generating an audio file; if the operation of the user is not detected until the first audio signal disappears, the recording is automatically stopped and no recording is made. If the user knows the first audio information, for example, see a baby crying, an animal calling, closing a door, etc., but the first audio information is not detected because it is not contained in the local audio library of the electronic device, the user may select the "mark" operation and add a graphic and a label that are easy to understand. The graphic representation can be added in the form of an album, a shooting and a file, and the label can be automatically input and selected from the labels in the existing sound effect library. After the electronic equipment stores the setting, the recorded audio is uploaded to the cloud corresponding machine learning data set according to the label. Meanwhile, whether the sound effect of the tag type exists in the cloud sound effect library is detected, and if the sound effect of the tag type exists in the cloud sound effect library, a sound effect set of the tag type is loaded into a local preset sound effect library of the electronic equipment and is integrated with sound effect information which is added by a user independently; if the same tag sound does not exist, a new tag entry is created in the local preset sound effect library and the cloud, and then the new tag entry is automatically merged into the tag data set if the same tag sound is added by a user.
For example, as shown in fig. 7 (a), if the first audio information does not match the first preset audio information, but the user knows what kind of sound the first audio information is, the electronic device may display the decibel value of the first audio signal in the interface 10, and display the prompt information: the sound type is unknown and the display identifies: seeking help and marking; after the user can click the mark, as shown in fig. 7 (b), the electronic device may then display an interface 12, where the interface 12 is an interface for the user to edit the first sound-effect information, and in the interface 12, the user may select a corresponding diagram for the first sound-effect information; or setting prompt information corresponding to the first sound effect information, preset sound effect information corresponding to the first sound effect information and the like, and then clicking the confirmation mark to finish editing the first sound effect information.
Step 302, when the reply information corresponding to the request information is received, the electronic device displays a second prompt message corresponding to the second sound effect information according to the reply information.
Optionally, in this embodiment of the application, after the electronic device issues the second audio signal and the request message in the first application, if a reply message corresponding to the request message is received, the electronic device may obtain and display a second prompt message corresponding to the second sound effect message according to the reply message.
For example, as shown in fig. 7 (a), as shown in fig. 8 (a), if the first sound effect information does not match the first preset sound effect information and the user does not know what kind of sound the first sound effect information is, the user may click to ask for help, then the electronic device will automatically generate audio according to the first audio signal, the user may edit the audio to obtain the second audio signal, then the electronic device may display the sharing identifier, and after the user clicks the sharing identifier, identifiers of multiple applications may be displayed, for example: the applications 1 to 4, and then the user may optionally select one application for sharing and publishing, and when publishing, as shown in fig. 8 (b), automatically generate request information, for example: what sound is in the recording? Want to help I distinguish and thanks to. The audio file will be temporarily stored in the local sound effect library, and the default storage name is: the acquisition date + number of the audio file may be: the number of the audio frequency shot by the user on the date of obtaining the audio frequency file is a serial number, so that the user can remember and retrieve conveniently.
In the embodiment of the application, under the condition that the electronic device and the user are not clear of the audio signal in the current environment, the user can acquire the sound of the audio signal in a mode of recording the audio signal and issuing the sound to other application programs, and the acquisition mode of the user on the sound effect information in the environment is improved.
Optionally, the prompting method provided in the embodiment of the present application further includes the following steps 401 and 402.
Step 401, the electronic device receives a first input of a user.
In the embodiment of the application, the first input is used for setting the second sound effect information and the prompt information corresponding to the second sound effect information.
Optionally, in this embodiment of the present application, after the user acquires the second sound effect information, the second sound effect information and prompt information corresponding to the second sound effect information may be set.
Optionally, in this embodiment of the application, the user may set a graphic representation and a tag of the second sound effect information, so as to facilitate understanding by himself, and may set the prompt information corresponding to the second sound effect information, so as to display the prompt information corresponding to the second sound effect information when the electronic 5 device is matched to the second sound effect information.
Optionally, in this embodiment of the application, the first input may be a click input, a long-press input, and the like of a user, which may be determined specifically according to an actual situation, and this embodiment of the application is not limited herein.
Step 402, the electronic device responds to the first input, sets the second sound effect information as second preset sound effect information, and sets second prompt information corresponding to the second preset sound effect information.
Optionally, in this embodiment of the application, after the electronic device acquires the second sound effect information, the electronic device may further acquire the second sound effect information
The second sound effect information is set as second preset sound effect information, namely the second sound effect information is stored in a local preset sound effect library, and second prompt information corresponding to the second preset sound effect information is set.
In the embodiment of the application, after the user acquires the second sound effect information, the second sound effect information can be processed
Setting is carried out, for example, prompt information and the like are set, and the second preset sound effect information is stored, so that 5, under the condition that the user hears the same or similar audio signals in other environments, the corresponding prompt information is obtained.
For example, as shown in fig. 9, when the first audio information is not acquired, the sound visualization dashboard for displaying the prompt information may display a default interface 01, where the default interface 01 may include four screen areas, which are respectively used to display identifiers: my sound library, my keywords, question history, and environmental mode identification, etc.
0 exemplary, in conjunction with FIG. 9, as shown in FIG. 10, after the user clicks on my sound effects library identification, the user is electrically prompted to select a sound effect library
The sub-equipment can display an interface 02, the interface 02 is used for displaying a local preset sound effect library, when the sound effect representative equipment contained in the local preset keyword library is detected, graphic representation and sound effect information can be displayed, and meanwhile, an identifier is also displayed in the interface 02: viewing, editing and deleting the local sound effect identification so as to view, edit or delete each sound effect information; simultaneously, the following can be displayed: downloading, recording and uploading the identification, wherein if the user can click to download 5 times, more detectable sound effect information can be downloaded from the cloud; if the user clicks the recording, then
The current environment sound can be recorded, and at the moment, the decibel is not limited; if the user clicks on the upload, the user may select and mark the past environmental sound recording file in the file, for example, add a tag, a graphic, a prompt message, and the like to the sound effect information.
Optionally, in the embodiment of the application, after the electronic device stores the flag setting, uploading the recorded or selected audio to the cloud-side corresponding machine learning data set according to the tag, and detecting whether the sound effect of the tag type already exists in the cloud-side sound effect library; if yes, loading the sound effect set of the tag type to the local equipment, and automatically adding the sound effect set with the user; if the tag entries do not exist, the tag entries are newly built in the local preset sound effect library and the cloud sound effect library at the same time, and then if the same tag sound is added by a user, the tag entries are automatically merged into the tag data set.
Optionally, in this embodiment of the application, the user may also view the second audio signal and the request information that are historically published in the first application.
For example, in conjunction with fig. 9, as shown in fig. 11, after the user clicks the question history identifier, the electronic device may display an interface 03, where the interface 03 is used to display the second audio signal and the request information issued in the first application program, in the case that the first sound-effect information does not match the first preset sound-effect information. The user can trace back the audio frequency asked once, if the audio frequency is judged to be definite, the marking operation can be selected by himself, the audio frequency is uploaded to the corresponding machine learning data set of the cloud end for learning after the marking is finished, and the operation of combining the same type items is labeled. The audio original files which are successfully marked are automatically deleted from the local place after being uploaded to the cloud end, and the marked audio original files are changed into a marked state; the unlabeled remains.
Optionally, in this embodiment of the application, a user may set a condition for obtaining audio information corresponding to an audio signal, for example, obtain the audio information when a decibel value of the audio signal exceeds a preset decibel threshold, or the user may set a plurality of environment modes in advance, and in different environment modes, the preset decibel thresholds of the environment modes are also different, that is, the preset decibel thresholds in the environment modes exceed the preset decibel threshold, and then obtain the audio information of the audio signal in the surrounding environment.
For example, referring to fig. 9, as shown in fig. 12, after the user clicks the environment mode identifier, the electronic device may display an interface 04, where the interface 04 is used to select multiple environment modes, for example, if the electronic device includes an automatic adjustment mode, an indoor environment mode, an outdoor environment mode, and a night environment mode, the electronic device may display identifiers corresponding to the four modes in the interface 04, and then the user may select the environment modes by himself or herself, and if the user selects the automatic adjustment mode identifier, in the automatic adjustment mode, the electronic device may automatically perform mode adjustment according to the volume of the whole environment.
Fig. 13 shows a flowchart of a prompting method, and specific steps may refer to the above steps, which are not described herein again.
According to the prompt method provided by the embodiment of the application, the execution main body can be an audio information display device. In the embodiment of the present application 5, an audio information display apparatus executing a prompting method is taken as an example to describe the audio information display apparatus provided in the embodiment of the present application.
Fig. 14 shows a schematic diagram of a possible structure of the audio information display apparatus according to the embodiment of the present application. As shown in fig. 14, the audio information display device 50 may include: an acquisition module 51 and a display module 52.
0, the obtaining module 51 is configured to obtain first audio information, where the first audio information includes audio information of a first audio signal, and the first audio signal is an audio signal in a collected environment. The display module 52 is configured to display first prompt information corresponding to the first audio information when the first audio information corresponding to the first audio information acquired by the acquisition module 51 matches the target audio information, where the first prompt information is used to prompt that the first audio signal exists in the environment.
5 this application embodiment provides a suggestion device, because electronic equipment can advance the suggestion information that the audio information that multiple audio signal corresponds, consequently, no matter what kind of environment the user is in, all can be through the audio signal in the collection environment to with the audio information that this audio signal's audio information corresponds, match with target audio information, and show the first suggestion information that corresponds with first audio information, thereby can indicate
What sound is present in the user's current environment. Therefore, the user can be reminded in a richer prompt 0 mode in more scenes.
In a possible implementation manner, the display module 52 is specifically configured to display, according to the azimuth information corresponding to the first audio information, first prompt information corresponding to the first audio information at a first position of a display interface of the electronic device, where the first position is a mapping position of the azimuth information on the display interface; wherein the orientation information is used to indicate the orientation of the first audio signal relative to the electronic device.
In one possible implementation, the first prompt message includes at least one of: of audio signals
Sound wave change images, preset text information and preset identification images.
In a possible implementation manner, the apparatus 50 further includes: and (5) unfolding the module. The display module 52 is further configured to display the floating window before the obtaining module 51 obtains the first audio information. And an expanding module, configured to expand the floating window when the decibel value of the first audio information is greater than the target value after the obtaining module 51 obtains the first audio information. The display module 52 is specifically configured to display first prompt information corresponding to the first audio information in the expanded floating window.
In a possible implementation manner, the apparatus 50 further includes: the system comprises a publishing module and a display module. The release module is used for releasing a second audio signal and request information in the first application program under the condition that the first audio information corresponding to the first audio information is not matched with the target audio information, the second audio signal is an audio signal in the environment, the request information is used for requesting to acquire the second audio information, and the second audio information is audio information corresponding to the second audio signal. And the display module is used for displaying second prompt information corresponding to the second sound effect information according to the reply information under the condition of receiving the reply information corresponding to the request information.
The audio information display device in the embodiment of the present application may be an electronic device, and may also be a component in the electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or may be a device other than a terminal. The electronic Device may be, for example, a Mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic Device, a Mobile Internet Device (MID), an Augmented Reality (AR)/Virtual Reality (VR) Device, a robot, a wearable Device, an ultra-Mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and may also be a server, a Network Attached Storage (Network Attached Storage, NAS), a personal computer (NAS), a Television (TV), a teller machine, a self-service machine, and the like, and the embodiments of the present application are not limited in particular.
The audio information display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.
The audio information display device provided in the embodiment of the present application can implement each process implemented by the foregoing method embodiment, and is not described here again to avoid repetition.
Optionally, as shown in fig. 15, an electronic device 6000 is further provided in an embodiment of the present application, and includes a processor 6001 and a memory 6002, where the memory 6002 stores a program or an instruction that is executable on the processor 6001, and when the program or the instruction is executed by the processor 6001, the steps of the above prompting method embodiment are implemented, and the same technical effect can be achieved, and is not described again here to avoid repetition.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 16 is a schematic hardware structure diagram of an electronic device implementing an embodiment of the present application.
The electronic device 100 includes, but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.
Those skilled in the art will appreciate that the electronic device 100 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device configuration shown in FIG. 16 does not constitute a limitation of electronic devices, which may include more or fewer components, or groups, than those shown
The processor 110 is configured to obtain first audio information, where the first audio information includes audio information of a first audio signal, and the first audio signal is an audio signal in a captured environment. The display unit 106 is configured to display first prompt information corresponding to the first audio information when the first audio information corresponding to the first audio information is matched with the target audio information, where the first prompt information is used to prompt that a first audio signal exists in an environment.
The embodiment of the application provides an electronic equipment, because electronic equipment can advance the prompt message that the audio information that multiple audio signal corresponds, consequently, no matter what environment the user is in, all can be through the audio signal in the collection environment to with the audio information that this audio signal's audio information corresponds, match with target audio information, and show the first prompt message that corresponds with first audio information, thereby can point out what kind of sound exists in the user's current environment. Therefore, the voice prompt can be performed on the user in a richer prompt mode in more scenes.
Optionally, the display unit 106 is specifically configured to display, according to the azimuth information corresponding to the first audio information, first prompt information corresponding to the first audio information at a first position of a display interface of the electronic device, where the first position is a mapping position of the azimuth information on the display interface; wherein the orientation information is used to indicate the orientation of the first audio signal relative to the electronic device.
Optionally, the display unit 106 is further configured to display a floating window before the first audio information is acquired. A processor 110, configured to, after acquiring the first audio information, expand the floating window if a decibel value of the first audio information is greater than a target value. The display unit 106 is specifically configured to display first prompt information corresponding to the first audio information in the expanded floating window.
Optionally, the processor 110 is further configured to, when the first audio information corresponding to the first audio information is not matched with the target audio information, issue a second audio signal and request information in the first application program, where the second audio signal is an audio signal in an environment, the request information is used to request to acquire the second audio information, and the second audio information is audio information corresponding to the second audio signal, and, when a reply information corresponding to the request information is received, display, according to the reply information, second prompt information corresponding to the second audio information.
It should be understood that, in the embodiment of the present application, the input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics Processing Unit 1041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a first storage area storing a program or an instruction and a second storage area storing data, wherein the first storage area may store an operating system, an application program or an instruction (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, memory 109 may include volatile memory or non-volatile memory, or memory 109 may include both volatile and non-volatile memory. The non-volatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. The volatile Memory may be a Random Access Memory (RAM), a Static Random Access Memory (Static RAM, SRAM), a Dynamic Random Access Memory (Dynamic RAM, DRAM), a Synchronous Dynamic Random Access Memory (Synchronous DRAM, SDRAM), a Double Data Rate Synchronous Dynamic Random Access Memory (Double Data Rate SDRAM, ddr SDRAM), an Enhanced Synchronous SDRAM (ESDRAM), a Synchronous Link DRAM (SLDRAM), and a Direct Memory bus RAM (DRRAM). Memory 109 in the embodiments of the subject application includes, but is not limited to, these and any other suitable types of memory.
Processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor, which mainly handles operations related to the operating system, user interface, application programs, etc., and a modem processor, which mainly handles wireless communication signals, such as a baseband processor. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored, and when the program or the instruction is executed by a processor, the program or the instruction implements the processes of the above-mentioned prompting method embodiment, and can achieve the same technical effects, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read only memory ROM, a random access memory RAM, a magnetic or optical disk, and the like.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above-mentioned prompt method embodiment, and can achieve the same technical effect, and is not described here again to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
Embodiments of the present application provide a computer program product, where the program product is stored in a storage medium, and the program product is executed by at least one processor to implement the processes of the foregoing prompting method embodiments, and can achieve the same technical effects, and in order to avoid repetition, details are not described here again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a component of' ...does not exclude the presence of another like element in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (11)

1. A method for prompting, the method comprising:
acquiring first audio information, wherein the first audio information comprises audio information of a first audio signal, and the first audio signal is an audio signal in a collected environment;
and displaying first prompt information corresponding to the first audio information under the condition that the first audio information corresponding to the first audio information is matched with target audio information, wherein the first prompt information is used for prompting that the first audio signal exists in the environment.
2. The method of claim 1, wherein the displaying the first prompt information corresponding to the first audio information comprises:
displaying first prompt information corresponding to the first audio information at a first position of a display interface of electronic equipment according to the azimuth information corresponding to the first audio information, wherein the first position is a mapping position of the azimuth information on the display interface;
wherein the orientation information is indicative of an orientation of the first audio signal relative to the electronic device.
3. The method of claim 1 or 2, wherein the first prompt message comprises at least one of: sound wave change images, preset text information and preset identification images of the audio signals.
4. The method of claim 1, wherein prior to obtaining the first audio information, the method further comprises:
displaying a floating window;
after the obtaining the first audio information, the method further comprises:
expanding the floating window under the condition that the decibel value of the first audio information is larger than a target value;
the displaying of the first prompt information corresponding to the first audio information includes:
and displaying first prompt information corresponding to the first audio information in the expanded floating window.
5. The method of claim 1, further comprising:
under the condition that first sound effect information corresponding to the first audio information is not matched with the target sound effect information, issuing a second audio signal and request information in a first application program, wherein the second audio signal is an audio signal in the environment, the request information is used for requesting to acquire second sound effect information, and the second sound effect information is sound effect information corresponding to the second audio signal;
and under the condition that reply information corresponding to the request information is received, displaying second prompt information corresponding to the second sound effect information according to the reply information.
6. A prompting device, the device comprising: the device comprises an acquisition module and a display module;
the acquisition module is used for acquiring first audio information, wherein the first audio information comprises audio information of a first audio signal, and the first audio signal is an acquired audio signal in an environment;
the display module is used for displaying first prompt information corresponding to the first audio information under the condition that the first audio information corresponding to the first audio information acquired by the acquisition module is matched with target audio information, and the first prompt information is used for prompting the existence of the first audio signal in the environment.
7. The apparatus according to claim 6, wherein the display module is specifically configured to display, according to the orientation information corresponding to the first audio information, first prompt information corresponding to the first audio information at a first position on a display interface of an electronic device, where the first position is a mapping position of the orientation information on the display interface;
wherein the orientation information is indicative of an orientation of the first audio signal relative to the electronic device.
8. The apparatus of claim 6 or 7, wherein the first prompt message comprises at least one of: sound wave change images, preset text information and preset identification images of the audio signals.
9. The apparatus of claim 6, further comprising: a deployment module;
the display module is further used for displaying a floating window before the acquisition module acquires the first audio information;
the expansion module is used for expanding the floating window under the condition that the decibel value of the first audio information is larger than a target value after the acquisition module acquires the first audio information;
the display module is specifically configured to display first prompt information corresponding to the first audio information in the expanded floating window.
10. The apparatus of claim 6, further comprising: the system comprises a publishing module and a display module;
the release module is used for releasing a second audio signal and request information in a first application program under the condition that first audio information corresponding to the first audio information is not matched with the target audio information, wherein the second audio signal is an audio signal in the environment, the request information is used for requesting to acquire second audio information, and the second audio information is audio information corresponding to the second audio signal;
and the display module is used for displaying second prompt information corresponding to the second sound effect information according to the reply information under the condition of receiving the reply information corresponding to the request information.
11. An electronic device comprising a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions when executed by the processor implementing the steps of the prompting method of any one of claims 1 to 5.
CN202211701999.3A 2022-12-28 2022-12-28 Prompting method and device and electronic equipment Pending CN115988131A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211701999.3A CN115988131A (en) 2022-12-28 2022-12-28 Prompting method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211701999.3A CN115988131A (en) 2022-12-28 2022-12-28 Prompting method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN115988131A true CN115988131A (en) 2023-04-18

Family

ID=85971899

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211701999.3A Pending CN115988131A (en) 2022-12-28 2022-12-28 Prompting method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN115988131A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103049077A (en) * 2011-10-14 2013-04-17 鸿富锦精密工业(深圳)有限公司 Sound feedback device and working method thereof
KR101328865B1 (en) * 2013-04-30 2013-11-13 주식회사 모뉴엘 Wrist watch for deaf and its control method
CN107682772A (en) * 2017-10-25 2018-02-09 倬韵科技(深圳)有限公司 A kind of hazard recognition is to control the method, apparatus of audio output and earphone
CN110673819A (en) * 2019-09-18 2020-01-10 联想(北京)有限公司 Information processing method and electronic equipment
CN112037468A (en) * 2020-08-31 2020-12-04 维沃移动通信有限公司 Safety early warning method and device and electronic equipment
CN112989101A (en) * 2019-12-18 2021-06-18 深圳市三诺数字科技有限公司 Reminding method, device, equipment and storage medium suitable for hearing-impaired patients
CN114708866A (en) * 2022-02-24 2022-07-05 潍坊歌尔电子有限公司 Head-mounted display device control method and device, head-mounted display device and medium
CN115132226A (en) * 2022-06-27 2022-09-30 思必驰科技股份有限公司 Voice interaction method, device and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103049077A (en) * 2011-10-14 2013-04-17 鸿富锦精密工业(深圳)有限公司 Sound feedback device and working method thereof
KR101328865B1 (en) * 2013-04-30 2013-11-13 주식회사 모뉴엘 Wrist watch for deaf and its control method
CN107682772A (en) * 2017-10-25 2018-02-09 倬韵科技(深圳)有限公司 A kind of hazard recognition is to control the method, apparatus of audio output and earphone
CN110673819A (en) * 2019-09-18 2020-01-10 联想(北京)有限公司 Information processing method and electronic equipment
CN112989101A (en) * 2019-12-18 2021-06-18 深圳市三诺数字科技有限公司 Reminding method, device, equipment and storage medium suitable for hearing-impaired patients
CN112037468A (en) * 2020-08-31 2020-12-04 维沃移动通信有限公司 Safety early warning method and device and electronic equipment
CN114708866A (en) * 2022-02-24 2022-07-05 潍坊歌尔电子有限公司 Head-mounted display device control method and device, head-mounted display device and medium
CN115132226A (en) * 2022-06-27 2022-09-30 思必驰科技股份有限公司 Voice interaction method, device and storage medium

Similar Documents

Publication Publication Date Title
CN110868639B (en) Video synthesis method and device
US11206448B2 (en) Method and apparatus for selecting background music for video shooting, terminal device and medium
CN109461462B (en) Audio sharing method and device
CN110110315B (en) To-do item management method and device
CN110557565A (en) Video processing method and mobile terminal
WO2019137166A1 (en) Video producing method, apparatus, storage medium, and electronic device
CN112184168B (en) Reminding task generation method and device and electronic equipment
CN112416485A (en) Information guiding method, device, terminal and storage medium
CN113596555B (en) Video playing method and device and electronic equipment
CN113055529B (en) Recording control method and recording control device
CN114416905A (en) Article searching method, label generating method and device
CN111638841B (en) Message detail page display method and device and electronic equipment
CN110493635B (en) Video playing method and device and terminal
CN104038407A (en) Instant message management method and device
CN109669710B (en) Note processing method and terminal
CN108710521B (en) Note generation method and terminal equipment
CN112069350A (en) Song recommendation method, device, equipment and computer storage medium
CN112100437A (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
CN115988131A (en) Prompting method and device and electronic equipment
CN105487746A (en) Search result displaying method and device
CN115134316B (en) Topic display method, device, terminal and storage medium
CN113377271A (en) Text acquisition method and device, computer equipment and medium
CN113256440A (en) Information processing method and device for virtual study room and storage medium
CN113204724A (en) Method and device for creating interactive information, electronic equipment and storage medium
CN114554283B (en) Target object display method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination