CN115412632A - Audio data processing method, device, terminal and storage medium - Google Patents

Audio data processing method, device, terminal and storage medium Download PDF

Info

Publication number
CN115412632A
CN115412632A CN202110606360.6A CN202110606360A CN115412632A CN 115412632 A CN115412632 A CN 115412632A CN 202110606360 A CN202110606360 A CN 202110606360A CN 115412632 A CN115412632 A CN 115412632A
Authority
CN
China
Prior art keywords
audio data
terminal
user
adjusting
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110606360.6A
Other languages
Chinese (zh)
Inventor
王伟伟
李以龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN202110606360.6A priority Critical patent/CN115412632A/en
Publication of CN115412632A publication Critical patent/CN115412632A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72442User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for playing music files

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • Multimedia (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The present disclosure relates to an audio data processing method, apparatus, terminal and storage medium, including: adjusting initial audio data corresponding to audio to be played into first audio data based on the environmental noise and a preset hearing curve; and adjusting the first audio data based on a compensation curve corresponding to at least one of user condition information associated with the individual hearing ability condition of the user and the playing state of the terminal, and outputting the obtained second audio data. The manner of adjusting the audio data according to the embodiment of the present disclosure may automatically adjust the audio data by means of software.

Description

Audio data processing method, device, terminal and storage medium
Technical Field
The present disclosure relates to the field of electronic technologies, and in particular, to an audio data processing method, apparatus, terminal, and storage medium.
Background
The terminal is exemplified by a mobile phone. In the mainstream mobile phone field at present, a volume key generally exists in a form of a physical key. By pressing the volume key, the user can manually adjust to a volume suitable for the ears of the user according to the change of the self requirement or the change of the current environment and the like. The manual audio data adjusting mode has insufficient intelligence and convenience. When the user cannot manually adjust the audio data in some scenes, the current audio data can be played, which often causes the problems of not clear played audio and the like, and the user experience is poor.
Disclosure of Invention
The present disclosure provides an audio data processing method, apparatus, terminal, and storage medium.
According to a first aspect of the embodiments of the present disclosure, there is provided an audio data processing method, including:
determining initial audio data corresponding to audio to be played based on a preset hearing curve;
adjusting the initial audio data into first audio data by combining the current environmental noise;
acquiring a compensation curve corresponding to at least one of user condition information associated with the individual hearing condition of a user and the playing state of a terminal;
and adjusting the first audio data based on the compensation curve, and outputting the adjusted second audio data.
In some embodiments, the adjusting the first audio data based on the compensation curve and outputting the adjusted second audio data includes:
determining a corresponding compensation value in the compensation curve according to the user condition information and/or the playing state;
and adjusting the volume and/or frequency of the first audio data according to the compensation value.
In some embodiments, the adjusting the first audio data based on the compensation curve and outputting the adjusted second audio data includes:
if the terminal is in a first playing state, adjusting the first audio data according to a first compensation value corresponding to the distance between the terminal and the user in the compensation curve, wherein the first playing state comprises a state of outputting the audio to be played through an audio module included in the terminal;
and if the terminal is in a second playing state, adjusting the first audio data according to a second compensation value corresponding to the type of the playing equipment in the compensation curve, wherein the second playing state comprises a state of outputting the audio to be played through the playing equipment connected with the terminal.
In some embodiments, if the terminal is in the first play state, adjusting the first audio data according to a first compensation value corresponding to a distance between the terminal and the user in the compensation curve includes:
determining the volume of the second audio data according to a first compensation value corresponding to the distance between the terminal and the user in the compensation curve; wherein the volume of the second audio data is positively correlated with the distance.
In some embodiments, if the terminal is in the second play state, adjusting the first audio data according to a second compensation value corresponding to the type of the playing device in the compensation curve to obtain second audio data includes:
when the playing device is of a first type, determining the volume of the second audio data as a first volume;
when the playing device is of a second type, determining the volume of the second audio data to be a second volume; the first type of playing device is a play-in device, the second type of playing device is a play-out device, and the second volume is larger than the first volume.
In some embodiments, the user condition information associated with the user's personal hearing condition comprises at least one of:
user age, hearing ability information, sleep condition information, or the user's hearing preference at different light intensities.
In some embodiments, the method further comprises:
acquiring the update state of the user condition information;
and responding to the update of the user condition information, and updating the compensation curve according to the updated user condition information.
According to a second aspect of the embodiments of the present disclosure, there is provided an audio data processing apparatus comprising:
the determining module is used for determining initial audio data corresponding to the audio to be played based on a preset hearing curve;
the first adjusting module is used for adjusting the initial audio data into first audio data by combining the current environmental noise;
the acquisition module is used for acquiring a compensation curve corresponding to at least one of user condition information associated with the personal hearing condition of a user and the playing state of the terminal;
and the second adjusting module is used for adjusting the first audio data based on the compensation curve and outputting the obtained second audio data.
In some embodiments, the second adjusting module is configured to:
determining a corresponding compensation value in the compensation curve according to the user condition information and/or the playing state;
and adjusting the volume and/or the frequency of the first audio data according to the compensation value.
In some embodiments, the second adjustment module is configured to:
if the terminal is in a first playing state, adjusting the first audio data according to a first compensation value corresponding to the distance between the terminal and the user in the compensation curve, wherein the first playing state comprises a state of outputting the audio to be played through an audio module included in the terminal;
and if the terminal is in a second playing state, adjusting the first audio data according to a second compensation value corresponding to the type of the playing equipment in the compensation curve, wherein the second playing state comprises a state of outputting the audio to be played through the playing equipment connected with the terminal.
According to a third aspect of the embodiments of the present disclosure, there is provided a terminal, including a processor, a memory, and an executable program stored on the memory and capable of being executed by the processor, wherein the processor executes the steps of the audio data processing method according to the first aspect when executing the executable program.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a storage medium having stored thereon an executable program which, when executed by a processor, implements the steps of the audio data processing method of the first aspect.
According to the audio data processing method disclosed by the embodiment of the disclosure, the influence of the environmental noise on the output audio to be played is removed through the first audio data determined by the environmental noise and the preset hearing curve, the effect of primarily adjusting the audio data is achieved, and the definition of the output audio to be played is primarily ensured. On the basis of the first audio data, the audio data are adjusted again through a compensation curve corresponding to at least one of user condition information associated with the individual hearing condition of the user and the playing state of the terminal, so that the adjusted second audio data not only remove the influence of environmental noise, but also adapt to the user condition information and/or the playing state of the terminal, and the personalized requirements of the user in different use scenes are met. This kind of mode of adjusting audio data of this disclosed embodiment can rely on audio data such as software automatically regulated volume, need not the volume key of manual adjustment physics button form, under ideal situation, can cancel the volume key of physics button, is favorable to saving the space of piling up at terminal, promotes user's use and experiences.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.
FIG. 1 is one of the flow diagrams of a method of audio data processing shown according to an exemplary embodiment;
FIG. 2 is a second schematic flow chart of an audio data processing method according to an exemplary embodiment;
FIG. 3 is a schematic block diagram of an audio data processing device according to an exemplary embodiment;
fig. 4 is a block diagram showing a constitutional structure of an audio data processing apparatus according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with embodiments of the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the disclosed embodiments, as detailed in the appended claims.
The terminology used in the embodiments of the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the embodiments of the present disclosure. As used in the disclosed embodiments and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information in the embodiments of the present disclosure, such information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of embodiments of the present disclosure. The word "if," as used herein, may be interpreted as "at \8230; \8230when" or "when 8230; \823030when" or "in response to a determination," depending on the context.
The execution subject that this disclosed embodiment relates to includes but not limited to: the mobile terminal comprises mobile phones, notebook computers, tablet computers, televisions, wearable equipment and the like.
Fig. 1 is a flowchart illustrating an audio data processing method according to an exemplary embodiment, as shown in fig. 1, the method including:
step S110, determining initial audio data corresponding to audio to be played based on a preset hearing curve;
step S120, adjusting the initial audio data into first audio data by combining the current environmental noise;
step S130, obtaining a compensation curve corresponding to at least one of user condition information related to the individual hearing ability condition of the user and the playing state of the terminal;
step S140, adjusting the first audio data based on the compensation curve, and outputting the adjusted second audio data.
In step S110, the preset hearing curve may be, without limitation, a standard hearing curve created according to existing hearing data. For example: and (4) a frequency-loudness curve obtained by collecting and summarizing a large amount of normal user hearing data. The preset hearing profile may also be a hearing profile formulated according to the target user in a specific environment (environment with little or no ambient noise)), also referred to as a standard hearing profile.
The preset hearing curve is used for determining initial audio data of audio to be played. The initial audio data refers to unadjusted audio data.
In step S120, the first audio data has removed the influence of the environmental noise on the output audio to be played, so as to perform an effect of primarily adjusting the audio data, and primarily ensure the definition of the output audio to be played.
Generally, the larger the noise, the larger the degree of adjustment to the original audio data, and the larger the difference between the first audio data and the original audio data; conversely, the smaller the noise, the smaller the degree of adjustment to the initial audio data, and the smaller the difference between the first audio data and the initial audio data. Even more, the first audio data, i.e. the initial audio data, does not need to be de-dryed compensated. For example: when the environmental noise of the current environment where the terminal is located is 50 decibels, it indicates that the environmental noise is large, and in order to ensure that the audio to be played can be clearly heard, the volume of the initial audio data can be properly increased to obtain the first audio data.
In step S130, the user condition information associated with the individual hearing ability of the user represents the individual characteristics of the user, and different users may have different hearing preferences or different hearing abilities. The same adjustment scheme may have good effect on some users, but may not be effective enough for another user, or even cannot hear the output audio played with the tape. Therefore, the first audio data are adjusted according to the user condition information, so that personalized adjustment schemes can be formulated, personalized requirements of different users can be met, and the same terminal can obtain better use experience when facing different users.
The play state of the terminal includes, but is not limited to, a handheld play state, a hands-free play state, or an earphone play state, wherein the handheld play state refers to a state in which the user terminal is close to the ear. Different play states require different volume and/or audio. The first audio data are adjusted according to the playing state of the terminal, adjustment schemes of different use scenes are enriched, and the intelligence of adjustment of the first audio data is further improved.
The compensation curve is a curve formulated based on at least one of user condition information associated with the user's personal hearing ability condition and the play state of the terminal. Through the compensation curve, the volume value and/or the frequency value corresponding to different user state information can be determined, and the volume value and/or the frequency value of the terminal in different playing states can also be determined.
The audio to be played can be output based on the second audio data in any playing state such as a handheld playing state, a hands-free playing state or an earphone playing state.
In step S140, based on the first audio data, the audio data is adjusted again through a compensation curve corresponding to at least one of the user condition information associated with the user' S individual hearing ability condition and the playing state of the terminal, so that the adjusted second audio data not only removes the influence of the environmental noise, but also adapts to the user condition information and/or the playing state of the terminal, thereby satisfying the personalized requirements of the user in different usage scenarios.
According to the embodiment of the disclosure, the first audio data is formed by the initial audio data, and the second audio data is formed by adjusting the first audio data, so that the first audio data and the second audio data can be automatically adjusted by software, the volume key in the form of the physical key does not need to be manually adjusted, and under an ideal condition, the volume key of the physical key can be cancelled, thereby being beneficial to saving the stacking space of the terminal and improving the use experience of a user.
In some other optional embodiments, the adjusting the first audio data based on the compensation curve, and outputting the adjusted second audio data includes:
determining a corresponding compensation value in the compensation curve according to the user condition information and/or the playing state;
and adjusting the volume and/or frequency of the first audio data according to the compensation value.
The first audio data comprises volume and/or frequency. The compensation values include, but are not limited to, compensation volume values and/or compensation frequency values. By adjusting the volume, different sound loudness can be obtained; by adjusting the frequency, sounds having different high-frequency or low-frequency tone qualities can be obtained. When the user condition information is changed, the loudness and the audio frequency can be adjusted at the same time, so that the definition of the output audio frequency to be played is ensured, and the tone quality is improved.
The compensation curve includes: a user status information compensation curve and a playing state compensation curve. Without limitation, the user condition information compensation curve may be a user condition information-frequency-loudness curve created by collecting data of the user using the terminal audio module. For example: and counting a user condition information-frequency-loudness curve obtained after the hearing data of the user is summarized and summarized in a period of time. Similarly, the compensation curve may be a playing state-frequency-loudness curve created by collecting data of the terminal audio module used by the user.
In some other optional embodiments, the adjusting the first audio data based on the compensation curve, and outputting the adjusted second audio data includes:
if the terminal is in a first playing state, adjusting the first audio data according to a first compensation value corresponding to the distance between the terminal and the user in the compensation curve, wherein the first playing state comprises a state of outputting the audio to be played through an audio module included in the terminal;
and if the terminal is in a second playing state, adjusting the first audio data according to a second compensation value corresponding to the type of the playing equipment in the compensation curve, wherein the second playing state comprises a state that the playing equipment connected with the terminal outputs the audio to be played.
And when in the first playing state, the terminal outputs audio through the audio module of the terminal. Taking the adjustment of the volume as an example: if the user is close to the terminal, the distance from the audio of the terminal to the ears of the user is small, the audio attenuation is small, and a clear playing effect can be obtained even if the volume is small. If the distance between the user and the terminal is far, the audio of the terminal can be transmitted to the ears of the user only by the far distance, the audio is attenuated more, and a clear playing effect can be obtained only by the larger volume, and at the moment, the volume can be increased.
It can be understood that, in the first playing state, the frequency can be adjusted according to the distance between the terminal and the user. For example: when the distance between the terminal and the user is short, the frequency of the first audio data can be reduced, the audio to be played is output at a lower frequency, and the tone quality with more rhythmic feeling is obtained. When the distance between the terminal and the user is long, the frequency of the first audio data can be increased, and the audio to be played is output at a high frequency, so that more powerful tone quality is obtained.
The first play state may be a handheld play state or a hands-free play state. When the user is in a handheld state, the user is close to the terminal and needs lower volume; in the hands-free state, the user is far away from the terminal and needs a higher volume.
The playing device includes, but is not limited to, an external device with an audio module, such as an earphone, a sound box, or a television. When the terminal is connected with the playing device, the audio can be output through the playing device. Different playing devices have different requirements on the volume, so that the first audio data is adjusted according to the type of the playing device, and the playing effect is improved.
In some other optional embodiments, if the terminal is in the first play state, adjusting the first audio data according to a first compensation value corresponding to a distance between the terminal and the user in the compensation curve to obtain second audio data includes:
determining the volume of the second audio data according to a first compensation value corresponding to the distance between the terminal and the user in the compensation curve; wherein the volume of the second audio data is in a positive correlation with the distance.
The larger the distance between the terminal and the user is, the larger the volume is; conversely, the smaller the distance between the terminal and the user, the smaller the volume.
In some other optional embodiments, if the terminal is in the second play state, adjusting the first audio data according to a second compensation value corresponding to the type of the playing device in the compensation curve includes:
when the playing device is of a first type, determining the volume of the second audio data to be a first volume;
when the playing device is of a second type, determining the volume of the second audio data to be a second volume; the first type of playing device is a play-in device, the second type of playing device is a play-out device, and the second volume is larger than the first volume.
The inner placement device is typically a device proximate the user's ear. When connected to the internal playback device, the terminal often outputs audio in a headphone mode. Internal discharge devices include, but are not limited to: an earphone or a hearing aid.
The playback device is typically a device that is remote from the user's ear. When connected to a playback device, the terminal often outputs audio in a non-headset mode or a hands-free mode. Playback devices include, but are not limited to: a sound box, a television or a computer, etc.
In other optional embodiments, the user condition information associated with the user's personal hearing condition comprises at least one of: user age, hearing ability information, sleep condition information, or the user's hearing preference at different light intensities.
Users may be experienced differently with age, with different frequencies of sound, or with different volumes of sound. For example: older users need to increase the volume of the first audio data more, and comparatively, younger users may increase the volume of the first audio data not or by a small amount.
Hearing ability information includes, but is not limited to: an audible frequency range and/or audible volume range of the user, wherein "audible" means capable of hearing the audio content clearly. Users of the same age may also experience different sounds at the same frequency, resulting in different hearing abilities.
The sleep condition information includes a time to start sleeping, a sleep duration, and/or the like. In the sleep time, the user has poor perception of the volume of the environment, and in order to achieve the effect of reminding the user, the volume of the first audio data can be increased. Outside of the sleep period, the user may be more sensitive to sound while staying awake.
In some embodiments, the sleep condition information may also be sleep quality information, which is hearing sensitive if the user has a high quality sleep time; if the user's sleep quality is poor, the volume and hue of the audio output may be different from the requirements for having a high quality sleep.
Under different ambient light intensities, users have different requirements for frequency and/or volume. For example: in the morning, the ambient light intensity is weaker and may be less desirable to the user, at which time the audio of the first audio data needs to be reduced. At noon, when the light intensity is strong, the user may prefer a higher volume, and at this time, the volume of the first audio data needs to be increased.
In some other optional embodiments, the method further comprises:
acquiring the update state of the user condition information;
and responding to the update of the user condition information, and updating the compensation curve according to the updated user condition information.
The update status includes at least one of: a change in age of the user, a change in sleep state information of the user, or a change in hearing preference of the user at different illumination intensities.
Updating the compensation curve further improves the accuracy and intelligence of the adjustment of the first audio data.
In the initial establishment stage of the compensation curve, corresponding relation data between user condition information of one time and playing parameters of audio output of the terminal can be collected, and the initial compensation curve is established based on the corresponding relation data. After the initial compensation curve is established, the state information of the terminal user can be collected periodically or aperiodically to determine the state change of the user, the change can be indicated by the updating state, and the compensation curve can be updated subsequently according to the updating state, so that the curve in the current application of the terminal is matched with the current state of the user.
As shown in fig. 2, in a specific example, the terminal is a mobile phone, and the audio data processing method includes:
and step S210, making a standard hearing curve of the human ear.
And S220, fitting a noise compensation curve meeting the definition requirement in different environmental noises. And obtaining first audio data according to the noise compensation curve and the standard hearing curve.
Step S230, defining an age compensation curve according to different ages; fitting a hearing preference curve of a user in a real scene under the light intensity of a common environment in life; in practical application, the user condition information compensation curve can be formed by fitting in combination with the age compensation curve, the user hearing preference curve, the hearing ability information of the user, the sleep condition information and the like.
Step S240, fitting the hearing status of the mobile phone in different playing states (for example, a handheld playing state, a hands-free playing state, or an earphone playing state) to obtain a playing state compensation curve.
And S250, integrating the user condition information compensation curve and the playing state compensation curve, and adjusting the first audio data to obtain second audio data. The audio to be played has more comfortable and clearer downstream tone (namely, output tone).
And step S260, if the user condition information is updated, updating the user personal condition compensation curve and/or the playing state compensation curve according to the updated user condition information. The method for updating the compensation curve has the function of autonomous learning. The adjustment can be automatically carried out according to the use habits of the user, such as the change of sleep time, age or hearing.
As shown in fig. 3, an embodiment of the present disclosure further provides an audio data processing apparatus 500, including:
a determining module 510, configured to determine initial audio data corresponding to an audio to be played based on a preset hearing curve;
a first adjusting module 520, configured to adjust the initial audio data into first audio data in combination with the current environmental noise;
an obtaining module 530, configured to obtain a compensation curve corresponding to at least one of user condition information associated with a user's individual hearing ability and a playing state of the terminal;
and a second adjusting module 540, configured to adjust the first audio data based on the compensation curve, and output second audio data obtained after adjustment.
In some other optional embodiments, the second adjusting module is configured to:
determining a corresponding compensation value in the compensation curve according to the user condition information and/or the playing state;
and adjusting the volume and/or frequency of the first audio data according to the compensation value.
In some other optional embodiments, the second adjusting module is configured to:
if the terminal is in a first playing state, adjusting the first audio data according to a first compensation value corresponding to the distance between the terminal and the user in the compensation curve, wherein the first playing state comprises a state of outputting the audio to be played through an audio module included in the terminal;
and if the terminal is in a second playing state, adjusting the first audio data according to a second compensation value corresponding to the type of the playing equipment in the compensation curve, wherein the second playing state comprises a state that the playing equipment connected with the terminal outputs the audio to be played.
In some other optional embodiments, the second adjusting module is configured to:
determining the volume of the second audio data according to a first compensation value corresponding to the distance between the terminal and the user in the compensation curve; wherein the volume of the second audio data is positively correlated with the distance.
In some other optional embodiments, the second adjusting module is configured to:
when the playing device is of a first type, determining the volume of the second audio data to be a first volume;
when the playing device is of a second type, determining the volume of the second audio data to be a second volume; the first type of playing equipment is internal playing equipment, the second type of playing equipment is external playing equipment, and the second volume is greater than the first volume.
In some other optional embodiments, the user condition information associated with the user's personal hearing condition comprises at least one of:
age of the user, hearing ability information, sleep condition information, or hearing preferences of the user at different light intensities.
In some other optional embodiments, the apparatus further comprises:
the updating module is used for acquiring the updating state of the user condition information;
and responding to the update of the user condition information, and updating the compensation curve according to the updated user condition information.
The embodiment of the present disclosure further provides a terminal, which includes a processor, a memory, and an executable program stored in the memory and capable of being executed by the processor, and is characterized in that when the processor executes the executable program, the steps of the audio data processing method according to any one of the above embodiments are executed.
The embodiment of the present disclosure further provides a storage medium, on which an executable program is stored, where the executable program is executed by a processor to implement the steps of the audio data processing method according to any one of the above embodiments.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
In an exemplary embodiment, the determining module, the first adjusting module, the obtaining module, the second adjusting module, the updating module, and the like may be implemented by one or more Central Processing Units (CPUs), graphics Processing Units (GPUs), baseband Processors (BPs), application Specific Integrated Circuits (ASICs), DSPs, programmable Logic Devices (PLDs), complex Programmable Logic Devices (CPLDs), field Programmable Gate Arrays (FPGAs), general purpose processors (GPUs), controllers, micro Controllers (MCUs), microprocessors (microprocessors), or other electronic elements for executing the foregoing methods.
Fig. 4 is a block diagram illustrating an apparatus 800 for processing audio data according to an exemplary embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 4, the apparatus 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communications component 816.
The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the apparatus 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
Power components 806 provide power to the various components of device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 800.
The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, audio component 810 includes a Microphone (MIC) configured to receive external audio signals when apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed status of the device 800, the relative positioning of components, such as a display and keypad of the device 800, the sensor assembly 814 may also detect a change in the position of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration/deceleration of the device 800, and a change in the temperature of the device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communications between the apparatus 800 and other devices in a wired or wireless manner. The apparatus 800 may access a wireless network based on a communication standard, such as WiFi,4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice in the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (12)

1. A method of audio data processing, comprising:
determining initial audio data corresponding to audio to be played based on a preset hearing curve;
adjusting the initial audio data into first audio data by combining the current environmental noise;
acquiring a compensation curve corresponding to at least one of user condition information associated with the individual hearing condition of a user and the playing state of a terminal;
and adjusting the first audio data based on the compensation curve, and outputting the adjusted second audio data.
2. The audio data processing method of claim 1, wherein the adjusting the first audio data based on the compensation curve and outputting the adjusted second audio data comprises:
determining a corresponding compensation value in the compensation curve according to the user condition information and/or the playing state;
and adjusting the volume and/or frequency of the first audio data according to the compensation value.
3. The audio data processing method of claim 1, wherein the adjusting the first audio data based on the compensation curve and outputting the adjusted second audio data comprises:
if the terminal is in a first playing state, adjusting the first audio data according to a first compensation value corresponding to the distance between the terminal and the user in the compensation curve, wherein the first playing state comprises a state of outputting the audio to be played through an audio module included in the terminal;
and if the terminal is in a second playing state, adjusting the first audio data according to a second compensation value corresponding to the type of the playing equipment in the compensation curve, wherein the second playing state comprises a state of outputting the audio to be played through the playing equipment connected with the terminal.
4. The audio data processing method of claim 3, wherein if the terminal is in a first playing state, adjusting the first audio data according to a first compensation value corresponding to a distance between the terminal and the user in the compensation curve comprises:
determining the volume of the second audio data according to a first compensation value corresponding to the distance between the terminal and the user in the compensation curve; wherein the volume of the second audio data is positively correlated with the distance.
5. The audio data processing method of claim 3, wherein if the terminal is in the second playing state, adjusting the first audio data according to a second compensation value corresponding to the type of the playing device in the compensation curve comprises:
when the playing device is of a first type, determining the volume of the second audio data as a first volume;
when the playing device is of a second type, determining the volume of the second audio data to be a second volume; the first type of playing equipment is internal playing equipment, the second type of playing equipment is external playing equipment, and the second volume is greater than the first volume.
6. The audio data processing method according to any one of claims 1 to 5, wherein the user condition information associated with the user's personal hearing condition comprises at least one of:
age of the user, hearing ability information, sleep condition information, or hearing preferences of the user at different light intensities.
7. The audio data processing method of claim 1, wherein the method further comprises:
acquiring the updating state of the user condition information;
and responding to the update of the user condition information, and updating the compensation curve according to the updated user condition information.
8. An audio data processing apparatus, comprising:
the determining module is used for determining initial audio data corresponding to the audio to be played based on a preset hearing curve;
the first adjusting module is used for adjusting the initial audio data into first audio data by combining the current environmental noise;
the acquisition module is used for acquiring a compensation curve corresponding to at least one of user condition information associated with the personal hearing condition of a user and the playing state of the terminal;
and the second adjusting module is used for adjusting the first audio data based on the compensation curve and outputting the adjusted second audio data.
9. The audio data processing device of claim 8, wherein the second adjusting module is configured to:
determining a corresponding compensation value in the compensation curve according to the user condition information and/or the playing state;
and adjusting the volume and/or frequency of the first audio data according to the compensation value.
10. The audio data processing device of claim 8, wherein the second adjusting module is configured to:
if the terminal is in a first playing state, adjusting the first audio data according to a first compensation value corresponding to the distance between the terminal and the user in the compensation curve, wherein the first playing state comprises a state of outputting the audio to be played through an audio module included in the terminal;
and if the terminal is in a second playing state, adjusting the first audio data according to a second compensation value corresponding to the type of the playing equipment in the compensation curve, wherein the second playing state comprises a state of outputting the audio to be played through the playing equipment connected with the terminal.
11. A terminal comprising a processor, a memory and an executable program stored on the memory and executable by the processor, characterized in that the processor executes the executable program to perform the steps of the audio data processing method according to any of claims 1 to 7.
12. A storage medium having stored thereon an executable program, which when executed by a processor implements the steps of the audio data processing method according to any one of claims 1 to 7.
CN202110606360.6A 2021-05-26 2021-05-26 Audio data processing method, device, terminal and storage medium Pending CN115412632A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110606360.6A CN115412632A (en) 2021-05-26 2021-05-26 Audio data processing method, device, terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110606360.6A CN115412632A (en) 2021-05-26 2021-05-26 Audio data processing method, device, terminal and storage medium

Publications (1)

Publication Number Publication Date
CN115412632A true CN115412632A (en) 2022-11-29

Family

ID=84156071

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110606360.6A Pending CN115412632A (en) 2021-05-26 2021-05-26 Audio data processing method, device, terminal and storage medium

Country Status (1)

Country Link
CN (1) CN115412632A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106331371A (en) * 2016-09-14 2017-01-11 维沃移动通信有限公司 Volume adjustment method and mobile terminal
WO2018205413A1 (en) * 2017-05-08 2018-11-15 深圳市科迈爱康科技有限公司 Audio volume adjustment method and terminal, and computer-readable storage medium
CN109729382A (en) * 2018-12-19 2019-05-07 北京达佳互联信息技术有限公司 Volume processing method, device and server, the electronic equipment of audio, video data
CN111031445A (en) * 2019-11-29 2020-04-17 深圳普罗声声学科技有限公司 Volume compensation method and device, computer equipment and storage medium
CN111314560A (en) * 2020-03-17 2020-06-19 青岛海信移动通信技术股份有限公司 Method for adjusting sound loudness and communication terminal
CN112104942A (en) * 2020-09-16 2020-12-18 歌尔科技有限公司 Earphone and volume adjusting method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106331371A (en) * 2016-09-14 2017-01-11 维沃移动通信有限公司 Volume adjustment method and mobile terminal
WO2018205413A1 (en) * 2017-05-08 2018-11-15 深圳市科迈爱康科技有限公司 Audio volume adjustment method and terminal, and computer-readable storage medium
CN109729382A (en) * 2018-12-19 2019-05-07 北京达佳互联信息技术有限公司 Volume processing method, device and server, the electronic equipment of audio, video data
CN111031445A (en) * 2019-11-29 2020-04-17 深圳普罗声声学科技有限公司 Volume compensation method and device, computer equipment and storage medium
CN111314560A (en) * 2020-03-17 2020-06-19 青岛海信移动通信技术股份有限公司 Method for adjusting sound loudness and communication terminal
CN112104942A (en) * 2020-09-16 2020-12-18 歌尔科技有限公司 Earphone and volume adjusting method thereof

Similar Documents

Publication Publication Date Title
CN107493500B (en) Multimedia resource playing method and device
CN106454644B (en) Audio playing method and device
CN108845787B (en) Audio adjusting method, device, terminal and storage medium
CN108200279B (en) Backlight adjusting method, device and equipment
CN107135452B (en) Hearing aid fitting method and device
CN111988704B (en) Sound signal processing method, device and storage medium
CN111698593B (en) Active noise reduction method and device, and terminal
CN108600503B (en) Voice call control method and device
CN114416015A (en) Audio adjusting method and device, electronic equipment and readable storage medium
CN106101441B (en) Terminal control method and device
WO2018058331A1 (en) Method and apparatus for controlling volume
CN105204841B (en) Range method of adjustment and device
CN115550791A (en) Audio processing method, device, earphone and storage medium
CN107677363B (en) Noise prompting method and intelligent terminal
CN104112460B (en) Method and device for playing audio data
US11388281B2 (en) Adaptive method and apparatus for intelligent terminal, and terminal
CN112019948A (en) Intercommunication device communication method, intercommunication device and storage medium
CN212305403U (en) Electronic equipment
CN115412632A (en) Audio data processing method, device, terminal and storage medium
CN113099334B (en) Configuration parameter determining method and device and earphone
CN111736798A (en) Volume adjusting method, volume adjusting device and computer readable storage medium
CN112118502B (en) Earphone control method, device, equipment and storage medium
CN112037719A (en) Screen brightness adjusting method and device
CN111225318A (en) Audio adjusting method and device and electronic equipment
US20240054987A1 (en) Earphone controlling method and apparatus, electronic device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination