CN115811681A - Earphone working mode control method, device, terminal and medium - Google Patents

Earphone working mode control method, device, terminal and medium Download PDF

Info

Publication number
CN115811681A
CN115811681A CN202111082536.9A CN202111082536A CN115811681A CN 115811681 A CN115811681 A CN 115811681A CN 202111082536 A CN202111082536 A CN 202111082536A CN 115811681 A CN115811681 A CN 115811681A
Authority
CN
China
Prior art keywords
environment
earphone
user
relevance
noise reduction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111082536.9A
Other languages
Chinese (zh)
Inventor
胡海林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN202111082536.9A priority Critical patent/CN115811681A/en
Priority to PCT/CN2022/108912 priority patent/WO2023040483A1/en
Publication of CN115811681A publication Critical patent/CN115811681A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00Speaker identification or verification techniques
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78Detection of presence or absence of voice signals
    • G10L25/84Detection of presence or absence of voice signals for discriminating voice from noise
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The application provides a method, a device, a terminal and a medium for controlling the working mode of an earphone. The method comprises the following steps: acquiring environmental characteristic information of an earphone worn by a user in a noise reduction mode; and controlling the working mode of the earphone according to the relevance between the environment corresponding to the environment characteristic information and the user. The method can make clear the relevance between the environment and the user by utilizing the environment characteristic information of the earphone in the noise reduction mode, thereby controlling the working mode of the earphone and enabling the earphone to work in the working mode adaptive to the surrounding environment, thereby improving the adaptability of the noise reduction function of the earphone to the environment and improving the use experience of the user on the noise reduction function of the earphone.

Description

Earphone working mode control method, device, terminal and medium
Technical Field
The present application relates to the field of noise reduction earphone control technologies, and for example, to a method, an apparatus, a terminal, and a medium for controlling an earphone operating mode.
Background
With the development of communication technology, fifth Generation mobile communication (5G) networks provide higher speed, larger capacity, and new functions and services, supporting more and more connected devices, such as headsets, than the previous generations of mobile communication networks.
The current earphones are gradually diversified in functions, for example, noise reduction earphones are favored by users in terms of noise reduction effects. A noise reduction earphone is an earphone which reduces noise by using a certain method. But the problems derived are numerous. When the noise reduction function of the earphone is used, useful sound in the environment can be shielded while external noise is shielded; for example, if the connected handset is louder during the user's use of the noise reducing headset, it may be difficult to hear a call from a nearby person or other useful information. Therefore, how to effectively control the noise reduction function of the earphone is an urgent problem to be solved in view of complex and various environments.
Disclosure of Invention
The application provides a method, a device, a terminal and a medium for controlling the working mode of an earphone to control the earphone to work in the working mode adaptive to the surrounding environment, so that the adaptability of the noise reduction function of the earphone to the environment is improved, and the use experience of a user on the noise reduction function of the earphone can also be improved.
The embodiment of the application provides a method for controlling the working mode of an earphone, which is applied to a terminal and comprises the following steps:
acquiring environmental characteristic information of an earphone worn by a user in a noise reduction mode;
and controlling the working mode of the earphone according to the relevance between the environment corresponding to the environment characteristic information and the user.
The embodiment of the present application further provides an earphone working mode control device, including:
the information acquisition module is set to acquire environmental characteristic information of an earphone worn by a user in a noise reduction mode;
and the control module is set to control the working mode of the earphone according to the relevance between the environment corresponding to the environment characteristic information and the user.
The embodiment of the application also provides a terminal, which comprises one or more processors; storage means for storing one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the above-described headset operating mode control method.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, and when the program is executed by a processor, the method for controlling an operating mode of an earphone is implemented.
The embodiment of the application provides a method, a device, a terminal and a medium for controlling the working mode of an earphone. The method comprises the following steps: acquiring environmental characteristic information of an earphone worn by a user in a noise reduction mode; and controlling the working mode of the earphone according to the relevance between the environment corresponding to the environment characteristic information and the user. According to the technical scheme, the working mode of the earphone is controlled by utilizing the relevance between the environment corresponding to the environment characteristic information and the user of the earphone in the noise reduction mode, so that the earphone works in the working mode adaptive to the surrounding environment, the adaptability of the noise reduction function of the earphone to the environment is improved, and the use experience of the user on the noise reduction function of the earphone can also be improved.
Drawings
Fig. 1 is a flowchart of a method for controlling an operating mode of an earphone according to an embodiment;
FIG. 2 is a diagram illustrating an embodiment of detecting a person using millimeter waves;
FIG. 3 is a schematic diagram illustrating an embodiment of identifying a length of a detection target using millimeter waves;
FIG. 4 is a diagram illustrating one embodiment of determining a number of people within a set range in an environment;
fig. 5A is a schematic diagram illustrating an embodiment of positioning a mobile phone by using two base stations;
fig. 5B is a schematic diagram illustrating an embodiment of positioning a mobile phone by using a base station;
FIG. 6 is a diagram illustrating an embodiment of processing an audio signal to obtain the frequency of the audio signal;
FIG. 7 is a diagram illustrating a method for processing a sound signal to obtain a loudness of the sound signal according to an embodiment;
FIG. 8 is a diagram illustrating an embodiment of processing an audio signal to obtain audio signal semantics;
fig. 9 is a flowchart of another method for controlling the operating mode of an earphone according to an embodiment;
fig. 10 is a schematic structural diagram of an earphone operating mode control device according to an embodiment;
fig. 11 is a schematic hardware structure diagram of a terminal according to an embodiment.
Detailed Description
The present application will be described with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently, or simultaneously. In addition, the order of the steps may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, subprograms, and the like.
It should be noted that the terms "first", "second", and the like in the embodiments of the present application are only used for distinguishing different apparatuses, modules, units, or other objects, and are not used for limiting the order or interdependence relationship of the functions performed by these apparatuses, modules, units, or other objects.
Fig. 1 is a flowchart of a method for controlling an operating mode of an earphone according to an embodiment. The embodiment can be suitable for the condition of flexibly controlling the working mode of the earphone. Specifically, the earphone working mode control method may be executed by an earphone working mode control device, and the earphone working mode control device may be implemented in a software and/or hardware manner and integrated in the terminal. Further, the terminal may be a terminal device independent from the headset, including but not limited to a computer, a tablet computer, a mobile phone, or a terminal device such as an audio/video player (e.g., MP3 or MP 4), or may be a chip or an electronic device integrated in the headset.
As shown in fig. 1, the method for controlling the working mode of the earphone of the present embodiment includes steps 110 and 120.
In step 110, the environmental characteristic information of the headset worn by the user in the noise reduction mode is obtained.
In this embodiment, the earphone mainly refers to an earphone with a noise reduction function, that is, a noise reduction earphone. Noise reducing headsets can be divided into two categories: active noise reduction headphones and passive noise reduction headphones. The working principle of the active noise reduction earphone can be considered that reverse sound waves equal to external noise are generated through a noise reduction system, and the noise is neutralized, so that the noise reduction effect is achieved. The working principle of the passive noise reduction earphone can be considered as that a closed space is formed by surrounding ears, or sound insulation materials such as silica gel earplugs are adopted to block outside noise. In this application, headphones may refer to active noise reduction headphones.
For example, the earphone may be a wired earphone or a wireless earphone, which is not limited herein. The wired earphone can perform data transmission with the terminal through a data line and the like; the Wireless headset can perform data transmission with the terminal through bluetooth or a Wireless Fidelity (WIFI) or the like.
The environment characteristic information can refer to information which is obtained after certain information or signals in the detected environment outside the earphone are subjected to specific processing and can represent whether the environment is possibly relevant to the user or not; the signals in the environment mainly refer to sound signals, and the detected sound signals can be subjected to signal processing according to actual requirements to obtain corresponding environment characteristic information; the information in the environment may be the number or density of people in the environment, the type of environment (e.g., library for a quieter type of environment, train station for a noisier type of environment), etc. For example, the environment characteristic information may include the number of people in the environment setting range, the frequency of the detected sound signal, the loudness of the sound signal, and/or the semantics of the sound signal, and the like, and the environment characteristic information may be used to determine the relevance between the environment and the user, that is, to determine whether there may be information in the environment that is useful for the user or is worth paying attention to the user.
In this step, when the headset is in the noise reduction mode, the information or the signal in the environment may be detected by a terminal device independent of the headset, or may be acquired by a chip or an electronic device integrated in the headset, and the information or the signal in the environment may be collected and stored to wait for subsequent processing to obtain the environment characteristic information. The implementation of detecting information or signals in an environment is not limited herein.
In step 120, the working mode of the headset is controlled according to the relevance between the environment corresponding to the environment feature information and the user.
In this embodiment, after the environmental characteristic information of the earphone worn by the user in the noise reduction mode is acquired, the relevance between the environment corresponding to the environmental characteristic information and the user needs to be determined. The relevance between the environment corresponding to the environment feature information and the user may be considered as whether the sound signal detected in the environment is relevant to the user, useful for the user, or worthy of the user's attention. The association comprises at least two levels, which may for example comprise a strong association, a medium association, a weak association, a no association, the stronger the association the more the user needs to focus on the sound in the environment, e.g. to divert the user's attention from the content played by the headset to the sound signals detected in the environment, at which point the operating mode of the headset may be controlled to make the user more likely to hear the sound signals in the environment, e.g. the headset may be controlled to operate in a non-noise reduction mode, a low volume mode or a pause playing mode, etc. The relevance is weak, so that the user does not need to pay attention to the sound in the environment, the user can continuously pay attention to the content played by the earphone, and the earphone of the user can continuously work in the noise reduction mode.
For example, when a user wears an earphone and is at a railway station, the number of people in a set range in an environment is very large, the environment is noisy, most of the environment is noise or voice of a person who is not related to the user, and the environment is considered to be not related to the user or to be weakly related. And under the condition that the user wears the earphone and is at home, the number of people in a set range in the environment is small, the environment is quite, once a person speaks or any movement is detected, the user needs to pay attention to or check the environment, the environment is related to the user or has strong relevance, and under the condition, the earphone can be controlled to work in a non-noise reduction mode, so that the user can pay attention to or check the environment conveniently, and important information is prevented from being missed. On the basis, according to the relevance between the environment and the user, the flexible control of the work mode of the earphone can be realized, so that the earphone is suitable for the environment.
According to the method for controlling the working mode of the earphone, the working mode of the earphone is controlled by utilizing the relevance between the environment corresponding to the environment characteristic information and the user of the earphone working in the noise reduction mode, the earphone can work in the working mode adaptive to the surrounding environment, and the earphone can be flexibly and accurately switched between the noise reduction mode and the non-noise reduction mode according to different relevance, so that the adaptability of the noise reduction function of the earphone to the environment is improved, and the use experience of the user on the noise reduction function of the earphone can also be improved. On the basis, the user can effectively find the possibly useful information around in time, and important information is prevented from being missed; in addition, unnecessary mode switching can be avoided, and therefore the use experience of the user on the noise reduction function is improved.
In an embodiment, the environmental characteristic information comprises at least one of: the number of people in a set range in the environment; the frequency of the sound signal in the environment; loudness of a sound signal in the environment; semantics of the sound signal in the environment.
In this embodiment, the environment mainly refers to an environment outside the earphone. Different environments correspond to different environment characteristic information. The number of people in the environment within the set range may be considered to be the number of people in the radius range set in the environment outside the earphone, with the earphone as the center. The size of the set radius range is not limited, and can be flexibly set according to actual requirements and the environment condition. It should be noted that, in order to ensure that the user can hear useful sound signals around the earphone at the position where the earphone is located (i.e. the position where the user wearing the earphone is located), the terminal detects the number of people in the set range in the external environment of the earphone. If the terminal is integrated in the headset, the terminal, the headset and the user can be considered to be in the same position, all as the center of the radius range.
The frequency of the sound signal may refer to information corresponding to the sound signal in a frequency domain.
The loudness of a sound signal, also called volume, may refer to the intensity of sound perceived by the human ear, i.e., the degree to which the sound is loud, which may be expressed in decibels.
The semantic meaning of the sound signal can be regarded as the text content corresponding to the sound signal.
Correspondingly, the condition for determining the relevance according to the environmental characteristic information comprises at least one of the following conditions:
whether the number of people in the set range in the environment is lower than a threshold number of people or not (if yes, the environment around the user is quiet, the sound signal detected from the environment is related to the user with high probability, and the relevance between the environment and the user is high);
whether the frequency of the sound signal in the environment is within a preset frequency range (if so, the frequency of the sound signal in the environment is in accordance with the sound frequency of the speaking of a person instead of noise, the sound signal is related to the user with high probability, and the relevance is strong); whether the loudness of the sound signal in the environment is greater than a loudness threshold value or not (if yes, the loudness of the sound signal in the environment is greater, and other people possibly speak towards the user, the sound signal is related to the user with high probability, and the relevance is high);
whether the semantic meaning of the sound signal in the environment contains the preset keyword (if yes, the sound signal in the environment contains the content which is interested by the user, and the relevance is strong).
In one embodiment, whether the relevance is relevant to the user can be determined according to the condition that the semantics of the sound signals in the environment comprise preset keywords; whether the relevance is related to the user can be judged according to at least two conditions of the three conditions that the number of people in the set range in the environment is lower than the threshold of the number of people, the frequency of the sound signal in the environment is in the preset frequency range, and the loudness of the sound signal in the environment is greater than the loudness threshold; it is also possible to determine whether the association is relevant to the user by combining all of the above four conditions. This is not a limitation here.
In an embodiment, the controlling the working mode of the earphone according to the relevance of the environment corresponding to the environment feature information to the user includes: if the environment characteristic information meets at least two conditions, determining that the relevance is related to the user, and controlling the earphone to be in a target working mode; wherein the conditions include: the number of people in the set range in the environment is lower than the threshold number of people; the frequency of the sound signal in the environment is within a preset frequency range; the loudness of the sound signal in the environment is greater than the loudness threshold.
In this embodiment, the association between the environment and the user may include two types: user-dependent, and user-independent. The target operation mode may refer to an operation mode that enables the user to hear the sound signal in the environment after the association is determined to be relevant to the user; if the target working mode is to control the earphone to be in the non-noise reduction mode, or to enable the user to hear the sound signal in the environment through other ways (such as reducing the playing volume of the earphone, pausing the playing, etc.) under the condition that the earphone is kept in the noise reduction mode.
Wherein, different environmental characteristic information corresponds to different conditions. The environment characteristic information satisfies at least two conditions, that is, at least two kinds of environment characteristic information respectively satisfy corresponding conditions, and in this case, the association may be determined to be related to the user. It should be noted that the present embodiment adopts a multiple decision method to control the working mode of the earphone.
In this embodiment, the threshold number of persons may be considered as a maximum number of persons within a set range in an environment outside the headphones. The conditions corresponding to the number of people in the set range in the environment may be: the number of people in the set range in the environment is lower than the preset threshold number of people. If the user is in a relatively calm environment, in order to avoid missing useful information around, the threshold number of people may be set to be relatively small, for example, in a library or an office, the threshold number of people may be set to be 5; the threshold number of people may be set relatively large if the user is in a relatively cluttered environment, such as 20 at a train station or a mall. The threshold number of people can be flexibly set according to different actual demands and environments, and is not limited herein. On the basis, according to the condition that the number of people in the set range in the environment is lower than the threshold value of the number of people, the relevance between the environment and the user can be judged from the perspective that the surrounding environment where the user is located is quiet or noisy. On the basis, if other environment characteristic information and corresponding conditions exist, the next judgment can be continued.
In general, the smaller the number of people in the setting range in the environment, the more the environment and the user are associated with each other, and the more likely it is that the user will be useful when detecting the sound signal in the environment. In some embodiments, if the number of people in the set range in the environment is 0 when the sound signal is detected, the earphone can be controlled to work in the noise reduction mode no matter what the threshold number of people is.
In this embodiment, the preset frequency range mainly refers to a frequency range that conforms to the sounding rule of a human, and the main purpose of determining whether the frequency of the sound signal is within the preset frequency range is to identify whether the sound signal contains human voice. For example, if the frequency of normal speaking of the person is approximately 500Hz to 2000Hz, the preset frequency range may be set to 500Hz to 2000Hz, and the preset frequency range is not limited herein. If the frequency of the recognized sound signal is not within the preset frequency range, it may be the sound of a machine or noise in the environment, etc., in which case the association may be determined to be irrelevant to the user; if the frequency of the recognized sound signal is within the preset frequency range, which indicates that the voice of the person speaking is recognized, the relevance can be determined as being related to the user in order to avoid missing a useful sound signal. If there is additional environmental characteristic information, then the process may continue to wait for further determinations. On the basis, according to the condition that the frequency of the sound signal in the environment is within the preset frequency range, part of non-human voice in the environment can be eliminated, so that the reliability of relevance judgment is not influenced.
It should be noted that, in some embodiments, in addition to the manner of using the preset frequency range to identify the human voice signal, the human voice signal may also be identified by other manners capable of distinguishing the human voice from the non-human voice signal, which is not limited herein.
In this embodiment, the loudness threshold may be considered as a minimum value of the set loudness of one sound signal. Different loudness thresholds may be set according to different environments, and the relationship between the loudness threshold and the average loudness in the environment may be a positive correlation. As in a library, since the environment is inherently quiet, the set loudness threshold may be relatively low, say 40 db; when the loudness of the received sound signal is detected to be greater than 40 decibels, the sound signal can be considered as a useful signal, and the relevance can be determined to be related to the user. Or if the preset loudness threshold is in a noisy environment such as a train station, the preset loudness threshold may be relatively higher, for example, 60 db; at this time, when it is detected that the loudness of the received sound signal is greater than 60 db, the sound signal may be regarded as a useful signal, and the correlation may be determined as being related to the user. It should be noted that, the loudness threshold is not limited here, and can be flexibly set according to actual situations and different environments.
The loudness of the sound signal is obtained mainly for identifying whether there is a signal greater than a loudness threshold in the sound signal, so as to determine whether the received sound signal is emitted by a user or whether a sound source is near the user. For example, if the loudness of the sound signal is below a loudness threshold, it may be that a distant person is speaking, or that a nearby person is talking to others rather than speaking to the user, in which case the sound signal may be deemed useless to the user, and such a less loud sound signal may be filtered; if the loudness of the sound signal is above the loudness threshold, it may be that a closer person is speaking, and it may also be that the person is speaking to the user, in which case the sound signal may be considered useful to the user and the association may be determined to be relevant to the user. On the basis, according to the condition that the loudness of the sound signal in the environment is greater than the loudness threshold value, a part of the sound signal which is possibly useless for the user can be excluded, and a part which is possibly useful for the user is reserved. In addition, if there is other environmental characteristic information, it can continue to wait for the next determination.
On the basis of the above embodiment, if the environment characteristic information satisfies at least two conditions, the relevance is determined to be relevant to the user, and the headset is controlled to be in the target working mode. Or combining the three pieces of environment characteristic information, and if all the three pieces of environment characteristic information meet the corresponding conditions, determining that the relevance between the environment corresponding to the combined three pieces of environment characteristic information and the user is related to the user, and controlling the earphone to be in the target working mode.
It should be noted that, whether any two items of environment characteristic information are combined or three items of environment characteristic information are combined to determine the relevance, the order of determination between the corresponding conditions of the environment characteristic information is not limited, and the environment characteristic information can be sorted according to actual requirements. For example, if the association with the user is determined by combining the two pieces of environment characteristic information, i.e., the frequency of the sound signal in the environment and the loudness of the sound signal in the environment, and the operating mode of the headphone is controlled, the two pieces of environment characteristic information may be determined in any order. Specifically, after a sound signal in the environment is detected, it may be preliminarily determined whether the sound signal is possibly useful according to the loudness of the sound signal, and the influence of non-human sounds (e.g., machine sounds in the environment close to the loudness of human sounds) may not be excluded, and at this time, the non-human sounds may be further excluded by determining whether the frequency of the sound signal is within a set range; or whether the frequency of the sound signal in the environment is in the preset frequency range or not can be judged firstly to filter out the non-human voice part, and then whether the sound signal is useful for the user or not can be further judged through the loudness of the sound signal. On the basis, the mode of multiple judgment is adopted, so that the reliability of working mode control can be improved, unnecessary working mode switching can be avoided, a user can pay attention to useful information in the environment in time, and the noise reduction effect is considered.
In an embodiment, the determination order may also be determined according to the importance degree of different environment feature information and corresponding conditions thereof on the relevance determination, so as to improve the efficiency of determining the relevance. For example, filtering the non-human voice signal is more important than filtering the voice signal with a weak loudness, and is more beneficial to accurately and efficiently determining the correlation, so the determination may be performed according to the frequency of the voice signal. Specifically, if the frequency of the sound signal is not within the preset frequency range, the sound signal can be directly judged to be irrelevant to the user without the need of next judgment; if within the preset frequency range, the preliminary decision is related to the user, and then the further decision can be made according to the loudness of the sound signal.
According to the method and the device, whether the relevance is multiple judgment related to the user is achieved by judging that the environmental characteristic information meets at least two conditions, on the basis, the working mode of the earphone can be switched more accurately and timely, the condition of user dislike caused by unnecessary mode switching is avoided, and the experience of the user in using the earphone noise reduction function is enhanced.
In one embodiment, the controlling the working mode of the earphone according to the relevance of the environment corresponding to the environment characteristic information and the user comprises: and if the semantics of the sound signals in the environment comprise preset keywords, determining that the relevance is related to the user, and controlling the earphone to be in a target working mode.
In this embodiment, the semantic meaning of the sound signal includes the preset keyword, and the main purpose of the semantic meaning is to determine whether the received sound signal includes content that is interesting to the user or useful to the user. For example, the preset keywords may include the user's name, occupation, address, and the like. If the semantics of the sound signal comprise one or more of the preset keywords, determining that the relevance is related to the user, and controlling the earphone to be in a target working mode; if the semantics of the sound signal do not comprise any preset keywords, the relevance is determined to be irrelevant to the user, and the headset can be controlled to continue to work in the noise reduction mode.
In one embodiment, keyword elements preset by a user are obtained, and the keyword elements are arranged and combined to obtain preset keywords in various forms. The keyword element may be one or more. When a plurality of keyword elements are provided, the plurality of keyword elements can be arranged and combined to obtain a plurality of preset keywords. For example, the number of the keyword elements is three, the three keyword elements may be respectively denoted as a, B, and C, and then various preset keywords such as { a, B, C, AB, AC, BC, BA,.. Multidot.,. ABC, ACB, BCA,. Multidot. } may be obtained after permutation and combination, and if one or more preset keywords are included in the sound signal, the sound signal may be considered to be related to the user, that is, a useful signal. In one embodiment, it can also be set that at least N (N ≧ 2) preset keyword elements must be included in the audio signal to be considered as a useful signal.
It should be noted that, in this embodiment, although the environmental characteristic information is only one of the semantics of the sound signal, since the preset keyword can more accurately reflect the interest and preference of the user, the relevance can be reliably determined according to the condition that whether the semantics of the sound signal includes the preset keyword. In addition, in some embodiments, the condition of whether the semantic meaning of the sound signal includes the preset keyword may also be applied to a multiple-decision scenario.
In one embodiment, the environmental characteristic information includes a number of people in a set range in the environment; the method for acquiring the environmental characteristic information of the earphone worn by the user in the noise reduction mode comprises the following steps: the method comprises the steps that millimeter waves are transmitted through a transmitting antenna of a terminal, and scattered waves of at least one detection target to the millimeter waves are received through a receiving antenna of the terminal; determining that the detection target is a person according to the scattered waves, and determining the distance between the terminal and the person through the time difference between the millimeter wave transmitting time and the scattered wave receiving time; and determining the number of people in a set range in the environment according to the distance between the terminal and the people.
In this embodiment, the millimeter wave may refer to an electromagnetic wave with a wavelength of 1 to 10 mm (corresponding to a frequency range of 30 to 300 GHz), and the millimeter wave may be transmitted through a transmitting antenna of the terminal. The detection target may refer to an object capable of reflecting millimeter waves, including a person to be detected within a set range in the environment. The scattered wave may refer to a signal wave reflected after the millimeter wave transmitted by the transmitting antenna is transmitted to the probe target and interacts with a dielectric constant in the probe target, and may be received by the receiving antenna of the terminal. According to the emitted millimeter waves and the received scattered waves of the detection targets, the distance between the earphones and the detection targets can be determined, and then the number of the detection targets in the set range in the environment is determined. On this basis, if it can be determined whether or not each detection target is a person, the number of persons within the set range in the environment can be accurately determined. In the step, the number of people in the set range in the environment can be determined in a mode that the transmitting antenna transmits millimeter waves at fixed time and the receiving antenna receives scattered waves in real time.
It should be noted that, if the terminal is a chip or an electronic device integrated in the earphone, or the terminal is a terminal device independent from the earphone and the earphone is a wired earphone, the terminal and the user may be considered to be located at the same position, and the terminal is used as a central point to emit millimeter waves, so that the distance between the earphone (that is, the terminal or the user) and the detection target may be determined. If the terminal is a terminal device independent of the earphone and the earphone is a wireless earphone (e.g., a bluetooth earphone), there may be a certain distance between the earphone and the terminal, and if the user wearing the bluetooth earphone is at a distance of 2 meters from the terminal, there may be a certain error between the distance determined by taking the terminal as a central point and the detected person. In this case, after the distance between the terminal and the person is determined, the distance between the person and the earphone can be obtained through conversion according to the distance and the position relation between the bluetooth earphone and the terminal, and therefore detection of the person in the environment can be achieved. The algorithm for distance conversion is not limited herein. In some embodiments, if the distance between the wireless headset and the terminal is much smaller than the distance between the wireless headset and the person, the error can be ignored.
Fig. 2 is a schematic diagram illustrating an embodiment of detecting a person by using millimeter waves. As shown in fig. 2, taking the case that the terminal is a terminal device independent from the headset and the headset is a wired headset (i.e. the terminal and the headset are regarded as the same position) as an example, the process of determining the distance between the headset and the detected person according to the time difference between the emission of the millimeter waves and the reception of the scattered waves is as follows:
firstly, millimeter waves S1 are transmitted through a transmitting antenna in a terminal, if people exist around the terminal, due to the fact that the dielectric constant of a detection target is constant, scattered waves S2 with certain characteristic signals can be generated after the dielectric constant interacts with the millimeter waves S1;
then, a receiving antenna in the terminal receives the reflected scattered wave S2, and assuming that the transmission time of the millimeter wave S1 is T1 and the receiving time of the scattered wave S2 is T2, the distance D between the terminal and the person can be represented as:
Figure BDA0003264601620000081
where C represents the speed of light.
In an embodiment, the time duration t1 for the millimeter waves S1 to be transmitted from the terminal to the detected object to be received and the time duration t2 for the millimeter waves S2 to be transmitted from the detected object to be received may also be determined, and specifically, the distance D between the terminal and the detected object may be represented as:
Figure BDA0003264601620000082
where C represents the speed of light.
In one embodiment, determining the detection target as a human figure according to the scattered waves comprises: determining attribute characteristics of the detection target according to the scattered waves, wherein the attribute characteristics comprise shape and/or area; and if the attribute characteristics accord with the character characteristics, determining that the detection target is a character.
In this embodiment, the attribute feature corresponding to the human character feature may be regarded as that the determined shape and/or area of the detection target approximately corresponds to the shape and/or area of the human body. Since there may be an object with the same or similar dielectric constant as the human body in the set range in the environment, if the main component of the human body is liquid, if there is a cup of milk tea around it, the milk tea will be judged as the human body by mistake in the detection. Therefore, before determining the distance between the terminal and the detection target, it is also determined whether the detection target is a human based on whether the determined attribute feature of the detection target matches the human feature.
Fig. 3 is a schematic diagram illustrating an embodiment of identifying a length of a detection target by using millimeter waves. As shown in fig. 3, taking the case that the terminal is a terminal device independent of the earphone and the earphone is a wired earphone (i.e. the terminal and the earphone are regarded as the same position) as an example, since the distance between the transmitting antenna and the receiving antenna is relatively short and can be ignored with respect to a far detection target, the transmitting antenna and the receiving antenna can be disposed at one position to identify the length of the detection target. The specific implementation process is as follows: firstly, respectively transmitting millimeter waves to a position A and a position B of a detection target by a transmitting antenna; then, according to the time difference between the millimeter wave emission and the scattered wave reception, the distances D1 and D2 between the terminal and the position A and the position B of the detection target and the included angle theta between the distances D1 and D2 are respectively determined; and finally, calculating the length | AB | between the position A and the position B of the detection target according to the cosine theorem, wherein the length | AB | can be expressed as follows:
Figure BDA0003264601620000083
the method can be used for calculating the lengths and included angles of the detection target at a plurality of different positions or in different directions, and on the basis, the mapping area and/or the shape of the detection target can be obtained. Then, area and/or shape can be defined in advance according to character characteristics, for example, a specific range can be preset for the area and/or shape; if the acquired area and/or shape of the detection target is within the range, the detection target can be determined to be a valid target, i.e., to conform to the human character, and can be determined to be a human character. The specific range is not limited to the setting herein.
FIG. 4 is a diagram illustrating an embodiment of determining a number of people in a set range in an environment. As shown in fig. 4, the number of persons within the range of the set radius R is detected based on the distance from the detection target (the detection target is determined to be a person) with the terminal as the center. On the basis, the number of people is compared with a preset number of people threshold, and if the determined number of people is smaller than the number of people threshold, the condition is met, and basis can be provided for the control of the next earphone target working mode. This embodiment passes through 5G millimeter wave recognition function, can effectively fix a position the personage in the earphone external environment to specific number of people is discerned to the accuracy.
In one embodiment, the number of people in the external environment of the earphone can be detected by the base station through communication with the terminal and notified to the terminal. According to the interactive communication between the base station and the terminal, the terminal can be quickly positioned by utilizing the Fourth Generation mobile communication (4G) and 5G technologies. Currently, two base stations can be used to locate a terminal, or one base station can be used to locate a terminal, so that the base station determines the number of people in a set range and then informs the terminal. However, in the method of determining the number of people in the environment by positioning the terminal using the base station, it is necessary to ensure that each person has the terminal, so the method has certain use limitation, and people without carrying the terminal cannot be positioned.
Taking a terminal as an example of a mobile phone, fig. 5A is a schematic diagram of an embodiment of implementing mobile phone positioning by using two base stations. As shown in fig. 5A, first, when the base station 1 interacts with the mobile phone, a distance X1 between the base station 1 and the mobile phone can be obtained, and a circle is generated with the base station 1 as a center and the X1 as a radius; then, when the base station 2 interacts with the mobile phone, the distance X2 between the base station 2 and the mobile phone can be obtained, and a circle is also generated by taking the base station 2 as a center and taking X2 as a radius; and finally, the intersection point of the two generated circles is the position of the mobile phone. On the basis, the base station can detect the number of the mobile phones within the set range and inform the terminal.
Fig. 5B is a schematic diagram of implementing handset positioning by using a base station according to an embodiment. As shown in fig. 5B, according to the uplink signal collected by the base station, the position and angular momentum information of the mobile phone can be obtained, so as to accurately locate the position of the mobile phone. The uplink signal may refer to a mobile phone signal received by the base station. On the basis, the base station can detect the number of the mobile phones in the set range and inform the terminal.
Fig. 6 is a schematic diagram of processing an audio signal to obtain the frequency of the audio signal according to an embodiment. In this embodiment, the environmental characteristic information includes a frequency of the sound signal. As shown in fig. 6, the sound signal is collected and processed to obtain the signal frequency as follows: firstly, collecting sound signals in the environment through signal collection equipment; then, the collected sound signal can be subjected to signal processing by an audio signal processing system, for example, the frequency of the sound signal can be obtained by a fourier transform method; and finally, judging whether the frequency of the sound signal is within the limited frequency range (such as 500-2000 Hz), if so, meeting the condition, and providing a basis for controlling the target working mode of the earphone.
Fig. 7 is a schematic diagram of processing a sound signal to obtain the loudness of the sound signal according to an embodiment. In this embodiment, the environment characteristic information includes loudness of the sound signal. As shown in fig. 7, the sound signal is collected and processed to obtain the loudness of the signal as follows: firstly, collecting sound signals in the environment through signal collection equipment; then, the collected sound signal can be subjected to signal processing through an audio signal processing system to obtain the loudness of the sound signal; and finally, judging whether the loudness of the sound signal is greater than a preset loudness threshold value, if so, meeting the condition, and providing a basis for controlling the target working mode of the earphone. The signal processing method for obtaining loudness is not limited herein.
FIG. 8 is a diagram illustrating an embodiment of processing an audio signal to obtain audio signal semantics. In this embodiment, the environmental characteristic information includes a semantic meaning of the sound signal. As shown in fig. 8, the implementation process of acquiring and processing the sound signal to obtain the corresponding text content is as follows: firstly, collecting sound signals in the environment through signal collection equipment; then, the collected sound signal can be processed by an audio signal processing system, for example, the text content corresponding to the sound signal can be obtained by a speech recognition model in the system; and finally, judging whether the text content corresponding to the sound signal contains preset keywords or not, if so, meeting the conditions and providing a basis for controlling the target working mode of the earphone. The manner of acquiring the text content corresponding to the sound signal is not limited herein.
On the basis of the embodiment, in the text content corresponding to the acquired sound signal, the detected information matched with the preset keyword can be displayed on a display screen of the terminal, so as to remind the user of quickly positioning the sound information in the environment. According to the embodiment, the keyword elements are arranged and combined, so that the matching degree identification accuracy between the semantics of the sound signal and the preset keywords can be improved, and the user can be effectively helped to acquire useful sound information in the environment.
It should be noted that the signal acquisition device mentioned in the above embodiments may refer to a microphone in a terminal or an electronic device integrated in an earphone; likewise, an audio signal processing system may also refer to an electronic device integrated in a terminal or an earphone. This is not a limitation here.
In one embodiment, the controlling the working mode of the earphone according to the relevance of the environment corresponding to the environment characteristic information and the user comprises: controlling the earphone to be in a non-noise reduction mode under the condition that the relevance is relevant to the user; under the condition that the relevance is relevant to the user, controlling the earphone to be in a noise reduction mode, and reducing the playing volume of the earphone; controlling the earphone to be in a noise reduction mode and displaying inquiry information about the working mode under the condition that the relevance is relevant to the user; and controlling the earphone to be in a noise reduction mode under the condition that the relevance is irrelevant to the user.
In this embodiment, the query information about the operation mode may be regarded as selection information about whether to exit the noise reduction mode, which is displayed on the display screen of the terminal. Under the condition that the relevance is relevant to the user, a plurality of control modes of the working mode of the earphone exist, for example, the earphone can be controlled to be in a non-noise reduction mode; the noise reduction mode may be maintained, but the user may be enabled to hear useful external sound by lowering the volume of the headphone playing, etc. And under the condition that the relevance is irrelevant to the user, the user can not do any operation, and the earphone is only required to be kept in the noise reduction mode.
Controlling the earphone to work in a non-noise reduction mode comprises various modes, such as directly quitting the noise reduction function of the earphone and waiting for the user to manually start again; or temporarily turning off the noise reduction function until the noise reduction mode re-start condition is met and then automatically turning on, wherein the noise reduction re-start condition may be a preset time value, and the preset time value may be approximately a period of time (e.g. 5 seconds), and the like, which is not limited; or temporarily closing the noise reduction function until the sound signal in the preset frequency range of the human voice is not detected; it is also possible to temporarily switch off the noise reduction function until the detected sound within the surrounding environment is noisy, etc.
Controlling the earphone to work in the noise reduction mode also comprises various modes, for example, after controlling the earphone to continuously work in the noise reduction mode, the playing volume of the earphone can be automatically reduced, or playing is paused, so that a user can judge whether the sound in the environment is related to the user, if the sound is not related to the user, the original volume of the earphone can be automatically recovered, and if the sound is related to the user, the user can select whether to continuously use the noise reduction mode of the earphone through the terminal; or, while the noise reduction mode is kept on, the terminal displays inquiry information about the working mode or reminds the user whether to select to turn off the noise reduction mode in a voice mode.
Fig. 9 is a flowchart of another method for controlling an operating mode of an earphone according to an embodiment. As shown in fig. 9, in this embodiment, three conditions are taken as an example to control the working mode of the earphones, that is, the number of people in the set range in the environment is lower than the threshold number of people, the frequency of the sound signal in the environment is in the preset frequency range, and the loudness of the sound signal in the environment is greater than the loudness threshold, and the method provided in this embodiment includes:
step 210: the number of people in the set range in the environment is determined.
Step 220: determining whether the number of people is below a threshold number of people; if yes, go to step 230; if not, go to step 280.
In this embodiment, if the number of people in the set range in the environment outside the earphone is higher than the number of people threshold when the sound signal is detected, it is determined that the relevance is irrelevant to the user, and the earphone can be controlled to continue to operate in the noise reduction mode. If the threshold of the number of people in the set range with the radius of 6 meters is set to be 3 by taking the earphone as the center, under the environment with a large number of people such as a subway station or a bus, the number of people detected in most cases exceeds 3, and the noise reduction mode can not be closed at the moment; if the number of people is lower than the set number of people threshold, the relevance is preliminarily judged to be related to the user, and the next judgment of the earphone working mode is continued.
Step 230: the frequency of the sound signal in the environment is determined.
Step 240: judging whether the frequency of the sound signal is in a preset frequency range or not; if yes, go to step 250; if not, go to step 280.
In this embodiment, if the frequency of the sound signal is not within the preset frequency range, which indicates that the sound signal may be an unvoiced sound signal, it may be determined that the relevance is irrelevant to the user, and the headset may be controlled to continue to operate in the noise reduction mode; if the frequency of the sound signal is within the preset frequency range, the influence of part of non-human voice in the sound signal is eliminated, the relevance can be further judged to be related to the user, and the next judgment is continued.
Step 250: the loudness of a sound signal in an environment is determined.
Step 260: determining whether the loudness of the sound signal is greater than a loudness threshold; if yes, go to step 270; if not, go to step 280.
In this embodiment, after the number of people in the set range in the environment and the frequency of the sound signal are determined, an erroneous determination of switching of the working mode of the earphone may still be generated, and at this time, whether the sound signal is related to the user may also be determined by determining the loudness of the sound signal. For example, the problem of the whisper discussion of the surrounding classmates in the library is irrelevant to the user, but the frequency of the emitted sound signal may be in a preset frequency range, and the judgment can be continued through the loudness of the sound; and the loudness threshold value can be adjusted according to the actual environment where the user is located, if the book tube environment is quite quiet, the loudness threshold value can be properly increased to filter out unnecessary sound signals, so that the working mode of the earphone does not need to be frequently switched, and the user is prevented from feeling the noise reduction function of the earphone.
Step 270: and determining the relevance as relevant to the user, and controlling the earphone to be in the target working mode.
In this embodiment, the relevance may be finally determined to be related to the user when three conditions are satisfied, that the number of people in the set range in the environment is lower than the threshold number of people, the frequency of the sound signal in the environment is in the preset frequency range, and the loudness of the sound signal in the environment is greater than the loudness threshold. Under the condition that the relevance is relevant to the user, the earphone can be controlled to be in a target working mode according to the actual condition, for example, the earphone can be controlled to be in a non-noise reduction mode; the earphone can also be controlled to be in the noise reduction mode continuously, and at the moment, the user can hear external sound clearly by reducing the playing volume of the earphone or pausing the playing and the like; the earphone can also be controlled to be continuously in the noise reduction mode, and at the moment, the user can select whether to exit the noise reduction mode or not through inquiry information about the working mode displayed on a display screen of the terminal.
Step 280: and determining the relevance to be irrelevant to the user, and controlling the earphone to be in a noise reduction mode.
In this embodiment, determining that the correlation is irrelevant to the user may indicate that the detected sound signal is useless for the user, and the user may continue to keep the noise reduction mode of the headphone and focus on the content played by the headphone.
According to the method for controlling the working mode of the earphone, the conditions corresponding to the three kinds of environment characteristic information are combined, so that multiple judgment and screening of sound signals can be realized; on the basis, according to the sound signals after multiple judgment, the working mode switching of the earphone can be controlled more accurately and timely, misjudgment of earphone working mode switching is effectively avoided, and the use experience of a user on the earphone noise reduction function is improved.
The embodiment of the application also provides a device for controlling the working mode of the earphone. Fig. 10 is a schematic structural diagram of an earphone operation mode control device according to an embodiment. As shown in fig. 10, the apparatus includes:
an information obtaining module 310 configured to obtain environmental characteristic information of an earphone worn by a user in a noise reduction mode;
the control module 320 is configured to control the working mode of the headset according to the relevance between the environment corresponding to the environment feature information and the user.
The earphone working mode control device of the embodiment can make clear the relevance between the environment and the user by utilizing the environment characteristic information for the earphone in the noise reduction mode, thereby controlling the working mode of the earphone and enabling the earphone to work in the working mode adaptive to the surrounding environment, so that the adaptability of the noise reduction function of the earphone to the environment is improved, and the use experience of the user on the noise reduction function of the earphone can also be improved.
In an embodiment, the environmental characteristic information comprises at least one of: a number of people within a set range in the environment; a frequency of a sound signal in the environment; a loudness of a sound signal in the environment; semantics of the sound signal in the environment.
In one embodiment, the control module 320 includes:
the correlation determination unit is set to determine that the correlation is related to the user if the environmental characteristic information meets at least two conditions, and the earphone is controlled to be in a target working mode;
wherein the conditions include: the number of people in the set range in the environment is lower than a threshold number of people; the frequency of the sound signal in the environment is within a preset frequency range; the loudness of the sound signal in the environment is greater than a loudness threshold.
In one embodiment, the control module 320 includes:
and the earphone control unit is used for setting the semanteme of the sound signal in the environment to include a preset keyword, determining that the relevance is related to the user, and controlling the earphone to be in a target working mode.
In an embodiment, the apparatus is specifically configured to: the environment characteristic information comprises the number of people in a set range in the environment;
on the basis of the above embodiment, the information obtaining module 310 includes:
the scattered wave receiving unit is used for transmitting millimeter waves through a transmitting antenna of the terminal and receiving scattered waves of at least one detection target for the millimeter waves through a receiving antenna of the terminal;
the figure and distance determining unit is used for determining that the detection target is a figure according to the scattered waves and determining the distance between the terminal and the figure according to the time difference between the millimeter wave transmitting time and the scattered wave receiving time;
and the number-of-people determining unit is set to determine the number of people in the set range in the environment according to the distance between the terminal and the people.
In one embodiment, the person-to-distance determining unit includes:
an attribute characteristic determination subunit, configured to determine an attribute characteristic of the detection target according to the scattered wave, where the attribute characteristic includes a shape and/or an area;
and the person determining subunit is used for determining that the detection target is a person if the attribute characteristics are set to accord with the person characteristics.
In one embodiment, the control module 320 includes:
a non-noise reduction mode control unit, configured to control the headset to be in a non-noise reduction mode when the relevance is related to a user;
the first noise reduction mode control unit is set to control the earphone to be in a noise reduction mode and reduce the playing volume of the earphone under the condition that the relevance is related to a user;
a second noise reduction mode control unit configured to control the headphone to be in a noise reduction mode and display inquiry information about a working mode, in a case where the relevance is related to a user;
and the third noise reduction mode control unit is used for controlling the earphone to be in a noise reduction mode under the condition that the relevance is irrelevant to the user.
The earphone working mode control device proposed by the present embodiment is the same as the earphone working mode control method proposed by the above embodiment, and technical details not described in detail in the present embodiment can be referred to any of the above embodiments, and the present embodiment has the same beneficial effects as the execution of the earphone working mode control method.
The embodiment of the application also provides a terminal. Fig. 11 is a schematic hardware structure diagram of a terminal according to an embodiment, as shown in fig. 11, the terminal provided in the present application includes a processor 410, a storage device 420, and a computer program stored on the storage device 420 and capable of being executed on the processor 410, and when the processor 410 executes the computer program, the above-mentioned earphone operation mode control method is implemented.
The terminal may also include a storage 420; the processor 410 in the terminal may be one or more, and fig. 11 illustrates one processor 410 as an example; storage 420 is used to store one or more programs; the one or more programs are executed by the one or more processors 410, so that the one or more processors 410 implement the headset operation mode control method as described in the embodiment of the present application.
The terminal further includes: a communication device 430, an input device 440, and an output device 450.
The processor 410, the storage 420, the communication 430, the input 440 and the output 450 in the terminal may be connected by a bus or other means, and fig. 11 illustrates the connection by a bus as an example.
The input device 440 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the terminal. The output device 450 may include a display device such as a display screen.
The communication device 430 may include a receive antenna and a transmit antenna. The communication device 430 is configured to receive scattered waves or emit millimeter waves according to the control of the processor 410, and may also perform information transceiving communication with other surrounding terminals or base stations.
The storage device 420, which is a computer-readable storage medium, may be configured to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the earphone operation mode control method according to the embodiment of the present application (for example, the information obtaining module 310 and the control module 320 in the earphone operation mode control device). The storage device 420 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the test equipment, and the like. Further, the storage 420 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the storage 420 may further include memory located remotely from the processor 410, which may be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The embodiment of the present application further provides a storage medium, where a computer program is stored, and when the computer program is executed by a processor, the method for controlling the working mode of the earphone according to any one of the embodiments of the present application is implemented. The method comprises the following steps: acquiring environmental characteristic information of an earphone worn by a user in a noise reduction mode; and controlling the working mode of the earphone according to the relevance between the environment corresponding to the environment characteristic information and the user.
The computer storage media of the embodiments of the present application may take any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer-readable storage medium may be, for example, but is not limited to: an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), a flash Memory, an optical fiber, a portable CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. A computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take a variety of forms, including, but not limited to: an electromagnetic signal, an optical signal, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, radio Frequency (RF), etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The above description is only exemplary embodiments of the present application, and is not intended to limit the scope of the present application.
It will be clear to a person skilled in the art that the term user terminal covers any suitable type of wireless user equipment, such as a mobile phone, a portable data processing device, a portable web browser or a car mounted mobile station.
In general, the various embodiments of the application may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the application is not limited thereto.
Embodiments of the application may be implemented by a data processor of a mobile device executing computer program instructions, for example in a processor entity, or by hardware, or by a combination of software and hardware. The computer program instructions may be assembly instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages.
Any logic flow block diagrams in the figures of this application may represent program steps, or may represent interconnected logic circuits, modules, and functions, or may represent a combination of program steps and logic circuits, modules, and functions. The computer program may be stored on a memory. The Memory may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as, but not limited to, read-Only Memory (ROM), random Access Memory (RAM), optical storage devices and systems (Digital versatile disks (DVD) or Compact Disks (CD), etc. computer-readable media may comprise non-transitory storage media.
The foregoing has provided by way of exemplary and non-limiting examples a detailed description of exemplary embodiments of the present application. Various modifications and adaptations to the foregoing embodiments may become apparent to those skilled in the relevant arts in view of the drawings and the following claims without departing from the scope of the invention. Accordingly, the proper scope of the application is to be determined according to the claims.

Claims (10)

1. A method for controlling the working mode of an earphone is applied to a terminal, and the method comprises the following steps:
acquiring environmental characteristic information of an earphone worn by a user in a noise reduction mode;
and controlling the working mode of the earphone according to the relevance between the environment corresponding to the environment characteristic information and the user.
2. The method of claim 1, wherein the environmental characteristic information comprises at least one of:
a number of people within a set range in the environment;
a frequency of a sound signal in the environment;
a loudness of a sound signal in the environment;
semantics of the sound signal in the environment.
3. The method of claim 2, wherein controlling the operating mode of the headset according to the relevance of the environment corresponding to the environment feature information to the user comprises:
if the environment characteristic information meets at least two conditions, determining that the relevance is related to the user, and controlling the earphone to be in a target working mode;
wherein the conditions include:
the number of people in the set range in the environment is lower than a threshold number of people;
the frequency of the sound signal in the environment is within a preset frequency range;
the loudness of the sound signal in the environment is greater than a loudness threshold.
4. The method according to claim 2, wherein controlling the working mode of the headset according to the relevance of the environment corresponding to the environment feature information to the user comprises:
and if the semantics of the sound signals in the environment comprise preset keywords, determining that the relevance is related to the user, and controlling the earphone to be in a target working mode.
5. The method of claim 2, wherein the environmental characteristic information includes a number of people within a set range in the environment;
the acquiring of the environmental characteristic information of the headset worn by the user in the noise reduction mode includes:
transmitting millimeter waves through a transmitting antenna of the terminal, and receiving scattered waves of at least one detection target for the millimeter waves through a receiving antenna of the terminal;
determining that the detection target is a person according to the scattered waves, and determining the distance between the terminal and the person according to the time difference between the millimeter wave transmitting time and the scattered wave receiving time;
and determining the number of people in the set range in the environment according to the distance between the terminal and the people.
6. The method of claim 5, wherein the determining that the detected object is a human being according to the scattered waves comprises:
determining attribute characteristics of the detection target according to the scattered waves, wherein the attribute characteristics comprise shapes and/or areas;
and if the attribute characteristics accord with the characteristics of the people, determining that the detection target is the people.
7. The method according to any one of claims 3 to 6, wherein controlling the working mode of the headset according to the relevance of the environment corresponding to the environment characteristic information and the user comprises:
controlling the earphone to be in a non-noise reduction mode under the condition that the relevance is relevant to a user;
controlling the earphone to be in a noise reduction mode and reducing the playing volume of the earphone under the condition that the relevance is relevant to the user;
controlling the earphone to be in a noise reduction mode and displaying inquiry information about a working mode under the condition that the relevance is relevant to a user;
and controlling the earphone to be in a noise reduction mode under the condition that the relevance is irrelevant to the user.
8. An earphone operation mode control device, comprising:
the information acquisition module is used for acquiring environmental characteristic information of an earphone worn by a user in a noise reduction mode;
and the control module is set to control the working mode of the earphone according to the relevance between the environment corresponding to the environment characteristic information and the user.
9. A terminal, comprising:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the headset operating mode control method of any one of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out a method of controlling an operating mode of a headset according to any one of claims 1-7.
CN202111082536.9A 2021-09-15 2021-09-15 Earphone working mode control method, device, terminal and medium Pending CN115811681A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202111082536.9A CN115811681A (en) 2021-09-15 2021-09-15 Earphone working mode control method, device, terminal and medium
PCT/CN2022/108912 WO2023040483A1 (en) 2021-09-15 2022-07-29 Headphone working mode control method and apparatus, terminal, and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111082536.9A CN115811681A (en) 2021-09-15 2021-09-15 Earphone working mode control method, device, terminal and medium

Publications (1)

Publication Number Publication Date
CN115811681A true CN115811681A (en) 2023-03-17

Family

ID=85482040

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111082536.9A Pending CN115811681A (en) 2021-09-15 2021-09-15 Earphone working mode control method, device, terminal and medium

Country Status (2)

Country Link
CN (1) CN115811681A (en)
WO (1) WO2023040483A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116405963B (en) * 2023-06-09 2023-08-22 深圳市微克科技有限公司 Bluetooth intelligent switch implementation method, system and medium based on dual-mode scheme

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5630538B2 (en) * 2013-07-01 2014-11-26 ソニー株式会社 Noise canceling system
CN104618829A (en) * 2014-12-29 2015-05-13 歌尔声学股份有限公司 Adjusting method of earphone environmental sound and earphone
EP3188495B1 (en) * 2015-12-30 2020-11-18 GN Audio A/S A headset with hear-through mode
CN108156550B (en) * 2017-12-27 2020-03-31 上海传英信息技术有限公司 Playing method and device of headset
US10681453B1 (en) * 2019-06-12 2020-06-09 Bose Corporation Automatic active noise reduction (ANR) control to improve user interaction
CN111683317B (en) * 2020-05-28 2022-04-08 江苏紫米电子技术有限公司 Prompting method and device applied to earphone, terminal and storage medium
CN112004174B (en) * 2020-08-27 2023-05-26 深圳市万声文化科技有限公司 Noise reduction control method, device and computer readable storage medium
CN112770214B (en) * 2021-01-28 2022-11-11 歌尔科技有限公司 Earphone control method and device and earphone
CN113596670B (en) * 2021-08-30 2022-10-14 歌尔科技有限公司 Earphone, earphone noise reduction mode switching method and device, and storage medium

Also Published As

Publication number Publication date
WO2023040483A1 (en) 2023-03-23

Similar Documents

Publication Publication Date Title
KR101981878B1 (en) Control of electronic devices based on direction of speech
JP6489563B2 (en) Volume control method, system, device and program
EP2973558B1 (en) Methods for adaptive acoustic processing based on characterising the acoustic environment
CN108962240A (en) A kind of sound control method and system based on earphone
JP2022523150A (en) Privacy device for smart speakers
KR102363872B1 (en) Key phrase detection using audio watermarking
CN108681440A (en) A kind of smart machine method for controlling volume and system
WO2021218377A1 (en) Noise reduction mode control method and apparatus, electronic device and storage medium
US11437021B2 (en) Processing audio signals
CN106528545B (en) Voice information processing method and device
CN109445739A (en) Audio frequency playing method, device, electronic equipment and computer-readable medium
CN106791067B (en) Call volume adjusting method and device and mobile terminal
CN108538320A (en) Recording control method and device, readable storage medium storing program for executing, terminal
CN109361995B (en) Volume adjusting method and device for electrical equipment, electrical equipment and medium
CN106940997B (en) Method and device for sending voice signal to voice recognition system
KR102633176B1 (en) Methods for reducing errors in environmental noise compensation systems
CN112230877A (en) Voice operation method and device, storage medium and electronic equipment
CN116324969A (en) Hearing enhancement and wearable system with positioning feedback
WO2023040483A1 (en) Headphone working mode control method and apparatus, terminal, and medium
CN108769364B (en) Call control method, device, mobile terminal and computer readable medium
CN112259076B (en) Voice interaction method, voice interaction device, electronic equipment and computer readable storage medium
KR20200113058A (en) Apparatus and method for operating a wearable device
EP3493200B1 (en) Voice-controllable device and method of voice control
CN112866480B (en) Information processing method, information processing device, electronic equipment and storage medium
CN112911062A (en) Voice processing method, control device, terminal device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination