WO2023040483A1 - Headphone working mode control method and apparatus, terminal, and medium - Google Patents

Headphone working mode control method and apparatus, terminal, and medium Download PDF

Info

Publication number
WO2023040483A1
WO2023040483A1 PCT/CN2022/108912 CN2022108912W WO2023040483A1 WO 2023040483 A1 WO2023040483 A1 WO 2023040483A1 CN 2022108912 W CN2022108912 W CN 2022108912W WO 2023040483 A1 WO2023040483 A1 WO 2023040483A1
Authority
WO
WIPO (PCT)
Prior art keywords
environment
earphone
user
working mode
sound signal
Prior art date
Application number
PCT/CN2022/108912
Other languages
French (fr)
Chinese (zh)
Inventor
胡海林
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2023040483A1 publication Critical patent/WO2023040483A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification techniques
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78—Detection of presence or absence of voice signals
    • G10L25/84—Detection of presence or absence of voice signals for discriminating voice from noise
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the present application relates to the technical field of noise-cancelling earphone control, for example, to a method, device, terminal and medium for controlling an earphone working mode.
  • the fifth generation mobile communication (Fifth Generation, 5G) network compared with previous generations of mobile communication networks, provides higher speed, greater capacity, and new functions and services, supporting more More and more connected devices, such as headphones, etc.
  • Noise-cancelling headphones refer to a kind of headphones that use a method to reduce noise. But there are also many derived problems. When using the noise reduction function of the earphones, while shielding the external noise, it will also shield the useful sounds in the environment; Calls from people nearby or other useful information.
  • This application provides an earphone working mode control method, device, terminal and medium to control the earphone to work in a working mode that is compatible with the surrounding environment, thereby improving the adaptability of the noise reduction function of the earphone to the environment, and also improving the user's understanding of the earphone.
  • the experience of using the noise reduction function is improved.
  • This application provides a headset working mode control method, which is applied to a terminal, including:
  • the present application also provides a headset working mode control device, including:
  • the information acquisition module is configured to acquire the environmental feature information of the earphone worn by the user in the noise reduction mode; the control module is configured to control the working mode of the earphone according to the correlation between the environment and the user corresponding to the environmental feature information.
  • the present application also provides a terminal, including one or more processors; a storage device configured to store one or more programs; when the one or more programs are executed by the one or more processors, so that the The one or more processors implement the above method for controlling the working mode of the earphone.
  • the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the above-mentioned headphone working mode control method is realized.
  • FIG. 1 is a flow chart of a method for controlling an earphone working mode provided by an embodiment
  • Fig. 2 is a schematic diagram of detecting people by using millimeter waves provided by an embodiment
  • Fig. 3 is a schematic diagram of using millimeter waves to identify the length of a detection target provided by an embodiment
  • Fig. 4 is a schematic diagram of determining the number of people within a set range in an environment provided by an embodiment
  • FIG. 5A is a schematic diagram of using two base stations to realize mobile phone positioning provided by an embodiment
  • FIG. 5B is a schematic diagram of using a base station to realize mobile phone positioning provided by an embodiment
  • Fig. 6 is a schematic diagram of processing a sound signal to obtain the frequency of the sound signal provided by an embodiment
  • Fig. 7 is a schematic diagram of processing a sound signal to obtain the loudness of the sound signal provided by an embodiment
  • Fig. 8 is a schematic diagram of processing a sound signal to obtain the semantics of the sound signal provided by an embodiment
  • Fig. 9 is a flow chart of another earphone working mode control method provided by an embodiment
  • Fig. 10 is a schematic structural diagram of an earphone working mode control device provided by an embodiment
  • Fig. 11 is a schematic diagram of a hardware structure of a terminal provided by an embodiment.
  • Fig. 1 is a flow chart of a method for controlling a working mode of an earphone provided by an embodiment. This embodiment is applicable to the situation where the working mode of the earphone is flexibly controlled.
  • the method for controlling the working mode of the earphone can be executed by the device for controlling the working mode of the headset, which can be realized by means of software and/or hardware, and integrated in the terminal.
  • the terminal can be a terminal device independent of the headset, including but not limited to a computer, tablet computer, mobile phone, or audio and video player (such as MP3 or MP4), or a chip or electronic device integrated in the headset.
  • the method for controlling the working mode of the headset in this embodiment includes S110 and S120.
  • the earphone mainly refers to an earphone with a noise reduction function, that is, a noise reduction earphone.
  • Noise canceling headphones can be divided into two types: active noise canceling headphones and passive noise canceling headphones.
  • the working principle of active noise reduction headphones can be considered to be that the noise reduction system generates reverse sound waves equal to the external noise to neutralize the noise, thereby achieving the effect of noise reduction.
  • the working principle of passive noise-canceling headphones can be considered as forming a closed space by surrounding the ears, or using sound-isolating materials such as silicone earplugs to block external noise.
  • earphones may refer to active noise canceling earphones.
  • the earphone may be a wired earphone or a wireless earphone, which is not limited here.
  • the wired headset can perform data transmission with the terminal through a data cable, etc.
  • the wireless headset can perform data transmission with the terminal through Bluetooth or a wireless network (Wireless Fidelity, WIFI).
  • Environmental characteristic information can refer to information obtained after specific processing of a kind of information or signal in the environment outside the earphone detected, which can indicate whether the environment may be relevant to the user; among them, the signal in the environment It mainly refers to the sound signal, and the detected sound signal can be signal-processed according to actual needs to obtain the corresponding environmental feature information; the information in the environment can be the number or density of people in the environment, the type of environment (for example, the library corresponds to a relatively A quiet environment type, a train station corresponds to a relatively noisy environment type) and so on.
  • the environmental feature information may include the number of people within the environment setting range, the frequency of the detected sound signal, the loudness of the sound signal, and/or the semantics of the sound signal, etc. These environmental feature information can be used to judge the relationship between the environment and the user , that is, to judge whether there may be information that is useful to the user or worthy of the user's attention in the environment.
  • the information or signal in the environment can be detected through a terminal device independent of the earphone, or the information or signal in the environment can be obtained through a chip or electronic device integrated in the earphone, It is collected and stored, and waits for subsequent processing to obtain environmental feature information.
  • the implementation manner of detecting information or signals in the environment is not limited here.
  • the working mode of the earphone is controlled according to the correlation between the environment and the user corresponding to the environment characteristic information.
  • the correlation between the environment corresponding to the environmental characteristic information and the user can be considered as whether the sound signal detected in the environment is related to the user, or whether it is useful to the user, or worthy of the user's attention, etc.
  • the correlation includes at least two levels, for example, it may include strong correlation, medium correlation, weak correlation, and no correlation. The stronger the correlation, the more the user needs to pay attention to the sounds in the environment, such as diverting the user's attention from the sound played by the headset. The content is transferred to the sound signal detected in the environment.
  • the working mode of the earphone can be controlled to make it easier for the user to hear the sound signal in the environment.
  • the earphone can be controlled to work in non-noise reduction mode, low volume mode or pause playback mode etc. If the correlation is weak, the user does not need to pay attention to the sound in the environment, and the user can continue to focus on the content played by the earphone. At this time, the user earphone can continue to work in the noise reduction mode.
  • the environment when the user wears headphones and is at a train station, there are a lot of people within the set range in the environment, the environment is noisy, and most of the environment is noise or voices of people who have nothing to do with the user. At this time, the environment can be considered It has nothing to do with the user or the correlation is weak. In this case, the user does not need to pay attention to the information in the environment, and only needs to control the headset to work in the noise reduction mode.
  • the user wears headphones and is at home there are few people within the set range in the environment, and the environment is relatively quiet. Once someone speaks or detects any movement, the user needs to pay attention or check.
  • the environment at this time is related to the user. Or the correlation is strong.
  • the earphone can be controlled to work in a non-noise reduction mode, so that the user can focus or check and avoid missing important information.
  • the flexible control of the working mode of the headset can be realized to adapt to the environment.
  • the embodiment of the present application provides a method for controlling the working mode of the earphone.
  • the correlation between the environment and the user corresponding to the environmental feature information is used to control the working mode of the earphone.
  • the working mode adapted to the surrounding environment can realize the flexible and accurate switching of the earphones between noise reduction and non-noise reduction modes according to different correlations, thereby improving the adaptability of the noise reduction function of the earphones to the environment, and also improving the user's understanding of the environment.
  • the experience of using the noise reduction function of headphones On this basis, users can promptly and effectively discover potentially useful information around them and avoid missing important information; in addition, unnecessary mode switching can also be avoided, thereby improving the user's experience with the noise reduction function.
  • the environment feature information includes at least one of the following: the number of people in the environment within a set range; the frequency of the sound signal in the environment; the loudness of the sound signal in the environment; the semantics of the sound signal in the environment.
  • the environment mainly refers to the environment outside the earphone.
  • Different environments correspond to different environmental characteristic information.
  • the number of people within the set range in the environment can be regarded as the number of people within the set radius in the environment outside the headset, centered on the headset.
  • the size of the set radius range which can be flexibly set according to actual needs and the environment.
  • the terminal detects the number of people within the set range in the external environment of the headset. If the terminal is integrated in the earphone, the terminal, the earphone, and the user can be considered to be at the same location, and can be used as the center of the foregoing radius range.
  • the frequency of the sound signal may refer to information corresponding to the sound signal in the frequency domain.
  • the loudness of the sound signal is also called the volume, which can refer to the strength of the sound felt by the human ear, that is, the loudness of the sound, which can be expressed in decibels.
  • the semantics of the sound signal can be regarded as the text content corresponding to the sound signal.
  • the conditions for determining the relevance according to the above-mentioned environmental feature information include at least one of the following:
  • the number of people within the set range in the environment is lower than the threshold of the number of people (if so, it means that the environment around the user is relatively quiet, and the sound signal detected from the environment is likely to be related to the user, and the environment and the user are highly correlated); Whether the frequency of the sound signal in the environment is within the preset frequency range (if it is, it means that the frequency of the sound signal in the environment matches the sound frequency of human speech rather than noise, and the sound signal is likely to be related to the user and has a strong correlation) ; Whether the loudness of the sound signal in the environment is greater than the loudness threshold (if yes, it means that the sound signal in the environment is louder, and it is likely that other people are talking to the user, then the sound signal has a high probability of being related to the user and has a strong correlation ); whether the semantics of the sound signal in the environment contains preset keywords (if yes, it means that the sound signal in the environment contains content that the user is interested in, and has a strong correlation).
  • controlling the working mode of the earphone according to the correlation between the environment and the user corresponding to the environmental characteristic information includes: if the environmental characteristic information satisfies at least two conditions below, then it is determined that the association is related to the user, and the earphone is controlled to be in the target Working mode: the number of people within the set range in the environment is lower than the threshold of the number of people; the frequency of the sound signal in the environment is within the preset frequency range; the loudness of the sound signal in the environment is greater than the loudness threshold.
  • the relationship between the environment and the user may include two types: user-related and user-independent.
  • the target working mode can refer to the working mode that enables the user to hear the sound signal in the environment after determining that the correlation is related to the user;
  • the noise reduction mode the user can hear the sound signal in the environment by other methods (such as reducing the playback volume of the earphone, pausing the playback, etc.).
  • Different environmental feature information corresponds to different conditions.
  • the environmental characteristic information satisfies at least two conditions, that is, at least two kinds of environmental characteristic information respectively satisfy the corresponding conditions.
  • the relevance may be determined to be related to the user.
  • This embodiment adopts a method of multiple determinations to control the working mode of the earphone.
  • the number of people threshold can be considered as the maximum number of people within the set range in the set environment outside the earphone.
  • the condition corresponding to the number of people within the set range in the environment may be: the number of people within the set range in the environment is lower than the preset number threshold. If the user is in a relatively calm environment, in order to avoid missing useful information around, the threshold of the number of people can be set relatively small, such as in a library or office, the threshold of the number of people can be set to 5; if the user is in a relatively chaotic environment In an environment, the threshold of the number of people can be set relatively large, for example, in a train station or a shopping mall, the threshold of the number of people can be set to 20.
  • the threshold of the number of people can be flexibly set according to actual needs and different environments, which is not limited here. On this basis, according to the condition that the number of people within the set range in the environment is lower than the number threshold, the correlation between the environment and the user can be judged from the perspective of whether the surrounding environment of the user is quiet or noisy. On this basis, if there are other environmental feature information and corresponding conditions, the next step of determination can be continued.
  • the earphone can be controlled to work in the noise reduction mode regardless of the number of people threshold.
  • the preset frequency range mainly refers to the frequency range conforming to the law of human vocalization, and the main purpose of determining whether the frequency of the sound signal is within the preset frequency range is to identify whether the sound signal contains human voice.
  • the frequency of normal human speech is approximately 500 Hz to 2000 Hz
  • the preset frequency range may be set to 500 Hz to 2000 Hz, and the preset frequency range is not limited here. If the frequency of the identified sound signal is not within the preset frequency range, it may be the sound of the machine or the noise in the environment, etc. In this case, it can be determined that the relevance is irrelevant to the user; if the identified sound signal If the frequency is within the preset frequency range, it means that the voice of a person is recognized.
  • the relevance is related to the user. If there is other environmental feature information, it may continue to wait for the next step of determination. On this basis, according to the condition that the frequency of the sound signal in the environment is within the preset frequency range, some non-human voices in the environment can be excluded, so as not to affect the reliability of the correlation determination.
  • the human voice signal in addition to using a preset frequency range to identify the human voice signal, the human voice signal may also be identified in other ways capable of distinguishing the human voice from the non-human voice signal, which is not limited herein.
  • the loudness threshold may be considered as a minimum value of the set loudness of a sound signal.
  • Different loudness thresholds may be set according to different environments, and the relationship between the loudness threshold and the average loudness in the environment may be a positive correlation. For example, in a library, since the environment itself is very quiet, the loudness threshold set can be relatively low, for example, 40 decibels; when it is detected that the loudness of the received sound signal is greater than 40 decibels, it can be considered The sound signal is a useful signal, and it can be determined that the relevance is related to the user.
  • the set loudness threshold can be relatively high, for example, 60 decibels; at this time, when the loudness of the received sound signal is detected to be greater than 60 decibels, the sound signal can be considered As a useful signal, the relevance may be determined to be related to the user.
  • the loudness threshold is not limited here, and can be flexibly set according to actual situations and different environments.
  • the main purpose of acquiring the loudness of the sound signal is to identify whether there is a signal greater than the loudness threshold in the sound signal, so as to determine whether the received sound signal is directed at the user, or whether the sound source is near the user. For example, if the loudness of the sound signal is lower than the loudness threshold, it may be that someone far away is talking, or the person next to him is talking to others instead of the user. In this case, the sound signal can be considered to be harmful to the user Useless, you can filter out such weaker sound signals; if the loudness of the sound signal is higher than the loudness threshold, it may be that someone nearby is talking, or it is likely to be talking to the user.
  • the sound signal may be useful to the user, and it can be determined that the association is related to the user. On this basis, according to the condition that the loudness of the sound signal in the environment is greater than the loudness threshold, a part of the sound signal that may be useless to the user can be excluded first, and a part that may be useful to the user can be reserved. In addition, if there is other environmental characteristic information, it may continue to wait for the next step of determination.
  • the environmental feature information meets at least two conditions, it is determined that the relevance is related to the user, and the earphone is controlled to be in the target working mode, which can be considered as combining any two pieces of environmental feature information, and both satisfy According to the corresponding conditions, it can be determined that the correlation between the environment and the user corresponding to the combination of the two pieces of environmental feature information is related to the user, and the earphone is controlled to be in the target working mode.
  • the order of determining the corresponding conditions of the environmental characteristic information there is no limit to the order of determining the corresponding conditions of the environmental characteristic information, and the order can be made according to actual needs. For example, the frequency of the sound signal in the environment and the loudness of the sound signal in the environment are combined to determine the relevance to the user and control the working mode of the earphone. Can be determined in any order.
  • the sound signal After detecting a sound signal in the environment, you can first judge whether the sound signal may be useful according to the loudness of the sound signal, and it may not be possible to rule out the influence of non-human voices (such as machine sounds that are close to the loudness of human voices in the environment) , at this time, you can continue to exclude the non-human voice part by checking whether the frequency of the sound signal is within the set range; you can also first filter out the part by judging whether the frequency of the sound signal in the environment is within the preset frequency range. The non-human voice part, and then judge whether the sound signal is useful to the user according to the loudness of the sound signal. On this basis, the use of multiple judgments can improve the reliability of the working mode control, avoid unnecessary switching of working modes, and enable users to pay attention to useful information in the environment in a timely manner while taking into account the effect of noise reduction.
  • non-human voices such as machine sounds that are close to the loudness of human voices in the environment
  • the order of determination may also be determined according to the importance of different environmental characteristic information and corresponding conditions to the determination of relevance, so as to improve the efficiency of determining relevance. For example, filtering out non-human voice signals is more important than filtering out weaker voice signals, which is more conducive to accurately and efficiently determining the relevance, and the determination can be made based on the frequency of the voice signals first. If the frequency of the sound signal is not within the preset frequency range, it can be directly judged that it has nothing to do with the user, and there is no need to make the next judgment; if it is within the preset frequency range, it is initially judged to be related to the user, and then it can determination.
  • the headset working mode can be switched more accurately and timely, avoiding unnecessary
  • the user's disgust caused by mode switching enhances the user's experience of using the noise reduction function of the headset.
  • the working mode of the earphone is controlled, including: if the semantics of the sound signal in the environment includes preset keywords, then it is determined that the correlation is related to the user, and the earphone is controlled. In target working mode.
  • the main purpose of judging whether the semantics of the sound signal includes preset keywords is to judge whether the received sound signal contains content that the user is interested in or useful to the user.
  • the preset keywords may include the user's name, occupation, address and so on. If the semantics of the sound signal includes one or more of the preset keywords, then determine the association as being relevant to the user, and control the earphone to be in the target working mode; if the semantics of the sound signal does not include any preset keywords, then determine the association Since it has nothing to do with the user, the earphone can be controlled to continue to work in the noise reduction mode.
  • the keyword elements preset by the user are obtained, and the keyword elements are arranged and combined to obtain preset keywords in various forms.
  • multiple keyword elements can be arranged and combined to obtain various preset keywords.
  • these three keyword elements can be recorded as A, B, and C respectively.
  • the environmental feature information is only the semantics of the sound signal
  • the preset keywords can more accurately reflect the user's interests and preferences, according to the condition of whether the semantics of the sound signal contains the preset keywords , can also reliably determine the association.
  • the condition of whether the semantics of the sound signal contains preset keywords it can also be applied to multiple determination scenarios.
  • the environmental characteristic information includes the number of people within the set range in the environment; obtaining the environmental characteristic information of the earphones worn by the user in the noise reduction mode includes: transmitting millimeter waves through the transmitting antenna of the terminal, and receiving The antenna receives at least one detection target's scattered wave of the millimeter wave; according to the scattered wave, it is determined that the detection target is a person, and the distance between the terminal and the person is determined by the time difference between the millimeter wave emission time and the scattered wave reception time; according to the distance between the terminal and the person The distance between them determines the number of people within the set range in the environment.
  • millimeter waves may refer to electromagnetic waves with a wavelength of 1-10 millimeters (corresponding to a frequency range of 30-300 GHz), and millimeter waves may be transmitted through a transmitting antenna of a terminal.
  • the detection target may refer to an object capable of reflecting millimeter waves, including persons to be detected within a set range in the environment.
  • the scattered wave may refer to the signal wave reflected back after the millimeter wave emitted by the transmitting antenna is sent to the detection target and interacts with the dielectric constant in the detection target, which can be received by the receiving antenna of the terminal.
  • the distance between the earphone and the detection target can be determined, and then the number of detection targets within the set range in the environment can be determined. On this basis, if it can be determined whether each detection target is a person, the number of people within the set range in the environment can be accurately determined.
  • the number of people within the set range in the environment can be determined by transmitting the millimeter wave regularly by the transmitting antenna and receiving the scattered wave by the receiving antenna in real time.
  • the terminal is a chip or electronic device integrated in the earphone, or the terminal is a terminal device independent of the earphone and the earphone is a wired earphone, then the earphone, terminal and user can be considered to be in the same position, and the terminal is the center point to transmit Millimeter waves can determine the distance between the earphone (that is, determine the terminal or user) and the detection target. If the terminal is a terminal device independent of the headset and the headset is a wireless headset (such as a Bluetooth headset), there may be a certain distance between the headset and the terminal.
  • the terminal is used as the center point to determine the distance between it and the detected person, there will be a certain error with the distance between the earphone and the person.
  • the distance between the person and the headset can be converted according to the distance and positional relationship between the Bluetooth headset and the terminal, so as to realize the detection of people in the environment.
  • the algorithm for distance conversion is not limited. In some embodiments, if the distance between the wireless headset and the terminal is much smaller than the distance between the wireless headset and the person, the error can also be ignored.
  • Fig. 2 is a schematic diagram of detecting people by using millimeter waves according to an embodiment.
  • the terminal is a terminal device independent of the earphone, and the earphone is a wired earphone (that is, the terminal and the earphone are regarded as the same location)
  • the earphone is a wired earphone (that is, the terminal and the earphone are regarded as the same location)
  • the millimeter wave S1 is transmitted through the transmitting antenna in the terminal. If there are people around, since the detection target has a certain dielectric constant, after the dielectric constant interacts with the millimeter wave S1, a scattered wave S2 with a certain characteristic signal will be generated; then , the receiving antenna in the terminal receives the reflected scattered wave S2, assuming that the transmission time of the millimeter wave S1 is T1, and the receiving time of the scattered wave S2 is T2, then the distance D between the terminal and the person can be expressed as:
  • C represents the speed of light.
  • the distance D between the terminal and the detection target can also be determined according to the time length t1 from the transmission of the millimeter wave S1 from the terminal to the reception by the detected target, and the time t2 from the transmission of the millimeter wave S2 to the reception by the terminal. It can be expressed as:
  • C represents the speed of light.
  • determining that the detection target is a person according to the scattered waves includes: determining attribute characteristics of the detection target according to the scattered waves, the attribute characteristics include shape and/or area; and determining that the detection target is a person if the attribute characteristics conform to the characteristics of the person.
  • the attribute feature conforming to the character of the person may be considered that the determined shape and/or area of the detection target roughly conforms to the shape and/or area of the human body. Since there may be objects with the same or similar dielectric constant as the human body within the set range in the environment, if the main component of the human body is liquid, if there is a cup of milk tea around, it is very likely that the milk tea will be misjudged as a human body during detection. Therefore, before determining the distance between the terminal and the detection target, it is necessary to determine whether the detection target is a person according to whether the determined attribute characteristics of the detection target conform to the characteristics of the person.
  • Fig. 3 is a schematic diagram of using millimeter waves to identify and detect the length of a target provided by an embodiment.
  • the terminal is a terminal device independent of the earphone, and the earphone is a wired earphone (that is, the terminal and the earphone are regarded as the same location)
  • the transmitting antenna and the receiving antenna The distance between them is relatively short and can be ignored, so the transmitting antenna and receiving antenna can be set in one place to identify the length of the detection target.
  • the implementation process is as follows: first, the transmitting antenna transmits millimeter waves to position A and position B of the detection target respectively; then, according to the time difference between transmitting the millimeter wave and receiving the scattered wave, respectively determine the position A and position B of the terminal and the detection target The distance between D1 and D2, and the angle ⁇ between D1 and D2; finally, according to the law of cosines, the length
  • the above method can be used to calculate the lengths and included angles of multiple different positions or different directions of the detection target, and on this basis, the mapped area and/or shape of the detection target can be obtained. Then the area and/or shape can be defined in advance according to the characteristics of the person, such as a range can be preset for the area and/or shape; if the area and/or shape of the acquired detection target is within the range, then it can It is determined that the detection target is a valid target, that is, conforms to the characteristics of a person, and can be determined as a person.
  • the setting of the range is not limited here.
  • Fig. 4 is a schematic diagram of determining the number of people within a set range in an environment provided by an embodiment.
  • the number of people within the set radius R is detected according to the distance from the detection target (the detection target has been judged to be a person). On this basis, it is compared with the preset number of people threshold, if the determined number of people is smaller than the number of people threshold, the condition is met, which can provide a basis for the next step of controlling the target working mode of the earphone.
  • the people in the external environment of the headset can be effectively positioned to accurately identify the number of people.
  • the base station can also communicate with the terminal to detect the number of people in the external environment of the headset, and notify the terminal.
  • the rapid positioning of the terminal can be realized.
  • Two base stations can be used to realize the positioning of the terminal, and one base station can also be used to realize the positioning of the terminal, so that the base station determines the number of people within the set range, and then notifies the terminal.
  • the method of using the base station to locate the terminal to determine the number of people in the environment needs to ensure that everyone has a terminal, so this method has certain usage restrictions, and people who do not carry a terminal cannot be located.
  • FIG. 5A is a schematic diagram of implementing mobile phone positioning by using two base stations provided by an embodiment.
  • the base station can detect the number of mobile phones within the set range and notify the terminal.
  • FIG. 5B is a schematic diagram of implementing mobile phone positioning by using a base station provided by an embodiment.
  • the uplink signal collected by the base station the location and angular momentum information of the mobile phone can be obtained, so as to accurately locate the location of the mobile phone.
  • the uplink signal may refer to a mobile phone signal received by the base station.
  • the base station can detect the number of mobile phones within the set range and notify the terminal.
  • Fig. 6 is a schematic diagram of processing a sound signal to obtain a frequency of the sound signal provided by an embodiment.
  • the environmental feature information includes the frequency of the sound signal.
  • the implementation process of collecting sound signals and processing them to obtain the signal frequency is as follows: first, the sound signals in the environment are collected through the signal collection equipment; then, the collected sound signals can be processed by the audio signal processing system Carry out signal processing, such as the frequency of the sound signal can be obtained by the Fourier transform method; finally, determine whether the frequency of the sound signal is within the limited frequency range (such as 500-2000Hz), if the frequency of the sound signal is within the limited In the frequency range, the condition is satisfied, which can provide a basis for the control of the target working mode of the earphone.
  • the limited frequency range such as 500-2000Hz
  • Fig. 7 is a schematic diagram of processing a sound signal to obtain the loudness of the sound signal provided by an embodiment.
  • the environmental feature information includes the loudness of the sound signal.
  • the implementation process of collecting sound signals and processing them to obtain signal loudness is as follows: first, the sound signals in the environment are collected through the signal collection equipment; then, the collected sound signals can be processed by the audio signal processing system Perform signal processing to obtain the loudness of the sound signal; finally, determine whether the loudness of the sound signal is greater than the preset loudness threshold, if the loudness of the sound signal is greater than the preset loudness threshold, the condition is met, and it can be the target of the earphone Provide basis for the control of working mode.
  • the signal processing method for acquiring the loudness is not limited here.
  • Fig. 8 is a schematic diagram of processing an audio signal to obtain semantics of the audio signal provided by an embodiment.
  • the environmental characteristic information includes the semantics of the sound signal.
  • the implementation process of collecting sound signals and processing them to obtain the corresponding text content is as follows: first, the sound signals in the environment are collected through the signal collection equipment; then, the collected sound signals can be processed through the audio signal processing system For example, the text content corresponding to the sound signal can be obtained through the speech recognition model in the system; finally, it is judged whether the text content corresponding to the sound signal contains preset keywords, if the text content corresponding to the sound signal contains If the preset keyword is included, the condition is met, which can provide a basis for controlling the target working mode of the earphone.
  • the detected information that matches the preset keyword can be displayed on the display screen of the terminal to remind the user to quickly locate the voice information.
  • the detected information that matches the preset keyword can be displayed on the display screen of the terminal to remind the user to quickly locate the voice information.
  • the signal acquisition device mentioned in the above embodiments may refer to a microphone in a terminal or an electronic device integrated in an earphone; similarly, an audio signal processing system may also refer to an electronic device integrated in a terminal or an earphone. This is not limited here.
  • controlling the working mode of the headset according to the correlation between the environment and the user corresponding to the environmental feature information includes: when the correlation is related to the user, performing one of the following: controlling the headset to be in a non-noise reduction mode ;Control the headset to be in the noise reduction mode, and reduce the playback volume of the headset; control the headset to be in the noise reduction mode, and display an inquiry message about the working mode; if the association is irrelevant to the user, control the headset to be in the noise reduction mode.
  • the inquiry information about the working mode can be regarded as selection information about whether to exit the noise reduction mode displayed on the display screen of the terminal.
  • the association is related to the user, there are multiple control methods for the working mode of the earphone, such as controlling the earphone to be in the non-noise-cancelling mode; it can also be kept in the noise-cancelling mode, but can be controlled by reducing the earphone playback volume, etc. Allows the user to hear useful sounds from the outside world. If the association is irrelevant to the user, the user does not need to perform any operations, and the earphones can continue to maintain the noise reduction mode.
  • Controlling the headphones to work in the non-noise reduction mode includes various forms, such as directly exiting the headphone noise reduction function, waiting for the user to manually turn it on again;
  • the re-opening condition can be a preset time value, and the preset time value can be roughly the time of a sentence (such as 5 seconds), etc., and this is not limited; it can also be temporarily turning off the noise reduction function until no people are detected.
  • the sound signal within the preset frequency range of the sound; the noise reduction function can also be temporarily turned off until the sound in the detected surrounding environment becomes noisy.
  • the playback volume of the earphones can be automatically lowered, or the playback can be paused to ensure that the user can judge whether the sound in the environment is consistent with the noise. It is related to yourself. If the sound in the environment has nothing to do with you, the original volume of the headset itself can be automatically restored. If the sound in the environment is related to you, the user can choose whether to continue using the noise reduction mode of the headset through the terminal; it can also be While keeping the noise reduction mode turned on, the terminal displays an inquiry message about the working mode, or reminds the user whether to choose to turn off the noise reduction mode in the form of voice.
  • Fig. 9 is a flow chart of another method for controlling the working mode of an earphone provided by an embodiment. As shown in Figure 9, there are three conditions in this embodiment, that is, the number of people within the set range in the environment is lower than the number threshold, the frequency of the sound signal in the environment is within the preset frequency range, and the loudness of the sound signal in the environment is greater than The loudness threshold is combined to control the earphone working mode as an example.
  • the method provided in this embodiment includes:
  • S210 Determine the number of people within a set range in the environment.
  • S220 Determine whether the number of people is lower than the number threshold; if the number is lower than the number threshold, execute S230; if the number is not lower than the number threshold, execute S280.
  • the earphone can be controlled to continue to work in the noise reduction mode. For example, if the number of people threshold is set to 3 within the set range with the earphone as the center and a radius of 6 meters, then in environments with a large number of people, such as subway stations or buses, the detected number of people will exceed 3 in most cases. , the noise reduction mode may not be turned off at this time; if the number of people is lower than the set number threshold, the preliminary determination is that the correlation is related to the user, and the next step of determining the working mode of the headset is continued.
  • S240 Determine whether the frequency of the sound signal is within the preset frequency range; if the frequency of the sound signal is within the preset frequency range, execute S250; if the frequency of the sound signal is not within the preset frequency range, execute S280.
  • the frequency of the sound signal is not within the preset frequency range, indicating that it may be a non-human voice signal, it can be determined that the relevance is irrelevant to the user, and the earphone can be controlled to continue to work in the noise reduction mode; if the frequency of the sound signal is within Within the set preset frequency range, the influence of some non-human voices in the sound signal is excluded, and it can be further determined that the relevance is related to the user, and then continue to the next step of determination.
  • S250 Determine the loudness of the sound signal in the environment.
  • S260 Determine whether the loudness of the sound signal is greater than the loudness threshold; if the loudness of the sound signal is greater than the loudness threshold, perform S270; if the loudness of the sound signal is not greater than the loudness threshold, perform S280.
  • the sound signal can also be determined by judging the loudness of the sound signal. Is it relevant to the user. For example, in the library, the students around are discussing the problem in a low voice, which has nothing to do with the user, but the frequency of the sound signal emitted may be within the preset frequency range. At this time, the loudness of the sound can be used to continue to judge; and it can also Adjust the loudness threshold according to the actual environment of the user.
  • the loudness threshold can be increased appropriately to filter out unnecessary sound signals, so that it is not necessary to frequently switch the working mode of the earphone to avoid causing the user to be confused. Disgusting noise canceling feature of headphones.
  • S270 Determine that the association is related to the user, and control the headset to be in the target working mode.
  • the earphone when the three conditions are satisfied that the number of people within the set range in the environment is lower than the number of people threshold, the frequency of the sound signal in the environment is within the preset frequency range, and the loudness of the sound signal in the environment is greater than the loudness threshold,
  • the relevance may ultimately be determined to be user-related.
  • the earphone can be controlled to be in the target working mode according to the actual situation. For example, the earphone can be controlled to be in the non-noise reduction mode; the earphone can also be controlled to continue to be in the noise reduction mode.
  • the user can hear the external sound clearly by adjusting the playback volume or pausing the playback; it can also control the headset to continue in the noise reduction mode. At this time, the user can choose whether to exit through the query information about the working mode displayed on the terminal screen. Noise canceling mode, etc.
  • S280 Determine that the association is irrelevant to the user, and control the earphone to be in the noise reduction mode.
  • the user can continue to maintain the noise reduction mode of the earphone and focus on the content played by the earphone.
  • An earphone working mode control method provided in the embodiment of the present application can realize multiple determination and screening of sound signals by combining the conditions corresponding to the three kinds of environmental feature information; on this basis, according to the sound signals after multiple determinations, The working mode switching of the earphone can be controlled more accurately and in a timely manner, effectively avoiding misjudgment of the working mode switching of the earphone, and improving the user experience of the noise reduction function of the earphone.
  • Fig. 10 is a schematic structural diagram of an earphone working mode control device provided by an embodiment. As shown in Figure 10, the device includes:
  • the information acquisition module 310 is configured to acquire the environmental characteristic information of the earphone worn by the user in the noise reduction mode; the control module 320 is configured to control the working mode of the earphone according to the correlation between the environment and the user corresponding to the environmental characteristic information .
  • the device for controlling the working mode of the earphone in this embodiment for the earphone in the noise reduction mode, can use the environmental feature information to clarify the correlation between the environment and the user, thereby controlling the working mode of the earphone so that the earphone can work in an environment compatible with the surrounding environment.
  • the working mode of the headset can improve the adaptability of the noise reduction function of the headset to the environment, and can also improve the user experience of the noise reduction function of the headset.
  • the environmental feature information includes at least one of the following: the number of people in the environment within a set range; the frequency of the sound signal in the environment; the loudness of the sound signal in the environment; Semantics of sound signals.
  • control module 320 includes:
  • the correlation determination unit is configured to determine that the correlation is related to the user when the environmental feature information satisfies at least two of the following conditions, and control the headset to be in a target working mode: the number of people in the environment within a set range The frequency of the sound signal in the environment is lower than the threshold of the number of people; the frequency of the sound signal in the environment is within a preset frequency range; the loudness of the sound signal in the environment is greater than the loudness threshold.
  • control module 320 includes:
  • the earphone control unit is configured such that the semantics of the sound signal in the environment includes preset keywords, then it is determined that the relevance is related to the user, and the earphone is controlled to be in a target working mode.
  • the environment feature information includes the number of people within the set range in the environment; on the basis of the above embodiments, the information acquisition module 310 includes:
  • the scattered wave receiving unit is configured to transmit a millimeter wave through the transmitting antenna of the terminal, and receives the scattered wave of at least one detection target for the millimeter wave through the receiving antenna of the terminal; the person and distance determining unit is configured to determine according to the scattered wave
  • the detection target is a person, and the distance between the terminal and the person is determined through the time difference between the millimeter wave emission time and the scattered wave reception time; the number of people determining unit is configured to determine the distance between the terminal and the person The number of people within a defined range in the described environment.
  • the person and distance determination unit includes:
  • the attribute feature determination subunit is configured to determine the attribute feature of the detection target according to the scattered wave, and the attribute feature includes shape and/or area; the character determination subunit is configured to determine that the attribute feature conforms to the character feature
  • the detection target is a person.
  • control module 320 includes:
  • the non-noise reduction mode control unit is configured to control the earphone to be in the non-noise reduction mode when the association is related to the user;
  • the first noise reduction mode control unit is configured to control the earphone to be in the non-noise reduction mode when the association is related to the user In related cases, control the earphone to be in the noise reduction mode, and reduce the playback volume of the earphone;
  • the second noise reduction mode control unit is configured to control the earphone when the association is related to the user It is in the noise reduction mode and displays inquiry information about the working mode;
  • the third noise reduction mode control unit is configured to control the earphone to be in the noise reduction mode when the association is irrelevant to the user.
  • the earphone working mode control device proposed in this embodiment and the earphone working mode control method proposed in the above-mentioned embodiments belong to the same idea, and the technical details not described in detail in this embodiment can be referred to any of the above-mentioned embodiments, and this embodiment has and implements Headphone working mode control method has the same effect.
  • Fig. 11 is a schematic diagram of the hardware structure of a terminal provided by an embodiment.
  • the terminal provided by this application includes a processor 410, a storage device 420, and a A running computer program, when the processor 410 executes the program, implements the above-mentioned method for controlling the working mode of the earphone.
  • the terminal may also include a storage device 420; there may be one or more processors 410 in the terminal, and one processor 410 is taken as an example in FIG. 11; the storage device 420 is configured to store one or more programs; the one or more The program is executed by the one or more processors 410, so that the one or more processors 410 implement the method for controlling the working mode of the earphone as described in the embodiment of the present application.
  • the terminal further includes: a communication device 430 , an input device 440 and an output device 450 .
  • the processor 410, the storage device 420, the communication device 430, the input device 440, and the output device 450 in the terminal may be connected through a bus or in other ways. In FIG. 11, connection through a bus is taken as an example.
  • the input device 440 can be configured to receive input numbers or character information, and generate key signal input related to user settings and function control of the terminal.
  • the output device 450 may include a display device such as a display screen.
  • Communications device 430 may include a receive antenna and a transmit antenna.
  • the communication device 430 is configured to receive scattered waves or emit millimeter waves according to the control of the processor 410 , and can also perform information sending and receiving communication with other terminals or base stations around.
  • the storage device 420 can be configured to store software programs, computer-executable programs, and modules, such as the program instructions/modules corresponding to the earphone working mode control method described in the embodiment of the present application (for example, the earphone working mode
  • the storage device 420 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the test equipment, and the like.
  • the storage device 420 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage devices.
  • the storage device 420 may include memories that are remotely located relative to the processor 410, and these remote memories may be connected to the terminal through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the embodiment of the present application further provides a storage medium, the storage medium stores a computer program, and when the computer program is executed by a processor, the method for controlling the working mode of the earphone described in any one of the embodiments of the present application is implemented.
  • the method includes: acquiring environmental characteristic information that the earphone worn by the user is in a noise reduction mode; and controlling the working mode of the earphone according to the correlation between the environment and the user corresponding to the environmental characteristic information.
  • the computer storage medium in the embodiments of the present application may use any combination of one or more computer-readable media.
  • the computer readable medium may be a computer readable signal medium or a computer readable storage medium.
  • a computer-readable storage medium may be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof.
  • Examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more conductors, portable computer disks, hard disks, Random Access Memory (RAM), Read Only Memory (Read Only) Memory, ROM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, EPROM), flash memory, optical fiber, portable CD-ROM (Compact Disk Read Only Memory, CD-ROM), optical storage device, magnetic memory components, or any suitable combination of the above.
  • a computer readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device.
  • a computer readable signal medium may include a data signal carrying computer readable program code in baseband or as part of a carrier wave. Such propagated data signals may take many forms, including but not limited to: electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. .
  • Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wires, optical cables, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the above.
  • any appropriate medium including but not limited to: wireless, wires, optical cables, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the above.
  • Computer program codes for performing the operations of the present application may be written in one or more programming languages or combinations thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional A procedural programming language, such as the "C" language or similar programming language.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer may be connected to the user computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or it may be connected to an external computer such as use an Internet service provider to connect via the Internet).
  • LAN Local Area Network
  • WAN Wide Area Network
  • the term user terminal covers any suitable type of wireless user equipment, such as a mobile telephone, portable data processing device, portable web browser or vehicular mobile station.
  • the various embodiments of the present application can be implemented in hardware or special purpose circuits, software, logic or any combination thereof.
  • some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software, which may be executed by a controller, microprocessor or other computing device, although the application is not limited thereto.
  • Computer program instructions may be assembly instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or written in any combination of one or more programming languages source or object code.
  • ISA Instruction Set Architecture
  • Any logic flow block diagrams in the drawings of the present application may represent program steps, or may represent interconnected logic circuits, modules and functions, or may represent a combination of program steps and logic circuits, modules and functions.
  • Computer programs can be stored on memory.
  • the memory may be of any type suitable for the local technical environment and may be implemented using any suitable data storage technology, such as ROM, RAM, optical memory devices and systems (Digital Video Disc (DVD) or CD, etc.
  • Computers may Read medium can comprise non-transitory storage medium.
  • Data processor can be any type that is suitable for local technical environment, such as but not limited to general purpose computer, special purpose computer, microprocessor, digital signal processor (Digital Signal Processing, DSP), Application Specific Integrated Circuit (ASIC), Programmable Logic Device (Field-Programmable Gate Array, FPGA) and processors based on multi-core processor architecture.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The present disclosure discloses a headphone working mode control method and apparatus, a terminal, and a medium. The headphone working mode control method comprises: acquiring environmental characteristic information of a headphone worn by a user in a noise reduction mode; and controlling the working mode of the headphone according to the relevance between the environment corresponding to the environmental characteristic information and the user.

Description

耳机工作模式控制方法、装置、终端及介质Earphone working mode control method, device, terminal and medium 技术领域technical field
本申请涉及降噪耳机控制技术领域，例如涉及一种耳机工作模式控制方法、装置、终端及介质。The present application relates to the technical field of noise-cancelling earphone control, for example, to a method, device, terminal and medium for controlling an earphone working mode.
背景技术Background technique
随着通信技术的发展，第五代移动通信(Fifth Generation，5G)网络，相比于前几代移动通信网络，提供了更高的速度、更大的容量以及新的功能和服务，支持越来越多的连接设备，如耳机等。With the development of communication technology, the fifth generation mobile communication (Fifth Generation, 5G) network, compared with previous generations of mobile communication networks, provides higher speed, greater capacity, and new functions and services, supporting more More and more connected devices, such as headphones, etc.
耳机在功能上逐步多样化，比如在降噪效果上，降噪耳机受到用户的青睐。降噪耳机，是指利用一种方法达到降低噪音的一种耳机。但是衍生而来的问题也有很多。当使用耳机降噪功能时，屏蔽外界杂音的同时也会把环境中有用的声音屏蔽掉；例如用户在使用降噪耳机的过程中，如果所连接的手机声音稍大，就会导致无法听到旁边人的呼叫或者其他有用信息。Headphones have gradually diversified in function. For example, in terms of noise reduction effect, noise reduction headphones are favored by users. Noise-cancelling headphones refer to a kind of headphones that use a method to reduce noise. But there are also many derived problems. When using the noise reduction function of the earphones, while shielding the external noise, it will also shield the useful sounds in the environment; Calls from people nearby or other useful information.
发明内容Contents of the invention
本申请提供一种耳机工作模式控制方法、装置、终端及介质，以控制耳机工作在与周围环境相适应的工作模式，从而提高耳机的降噪功能对环境的适应性，也可以改善用户对耳机降噪功能的使用体验。This application provides an earphone working mode control method, device, terminal and medium to control the earphone to work in a working mode that is compatible with the surrounding environment, thereby improving the adaptability of the noise reduction function of the earphone to the environment, and also improving the user's understanding of the earphone. The experience of using the noise reduction function.
本申请提供一种耳机工作模式控制方法，应用于终端，包括：This application provides a headset working mode control method, which is applied to a terminal, including:
获取用户佩戴的耳机处于降噪模式下的环境特征信息；根据所述环境特征信息对应的环境与用户的关联性，控制所述耳机的工作模式。Acquiring the environmental characteristic information of the earphone worn by the user in the noise reduction mode; controlling the working mode of the earphone according to the correlation between the environment and the user corresponding to the environmental characteristic information.
本申请还提供了一种耳机工作模式控制装置，包括：The present application also provides a headset working mode control device, including:
信息获取模块，设置为获取用户佩戴的耳机处于降噪模式下的环境特征信息；控制模块，设置为根据所述环境特征信息对应的环境与用户的关联性，控制所述耳机的工作模式。The information acquisition module is configured to acquire the environmental feature information of the earphone worn by the user in the noise reduction mode; the control module is configured to control the working mode of the earphone according to the correlation between the environment and the user corresponding to the environmental feature information.
本申请还提供了一种终端，包括一个或多个处理器；存储装置，设置为存储一个或多个程序；当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现上述的耳机工作模式控制方法。The present application also provides a terminal, including one or more processors; a storage device configured to store one or more programs; when the one or more programs are executed by the one or more processors, so that the The one or more processors implement the above method for controlling the working mode of the earphone.
本申请还提供了一种计算机可读存储介质，计算机可读存储介质上存储有 计算机程序，该程序被处理器执行时实现上述的耳机工作模式控制方法。The present application also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the above-mentioned headphone working mode control method is realized.
附图说明Description of drawings
图1为一实施例提供的一种耳机工作模式控制方法的流程图；FIG. 1 is a flow chart of a method for controlling an earphone working mode provided by an embodiment;
图2为一实施例提供的一种利用毫米波探测人物的示意图；Fig. 2 is a schematic diagram of detecting people by using millimeter waves provided by an embodiment;
图3为一实施例提供的一种利用毫米波识别探测目标长度的示意图；Fig. 3 is a schematic diagram of using millimeter waves to identify the length of a detection target provided by an embodiment;
图4为一实施例提供的一种确定环境中设定范围内的人数的示意图；Fig. 4 is a schematic diagram of determining the number of people within a set range in an environment provided by an embodiment;
图5A为一实施例提供的一种利用两个基站实现手机定位的示意图；FIG. 5A is a schematic diagram of using two base stations to realize mobile phone positioning provided by an embodiment;
图5B为一实施例提供的一种利用一个基站实现手机定位的示意图；FIG. 5B is a schematic diagram of using a base station to realize mobile phone positioning provided by an embodiment;
图6为一实施例提供的一种处理声音信号以获取声音信号频率的示意图；Fig. 6 is a schematic diagram of processing a sound signal to obtain the frequency of the sound signal provided by an embodiment;
图7为一实施例提供的一种处理声音信号以获取声音信号响度的示意图；Fig. 7 is a schematic diagram of processing a sound signal to obtain the loudness of the sound signal provided by an embodiment;
图8为一实施例提供的一种处理声音信号以获取声音信号语义的示意图；Fig. 8 is a schematic diagram of processing a sound signal to obtain the semantics of the sound signal provided by an embodiment;
图9为一实施例提供的另一种耳机工作模式控制方法的流程图；Fig. 9 is a flow chart of another earphone working mode control method provided by an embodiment;
图10为一实施例提供的一种耳机工作模式控制装置的结构示意图；Fig. 10 is a schematic structural diagram of an earphone working mode control device provided by an embodiment;
图11为一实施例提供的一种终端的硬件结构示意图。Fig. 11 is a schematic diagram of a hardware structure of a terminal provided by an embodiment.
具体实施方式Detailed ways
下面结合附图和实施例对本申请进行说明。此处所描述的具体实施例仅仅用于解释本申请。为了便于描述，附图中仅示出了与本申请相关的部分。The application will be described below in conjunction with the accompanying drawings and embodiments. The specific embodiments described herein are for illustration of the application only. For ease of description, only parts relevant to the present application are shown in the drawings.
在讨论示例性实施例之前应当提到的是，一些示例性实施例被描述成作为流程图描绘的处理或方法。虽然流程图将多个步骤描述成顺序的处理，但是其中的许多步骤可以被并行地、并发地或者同时实施。此外，多个步骤的顺序可以被重新安排。当其操作完成时所述处理可以被终止，但是还可以具有未包括在附图中的附加步骤。所述处理可以对应于方法、函数、规程、子例程、子程序等等。Before discussing the exemplary embodiments, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe steps as sequential processing, many of the steps may be performed in parallel, concurrently, or simultaneously. Additionally, the order of various steps may be rearranged. The process may be terminated when its operations are complete, but may also have additional steps not included in the figure. The processing may correspond to a method, function, procedure, subroutine, subroutine, or the like.
本申请实施例中提及的“第一”、“第二”等概念仅用于对不同的装置、模块、单元或其他对象进行区分，并非用于限定这些装置、模块、单元或其他对象所执行的功能的顺序或者相互依存关系。Concepts such as "first" and "second" mentioned in the embodiments of the present application are only used to distinguish different devices, modules, units or other objects, and are not used to limit the meaning of these devices, modules, units or other objects. The sequence or interdependence of functions performed.
图1为一实施例提供的一种耳机工作模式控制方法的流程图。本实施例可适用于对耳机的工作模式进行灵活控制的情况。该耳机工作模式控制方法可以 由耳机工作模式控制装置执行，该耳机工作模式控制装置可以通过软件和/或硬件的方式实现，并集成在终端中。终端可以是独立于耳机的终端设备，包括但不限于计算机、平板电脑、手机或音视频播放器(例如MP3或MP4)等终端设备，也可以是集成在耳机中的芯片或电子设备。Fig. 1 is a flow chart of a method for controlling a working mode of an earphone provided by an embodiment. This embodiment is applicable to the situation where the working mode of the earphone is flexibly controlled. The method for controlling the working mode of the earphone can be executed by the device for controlling the working mode of the headset, which can be realized by means of software and/or hardware, and integrated in the terminal. The terminal can be a terminal device independent of the headset, including but not limited to a computer, tablet computer, mobile phone, or audio and video player (such as MP3 or MP4), or a chip or electronic device integrated in the headset.
如图1所示，本实施例的耳机工作模式控制方法包括S110和S120。As shown in FIG. 1 , the method for controlling the working mode of the headset in this embodiment includes S110 and S120.
在S110中，获取用户佩戴的耳机处于降噪模式下的环境特征信息。In S110, the environment characteristic information that the earphone worn by the user is in the noise reduction mode is acquired.
本实施例中，耳机主要指具有降噪功能的耳机，即降噪耳机。降噪耳机可以分为两种：主动降噪耳机和被动降噪耳机。主动降噪耳机的工作原理可以认为是通过降噪***产生与外界噪音相等的反向声波，将噪音中和，从而实现降噪的效果。被动降噪耳机的工作原理可以认为是通过包围耳朵形成封闭空间，或者采用硅胶耳塞等隔音材料来阻挡外界噪声。在本申请中，耳机可以是指主动降噪耳机。In this embodiment, the earphone mainly refers to an earphone with a noise reduction function, that is, a noise reduction earphone. Noise canceling headphones can be divided into two types: active noise canceling headphones and passive noise canceling headphones. The working principle of active noise reduction headphones can be considered to be that the noise reduction system generates reverse sound waves equal to the external noise to neutralize the noise, thereby achieving the effect of noise reduction. The working principle of passive noise-canceling headphones can be considered as forming a closed space by surrounding the ears, or using sound-isolating materials such as silicone earplugs to block external noise. In this application, earphones may refer to active noise canceling earphones.
示例性的，耳机可以为有线耳机，也可以为无线耳机，此处对此不作限定。其中，有线耳机可以通过数据线等与终端进行数据传输；无线耳机可以通过蓝牙或者无线网(Wireless Fidelity，WIFI)等与终端进行数据传输。Exemplarily, the earphone may be a wired earphone or a wireless earphone, which is not limited here. Wherein, the wired headset can perform data transmission with the terminal through a data cable, etc.; the wireless headset can perform data transmission with the terminal through Bluetooth or a wireless network (Wireless Fidelity, WIFI).
环境特征信息，可以指对所检测到的耳机外界的环境中的一种信息或信号进行特定处理之后获得的、可以表征该环境对用户来说是否可能有关联的信息；其中，环境中的信号主要指声音信号，可根据实际需求对所检测到的声音信号进行信号处理以得到相应的环境特征信息；环境中的信息可以为环境中人的数量或密度、环境类型(例如图书馆对应于较为安静的环境类型，火车站对应于较为嘈杂的环境类型)等。如环境特征信息可以包括环境设定范围内的人数、检测到的声音信号的频率、声音信号的响度和/或声音信号的语义等，这些环境特征信息都可用于判断环境与用户之间的关联性，也即判断环境中是否可能存在对用户有用或者值得用户关注的信息。Environmental characteristic information can refer to information obtained after specific processing of a kind of information or signal in the environment outside the earphone detected, which can indicate whether the environment may be relevant to the user; among them, the signal in the environment It mainly refers to the sound signal, and the detected sound signal can be signal-processed according to actual needs to obtain the corresponding environmental feature information; the information in the environment can be the number or density of people in the environment, the type of environment (for example, the library corresponds to a relatively A quiet environment type, a train station corresponds to a relatively noisy environment type) and so on. For example, the environmental feature information may include the number of people within the environment setting range, the frequency of the detected sound signal, the loudness of the sound signal, and/or the semantics of the sound signal, etc. These environmental feature information can be used to judge the relationship between the environment and the user , that is, to judge whether there may be information that is useful to the user or worthy of the user's attention in the environment.
在S110中，耳机处于降噪模式的情况下，可以通过独立于耳机的终端设备检测环境中的信息或信号，也可以通过集成在耳机中的芯片或电子设备来获取环境中的信息或信号，并采集存储起来，等待后续的处理以得到环境特征信息。此处不对检测环境中的信息或信号的实现方式进行限定。In S110, when the earphone is in the noise reduction mode, the information or signal in the environment can be detected through a terminal device independent of the earphone, or the information or signal in the environment can be obtained through a chip or electronic device integrated in the earphone, It is collected and stored, and waits for subsequent processing to obtain environmental feature information. The implementation manner of detecting information or signals in the environment is not limited here.
在S120中，根据所述环境特征信息对应的环境与用户的关联性，控制所述耳机的工作模式。In S120, the working mode of the earphone is controlled according to the correlation between the environment and the user corresponding to the environment characteristic information.
本实施例中，在获取到用户佩戴的耳机处于降噪模式下的环境特征信息之后，需要确定该环境特征信息所对应的环境与用户的关联性。环境特征信息所对应的环境与用户的关联性，可以认为是在环境中所检测到的声音信号与用户 是否相关、或者是对用户来说是否有用、或者值得用户关注等。关联性包括至少两个等级，例如，可以包括强关联、中等关联、弱关联、无关联，关联性越强，则用户更需要关注环境中的声音，例如将用户的注意力从耳机所播放的内容转移到环境中所检测到的声音信号上，此时可以控制耳机的工作模式以使用户更易听到环境中的声音信号，例如可以控制耳机工作在非降噪模式、低音量模式或者暂停播放模式等。关联性较弱，则用户不需要关注环境中的声音，用户可以继续把注意力放在耳机所播放的内容上，此时用户耳机可以继续工作于降噪模式。In this embodiment, after acquiring the environmental characteristic information that the earphone worn by the user is in the noise reduction mode, it is necessary to determine the correlation between the environment corresponding to the environmental characteristic information and the user. The correlation between the environment and the user corresponding to the environmental feature information can be considered as whether the sound signal detected in the environment is related to the user, or whether it is useful to the user, or worthy of the user's attention, etc. The correlation includes at least two levels, for example, it may include strong correlation, medium correlation, weak correlation, and no correlation. The stronger the correlation, the more the user needs to pay attention to the sounds in the environment, such as diverting the user's attention from the sound played by the headset. The content is transferred to the sound signal detected in the environment. At this time, the working mode of the earphone can be controlled to make it easier for the user to hear the sound signal in the environment. For example, the earphone can be controlled to work in non-noise reduction mode, low volume mode or pause playback mode etc. If the correlation is weak, the user does not need to pay attention to the sound in the environment, and the user can continue to focus on the content played by the earphone. At this time, the user earphone can continue to work in the noise reduction mode.
示例性的，在用户佩戴耳机且在火车站的情况下，环境中设定范围内的人数非常多，环境嘈杂，环境中大多是噪音或者与用户无关的人说话的声音，此时可以认为环境与用户无关或者关联性较弱，这种情况下，用户不需要关注环境中的信息，控制耳机工作于降噪模式即可。而在用户佩戴耳机且在家中的情况下，环境中设定范围内的人数很少，环境较为安静，一旦有人说话或者检测到任何动静，都需要用户关注或检查，此时的环境与用户有关或者关联性较强，这种情况下，可以控制耳机工作于非降噪模式，以便于用户关注或检查，避免错过重要信息。在此基础上，根据环境与用户的关联性，可以实现对耳机工作模式的灵活控制，使其适应于环境。For example, when the user wears headphones and is at a train station, there are a lot of people within the set range in the environment, the environment is noisy, and most of the environment is noise or voices of people who have nothing to do with the user. At this time, the environment can be considered It has nothing to do with the user or the correlation is weak. In this case, the user does not need to pay attention to the information in the environment, and only needs to control the headset to work in the noise reduction mode. However, when the user wears headphones and is at home, there are few people within the set range in the environment, and the environment is relatively quiet. Once someone speaks or detects any movement, the user needs to pay attention or check. The environment at this time is related to the user. Or the correlation is strong. In this case, the earphone can be controlled to work in a non-noise reduction mode, so that the user can focus or check and avoid missing important information. On this basis, according to the correlation between the environment and the user, the flexible control of the working mode of the headset can be realized to adapt to the environment.
本申请实施例提供的一种耳机工作模式控制方法，对工作于降噪模式下的耳机，利用环境特征信息对应的环境与用户的关联性来进行耳机工作模式的控制，能够使耳机工作在与周围环境相适应的工作模式，根据不同的关联性可以实现耳机在降噪和非降噪模式之间灵活、准确的切换，从而提高耳机的降噪功能对环境的适应性，也可以改善用户对耳机降噪功能的使用体验。在此基础上，用户可以及时有效发现周围可能有用的信息，避免错过重要信息；此外，也可以避免非必要的模式切换，从而改善用户对降噪功能的使用体验。The embodiment of the present application provides a method for controlling the working mode of the earphone. For the earphone working in the noise reduction mode, the correlation between the environment and the user corresponding to the environmental feature information is used to control the working mode of the earphone. The working mode adapted to the surrounding environment can realize the flexible and accurate switching of the earphones between noise reduction and non-noise reduction modes according to different correlations, thereby improving the adaptability of the noise reduction function of the earphones to the environment, and also improving the user's understanding of the environment. The experience of using the noise reduction function of headphones. On this basis, users can promptly and effectively discover potentially useful information around them and avoid missing important information; in addition, unnecessary mode switching can also be avoided, thereby improving the user's experience with the noise reduction function.
在一实施例中，环境特征信息包括以下至少一项：环境中设定范围内的人数；环境中声音信号的频率；环境中声音信号的响度；环境中声音信号的语义。In an embodiment, the environment feature information includes at least one of the following: the number of people in the environment within a set range; the frequency of the sound signal in the environment; the loudness of the sound signal in the environment; the semantics of the sound signal in the environment.
本实施例中，环境主要指耳机外界的环境。不同的环境对应不同的环境特征信息。环境中设定范围内的人数，可以认为是以耳机为中心，在耳机外界的环境中设定半径范围内的人数。此处对所设定的半径范围的大小不作限定，可根据实际需求和所处环境情况进行灵活设定。为了保证在耳机所处位置(也即佩戴耳机的用户自身所处位置)，用户能够听到周围有用的声音信号，终端探测的是耳机外界环境中设定范围内的人数。如果终端集成在耳机中，则终端、耳机以及用户可以认为是处于同一位置，都可以作为上述半径范围的中心。In this embodiment, the environment mainly refers to the environment outside the earphone. Different environments correspond to different environmental characteristic information. The number of people within the set range in the environment can be regarded as the number of people within the set radius in the environment outside the headset, centered on the headset. Here, there is no limitation on the size of the set radius range, which can be flexibly set according to actual needs and the environment. In order to ensure that the user can hear useful sound signals around the location of the headset (that is, the location of the user wearing the headset), the terminal detects the number of people within the set range in the external environment of the headset. If the terminal is integrated in the earphone, the terminal, the earphone, and the user can be considered to be at the same location, and can be used as the center of the foregoing radius range.
声音信号的频率可以指声音信号在频域上相对应的信息。The frequency of the sound signal may refer to information corresponding to the sound signal in the frequency domain.
声音信号的响度又称为音量，可以指人耳所感受到的声音强弱，即声音响亮的程度，其可以通过分贝来表示。The loudness of the sound signal is also called the volume, which can refer to the strength of the sound felt by the human ear, that is, the loudness of the sound, which can be expressed in decibels.
声音信号的语义，可以认为是声音信号所对应的文本内容。The semantics of the sound signal can be regarded as the text content corresponding to the sound signal.
相应的，根据上述环境特征信息确定关联性的条件，包括以下至少一种：Correspondingly, the conditions for determining the relevance according to the above-mentioned environmental feature information include at least one of the following:
环境中设定范围内的人数是否低于人数阈值(如果是，说明用户周围的环境较为安静，则从环境中检测到的声音信号大概率与用户有关，环境与用户的关联性较强)；环境中声音信号的频率是否在预设频率范围内(如果是，说明环境中的声音信号的频率符合人说话的声音频率而不是噪音，则该声音信号大概率与用户有关，关联性较强)；环境中声音信号的响度是否大于响度阈值(如果是，说明环境中的声音信号的响度较大，很可能是其他人在冲用户说话，则该声音信号大概率与用户有关，关联性较强)；环境中声音信号的语义是否包含预设关键词(如果是，说明环境中的声音信号包含用户感兴趣的内容，关联性较强)。Whether the number of people within the set range in the environment is lower than the threshold of the number of people (if so, it means that the environment around the user is relatively quiet, and the sound signal detected from the environment is likely to be related to the user, and the environment and the user are highly correlated); Whether the frequency of the sound signal in the environment is within the preset frequency range (if it is, it means that the frequency of the sound signal in the environment matches the sound frequency of human speech rather than noise, and the sound signal is likely to be related to the user and has a strong correlation) ; Whether the loudness of the sound signal in the environment is greater than the loudness threshold (if yes, it means that the sound signal in the environment is louder, and it is likely that other people are talking to the user, then the sound signal has a high probability of being related to the user and has a strong correlation ); whether the semantics of the sound signal in the environment contains preset keywords (if yes, it means that the sound signal in the environment contains content that the user is interested in, and has a strong correlation).
在一实施例中，可以根据环境中声音信号的语义包括预设关键词这个条件来判定关联性是否为与用户相关；也可以根据环境中设定范围内的人数低于人数阈值、环境中声音信号的频率在预设频率范围内以及环境中声音信号的响度大于响度阈值这三个条件中的至少两个条件来判定关联性是否为与用户相关；还可以将上述四个条件全部结合来判定关联性是否为与用户相关。此处对此不作限定。In one embodiment, it can be determined whether the relevance is related to the user according to the condition that the semantics of the sound signal in the environment includes preset keywords; The frequency of the signal is within the preset frequency range and the loudness of the sound signal in the environment is greater than the loudness threshold. At least two conditions are used to determine whether the relevance is related to the user; it can also be determined by combining all the above four conditions Whether the affinity is user-related. This is not limited here.
在一实施例中，根据环境特征信息对应的环境与用户的关联性，控制耳机的工作模式，包括：环境特征信息满足以下至少两种条件，则确定关联性为与用户相关，控制耳机处于目标工作模式：环境中设定范围内的人数低于人数阈值；环境中声音信号的频率在预设频率范围内；环境中声音信号的响度大于响度阈值。In one embodiment, controlling the working mode of the earphone according to the correlation between the environment and the user corresponding to the environmental characteristic information includes: if the environmental characteristic information satisfies at least two conditions below, then it is determined that the association is related to the user, and the earphone is controlled to be in the target Working mode: the number of people within the set range in the environment is lower than the threshold of the number of people; the frequency of the sound signal in the environment is within the preset frequency range; the loudness of the sound signal in the environment is greater than the loudness threshold.
本实施例中，环境与用户的关联性可包括两种：与用户相关，以及与用户无关。目标工作模式可以指在确定关联性为与用户相关之后，使得用户能够听到环境中的声音信号的工作模式；如目标工作模式可以是控制耳机处于非降噪模式，也可以是在保持耳机处于降噪模式的情况下，通过其他方式(如降低耳机播放音量、暂停播放等方式)来使得用户能够听到环境中的声音信号。In this embodiment, the relationship between the environment and the user may include two types: user-related and user-independent. The target working mode can refer to the working mode that enables the user to hear the sound signal in the environment after determining that the correlation is related to the user; In the case of the noise reduction mode, the user can hear the sound signal in the environment by other methods (such as reducing the playback volume of the earphone, pausing the playback, etc.).
不同的环境特征信息对应不同的条件。环境特征信息满足至少两种条件，即有至少两种环境特征信息分别满足对应的条件，这种情况下，可以确定关联性为与用户相关。本实施例采用的是多重判定的方法以控制耳机的工作模式。Different environmental feature information corresponds to different conditions. The environmental characteristic information satisfies at least two conditions, that is, at least two kinds of environmental characteristic information respectively satisfy the corresponding conditions. In this case, the relevance may be determined to be related to the user. This embodiment adopts a method of multiple determinations to control the working mode of the earphone.
本实施例中，人数阈值可以认为是在所设定的耳机外界的环境中设定范围 内的人数的最大值。与环境中设定范围内的人数所对应的条件可以是：环境中设定范围内的人数低于所预先设定的人数阈值。若用户处于相对平静的环境中，为了避免错过周围的有用信息，则人数阈值可以设定得相对较小，如在图书馆或办公室内，人数阈值可以设定为5；若用户处于相对混乱的环境中，则人数阈值可以设定得相对较大，如在火车站或商场中，人数阈值可以设定为20。人数阈值可以根据实际需求和环境的不同进行灵活设定，此处对此不作限定。在此基础上，根据环境中设定范围内的人数低于人数阈值这个条件，能够从用户所处的周围环境是安静还是嘈杂的角度，判断环境与用户的关联性。在此基础上，如果还有其他的环境特征信息及相应的条件，则可以继续进行下一步判定。In this embodiment, the number of people threshold can be considered as the maximum number of people within the set range in the set environment outside the earphone. The condition corresponding to the number of people within the set range in the environment may be: the number of people within the set range in the environment is lower than the preset number threshold. If the user is in a relatively calm environment, in order to avoid missing useful information around, the threshold of the number of people can be set relatively small, such as in a library or office, the threshold of the number of people can be set to 5; if the user is in a relatively chaotic environment In an environment, the threshold of the number of people can be set relatively large, for example, in a train station or a shopping mall, the threshold of the number of people can be set to 20. The threshold of the number of people can be flexibly set according to actual needs and different environments, which is not limited here. On this basis, according to the condition that the number of people within the set range in the environment is lower than the number threshold, the correlation between the environment and the user can be judged from the perspective of whether the surrounding environment of the user is quiet or noisy. On this basis, if there are other environmental feature information and corresponding conditions, the next step of determination can be continued.
通常情况下，环境中设定范围内的人数越少，则环境与用户的关联性越强，在检测到环境中的声音信号时，对用户有用的可能性越大。在一些实施例中，如果检测到声音信号时环境中设定范围内的人数为0，则无论人数阈值为多少，都可以控制耳机工作在降噪模式。Generally, the fewer the number of people within the set range in the environment, the stronger the correlation between the environment and the user, and the greater the possibility of being useful to the user when the sound signal in the environment is detected. In some embodiments, if the number of people within the set range in the environment is 0 when the sound signal is detected, the earphone can be controlled to work in the noise reduction mode regardless of the number of people threshold.
本实施例中，预设频率范围主要指符合人的发声规律的频率范围，判定声音信号的频率是否在预设频率范围内的主要目的是识别声音信号中是否包含人声。例如，人正常说话的频率大致在500Hz至2000Hz，则预设频率范围可以设置为500Hz至2000Hz，此处对预设频率范围不作限定。如果所识别到的声音信号的频率不在预设频率范围内，则可能是机器的声音或者环境中的噪音等，这种情况下，可以判定关联性为与用户无关；如果识别到的声音信号的频率在预设频率范围内，说明识别到了人说话的声音，为了避免错过有用的声音信号，可以判定关联性为与用户有关。如果还有其他的环境特征信息，则可以继续等待下一步判定。在此基础上，根据环境中声音信号的频率在预设频率范围内这个条件，能够将环境中的部分非人声排除掉，以免影响对关联性判定的可靠性。In this embodiment, the preset frequency range mainly refers to the frequency range conforming to the law of human vocalization, and the main purpose of determining whether the frequency of the sound signal is within the preset frequency range is to identify whether the sound signal contains human voice. For example, the frequency of normal human speech is approximately 500 Hz to 2000 Hz, then the preset frequency range may be set to 500 Hz to 2000 Hz, and the preset frequency range is not limited here. If the frequency of the identified sound signal is not within the preset frequency range, it may be the sound of the machine or the noise in the environment, etc. In this case, it can be determined that the relevance is irrelevant to the user; if the identified sound signal If the frequency is within the preset frequency range, it means that the voice of a person is recognized. In order to avoid missing useful sound signals, it can be determined that the relevance is related to the user. If there is other environmental feature information, it may continue to wait for the next step of determination. On this basis, according to the condition that the frequency of the sound signal in the environment is within the preset frequency range, some non-human voices in the environment can be excluded, so as not to affect the reliability of the correlation determination.
在一些实施例中，除了使用预设频率范围的方式来识别人声信号，也可以通过其他能够区分人声和非人声信号的方式来识别出人声信号，此处对此不作限定。In some embodiments, in addition to using a preset frequency range to identify the human voice signal, the human voice signal may also be identified in other ways capable of distinguishing the human voice from the non-human voice signal, which is not limited herein.
本实施例中，响度阈值可以认为是所设定的一个声音信号响度的最小值。根据不同的环境可以设定不同的响度阈值，且响度阈值与环境中的平均响度之间的关系可以为正相关。如在图书馆中，由于此环境中本身就很安静，故所设定的响度阈值可以相对低一些，比如说为40分贝；当检测到所接收的声音信号的响度大于40分贝，则可以认为该声音信号为有用信号，可以判定关联性为与用户有关。或者若是在火车站等嘈杂的环境下，所设定的响度阈值可以相 对高一些，比如说为60分贝；此时当检测到所接收的声音信号的响度大于60分贝，则可以认为该声音信号为有用信号，可以判定关联性为与用户有关。此处对响度阈值不作限定，可根据实际情况和不同环境灵活设定。In this embodiment, the loudness threshold may be considered as a minimum value of the set loudness of a sound signal. Different loudness thresholds may be set according to different environments, and the relationship between the loudness threshold and the average loudness in the environment may be a positive correlation. For example, in a library, since the environment itself is very quiet, the loudness threshold set can be relatively low, for example, 40 decibels; when it is detected that the loudness of the received sound signal is greater than 40 decibels, it can be considered The sound signal is a useful signal, and it can be determined that the relevance is related to the user. Or if it is in a noisy environment such as a train station, the set loudness threshold can be relatively high, for example, 60 decibels; at this time, when the loudness of the received sound signal is detected to be greater than 60 decibels, the sound signal can be considered As a useful signal, the relevance may be determined to be related to the user. The loudness threshold is not limited here, and can be flexibly set according to actual situations and different environments.
获取声音信号的响度的主要目的是识别声音信号中是否有大于响度阈值的信号，从而判断接收到的声音信号是否是针对用户发出的，或者判断声源是否在用户附近。例如，如果声音信号的响度低于响度阈值，则可能是较远处的人正在说话，或者是旁边的人正在与他人谈话而非与用户说话，这种情况下，可认为声音信号对用户是无用的，可以滤除这类响度较弱的声音信号；如果声音信号的响度高于响度阈值，则可能是较近处的人正在说话，也很有可能是正与用户说话，这种情况下，可认为声音信号对用户可能会有用，可以判定关联性为与用户有关。在此基础上，根据环境中声音信号的响度大于响度阈值这个条件，能够将可能对用户无用的声音信号先排除掉一部分，保留可能会对用户有用的部分。此外，如果还有其他的环境特征信息，则可以继续等待下一步判定。The main purpose of acquiring the loudness of the sound signal is to identify whether there is a signal greater than the loudness threshold in the sound signal, so as to determine whether the received sound signal is directed at the user, or whether the sound source is near the user. For example, if the loudness of the sound signal is lower than the loudness threshold, it may be that someone far away is talking, or the person next to him is talking to others instead of the user. In this case, the sound signal can be considered to be harmful to the user Useless, you can filter out such weaker sound signals; if the loudness of the sound signal is higher than the loudness threshold, it may be that someone nearby is talking, or it is likely to be talking to the user. In this case, It can be considered that the sound signal may be useful to the user, and it can be determined that the association is related to the user. On this basis, according to the condition that the loudness of the sound signal in the environment is greater than the loudness threshold, a part of the sound signal that may be useless to the user can be excluded first, and a part that may be useful to the user can be reserved. In addition, if there is other environmental characteristic information, it may continue to wait for the next step of determination.
在上述实施例的基础上，环境特征信息满足至少两种条件，则确定关联性为与用户相关，并控制耳机处于目标工作模式，可以认为是将任意两项环境特征信息相结合，且均满足所对应的条件，则可以确定该两项环境特征信息结合后所对应的环境与用户的关联性为与用户相关，并控制耳机处于目标工作模式。也可以将三种环境特征信息相结合，且均满足所对应的条件，则可以确定该三项环境特征信息结合后所对应的环境与用户的关联性为与用户相关，并控制耳机处于目标工作模式。On the basis of the above-mentioned embodiments, if the environmental feature information meets at least two conditions, it is determined that the relevance is related to the user, and the earphone is controlled to be in the target working mode, which can be considered as combining any two pieces of environmental feature information, and both satisfy According to the corresponding conditions, it can be determined that the correlation between the environment and the user corresponding to the combination of the two pieces of environmental feature information is related to the user, and the earphone is controlled to be in the target working mode. It is also possible to combine the three kinds of environmental feature information, and all of them meet the corresponding conditions, then it can be determined that the correlation between the environment and the user corresponding to the combination of the three environmental feature information is related to the user, and the earphone is controlled to be in the target working state. model.
不管是将任意两项环境特征信息相结合，还是将三种环境特征信息相结合，来判定关联性，都不限定环境特征信息对应条件之间的先后判定顺序，可根据实际需求进行排序。比如说，采用将环境中声音信号的频率以及环境中声音信号的响度这两个环境特征信息相结合的方式来确定与用户的关联性，并控制耳机的工作模式，则这两个环境特征信息可以按照任意顺序来判定。在检测到环境中的一个声音信号之后，可以先根据声音信号的响度来初步判断该声音信号是否可能有用，可能会无法排除非人声(如环境中与人声响度接近的机器声音)的影响，此时可以继续通过该声音信号的频率是否在设定范围之内来排除掉非人声部分；也可以先通过判定环境中声音信号的频率是否在预设频率范围内，以先滤除掉非人声部分，之后再通过声音信号的响度来判定该声音信号是否对用户有用。在此基础上，采用多重判定的方式，可以提高工作模式控制的可靠性，能够避免不必要的工作模式切换，也能够使用户及时关注环境中的有用信息，并兼顾降噪效果。Regardless of combining any two pieces of environmental characteristic information or combining three kinds of environmental characteristic information to determine the relevance, there is no limit to the order of determining the corresponding conditions of the environmental characteristic information, and the order can be made according to actual needs. For example, the frequency of the sound signal in the environment and the loudness of the sound signal in the environment are combined to determine the relevance to the user and control the working mode of the earphone. Can be determined in any order. After detecting a sound signal in the environment, you can first judge whether the sound signal may be useful according to the loudness of the sound signal, and it may not be possible to rule out the influence of non-human voices (such as machine sounds that are close to the loudness of human voices in the environment) , at this time, you can continue to exclude the non-human voice part by checking whether the frequency of the sound signal is within the set range; you can also first filter out the part by judging whether the frequency of the sound signal in the environment is within the preset frequency range. The non-human voice part, and then judge whether the sound signal is useful to the user according to the loudness of the sound signal. On this basis, the use of multiple judgments can improve the reliability of the working mode control, avoid unnecessary switching of working modes, and enable users to pay attention to useful information in the environment in a timely manner while taking into account the effect of noise reduction.
在一实施例中，也可以根据不同环境特征信息及其对应的条件对关联性判定的重要程度，确定判定顺序，以提高确定关联性的效率。例如，滤除非人声信号相比于滤除响度较弱的声音信号更重要，更有利于准确高效地判定关联性，则可以先根据声音信号的频率进行判定。如果声音信号的频率不在预设频率范围内，即可直接判定为与用户无关，无需进行下一次判定；如果在预设频率范围内，则初步判定为与用户有关，然后可以根据声音信号的响度判定。In an embodiment, the order of determination may also be determined according to the importance of different environmental characteristic information and corresponding conditions to the determination of relevance, so as to improve the efficiency of determining relevance. For example, filtering out non-human voice signals is more important than filtering out weaker voice signals, which is more conducive to accurately and efficiently determining the relevance, and the determination can be made based on the frequency of the voice signals first. If the frequency of the sound signal is not within the preset frequency range, it can be directly judged that it has nothing to do with the user, and there is no need to make the next judgment; if it is within the preset frequency range, it is initially judged to be related to the user, and then it can determination.
本实施例通过判定环境特征信息满足至少两种条件，实现了对关联性是否为与用户相关的多重判定，在此基础上能够更准确的、更适时的切换耳机工作模式，避免了非必要的模式切换所引起用户反感的情况，增强了用户使用耳机降噪功能的体验。In this embodiment, by judging that the environmental feature information satisfies at least two conditions, multiple judgments on whether the relevance is related to the user are realized. On this basis, the headset working mode can be switched more accurately and timely, avoiding unnecessary The user's disgust caused by mode switching enhances the user's experience of using the noise reduction function of the headset.
在一实施例中，根据环境特征信息对应的环境与用户的关联性，控制耳机的工作模式，包括：环境中声音信号的语义包括预设关键词，则确定关联性为与用户相关，控制耳机处于目标工作模式。In one embodiment, according to the correlation between the environment and the user corresponding to the environmental feature information, the working mode of the earphone is controlled, including: if the semantics of the sound signal in the environment includes preset keywords, then it is determined that the correlation is related to the user, and the earphone is controlled. In target working mode.
本实施例中，判断声音信号的语义是否包括预设关键词的主要目的是，判断接收到的声音信号是否包含用户感兴趣或对用户有用的内容。例如，预设关键词可以包括用户的姓名、职业、住址等。如果声音信号的语义包括预设关键词中的一个或多个，则确定关联性为与用户相关，并控制耳机处于目标工作模式；如果声音信号的语义不包括任何预设关键词，则确定关联性为与用户无关，则可以控制耳机继续工作于降噪模式。In this embodiment, the main purpose of judging whether the semantics of the sound signal includes preset keywords is to judge whether the received sound signal contains content that the user is interested in or useful to the user. For example, the preset keywords may include the user's name, occupation, address and so on. If the semantics of the sound signal includes one or more of the preset keywords, then determine the association as being relevant to the user, and control the earphone to be in the target working mode; if the semantics of the sound signal does not include any preset keywords, then determine the association Since it has nothing to do with the user, the earphone can be controlled to continue to work in the noise reduction mode.
在一实施例中，获取用户预设的关键词元素，对关键词元素进行排列组合，得到多种形式的预设关键词。关键词元素可以为一个或多个。当关键词元素为多个的情况下，可以对多个关键词元素进行排列组合，得到多种预设关键词。例如，关键词元素为三个，这三个关键词元素可分别记为A、B、C，则经过排列组合之后可以得到{A、B、C、AB、AC、BC、BA、...、ABC、ACB、BCA、...}等多种预设关键词，如果声音信号中包括其中的一种或多种预设关键词，则可以认为该声音信号与用户相关，即为有用信号。在一实施例中，也可以设置声音信号中必须包括至少N(N≥2)个预设关键词元素，才认为该声音信号是有用信号。In one embodiment, the keyword elements preset by the user are obtained, and the keyword elements are arranged and combined to obtain preset keywords in various forms. There can be one or more keyword elements. When there are multiple keyword elements, multiple keyword elements can be arranged and combined to obtain various preset keywords. For example, there are three keyword elements, and these three keyword elements can be recorded as A, B, and C respectively. After permutation and combination, {A, B, C, AB, AC, BC, BA, ... , ABC, ACB, BCA, ...} and other preset keywords, if the sound signal includes one or more of the preset keywords, it can be considered that the sound signal is related to the user, that is, a useful signal . In an embodiment, it may also be set that the sound signal must include at least N (N≧2) preset keyword elements before the sound signal is considered to be a useful signal.
本实施例中，虽然环境特征信息只有声音信号的语义这一种，但由于预设关键词可以较为准确地反映用户的兴趣和偏好，所以根据声音信号的语义是否包含预设关键词这一条件，也能够可靠地确定关联性。此外，在一些实施例中，根据声音信号的语义是否包含预设关键词这一条件，也可以应用于多重判定场景中。In this embodiment, although the environmental feature information is only the semantics of the sound signal, since the preset keywords can more accurately reflect the user's interests and preferences, according to the condition of whether the semantics of the sound signal contains the preset keywords , can also reliably determine the association. In addition, in some embodiments, according to the condition of whether the semantics of the sound signal contains preset keywords, it can also be applied to multiple determination scenarios.
在一实施例中，环境特征信息包括环境中设定范围内的人数；获取用户佩 戴的耳机处于降噪模式下的环境特征信息，包括：通过终端的发射天线发射毫米波，并通过终端的接收天线接收至少一个探测目标对于毫米波的散射波；根据散射波确定探测目标为人物，并通过毫米波发射时间与散射波接收时间的时间差，确定终端与人物之间的距离；根据终端与人物之间的距离，确定环境中设定范围内的人数。In one embodiment, the environmental characteristic information includes the number of people within the set range in the environment; obtaining the environmental characteristic information of the earphones worn by the user in the noise reduction mode includes: transmitting millimeter waves through the transmitting antenna of the terminal, and receiving The antenna receives at least one detection target's scattered wave of the millimeter wave; according to the scattered wave, it is determined that the detection target is a person, and the distance between the terminal and the person is determined by the time difference between the millimeter wave emission time and the scattered wave reception time; according to the distance between the terminal and the person The distance between them determines the number of people within the set range in the environment.
本实施例中，毫米波可以指波长为1-10毫米(对应频率范围为30-300GHz)的电磁波，可以通过终端的发射天线发射毫米波。探测目标可以指能够反射毫米波的物体，包括在环境中设定范围内所需要探测的人物。散射波可以指发射天线所发射的毫米波发送至探测目标，与探测目标内的介电常数相互作用之后所反射回来的信号波，其可以通过终端的接收天线来接收。根据发射的毫米波以及接收到的探测目标的散射波，可以确定耳机与探测目标之间的距离，进而确定在环境中设定范围内探测目标的数量。在此基础上，如果能确定每个探测目标是否为人物，则可以准确确定在环境中设定范围内的人数。可以通过发射天线定时发射毫米波，接收天线实时接收散射波的方式，来确定环境中设定范围内的人数。In this embodiment, millimeter waves may refer to electromagnetic waves with a wavelength of 1-10 millimeters (corresponding to a frequency range of 30-300 GHz), and millimeter waves may be transmitted through a transmitting antenna of a terminal. The detection target may refer to an object capable of reflecting millimeter waves, including persons to be detected within a set range in the environment. The scattered wave may refer to the signal wave reflected back after the millimeter wave emitted by the transmitting antenna is sent to the detection target and interacts with the dielectric constant in the detection target, which can be received by the receiving antenna of the terminal. According to the emitted millimeter waves and the received scattered waves of the detection target, the distance between the earphone and the detection target can be determined, and then the number of detection targets within the set range in the environment can be determined. On this basis, if it can be determined whether each detection target is a person, the number of people within the set range in the environment can be accurately determined. The number of people within the set range in the environment can be determined by transmitting the millimeter wave regularly by the transmitting antenna and receiving the scattered wave by the receiving antenna in real time.
若终端为集成于耳机内部的芯片或电子设备，或者终端为独立于耳机的终端设备且耳机为有线耳机，则耳机、终端和用户可以认为是处在同一个位置，以终端为中心点来发射毫米波，可以确定耳机(也即确定终端或用户)与探测目标之间的距离。若终端为独立于耳机的终端设备且耳机为无线耳机(如蓝牙耳机)，则耳机和终端之间可能会存在一定的距离，如戴着蓝牙耳机的用户在距离终端2米远的地方，则此时如果以终端为中心点来确定其与探测到的人物之间的距离，会与耳机与人物之间的距离存在一定的误差。这种情况下，可以在确定终端与人物之间的距离之后，再根据蓝牙耳机与终端之间的距离和位置关系，换算得到该人物与耳机的距离，从而实现对环境中人的探测。此处对距离换算的算法不作限定。在一些实施例中，若无线耳机与终端之间的距离远小于与人物之间的距离，则该误差也可以忽略不计。If the terminal is a chip or electronic device integrated in the earphone, or the terminal is a terminal device independent of the earphone and the earphone is a wired earphone, then the earphone, terminal and user can be considered to be in the same position, and the terminal is the center point to transmit Millimeter waves can determine the distance between the earphone (that is, determine the terminal or user) and the detection target. If the terminal is a terminal device independent of the headset and the headset is a wireless headset (such as a Bluetooth headset), there may be a certain distance between the headset and the terminal. For example, if a user wearing a Bluetooth headset is 2 meters away from the terminal, then At this time, if the terminal is used as the center point to determine the distance between it and the detected person, there will be a certain error with the distance between the earphone and the person. In this case, after determining the distance between the terminal and the person, the distance between the person and the headset can be converted according to the distance and positional relationship between the Bluetooth headset and the terminal, so as to realize the detection of people in the environment. Here, the algorithm for distance conversion is not limited. In some embodiments, if the distance between the wireless headset and the terminal is much smaller than the distance between the wireless headset and the person, the error can also be ignored.
图2为一实施例提供的一种利用毫米波探测人物的示意图。如图2所示，以终端为独立于耳机的终端设备，且耳机为有线耳机(即终端与耳机视为同一位置)的情况为例，根据发射毫米波与接收散射波之间的时间差，来确定耳机与探测到的人物之间的距离的实现过程如下：Fig. 2 is a schematic diagram of detecting people by using millimeter waves according to an embodiment. As shown in Figure 2, taking the case where the terminal is a terminal device independent of the earphone, and the earphone is a wired earphone (that is, the terminal and the earphone are regarded as the same location), according to the time difference between transmitting the millimeter wave and receiving the scattered wave, the The implementation process of determining the distance between the headset and the detected person is as follows:
首先，通过终端内的发射天线发射毫米波S1，如果周围有人，由于探测目标的介电常数一定，该介电常数与毫米波S1相互作用之后，会产生具有一定特征信号的散射波S2；然后，终端内的接收天线接收反射回来的散射波S2，假设毫米波S1的发射时间为T1，散射波S2的接收时间为T2，则终端与人物 之间的距离D可以表示为：First, the millimeter wave S1 is transmitted through the transmitting antenna in the terminal. If there are people around, since the detection target has a certain dielectric constant, after the dielectric constant interacts with the millimeter wave S1, a scattered wave S2 with a certain characteristic signal will be generated; then , the receiving antenna in the terminal receives the reflected scattered wave S2, assuming that the transmission time of the millimeter wave S1 is T1, and the receiving time of the scattered wave S2 is T2, then the distance D between the terminal and the person can be expressed as:
Figure PCTCN2022108912-appb-000001
其中，C表示光速。
Figure PCTCN2022108912-appb-000001
Among them, C represents the speed of light.
在一实施例中，也可以根据毫米波S1从终端发射到被探测目标接收的时长t1，以及毫米波S2从探测目标发射到被终端接收的时长t2确定，终端与探测目标之间的距离D可以表示为：In an embodiment, the distance D between the terminal and the detection target can also be determined according to the time length t1 from the transmission of the millimeter wave S1 from the terminal to the reception by the detected target, and the time t2 from the transmission of the millimeter wave S2 to the reception by the terminal. It can be expressed as:
Figure PCTCN2022108912-appb-000002
其中，C表示光速。
Figure PCTCN2022108912-appb-000002
Among them, C represents the speed of light.
在一实施例中，根据散射波确定探测目标为人物，包括：根据散射波确定探测目标的属性特征，属性特征包括形状和/或面积；属性特征符合人物特征，则确定探测目标为人物。In an embodiment, determining that the detection target is a person according to the scattered waves includes: determining attribute characteristics of the detection target according to the scattered waves, the attribute characteristics include shape and/or area; and determining that the detection target is a person if the attribute characteristics conform to the characteristics of the person.
本实施例中，符合人物特征的属性特征可以认为是所确定的探测目标的形状和/或面积大致与人体的形状和/或面积相符合。由于在环境中设定范围内可能会存在与人体介电常数相同或者相近的物体，如人体主要成分是液体，若周围有一杯奶茶，则在探测时极有可能会把奶茶误判定为人体。因此，在确定终端与探测目标之间的距离之前，还要根据所确定的探测目标的属性特征是否符合人物特征，来确定所探测目标是否为人物。In this embodiment, the attribute feature conforming to the character of the person may be considered that the determined shape and/or area of the detection target roughly conforms to the shape and/or area of the human body. Since there may be objects with the same or similar dielectric constant as the human body within the set range in the environment, if the main component of the human body is liquid, if there is a cup of milk tea around, it is very likely that the milk tea will be misjudged as a human body during detection. Therefore, before determining the distance between the terminal and the detection target, it is necessary to determine whether the detection target is a person according to whether the determined attribute characteristics of the detection target conform to the characteristics of the person.
图3为一实施例提供的一种利用毫米波识别探测目标长度的示意图。如图3所示，以终端为独立于耳机的终端设备，且耳机为有线耳机(即终端与耳机视为同一位置)的情况为例，由于相对于远处的探测目标，发射天线和接收天线之间的距离较短，可以忽略不计，因此可以将发射天线和接收天线设置于一处来进行探测目标长度的识别。实现过程如下：首先，发射天线分别发射毫米波至探测目标的A位置和B位置处；然后根据发射毫米波与接收散射波之间的时间差，来分别确定终端与探测目标的A位置和B位置之间的距离D1和D2，以及距离D1与D2之间的夹角θ；最后根据余弦定理可计算得到探测目标的A位置和B位置之间的长度|AB|，可表示为：
Figure PCTCN2022108912-appb-000003
Fig. 3 is a schematic diagram of using millimeter waves to identify and detect the length of a target provided by an embodiment. As shown in Figure 3, taking the case where the terminal is a terminal device independent of the earphone, and the earphone is a wired earphone (that is, the terminal and the earphone are regarded as the same location), since the transmitting antenna and the receiving antenna The distance between them is relatively short and can be ignored, so the transmitting antenna and receiving antenna can be set in one place to identify the length of the detection target. The implementation process is as follows: first, the transmitting antenna transmits millimeter waves to position A and position B of the detection target respectively; then, according to the time difference between transmitting the millimeter wave and receiving the scattered wave, respectively determine the position A and position B of the terminal and the detection target The distance between D1 and D2, and the angle θ between D1 and D2; finally, according to the law of cosines, the length |AB| between the A position and B position of the detection target can be calculated, which can be expressed as:
Figure PCTCN2022108912-appb-000003
利用上述方法可以对探测目标的多个不同位置或不同方向上的长度和夹角进行计算，并在此基础上，可以得到探测目标的映射面积和/或形状。然后可以根据人物特征，预先对面积和/或形状进行限定，如可以对面积和/或形状预先设定一个范围；如果所获取的探测目标的面积和/或形状在该范围之内，则可以判定探测目标为有效目标，即符合人物特征，可确定为人物。此处对范围的设定不作限定。The above method can be used to calculate the lengths and included angles of multiple different positions or different directions of the detection target, and on this basis, the mapped area and/or shape of the detection target can be obtained. Then the area and/or shape can be defined in advance according to the characteristics of the person, such as a range can be preset for the area and/or shape; if the area and/or shape of the acquired detection target is within the range, then it can It is determined that the detection target is a valid target, that is, conforms to the characteristics of a person, and can be determined as a person. The setting of the range is not limited here.
图4为一实施例提供的一种确定环境中设定范围内的人数的示意图。如图 4所示，以终端为中心，根据与探测目标(已判断探测目标为人物)之间的距离，探测设定半径R范围内的人数。在此基础上，与所预先设定的人数阈值进行比较，若所确定的人数小于人数阈值，则满足条件，可以为下一步耳机的目标工作模式的控制提供依据。本实施例通过5G毫米波识别功能，能够有效对耳机外界环境中的人物进行定位，以准确识别出人数。Fig. 4 is a schematic diagram of determining the number of people within a set range in an environment provided by an embodiment. As shown in Figure 4, with the terminal as the center, the number of people within the set radius R is detected according to the distance from the detection target (the detection target has been judged to be a person). On this basis, it is compared with the preset number of people threshold, if the determined number of people is smaller than the number of people threshold, the condition is met, which can provide a basis for the next step of controlling the target working mode of the earphone. In this embodiment, through the 5G millimeter wave recognition function, the people in the external environment of the headset can be effectively positioned to accurately identify the number of people.
在一个实施例中，还可以由基站通过与终端通信以探测耳机外界环境中的人数，并通知给终端。根据基站与终端之间的交互通信，并利用***移动通信(Fourth Generation，4G)、5G技术可以实现终端的快速定位。可以利用两个基站来实现对终端的定位，也可以利用一个基站来实现对终端的定位，从而由基站确定设定范围内的人数，然后再通知给终端。但是，利用基站对终端进行定位来确定环境中的人数的方法，需要保证每个人都拥有终端，故该方法具有一定的使用限制，对没有携带终端的人无法进行定位。In one embodiment, the base station can also communicate with the terminal to detect the number of people in the external environment of the headset, and notify the terminal. According to the interactive communication between the base station and the terminal, and using the fourth generation mobile communication (4G) and 5G technology, the rapid positioning of the terminal can be realized. Two base stations can be used to realize the positioning of the terminal, and one base station can also be used to realize the positioning of the terminal, so that the base station determines the number of people within the set range, and then notifies the terminal. However, the method of using the base station to locate the terminal to determine the number of people in the environment needs to ensure that everyone has a terminal, so this method has certain usage restrictions, and people who do not carry a terminal cannot be located.
以终端为手机为例，图5A为一实施例提供的一种利用两个基站实现手机定位的示意图。如图5A所示，首先，当基站1与手机交互，可以得到基站1与手机之间的距离X1，并以基站1为中心，X1为半径生成一个圆；然后，当基站2与手机交互，可以得到基站2与手机之间的距离X2，并以基站2为中心，X2为半径也生成一个圆；最后，所生成的两个圆的交叉点即为手机所在的位置。在此基础上，基站可以探测到设定范围内的手机的数量，并通知终端。Taking the terminal as a mobile phone as an example, FIG. 5A is a schematic diagram of implementing mobile phone positioning by using two base stations provided by an embodiment. As shown in Figure 5A, first, when base station 1 interacts with the mobile phone, the distance X1 between base station 1 and the mobile phone can be obtained, and a circle is generated with base station 1 as the center and X1 as the radius; then, when base station 2 interacts with the mobile phone, The distance X2 between the base station 2 and the mobile phone can be obtained, and a circle is generated with the base station 2 as the center and X2 as the radius; finally, the intersection point of the two generated circles is the location of the mobile phone. On this basis, the base station can detect the number of mobile phones within the set range and notify the terminal.
图5B为一实施例提供的一种利用一个基站实现手机定位的示意图。如图5B所示，根据基站收集到的上行信号，可以获取手机的位置和角动量信息，以此来精准定位手机的位置。其中，上行信号可以指基站所接收到的手机信号。在此基础上，基站可以探测到设定范围内的手机的数量，并通知终端。FIG. 5B is a schematic diagram of implementing mobile phone positioning by using a base station provided by an embodiment. As shown in Figure 5B, according to the uplink signal collected by the base station, the location and angular momentum information of the mobile phone can be obtained, so as to accurately locate the location of the mobile phone. Wherein, the uplink signal may refer to a mobile phone signal received by the base station. On this basis, the base station can detect the number of mobile phones within the set range and notify the terminal.
图6为一实施例提供的一种处理声音信号以获取声音信号频率的示意图。本实施例中，环境特征信息包括声音信号的频率。如图6所示，采集声音信号并对其进行处理获取信号频率的实现过程如下：首先，通过信号采集设备采集环境中的声音信号；然后，可以通过音频信号处理***将所采集到的声音信号进行信号处理，如可以通过傅里叶变换方法获取声音信号的频率；最后，判断该声音信号的频率是否在所限制的频率范围(如500-2000Hz)内，若该声音信号的频率在所限制的频率范围内，则满足条件，可以为耳机的目标工作模式的控制提供依据。Fig. 6 is a schematic diagram of processing a sound signal to obtain a frequency of the sound signal provided by an embodiment. In this embodiment, the environmental feature information includes the frequency of the sound signal. As shown in Figure 6, the implementation process of collecting sound signals and processing them to obtain the signal frequency is as follows: first, the sound signals in the environment are collected through the signal collection equipment; then, the collected sound signals can be processed by the audio signal processing system Carry out signal processing, such as the frequency of the sound signal can be obtained by the Fourier transform method; finally, determine whether the frequency of the sound signal is within the limited frequency range (such as 500-2000Hz), if the frequency of the sound signal is within the limited In the frequency range, the condition is satisfied, which can provide a basis for the control of the target working mode of the earphone.
图7为一实施例提供的一种处理声音信号以获取声音信号响度的示意图。本实施例中，环境特征信息包括声音信号的响度。如图7所示，采集声音信号并对其进行处理获取信号响度的实现过程如下：首先，通过信号采集设备采集环境中的声音信号；然后，可以通过音频信号处理***将所采集到的声音信号 进行信号处理以获取声音信号的响度；最后，判断该声音信号的响度是否大于所预设的响度阈值，若该声音信号的响度大于所预设的响度阈值，则满足条件，可以为耳机的目标工作模式的控制提供依据。此处对获取响度的信号处理方法不作限定。Fig. 7 is a schematic diagram of processing a sound signal to obtain the loudness of the sound signal provided by an embodiment. In this embodiment, the environmental feature information includes the loudness of the sound signal. As shown in Figure 7, the implementation process of collecting sound signals and processing them to obtain signal loudness is as follows: first, the sound signals in the environment are collected through the signal collection equipment; then, the collected sound signals can be processed by the audio signal processing system Perform signal processing to obtain the loudness of the sound signal; finally, determine whether the loudness of the sound signal is greater than the preset loudness threshold, if the loudness of the sound signal is greater than the preset loudness threshold, the condition is met, and it can be the target of the earphone Provide basis for the control of working mode. The signal processing method for acquiring the loudness is not limited here.
图8为一实施例提供的一种处理声音信号以获取声音信号语义的示意图。本实施例中，环境特征信息包括声音信号的语义。如图8所示，采集声音信号并对其进行处理获取对应文本内容的实现过程如下：首先，通过信号采集设备采集环境中的声音信号；然后，可以通过音频信号处理***将所采集到的声音信号进行信号处理，如可以通过***内的语音识别模型以获取声音信号对应的文本内容；最后，判断该声音信号对应的文本内容中是否包含预设关键词，若该声音信号对应的文本内容中包含预设关键词，则满足条件，可以为耳机的目标工作模式的控制提供依据。此处对获取声音信号对应文本内容的方式不作限定。Fig. 8 is a schematic diagram of processing an audio signal to obtain semantics of the audio signal provided by an embodiment. In this embodiment, the environmental characteristic information includes the semantics of the sound signal. As shown in Figure 8, the implementation process of collecting sound signals and processing them to obtain the corresponding text content is as follows: first, the sound signals in the environment are collected through the signal collection equipment; then, the collected sound signals can be processed through the audio signal processing system For example, the text content corresponding to the sound signal can be obtained through the speech recognition model in the system; finally, it is judged whether the text content corresponding to the sound signal contains preset keywords, if the text content corresponding to the sound signal contains If the preset keyword is included, the condition is met, which can provide a basis for controlling the target working mode of the earphone. Here, there is no limitation on the manner of acquiring the text content corresponding to the sound signal.
在上述实施例的基础上，在所获取的声音信号对应的文本内容中，所检测到的与预设关键词相匹配的信息可以显示在终端的显示屏上，用于提醒用户快速定位环境中的声音信息。本实施例通过对关键词元素进行排列组合，能够提高声音信号的语义与预设关键词之间的匹配度识别准确性，有效帮助用户获取环境中的有用声音信息。On the basis of the above-mentioned embodiments, in the text content corresponding to the acquired sound signal, the detected information that matches the preset keyword can be displayed on the display screen of the terminal to remind the user to quickly locate the voice information. In this embodiment, by arranging and combining keyword elements, it is possible to improve the recognition accuracy of the matching degree between the semantics of the sound signal and the preset keywords, and effectively help the user obtain useful sound information in the environment.
上述实施例中所提到的信号采集设备可以是指终端中的话筒或者集成在耳机内的电子设备；同样的，音频信号处理***也可以是指集成在终端或者耳机内的电子设备。此处对此不作限定。The signal acquisition device mentioned in the above embodiments may refer to a microphone in a terminal or an electronic device integrated in an earphone; similarly, an audio signal processing system may also refer to an electronic device integrated in a terminal or an earphone. This is not limited here.
在一实施例中，根据环境特征信息对应的环境与用户的关联性，控制耳机的工作模式，包括：在关联性为与用户相关的情况下，执行以下之一：控制耳机处于非降噪模式；控制耳机处于降噪模式，且降低耳机的播放音量；控制耳机处于降噪模式，并显示关于工作模式的询问信息；在关联性为与用户无关的情况下，控制耳机处于降噪模式。In one embodiment, controlling the working mode of the headset according to the correlation between the environment and the user corresponding to the environmental feature information includes: when the correlation is related to the user, performing one of the following: controlling the headset to be in a non-noise reduction mode ;Control the headset to be in the noise reduction mode, and reduce the playback volume of the headset; control the headset to be in the noise reduction mode, and display an inquiry message about the working mode; if the association is irrelevant to the user, control the headset to be in the noise reduction mode.
本实施例中，关于工作模式的询问信息可以认为是显示在终端显示屏上的关于是否要退出降噪模式的选择信息。关联性为与用户相关的情况下，有多种耳机工作模式的控制方式，如可以控制耳机处于非降噪模式；也可以继续保持在降噪模式下，但是可以通过降低耳机播放音量等方式来使得用户能够听到外界有用声音。关联性为与用户无关的情况下，用户可以不作任何操作，耳机继续保持降噪模式即可。In this embodiment, the inquiry information about the working mode can be regarded as selection information about whether to exit the noise reduction mode displayed on the display screen of the terminal. When the association is related to the user, there are multiple control methods for the working mode of the earphone, such as controlling the earphone to be in the non-noise-cancelling mode; it can also be kept in the noise-cancelling mode, but can be controlled by reducing the earphone playback volume, etc. Allows the user to hear useful sounds from the outside world. If the association is irrelevant to the user, the user does not need to perform any operations, and the earphones can continue to maintain the noise reduction mode.
控制耳机工作于非降噪模式包括多种形式，如直接退出耳机降噪功能，等待用户手动再次开启；或者是暂时关闭降噪功能，直至满足降噪模式重开启条 件再自动开启，其中降噪重开启条件可以为一个预设时间值，预设时间值可以大致为一句话的时间(如5秒钟)等，对此不作限定；也可以为暂时关闭降噪功能，直至检测不到处于人声的预设频率范围内的声音信号；还可以为暂时关闭降噪功能，直至所检测到的周围环境内的声音变嘈杂等。Controlling the headphones to work in the non-noise reduction mode includes various forms, such as directly exiting the headphone noise reduction function, waiting for the user to manually turn it on again; The re-opening condition can be a preset time value, and the preset time value can be roughly the time of a sentence (such as 5 seconds), etc., and this is not limited; it can also be temporarily turning off the noise reduction function until no people are detected. The sound signal within the preset frequency range of the sound; the noise reduction function can also be temporarily turned off until the sound in the detected surrounding environment becomes noisy.
控制耳机工作于降噪模式也包括多种方式，如在控制耳机继续工作于降噪模式之后，可以自动调低耳机自身的播放音量，或者暂停播放，以保证用户可以判断环境中的声音是否与自己有关，若环境中的声音与自己无关，则可以自动恢复耳机自身原来的音量，若环境中的声音与自己有关，则用户可以通过终端来选择是否要继续使用耳机降噪模式；也可以是保持降噪模式开启的同时，通过终端显示关于工作模式的询问信息，或者语音的形式来提醒用户是否要选择关闭降噪模式。There are also many ways to control the earphones to work in the noise reduction mode. For example, after controlling the earphones to continue to work in the noise reduction mode, the playback volume of the earphones can be automatically lowered, or the playback can be paused to ensure that the user can judge whether the sound in the environment is consistent with the noise. It is related to yourself. If the sound in the environment has nothing to do with you, the original volume of the headset itself can be automatically restored. If the sound in the environment is related to you, the user can choose whether to continue using the noise reduction mode of the headset through the terminal; it can also be While keeping the noise reduction mode turned on, the terminal displays an inquiry message about the working mode, or reminds the user whether to choose to turn off the noise reduction mode in the form of voice.
图9为一实施例提供的另一种耳机工作模式控制方法的流程图。如图9所示，本实施例中是以三种条件，即环境中设定范围内的人数低于人数阈值、环境中声音信号的频率在预设频率范围内以及环境中声音信号的响度大于响度阈值相结合对耳机工作模式进行控制为例，本实施例提供的方法包括：Fig. 9 is a flow chart of another method for controlling the working mode of an earphone provided by an embodiment. As shown in Figure 9, there are three conditions in this embodiment, that is, the number of people within the set range in the environment is lower than the number threshold, the frequency of the sound signal in the environment is within the preset frequency range, and the loudness of the sound signal in the environment is greater than The loudness threshold is combined to control the earphone working mode as an example. The method provided in this embodiment includes:
S210：确定环境中设定范围内的人数。S210: Determine the number of people within a set range in the environment.
S220：判定人数是否低于人数阈值；若人数低于人数阈值，则执行S230；若人数不低于人数阈值，则执行S280。S220: Determine whether the number of people is lower than the number threshold; if the number is lower than the number threshold, execute S230; if the number is not lower than the number threshold, execute S280.
本实施例中，若检测到声音信号时耳机外界的环境中设定范围内的人数高于人数阈值，则判定关联性为与用户无关，可以控制耳机继续工作于降噪模式。如设定在以耳机为中心，半径为6米的设定范围内的人数阈值为3人，则在地铁站或公交车等人数众多的环境下，多数情况所探测到的人数都会超过3人，此时可以不关闭降噪模式；若是人数低于所设定的人数阈值，则初步判定关联性为与用户有关，继续进行下一步耳机工作模式的判定。In this embodiment, if the number of people within the set range outside the earphone is higher than the number threshold when the sound signal is detected, it is determined that the relevance is irrelevant to the user, and the earphone can be controlled to continue to work in the noise reduction mode. For example, if the number of people threshold is set to 3 within the set range with the earphone as the center and a radius of 6 meters, then in environments with a large number of people, such as subway stations or buses, the detected number of people will exceed 3 in most cases. , the noise reduction mode may not be turned off at this time; if the number of people is lower than the set number threshold, the preliminary determination is that the correlation is related to the user, and the next step of determining the working mode of the headset is continued.
S230：确定环境中声音信号的频率。S230: Determine the frequency of the sound signal in the environment.
S240：判定声音信号的频率是否在预设频率范围内；若声音信号的频率在预设频率范围内，则执行S250；若声音信号的频率不在预设频率范围内，则执行S280。S240: Determine whether the frequency of the sound signal is within the preset frequency range; if the frequency of the sound signal is within the preset frequency range, execute S250; if the frequency of the sound signal is not within the preset frequency range, execute S280.
本实施例中，若声音信号的频率不在预设频率范围内，说明可能是非人声信号，则可判定关联性为与用户无关，可以控制耳机继续工作在降噪模式；若声音信号的频率在设定的预设频率范围内，则排除了声音信号中部分非人声的影响，则可以进一步判定关联性为与用户有关，再继续进行下一步判定。In this embodiment, if the frequency of the sound signal is not within the preset frequency range, indicating that it may be a non-human voice signal, it can be determined that the relevance is irrelevant to the user, and the earphone can be controlled to continue to work in the noise reduction mode; if the frequency of the sound signal is within Within the set preset frequency range, the influence of some non-human voices in the sound signal is excluded, and it can be further determined that the relevance is related to the user, and then continue to the next step of determination.
S250：确定环境中声音信号的响度。S250: Determine the loudness of the sound signal in the environment.
S260：判定声音信号的响度是否大于响度阈值；若音信号的响度大于响度阈值，则执行S270；若音信号的响度不大于响度阈值，则执行S280。S260: Determine whether the loudness of the sound signal is greater than the loudness threshold; if the loudness of the sound signal is greater than the loudness threshold, perform S270; if the loudness of the sound signal is not greater than the loudness threshold, perform S280.
本实施例中，在通过环境中设定范围内的人数和声音信号的频率判定之后，还是可能会产生耳机工作模式切换的误判，此时还可以通过声音信号响度的判断来确定该声音信号是否与用户相关。比如，在图书管里周围同学在小声讨论问题，与用户无关，但是所发出的声音信号的频率可能会处在预设频率范围内，此时可以通过声音的响度来继续进行判定；并且还可以根据用户所处的实际环境调节响度阈值的大小，如图书管环境很安静，可以适当将响度阈值增加以过滤掉不必要的声音信号，则可以不必频繁地切换耳机的工作模式，避免引起用户对耳机降噪功能的反感。In this embodiment, after judging by the number of people within the setting range in the environment and the frequency of the sound signal, misjudgment of switching the working mode of the earphone may still occur. At this time, the sound signal can also be determined by judging the loudness of the sound signal. Is it relevant to the user. For example, in the library, the students around are discussing the problem in a low voice, which has nothing to do with the user, but the frequency of the sound signal emitted may be within the preset frequency range. At this time, the loudness of the sound can be used to continue to judge; and it can also Adjust the loudness threshold according to the actual environment of the user. For example, if the environment of the library is very quiet, the loudness threshold can be increased appropriately to filter out unnecessary sound signals, so that it is not necessary to frequently switch the working mode of the earphone to avoid causing the user to be confused. Disgusting noise canceling feature of headphones.
S270：确定关联性为与用户相关，控制耳机处于目标工作模式。S270: Determine that the association is related to the user, and control the headset to be in the target working mode.
本实施例中，在满足环境中设定范围内的人数低于人数阈值、环境中声音信号的频率在预设频率范围内以及环境中声音信号的响度大于响度阈值这三个条件的情况下，可以最终确定关联性为与用户相关。在关联性为与用户相关的情况下，可以根据实际情况控制耳机处于目标工作模式，如可以控制耳机处于非降噪模式；也可以控制耳机继续处于降噪模式，此时用户可以通过降低耳机自身的播放音量或暂停播放等方式来使用户听清外界声音；还可以控制耳机继续处于降噪模式，此时用户可以通过终端的显示屏所显示的关于工作模式的询问信息，来自行选择是否退出降噪模式等。In this embodiment, when the three conditions are satisfied that the number of people within the set range in the environment is lower than the number of people threshold, the frequency of the sound signal in the environment is within the preset frequency range, and the loudness of the sound signal in the environment is greater than the loudness threshold, The relevance may ultimately be determined to be user-related. In the case that the association is related to the user, the earphone can be controlled to be in the target working mode according to the actual situation. For example, the earphone can be controlled to be in the non-noise reduction mode; the earphone can also be controlled to continue to be in the noise reduction mode. The user can hear the external sound clearly by adjusting the playback volume or pausing the playback; it can also control the headset to continue in the noise reduction mode. At this time, the user can choose whether to exit through the query information about the working mode displayed on the terminal screen. Noise canceling mode, etc.
S280：确定关联性为与用户无关，控制耳机处于降噪模式。S280: Determine that the association is irrelevant to the user, and control the earphone to be in the noise reduction mode.
本实施例中，确定关联性为与用户无关，可以说明所检测到的声音信号对用户无用，用户可以继续保持耳机的降噪模式，把注意力放在耳机所播放的内容上。In this embodiment, it is determined that the relevance is irrelevant to the user, which means that the detected sound signal is useless to the user, and the user can continue to maintain the noise reduction mode of the earphone and focus on the content played by the earphone.
本申请实施例提供的一种耳机工作模式控制方法，通过将三种环境特征信息对应的条件相结合，能够实现对声音信号的多重判定和筛选；在此基础上根据多重判定后的声音信号，能够更准确、更适时的控制耳机的工作模式切换，有效避免了耳机工作模式切换的误判，改善了用户对耳机降噪功能的使用体验。An earphone working mode control method provided in the embodiment of the present application can realize multiple determination and screening of sound signals by combining the conditions corresponding to the three kinds of environmental feature information; on this basis, according to the sound signals after multiple determinations, The working mode switching of the earphone can be controlled more accurately and in a timely manner, effectively avoiding misjudgment of the working mode switching of the earphone, and improving the user experience of the noise reduction function of the earphone.
本申请实施例还提供了一种耳机工作模式控制装置。图10为一实施例提供的一种耳机工作模式控制装置的结构示意图。如图10所示，该装置包括：The embodiment of the present application also provides a device for controlling a working mode of an earphone. Fig. 10 is a schematic structural diagram of an earphone working mode control device provided by an embodiment. As shown in Figure 10, the device includes:
信息获取模块310，设置为获取用户佩戴的耳机处于降噪模式下的环境特征信息；控制模块320，设置为根据所述环境特征信息对应的环境与用户的关 联性，控制所述耳机的工作模式。The information acquisition module 310 is configured to acquire the environmental characteristic information of the earphone worn by the user in the noise reduction mode; the control module 320 is configured to control the working mode of the earphone according to the correlation between the environment and the user corresponding to the environmental characteristic information .
本实施例的耳机工作模式控制装置，对处于降噪模式下的耳机，利用环境特征信息可以明确环境与用户的关联性，据此可以控制耳机的工作模式，使耳机工作在与周围环境相适应的工作模式，从而提高耳机的降噪功能对环境的适应性，也可以改善用户对耳机降噪功能的使用体验。The device for controlling the working mode of the earphone in this embodiment, for the earphone in the noise reduction mode, can use the environmental feature information to clarify the correlation between the environment and the user, thereby controlling the working mode of the earphone so that the earphone can work in an environment compatible with the surrounding environment. The working mode of the headset can improve the adaptability of the noise reduction function of the headset to the environment, and can also improve the user experience of the noise reduction function of the headset.
在一实施例中，所述环境特征信息包括以下至少一项：所述环境中设定范围内的人数；所述环境中声音信号的频率；所述环境中声音信号的响度；所述环境中声音信号的语义。In an embodiment, the environmental feature information includes at least one of the following: the number of people in the environment within a set range; the frequency of the sound signal in the environment; the loudness of the sound signal in the environment; Semantics of sound signals.
在一实施例中，所述控制模块320，包括：In one embodiment, the control module 320 includes:
相关确定单元，设置为所述环境特征信息满足以下至少两种条件的情况下，确定所述关联性为与用户相关，控制所述耳机处于目标工作模式：所述环境中设定范围内的人数低于人数阈值；所述环境中声音信号的频率在预设频率范围内；所述环境中声音信号的响度大于响度阈值。The correlation determination unit is configured to determine that the correlation is related to the user when the environmental feature information satisfies at least two of the following conditions, and control the headset to be in a target working mode: the number of people in the environment within a set range The frequency of the sound signal in the environment is lower than the threshold of the number of people; the frequency of the sound signal in the environment is within a preset frequency range; the loudness of the sound signal in the environment is greater than the loudness threshold.
在一实施例中，所述控制模块320，包括：In one embodiment, the control module 320 includes:
耳机控制单元，设置为所述环境中声音信号的语义包括预设关键词，则确定所述关联性为与用户相关，控制所述耳机处于目标工作模式。The earphone control unit is configured such that the semantics of the sound signal in the environment includes preset keywords, then it is determined that the relevance is related to the user, and the earphone is controlled to be in a target working mode.
在一实施例中，所述环境特征信息包括所述环境中设定范围内的人数；在上述实施例的基础上，所述信息获取模块310，包括：In one embodiment, the environment feature information includes the number of people within the set range in the environment; on the basis of the above embodiments, the information acquisition module 310 includes:
散射波接收单元，设置为通过终端的发射天线发射毫米波，并通过终端的接收天线接收至少一个探测目标对于所述毫米波的散射波；人物与距离确定单元，设置为根据所述散射波确定所述探测目标为人物，并通过所述毫米波发射时间与所述散射波接收时间的时间差，确定终端与人物之间的距离；人数确定单元，设置为根据终端与人物之间的距离，确定所述环境中设定范围内的人数。The scattered wave receiving unit is configured to transmit a millimeter wave through the transmitting antenna of the terminal, and receives the scattered wave of at least one detection target for the millimeter wave through the receiving antenna of the terminal; the person and distance determining unit is configured to determine according to the scattered wave The detection target is a person, and the distance between the terminal and the person is determined through the time difference between the millimeter wave emission time and the scattered wave reception time; the number of people determining unit is configured to determine the distance between the terminal and the person The number of people within a defined range in the described environment.
在一实施例中，所述人物与距离确定单元，包括：In one embodiment, the person and distance determination unit includes:
属性特征确定子单元，设置为根据所述散射波确定所述探测目标的属性特征，所述属性特征包括形状和/或面积；人物确定子单元，设置为所述属性特征符合人物特征，则确定所述探测目标为人物。The attribute feature determination subunit is configured to determine the attribute feature of the detection target according to the scattered wave, and the attribute feature includes shape and/or area; the character determination subunit is configured to determine that the attribute feature conforms to the character feature The detection target is a person.
在一实施例中，所述控制模块320，包括：In one embodiment, the control module 320 includes:
非降噪模式控制单元，设置为在所述关联性为与用户相关的情况下，控制所述耳机处于非降噪模式；第一降噪模式控制单元，设置为在所述关联性为与用户相关的情况下，控制所述耳机处于降噪模式，且降低所述耳机的播放音量；第二降噪模式控制单元，设置为在所述关联性为与用户相关的情况下，控制所 述耳机处于降噪模式，并显示关于工作模式的询问信息；第三降噪模式控制单元，设置为在所述关联性为与用户无关的情况下，控制所述耳机处于降噪模式。The non-noise reduction mode control unit is configured to control the earphone to be in the non-noise reduction mode when the association is related to the user; the first noise reduction mode control unit is configured to control the earphone to be in the non-noise reduction mode when the association is related to the user In related cases, control the earphone to be in the noise reduction mode, and reduce the playback volume of the earphone; the second noise reduction mode control unit is configured to control the earphone when the association is related to the user It is in the noise reduction mode and displays inquiry information about the working mode; the third noise reduction mode control unit is configured to control the earphone to be in the noise reduction mode when the association is irrelevant to the user.
本实施例提出的耳机工作模式控制装置与上述实施例提出的耳机工作模式控制方法属于同一构思，未在本实施例中详尽描述的技术细节可参见上述任意实施例，并且本实施例具备与执行耳机工作模式控制方法相同的效果。The earphone working mode control device proposed in this embodiment and the earphone working mode control method proposed in the above-mentioned embodiments belong to the same idea, and the technical details not described in detail in this embodiment can be referred to any of the above-mentioned embodiments, and this embodiment has and implements Headphone working mode control method has the same effect.
本申请实施例还提供了一种终端。图11为一实施例提供的一种终端的硬件结构示意图，如图11所示，本申请提供的终端，包括处理器410、存储装置420以及存储在存储装置420上并可在处理器上410运行的计算机程序，处理器410执行所述程序时实现上述的耳机工作模式控制方法。The embodiment of the present application also provides a terminal. Fig. 11 is a schematic diagram of the hardware structure of a terminal provided by an embodiment. As shown in Fig. 11, the terminal provided by this application includes a processor 410, a storage device 420, and a A running computer program, when the processor 410 executes the program, implements the above-mentioned method for controlling the working mode of the earphone.
终端还可以包括存储装置420；该终端中的处理器410可以是一个或多个，图11中以一个处理器410为例；存储装置420设置为存储一个或多个程序；所述一个或多个程序被所述一个或多个处理器410执行，使得所述一个或多个处理器410实现如本申请实施例中所述的耳机工作模式控制方法。The terminal may also include a storage device 420; there may be one or more processors 410 in the terminal, and one processor 410 is taken as an example in FIG. 11; the storage device 420 is configured to store one or more programs; the one or more The program is executed by the one or more processors 410, so that the one or more processors 410 implement the method for controlling the working mode of the earphone as described in the embodiment of the present application.
终端还包括：通信装置430、输入装置440和输出装置450。The terminal further includes: a communication device 430 , an input device 440 and an output device 450 .
终端中的处理器410、存储装置420、通信装置430、输入装置440和输出装置450可以通过总线或其他方式连接，图11中以通过总线连接为例。The processor 410, the storage device 420, the communication device 430, the input device 440, and the output device 450 in the terminal may be connected through a bus or in other ways. In FIG. 11, connection through a bus is taken as an example.
输入装置440可设置为接收输入的数字或字符信息，以及产生与终端的用户设置以及功能控制有关的按键信号输入。输出装置450可包括显示屏等显示设备。The input device 440 can be configured to receive input numbers or character information, and generate key signal input related to user settings and function control of the terminal. The output device 450 may include a display device such as a display screen.
通信装置430可以包括接收天线和发射天线。通信装置430设置为根据处理器410的控制接收散射波或发射毫米波，也可以与周围的其他终端或基站进行信息收发通信。 Communications device 430 may include a receive antenna and a transmit antenna. The communication device 430 is configured to receive scattered waves or emit millimeter waves according to the control of the processor 410 , and can also perform information sending and receiving communication with other terminals or base stations around.
存储装置420作为一种计算机可读存储介质，可设置为存储软件程序、计算机可执行程序以及模块，如本申请实施例所述耳机工作模式控制方法对应的程序指令/模块(例如，耳机工作模式控制装置中的信息获取模块310以及控制模块320)。存储装置420可包括存储程序区和存储数据区，其中，存储程序区可存储操作***、至少一个功能所需的应用程序；存储数据区可存储根据测试设备的使用所创建的数据等。此外，存储装置420可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中，存储装置420可包括相对于处理器410远程设置的存储器，这些远程存储器可以通过网络连接至终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The storage device 420, as a computer-readable storage medium, can be configured to store software programs, computer-executable programs, and modules, such as the program instructions/modules corresponding to the earphone working mode control method described in the embodiment of the present application (for example, the earphone working mode The information acquisition module 310 and the control module 320 in the control device). The storage device 420 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the test equipment, and the like. In addition, the storage device 420 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage devices. In some examples, the storage device 420 may include memories that are remotely located relative to the processor 410, and these remote memories may be connected to the terminal through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
本申请实施例还提供一种存储介质，所述存储介质存储有计算机程序，所述计算机程序被处理器执行时实现本申请实施例中任一所述的耳机工作模式控制方法。该方法包括：获取用户佩戴的耳机处于降噪模式下的环境特征信息；根据所述环境特征信息对应的环境与用户的关联性，控制所述耳机的工作模式。The embodiment of the present application further provides a storage medium, the storage medium stores a computer program, and when the computer program is executed by a processor, the method for controlling the working mode of the earphone described in any one of the embodiments of the present application is implemented. The method includes: acquiring environmental characteristic information that the earphone worn by the user is in a noise reduction mode; and controlling the working mode of the earphone according to the correlation between the environment and the user corresponding to the environmental characteristic information.
本申请实施例的计算机存储介质，可以采用一个或多个计算机可读的介质的任意组合。计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质。计算机可读存储介质例如可以是，但不限于：电、磁、光、电磁、红外线、或半导体的***、装置或器件，或者任意以上的组合。计算机可读存储介质的例子(非穷举的列表)包括：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机存取存储器(Random Access Memory，RAM)、只读存储器(Read Only Memory，ROM)、可擦式可编程只读存储器(Erasable Programmable Read Only Memory，EPROM)、闪存、光纤、便携式光盘只读存储器(Compact Disk Read Only Memory，CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行***、装置或者器件使用或者与其结合使用。The computer storage medium in the embodiments of the present application may use any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer-readable storage medium may be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. Examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more conductors, portable computer disks, hard disks, Random Access Memory (RAM), Read Only Memory (Read Only) Memory, ROM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, EPROM), flash memory, optical fiber, portable CD-ROM (Compact Disk Read Only Memory, CD-ROM), optical storage device, magnetic memory components, or any suitable combination of the above. A computer readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device.
计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于：电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读介质可以发送、传播或者传输用于由指令执行***、装置或者器件使用或者与其结合使用的程序。A computer readable signal medium may include a data signal carrying computer readable program code in baseband or as part of a carrier wave. Such propagated data signals may take many forms, including but not limited to: electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. .
计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：无线、电线、光缆、无线电频率(Radio Frequency，RF)等等，或者上述的任意合适的组合。Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wires, optical cables, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the above.
可以以一种或多种程序设计语言或其组合来编写用于执行本申请操作的计算机程序代码，所述程序设计语言包括面向对象的程序设计语言，诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言，诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络，包括局域网(Local Area Network，LAN)或广域网(Wide Area Network，WAN)，连接到用户计算机，或者， 可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。Computer program codes for performing the operations of the present application may be written in one or more programming languages or combinations thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional A procedural programming language, such as the "C" language or similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or it may be connected to an external computer such as use an Internet service provider to connect via the Internet).
以上所述，仅为本申请的示例性实施例而已。The above descriptions are merely exemplary embodiments of the present application.
术语用户终端涵盖任何适合类型的无线用户设备，例如移动电话、便携数据处理装置、便携网络浏览器或车载移动台。The term user terminal covers any suitable type of wireless user equipment, such as a mobile telephone, portable data processing device, portable web browser or vehicular mobile station.
一般来说，本申请的多种实施例可以在硬件或专用电路、软件、逻辑或其任何组合中实现。例如，一些方面可以被实现在硬件中，而其它方面可以被实现在可以被控制器、微处理器或其它计算装置执行的固件或软件中，尽管本申请不限于此。In general, the various embodiments of the present application can be implemented in hardware or special purpose circuits, software, logic or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software, which may be executed by a controller, microprocessor or other computing device, although the application is not limited thereto.
本申请的实施例可以通过移动装置的数据处理器执行计算机程序指令来实现，例如在处理器实体中，或者通过硬件，或者通过软件和硬件的组合。计算机程序指令可以是汇编指令、指令集架构(Instruction Set Architecture，ISA)指令、机器指令、机器相关指令、微代码、固件指令、状态设置数据、或者以一种或多种编程语言的任意组合编写的源代码或目标代码。The embodiments of the present application may be implemented by a data processor of a mobile device executing computer program instructions, for example in a processor entity, or by hardware, or by a combination of software and hardware. Computer program instructions may be assembly instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or written in any combination of one or more programming languages source or object code.
本申请附图中的任何逻辑流程的框图可以表示程序步骤，或者可以表示相互连接的逻辑电路、模块和功能，或者可以表示程序步骤与逻辑电路、模块和功能的组合。计算机程序可以存储在存储器上。存储器可以具有任何适合于本地技术环境的类型并且可以使用任何适合的数据存储技术实现，例如ROM、RAM、光存储器装置和***(数码多功能光碟(Digital Video Disc，DVD)或CD等。计算机可读介质可以包括非瞬时性存储介质。数据处理器可以是任何适合于本地技术环境的类型，例如但不限于通用计算机、专用计算机、微处理器、数字信号处理器(Digital Signal Processing，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、可编程逻辑器件(Field-Programmable Gate Array，FPGA)以及基于多核处理器架构的处理器。Any logic flow block diagrams in the drawings of the present application may represent program steps, or may represent interconnected logic circuits, modules and functions, or may represent a combination of program steps and logic circuits, modules and functions. Computer programs can be stored on memory. The memory may be of any type suitable for the local technical environment and may be implemented using any suitable data storage technology, such as ROM, RAM, optical memory devices and systems (Digital Video Disc (DVD) or CD, etc. Computers may Read medium can comprise non-transitory storage medium.Data processor can be any type that is suitable for local technical environment, such as but not limited to general purpose computer, special purpose computer, microprocessor, digital signal processor (Digital Signal Processing, DSP), Application Specific Integrated Circuit (ASIC), Programmable Logic Device (Field-Programmable Gate Array, FPGA) and processors based on multi-core processor architecture.

Claims (10)

  1. 一种耳机工作模式控制方法，应用于终端，包括：A method for controlling an earphone working mode, applied to a terminal, comprising:
    获取用户佩戴的耳机处于降噪模式下的环境特征信息；Obtain the environmental characteristic information of the headset worn by the user in the noise reduction mode;
    根据所述环境特征信息对应的环境与用户的关联性，控制所述耳机的工作模式。According to the correlation between the environment and the user corresponding to the environment characteristic information, the working mode of the earphone is controlled.
  2. 根据权利要求1所述的方法，其中，所述环境特征信息包括以下至少一项：The method according to claim 1, wherein the environmental feature information includes at least one of the following:
    所述环境中设定范围内的人数；the number of people within a defined range in the environment in question;
    所述环境中声音信号的频率；the frequency of the sound signal in the environment;
    所述环境中声音信号的响度；the loudness of the sound signal in the environment;
    所述环境中声音信号的语义。Semantics of sound signals in the environment.
  3. 根据权利要求2所述的方法，其中，所述根据所述环境特征信息对应的环境与用户的关联性，控制所述耳机的工作模式，包括：The method according to claim 2, wherein the controlling the working mode of the earphone according to the correlation between the environment corresponding to the environment feature information and the user comprises:
    在所述环境特征信息满足以下至少两种条件的情况下，确定所述关联性为与用户相关，控制所述耳机处于目标工作模式：When the environmental characteristic information satisfies at least two of the following conditions, it is determined that the association is related to the user, and the earphone is controlled to be in a target working mode:
    所述环境中设定范围内的人数低于人数阈值；The number of people within the set range in the environment is below the number threshold;
    所述环境中声音信号的频率在预设频率范围内；The frequency of the sound signal in the environment is within a preset frequency range;
    所述环境中声音信号的响度大于响度阈值。The loudness of the sound signal in the environment is greater than a loudness threshold.
  4. 根据权利要求2所述的方法，其中，所述根据所述环境特征信息对应的环境与用户的关联性，控制所述耳机的工作模式，包括：The method according to claim 2, wherein the controlling the working mode of the earphone according to the correlation between the environment corresponding to the environment feature information and the user comprises:
    在所述环境中声音信号的语义包括预设关键词的情况下，确定所述关联性为与用户相关，控制所述耳机处于目标工作模式。If the semantics of the sound signal in the environment includes preset keywords, the relevance is determined to be related to the user, and the earphone is controlled to be in a target working mode.
  5. 根据权利要求2所述的方法，其中，在所述环境特征信息包括所述环境中设定范围内的人数的情况下；The method according to claim 2, wherein, when the environment feature information includes the number of people within a set range in the environment;
    所述获取用户佩戴的耳机处于降噪模式下的环境特征信息，包括：The acquisition of the environmental characteristic information of the earphone worn by the user in the noise reduction mode includes:
    通过所述终端的发射天线发射毫米波，并通过所述终端的接收天线接收至少一个探测目标对于所述毫米波的散射波；transmitting millimeter waves through the transmitting antenna of the terminal, and receiving scattered waves of at least one detection target for the millimeter waves through the receiving antenna of the terminal;
    在根据所述散射波确定所述探测目标为人物的情况下，通过所述毫米波的发射时间与所述散射波的接收时间的时间差，确定所述终端与所述人物之间的距离；In the case where the detection target is determined to be a person according to the scattered wave, the distance between the terminal and the person is determined based on a time difference between the emission time of the millimeter wave and the reception time of the scattered wave;
    根据所述终端与所述人物之间的距离，确定所述环境中设定范围内的人数。The number of people within a set range in the environment is determined according to the distance between the terminal and the person.
  6. 根据权利要求5所述的方法，其中，所述根据所述散射波确定所述探测目标为人物，包括：The method according to claim 5, wherein said determining that said detection target is a person according to said scattered waves comprises:
    根据所述散射波确定所述探测目标的属性特征，所述属性特征包括形状和面积中的至少之一；determining an attribute feature of the detection target according to the scattered wave, the attribute feature including at least one of shape and area;
    在所述属性特征符合人物特征的情况下，确定所述探测目标为人物。If the attribute feature matches the character of the person, it is determined that the detection target is a person.
  7. 根据权利要求3-6中任一项所述的方法，其中，所述根据所述环境特征信息对应的环境与用户的关联性，控制所述耳机的工作模式，包括：The method according to any one of claims 3-6, wherein the controlling the working mode of the earphone according to the correlation between the environment corresponding to the environment feature information and the user comprises:
    在所述关联性为与用户相关的情况下，执行以下之一：控制所述耳机处于非降噪模式；控制所述耳机处于降噪模式，且降低所述耳机的播放音量；控制所述耳机处于降噪模式，并显示关于工作模式的询问信息；When the association is related to the user, perform one of the following: control the earphone to be in a non-noise reduction mode; control the earphone to be in a noise reduction mode, and reduce the playback volume of the earphone; control the earphone In the noise reduction mode, and display the query information about the working mode;
    在所述关联性为与用户无关的情况下，控制所述耳机处于降噪模式。In the case that the association is irrelevant to the user, the earphone is controlled to be in the noise reduction mode.
  8. 一种耳机工作模式控制装置，包括：A headphone working mode control device, comprising:
    信息获取模块，设置为获取用户佩戴的耳机处于降噪模式下的环境特征信息；The information acquisition module is configured to acquire the environmental characteristic information of the earphone worn by the user in the noise reduction mode;
    控制模块，设置为根据所述环境特征信息对应的环境与用户的关联性，控制所述耳机的工作模式。The control module is configured to control the working mode of the earphone according to the correlation between the environment and the user corresponding to the environment characteristic information.
  9. 一种终端，包括：A terminal comprising:
    至少一个处理器；at least one processor;
    存储装置，设置为存储至少一个程序；a storage device configured to store at least one program;
    当所述至少一个程序被所述至少一个处理器执行，使得所述至少一个处理器实现如权利要求1-7中任一项所述的耳机工作模式控制方法。When the at least one program is executed by the at least one processor, the at least one processor implements the earphone working mode control method according to any one of claims 1-7.
  10. 一种计算机可读存储介质，存储有计算机程序，其中，所述程序被处理器执行时实现如权利要求1-7中任一项所述的耳机工作模式控制方法。A computer-readable storage medium storing a computer program, wherein, when the program is executed by a processor, the method for controlling the working mode of the earphone according to any one of claims 1-7 is realized.
PCT/CN2022/108912 2021-09-15 2022-07-29 Headphone working mode control method and apparatus, terminal, and medium WO2023040483A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111082536.9 2021-09-15
CN202111082536.9A CN115811681A (en) 2021-09-15 2021-09-15 Earphone working mode control method, device, terminal and medium

Publications (1)

Publication Number Publication Date
WO2023040483A1 true WO2023040483A1 (en) 2023-03-23

Family

ID=85482040

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/108912 WO2023040483A1 (en) 2021-09-15 2022-07-29 Headphone working mode control method and apparatus, terminal, and medium

Country Status (2)

Country Link
CN (1) CN115811681A (en)
WO (1) WO2023040483A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116405963A (en) * 2023-06-09 2023-07-07 深圳市微克科技有限公司 Bluetooth intelligent switch implementation method, system and medium based on dual-mode scheme

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013238870A (en) * 2013-07-01 2013-11-28 Sony Corp Noise cancelling system
CN105554610A (en) * 2014-12-29 2016-05-04 北京小鸟听听科技有限公司 Method for regulating environmental sound of earphone and earphone
US20170193978A1 (en) * 2015-12-30 2017-07-06 Gn Audio A/S Headset with hear-through mode
CN108156550A (en) * 2017-12-27 2018-06-12 上海传英信息技术有限公司 The playing method and device of headphone
CN111683317A (en) * 2020-05-28 2020-09-18 江苏紫米电子技术有限公司 Prompting method and device applied to earphone, terminal and storage medium
CN112004174A (en) * 2020-08-27 2020-11-27 努比亚技术有限公司 Noise reduction control method and device and computer readable storage medium
CN112770214A (en) * 2021-01-28 2021-05-07 歌尔科技有限公司 Earphone control method and device and earphone
CN113596670A (en) * 2021-08-30 2021-11-02 歌尔科技有限公司 Earphone, earphone noise reduction mode switching method and device, and storage medium
CN114080589A (en) * 2019-06-12 2022-02-22 伯斯有限公司 Automatic Active Noise Reduction (ANR) control to improve user interaction

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013238870A (en) * 2013-07-01 2013-11-28 Sony Corp Noise cancelling system
CN105554610A (en) * 2014-12-29 2016-05-04 北京小鸟听听科技有限公司 Method for regulating environmental sound of earphone and earphone
US20170193978A1 (en) * 2015-12-30 2017-07-06 Gn Audio A/S Headset with hear-through mode
CN108156550A (en) * 2017-12-27 2018-06-12 上海传英信息技术有限公司 The playing method and device of headphone
CN114080589A (en) * 2019-06-12 2022-02-22 伯斯有限公司 Automatic Active Noise Reduction (ANR) control to improve user interaction
CN111683317A (en) * 2020-05-28 2020-09-18 江苏紫米电子技术有限公司 Prompting method and device applied to earphone, terminal and storage medium
CN112004174A (en) * 2020-08-27 2020-11-27 努比亚技术有限公司 Noise reduction control method and device and computer readable storage medium
CN112770214A (en) * 2021-01-28 2021-05-07 歌尔科技有限公司 Earphone control method and device and earphone
CN113596670A (en) * 2021-08-30 2021-11-02 歌尔科技有限公司 Earphone, earphone noise reduction mode switching method and device, and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116405963A (en) * 2023-06-09 2023-07-07 深圳市微克科技有限公司 Bluetooth intelligent switch implementation method, system and medium based on dual-mode scheme
CN116405963B (en) * 2023-06-09 2023-08-22 深圳市微克科技有限公司 Bluetooth intelligent switch implementation method, system and medium based on dual-mode scheme

Also Published As

Publication number Publication date
CN115811681A (en) 2023-03-17

Similar Documents

Publication Publication Date Title
CN111091828B (en) Voice wake-up method, device and system
CN102770909B (en) Voice activity detection based on multiple speech activity detectors
JP6489563B2 (en) Volume control method, system, device and program
EP3127116B1 (en) Attention-based dynamic audio level adjustment
US10349176B1 (en) Method for processing signals, terminal device, and non-transitory computer-readable storage medium
CN106528545B (en) Voice information processing method and device
EP4109863A1 (en) Method and apparatus for masking sound, and terminal device
CN108962240A (en) A kind of sound control method and system based on earphone
JP2018508868A (en) Context-based access validation
CN108777827B (en) Wireless earphone, volume adjusting method and related product
US9706321B2 (en) Electronic device including modifiable output parameter
CN109243488B (en) Audio detection method, device and storage medium
CN109379490B (en) Audio playing method and device, electronic equipment and computer readable medium
WO2020019857A1 (en) Microphone hole blocking detection method and related product
JP2021509963A (en) Multi-beam selection method and equipment
CN116324969A (en) Hearing enhancement and wearable system with positioning feedback
WO2023040483A1 (en) Headphone working mode control method and apparatus, terminal, and medium
US11227617B2 (en) Noise-dependent audio signal selection system
CN109194998A (en) Data transmission method, device, electronic equipment and computer-readable medium
CN108769364A (en) Call control method, device, mobile terminal and computer-readable medium
CN110719545A (en) Audio playing device and method for playing audio
WO2021021111A1 (en) Wireless audio testing
US20210152965A1 (en) Method for detecting blocking of microphone and related products
CN112911062B (en) Voice processing method, control device, terminal device and storage medium
CN105764116A (en) Method of connection between terminals and terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22868860

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE