WO2019061323A1

WO2019061323A1 - Noise canceling method and terminal

Info

Publication number: WO2019061323A1
Application number: PCT/CN2017/104471
Authority: WO
Inventors: 曹军; 张玉磊; 王成永; 桂明建
Original assignee: 深圳传音通讯有限公司
Priority date: 2017-09-29
Filing date: 2017-09-29
Publication date: 2019-04-04
Also published as: CN111356908B; CN111356908A

Abstract

Disclosed in embodiments of the present invention are a noise canceling method and a terminal. The method comprises: a terminal detects target distances, the target distances comprising a distance from the mouth of a user to a primary microphone of the terminal and a distance from the mouth of the user to a secondary microphone of the terminal; the terminal matches reference values corresponding to the target distances, multiple distances and a reference value corresponding to each distance being pre-stored in the terminal, each reference value being a preset value used for indicating a difference between sound signals, and the multiple distances comprising the target distances; and the terminal filters out environmental noise according to actual values and the reference values, each actual value being a difference between a sound signal of the primary microphone and a sound signal of the secondary microphone. By means of the embodiments of the present invention, noise canceling performance can be improved.

Description

一种降噪方法及终端Noise reduction method and terminal

技术领域Technical field

本发明涉及计算机技术领域，具体涉及了一种降噪方法及终端。The present invention relates to the field of computer technologies, and in particular, to a noise reduction method and a terminal.

背景技术Background technique

在人们日常的交流中，语音交流是一种不可或缺的交流方式，例如电话沟通，发送语音消息等。在用户利用终端进行语音交流的过程中，麦克风负责收录用户的语音信息，由于麦克风收录用户的语音信息的同时也会收录到用户所处环境的噪声，所以用户所处环境的噪声一直是影响语音交流质量的一个不可忽视的因素。为了解决这一问题，本领域技术人员提出了双麦克风降噪方法，双麦克风降噪的原理是：终端设置两个麦克风，一个麦克风为靠近用户嘴部的主麦克风，收集的人声信号的强度较大，另一个麦克风为远离用户嘴部的副麦克风，收集的人声信号的强度较小；终端收集的两个人声信号的强度大致相差6dB，而收集到的周围环境噪声的强度几乎是相同的，因此，将主麦克风收集的声音信号的强度减去副麦克风收集到的声音信号的强度，就可以抵消主麦克风收集到的环境噪声和副麦克风收集到的环境噪声，从而实现降噪；另外，若相减所产生的信号强度差值为6dB，那么，该6dB的信号强度差值就属于人声。In people's daily communication, voice communication is an indispensable means of communication, such as telephone communication, sending voice messages, and so on. In the process of the user using the terminal for voice communication, the microphone is responsible for recording the user's voice information. Since the microphone records the user's voice information and also records the noise of the user's environment, the noise of the user's environment always affects the voice. A non-negligible factor in the quality of communication. In order to solve this problem, a person skilled in the art proposes a dual microphone noise reduction method. The principle of dual microphone noise reduction is: the terminal sets two microphones, one microphone is the main microphone close to the user's mouth, and the intensity of the collected vocal signals. Larger, the other microphone is a sub-microphone away from the user's mouth, the intensity of the collected vocal signals is small; the intensity of the two vocal signals collected by the terminal is roughly 6dB, and the intensity of the collected ambient noise is almost the same. Therefore, by subtracting the intensity of the sound signal collected by the primary microphone from the intensity of the sound signal collected by the secondary microphone, the ambient noise collected by the primary microphone and the ambient noise collected by the secondary microphone can be cancelled, thereby achieving noise reduction; If the difference in signal strength produced by the subtraction is 6 dB, then the difference in signal strength of 6 dB belongs to the human voice.

在实际应用双麦克风降噪方法的过程中，两个麦克风接收到人声信号的强度差很有可能不是6dB，这时，如果按照以上原理进行降噪的可能导致降噪性能会大幅降低。In the actual application of the dual microphone noise reduction method, the intensity difference between the two microphones receiving the vocal signal is likely to be not 6 dB. At this time, if the noise reduction according to the above principle may result in a significant reduction in noise reduction performance.

发明内容Summary of the invention

本发明实施例提供一种降噪方法及终端，能够提升降噪的性能。The embodiment of the invention provides a noise reduction method and a terminal, which can improve the performance of noise reduction.

第一方面，本发明实施例提供了一种降噪方法，该方法包括：In a first aspect, an embodiment of the present invention provides a noise reduction method, where the method includes:

终端检测目标距离，该目标距离包括用户嘴部到该终端的主麦克风的距离以及包括该用户嘴部到该终端的副麦克风的距离；The terminal detects a target distance including a distance from the mouth of the user to the main microphone of the terminal and a distance including the sub-microphone of the user's mouth to the terminal;

该终端匹配该目标距离对应的参考值，该终端预存有多个距离且该多个距离中每个距离各自对应有参考值，该参考值为预设的用于表征声音信号之间的差值，该多个距离包括该目标距离；The terminal matches a reference value corresponding to the target distance, and the terminal prestores multiple distances and the multiple distances Each of the distances has a reference value corresponding to each of the distances, and the reference value is preset for characterizing a difference between the sound signals, the plurality of distances including the target distance;

该终端根据实际值和该参考值滤除环境噪声，该实际值为该主麦克风的声音信号与该副麦克风的声音信号之间的差值。The terminal filters out ambient noise according to the actual value and the reference value, the actual value being the difference between the sound signal of the primary microphone and the sound signal of the secondary microphone.

第二方面，本发明实施例提供了一种终端，该终端包括用于执行上述第一方面的方法的单元。In a second aspect, an embodiment of the present invention provides a terminal, where the terminal includes a unit for performing the method of the foregoing first aspect.

第三方面，本发明实施例提供了又一种终端，该终端包括处理器和存储器，该处理器和存储器相互连接，其中，该存储器用于存储程序指令，该处理器用于调用该存储器中的程序指令来执行上述第一方面的方法。In a third aspect, an embodiment of the present invention provides a terminal, where the terminal includes a processor and a memory, where the processor and the memory are connected to each other, wherein the memory is configured to store program instructions, and the processor is configured to invoke the Program instructions to perform the method of the first aspect above.

第四方面，本发明实施例提供了一种计算机可读存储介质，该计算机存储介质存储有程序指令，该程序指令当被处理器运行时，该处理器执行上述第一方面的方法。In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium storing program instructions, the program instructions, when executed by a processor, executing the method of the first aspect.

在本发明实施例中，终端预存有多个距离且所述多个距离中每个距离各自对应有参考值，即过滤人声所使用的参考值会随着用户嘴部到终端的麦克风(包括主麦克风和副麦克风)的距离的变化而变化，相较于现有技术在任何情况下都是用相同的参考值而言，降噪性能更好，过滤出的人声更加真实。In the embodiment of the present invention, the terminal prestores a plurality of distances, and each of the plurality of distances respectively has a reference value, that is, the reference value used for filtering the human voice is followed by the microphone of the user's mouth to the terminal (including The distance between the main microphone and the sub-microphone varies, and the noise reduction performance is better and the filtered human voice is more realistic than the prior art in any case with the same reference value.

附图说明DRAWINGS

为了更清楚地说明本发明实施例技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are some embodiments of the present invention. For the ordinary technicians, other drawings can be obtained based on these drawings without any creative work.

图1是本发明实施例提供的一种降噪方法的流程示意图；1 is a schematic flow chart of a noise reduction method according to an embodiment of the present invention;

图2是本发明实施例提供的一种目标距离测量方法的场景示意图；2 is a schematic diagram of a scenario of a target distance measurement method according to an embodiment of the present invention;

图3是本发明实施例提供的又一种目标距离测量方法的场景示意图；3 is a schematic diagram of a scenario of a target distance measurement method according to an embodiment of the present invention;

图4是本发明实施例提供的一种终端的结构示意图；4 is a schematic structural diagram of a terminal according to an embodiment of the present invention;

图5是本发明实施例提供的又一种终端的结构示意图；FIG. 5 is a schematic structural diagram of still another terminal according to an embodiment of the present disclosure;

图6是本发明实施例提供的又一种终端的结构示意图。 FIG. 6 is a schematic structural diagram of still another terminal according to an embodiment of the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

应当理解，当在本说明书和所附权利要求书中使用时，术语“包括”和“包含”指示所描述特征、整体、步骤、操作、元素和/或组件的存在，但并不排除一个或多个其它特征、整体、步骤、操作、元素、组件和/或其集合的存在或添加。The use of the terms "comprising", "comprising", "","," The presence or addition of a plurality of other features, integers, steps, operations, elements, components, and/or collections thereof.

还应当理解，在此本发明说明书中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本发明。如在本发明说明书和所附权利要求书中所使用的那样，除非上下文清楚地指明其它情况，否则单数形式的“一”“一个”及“该”意在包括复数形式。It is also to be understood that the terminology of the present invention is to be construed as a The singular forms "a", "the" and "the"

还应当进一步理解，在本发明说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合，并且包括这些组合。It is further understood that the term "and/or" used in the description of the invention and the appended claims means any combination and all possible combinations of one or more of the associated listed items, .

如在本说明书和所附权利要求书中所使用的那样，术语“如果”可以依据上下文被解释为“当......时”或“一旦”或“响应于确定”或“响应于检测到”。类似地，短语“如果确定”或“如果检测到[所描述条件或事件]”可以依据上下文被解释为意指“一旦确定”或“响应于确定”或“一旦检测到[所描述条件或事件]”或“响应于检测到[所描述条件或事件]”。As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "once" or "in response to determining" or "in response to" detected". Similarly, the phrase "if determined" or "if detected [condition or event described]" may be interpreted in context to mean "once determined" or "in response to determining" or "once detected [condition or event described] ] or "in response to detecting [conditions or events described]".

具体实现中，本发明实施例中描述的终端包括但不限于诸如具有触摸敏感表面(例如，触摸屏显示器和/或触摸板)的移动电话、膝上型计算机或平板计算机之类的其它便携式设备。还应当理解的是，在某些实施例中，该设备并非便携式通信设备，而是具有触摸敏感表面(例如，触摸屏显示器和/或触摸板)的台式计算机。In particular implementations, the terminals described in this embodiment of the invention include, but are not limited to, other portable devices such as mobile phones, laptop computers or tablet computers having touch sensitive surfaces (eg, touch screen displays and/or touch pads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer having a touch sensitive surface (eg, a touch screen display and/or a touch pad).

在接下来的讨论中，描述了包括显示器和触摸敏感表面的终端。然而，应当理解的是，终端可以包括诸如物理键盘、鼠标和/或控制杆的一个或多个其它物理用户接口设备。In the following discussion, a terminal including a display and a touch sensitive surface is described. However, should It is understood that the terminal can include one or more other physical user interface devices such as a physical keyboard, mouse, and/or joystick.

终端支持各种应用程序，例如以下中的一个或多个：绘图应用程序、演示应用程序、文字处理应用程序、网站创建应用程序、盘刻录应用程序、电子表格应用程序、游戏应用程序、电话应用程序、视频会议应用程序、电子邮件应用程序、即时消息收发应用程序、锻炼支持应用程序、照片管理应用程序、数码相机应用程序、数字摄影机应用程序、web浏览应用程序、数字音乐播放器应用程序和/或数字视频播放器应用程序。The terminal supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk burning applications, spreadsheet applications, gaming applications, phone applications Programs, video conferencing applications, email applications, instant messaging applications, workout support applications, photo management applications, digital camera applications, digital camera applications, web browsing applications, digital music player applications, and / or digital video player app.

可以在终端上执行的各种应用程序可以使用诸如触摸敏感表面的至少一个公共物理用户接口设备。可以在应用程序之间和/或相应应用程序内调整和/或改变触摸敏感表面的一个或多个功能以及终端上显示的相应信息。这样，终端的公共物理架构(例如，触摸敏感表面)可以支持具有对用户而言直观且透明的用户界面的各种应用程序。Various applications that can be executed on the terminal can use at least one common physical user interface device such as a touch sensitive surface. One or more functions of the touch sensitive surface and corresponding information displayed on the terminal can be adjusted and/or changed within the application and/or within the respective application. In this way, the common physical architecture of the terminal (eg, a touch-sensitive surface) can support a variety of applications with a user interface that is intuitive and transparent to the user.

本发明实施例中，终端可以包括移动手机、平板电脑、个人数字助理(Personal Digital Assistant，PDA)、移动互联网设备(Mobile Internet Device，MID)、智能穿戴设备(如智能手表、智能手环)等各种设备，本发明实施例不作限定。In the embodiment of the present invention, the terminal may include a mobile phone, a tablet computer, a personal digital assistant (PDA), a mobile internet device (MID), a smart wearable device (such as a smart watch, a smart bracelet), and the like. Various devices are not limited in the embodiment of the present invention.

参见图1，是本发明实施例提供的一种降噪方法的示意流程图，该方法可包括：FIG. 1 is a schematic flowchart of a noise reduction method according to an embodiment of the present invention. The method may include:

101、终端检测目标距离。101. The terminal detects the target distance.

其中，终端包括主麦克风和副麦克风，通常情况下主麦克风收集(或者“检测”)到的人声和周围环境声都比较明显，副麦克风收集的周围环境声比较明显但是收集的人声不明显，因此可以根据主麦克风收集的声音信号和副麦克风收集到的声音信号过滤出人声，例如，当该终端为手机时，可以在免提通话时过滤人声。本发明实施例中的目标距离包括用户嘴部到该终端的主麦克风的距离以及包括该用户嘴部到该终端的副麦克风的距离。The terminal includes a main microphone and a sub-microphone. Generally, the vocal and ambient sounds collected (or “detected” by the main microphone are relatively obvious, and the ambient sound collected by the sub-microphone is relatively obvious but the collected human voice is not obvious. Therefore, the voice can be filtered according to the sound signal collected by the main microphone and the sound signal collected by the sub-microphone. For example, when the terminal is a mobile phone, the human voice can be filtered during the hands-free call. The target distance in the embodiment of the present invention includes the distance from the mouth of the user to the main microphone of the terminal and the distance from the mouth of the user to the sub-microphone of the terminal.

可选的，该终端通过摄像头获取用户嘴部图像，具体为：该终端匹配获取的该用户嘴部图像对应的距离，该终端预存有多个嘴部图像且该多个嘴部图像中每个嘴部图像各自对应有自身的距离，为了便于后续描述以及与其他距离进行区分，可以称获取的该用户嘴部图像对应的距离为目标距离。可选的，该终端的摄像头将实时获取用户的嘴部图像，若用户的嘴部图像发生了尺寸变化和/或位移变化，则该终端重新匹配变化后的用户嘴部图像对应的距离，并将该终端重新匹配的变化后的用户嘴部图像对应的距离作为目标距离。通过实时获取用户嘴部图像，能够避免由于用户移动而造成的目标距离获取不准确的问题，提升降噪的性能。Optionally, the terminal obtains an image of the user's mouth through the camera, specifically: the terminal is matched and obtained. The distance corresponding to the mouth image of the user, the terminal pre-stores a plurality of mouth images, and each of the plurality of mouth images respectively has its own distance, in order to facilitate subsequent description and distinguishing from other distances, The distance corresponding to the acquired mouth image of the user may be referred to as the target distance. Optionally, the camera of the terminal acquires the mouth image of the user in real time, and if the size change and/or displacement of the user's mouth image changes, the terminal re-matches the distance corresponding to the changed mouth image of the user, and The distance corresponding to the changed user mouth image that the terminal re-matches is used as the target distance. By acquiring the image of the user's mouth in real time, the problem of inaccurate acquisition of the target distance due to the user's movement can be avoided, and the performance of noise reduction can be improved.

终端可以通过多种方案检测该目标距离，以下例举四种可选方案。The terminal can detect the target distance through various schemes. The following four options are exemplified.

第一种方案，该终端通过红外线传感器检测该用户嘴部到该终端的距离，检测出的该用户嘴部到该终端的距离可以称为目标距离。参见图2，是本发明实施例提供的一种目标距离测量方法的场景示意图。该终端的红外线传感器发射出红外线，该红外线在传播过程中受到用户嘴部的遮挡从而发生反射，该红外线传感器接收到反射的红外线；该终端根据发射出红外线与接收到红外线的时间差以及红外线的传播速度计算出该目标距离。可选的，该终端每隔预设时间间隔(例如1秒，2秒，3秒，等等)重新发射红外线；在该终端重新接收红外线之后，再次计算重新发射和重新接收红外线的时间差；若再次计算的时间差与上一次的时间差发生了变化，则该终端根据再次计算的时间差以及红外线的传播速度计算距离，该根据再次计算的时间差以及红外线的传播速度计算出的距离为目标距离。可以看出，通过每隔预设时间重新发射红外线，能够避免由于用户移动而造成的目标距离获取不准确的问题，提升降噪的性能。In the first solution, the terminal detects the distance from the mouth of the user to the terminal through an infrared sensor, and the detected distance from the mouth of the user to the terminal may be referred to as a target distance. FIG. 2 is a schematic diagram of a scenario of a target distance measurement method according to an embodiment of the present invention. The infrared sensor of the terminal emits infrared rays, which are reflected by the user's mouth during the propagation to reflect, and the infrared sensor receives the reflected infrared rays; the terminal is based on the time difference between the emitted infrared rays and the received infrared rays and the propagation of infrared rays The speed calculates the target distance. Optionally, the terminal re-transmits infrared rays every preset time interval (for example, 1 second, 2 seconds, 3 seconds, etc.); after the terminal receives infrared rays again, calculates a time difference between re-transmitting and re-receiving infrared rays; The time difference between the recalculated time and the previous time difference is changed, and the terminal calculates the distance based on the recalculated time difference and the propagation speed of the infrared ray, and the distance calculated from the recalculated time difference and the infrared ray propagation speed is the target distance. It can be seen that by re-emitting the infrared rays every preset time, the problem of inaccurate acquisition of the target distance due to the user's movement can be avoided, and the performance of noise reduction is improved.

第二种方案，该终端有多个副麦克风，该终端检测该用户嘴部到该多个副麦克风中每个副麦克风的距离以及该用户嘴部到该终端的主麦克风的距离；该目标距离包括该用户嘴部到该终端的主麦克风的距离以及该用户嘴部到目标副麦克风的距离，该目标副麦克风为该多个副麦克风中到该用户嘴部的距离与该终端的主麦克风到该用户嘴部的距离之差最大的副麦克风。参见图3，是本发明实施例提供的又一种目标距离测量方法的场景示意图。图3中包括主麦克风和多个副麦克风，图3以该多个副麦克风包括副麦克风1和副麦克风2为例进行示意。可以看出，通过对该目标副麦克风的确定，避免了在该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离相当的情况下，进行降噪处理造成的人声信号削弱的问题，从而提升降噪的性能。In a second aspect, the terminal has a plurality of sub-microphones, and the terminal detects a distance from the mouth of the user to each of the plurality of sub-microphones and a distance from the mouth of the user to the main microphone of the terminal; the target distance The distance from the mouth of the user to the main microphone of the terminal and the distance from the mouth of the user to the target sub-microphone, the target sub-microphone is the distance from the plurality of sub-microphones to the mouth of the user and the main microphone of the terminal The sub-microphone with the largest difference in the distance between the mouths of the user. FIG. 3 is a schematic diagram of a scenario of a target distance measurement method according to an embodiment of the present invention. Figure 3 includes the main mic The wind and the plurality of sub-microphones are illustrated in FIG. 3 by taking the plurality of sub-microphones including the sub-microphone 1 and the sub-microphone 2 as an example. It can be seen that by determining the target sub-microphone, noise reduction processing is avoided in a case where the distance of the user's mouth from the main microphone of the terminal is equal to the distance of the user's mouth from the sub-microphone of the terminal. The problem caused by the weakening of the vocal signal improves the performance of noise reduction.

第三种方案，该终端的副麦克风可以移动，若该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离之差不大于第二预设值，则该终端调整该副麦克风的位置以使得该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离之差大于第二预设值。其中，该第二预设值可以为0.5厘米，1厘米，1.5厘米等距离值中的任一个。可以看出，通过对该副麦克风的位置调整，避免了在该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离相当的情况下，进行降噪处理造成的人声信号削弱的问题，从而提升降噪的性能。In a third solution, the sub-microphone of the terminal can be moved. If the distance between the mouth of the user and the main microphone of the terminal is less than the second preset value of the distance between the user's mouth and the sub-microphone of the terminal, The terminal adjusts the position of the sub-microphone such that the difference between the distance of the user's mouth from the main microphone of the terminal and the distance of the user's mouth from the sub-microphone of the terminal is greater than a second preset value. Wherein, the second preset value may be any one of 0.5 cm, 1 cm, and 1.5 cm equidistance values. It can be seen that by adjusting the position of the sub-microphone, the noise reduction processing is avoided when the distance between the user's mouth and the main microphone of the terminal is equal to the distance of the user's mouth from the sub-microphone of the terminal. The problem caused by the weakening of the vocal signal improves the performance of noise reduction.

第四种方案，该终端通过摄像头获取用户嘴部的状态；若该用户嘴部的状态为运动状态，且通过该主麦克风和该副麦克风获取的声音信号弱于第三预设值，则该终端输出提示信息以提示重新输入声音，该第三预设阈值为预先设置的用于参考对比值；该实际值为该主麦克风获取的重新输入的声音信号与该副麦克风获取的重新输入的声音信号之间的差值。当通过该主麦克风和该副麦克风获取的声音信号弱于第三预设值时，说明用户输入的声音信号的音量值过小，若进行降噪处理容易消除人声信号。可以看出，通过上述输出提示信息的方式，可以提示用户在输入的声音信号的音量值过小的情况下重新输入声音信号，能够避免由于用户输入的声音信号的音量值过小而造成的消除噪声信号不准确的问题，从而提升降噪的性能。In a fourth solution, the terminal acquires a state of the user's mouth through the camera; if the state of the user's mouth is in a motion state, and the sound signal obtained by the primary microphone and the secondary microphone is weaker than the third preset value, the The terminal outputs the prompt information to prompt to re-enter the sound, and the third preset threshold is preset for the reference comparison value; the actual value is the re-input sound signal acquired by the primary microphone and the re-input sound acquired by the secondary microphone The difference between the signals. When the sound signal obtained by the main microphone and the sub-microphone is weaker than the third preset value, it indicates that the volume value of the sound signal input by the user is too small, and if the noise reduction process is performed, the human voice signal is easily eliminated. It can be seen that, by the manner of outputting the prompt information, the user can be prompted to re-enter the sound signal when the volume value of the input sound signal is too small, thereby avoiding the elimination caused by the volume value of the sound signal input by the user being too small. The problem of inaccurate noise signals improves the performance of noise reduction.

102、该终端匹配该目标距离对应的参考值。102. The terminal matches a reference value corresponding to the target distance.

具体地，终端预存有多个距离且该多个距离中每个距离各自对应有参考值，该参考值为预设的用于表征声音信号之间的差值，该多个距离包括该目标距离，例如，在实际应用中发现当主麦克风的声音信号与副麦克风的声音信号的差值为6db时能够很好的分离除人声，那么该参考值可以设置为6db；再如，在实际应用中发现当主麦克风的声音信号与副麦克风的声音信号的差值为7db时能够很好的分离除人声，那么该参考值可以设置为7db。总而言之，该参考值属于预先设置的用于参考对比的值。Specifically, the terminal prestores a plurality of distances, and each of the plurality of distances respectively has a reference value, where the reference value is preset for characterizing a difference between the sound signals, the multiple distances including the target distance For example, in practical applications, it is found that when the difference between the sound signal of the main microphone and the sound signal of the sub-microphone is 6 db, the reference value can be set to 6 db; In the application, it is found that when the difference between the sound signal of the main microphone and the sound signal of the sub-microphone is 7 db, the vocal can be well separated, and the reference value can be set to 7 db. In summary, the reference value belongs to a pre-set value for reference comparison.

103、该终端根据实际值和该参考值滤除环境噪声。103. The terminal filters out ambient noise according to the actual value and the reference value.

其中，该实际值为检测到的该主麦克风的声音信号与检测到的该副麦克风的声音信号之间的差值。可选的，若该实际值与该参考值的差值的绝对值小于第一预设值(例如，0db，0.5dB，1dB，1.5dB，等等)，则该终端将该实际值作为有用信号。该第一预设阈值为预先设置的用于参考对比的值可以看出，通过上述方式，终端能够根据该实际值和该参考值滤除环境噪声，避免了根据固定的主麦克风与副麦克风获取的人声信号强度差滤除环境噪声，所引起的滤除环境噪声不准确的问题，提升降噪的性能。The actual value is the difference between the detected sound signal of the primary microphone and the detected sound signal of the secondary microphone. Optionally, if the absolute value of the difference between the actual value and the reference value is less than a first preset value (eg, 0 db, 0.5 dB, 1 dB, 1.5 dB, etc.), the terminal uses the actual value as a useful signal. The first preset threshold is a preset value for reference comparison. It can be seen that, in the above manner, the terminal can filter out the ambient noise according to the actual value and the reference value, thereby avoiding obtaining according to the fixed primary microphone and the secondary microphone. The difference in vocal signal strength filters out environmental noise, causing inaccurate filtering of environmental noise and improving noise reduction performance.

可选的，若该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离之差大于第二预设值，则该终端根据实际值和该参考值滤除环境噪声，该第二预设阈值为预先设置的用于参考对比的值；若该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离之差不大于第二预设值，则该终端将主麦克风获取的声音作为有用信号。需要说明的是，在该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离相当的情况下，主麦克风和副麦克风获取的声音信号是相似的，若进行降噪处理会造成人声信号削弱甚至消除的问题，通过上述方式，能够有效地避免该问题。Optionally, if the difference between the distance of the user's mouth from the main microphone of the terminal and the distance of the user's mouth from the secondary microphone of the terminal is greater than a second preset value, the terminal filters according to the actual value and the reference value. In addition to the environmental noise, the second preset threshold is a preset value for reference comparison; if the distance between the user's mouth and the main microphone of the terminal is different from the distance of the user's mouth from the sub-microphone of the terminal, When the value is greater than the second preset value, the terminal uses the sound acquired by the main microphone as a useful signal. It should be noted that, when the distance between the user's mouth and the main microphone of the terminal is equal to the distance of the user's mouth from the sub-microphone of the terminal, the sound signals acquired by the primary microphone and the secondary microphone are similar. Performing the noise reduction process can cause the problem that the vocal signal is weakened or even eliminated, and the above problem can effectively avoid the problem.

在图1所示的方法中，终端预存有多个距离且所述多个距离中每个距离各自对应有参考值，即过滤人声所使用的参考值会随着用户嘴部到终端的麦克风(包括主麦克风和副麦克风)的距离的变化而变化，相较于现有技术在任何情况下都是用相同的参考值而言，降噪性能更好，过滤出的人声更加真实。In the method shown in FIG. 1, the terminal prestores a plurality of distances and each of the plurality of distances respectively has a reference value, that is, the reference value used for filtering the human voice is followed by the microphone of the user's mouth to the terminal. The change in the distance (including the main microphone and the sub-microphone) varies, and the noise reduction performance is better with the same reference value in any case than the prior art, and the filtered human voice is more realistic.

以上描述了本发明实施例的方法，以下进一步描述本发明实施例的装置。The method of the embodiments of the present invention has been described above, and the apparatus of the embodiments of the present invention is further described below.

参见图4，是本发明实施例提供的一种终端的示意框图。该终端包括检测单元401，匹配单元402和滤除单元403，各个单元的描述如下。 FIG. 4 is a schematic block diagram of a terminal according to an embodiment of the present invention. The terminal includes a detecting unit 401, a matching unit 402, and a filtering unit 403, each of which is described below.

检测单元401用于检测目标距离，该目标距离包括用户嘴部到该终端的主麦克风的距离以及包括该用户嘴部到该终端的副麦克风的距离。The detecting unit 401 is configured to detect a target distance including a distance from the mouth of the user to the main microphone of the terminal and a distance including the sub-microphone of the user's mouth to the terminal.

匹配单元402用于匹配该目标距离对应的参考值，该匹配单元402预存有多个距离且该多个距离中每个距离各自对应有参考值，该参考值为预设的用于表征声音信号之间的差值，该多个距离包括该目标距离。The matching unit 402 is configured to match the reference value corresponding to the target distance, the matching unit 402 prestores a plurality of distances, and each of the plurality of distances respectively has a reference value, where the reference value is preset for characterizing the sound signal. The difference between the multiple distances includes the target distance.

滤除单元403用于根据实际值和该参考值滤除环境噪声，该实际值为该主麦克风的声音信号与该副麦克风的声音信号之间的差值。The filtering unit 403 is configured to filter out ambient noise according to the actual value and the reference value, the actual value being a difference between the sound signal of the primary microphone and the sound signal of the secondary microphone.

在又一种可选的方案中，滤除单元403根据实际值和该参考值滤除环境噪声，具体为：若该实际值与该参考值的差值的绝对值小于第一预设值，则该滤除单元403将该实际值作为有用信号。可以看出，通过上述方式，能够避免由于终端位置不固定，主麦克风和副麦克风获取的人声信号的强度差不为6dB的问题，提升降噪的性能。In another optional solution, the filtering unit 403 filters out the ambient noise according to the actual value and the reference value, specifically, if the absolute value of the difference between the actual value and the reference value is less than the first preset value, Then, the filtering unit 403 takes the actual value as a useful signal. It can be seen that, in the above manner, the problem that the intensity difference of the vocal signals acquired by the primary microphone and the secondary microphone is not 6 dB due to the unfixed terminal position can be avoided, and the performance of noise reduction is improved.

在又一种可选的方案中，滤除单元403根据实际值和该参考值滤除环境噪声，具体为：若该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离之差大于第二预设值，则该滤除单元403根据实际值和该参考值滤除环境噪声；若该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离之差不大于第二预设值，则该滤除单元403将主麦克风获取的声音作为有用信号。需要理解的是，在该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离相当的情况下，主麦克风和副麦克风获取的声音信号是相似的，若进行降噪处理会造成人声信号削弱的问题，通过上述方式，能够有效地避免该问题。In still another optional solution, the filtering unit 403 filters out the environmental noise according to the actual value and the reference value, specifically: if the distance between the user's mouth and the main microphone of the terminal and the user's mouth are away from the terminal The difference between the distances of the sub-microphones is greater than the second preset value, and the filtering unit 403 filters out the ambient noise according to the actual value and the reference value; if the distance of the user's mouth from the main microphone of the terminal is the mouth of the user The difference between the distances from the sub-microphones of the terminal is not greater than the second preset value, and the filtering unit 403 uses the sound acquired by the main microphone as a useful signal. It should be understood that the sound signals acquired by the primary microphone and the secondary microphone are similar if the distance of the user's mouth from the main microphone of the terminal is equal to the distance of the user's mouth from the secondary microphone of the terminal. The noise reduction process causes a problem that the vocal signal is weakened, and in the above manner, the problem can be effectively avoided.

在又一种可选的方案中，检测单元401检测目标距离，具体为：首先，通过摄像头获取用户嘴部图像；然后，匹配获取的该用户嘴部图像对应的距离，终端预存有多个嘴部图像且该多个嘴部图像中每个嘴部图像信息各自对应有自身的距离，检测单元401获取的该用户嘴部图像对应的距离为目标距离。In another optional solution, the detecting unit 401 detects the target distance, specifically: first, acquiring the image of the user's mouth through the camera; then, matching the acquired distance corresponding to the mouth image of the user, the terminal pre-stores a plurality of mouths Each of the plurality of mouth images has its own distance, and the distance corresponding to the user's mouth image acquired by the detecting unit 401 is the target distance.

在又一种可选的方案中，检测单元401检测目标距离，具体为：通过红外线传感器检测该用户嘴部到该终端的距离，该用户嘴部到该终端的距离为目标距离。在又一种可选的方案中，该终端包括多个麦克风，检测单元401检测目标距离，具体为：检测该用户嘴部到多个副麦克风中每个副麦克风的距离以及该用户嘴部到该终端的主麦克风的距离；该目标距离包括该用户嘴部到该终端的主麦克风的距离以及该用户嘴部到目标副麦克风的距离，该目标副麦克风为该多个副麦克风中到该用户嘴部的距离与该终端的主麦克风到该用户嘴部的距离之差最大的副麦克风。可以看出，通过该检测单元401对该目标副麦克风的确定，避免了在该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离相当的情况下，进行降噪处理造成的人声信号削弱的问题，从而提升降噪的性能。In still another optional solution, the detecting unit 401 detects the target distance, specifically: detecting the distance of the user's mouth to the terminal by using an infrared sensor, and the distance from the user's mouth to the terminal is the target. distance. In still another optional solution, the terminal includes a plurality of microphones, and the detecting unit 401 detects the target distance, specifically: detecting a distance from the user's mouth to each of the plurality of sub-microphones and the user's mouth to a distance of the main microphone of the terminal; the target distance includes a distance from the mouth of the user to the main microphone of the terminal and a distance from the mouth of the user to the target sub-microphone, and the target sub-microphone is the user in the plurality of sub-microphones The sub-microphone having the largest difference between the distance of the mouth and the distance from the main microphone of the terminal to the mouth of the user. It can be seen that the determination of the target sub-microphone by the detecting unit 401 avoids the case where the distance between the user's mouth and the main microphone of the terminal is equal to the distance of the user's mouth from the sub-microphone of the terminal. The problem of weakening the vocal signal caused by the noise reduction processing is performed, thereby improving the performance of noise reduction.

在又一种可选的方案中，该终端还包括提示单元404，该提示单元404用于在该检测单元401检测目标距离之后，该匹配单元402匹配该目标距离对应的参考值之前，通过摄像头获取用户嘴部的状态；若该用户嘴部的状态为运动状态，且通过该主麦克风和该副麦克风获取的声音信号弱于第三预设值，则该提示单元404输出提示信息以提示重新输入声音；该实际值为该主麦克风获取的重新输入的声音信号与该副麦克风获取的重新输入的声音信号之间的差值。可以看出，通过上述输出提示信息的方式，可以避免由于用户输入的声音信号的音量值过小而造成的消除噪声信号不准确的问题，从而提升降噪的性能。In still another optional solution, the terminal further includes a prompting unit 404, configured to pass the camera after the detecting unit 401 detects the target distance, and the matching unit 402 matches the reference value corresponding to the target distance. Obtaining a state of the mouth of the user; if the state of the mouth of the user is a motion state, and the sound signal acquired by the primary microphone and the secondary microphone is weaker than the third preset value, the prompting unit 404 outputs the prompt information to prompt the re Input sound; the actual value is the difference between the re-inputted sound signal acquired by the primary microphone and the re-inputted sound signal acquired by the secondary microphone. It can be seen that the manner of outputting the prompt information can avoid the problem that the noise signal is inaccurate due to the volume value of the sound signal input by the user is too small, thereby improving the performance of noise reduction.

需要说明的是，各个操作的实现还可以对应参照图1所示的方法实施例的相应描述。It should be noted that the implementation of each operation may also correspond to the corresponding description of the method embodiment shown in FIG. 1 .

在图4所示的终端40中，终端预存有多个距离且所述多个距离中每个距离各自对应有参考值，即过滤人声所使用的参考值会随着用户嘴部到终端的麦克风(包括主麦克风和副麦克风)的距离的变化而变化，相较于现有技术在任何情况下都是用相同的参考值而言，降噪性能更好，过滤出的人声更加真实。In the terminal 40 shown in FIG. 4, the terminal prestores a plurality of distances, and each of the plurality of distances respectively has a reference value, that is, the reference value used for filtering the human voice will follow the mouth of the user to the terminal. The distance between the microphone (including the main microphone and the sub-microphone) varies, and the noise reduction performance is better and the filtered human voice is more realistic than the prior art in any case with the same reference value.

参见图5，是本发明实施例提供的又一种终端的示意性框图。如图5所示的本实施例中的终端可以包括：一个或多个处理器501；一个或多个输入设备502，一个或多个输出设备503和存储器505。上述处理器501、输入设备502、输出设备503和存储器505通过总线505连接。存储器502用于存储指令。 FIG. 5 is a schematic block diagram of still another terminal according to an embodiment of the present invention. The terminal in this embodiment as shown in FIG. 5 may include one or more processors 501; one or more input devices 502, one or more output devices 503, and a memory 505. The above processor 501, input device 502, output device 503, and memory 505 are connected by a bus 505. Memory 502 is used to store instructions.

所称处理器501可以是中央处理单元(Central Processing Unit，CPU)，该处理器还可以是其他通用处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现成可编程门阵列(Field-Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The processor 501 may be a central processing unit (CPU), and the processor may be another general-purpose processor, a digital signal processor (DSP), or an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.

输入设备502可以包括触摸屏、指纹采传感器(用于采集用户的指纹信息和指纹的方向信息)、红外线传感器、摄像头等，例如，在下面一些操作中的输入设备502指的是摄像头，在下面又一些操作中输入设备502指的是红外线传感器，等等，输出设备503可以包括显示器(LCD等，或者说显示屏)、扬声器、摄像头等，例如，在下面一些操作中的输出设备503指的是显示屏，在下面又一些操作中输出设备503指的是扬声器，等等。The input device 502 may include a touch screen, a fingerprint sensor (for collecting fingerprint information of the user and direction information of the fingerprint), an infrared sensor, a camera, etc., for example, the input device 502 in the following operations refers to a camera, and below In some operations, the input device 502 refers to an infrared sensor, etc., and the output device 503 may include a display (LCD or the like, or a display screen), a speaker, a camera, etc., for example, the output device 503 in some of the following operations refers to The display screen, in some of the following operations, the output device 503 refers to a speaker, and the like.

该存储器505可以包括只读存储器和随机存取存储器，并向处理器501提供指令和数据。存储器505的一部分还可以包括非易失性随机存取存储器。例如，存储器505还可以存储设备类型的信息。The memory 505 can include read only memory and random access memory and provides instructions and data to the processor 501. A portion of the memory 505 can also include a non-volatile random access memory. For example, the memory 505 can also store information of the device type.

处理器501用于运行存储器505存储的程序指令来执行如下操作：The processor 501 is configured to execute program instructions stored in the memory 505 to perform the following operations:

通过输入设备502检测目标距离，该目标距离包括用户嘴部到该终端的主麦克风的距离以及包括该用户嘴部到该终端的副麦克风的距离；该输入设备502可以为摄像头，通过采集用户嘴部图像来得到目标距离，该输入设备502还可以为红外线传感器，通过红外线测距原理来得到目标距离。The target distance is detected by the input device 502, the target distance including the distance from the user's mouth to the main microphone of the terminal and the distance from the user's mouth to the sub-microphone of the terminal; the input device 502 may be a camera, by collecting the user's mouth The image is obtained to obtain the target distance, and the input device 502 can also be an infrared sensor, and the target distance is obtained by the infrared ranging principle.

匹配该目标距离对应的参考值，该存储器505预存有多个距离且该多个距离中每个距离各自对应有参考值，该参考值为预设的用于表征声音信号之间的差值，该多个距离包括该目标距离。Matching the reference value corresponding to the target distance, the memory 505 prestores a plurality of distances, and each of the plurality of distances respectively has a reference value, where the reference value is a preset value used to represent the difference between the sound signals, The plurality of distances includes the target distance.

根据实际值和该参考值滤除环境噪声，该实际值为该主麦克风的声音信号与该副麦克风的声音信号之间的差值。The ambient noise is filtered according to the actual value and the reference value, and the actual value is the difference between the sound signal of the primary microphone and the sound signal of the secondary microphone.

在又一种可选的方案中，处理器501根据实际值和该参考值滤除环境噪声，可以为：若该实际值与该参考值的差值的绝对值小于第一预设值，则该终端将该实际值作为有用信号。可以看出，通过上述方式，能够避免由于终端位置不固定，主麦克风和副麦克风获取的人声信号的强度差不固定的问题，提升降噪的性能。In another optional solution, the processor 501 filters the ambient noise according to the actual value and the reference value, and may be: if the absolute value of the difference between the actual value and the reference value is less than the first preset value, The terminal will This actual value is used as a useful signal. It can be seen that, in the above manner, the problem that the intensity difference of the vocal signals acquired by the primary microphone and the secondary microphone is not fixed due to the unfixed terminal position can be avoided, and the performance of noise reduction is improved.

在又一种可选的方案中，该处理器501根据实际值和该参考值滤除环境噪声，还可以为：若该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离之差大于第二预设值，则该处理器501根据实际值和该参考值滤除环境噪声；若该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离之差不大于第二预设值，则该处理器501将主麦克风获取的声音作为有用信号。需要理解的是，在该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离相当的情况下，主麦克风和副麦克风获取的声音信号是相似的，若进行降噪处理会造成人声信号削弱的问题，通过上述方式，能够有效地避免该问题。In another optional solution, the processor 501 filters the ambient noise according to the actual value and the reference value, and may also be: if the user's mouth is away from the main microphone of the terminal and the user's mouth is away from the If the difference between the distances of the sub-microphones of the terminal is greater than the second preset value, the processor 501 filters out the ambient noise according to the actual value and the reference value; if the mouth of the user is away from the main microphone of the terminal and the mouth of the user The difference between the distances from the sub-microphones of the terminal is not greater than the second preset value, and the processor 501 uses the sound acquired by the main microphone as a useful signal. It should be understood that the sound signals acquired by the primary microphone and the secondary microphone are similar if the distance of the user's mouth from the main microphone of the terminal is equal to the distance of the user's mouth from the secondary microphone of the terminal. The noise reduction process causes a problem that the vocal signal is weakened, and in the above manner, the problem can be effectively avoided.

在又一种可选的方案中，该处理器501通过该输入设备502(该输入设备502在此处为摄像头)，检测目标距离，具体为：通过摄像头获取用户嘴部图像；匹配获取的该用户嘴部图像对应的距离，该存储器505预存有多个嘴部图像且该多个嘴部图像中每个嘴部图像信息各自对应有自身的距离，获取的该用户嘴部图像对应的距离为目标距离。In another optional solution, the processor 501 detects the target distance through the input device 502 (the input device 502 is a camera here), specifically: acquiring a user mouth image through the camera; matching the acquired image a distance corresponding to the mouth image of the user, the memory 505 pre-stores a plurality of mouth images, and each mouth image information of the plurality of mouth images respectively has its own distance, and the obtained distance corresponding to the mouth image of the user is Target distance.

在又一种可选的方案中，该处理器501通过该输入设备502(该输入设备502在此处为红外线传感器)，检测目标距离，具体为：该处理器501通过红外线传感器检测该用户嘴部到该终端的距离，该用户嘴部到该终端的距离为目标距离。在又一种可选的方案中，该终端包括多个麦克风，处理器501通过输入设备502(该输入设备502在此处可以为红外线传感器，也可以为摄像头，还可以为其他可以检测该目标距离的设备)，检测目标距离，具体为：检测该用户嘴部到该多个副麦克风中每个副麦克风的距离以及该用户嘴部到该终端的主麦克风的距离；该目标距离包括该用户嘴部到该终端的主麦克风的距离以及该用户嘴部到目标副麦克风的距离，该目标副麦克风为该多个副麦克风中到该用户嘴部的距离与该终端的主麦克风到该用户嘴部的距离之差最大的副麦克风。可以看出，通过该检测单元401对该目标副麦克风的确定，避免了在该用户嘴部离该终端的主麦克风的距离与该用户嘴部离该终端的副麦克风的距离相当的情况下，进行降噪处理造成的人声信号削弱的问题，从而提升降噪的性能。In still another alternative, the processor 501 detects the target distance through the input device 502 (the input device 502 is an infrared sensor here), specifically: the processor 501 detects the user mouth by using an infrared sensor. The distance from the user to the terminal, the distance from the mouth of the user to the terminal is the target distance. In still another optional solution, the terminal includes a plurality of microphones, and the processor 501 passes through the input device 502 (the input device 502 can be an infrared sensor here, or can be a camera, and can also detect the target for others) a distance device, detecting a target distance, specifically: detecting a distance from the mouth of the user to each of the plurality of sub-microphones and a distance from the mouth of the user to the main microphone of the terminal; the target distance includes the user The distance from the mouth to the main microphone of the terminal and the distance from the mouth of the user to the target sub-microphone, the target sub-microphone is the distance from the plurality of sub-microphones to the mouth of the user and the main microphone of the terminal to the mouth of the user The largest difference in the distance between the ministries Ke Feng. It can be seen that the determination of the target sub-microphone by the detecting unit 401 avoids the case where the distance between the user's mouth and the main microphone of the terminal is equal to the distance of the user's mouth from the sub-microphone of the terminal. The problem of weakening the vocal signal caused by the noise reduction processing is performed, thereby improving the performance of noise reduction.

在又一种可选的方案中，该终端包括多个麦克风，处理器501通过输入设备502，检测目标距离，具体为：该处理器501通过输入设备502(该输入设备502在此处可以为红外线传感器，也可以为摄像头，还可以为其他可以检测该目标距离的设备)检测目标距离之后，该处理器501匹配该目标距离对应的参考值之前，还包括：通过摄像头获取用户嘴部的状态；若该用户嘴部的状态为运动状态，且通过该主麦克风和该副麦克风获取的声音信号弱于第三预设值，则输出提示信息以提示重新输入声音；该实际值为该主麦克风获取的重新输入的声音信号与该副麦克风获取的重新输入的声音信号之间的差值。可以看出，通过上述输出提示信息的方式，可以避免由于用户输入的声音信号的音量值过小而造成的消除噪声信号不准确的问题，从而提升降噪的性能。In still another optional solution, the terminal includes a plurality of microphones, and the processor 501 detects the target distance through the input device 502. Specifically, the processor 501 passes through the input device 502. The input device 502 can be The infrared sensor may also be a camera, and may detect the target distance for other devices capable of detecting the target distance. Before the processor 501 matches the reference value corresponding to the target distance, the method further includes: acquiring the state of the user's mouth through the camera. If the state of the mouth of the user is a motion state, and the sound signal obtained by the primary microphone and the secondary microphone is weaker than the third preset value, the prompt information is output to prompt to re-enter the sound; the actual value is the primary microphone The difference between the acquired re-inputted sound signal and the re-inputted sound signal acquired by the secondary microphone. It can be seen that the manner of outputting the prompt information can avoid the problem that the noise signal is inaccurate due to the volume value of the sound signal input by the user is too small, thereby improving the performance of noise reduction.

在图5所示的终端50中，终端预存有多个距离且所述多个距离中每个距离各自对应有参考值，即过滤人声所使用的参考值会随着用户嘴部到终端的麦克风(包括主麦克风和副麦克风)的距离的变化而变化，相较于现有技术在任何情况下都是用相同的参考值而言，降噪性能更好，过滤出的人声更加真实。In the terminal 50 shown in FIG. 5, the terminal prestores a plurality of distances, and each of the plurality of distances respectively has a reference value, that is, the reference value used for filtering the human voice will follow the mouth of the user to the terminal. The distance between the microphone (including the main microphone and the sub-microphone) varies, and the noise reduction performance is better and the filtered human voice is more realistic than the prior art in any case with the same reference value.

如图6所示，图6是本发明实例提供的又一种终端(如手机)的结构示意图。该终端600可包括：基带芯片610、存储器616(一个或多个计算机可读存储介质)、射频(RF)模块616、******617。这些部件可在一个或多个通信总线614上通信。As shown in FIG. 6, FIG. 6 is a schematic structural diagram of still another terminal (such as a mobile phone) according to an example of the present invention. The terminal 600 can include a baseband chip 610, a memory 616 (one or more computer readable storage media), a radio frequency (RF) module 616, and a peripheral system 617. These components can communicate over one or more communication buses 614.

******617主要用于实现终端610和用户/外部环境之间的交互功能，主要包括终端600的输入输出设备。具体实现中，******617可包括：触摸屏(也可以为触摸显示屏)控制器618、摄像头控制器619、音频控制器620 以及传感器管理模块621。其中，各个控制器可与各自对应的***设备(如触摸屏(也可以为触摸显示屏)623、摄像头624、音频电路626以及传感器626)耦合。需要说明的，******617还可以包括其他I/O外设。The peripheral system 617 is mainly used to implement the interaction function between the terminal 610 and the user/external environment, and mainly includes the input and output devices of the terminal 600. In a specific implementation, the peripheral system 617 can include: a touch screen (also can be a touch display screen) controller 618, a camera controller 619, and an audio controller 620. And a sensor management module 621. Each controller may be coupled to a respective peripheral device (such as a touch screen (which may also be a touch display screen) 623, a camera 624, an audio circuit 626, and a sensor 626). It should be noted that the peripheral system 617 may also include other I/O peripherals.

基带芯片610可集成包括：一个或多个处理器611、时钟模块622以及电源管理模块613。集成于基带芯片610中的时钟模块622主要用于为处理器611产生数据传输和时序控制所需要的时钟。集成于基带芯片610中的电源管理模块613主要用于为处理器611、射频模块616以及******提供稳定的、高精确度的电压。The baseband chip 610 can be integrated to include one or more processors 611, a clock module 622, and a power management module 613. The clock module 622 integrated in the baseband chip 610 is primarily used to generate the clocks required for data transfer and timing control for the processor 611. The power management module 613 integrated in the baseband chip 610 is mainly used to provide a stable, high-precision voltage for the processor 611, the radio frequency module 616, and the peripheral system.

射频(RF)模块616用于接收和发送射频信号，主要集成了终端600的接收器和发射器。射频(RF)模块616通过射频信号与通信网络和其他通信设备通信。具体实现中，射频(RF)模块616可包括但不限于：天线***、RF收发器、一个或多个放大器、调谐器、一个或多个振荡器、数字信号处理器、CODEC芯片、SIM卡和存储介质等。在一些实施例中，可在单独的芯片上实现射频(RF)模块616。A radio frequency (RF) module 616 is used to receive and transmit radio frequency signals, primarily integrating the receiver and transmitter of terminal 600. A radio frequency (RF) module 616 communicates with the communication network and other communication devices via radio frequency signals. In a specific implementation, the radio frequency (RF) module 616 can include, but is not limited to: an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chip, a SIM card, and Storage media, etc. In some embodiments, a radio frequency (RF) module 616 can be implemented on a separate chip.

存储器616与处理器611耦合，用于存储各种软件程序和/或多组指令。具体实现中，存储器616可包括高速随机存取的存储器，并且也可包括非易失性存储器，例如一个或多个磁盘存储设备、闪存设备或其他非易失性固态存储设备。存储器616可以存储操作***(下述简称***)，例如ANDROID，IOS，WINDOWS，或者LINUX等嵌入式操作***。存储器616还可以存储网络通信程序，该网络通信程序可用于与一个或多个附加设备，一个或多个终端设备，一个或多个网络设备进行通信。存储器616还可以存储用户接口程序，该用户接口程序可以通过图形化的操作界面将应用程序的内容形象逼真的显示出来，并通过菜单、对话框以及按键等输入控件接收用户对应用程序的控制操作。 Memory 616 is coupled to processor 611 for storing various software programs and/or sets of instructions. In particular implementations, memory 616 can include high speed random access memory, and can also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state storage devices. The memory 616 can store an operating system (hereinafter referred to as a system) such as an embedded operating system such as ANDROID, IOS, WINDOWS, or LINUX. The memory 616 can also store a network communication program that can be used to communicate with one or more additional devices, one or more terminal devices, one or more network devices. The memory 616 can also store a user interface program, which can realistically display the content of the application through a graphical operation interface, and receive user control operations on the application through input controls such as menus, dialog boxes, and keys. .

存储器616还可以存储一个或多个应用程序。如图6所示，这些应用程序可包括：社交应用程序(例如Facebook)，图像管理应用程序(例如相册)，购物类应用程序(例如淘宝)，浏览器(例如Safari，Google Chrome)等等。 Memory 616 can also store one or more applications. As shown in FIG. 6, these applications may include: social applications (such as Facebook), image management applications (such as photo albums), shopping applications (such as Taobao), browsers (such as Safari, Google Chrome), and the like.

本申请中，处理器611可用于读取和执行计算机可读指令。具体的，处理器611可用于调用存储于存储器616中的程序，例如本申请提供的降噪方法的实现程序，并执行该程序包含的指令，从而实现图1所示方法实施例。In the present application, processor 611 can be used to read and execute computer readable instructions. Specifically, processing The 611 can be used to invoke a program stored in the memory 616, such as an implementation of the noise reduction method provided by the present application, and execute the instructions contained in the program, thereby implementing the method embodiment shown in FIG.

应当理解，终端600仅为本发明实施例提供的一个例子，并且，终端600可具有比示出的部件更多或更少的部件，可以组合两个或更多个部件，或者可具有部件的不同配置实现。在本发明的另一实施例中提供一种芯片***，该芯片***包括至少一个处理器，存储器和接口电路，该存储器、该收发器和该至少一个处理器通过线路互联，该至少一个存储器中存储有指令；该指令被该处理器执行时，图1所示实施例的方法得以实现。It should be understood that the terminal 600 is only an example provided by an embodiment of the present invention, and that the terminal 600 may have more or less components than the illustrated components, may combine two or more components, or may have components. Different configurations are implemented. In another embodiment of the present invention, a chip system is provided, the chip system comprising at least one processor, a memory and an interface circuit, the memory, the transceiver and the at least one processor being interconnected by a line, the at least one memory An instruction is stored; when the instruction is executed by the processor, the method of the embodiment shown in FIG. 1 is implemented.

在本发明实施例的另一实施例中提供一种计算机程序产品，当该计算机程序产品在处理器上运行时，图1所示实施例的方法得以实现。In another embodiment of an embodiment of the present invention, a computer program product is provided, the method of the embodiment of FIG. 1 being implemented when the computer program product is run on a processor.

在本发明的另一实施例中提供一种计算机可读存储介质，该计算机可读存储介质存储有计算机程序，该计算机程序被处理器执行时实现图1所示实施例的方法。In another embodiment of the present invention, a computer readable storage medium is stored, the computer readable storage medium storing a computer program that, when executed by a processor, implements the method of the embodiment of FIG.

该计算机可读存储介质可以是前述任一实施例该的终端的内部存储单元，例如终端的硬盘或内存。该计算机可读存储介质也可以是该终端的外部存储设备，例如该终端上配备的插接式硬盘，智能存储卡(Smart Media Card,SMC)，安全数字(Secure Digital,SD)卡，闪存卡(Flash Card)等。进一步地，该计算机可读存储介质还可以既包括该终端的内部存储单元也包括外部存储设备。该计算机可读存储介质用于存储该计算机程序以及该终端所需的其他程序和数据。该计算机可读存储介质还可以用于暂时地存储已经输出或者将要输出的数据。The computer readable storage medium may be an internal storage unit of the terminal of any of the foregoing embodiments, such as a hard disk or a memory of the terminal. The computer readable storage medium may also be an external storage device of the terminal, such as a plug-in hard disk equipped on the terminal, a smart memory card (SMC), a Secure Digital (SD) card, and a flash memory card. (Flash Card), etc. Further, the computer readable storage medium may also include both an internal storage unit of the terminal and an external storage device. The computer readable storage medium is for storing the computer program and other programs and data required by the terminal. The computer readable storage medium can also be used to temporarily store data that has been output or is about to be output.

本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、计算机软件或者二者的结合来实现，为了清楚地说明硬件和软件的可互换性，在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本发明的范围。Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both, for clarity of hardware and software. Interchangeability, the composition and steps of the various examples have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A skilled person can use different methods to implement the described functions for each particular application, but such implementation should not be considered as an extension of the present invention. Wai.

所属领域的技术人员可以清楚地了解到，为了描述的方便和简洁，上述描述的终端和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。A person skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working process of the terminal and the unit described above can be referred to the corresponding process in the foregoing method embodiment, and details are not described herein again.

在本发明所提供的几个实施例中，应该理解到，所揭露的终端和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，该单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个***，或一些特征可以忽略，或不执行。另外，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口、装置或单元的间接耦合或通信连接，也可以是电的，机械的或其它的形式连接。In the several embodiments provided by the present invention, it should be understood that the disclosed terminal and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, or an electrical, mechanical or other form of connection.

该作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本发明实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.

另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以是两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

该集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分，或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例该方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, can be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention contributes in essence or to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method of various embodiments of the present invention. The foregoing storage medium includes: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk. The medium in which the program code is stored.

以上，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到各种等效的修改或替换，这些修改或替换都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应以权利要求的保护范围为准。 The above is only the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any equivalent modification or can be easily conceived by those skilled in the art within the technical scope of the present disclosure. Such modifications or substitutions are intended to be included within the scope of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

一种降噪方法，其特征在于，包括：A noise reduction method, comprising:

终端检测目标距离，所述目标距离包括用户嘴部到所述终端的主麦克风的距离以及包括所述用户嘴部到所述终端的副麦克风的距离；The terminal detects a target distance including a distance from a mouth of the user to a main microphone of the terminal and a distance including a sub-microphone of the user's mouth to the terminal;

所述终端匹配所述目标距离对应的参考值，所述终端预存有多个距离且所述多个距离中每个距离各自对应有参考值，所述参考值为预设的用于表征声音信号之间的差值，所述多个距离包括所述目标距离；The terminal matches a reference value corresponding to the target distance, the terminal prestores a plurality of distances, and each of the multiple distances respectively has a reference value, and the reference value is preset for representing a sound signal. a difference between the plurality of distances including the target distance;

所述终端根据实际值和所述参考值滤除环境噪声，所述实际值为所述主麦克风的声音信号与所述副麦克风的声音信号之间的差值。The terminal filters out ambient noise according to an actual value and the reference value, where the actual value is a difference between a sound signal of the primary microphone and a sound signal of the secondary microphone.
根据权利要求1所述的方法，其特征在于，所述终端根据实际值和所述参考值滤除环境噪声，包括：The method according to claim 1, wherein the terminal filters out environmental noise according to the actual value and the reference value, including:

若所述实际值与所述参考值的差值的绝对值小于第一预设值，则所述终端将所述实际值作为有用信号。If the absolute value of the difference between the actual value and the reference value is less than the first preset value, the terminal uses the actual value as a useful signal.
根据权利要求1所述的方法，其特征在于，所述终端根据实际值和所述参考值滤除环境噪声，包括：The method according to claim 1, wherein the terminal filters out environmental noise according to the actual value and the reference value, including:

若所述用户嘴部离所述终端的主麦克风的距离与所述用户嘴部离所述终端的副麦克风的距离之差大于第二预设值，则所述终端根据实际值和所述参考值滤除环境噪声；If the difference between the distance of the user's mouth from the main microphone of the terminal and the distance of the user's mouth from the sub-microphone of the terminal is greater than a second preset value, the terminal according to the actual value and the reference Values filter out environmental noise;

若所述用户嘴部离所述终端的主麦克风的距离与所述用户嘴部离所述终端的副麦克风的距离之差不大于第二预设值，则所述终端将主麦克风获取的声音作为有用信号。If the difference between the distance of the user's mouth from the main microphone of the terminal and the distance of the user's mouth from the sub-microphone of the terminal is not greater than a second preset value, the terminal acquires the sound of the main microphone As a useful signal.
根据权利要求1-3任一项所述的方法，其特征在于，所述终端检测目标距离，包括：The method according to any one of claims 1-3, wherein the terminal detects a target distance, including:

所述终端通过摄像头获取用户嘴部图像；The terminal acquires an image of a user's mouth through a camera;

所述终端匹配获取的所述用户嘴部图像对应的距离，所述终端预存有多个嘴部图像且所述多个嘴部图像中每个嘴部图像各自对应有自身的距离，获取的所述用户嘴部图像对应的距离为目标距离。 The terminal matches the acquired distance corresponding to the mouth image of the user, the terminal pre-stores a plurality of mouth images, and each of the plurality of mouth images respectively has its own distance, and the acquired location The distance corresponding to the mouth image of the user is the target distance.
根据权利要求1-3任一项所述的方法，其特征在于，所述终端检测目标距离，包括：The method according to any one of claims 1-3, wherein the terminal detects a target distance, including:

所述终端通过红外线传感器检测所述用户嘴部到所述终端的距离，所述用户嘴部到所述终端的距离为目标距离。The terminal detects the distance from the mouth of the user to the terminal by using an infrared sensor, and the distance from the mouth of the user to the terminal is a target distance.
根据权利要求1-3任一项所述的方法，其特征在于，所述终端检测目标距离之后，所述终端匹配所述目标距离对应的参考值之前，还包括：The method according to any one of claims 1-3, wherein, after the terminal detects the target distance, before the terminal matches the reference value corresponding to the target distance, the method further includes:

所述终端通过摄像头获取用户嘴部的状态；The terminal acquires a state of a user's mouth through a camera;

若所述用户嘴部的状态为运动状态，且通过所述主麦克风和所述副麦克风获取的声音信号弱于第三预设值，则所述终端输出提示信息以提示重新输入声音；所述实际值为所述主麦克风获取的重新输入的声音信号与所述副麦克风获取的重新输入的声音信号之间的差值。If the state of the mouth of the user is a motion state, and the sound signal acquired by the primary microphone and the secondary microphone is weaker than the third preset value, the terminal outputs prompt information to prompt to re-enter the sound; The actual value is the difference between the re-inputted sound signal acquired by the primary microphone and the re-inputted sound signal acquired by the secondary microphone.
根据权利要求1-3任一项所述的方法，其特征在于，所述副麦克风为多个副麦克风，所述终端检测目标距离，包括：The method according to any one of claims 1-3, wherein the secondary microphone is a plurality of secondary microphones, and the terminal detects the target distance, including:

所述终端检测所述用户嘴部到所述多个副麦克风中每个副麦克风的距离以及所述用户嘴部到所述终端的主麦克风的距离；The terminal detects a distance from the user's mouth to each of the plurality of sub-microphones and a distance from the user's mouth to the main microphone of the terminal;

所述目标距离包括所述用户嘴部到所述终端的主麦克风的距离以及所述用户嘴部到目标副麦克风的距离，所述目标副麦克风为所述多个副麦克风中到所述用户嘴部的距离与所述终端的主麦克风到所述用户嘴部的距离之差最大的副麦克风。The target distance includes a distance from the user's mouth to a main microphone of the terminal and a distance from the user's mouth to a target sub-microphone, and the target sub-microphone is the plurality of sub-microphones to the user's mouth The sub-microphone having the largest difference between the distance of the portion and the distance from the main microphone of the terminal to the mouth of the user.
一种终端，其特征在于，包括用于执行如权利要求1-7中任一权利要求所述的方法的单元。A terminal characterized by comprising means for performing the method of any of claims 1-7.
一种终端，其特征在于，包括处理器和存储器，其中，所述存储器用于存储程序指令，所述处理器被配置用于调用所述程序指令来执行如权利要求1-7任一权利要求所述的方法。A terminal, comprising a processor and a memory, wherein the memory is for storing program instructions, the processor being configured to invoke the program instructions to perform any of claims 1-7 Said method.
一种计算机可读存储介质，其特征在于，所述计算机存储介质存储有程序指令，所述程序指令当被处理器执行时使所述处理器执行如权利要求1-7任一项所述的方法。 A computer readable storage medium, characterized in that the computer storage medium stores program instructions that, when executed by a processor, cause the processor to perform the method of any of claims 1-7 method.