WO2016033918A1 - 一种全息音频装置及控制方法 - Google Patents

一种全息音频装置及控制方法 Download PDF

Info

Publication number
WO2016033918A1
WO2016033918A1 PCT/CN2015/000557 CN2015000557W WO2016033918A1 WO 2016033918 A1 WO2016033918 A1 WO 2016033918A1 CN 2015000557 W CN2015000557 W CN 2015000557W WO 2016033918 A1 WO2016033918 A1 WO 2016033918A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound field
signal
holographic
signal processing
playback
Prior art date
Application number
PCT/CN2015/000557
Other languages
English (en)
French (fr)
Inventor
张德明
Original Assignee
北京塞宾科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京塞宾科技有限公司 filed Critical 北京塞宾科技有限公司
Publication of WO2016033918A1 publication Critical patent/WO2016033918A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control

Definitions

  • the invention relates to a holographic audio device and a control method.
  • Single-microphone recording is the easiest, but the sound field is also the most monotonous.
  • the original intention of stereo recording is to create a richer stereo field.
  • There are various ways to configure the microphone which are all trying to simulate the perception of the human ear. For example, delay, amplitude difference, phase, etc., but it is difficult to achieve the real human ear perception by simply placing the position of the microphone.
  • the simulated head recording can realize the realistic expression of the immersed three-dimensional sound field, but it is still mainly used in some professional laboratories as a testing tool. For a wide range of audio and video recording, it is extremely inconvenient to use and extremely expensive ( The simulation head, recording equipment, processing equipment, etc.
  • the current simulation head is mainly used for the test of communication equipment, not for the purpose of human stereo field perception, its texture and structure. There is still a big difference with the real human head, and these differences will ultimately affect the recorded sound field effect.
  • a holographic audio device comprising a microphone unit capable of collecting a three-dimensional sound field, wherein: the signal output end of the microphone unit is connected to the acquisition signal processing module, and the signal output terminal of the acquisition signal processing module is connected to the holographic sound field signal processing unit; the holographic sound field The signal output end of the signal processing unit is connected to the playback signal processing module, and the signal output end of the playback signal processing module The audio playback unit is connected; the holographic sound field signal processing unit is externally connected with a source coding module and a source decoding module.
  • the holographic sound field signal processing unit is connected with a storage module.
  • the microphone unit collects a three-dimensional sound field signal, and the acquisition signal processing module processes the acquired signal and converts it into a digital signal.
  • the digital signal is input to the holographic sound field signal processing unit, and the holographic sound field signal processing unit processes the sound field signal, and the processed signal is processed. After the source code is compressed, it is sent to the host through the network;
  • the host sends a signal to the holographic audio device through the network, and the signal is input to the holographic sound field signal processing unit after being decoded by the source, and the holographic sound field signal processing unit outputs the signal to the playback signal processing module to perform audio playback through the audio playback unit.
  • the network connection between the host and the holographic audio device may be WIFI, wired network, WAPI, Bluetooth.
  • the host can be a computer or a mobile phone.
  • An audio processing module is provided on the host for performing background noise cancellation and echo suppression processing on the acoustic signal.
  • the following sound field-related application operations, recording, storage, and monitoring playback of the sound field can be performed on the host; video recording, monitoring, and playback of the sound field; network communication of the sound field; background noise elimination, hearing diagnosis; and enhanced sound field-based binaural Audio health application.
  • the invention can effectively realize the recording and playback of the holographic sound field signal.
  • the microphone unit of the holographic audio device can collect the three-dimensional sound field signal, and the holographic sound field signal processing unit processes the sound field signal, and the processed signal is compressed by the source code and sent to the host through the network; the host can also transmit the holographic audio device through the network.
  • the sound field signal is recorded, and the holographic sound field signal processing unit is connected with a storage module, and can also store the recorded sound field signal.
  • the host can send a signal to the holographic audio device through the network, and the signal is decoded by the source and input into the holographic sound field signal processing unit, and the audio playback unit performs audio playback.
  • the holographic audio device can also be separately monitored for playback.
  • the host of the present invention may be a computer or a mobile phone, and the network connection between the host and the holographic audio device may be WIFI, wired network, WAPI, Bluetooth, and further facilitates recording and playback of the holographic sound field signal.
  • the host computer of the invention is provided with an audio processing module, which can perform background noise elimination and echo suppression processing on the acoustic signal, and can effectively improve the quality of the sound field signal.
  • FIG. 1 is a circuit block diagram of a holographic audio device and a host of the present invention.
  • the holographic audio device includes a microphone unit that can acquire a three-dimensional sound field, and the microphone unit includes an earphone-based or artificial head-based, but is not limited thereto. Sound field acquisition based on the microphone unit, and can be performed at the same time When listening to the loopback.
  • the signal output end of the microphone unit is connected to the acquisition signal processing module, and the signal output end of the acquisition signal processing module is connected to the holographic sound field signal processing unit; the signal output end of the holographic sound field signal processing unit is connected to the playback signal processing module, and the signal output end of the playback signal processing module is The audio playback unit is connected; the holographic sound field signal processing unit is externally connected with a source coding module and a source decoding module.
  • the holographic sound field signal processing unit is externally connected with a WIFI module, and the holographic sound field signal processing unit is connected with a storage module.
  • the microphone unit collects a three-dimensional sound field signal, and the acquisition signal processing module processes the acquired signal and converts it into a digital signal.
  • the digital signal is input to the holographic sound field signal processing unit, and the holographic sound field signal processing unit processes the sound field signal, and the processed signal is processed.
  • the source code is compressed, it is sent to the host through the network; the host can record the sound field signal transmitted by the holographic audio device through the network, and the holographic sound field signal processing unit is connected with the storage module, and also stores the recorded sound field signal.
  • the host sends a signal to the holographic audio device through the network, and the signal is input to the holographic sound field signal processing unit after being decoded by the source, and the holographic sound field signal processing unit outputs the signal to the playback signal processing module to perform audio playback through the audio playback unit.
  • the holographic audio device can also be separately monitored for playback.
  • the host can be a computer or a mobile phone.
  • the mobile phone is used as a host.
  • the network connection between the host and the holographic audio device may be WIFI, wired network, WAPI, Bluetooth.
  • An audio processing module is provided on the host for performing background noise cancellation and echo suppression processing on the acoustic signal.
  • the following sound field-related application operations, recording, storage, and monitoring playback of the sound field can be performed on the host; video recording, monitoring, and playback of the sound field; network communication of the sound field; background noise elimination, hearing diagnosis; and enhanced sound field-based binaural Audio health application.
  • the sound field needs to be reconstructed at the user end, and the sound field reconstruction end is not necessarily the same device as the sound field recording end.
  • the playback end is based on the earphone, it is a personal audio and communication scene.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)
  • Telephone Function (AREA)

Abstract

一种全息音频装置及控制方法，麦克风单元采集三维声场信号，采集信号处理模块对采集信号进行处理并转换成数字信号，前述数字信号输入至全息声场信号处理单元，全息声场信号处理单元对声场信号进行处理，处理后的信号经信源编码压缩后，通过网络发送至主机；主机通过网络向全息音频装置发送信号，信号经信源解码后输入全息声场信号处理单元，全息声场信号处理单元输出信号至回放信号处理模块，通过音频回放单元进行音频回放。

Description

一种全息音频装置及控制方法 技术领域
本发明涉及一种全息音频装置及控制方法。
背景技术
传统录音方法包括单麦克录音、立体声录音(AB、XY、MS、ORTF)。单麦克录音最为简便，但是声场也最为单调；立体声录音的初衷是营造更为丰富的立体声场，在麦克风配置上出现了多种多样的方式，都是试图模拟人的两耳对声音的感知特性，比如延时、幅度差异、相位等，然而只是靠麦克风摆放位置是难以达到模拟真正的人耳感知的。仿真人头录音能够实现浸入式三维声场的逼真体现，但目前主要还是存在于一些专业实验室作为测试工具使用，对于广泛的音频视频录制来说，一是极为不方便使用，同时也是极为昂贵的(包含仿真人头、录音设备、处理设备等一套需要100万欧元左右)，另外，目前的仿真人头主要应用于通信器材的测试，并非为了人耳立体声场感知的目的制作的，它的质地、结构与真实人头还是存在很大的差异，这些差异会最终影响所录制的声场效果。
另一方面，移动宽带的迅猛发展，普通消费者的手机、平板电脑等常用工具除了打电话之外都有了音频视频录制能力，以及很多的数码产品诸如录音笔、可摄像的相机等大多数情况下这些设备都是基于内部麦克风来录制声音的，这些内置麦克风一方面音质比较差，同时声场展现能力也非常差。
目前也出现了一些为手机等设备提供立体声录音的接口设备，这些设备接口离上述专业立体声麦克风还有很大距离，更谈不上浸入式三维声场了。除了音频录制回放之外，在传统手机等视频录制回放中也是没有声场的采集回放及控制的能力的，导致视频体验整体不佳。在视频监控、在线教育、网络音视频通讯等领域，要么压根没有音频能力，有的是简单的单声道音频，有的是普通的立体声，总之，听觉体验远远达不到身临其境的需求。
发明内容
本发明的发明目的在于提供一种全息音频装置及控制方法，能够实现对全息声场信号的录制和回放。
基于同一发明构思，本发明具有两个独立的技术方案：
1、一种全息音频装置，包括可采集三维声场的麦克风单元，其特征在于：麦克风单元的信号输出端接采集信号处理模块，采集信号处理模块的信号输出端接全息声场信号处理单元；全息声场信号处理单元的信号输出端接回放信号处理模块，回放信号处理模块的信号输出端 接音频回放单元；全息声场信号处理单元外接有信源编码模块和信源解码模块。
全息声场信号处理单元接有存储模块。
2、一种上述装置的控制方法，其特征在于：
麦克风单元采集三维声场信号，采集信号处理模块对采集信号进行处理并转换成数字信号，前述数字信号输入至全息声场信号处理单元，全息声场信号处理单元对声场信号进行处理，处理后的信号经信源编码压缩后，通过网络发送至主机；
主机通过网络向全息音频装置发送信号，信号经信源解码后输入全息声场信号处理单元，全息声场信号处理单元输出信号至回放信号处理模块，通过音频回放单元进行音频回放。
主机与全息音频装置之间的网络连接可以是WIFI、有线网络、WAPI、蓝牙。
主机可以是电脑、手机。
主机上设有音频处理模块，用于对声学信号进行背景噪声消除、回声抑制处理。
在主机上可以进行如下与声场相关的应用操作，声场的录制、存储、监听回放；包含声场的视频录制、监控、回放；声场的网络通讯；背景噪声消除、听力诊断；增强基于声场的双耳音频健康应用。
本发明具有的有益效果：
本发明能够有效实现全息声场信号的录制和回放。全息音频装置的麦克风单元可采集三维声场信号，全息声场信号处理单元对声场信号进行处理，处理后的信号经信源编码压缩后，通过网络发送至主机；主机也可对全息音频装置通过网络传送的声场信号进行录制，全息声场信号处理单元接有存储模块，也可存放录制的声场信号。主机可通过网络向全息音频装置发送信号，信号经信源解码后输入全息声场信号处理单元，通过音频回放单元进行音频回放。全息音频装置也可单独进行监听回放。
本发明的主机可以是电脑、手机，主机与全息音频装置之间的网络连接可以是WIFI、有线网络、WAPI、蓝牙，进一步方便全息声场信号的录制和回放。本发明主机上设有音频处理模块，可对声学信号进行背景噪声消除、回声抑制处理，可有效提升声场信号的品质。
附图说明
图1是本发明全息音频装置及主机的电路原理框图。
具体实施方式
如图1所示，全息音频装置包括可采集三维声场的麦克风单元，麦克风单元包括基于耳机的或者基于人工头的，但不限于此。基于麦克风单元进行声场采集，同时可以进行及 时的监听回环。
麦克风单元的信号输出端接采集信号处理模块，采集信号处理模块的信号输出端接全息声场信号处理单元；全息声场信号处理单元的信号输出端接回放信号处理模块，回放信号处理模块的信号输出端接音频回放单元；全息声场信号处理单元外接有信源编码模块和信源解码模块。全息声场信号处理单元外接有WIFI模块，全息声场信号处理单元接有存储模块。
麦克风单元采集三维声场信号，采集信号处理模块对采集信号进行处理并转换成数字信号，前述数字信号输入至全息声场信号处理单元，全息声场信号处理单元对声场信号进行处理，处理后的信号经信源编码压缩后，通过网络发送至主机；主机可对全息音频装置通过网络传送的声场信号进行录制，全息声场信号处理单元接有存储模块，也存放录制的声场信号。
主机通过网络向全息音频装置发送信号，信号经信源解码后输入全息声场信号处理单元，全息声场信号处理单元输出信号至回放信号处理模块，通过音频回放单元进行音频回放。全息音频装置也可单独进行监听回放。
主机可以是电脑、手机，本实施例中，采用手机作为主机。主机与全息音频装置之间的网络连接可以是WIFI、有线网络、WAPI、蓝牙。主机上设有音频处理模块，用于对声学信号进行背景噪声消除、回声抑制处理。
在主机上可以进行如下与声场相关的应用操作，声场的录制、存储、监听回放；包含声场的视频录制、监控、回放；声场的网络通讯；背景噪声消除、听力诊断；增强基于声场的双耳音频健康应用。
作为声场通信、监听回放等应用场景，需要将声场在用户端重建出来，声场重建端并不一定与声场录制端为同一设备。当回放端是基于耳机时，即为个人音频及通信场景，此时如果与录制端为同一设备，需要处理麦克风与耳机单元的声学隔离，以及隔离不彻底而要进行的声学回声消除处理；当回放端与录制端不重合且是扬声器***时，对应的是娱乐媒体***，不需要进行实时回声消除的处理；当回放端是扬声器***，且与录制端在一起时(比如基于扬声器***的声场实时通信)，需要进行较为复杂的声学回声消除处理。

Claims (7)

  1. 一种全息音频装置，包括可采集三维声场的麦克风单元，其特征在于：麦克风单元的信号输出端接采集信号处理模块，采集信号处理模块的信号输出端接全息声场信号处理单元；全息声场信号处理单元的信号输出端接回放信号处理模块，回放信号处理模块的信号输出端接音频回放单元；全息声场信号处理单元外接有信源编码模块和信源解码模块。
  2. 根据权利要求1所述的全息音频装置，其特征在于：全息声场信号处理单元接有存储模块。
  3. 一种权利要求1所述装置的控制方法，其特征在于：
    麦克风单元采集三维声场信号，采集信号处理模块对采集信号进行处理并转换成数字信号，前述数字信号输入至全息声场信号处理单元，全息声场信号处理单元对声场信号进行处理，处理后的信号经信源编码压缩后，通过网络发送至主机；
    主机通过网络向全息音频装置发送信号，信号经信源解码后输入全息声场信号处理单元，全息声场信号处理单元输出信号至回放信号处理模块，通过音频回放单元进行音频回放。
  4. 根据权利要求3所述的方法，其特征在于：主机与全息音频装置之间的网络连接可以是WIFI、有线网络、WAPI、蓝牙。
  5. 根据权利要求4所述的方法，其特征在于：主机可以是电脑、手机。
  6. 根据权利要求5所述的方法，其特征在于：主机上设有音频处理模块，用于对声学信号进行背景噪声消除、回声抑制处理。
  7. 根据权利要求6所述的方法，其特征在于：在主机上可以进行如下与声场相关的应用操作，
    声场的录制、存储、监听回放；包含声场的视频录制、监控、回放；声场的网络通讯；背景噪声消除、听力诊断；增强基于声场的双耳音频健康应用。
PCT/CN2015/000557 2014-09-01 2015-08-04 一种全息音频装置及控制方法 WO2016033918A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410440363.7A CN104168534A (zh) 2014-09-01 2014-09-01 一种全息音频装置及控制方法
CN201410440363.7 2014-09-01

Publications (1)

Publication Number Publication Date
WO2016033918A1 true WO2016033918A1 (zh) 2016-03-10

Family

ID=51912130

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/000557 WO2016033918A1 (zh) 2014-09-01 2015-08-04 一种全息音频装置及控制方法

Country Status (2)

Country Link
CN (1) CN104168534A (zh)
WO (1) WO2016033918A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104217750A (zh) * 2014-09-01 2014-12-17 北京塞宾科技有限公司 一种全息音频录制回放方法
CN104168465A (zh) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 一种视频音频采集方法
CN104168534A (zh) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 一种全息音频装置及控制方法
CN104283697A (zh) * 2014-09-28 2015-01-14 北京塞宾科技有限公司 一种可采集声场信息的通信装置及通信方法
CN106126185A (zh) * 2016-08-18 2016-11-16 北京塞宾科技有限公司 一种基于蓝牙的全息声场录音通讯装置及***

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040151066A1 (en) * 2003-01-14 2004-08-05 Kim Yang Hann Method of visualizing sound fields of individual sound sources using acoustic holography
CN101166377A (zh) * 2006-10-17 2008-04-23 施伟强 一种多语种环绕立体声的低码率编解码方案
CN102637119A (zh) * 2011-11-17 2012-08-15 朱琴琴 智能手持终端的外接显示控制器及控制方法
CN103453980A (zh) * 2013-08-08 2013-12-18 大连理工大学 一种基于压缩感知的声场参数获取方法
CN103634561A (zh) * 2012-08-21 2014-03-12 徐丙川 会议通信装置和***
CN104168534A (zh) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 一种全息音频装置及控制方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1254972C (zh) * 2004-01-19 2006-05-03 上海交通大学 基于ip网络智能视频内容监控***
CN101001485A (zh) * 2006-10-23 2007-07-18 中国传媒大学 一种有限声源多通道声场***及声场模拟方法
TWI489450B (zh) * 2010-12-03 2015-06-21 Fraunhofer Ges Forschung 用以產生音訊輸出信號或資料串流之裝置及方法、和相關聯之系統、電腦可讀媒體與電腦程式
CN104025461B (zh) * 2011-12-28 2016-02-24 Lg电子株式会社 移动终端
CN103578512B (zh) * 2013-10-18 2016-05-11 三星电子（中国）研发中心 录音快速回放的方法及其装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040151066A1 (en) * 2003-01-14 2004-08-05 Kim Yang Hann Method of visualizing sound fields of individual sound sources using acoustic holography
CN101166377A (zh) * 2006-10-17 2008-04-23 施伟强 一种多语种环绕立体声的低码率编解码方案
CN102637119A (zh) * 2011-11-17 2012-08-15 朱琴琴 智能手持终端的外接显示控制器及控制方法
CN103634561A (zh) * 2012-08-21 2014-03-12 徐丙川 会议通信装置和***
CN103453980A (zh) * 2013-08-08 2013-12-18 大连理工大学 一种基于压缩感知的声场参数获取方法
CN104168534A (zh) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 一种全息音频装置及控制方法

Also Published As

Publication number Publication date
CN104168534A (zh) 2014-11-26

Similar Documents

Publication Publication Date Title
WO2016033919A1 (zh) 一种全息音频录制回放方法
WO2016033918A1 (zh) 一种全息音频装置及控制方法
US11037544B2 (en) Sound output device, sound output method, and sound output system
KR102045600B1 (ko) 이어폰 능동 노이즈 제어
CN104321812B (zh) 在呼叫期间的三维声音压缩及空中发射
US20140050326A1 (en) Multi-Channel Recording
CN112956210B (zh) 基于均衡滤波器的音频信号处理方法及装置
US9967668B2 (en) Binaural recording system and earpiece set
US7921016B2 (en) Method and device for providing 3D audio work
WO2018032587A1 (zh) 一种基于蓝牙的全息声场录音通讯装置及***
JP5697079B2 (ja) 音再現システム、音再現装置および音再現方法
WO2016033920A1 (zh) 一种视频音频采集方法
US20160057527A1 (en) Binaural recording system and earpiece set
WO2016045233A1 (zh) 一种可采集声场信息的通信装置及通信方法
Kearney et al. Design of an interactive virtual reality system for ensemble singing
CN114339582B (zh) 双通道音频处理、方向感滤波器生成方法、装置以及介质
WO2021212287A1 (zh) 音频信号处理方法、音频处理装置及录音设备
US20170094412A1 (en) Wearable recording and playback system
San Martín et al. Influence of recording technology on the determination of binaural psychoacoustic indicators in soundscape investigations
CN206619124U (zh) 一种基于蓝牙的全息声场录音通讯装置、***及外部终端
WO2022178852A1 (zh) 一种辅助聆听方法及装置
JP2005123959A (ja) 高臨場感通信会議装置
San Martín Murugarren et al. Influence of recording technology on the determination of binaural psychoacoustic indicators in soundscape investigations
Costerton A systematic review of the most appropriate methods of achieving spatially enhanced audio for headphone use
Geronazzo et al. The selfear project: a mobile application for low-cost pinna-related transfer function acquisition

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15838903

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03/07/2017)

122 Ep: pct application non-entry in european phase

Ref document number: 15838903

Country of ref document: EP

Kind code of ref document: A1