TW201225696A - Interactive sound playback - Google Patents

Interactive sound playback Download PDF

Info

Publication number
TW201225696A
TW201225696A TW99142232A TW99142232A TW201225696A TW 201225696 A TW201225696 A TW 201225696A TW 99142232 A TW99142232 A TW 99142232A TW 99142232 A TW99142232 A TW 99142232A TW 201225696 A TW201225696 A TW 201225696A
Authority
TW
Taiwan
Prior art keywords
signal
sound
interactive
recording
sound recording
Prior art date
Application number
TW99142232A
Other languages
Chinese (zh)
Inventor
Po-Hsun Sung
Original Assignee
Merry Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Merry Electronics Co Ltd filed Critical Merry Electronics Co Ltd
Priority to TW99142232A priority Critical patent/TW201225696A/en
Publication of TW201225696A publication Critical patent/TW201225696A/en

Links

Landscapes

  • Stereophonic System (AREA)

Abstract

An interactive sound playback comprises two speakers, two microphones, a movement sensor and an audio processor. Two speakers and two microphones are separately disposed at both sides of the interactive sounds playback. The audio processor is electrically connected with two speakers, two microphones and the movement sensor. During a recording mode, the audio processor receives a moving signal from the movement sensor and a first sound signal from the microphones, and saves the first sound signals and the moving signal as a position data. Further during a playing mode, the audio processor outputs the first sound signal to the speakers by a first path or outputs a second sound signal modified by comparing the moving signal and the position data by a second path.

Description

201225696 六、發明說明: 【發明所屬之技術領域】 本發明係有關於-種互動式聲音錄放裝置,特暇揭露一種 利用動作感知而建構而成的互動式聲音錄魏置,隨著配戴者頭 部轉動’同步調整所能感受的立體聲音。 、 【先前技術】 ,在虛擬實境的實踐技術中,目前較為廣泛的應財所謂的擴 增實境Augmented reality (AR)與浸人式虛擬實境immersi〇n vmual reaiity。所擴增實境’就是指「制者在頭部穿戴一種 透明的顯示設備’能_真實世界的場景與電生的影像直接 合成’本質上仍屬某雜殊型式之虛擬實境」。真實場景的融入, 主要的目的是在提昇感知的效果,擴增實境系統中有兩大要素, 是與虛擬實境大列目同的,—是真實場景的物件,因為其複:而 無法7L全用電腦來建構模擬的,而主要目的是在於提昇直實世界 中_任務的執行效果U是真實與虛擬的複合互動。總結 而。擴增貫境具有三大特色:】·它結合虛擬與真實世界;2·能夠 故到即%^生互動;3.在立體環境中運作。 而浸人式虛擬實境與擴增實境的差異性就在於融入性的老 ^所·浸人式虛擬環境,其必馳提供―個完全融入之環境 t使=者在虛擬的空間中’感受到彷彿真實中的環境。因此若垄 聽與、觸=擬,除了創造使用者接受的感覺訊號,如視覺、 :見見:必V頁也要同時考慮到心理學,讓使用者產生幻覺, :法分清楚是細或真實的魏。綠需能涵蓋這錄人 出擬真的人造世界,在技術上是-個複雜的課題。 201225696 灣年代’美國的nasa,執行-個虛擬互動的平台(Virtual Interactive Environment Workstation) 相關技術的研發,過去的虛擬互動技術,主要是以感應人體動作 與3D視覺為主’而搭配聲音的輸出,卿聲音的定位、方向性、 雙耳立體音效喊術為主^在198(M年代,綱犯音效技 術的開發,則隨著電影娛樂、音響技術、3C消費產品等岸用 過去空間聲學與聽覺之研究,制於實際的產品上,如\olby201225696 VI. Description of the Invention: [Technical Field] The present invention relates to an interactive sound recording and playback device, and particularly discloses an interactive sound recording device constructed by using motion perception, with the wearer The head rotates 'synchronously adjusts the stereo sound that can be felt. [Previous technology] In the practice technology of virtual reality, the current widely-available Augmented reality (AR) and the immersive virtual reality immersi〇n vmual reaiity. The augmented reality 'is that the maker wears a transparent display device on the head'. The real-world scene and the electro-generated image are directly synthesized. ‘In essence, it is still a virtual reality of a heterogeneous pattern.” The main purpose of the integration of real scenes is to enhance the perception effect. There are two major elements in the augmented reality system, which are the same as the virtual reality. It is the object of the real scene, because it can not 7L uses the computer to construct the simulation, and the main purpose is to improve the real world _ the execution effect of the task U is the composite interaction between real and virtual. Summary. Amplification has three major characteristics:] It combines virtual and real world; 2. It can interact with %^; 3. Operates in a three-dimensional environment. The difference between the immersive virtual reality and the augmented reality lies in the integration of the old and the immersive virtual environment, which provides a fully integrated environment that makes the person in the virtual space. Feel the environment as if it were real. Therefore, if you listen to, touch, or simulate, in addition to creating a sensory signal that the user accepts, such as visual: see: must also consider the psychology of the V page, let the user have hallucinations, the law is clear or fine Real Wei. Green needs to cover this record. The artificially artificial world is technically a complex subject. 201225696 Bay years 'Nasa of the United States, the implementation of a virtual interactive platform (Virtual Interactive Environment Workstation) related technology research and development, the past virtual interactive technology, mainly inductive body movements and 3D vision-based with the output of sound, Qing sound positioning, directionality, binaural stereo sounds are mainly based on 198 (M era, the development of the sound technology of the guilty, along with the movie entertainment, sound technology, 3C consumer products, etc. Research, based on actual products, such as \olby

Laboratory、DTS、SRS等。而這些技術’亦可應用於虛擬實 多媒體播放’結合3D顯示技術與聲道、^聲道甚至是最新 = 11.1聲逞’使用者可在具這些設備_放環境巾,體驗虛擬實 境的3D音場感受。然而但透過這樣技術所實踐的虛擬環境,仍然 屬於被動式的較,使財雖有身歷魏_官歧,但 與其進行互動。 — 在互動的技術上,軸已魏間遊錢大赫出互動式的遊 戲機台’而可透過感應使用者的動作來實踐藉由人體動作與 互動的感覺,不過在其應用鱗場魏建置上,即使可連么士多: 道_出,仍屬於實_魏立麟,其所輸出的聲音^無法 跟著使用者的頭部方向轉動進而調整犯音場的成像,使用者還^ 可以區隔真f環紗互動遊朗音場環境,因此尚無法非常擬= 的融入於遊戲當中。 一 【發明内容】 隨===== 201225696 所能感受到的立體聲音。 緣疋,為達上述目的,本發明之互動式聲音錄放裒置係包括 有二,聲器、二麥克風、—動作感測器及一影音處理裝置,其中 -揚聲器及二麥克風皆設置於互動式聲音錄放裝置之兩側,而影 音處理裝置係m連接於二揚聲器、二麥克風及動作感測器,且 =音處理裝置具有-錄製模式及—触減,在錄製模式下,影 音,理接收由動作感測||之-動作感觀號及二麥克風之 一第-聲音喊,並f轉第—聲音峨及將動作感測訊號儲存為 -位置#訊’而在播放模式下,影音處理裝置即直接透過一第一 路徑輸出第-聲音職至二揚聲賴放,或者透過—第二路徑參 考動作感測訊號及位置資訊而調整_第二聲音訊號後再輸出至^ 揚聲器播放。 為達上述目的’本發明之互動式聲音錄放裝置更包括有 影,電性連接於影音處理裝置,_得以應胁浸人式虛擬實境 綜合上述,本發明與習知技術相比之下,其係在使用 言ί置有麥克取直接儲存聲音,因此可以在—第―模式下錄製产 i兄聲音,亚在第二模式下重現鱗音至科賴聲器1甚 =依據兩模式下使用者頭部位置的不同而調整重現的聲音: 疋再彳合配包括了攝影機之擴增實境系統而整合於一裝置上,右 即_1針對擴增貫境的處理技術提升至浸人式虛擬實境,同時顯7 =影像縣受讀聲音絲,而緖供給使用者最佳的擬真= 【實施方式】 以下將參照相關圖式,說明依據本發日月各種較佳實施例所呈 6 201225696 現之互動式聲音錄放裝置。 九凊參照第1圖所示,為本發明互動式聲音錄放裝置之應用示 意圖。在此應用例當中,互動式聲音錄放裝置係實施為主體為一 見10之、”。構’眼鏡1Q包括有—鼻架U,以及由鼻架U兩側延 4出的_鏡框12,以及由二鏡框12延伸出的二鏡㈣^,且二鏡 框12上分別嵌入有一鏡片14。 互動式聲曰錄放裝置另包括有二揚聲器如、二麥克風如、一Laboratory, DTS, SRS, etc. And these technologies can also be applied to virtual real multimedia playback 'combined with 3D display technology and channel, ^ channel and even the latest = 11.1 sonar' users can use these devices _ put environmental towel, experience virtual reality 3D Sound field experience. However, the virtual environment practiced through such technology is still a passive one, so that although the wealth has a reputation, it interacts with it. — In terms of interactive technology, the axis has moved between the Wei and the West to create an interactive game console' and can sense the movement and interaction of the human body by sensing the user's movements, but in its application scale Wei Wei Put it on, even if you can connect with a lot of people: Road _ out, still belongs to the real _ Wei Lilin, the sound ^ output can not follow the direction of the user's head to adjust the imaging of the sound field, the user can also be separated The real f-loop yarn interacts with the sound field environment, so it is not possible to integrate it into the game. A [Summary of the Invention] The stereo sound that can be felt with ===== 201225696. In order to achieve the above objective, the interactive sound recording and playback device of the present invention comprises two sounders, two microphones, a motion sensor and a video processing device, wherein the speaker and the two microphones are all arranged in an interactive manner. The two sides of the sound recording and reproducing device are connected to the two speakers, the two microphones and the motion sensor, and the sound processing device has a recording mode and a touchdown. In the recording mode, the video and audio are received by the sound recording device. Motion sensing||-the action sense number and one of the two microphones - the voice yells, and f turns the first - the sound 峨 and stores the motion sensing signal as - position # 讯', and in the play mode, the audio processing device That is, the first sound path is directly outputted through a first path, or the second sound signal is adjusted through the second path reference motion sensing signal and position information, and then output to the ^ speaker. In order to achieve the above object, the interactive sound recording and reproducing device of the present invention further includes a shadow and is electrically connected to the audio-visual processing device, and the present invention is compared with the prior art. It uses the microphone to directly store the sound, so you can record the production of the sibling sound in the -first mode, and the sub-reproduce the scale sound in the second mode to the Kolei 1 even according to the two modes. The reproduced sound is adjusted by the position of the user's head: 疋 彳 配 包括 包括 包括 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影 摄影Human virtual reality, at the same time, 7 = image county, the sound is read, and the user provides the best simulation of the user = [Embodiment] Hereinafter, various preferred embodiments according to the present day and month will be described with reference to the related drawings. Presented 2012 20126696 The interactive sound recording and playback device. The reference to Fig. 1 is a schematic view of the application of the interactive sound recording and reproducing device of the present invention. In this application example, the interactive sound recording and playback device is implemented as a main body, and the frame 1Q includes a nose frame U, and a frame 12 extending from both sides of the nose frame U, and The two mirrors 12 extend out of the two mirrors (four) ^, and the two mirror frames 12 are respectively embedded with a lens 14. The interactive sonar recording and recording device further includes two speakers, such as two microphones, one

別白感測°。4〇及一影音處理裝置,二揚聲器20與二麥克風30 ^ η 13之中段延伸設置,而動作感測器40係嵌設於鼻弈 11允:曰處理装置可貫施為一晶片結構而組設於鏡腳13或鼻奔 測哭^ί刀別電性連接於二揚聲器2〇、二麥克風30及動作1 护 〜3處理裝置設計具有兩鶴倾式,當於-錄製模3 I舞立由動作感測器4〇之—動作感測訊號及二麥克風30之- 位訊號,⑽存第—聲音贼及將動作制減儲存為— 聲—播賴式時,影音處理裝置敍接輸出第- 20^1 播:。貝而調整—第二聲音訊號後再輸出至該二揚聲器2Don't feel white. 4〇 and a video processing device, the two speakers 20 and the two microphones 30 ^ η 13 are extended, and the motion sensor 40 is embedded in the nose 11: the processing device can be applied as a wafer structure Set on the temples 13 or nose test crying ^ 刀 knife is electrically connected to the two speakers 2 〇, two microphones 30 and action 1 Guard ~ 3 treatment device design with two crane tilt, when - recording mode 3 I dance By the action sensor 4, the action sensing signal and the second microphone 30-bit signal, (10) the storage-sound thief and the action reduction are stored as - the sound-broadcast type, the audio-visual processing device is connected to the output - 20^1 broadcast:. Adjusted to the second sound signal and then output to the second speaker 2

儀等感—4〇例如可以實施為三轴加速度計或是R 心述生而_ 獨設晴1Q之瓣式外,心 201225696 本發明互動式聲音錄放裝置另外 於鼻架u上,藉由攝影機50所有設置 線傳輸的方式將稽案傳送至具有择麻理=,(傳輸或無 處H城理產生—立體晝面而呈現在鏡片 片14細明。另外,透過擴增實境處理二二 也y以疋在+透明的鏡片14上顯示與所視 一來即可與所視目標的晝面疊加在一起。 ,貝4如此 在此另要補充說明的是,本發明 第】圖般整合在眼鏡H)上以外,置=如 手機、個人數位助理或個人攝影機 =如冬_ 表古® «心“、 僻如機寺裝置上’而二揚聲器20、二 ^風30及動作感測器4G可以整合在—耳機上以 ==機載上時’二揚聲器2〇及二麥克風心是: 是額頭=:::而動作感測器4。_在頭頂㈣央處或 r2參閱第2圖’為本發明互動式聲音錄放裳置於錄製 作5兄明圖。®中所示’當使用者將第1圖中之眼鏡10戴 人旁够歧3G分職彳_魏之聲音,而此種收 " ^^^^#t(Head-Iated transfer ^ίοη,ΗΚΤρ} 別透^放大克風3G所接收的聲音訊號係分 送至影音處理裝置6〇,且解析儲存為一左 感知產峰:一叙*道聲曰Λ號’在此同時’動作感測器40所 7_ΑΛ it作感測訊號係傳送至一類比數位轉換器 理農置6。,且在影音處理裝置6”=; ttr 在此另須說明的是,攝影機如此時亦同步 —象’亚將‘虎直接傳送至影音處理裝置6〇解析儲存,以方⑸ 8 201225696 便再透過有線傳輸或無線傳輸的彳 處理功能之_或數位處理器。W傳拉具有擴增實境 此處另須說明的是,在錄製模式下,使 + 的感知而使得身體及頭部的位置有境 .幻0與動作感測器4〇兩者所產生之 克 裝置60當中,曰πΒ士4说丁— 7且加储存於影音處理 訊, 模式之動肢動絲讀放裝置於播放 】、ί = _音效,那麼影音處理裝置60可以選 ;=;:左聲道聲音訊號及右聲道聲音訊號直接藉由二 的揚聲器%〇 ’再傳送至左、右耳 為原本左聲迢耸音訊號及右聲道聲音邙骑士 彳= 號,因_者 揚釆°° 2〇中所聽到的即為立體的聲音。 广第= 卜立影音處理裝置60亦可選漏放一第二聲音訊號,而此 聲日訊賴如可以是由—外部裝置11G所產生,或$ 二rm6G所喊,此處影音處理裝置⑼可以選擇透過‘ 二:聲道聲音訊號及右聲道聲音訊號先藉由—第二路徑而傳 ,到:触紐賴器91_)職為餘喊,再送至數位訊號 二,9〇處理,而後再送至數位類比轉換器92(D/A)轉換為類二 聲:訊號’經放大器81放大處理後,再傳送至左、右耳的揚聲器 …此,式之下’數位訊號處理器9〇更接收一比較訊號,此比較 ^虎乃疋藉由連接縣作❹彳11 4G與影音處贿置60之間的比 U3:斤达出‘’且此處比較器93係分別接受來自動作感測器卯 於播放拉式下所制的動傾職號,以及來自影音處理裝置⑼η 9 201225696 由夕部裝置no所送蚊—位£資訊,當數位喊處理器如接收 ,較訊號後,係可來自影音處理裝置⑹所輸出的聲音訊號, 最後再傳送至左、右耳的揚聲器20。 … —舉例來5兒,當使用者身處於眼前有汽車跌過的環境時,可以 先藉由二麥克風3〇將汽車經過時的聲音錄製起來,由於記錄在^ 音處理裝置6〇中的左聲道聲音訊號及右聲道聲音訊號本身即為^ 包含有人·函數(HRTF)效應的聲音減,因此使用者可以直接 透過第—路徑從揚聲器㈤中重現汽車經過的立體聲音;另一方 面’影音處理裝置60可以接受例如是電子遊樂器之外部裝置所送 入之聲音訊號及位置,麵戲#中本身即已具有不同位 所對應的聲音訊號,而#數位訊號處理器⑻接收使用者頭部轉動 後產生之動作制職後,即可對應變更聲音魏的空 使用者能更融人於遊戲的空間敍#巾,因此使 二 下所聽到的聲音職財更受。 路^Sense of the instrument - 4 〇 can be implemented as a three-axis accelerometer or R heart _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 50 All the way to set the line transmission will be transmitted to the selected case = (transmission or nowhere H Chengli produced - stereo faceted and presented in the lens sheet 14 in detail. In addition, through the augmented reality processing 22 y is displayed on the + transparent lens 14 and can be superimposed on the face of the object to be viewed. The shell 4 is also added here, and the present invention is integrated in the first embodiment. Outside the glasses H), set = such as mobile phones, personal digital assistants or personal cameras = such as winter _ _ ancient - «Heart", secluded temple on the device 'and two speakers 20, two wind 30 and motion sensor 4G Can be integrated on the headset to == onboard when the 'two speakers 2 〇 and two microphone hearts are: is the forehead =::: and the motion sensor 4. _ at the top of the head (four) or r2 see Figure 2' For the interactive sound recording and playback of the present invention, it is placed in the recording of the 5 brothers. The glasses in Figure 1 are worn by people. 3G is divided into 彳 _ wei's voice, and this kind of income "^^^^#t(Head-Iated transfer ^ίοη, ΗΚΤρ} Do not see through the magnifying 3G The received sound signal is sent to the audio-visual processing device 6〇, and the analysis and storage are stored as a left-sensing peak: a narration channel 曰Λ ' ' at the same time' motion sensor 40 7_ΑΛ it as a sensing signal It is transmitted to a kind of analog-to-digital converter, and in the audio-visual processing device 6"=; ttr, it should be noted that the camera is also synchronized at this time - like the 'Asian' tiger directly transmitted to the audio-visual processing device 6〇 parsing storage, the side (5) 8 201225696 will then pass the wired transmission or wireless transmission of the 彳 processing function _ or digital processor. W pass pull has augmented reality here, it should be noted that in the recording mode, The perception of + makes the position of the body and the head come into being. Among the gram devices 60 generated by both the illusion 0 and the motion sensor 4, 曰πΒ士4 says 丁-7 and is stored in the video processing signal. The mode of the limb-moving wire reading and reproducing device is played, ί = _ sound effect, then the audio-visual processing device 60 Select;=;: The left channel sound signal and the right channel sound signal are directly transmitted to the left and right ears by the second speaker %〇' to the left and right ear sounds and the right channel sound 邙 彳 = No., because the _ 釆 釆 ° ° ° ° hear what is heard in the three-dimensional sound. Guangdi = Bu Li audio and video processing device 60 can also choose to miss a second sound signal, and this sound can be It is generated by the external device 11G, or by the two rm6G. Here, the audio processing device (9) can choose to transmit through the second path through the 'two: channel sound signal and the right channel sound signal. The new lais 91_) is shouted, then sent to the digital signal 2, 9 〇 processing, and then sent to the digital analog converter 92 (D / A) converted to the second sound: the signal 'amplified by the amplifier 81, then transmitted To the left and right ear speakers... This, below the 'digital signal processor 9', receives a comparison signal, this comparison ^ Tiger is connected between the county for 11 4G and the video between the 60 Than U3: Jinda out '' and here the comparator 93 is accepted from the action sensor to play The slogan number produced under the formula, and the information from the audio-visual processing device (9) η 9 201225696 by the eve device no-station information, when the digital screaming processor receives, after the signal, it can come from the audio-visual processing device (6) The output audio signal is finally transmitted to the speaker 20 of the left and right ears. ... - For example, when the user is in an environment where the car is in front of the car, the sound of the car passing through the second microphone can be recorded first, because it is recorded in the left side of the sound processing device 6〇 The channel sound signal and the right channel sound signal are themselves reduced by the sound containing the human function (HRTF) effect, so the user can directly reproduce the stereo sound of the car through the first path through the first path; The audio-visual processing device 60 can accept an audio signal and a location that is sent by an external device such as an electronic game instrument. The video game itself has an audio signal corresponding to a different bit, and the # digital signal processor (8) receives the user. After the action of the head is turned, the user who can change the sound of Wei can be more immersed in the space of the game, so that the sound of the second voice is more affected. Road ^

處理放模式下,攝影機5G所之影像即可由影音 、理破置60產生一立體畫面至—顯 ,,B 以送至具有擴增實境處理;能之電腦或;:處== 中聽到立體音效。_,時從二揚聲器 電腦螢幕時,那麼立體音效====實,記型 乍為輸出,其產生立齡奴效料耳时 運算,在此即不另作贅述。 聿。己u匈内抑式另作 另須補充的是,本發明互動絲音錄 —微型投影機’例如安裝在第丨_ 、置,另外增設 、見上,如此一來,上述立[s 201225696 體畫面亦可透過微型投影機而投射至牆面或布幕,而有較大晝面 的顯示。 ~ 接著’請參閱第4圖所示’為本發明互動式聲音錄放裝置中 數位訊號處理器之内部電路示意圖。如圖所示,數位訊 哭 90中包括有複數個數位濾波器94、複數個時間差運算處理°器95二 複數個音量差運算處理器96、複數個人頭權函數運算處理器97、 一動作感測電路98及複數個加法器99,其中左聲^立: 聲道聲音訊號傳送到一類比數位轉換器91轉換後,係二別送°入至 # 該些數位濾波器94作滤波處理,例如左聲道聲音訊號就傳送到對 應的兩健位濾波器94,且其中-個數位濾波器94所處理後的訊 號係傳送至-加法器99,另-個數位濾、波器如所處理後的訊號則 Ϊ达至另一加法器"’而每一個疊加左、右聲道聲音訊號的加法 器94係可將訊號再傳送至對應的時間差運算處理器%、音量差運 算處理器96、人頭權函數運算處理器97 ,另外,^較^依據 當下使用者頭部轉動所傳來的動作感測訊號及影音處理裝置⑻所 輸出之位置資輯產生的比較訊酬傳送至動域測電路%,經 鲁,動作感測電路98處理更新一動作感測參考值後,再分別傳送至時 間差運算處理器95、音量差運算處理器96、人頭權函數運算處理 器97,因此得以調整來自影音處理裝置6〇所輪出的聲音訊沪,而 能調整左、右聲道聲音訊號的時間相位及音量大小,並且能加入 人頭權函數之計算處理,而使得最後輸出的左、右聲道聲音訊號 在使用者左、右耳揚聲器20播放時,能具有立體擬真效果。 綜合上述,本發明絲錢音職裝置_在賴者兩耳設 置有麥克取直麟存聲音’ 0此可峰—帛—模灯錄製當時 的環境聲音,並在第二模式下重現該聲音至兩耳旁之揚聲器:且 甚至可以依據兩模式下使用者頭部位置的不同而調整=的聲⑸ 201225696 音,隨著使用者頭部的擺動而模擬調絲音音場的變化,因而具 有立擬真之效果’喊配包括攝影機之擴增實境祕而整合於 j置上雜即可針對擴增實境的處理技術提升至浸入式虛擬 =兄=僅在aΦ上具有立體影像,也可以整合加人立體聲音效 ,而技供給使用者最佳的擬真實境。 之梦、僅為舉嫌,而料關性者。任何未麟本發明 :==對其進行之等效修改或變更,均應包含於後附 【圖式簡單說明】 =圖為本發明互動式聲音錄放裝置之應用示意圖; 3本發日歧賦聲音觀裝狀職 明互動式聲音錄放裝置於播放模式之動:: 弟4圖為 動絲錢魏置中餘職處㈣之内和 【主要元件符號說明】 10 眼鏡 12鏡框 14鏡片 30麥克風 50攝影機 70類比數位轉換器 80切換器 11鼻架 13 鏡腳 20 揚聲器 40 動作感測器 60 影音處理裝置 71 放大器 81 放大器 201225696 90 數位訊號處理器 91 類比數位轉換器 92 數位類比轉換器 93 比較器 94 漉波器 95 時間差運算處理器 96 音量差運算處理器 97 人頭權函數運算處理器 98 動作感測電路 99 加法器 100 顯示屏 110 外部裝置In the processing mode, the image of the 5G camera can generate a stereoscopic image from the audio and video, and the B is sent to the Augmented Reality; the computer can be heard; Sound effects. _, when from the second speaker computer screen, then the stereo sound effect ==== real, the record type is the output, which produces the calculation of the age-old slave effect ear, here is no further description. Hey. In addition, it is necessary to add that the interactive silk recording-micro projector of the present invention is installed, for example, in the third 、, and is additionally added and seen, so that the above-mentioned standing [s 201225696 body] The screen can also be projected onto a wall or screen through a pico projector, with a larger faceted display. ~ Next, please refer to FIG. 4, which is a schematic diagram of the internal circuit of the digital signal processor in the interactive sound recording and reproducing device of the present invention. As shown in the figure, the digital crying 90 includes a plurality of digital filters 94, a plurality of time difference arithmetic processors 95, a plurality of volume difference arithmetic processors 96, a plurality of personal head weight function arithmetic processors 97, and a sense of motion. The measuring circuit 98 and the plurality of adders 99, wherein the left sound: the channel sound signal is transmitted to an analog converter 91, and the two digits are sent to the digital filter 94 for filtering, for example, left. The channel sound signal is transmitted to the corresponding two-station filter 94, and the signal processed by the digitizer 94 is transmitted to the adder 99, and the other digital filter is processed. The signal reaches the other adder "' and each adder 94 that superimposes the left and right channel audio signals can transmit the signal to the corresponding time difference operation processor %, the volume difference operation processor 96, and the person The head weight function operation processor 97 is further configured to transmit the comparison signal generated by the current user's head rotation and the position information output by the video processing device (8) to the dynamic field measurement circuit. %,through After the motion sensing circuit 98 processes and updates the motion sensing reference value, it is transmitted to the time difference operation processor 95, the volume difference operation processor 96, and the head weight function operation processor 97, thereby being adjusted from the video processing device 6. The sound that is rotated by the squad is used to adjust the time phase and volume of the left and right channel sound signals, and can be added to the calculation process of the human head weight function, so that the last output left and right channel sound signals are When the user's left and right ear speakers 20 are played, they can have a stereoscopic effect. In summary, the silk money sound device of the present invention has a microphone to capture the sound of the sound in the ears of the stalker, and the sound is recorded in the second mode, and the sound is reproduced in the second mode. Speakers to both ears: and even according to the position of the user's head in the two modes, the sound of the sound is changed (5) 201225696, which simulates the change of the sound field with the swing of the user's head. The effect of the original simulation 'calling with the camera's augmented reality secret and integrated into j set up can be raised to the immersive virtual processing technology for augmented reality = brother = only stereo image on aΦ, also It can integrate the stereo sound effect, and the technology provides the user with the best real world. The dream is only for the sake of suspicion. Any unexperimented invention: == Equivalent modification or modification of the invention shall be included in the attached [Simplified description of the schema] = diagram is the application diagram of the interactive sound recording and playback device of the present invention; The sound view of the installation of the Ming and Qing dynasty interactive sound recording and playback device in the play mode:: Brother 4 picture for the dynamic silk money Wei set in the remaining positions (four) and [main symbol description] 10 glasses 12 frame 14 lens 30 microphone 50 Camera 70 analog-to-digital converter 80 switcher 11 nose frame 13 mirror foot 20 speaker 40 motion sensor 60 audio and video processing device 71 amplifier 81 amplifier 201225696 90 digital signal processor 91 analog digital converter 92 digital analog converter 93 comparator 94 Chopper 95 Time Difference Operation Processor 96 Volume Difference Operation Processor 97 Head Weight Function Operation Processor 98 Motion Sensing Circuit 99 Adder 100 Display 110 External Device

Claims (1)

201225696 七、申請專利範圍: 1.一種互動式聲音錄放裝置,其包括有: 一揚聲态,設置於該互動式聲音錄放裝置之兩側; -麥克風,設置於該互動式聲音錄放裝置之兩側,並錄製一第 一聲音訊號; -動作感測器’偵測使用者綠移動而產生—動作感測訊號; -影音處理裝置,電性連祕該二麟器、該二麥克風及該動 作感測器,且郷音處縣置具有兩讎作模式: -錄製模式’接收由該動域測訊號及該第—聲音訊號,並 儲存該第一聲音訊號及將該動作感測訊號儲存為一位置資 訊; 一播放模式,由該影音處理裝置透過一第一路徑直接輸出該 弟:聲音訊號至該二揚聲器播放,或者透過一第二路捏參 考搞作感測訊號及該位置資訊而調整一第二聲音訊號後 再輸出至該二揚聲器播放。 專利减第1項所述之互動式聲音錄放裝置,其中該第二 ^曰訊號係由-外輕置產生而輸人至該影音處理裝置。 蓉立明專利耗圍第1項所述之互動式聲音錄放裝置,其中該第二 聲曰訊號係内建於該影音處理裝置。 利驰圍第2項所述之互動式聲音錄放裝置,其中該外部 =置更提供-外部位置資訊以取代錄製模式下產生之該位置資 申明專利乾圍第!項所述之互動式聲音錄放裝置,其中該動作 感^、係透過—類崎位賴如轉換鞠減測訊號。 μ專利乾圍第1項所述之互動式聲音錄放裝置,其中該影音… 201225696 處理裝置接收該第一聲音訊號後,係分別解析儲存為一左聲道 聲音訊號及一右聲道聲音訊號。 7.如申請專利範圍第1項所述之互動式聲音錄放裝置,其中更包括 有一比較器電性連接在該影音處理裝置及該動作感測器之間, 其係於比較該動作感測訊號及該位置資訊後輸出一比較訊號至 一數位訊號處理器,且該數位訊號處理器同時接收由該影音處 理裝置輸出之該第二聲音訊號,經與該比較訊號處理後調整輸 出。 # 8.如申請專利範圍第7項所述之互動式聲音錄放裝置,其中該數位 號處理器包括加入人頭權函數運算處理器。 9.如申請專利範圍第7項所述之互動式聲音錄放裝置,其中該數位 sfl號處理益包括加入時間差運算處理器。 10·如申請專利翻第7項所狀互動式聲音雜裝置,其中該數 位訊號處理器包括加入音量差運算處理器。 11·如申請專利範圍第7項所述之互動式聲音錄放裝置,其中該數 位訊號處理器包括—動作感測電路以即時更新一動作感測參考201225696 VII. Patent application scope: 1. An interactive sound recording and playback device, comprising: a raised sound state disposed on two sides of the interactive sound recording and playback device; - a microphone disposed on the interactive sound recording and playback device Side, and recording a first sound signal; - motion sensor 'detects user green movement to generate - motion sensing signal; - video processing device, electrical connection to the two devices, the two microphones and the action The sensor, and the county has two modes of operation: - the recording mode 'receives the motion signal and the first sound signal, and stores the first sound signal and stores the motion sensing signal as a positional information; a playback mode, the audio processing device directly outputs the brother through a first path: the audio signal is played to the two speakers, or is adjusted by using a second way pinch reference signal and the position information After the second audio signal is output to the two speakers for playback. The interactive sound recording and reproducing device of claim 1, wherein the second signal is generated by the external light and is input to the audio processing device. The interactive sound recording and reproducing device according to the first aspect of the invention, wherein the second acoustic signal is built in the audio processing device. The interactive sound recording and reproducing device described in item 2 of Li Chi Wai, wherein the external = set provides external location information to replace the position generated in the recording mode. The interactive sound recording and reproducing device according to the item, wherein the action sense is transmitted through a class-like-like position conversion signal. The interactive sound recording and reproducing device according to the first aspect of the invention, wherein the processing device receives the first sound signal, and separately analyzes and stores the left sound signal and the right channel sound signal. 7. The interactive sound recording and reproducing device according to claim 1, further comprising a comparator electrically connected between the audio processing device and the motion sensor, wherein the action sensing signal is compared And outputting a comparison signal to the digital signal processor, and the digital signal processor simultaneously receives the second audio signal output by the audio processing device, and adjusts the output after being processed by the comparison signal. 8. The interactive sound recording and reproducing device of claim 7, wherein the digital processor comprises a human head function computing processor. 9. The interactive sound recording and reproducing device according to claim 7, wherein the digital sfl number processing benefit comprises adding a time difference operation processor. 10. If the patent application is turned over, the interactive sound mixing device of the seventh item, wherein the digital signal processor includes a volume difference arithmetic processor. 11. The interactive sound recording and reproducing device according to claim 7, wherein the digital signal processor comprises an action sensing circuit for updating an action sensing reference in real time. 乂古 Λ \ 12.如申請專利範圍f 7項所述之互動式聲音錄放裝置,其中該數 位訊號處理器係由—類位數位轉換器接收訊號,並輸出至一數 位類比轉換器轉換後提供該聲音訊號。 13^°申請專利範_ 1項所狀互動式聲音錄放裝置,其中該影 =裝置更電性連接有一攝影機及一顯示屏,在該錄製模式 下藉由4攝影機錄製之影像,係可於該播放 理裝置產生-立體晝面於該顯示屏上。 〜曰處 14_如申%專她®第1項所狀互動式聲音賊裝置,其中談與 a處理裳置更電性連接有—攝影機及-微型投f彡機,在該錄製 201225696 模式下藉由該攝影機錄製之影像,係可於該播放模式下由該影 音處理裝置產生一立體晝面,並藉由該微型投影機將該立體晝 面投射出。 15.如申請專利範圍第1項所述之互動式聲音錄放裝置,其中該動 作感測器為一三軸加速度計或一陀螺儀。乂古Λ \ 12. The interactive sound recording and reproducing device according to claim 7, wherein the digital signal processor receives the signal by the class-like bit-bit converter and outputs the signal to a digital-to-digital converter. The sound signal. 13^°Application Patent Model _ 1 interactive voice recording and playback device, wherein the shadow device is more electrically connected to a camera and a display screen, and the image recorded by the 4 camera in the recording mode is The playback device generates a stereoscopic surface on the display. ~ 曰 曰 14 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ The image recorded by the camera can generate a stereoscopic surface by the audio processing device in the play mode, and the stereoscopic surface is projected by the pico projector. 15. The interactive sound recording and reproducing device according to claim 1, wherein the motion sensor is a three-axis accelerometer or a gyroscope.
TW99142232A 2010-12-03 2010-12-03 Interactive sound playback TW201225696A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW99142232A TW201225696A (en) 2010-12-03 2010-12-03 Interactive sound playback

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW99142232A TW201225696A (en) 2010-12-03 2010-12-03 Interactive sound playback

Publications (1)

Publication Number Publication Date
TW201225696A true TW201225696A (en) 2012-06-16

Family

ID=46726272

Family Applications (1)

Application Number Title Priority Date Filing Date
TW99142232A TW201225696A (en) 2010-12-03 2010-12-03 Interactive sound playback

Country Status (1)

Country Link
TW (1) TW201225696A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015169124A1 (en) * 2014-05-08 2015-11-12 制约智能机械人(Sir)(香港)有限公司 Terminal sound mixing system and playing method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015169124A1 (en) * 2014-05-08 2015-11-12 制约智能机械人(Sir)(香港)有限公司 Terminal sound mixing system and playing method
JP2017520139A (en) * 2014-05-08 2017-07-20 サブ−インテリジェンス ロボティクス(エスアイアール) コーポレーション(ホンコン) リミテッド Endpoint mixing system and reproduction method thereof

Similar Documents

Publication Publication Date Title
US20120207308A1 (en) Interactive sound playback device
JP7275227B2 (en) Recording virtual and real objects in mixed reality devices
KR102197544B1 (en) Mixed reality system with spatialized audio
US10816807B2 (en) Interactive augmented or virtual reality devices
JP6923245B2 (en) Audience-based haptics
US20180123813A1 (en) Augmented Reality Conferencing System and Method
JP7408678B2 (en) Image processing method and head mounted display device
JP5992210B2 (en) Information processing program, information processing apparatus, information processing system, and information processing method
WO2018100800A1 (en) Information processing device, information processing method, and computer program
JP6017854B2 (en) Information processing apparatus, information processing system, information processing method, and information processing program
US9420392B2 (en) Method for operating a virtual reality system and virtual reality system
JP7165215B2 (en) Virtual Reality, Augmented Reality, and Mixed Reality Systems with Spatialized Audio
CN107277736A (en) Simulation System, Sound Processing Method And Information Storage Medium
US11806621B2 (en) Gaming with earpiece 3D audio
TW201228332A (en) Mobile electronic device
JP2016045814A (en) Virtual reality service providing system and virtual reality service providing method
WO2018101279A1 (en) Information processing device, information processing method, and computer program
JP6613429B2 (en) Audiovisual playback device
TW201225696A (en) Interactive sound playback
CN102568535A (en) Interactive voice recording and playing device
EP4080907A1 (en) Information processing device and information processing method
Higa et al. A two-by-two mixed reality system that merges real and virtual worlds in both audio and visual senses
JP2020025275A (en) Video and audio reproduction device and method
JP2020181123A (en) Karaoke rendition system
WO2022209129A1 (en) Information processing device, information processing method and program