TWI382401B - Interactive video playing system and method - Google Patents

Interactive video playing system and method Download PDF

Info

Publication number
TWI382401B
TWI382401B TW98140002A TW98140002A TWI382401B TW I382401 B TWI382401 B TW I382401B TW 98140002 A TW98140002 A TW 98140002A TW 98140002 A TW98140002 A TW 98140002A TW I382401 B TWI382401 B TW I382401B
Authority
TW
Taiwan
Prior art keywords
interactive
video
audio
music
animation
Prior art date
Application number
TW98140002A
Other languages
Chinese (zh)
Other versions
TW201118855A (en
Inventor
Jui Wei Ho
Jen Yu Wu
Kun Da Wu
Guo Zua Wu
Yueh Lun Lee
Hao Hsiang Yu
Yun Hung Cheng
Original Assignee
Ind Tech Res Inst
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ind Tech Res Inst filed Critical Ind Tech Res Inst
Priority to TW98140002A priority Critical patent/TWI382401B/en
Publication of TW201118855A publication Critical patent/TW201118855A/en
Application granted granted Critical
Publication of TWI382401B publication Critical patent/TWI382401B/en

Links

Landscapes

  • Reverberation, Karaoke And Other Acoustics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Description

互動式影音播放系統及方法Interactive video and audio playback system and method

本發明是有關於一種互動式影音播放方法及系統,且特別是有關於一種應用於Karaoke的互動式影音播放方法及系統。The invention relates to an interactive video and audio playing method and system, and in particular to an interactive video and audio playing method and system applied to Karaoke.

音樂伴唱系統,一般通稱為Karaoke,可讓使用者在無他人伴奏的情況下,點播相關的歌曲並進行演唱。The music accompaniment system, commonly known as Karaoke, allows users to order and sing related songs without the accompaniment of others.

已知的作法之一是在伴唱系統中設置一種評分裝置。但此評分裝置並不是真正地去評分歌唱者的歌聲品質,只是作為趣味的一個目的而在歌曲結尾的時候,顯示出一種高分範圍內的亂數。One of the known practices is to provide a scoring device in the accompaniment system. However, this scoring device does not really score the vocal quality of the singer, but as a purpose of interest, at the end of the song, it shows a random number in the high score range.

專利I282970提出一種Karaoke計分方法,可確實對歌唱者的歌唱能力給予評分。但這也只是在歌曲結尾最後,顯示出一個較有意義的分數。在整個演唱的過程中,使用者和播放的影音內容幾乎沒有任何互動。Patent I282970 proposes a Karaoke scoring method that reliably scores the singer's singing ability. But this is only at the end of the song, showing a more meaningful score. Throughout the singing process, the user and the audio and video content played have almost no interaction.

本發明在提供一種互動影音播放系統及方法,可依歌唱者歌聲之品質控制互動節目的播出內容。The present invention provides an interactive video and audio playback system and method for controlling the broadcast content of an interactive program according to the quality of the singer's voice.

本發明提供一種互動式影音播放系統,包括:資料庫單元、樂聲評分單元、及影音處理單元。資料庫單元,包括主節目動畫資料庫、互動節目動畫資料庫、標準樂聲特徵檔。主節目動畫資料庫包括主節目影音內容,且互動節目動畫資料庫包括多個互動影音內容。樂聲評分單元,接收從資料庫單元而來的標準樂聲特徵檔,並接收從使用者而來的標的樂聲,擷取標的樂聲的特徵,並比較標準樂聲特徵檔與標的樂聲的特徵,作成對標的樂聲的評價並輸出。影音處理單元,連接至資料庫單元,及樂聲評分單元,包括主節目動畫處理部、互動節目動畫處理部、以及疊加器。其中主節目動畫處理部,包括第一影音解碼器,對主節目影音內容進行解碼並輸出至疊加器。互動節目動畫處理部,包括第二影音解碼器、以及互動節目選擇器。其中互動節目選擇器根據樂聲評分單元所輸出的評價,從多個互動影音內容中選擇一互動影音內容,傳送到第二影音解碼器進行解碼並輸出至疊加器。疊加器,接收第一影音解碼器所輸出的主節目影音內容,及第二影音解碼器所輸出的互動影音內容,進行疊加之後輸出。The invention provides an interactive video and audio playback system, comprising: a database unit, a music score unit, and a video processing unit. The database unit includes a main program animation database, an interactive program animation database, and a standard music sound profile. The main program animation database includes the main program audio and video content, and the interactive program animation database includes a plurality of interactive audio and video content. The music sound scoring unit receives the standard music feature file from the database unit, receives the target music sound from the user, captures the characteristics of the target music sound, and compares the standard music sound feature with the target music sound The characteristics of the target are evaluated and output. The audio processing unit is connected to the database unit and the music sounding unit, and includes a main program animation processing unit, an interactive program animation processing unit, and an adder. The main program animation processing unit includes a first video decoder that decodes the main program video content and outputs it to the adder. The interactive program animation processing unit includes a second video decoder and an interactive program selector. The interactive program selector selects an interactive video content from the plurality of interactive audio and video content according to the evaluation output by the music sound scoring unit, and transmits the content to the second video decoder for decoding and outputting to the adder. The superimposer receives the main program audio and video content output by the first video decoder and the interactive video and audio content output by the second video decoder, and outputs the content after superimposition.

本發明還提供一種互動式影音播放方法,包括下述步驟:載入主節目影音內容,其中主節目影音內容包括背景音樂檔、載入標準樂聲特徵檔,根據標準樂聲特徵檔及背景音樂檔的音量變化,使標準樂聲特徵檔及背景音樂檔的播放時間軸對齊、接收從使用者而來的標的樂聲,擷取標的樂聲的特徵,並比較播放時間軸對齊之後的標準樂聲特徵檔與標的樂聲的特徵,以作成對標的樂聲的評價、載入多個互動影音內容,並根據對標的樂聲的評價,從多個互動影音內容中選擇一互動影音內容、把載入的主節目影音內容與選擇的互動影音內容疊加之後輸出。The invention also provides an interactive video and audio playing method, comprising the steps of: loading a main program audio and video content, wherein the main program audio and video content comprises a background music file, a standard music sound feature file, according to a standard music sound feature file and background music The volume change of the file aligns the playing time axis of the standard music feature file and the background music file, receives the target music sound from the user, captures the characteristics of the target music sound, and compares the standard music after the time axis alignment The characteristics of the sound feature file and the target music sound are used to evaluate the sound of the target music, load a plurality of interactive audio and video content, and select an interactive video and audio content from the plurality of interactive audio and video content according to the evaluation of the target music sound, The loaded main program video content is superimposed with the selected interactive video content and output.

依照上述記載,本發明的互動式影音播放系統及方法至少具有以下之技術特徵:According to the above description, the interactive video playback system and method of the present invention has at least the following technical features:

1.分別對主節目動畫與互動節目動畫做解碼(使用兩組影音解碼器)之後再疊加(疊加器)輸出。藉此可在主節目動畫播放的同時,出現互動節目動畫。1. Decode the main program animation and interactive program animation separately (using two sets of video decoders) and then superimpose (overlay) output. In this way, an interactive program animation can occur while the main program animation is being played.

2.在影音處理的部分(影音處理單元),可讓使用者以歌聲的品質控制所播放的互動畫面內容。2. In the part of audio and video processing (video processing unit), the user can control the content of the interactive picture played by the quality of the singing voice.

3.針對標候樂聲的評價方法(樂聲評分單元)是使用預先製作好的標準樂聲特徵檔作為評分的基準,如此則可有一個固定的比對基準。3. The evaluation method for the tune music (sound score unit) is to use the pre-made standard music profile as the benchmark for scoring, so that there is a fixed comparison benchmark.

4.針對標候樂聲的評價方法(樂聲評分單元)還可以利用歌詞檔,對歌唱者的歌詞同步做比對評分。4. The evaluation method for the standard music sound (the music sounding unit) can also use the lyrics file to compare the lyrics' lyrics.

5.選播互動影音內容的方式(互動節目選擇器)可按照一個預先製作好的評分動畫對照表、互動節目導航檔的定義來讀取需對應播放的互動影音內容,之後再進行解碼處理(送至第二影音解碼器)。5. The method of selecting interactive audio and video content (interactive program selector) can read the interactive video and audio content to be played according to the definition of a pre-made scored animation table and interactive program navigation file, and then perform decoding processing ( Send to the second video decoder).

為讓本發明之上述技術特徵能更明顯易懂,下文特舉實施例,並配合所附圖式作詳細說明如下。In order to make the above technical features of the present invention more comprehensible, the following embodiments are described in detail with reference to the accompanying drawings.

請參照圖1,其繪示依照本發明的一個實施例的互動式影音播放系統的方塊圖。Please refer to FIG. 1, which is a block diagram of an interactive video playback system in accordance with one embodiment of the present invention.

本發明的互動式影音播放系統100,包括:資料庫單元200、樂聲評分單元300、及影音處理單元400。詳言之,還可包括輸入輸出介面600,供使用者輸入指令到影音處理單元400,並供影音處理單元400該資料庫單元200進行存取。以下就各單元逐一說明。The interactive video playback system 100 of the present invention includes a database unit 200, a music score unit 300, and a video processing unit 400. In detail, an input/output interface 600 may also be included for the user to input an instruction to the audio processing unit 400 and to the audio processing unit 400 for access by the database unit 200. The following is a description of each unit.

[資料庫單元200][Database Unit 200]

資料庫單元200包括主節目動畫資料庫210、互動節目動畫資料庫220、標準樂聲特徵檔230。前述的資料庫單元200,舉例而言,可以是一個資訊儲存裝置,儲存著上述各資料庫及特徵檔。The database unit 200 includes a main program animation database 210, an interactive program animation database 220, and a standard music feature file 230. The foregoing database unit 200, for example, may be an information storage device that stores the above-mentioned databases and signature files.

其中主節目動畫資料庫210包括了要播放的主節目影音檔,及其相關的檔案資訊等(如檔案名稱、播放長度等),例如可以是Karaoke的背景音樂檔212a,及其檔案資訊等,統稱為主節目影音內容212。此外,主節目動畫資料庫210還包括了歌詞檔214。The main program animation database 210 includes the main program video file to be played, and related file information (such as file name, play length, etc.), for example, Karaoke's background music file 212a, and its file information, etc. They are collectively referred to as main program audio and video content 212. In addition, the main program animation database 210 also includes a lyric file 214.

互動節目動畫資料庫220包括多個互動影音內容222,也就是搭配主節目影音內容212一起播放的一些動畫,及其相關的檔案資訊等(如檔案名稱、播放長度等)。這些互動影音內容222,例如是音評互動動畫222a(繪示於圖8),其動畫內容隨著樂聲評分單元300給出的評價不同而不同。或者還可進一步包括定時互動動畫222b(繪示於圖8),其在某些固定的播放時間點(例如前奏、結尾等),或是每隔預定時間(可為等間隔或不等間隔),如每隔10秒播放,或是可隨播放的主節目影音內容而改變間隔(例如快歌、慢歌的播放間隔不同)。The interactive program animation database 220 includes a plurality of interactive video content 222, that is, some animations played together with the main program audio and video content 212, and related file information (such as file name, playback length, etc.). These interactive video content 222, for example, is a sound comment interactive animation 222a (shown in FIG. 8) whose animation content differs depending on the evaluation given by the music score unit 300. Or may further include a timed interactive animation 222b (shown in FIG. 8) at some fixed playback time points (eg, intro, ending, etc.), or every predetermined time (which may be equally spaced or unequal intervals) For example, it can be played every 10 seconds, or the interval of the main program audio and video content can be changed (for example, the playback interval of fast songs and slow songs is different).

本發明的標準樂聲特徵檔230是針對每一首歌預先製作好的檔案,是用來作為評分的基準,舉例而言,其包括了主節目影音內容212的音調、音量特徵。The standard musical feature 230 of the present invention is a pre-made archive for each song and is used as a benchmark for scoring, for example, including the pitch and volume characteristics of the main program video content 212.

[樂聲評分單元300][Roxy Score Unit 300]

樂聲評分單元300,接收從資料庫單元200而來的標準樂聲特徵檔230,並接收從使用者,例如是歌唱者而來的標的樂聲500,以擷取標的樂聲500的特徵,並比較標準樂聲特徵檔230與標的樂聲500的特徵,作成對標的樂聲500的評價E,並輸出到影音處理單元400。The music sound scoring unit 300 receives the standard musical sound feature 230 from the database unit 200, and receives the target musical sound 500 from the user, for example, a singer, to capture the characteristics of the target musical sound 500. The characteristics of the standard music feature file 230 and the target music 500 are compared, and the evaluation E of the target music 500 is made and output to the audio processing unit 400.

上述的樂聲評分單元300可包括至少一麥克風輸入部(未圖示),例如一個或者更多,以接收至少一個標的樂聲500,例如一個歌唱者(即獨唱)或者更多歌唱者(例如兩人比賽唱歌、或合唱)的歌聲輸入。The above-described musical score unit 300 may include at least one microphone input (not shown), such as one or more, to receive at least one target musical 500, such as a singer (ie, solo) or more singers (eg, The singing of the two people singing, or chorus).

樂聲評分單元300,舉例而言,可針對標的樂聲500的歌詞、音調、音量等三方面來進行評價,且不限定需同時評價這三個方面,例如可只選一種來評價,或任選兩種來評價,或三種都選亦可。The music sound scoring unit 300 can be evaluated for three aspects of the lyrics, the pitch, the volume, and the like of the target music 500, and is not limited to the three aspects, for example, one can be evaluated, or Choose two to evaluate, or three to choose.

每種評價又可再分成多個等級,例如,分成三等級如-1、+0、+1,當然數字的級距可任意變化,例如以-5、+0、+5來計分,或是其他任意數字皆可。當然,也可以分得更細,例如分成五等級或更多,或是分得較粗略,例如分成兩等級。Each evaluation can be further divided into multiple levels, for example, divided into three levels such as -1, +0, +1, of course, the level of the number can be arbitrarily changed, for example, by -5, +0, +5, or Any other number is acceptable. Of course, it can be divided into finer parts, for example, divided into five levels or more, or divided into coarser, for example, divided into two levels.

擷取標的樂聲500的特徵並作成評價的方式,可進一步闡述如下。The manner in which the characteristics of the target music 500 are captured and evaluated is further explained below.

請參照圖2,其繪示樂聲評分單元的方塊圖。Please refer to FIG. 2, which shows a block diagram of the music score unit.

主節目影音內容212,詳言之,可包括背景音樂檔212a。樂聲評分單元300,舉例而言,可包括同步部310、和比對部320。The main program video content 212, in particular, may include a background music file 212a. The music score unit 300 may include, for example, a synchronization unit 310 and a comparison unit 320.

本發明的標準樂聲特徵檔230是針對預先製作好的檔案,為了要進行評比,需要先使標準樂聲特徵檔230與播放的主節目影音內容212同步,也就是說,要使標準樂聲特徵檔230和主節目影音內容212的播放時間軸對齊,使兩者的播放起點一致。The standard music feature file 230 of the present invention is for pre-made files. In order to be evaluated, it is necessary to synchronize the standard music feature file 230 with the played main program video content 212, that is, to make the standard music sound The feature file 230 is aligned with the play time axis of the main program video content 212 so that the playback starting points of the two are identical.

同步部310根據標準樂聲特徵檔230及背景音樂檔212a的音量變化,使標準樂聲特徵檔230和背景音樂檔212a的播放時間軸對齊,並將播放時間軸對齊之後的標準樂聲特徵230檔輸出到比對部320。The synchronization unit 310 aligns the playback time axes of the standard music feature 230 and the background music file 212a according to the volume changes of the standard music profile 230 and the background music file 212a, and aligns the standard music features 230 after the playback time axis is aligned. The file is output to the matching unit 320.

比對部320接收播放時間軸對齊之後的標準樂聲特徵檔230,與所擷取的標的樂聲500的特徵進行比較,以作成評價E。圖2為了易於說明,只繪示出一個標的樂聲500,但並不限於此,本發明也可以接收多個標的樂聲輸入,並針對各標的樂聲輸入作成各別的比對。The matching unit 320 receives the standard musical sound feature 230 after the playing time axis is aligned, and compares with the characteristics of the captured target musical sound 500 to create an evaluation E. FIG. 2 shows only one target musical sound 500 for ease of explanation. However, the present invention is not limited thereto, and the present invention can also receive a plurality of target musical sound inputs, and make respective alignments for the respective musical sound input.

請再參照圖3,其繪示出樂聲評分單元300的更詳細的例子。Referring again to FIG. 3, a more detailed example of the music score unit 300 is illustrated.

比對部320舉例而言,可包括特徵計算部322及評價作成部324。The comparison unit 320 may include, for example, a feature calculation unit 322 and an evaluation creation unit 324.

特徵計算部322接收標的樂聲500,並計算標的樂聲500的特徵,將特徵輸出到評價作成部324。同步部310把播放時間軸對齊之後的標準樂聲特徵檔230輸出到評價作成部324。The feature calculation unit 322 receives the target musical sound 500, calculates the feature of the target musical sound 500, and outputs the feature to the evaluation creating unit 324. The synchronization unit 310 outputs the standard musical characteristic file 230 after the playback time axis is aligned to the evaluation creating unit 324.

評價作成部324比較從同步部310而來的播放時間軸對齊之後的標準樂聲特徵檔230、與標的樂聲500的特徵,進而作成評價E。The evaluation creating unit 324 compares the standard musical sound feature 230 after the playback time axis alignment from the synchronization unit 310 with the feature of the target musical sound 500, and further creates an evaluation E.

圖3中的特徵計算部322,舉例而言,可包括音調特徵計算部(未圖示),及音量特徵計算部(未圖示)之中至少一者。對應於此,此時特徵計算部322所作成的評價E也可包括音調評價、及音量評價之中至少一者。The feature calculation unit 322 in FIG. 3 may include, for example, at least one of a pitch feature calculation unit (not shown) and a volume feature calculation unit (not shown). Corresponding to this, at this time, the evaluation E created by the feature calculation unit 322 may include at least one of pitch evaluation and volume evaluation.

[影音處理單元400][Audio Processing Unit 400]

如圖1,影音處理單元400連接至資料庫單元200,及樂聲評分單元300。影音處理單元包括400:主節目動畫處理部410、互動節目動畫處理部420、以及疊加器430。As shown in FIG. 1, the video processing unit 400 is connected to the database unit 200, and the music score unit 300. The video processing unit includes 400: a main program animation processing unit 410, an interactive program animation processing unit 420, and an adder 430.

主節目動畫處理部410,包括第一影音解碼器412,對主節目影音內容212進行解碼並輸出至疊加器430。The main program animation processing unit 410 includes a first video decoder 412 that decodes the main program video content 212 and outputs it to the adder 430.

互動節目動畫處理部420,包括第二影音解碼器422、及互動節目選擇器424。其中互動節目選擇器424根據樂聲評分單元300所輸出的評價E,從多個互動影音內容222中選擇一個互動影音內容,傳送到第二影音解碼器422進行解碼並輸出至疊加器430。The interactive program animation processing unit 420 includes a second video decoder 422 and an interactive program selector 424. The interactive program selector 424 selects one interactive video content from the plurality of interactive video content 222 according to the evaluation E output by the music sound scoring unit 300, transmits it to the second video decoder 422 for decoding, and outputs it to the adder 430.

前面已經解釋過,所謂的互動影音內容222,就是搭配主節目影音內容212一起播放的一些動畫。舉例而言,互動影音內容可以是一種養成遊戲。此時,上述互動節目選擇器424根據評價E選擇互動影音內容方式,可以像這樣:當使用者(歌者)在KTV包廂內點播慢拍情歌,螢幕上除了原版音樂錄影帶的畫面之外還會出現一位女性或卡通人物。若使用者走音或節拍錯誤,畫面上的女生臉色會越來越陰沉,最後轉頭走人。反之若消費者音準正確且音量適中,畫面上的女生會越來越開心,最後心花怒放成為專屬歌迷。當然,這只是一個例子,互動影音內容的畫面不一定是卡通,由實景拍攝的畫面亦可,且不一定只於出現人物,任何形式的影音內容皆可。As explained above, the so-called interactive video content 222 is some animation that is played along with the main program video content 212. For example, interactive video content can be a development game. At this time, the interactive program selector 424 selects the interactive video content mode according to the evaluation E, and can be like this: when the user (singer) orders the slow love song in the KTV box, the screen is in addition to the original music video screen. A female or cartoon character will appear. If the user moves or the beat is wrong, the girl's face on the screen will become more and more gloomy, and finally turn around and leave. On the other hand, if the consumer's pitch is correct and the volume is moderate, the girls on the screen will be more and more happy, and finally they will become the exclusive fans. Of course, this is just an example. The picture of interactive audio and video content is not necessarily a cartoon. The picture taken by the real scene can also be used, and it is not necessarily only for the appearance of characters, and any form of audio and video content is acceptable.

上述的主節目動畫處理部410可進一步闡述如下。The above-described main program animation processing unit 410 can be further explained as follows.

請再參照圖4,其繪示圖1的主節目動畫資料庫、影音處理單元、及樂聲評分單元的局部圖示。Referring to FIG. 4 again, a partial diagram of the main program animation database, the video processing unit, and the music sound scoring unit of FIG. 1 is illustrated.

主節目動畫資料庫210,詳言之,還包括歌詞檔214,且主節目動畫處理部410還可包括一歌詞顯示器414。The main program animation database 210, in particular, also includes a lyric file 214, and the main program animation processing unit 410 may further include a lyric display 414.

歌詞顯示器414接收從主節目動畫資料庫210而來的歌詞檔214,並輸出到疊加器430,與解碼後的主動節目影音內容212、解碼後的互動影音內容222疊加之後輸出。The lyric display 414 receives the lyric file 214 from the main program animation database 210, and outputs it to the adder 430, and outputs it after superimposing the decoded active program video content 212 and the decoded interactive video content 222.

利用歌詞檔214,樂聲評分單元300還可進行歌詞同步評價。舉例而言,樂聲評分單元300可包括歌詞同步計算部326,比較歌詞檔214與標的樂聲500的特徵,以判定歌詞同步的程度並輸出評價E。此時輸出的評價E就可包括歌詞同步評價。Using the lyric file 214, the music score unit 300 can also perform lyrics synchronization evaluation. For example, the music score unit 300 may include a lyrics synchronization calculation unit 326 that compares the lyrics file 214 with the characteristics of the target musical sound 500 to determine the degree of lyric synchronization and output the evaluation E. The evaluation E output at this time may include lyrics synchronization evaluation.

請再參照圖5,其繪示動畫疊加的流程示意圖。Referring again to FIG. 5, a schematic flow chart of the animation overlay is shown.

疊加器430,接收第一影音解碼器412解碼後所輸出的主節目影音內容212,及第二影音解碼器422解碼後所輸出的互動影音內容222,進行疊加之後輸出至影音的顯示及播放單元,例如顯示螢幕(電視或電腦螢幕...等)及音響...等。The superimposer 430 receives the main program video and audio content 212 decoded by the first video and audio decoder 412, and the interactive video and audio content 222 output by the second video and audio decoder 422, and outputs the video and audio to the display and playback unit. For example, display screens (television or computer screens, etc.) and audio...etc.

上述互動節目動畫處理部420還可包括移除背景部426,接收從該互動節目選擇器424所選擇的該互動影音內容222,進行移除背景的處理,並輸出至該疊加器430。此外,互動節目動畫處理部420還可包括暫存部428,把已解碼的互動影音內容先暫時儲存,再傳送到移除背景部426。The interactive program animation processing unit 420 may further include a removal background portion 426 that receives the interactive video content 222 selected from the interactive program selector 424, performs a process of removing the background, and outputs the same to the adder 430. In addition, the interactive program animation processing unit 420 may further include a temporary storage unit 428 that temporarily stores the decoded interactive video and audio content and then transmits the content to the removal background portion 426.

互動節目選擇器424選擇互動影音內容的方式(以下稱為選播互動影音內容的方式),將進一步闡述如後。The way in which the interactive program selector 424 selects interactive audio and video content (hereinafter referred to as the manner in which the interactive audio and video content is selected) will be further explained as follows.

請參照圖6,其繪示圖1的互動節目動畫資料庫與互動節目動畫處理部的局部圖示。Please refer to FIG. 6 , which is a partial diagram of the interactive program animation database and the interactive program animation processing unit of FIG. 1 .

參照圖6,上述的互動節目動畫資料庫220,除了多個互動影音內容之外,還可包括評分動畫對照表224。評分動畫對照表224規定出不同的評價與多個互動影音內容222的對應關係。詳言之,例如把多個互動影音內容222予以命名或編號,如命名為互動影音動畫1、互動影音動畫2、…等,評分動畫對照表224則規定出不同的評價所對應播放的是哪一個互動影音內容222,例如評價2對應到互動影音動畫2。Referring to FIG. 6, the interactive program animation database 220 may include a score animation comparison table 224 in addition to a plurality of interactive video content. The score animation comparison table 224 specifies the correspondence between the different evaluations and the plurality of interactive video content 222. In detail, for example, a plurality of interactive audio and video content 222 are named or numbered, such as interactive video animation 1, interactive video animation 2, etc., and the rating animation table 224 specifies which of the different evaluations are played. An interactive video content 222, such as rating 2 corresponds to interactive video animation 2.

且互動節目選擇器424所選擇的互動影音內容是按照評分動畫對照表224所規定的對應關係而選的。And the interactive video content selected by the interactive program selector 424 is selected according to the correspondence defined by the scoring animation comparison table 224.

關於評分動畫對照表224,請進一步參照圖7,其繪示評分動畫對照表的一個例子。Regarding the scoring animation comparison table 224, please refer further to FIG. 7, which shows an example of a scoring animation comparison table.

舉例而言,樂聲評分單元300是針對歌詞、音調、音量等三方面來評分。如果再把每種評分又分成三個等級來看的話,一共有27種評分結果。評分動畫對照表224就是規定出不同的評價與多個互動影音內容222的對應關係,例如針對這27種評分結果,分別指定對應的互動影音內容222。For example, the music score unit 300 is scored for three aspects of lyrics, pitch, volume, and the like. If you then divide each score into three levels, there are a total of 27 ratings. The score animation comparison table 224 specifies the correspondence between the different evaluations and the plurality of interactive video content 222. For example, for the 27 evaluation results, the corresponding interactive video content 222 is specified.

根據圖7的評分動畫對照表224的一個例子可看出,如果由樂聲評分單元300輸出的評價E為音調+1分、歌詞+1分,音量+0分的話,就會對應到動畫10-2,於是互動節目選擇器424,就會在多個互動影音內容222中選取動畫10-2,並傳送到第2影音解碼器422。According to an example of the scoring animation comparison table 224 of FIG. 7, it can be seen that if the evaluation E output by the musical sound scoring unit 300 is the pitch +1 score, the lyrics +1 score, and the volume + 0 score, it corresponds to the animation 10 -2, then the interactive program selector 424 selects the animation 10-2 among the plurality of interactive video content 222 and transmits it to the second video decoder 422.

此外,也可以在前奏和結尾的地方,按照評價E所累計的總分來指示對應的互動影音內容。例如參照圖7在前奏和結尾的時候,按總分的高、中、低,來指定到不同的互動影音內容222。當然上述圖7只是評分動畫對照表224的一個例子,本發明並不限定評分動畫對照表需有音調、歌詞、音量的評價,可以更多,也可以更少,且每個評價也不限定為三等級,可以更多,也可以更少。In addition, it is also possible to indicate the corresponding interactive audio and video content according to the total score accumulated by the evaluation E at the prelude and the end. For example, referring to FIG. 7 at the prelude and the end, the different interactive video content 222 is assigned according to the high, medium, and low of the total score. Of course, FIG. 7 is only an example of the scoring animation comparison table 224. The present invention does not limit the evaluation of the pitch animation, the lyrics, and the volume, and may be more or less, and each evaluation is not limited to Three levels, more or less.

針對選播互動影音內容222的方式,還可再進一步闡述如下。請參照圖8,其為圖6的互動節目動畫資料庫的更詳細的例子。圖8與圖6的主要不同在於,圖8進一步繪示了互動節目導航檔。The manner of selecting the interactive audio and video content 222 can be further elaborated as follows. Please refer to FIG. 8, which is a more detailed example of the interactive program animation database of FIG. The main difference between FIG. 8 and FIG. 6 is that FIG. 8 further depicts an interactive program navigation file.

如圖8,多個互動影音內容222舉例而言,可包括前面已說明過的至少一音評互動動畫222a,或者再進而包括至少一定時互動動畫222b。請注意,雖然為了方便說明而在圖8中一併示出了222a、及222b,但本發明並不限定需要同時具有兩者,只有音評互動動畫222a亦可。As shown in FIG. 8, a plurality of interactive audiovisual content 222, for example, may include at least one of the soundtrack interactive animations 222a, or further including at least a certain time interactive animation 222b. Please note that although 222a and 222b are shown together in FIG. 8 for convenience of explanation, the present invention is not limited to the need to have both, and only the sound review interactive animation 222a may be used.

互動節目動畫資料庫220,舉例而言,還可包括互動節目導航檔226,其中該互動節目導航檔226指定出在不同的播放時間點所需對應播放的互動影音內容222。The interactive program animation library 220, for example, can also include an interactive program navigation file 226, wherein the interactive program navigation file 226 specifies interactive audio and video content 222 that is required to be played at different playback time points.

按照圖8的例子看來,當互動影音內容222包括了音評互動動畫222a、定時互動動畫222b時,互動節目導航檔224指定出在某些播放時間點要播放定時互動動畫222b,而在某些播放時間點要播放音評互動動畫222a。互動節目選擇器424按照互動節目導航檔224的指定,在不同的播放時間點選擇對應的互動影音內容222,並輸出到第二影音解碼器422。According to the example of FIG. 8, when the interactive video content 222 includes the sound review interactive animation 222a and the timed interactive animation 222b, the interactive program navigation file 224 specifies that the timed interactive animation 222b is to be played at some playing time points, and The sound review interactive animation 222a is played at some play time points. The interactive program selector 424 selects the corresponding interactive video content 222 at different playback time points according to the designation of the interactive program navigation file 224, and outputs the corresponding interactive video content 222 to the second video decoder 422.

接下來說明本發明的互動式影音播放方法。為使說簡潔,在前述說明互動式影音播放系統時已說明過的元件,將採用相同的名稱、元件符號,且不再重覆說明。Next, the interactive video and audio playback method of the present invention will be described. For the sake of brevity, the components that have been described in the foregoing description of the interactive video playback system will use the same names, component symbols, and will not be repeated.

請參照圖9,其繪示依照本發明的一個實施例的互動式影音播放方法的流程圖。Please refer to FIG. 9, which is a flowchart of an interactive video and audio playback method according to an embodiment of the present invention.

首先,進行步驟S100,載入主節目影音內容212,其中主節目影音內容212包括背景音樂檔212a。First, step S100 is performed to load the main program video content 212, wherein the main program video content 212 includes the background music file 212a.

接著,進行步驟S200,載入標準樂聲特徵檔230(步驟S210),根據標準樂聲特徵檔230及背景音樂檔212a的音量變化,使標準樂聲特徵檔230及背景音樂檔212a的播放時間軸對齊(步驟S220)。Next, proceeding to step S200, loading the standard music feature 230 (step S210), and playing the standard music feature 230 and the background music file 212a according to the volume changes of the standard music feature 230 and the background music file 212a. The axes are aligned (step S220).

在調整好標準樂聲特徵檔230的播放時間軸之後,進行步驟S300,接收從使用者而來的標的樂聲500,例如通過至少一麥克風輸入,接收使用者的歌聲(步驟S310),並擷取標的樂聲500的特徵(步驟S320),比較播放時間軸對齊之後的標準樂聲特徵檔230與標的樂聲230的特徵,以作成對標的樂聲的評價E(步驟S330)。After the playback time axis of the standard music feature file 230 is adjusted, step S300 is performed to receive the target music 500 from the user, for example, through at least one microphone input, to receive the user's voice (step S310), and The feature of the target musical sound 500 is extracted (step S320), and the characteristics of the standard musical sound feature 230 and the target musical sound 230 after the time axis alignment are compared are compared to make an evaluation E of the target musical sound (step S330).

在擷取特徵的步驟S320中,詳言之,是先計算該標的樂聲500的音調特徵及音量特徵之中至少一者,例如可計算兩者或是其中一者皆可。於是在後續作成評價的步驟S330中,是對應作成標的樂聲500的音調評價及音量評價之中至少一者。In the step S320 of capturing the feature, in detail, at least one of the pitch feature and the volume feature of the target music 500 is first calculated, for example, either or both of them may be calculated. Then, in the step S330 of the subsequent creation evaluation, at least one of the pitch evaluation and the volume evaluation corresponding to the musical sound 500 of the target is performed.

此外,擷取標的樂聲500的特徵,還可按照某個單位時間(例如0.001秒)把標的樂聲500分割成多個部分來擷取,且對標的樂聲500的評價E也可按照該單位時間而作成。藉此,可即時對標的樂聲500進行評價。且透過前述的輸入輸出介面600,例如是點歌器或是遙控器等,可隨時接收使用者的指令,而在得到評價E之後,當接收到一個顯示分數的指令時,便可即時將評價輸出到顯示單元,而不必等到全曲演唱完畢。In addition, the feature of the target musical sound 500 can be captured, and the target musical sound 500 can be divided into a plurality of parts according to a certain unit time (for example, 0.001 seconds), and the evaluation E of the target musical sound 500 can also be followed. Made in unit time. Thereby, the target music 500 can be evaluated immediately. And through the foregoing input and output interface 600, for example, a karaoke machine or a remote controller, etc., the user's instruction can be received at any time, and after receiving the evaluation E, when receiving an instruction to display the score, the evaluation can be immediately performed. Output to the display unit without having to wait until the whole song is finished.

在得到評價E之後,進行步驟S400,載入多個互動影音內容222(步驟S410),並根據對標的樂聲500的評價E,從多個互動影音內容222中選擇一互動影音內容(步驟S420)。After the evaluation E is obtained, the process proceeds to step S400, the plurality of interactive video and audio content 222 is loaded (step S410), and an interactive video content is selected from the plurality of interactive video and audio contents 222 according to the evaluation E of the target musical sound 500 (step S420). ).

在選擇互動影音內容的步驟S420中,詳言之,可根據評分動畫對照表224來選擇評價E所對應的互動影音內容222。其中評分動畫對照表224,如前述圖6或圖7所例示,其規定出不同的評價E與互動影音內容222的對應關係。In the step S420 of selecting the interactive video content, in detail, the interactive video content 222 corresponding to the evaluation E can be selected according to the scoring animation comparison table 224. The scoring animation comparison table 224, as exemplified in FIG. 6 or FIG. 7 above, specifies the correspondence between the different evaluation E and the interactive video content 222.

最後,在選好互動影音內容之後,執行步驟S500,把載入的主節目影音內容212與選擇的該互動影音內容222疊加之後輸出。Finally, after the interactive video content is selected, step S500 is executed to superimpose the loaded main program video content 212 and the selected interactive video content 222 and output.

[步驟S400的變化例][Modification of Step S400]

請參照圖10,其繪示上述步驟S400的變化例。Please refer to FIG. 10, which illustrates a variation of the above step S400.

上述步驟S400可取代為步驟S400a,詳言之可進一步包括下述步驟:在圖10的步驟S410中,載入的多個互動影音內容222可以是音評互動動畫222a,此音評互動動畫222a是針對不同的評價E所作成的動畫。此外,載入的多個互動影音內容222還可包括至少一定時互動動畫222b,此定時互動動畫222b是在規定的播放時間點需播放的動畫。The step S400 may be replaced by the step S400a. In detail, the method may further include the following steps. In step S410 of FIG. 10, the loaded plurality of interactive video content 222 may be a sound review interactive animation 222a, and the sound review interactive animation 222a It is an animation made for different evaluations E. In addition, the loaded plurality of interactive video content 222 may further include at least a certain time interactive animation 222b, which is an animation to be played at a specified playing time point.

在載入多個互動影音內容的步驟S410之後,載入如前述圖8所例示的互動節目導航檔226(步驟S412),此導航檔指定出在不同的播放時間點所需播放的互動影音內容222。並根據互動節目導航檔226,按照規定的播放時間點從已載入的多個互動影音內容222選擇要對應播放的互動影音內容(步驟S414)。After the step S410 of loading a plurality of interactive video content, the interactive program navigation file 226 as illustrated in the foregoing FIG. 8 is loaded (step S412), and the navigation file specifies the interactive audio and video content to be played at different playback time points. 222. And according to the interactive program navigation file 226, the interactive video and audio content to be played correspondingly is selected from the loaded plurality of interactive video and audio contents 222 according to the specified playing time point (step S414).

舉例而言,互動節目導航檔226規定出,在播放時間軸中哪些時間點要播放音評互動動畫222a,又哪些時間點要播放定時互動動畫222b。如果只有音評互動動畫222a,也可以只規定哪些時間點要播放音評互動動畫222a即可。此時,選擇對應的互動影音內容的步驟S414就包括了選擇對應的音評互動動畫222a。For example, the interactive program navigation file 226 specifies which time points in the playback timeline are to play the sounding interactive animation 222a, and at which time points to play the timed interactive animation 222b. If only the sound review interactive animation 222a is available, it is also possible to specify only which time points to play the soundtrack interactive animation 222a. At this time, the step S414 of selecting the corresponding interactive video content includes selecting the corresponding sound comment interaction animation 222a.

當進行歌詞同步評價時,關於本發明的互動式影音播放方法,除了如圖9的樣態,還可有其他的變化。請參照圖11,其繪示圖9的變化例。在圖11中,與圖9相同的部分僅列出步驟符號,且省略其說明。When the lyrics synchronization evaluation is performed, there are other variations with respect to the interactive video playback method of the present invention, in addition to the state of FIG. Please refer to FIG. 11 , which illustrates a variation of FIG. 9 . In FIG. 11, the same portions as those in FIG. 9 only show step symbols, and the description thereof is omitted.

圖11與圖9不同的地方是在於,把圖9的步驟S100、S330、S500分別取代為S100a、S330a、S500a。11 is different from FIG. 9 in that steps S100, S330, and S500 of FIG. 9 are replaced with S100a, S330a, and S500a, respectively.

步驟S100a是,載入該主節目影音內容212(包括背景音樂),及歌詞檔214。Step S100a is to load the main program video content 212 (including background music), and the lyric file 214.

步驟S330a是,比較歌詞檔214與標的樂聲500的特徵,以作成對標的樂聲500的歌詞同步評價。In step S330a, the features of the lyrics file 214 and the target musical sound 500 are compared to make a lyrics synchronization evaluation of the target musical sound 500.

步驟S500a是,把載入的主節目影音內容212、選擇的互動影音內容222、及歌詞檔214疊加。In step S500a, the loaded main program video content 212, the selected interactive video content 222, and the lyric file 214 are superimposed.

在上述的各方法的實施例中,選擇的互動影音內容222被疊加之前,還可包括先對選擇的互動影音內容222去除背景。且於疊加時,是把載入的主節目影音內容與已去除背景的互動影音內容222疊加。In the above embodiments of the method, before the selected interactive video content 222 is superimposed, the selected interactive video content 222 may be removed from the background. And when superimposing, the loaded main program video content is superimposed with the removed background audio and video content 222.

綜上所述,根據本發明的互動式影音播放系統及方法,使用者可利用即時的評價(即使用者的歌聲評分)和存放於互動節目動畫資料庫的互動影音內容(例如遊戲內容)進行互動娛樂。也就是說,可提供使用者一邊唱歌,一邊享受互動遊戲的樂趣,以增進karaoke影音系統之產品效益。In summary, according to the interactive video playback system and method of the present invention, the user can use the instant evaluation (ie, the user's singing score) and the interactive audio and video content (such as game content) stored in the interactive program animation database. Interactive entertainment. In other words, users can enjoy the fun of interactive games while singing, in order to enhance the product benefits of karaoke audio and video systems.

藉由上述特徾,本發明的互動式影音播放系統及方法至少具有下述優點:With the above features, the interactive video playback system and method of the present invention has at least the following advantages:

1.在本發明的互動式影音播放系統及方法中,在影音處理的部分(影音處理單元)是分別對主節目動畫與互動節目動畫做解碼(使用兩組影音解碼器),之後將兩組節目動畫及歌詞影像做疊加(疊加器)輸出。藉此可在主節目動畫播放的同時,出現互動節目動畫,可提高使用樂趣。1. In the interactive video playback system and method of the present invention, the video processing portion (the audio and video processing unit) decodes the main program animation and the interactive program animation separately (using two sets of video decoders), and then two groups. The program animation and lyrics images are superimposed (overlay) output. In this way, an interactive program animation can be played at the same time as the main program animation is played, which can improve the fun of use.

2.在本發明的互動式影音播放系統及方法中,在影音處理的部分(影音處理單元),結合了karaoke播放技術與歌聲特徵評分計算技術,並讓使用者以歌聲的品質控制所播放的互動畫面內容,可進一步提高互動的樂趣。2. In the interactive video playback system and method of the present invention, in the audio-visual processing part (video processing unit), the karaoke playing technology and the singing feature score calculation technology are combined, and the user is controlled by the quality of the singing voice. Interactive screen content can further enhance the fun of interaction.

3.在本發明的互動式影音播放系統及方法中,針對標候樂聲的評價方法(樂聲評分單元)是使用預先製作好的標準樂聲特徵檔作為評分的基準,對歌唱者的音調、音量做相似度比對評分,如此則可有一個固定的比對基準。3. In the interactive video playback system and method of the present invention, the evaluation method for the tune music sound (the music sound scoring unit) is to use the pre-made standard music sound feature file as the reference for the score, the tone to the singer The volume is similarly scored, so there is a fixed comparison benchmark.

4.在本發明的互動式影音播放系統及方法中,針對標候樂聲的評價方法(樂聲評分單元)還可以利用從資料庫而來的歌詞檔,對歌唱者的歌詞同步做比對評分。4. In the interactive video playback system and method of the present invention, the evaluation method for the tune music sound (the music sound scoring unit) can also use the lyric file from the database to compare the lyrics of the singer. score.

5.在本發明的互動式影音播放系統及方法中,選播互動影音內容的方式(互動節目選擇器)可按照一個預先製作好的評分動畫對照表,讀取需對應播放的互動影音內容,之後再進行解碼處理(送至第二影音解碼器)。藉此,可利用評分動畫對照表指定出的對應關係,使不同的評價對應到不同動畫,可使互動的內容更為豐富多變化。5. In the interactive video playback system and method of the present invention, the method for selecting interactive audio and video content (interactive program selector) can read the interactive audio and video content to be played according to a pre-made score animation comparison table. Then, the decoding process is performed (sent to the second video decoder). In this way, the correspondence relationship specified by the scoring animation comparison table can be utilized, so that different evaluations correspond to different animations, and the interactive content can be richer and more varied.

6.在本發明的互動式影音播放系統及方法中,還可把互動影音內容再細分為音評動畫、定時動畫,並由一個預先製作好的互動節目導航檔定義在不同的時間點所需播放的是音評動畫、或定時動畫,且互動節目選擇器還可按照此互動節目導航檔,讀取需對應播放的互動影音內容,之後再進行解碼處理(送至第二影音解碼器)。藉此,可進一步變化互動的內容。6. In the interactive video and audio playback system and method of the present invention, the interactive audio and video content can be further subdivided into sound review animation, timed animation, and defined by a pre-made interactive program navigation file at different time points. The sound review animation or the timed animation is played, and the interactive program selector can also read the interactive audio and video content corresponding to the play according to the interactive program navigation file, and then perform decoding processing (send to the second video decoder). In this way, the interactive content can be further changed.

雖然本發明已以實施例揭露如上,然其並非用以限定本發明,任何所屬技術領域中具有通常知識者,在不脫離本發明之精神和範圍內,當可作些許之更動與潤飾,故本發明之保護範圍當視後附之申請專利範圍所界定者為準。Although the present invention has been disclosed in the above embodiments, it is not intended to limit the invention, and any one of ordinary skill in the art can make some modifications and refinements without departing from the spirit and scope of the invention. The scope of the invention is defined by the scope of the appended claims.

100...互動式影音播放系統100. . . Interactive video playback system

200...資料庫單元200. . . Database unit

210...主節目動畫資料庫210. . . Main program animation database

212...主節目影音內容212. . . Main program audio and video content

212a...背景音樂檔212a. . . Background music file

214...歌詞檔214. . . Lyrics file

220...互動節目動畫資料庫220. . . Interactive program animation database

222...互動影音內容222. . . Interactive audio and video content

222a...音評互動動畫222a. . . Sound review interactive animation

222b...定時互動動畫222b. . . Timed interactive animation

224...評分動畫對照表224. . . Scoring animation table

226...互動節目導航檔226. . . Interactive program navigation file

230...標準樂聲特徵檔230. . . Standard music profile

300...樂聲評分單元300. . . Music score unit

310...同步部310. . . Synchronization unit

320...比對部320. . . Comparison department

322...特徵計算部322. . . Feature calculation department

324...評價作成部324. . . Evaluation preparation department

326...歌詞同步計算部326. . . Lyrics synchronization calculation department

400...影音處理單元400. . . Video processing unit

410...主節目動畫處理部410. . . Main program animation processing department

412...第一影音解碼器412. . . First video decoder

414...歌詞顯示器414. . . Lyrics display

420...互動節目動畫處理部420. . . Interactive program animation processing department

422...第二影音解碼器422. . . Second video decoder

424...互動節目選擇器424. . . Interactive program selector

426...移除背景部426. . . Remove background

428...暫存部428. . . Temporary department

430...疊加器430. . . Adder

600...輸入輸出介面600. . . Input and output interface

E...評價E. . . Evaluation

S100~S500a...各步驟S100~S500a. . . Each step

圖1繪示依照本發明的一個實施例的互動式影音播放系統的方塊圖。1 is a block diagram of an interactive video playback system in accordance with one embodiment of the present invention.

圖2繪示樂聲評分單元的一例的方塊圖。2 is a block diagram showing an example of a music score unit.

圖3繪示樂聲評分單元的另一例的方塊圖。FIG. 3 is a block diagram showing another example of the music sound scoring unit.

圖4繪示圖1的主節目動畫資料庫、影音處理單元、及樂聲評分單元的局部圖示。4 is a partial pictorial illustration of the main program animation database, the audio processing unit, and the music score unit of FIG. 1.

圖5繪示動畫疊加的流程示意圖。FIG. 5 is a schematic flow chart of an animation overlay.

圖6繪示圖1的互動節目動畫資料庫與互動節目動畫處理部的局部圖示。6 is a partial diagram of the interactive program animation database and the interactive program animation processing unit of FIG. 1.

圖7繪示評分動畫對照表的一例。FIG. 7 shows an example of a scoring animation comparison table.

圖8為圖6的互動節目動畫資料庫的一例的方塊圖。8 is a block diagram showing an example of the interactive program animation database of FIG. 6.

圖9繪示依照本發明的一個實施例的互動式影音播放方法的流程圖。9 is a flow chart of an interactive video and audio playback method in accordance with one embodiment of the present invention.

圖10繪示步驟S400的變化例。FIG. 10 illustrates a variation of step S400.

圖11繪示圖9的變化例。FIG. 11 illustrates a variation of FIG.

S100~S500...步驟S100~S500. . . step

Claims (23)

一種互動式影音播放系統,包括:一資料庫單元,該資料庫單元包括一主節目動畫資料庫、一互動節目動畫資料庫、一標準樂聲特徵檔,其中該主節目動畫資料庫包括一主節目影音內容,且該互動節目動畫資料庫包括多個互動影音內容;一樂聲評分單元,接收從該資料庫單元而來的該標準樂聲特徵檔,並接收一標的樂聲,擷取該標的樂聲的特徵,並比較該標準樂聲特徵檔與該標的樂聲的該特徵,作成對該標的樂聲的評價並輸出;以及一影音處理單元,連接至該資料庫單元,及該樂聲評分單元,該影音處理單元包括:一主節目動畫處理部、一互動節目動畫處理部、以及一疊加器,其中該主節目動畫處理部,包括一第一影音解碼器,對該主節目影音內容進行解碼並輸出至該疊加器,該互動節目動畫處理部,包括一第二影音解碼器、以及一互動節目選擇器,其中該互動節目選擇器根據該樂聲評分單元所輸出的該評價,從該多個互動影音內容中選擇一互動影音內容,傳送到該第二影音解碼器進行解碼並輸出至該疊加器,該疊加器,接收該第一影音解碼器所輸出的該主節目影音內容,及該第二影音解碼器所輸出的該互動影音內容,進行疊加之後輸出。An interactive video playback system includes: a database unit, the database unit includes a main program animation database, an interactive program animation database, and a standard music feature file, wherein the main program animation database includes a main a program audio and video content, and the interactive program animation database includes a plurality of interactive audio and video content; a music sound scoring unit receives the standard music feature file from the database unit, and receives a target music sound, and takes the a feature of the target music, and comparing the standard music feature with the feature of the target music, making an evaluation and outputting the target music; and a video processing unit connected to the database unit, and the music a sound scoring unit, the video processing unit includes: a main program animation processing unit, an interactive program animation processing unit, and an adder, wherein the main program animation processing unit includes a first video decoder, and the main program audio and video The content is decoded and output to the adder, the interactive program animation processing unit includes a second video decoder, and an interactive program selection The interactive program selector selects an interactive video content from the plurality of interactive audio and video content according to the evaluation output by the music sounding unit, and transmits the content to the second video decoder for decoding and outputting to the superimposer. The adder receives the content of the main program video and audio output by the first video decoder, and the interactive video and audio content output by the second video decoder is superimposed and output. 如申請專利範圍第1項所述的互動式影音播放系統,其中該互動節目動畫資料庫還包括一評分動畫對照表,規定不同的該評價與該多個互動影音內容的對應關係,且該互動節目選擇器是按照該評分動畫對照表所規定的該對應關係而選擇對應的該互動影音內容。The interactive video playback system according to claim 1, wherein the interactive program animation database further includes a scoring animation comparison table, and the correspondence between the different evaluations and the plurality of interactive audio and video contents is specified, and the interaction is The program selector selects the corresponding interactive video content according to the correspondence defined by the rating animation comparison table. 如申請專利範圍第1項所述的互動式影音播放系統,其中該主節目影音內容包括一背景音樂檔,且該樂聲評分單元包括一同步部、和一比對部,其中該同步部根據該標準樂聲特徵檔及該背景音樂檔的音量變化,使該標準樂聲特徵檔和該背景音樂檔的播放時間軸對齊,並將該播放時間軸對齊之後的標準樂聲特徵檔輸出到該比對部,該比對部接收該播放時間軸對齊之後的該標準樂聲特徵檔,與所擷取的該標的樂聲的該特徵進行比較,以作成該評價。The interactive video playback system of claim 1, wherein the main program audio and video content comprises a background music file, and the music sound scoring unit comprises a synchronization portion and a comparison portion, wherein the synchronization portion is The standard music feature file and the volume change of the background music file, the standard music feature file is aligned with the playing time axis of the background music file, and the standard music feature file after the playing time axis is aligned is output to the The comparison unit receives the standard music pattern after the playing time axis is aligned, and compares the captured characteristics of the target music to make the evaluation. 如申請專利範圍第3項所述的互動式影音播放系統,其中該比對部包括一特徵計算部及一評價作成部,其中該同步部把該播放時間軸對齊之後的該標準樂聲特徵檔輸出到該評價作成部,且該特徵計算部接收該標的樂聲,並計算該標的樂聲的該特徵,並將該特徵輸出到該評價作成部,且該評價作成部比較從該同步部而來的該播放時間軸對齊之後的該標準樂聲特徵檔、與該標的樂聲的該特徵,進而作成該評價。The interactive video playback system of claim 3, wherein the comparison portion includes a feature calculation portion and an evaluation creation portion, wherein the synchronization portion aligns the playback time axis with the standard music feature file Outputting to the evaluation creation unit, the feature calculation unit receives the target music, calculates the feature of the target music, and outputs the feature to the evaluation preparation unit, and the evaluation preparation unit compares the synchronization unit from the synchronization unit. The standard music pattern after the time axis alignment is obtained, and the feature of the target music, and the evaluation is made. 如申請專利範圍第4項所述的互動式影音播放系統,其中該特徵計算部包括一音調特徵計算部,及一音量特徵計算部之中至少一者,且該評價作成部對應於該特徵計算部作成的該評價包括一音調評價、及一音量評價之中至少一者。The interactive video playback system of claim 4, wherein the feature calculation unit includes at least one of a tone feature calculation unit and a volume feature calculation unit, and the evaluation preparation unit corresponds to the feature calculation. The evaluation made by the department includes at least one of a tone evaluation and a volume evaluation. 如申請專利範圍第1項所述的互動式影音播放系統,其中該主節目動畫資料庫還包括一歌詞檔,且該主節目動畫處理部還包括一歌詞顯示器,該歌詞顯示器接收從該主節目動畫資料庫而來的該歌詞檔,並輸出到該疊加器,與解碼後的該主動節目影音內容、解碼後的該互動影音內容疊加之後輸出,且該樂聲評分單元包括一歌詞同步計算部,比較該歌詞檔與該標的樂聲的特徵,以判定歌詞同步的程度作成一歌詞同步評價作為該評價。The interactive video playback system of claim 1, wherein the main program animation database further includes an lyric file, and the main program animation processing portion further includes a lyric display, the lyric display receiving the main program The lyrics file from the animation database is output to the superimposer, and is outputted after being superimposed with the decoded active video and audio content and the decoded interactive video and audio content, and the music sound scoring unit includes a lyrics synchronization calculation unit. Comparing the lyrics file with the characteristics of the target music, and determining the degree of lyrics synchronization to make a lyrics synchronization evaluation as the evaluation. 如申請專利範圍第1項所述的互動式影音播放系統,其中該互動節目動畫資料庫還包括一互動節目導航檔,其中該互動節目導航檔指定出在不同的播放時間點所需對應播放的該互動影音內容,該互動節目選擇器按照該互動節目導航檔,在不同的播放時間點選擇對應的該互動影音內容,並輸出到該第二影音解碼器。The interactive video playback system of claim 1, wherein the interactive program animation database further comprises an interactive program navigation file, wherein the interactive program navigation file specifies a corresponding playback time at different playback time points. In the interactive video and audio content, the interactive program selector selects the corresponding interactive video and audio content at different playing time points according to the interactive program navigation file, and outputs the corresponding interactive video and audio content to the second video and audio decoder. 如申請專利範圍第1項所述的互動式影音播放系統,其中該多個互動影音內容包括至少一音評互動動畫,該至少一音評互動動畫是針對不同的該評價所作成的動畫。The interactive video playback system of claim 1, wherein the plurality of interactive audio and video content comprises at least one soundtrack interactive animation, and the at least one soundtrack interactive animation is an animation made for different evaluations. 如申請專利範圍第8項所述的互動式影音播放系統,其中該多個互動影音內容還包括至少一定時互動動畫,該定時互動動畫是在規定的播放時間點需播放的動畫。The interactive video and audio playback system of claim 8, wherein the plurality of interactive audio and video content further comprises at least a certain time interactive animation, wherein the timed interactive animation is an animation to be played at a specified playing time point. 如申請專利範圍第1項所述的互動式影音播放系統,其中該互動節目動畫處理部還包括一移除背景部,接收從該互動節目選擇器所選擇的該互動影音內容,進行移除背景的處理,並輸出至該疊加器。The interactive video playback system of claim 1, wherein the interactive program animation processing unit further comprises a removal background portion, receiving the interactive audio and video content selected from the interactive program selector, and removing the background. Processing and output to the overlay. 如申請專利範圍第1項所述的互動式影音播放系統,其中該樂聲評分單元包括至少一麥克風輸入部,以接收至少一個該標的樂聲。The interactive video playback system of claim 1, wherein the music score unit comprises at least one microphone input to receive at least one of the target music. 如申請專利範圍第1項所述的互動式影音播放系統,還包括一輸入/輸出介面,以供一指令輸入到該影音處理單元,並供影音處理單元對該資料庫單元進行存取。The interactive video playback system of claim 1, further comprising an input/output interface for inputting an instruction to the video processing unit and for accessing the database unit by the video processing unit. 一種互動式影音播放方法,包括:載入一主節目影音內容,其中該主節目影音內容包括一背景音樂檔;載入一標準樂聲特徵檔,根據該標準樂聲特徵檔及該背景音樂檔的音量變化,使該標準樂聲特徵檔及該背景音樂檔的播放時間軸對齊;接收一標的樂聲,擷取該標的樂聲的特徵,並比較該播放時間軸對齊之後的該標準樂聲特徵檔與該標的樂聲的該特徵,以作成對該標的樂聲的評價;載入多個互動影音內容,並根據對該標的樂聲的該評價,從該多個互動影音內容中選擇一互動影音內容;以及把載入的該主節目影音內容與選擇的該互動影音內容疊加之後輸出。An interactive video and audio playback method includes: loading a main program audio and video content, wherein the main program video content includes a background music file; loading a standard music feature file, according to the standard music feature file and the background music file a volume change that aligns the standard music profile with the playback time axis of the background music file; receives a target music, captures the characteristics of the target music, and compares the standard music after the time axis alignment a feature file and the feature of the target music to make an evaluation of the target music; loading a plurality of interactive video content, and selecting one of the plurality of interactive audio and video contents according to the evaluation of the target music Interactive audio and video content; and outputting the loaded main program audio and video content and the selected interactive video content. 如申請專利範圍第13項所述的互動式影音播放方法,其中從該多個互動影音內容中選擇一互動影音內容的步驟包括:根據一評分動畫對照表來選擇該評價所對應的該互動影音內容,其中該評分動畫對照表規定出不同的該評價與該互動影音內容的對應關係。The interactive video and audio playback method of claim 13, wherein the step of selecting an interactive video content from the plurality of interactive audio and video content comprises: selecting the interactive video corresponding to the evaluation according to a rating animation comparison table Content, wherein the rating animation table specifies different correspondences between the evaluation and the interactive video content. 如申請專利範圍第13項所述的互動式影音播放方法,其中擷取該標的樂聲的該特徵的步驟包括,計算該標的樂聲的一音調特徵及一音量特徵之中至少一者,並對應作成對該標的樂聲的一音調評價及一音量評價之中至少一者。The interactive video playback method of claim 13, wherein the step of capturing the feature of the target music comprises calculating at least one of a tonal feature and a volume feature of the target musical sound, and Corresponding to at least one of a pitch evaluation and a volume evaluation of the target music. 如申請專利範圍第13項所述的互動式影音播放方法,其中於載入該主節目影音內容的步驟,還包括載入一歌詞檔,且把載入的該主節目影音內容與選擇的該互動影音內容疊加的步驟,還包括與該歌詞檔疊加,且作成對該標的樂聲的該評價的步驟包括,比較該歌詞檔與該標的樂聲的該特徵,以作成對該標的樂聲的一歌詞同步評價作為該評價。The interactive video playing method according to claim 13, wherein the step of loading the main program video content further includes loading an lyric file, and loading the main program video content and the selected one. The step of superimposing the interactive audio and video content further includes superimposing the lyrics file, and the step of making the evaluation of the target music includes comparing the lyric file with the feature of the target music to create the target music A lyrics synchronization evaluation was made as the evaluation. 如申請專利範圍第13項所述的互動式影音播放方法,其中載入該多個互動影音內容的還步驟包括:載入一互動節目導航檔,該互動節目導航檔指定出在不同的播放時間點所需對應播放的該互動影音內容;以及根據該互動節目導航檔從該多個互動影音內容選擇對應的該互動影音內容。The interactive video and audio playback method of claim 13, wherein the step of loading the plurality of interactive audio and video content comprises: loading an interactive program navigation file, the interactive program navigation file is specified at different playing time Selecting the interactive audio and video content corresponding to the playing; and selecting the corresponding interactive audio and video content from the plurality of interactive audio and video content according to the interactive program navigation file. 如申請專利範圍第17項所述的互動式影音播放方法,其中載入的該多個互動影音內容包括至少一音評互動動畫,該至少一音評互動動畫是針對不同的該評價所作成的動畫,且從該多個互動影音內容中選擇對應的該互動影音內容的步驟包括從該至少一音評互動動畫中選擇對應的該音評互動動畫。The interactive video and audio playback method of claim 17, wherein the plurality of interactive audio and video content loaded includes at least one soundtrack interactive animation, and the at least one soundtrack interactive animation is made for different evaluations. Animating, and selecting the corresponding interactive audio and video content from the plurality of interactive audio and video content comprises selecting a corresponding one of the soundtrack interactive animations from the at least one soundtrack interactive animation. 如申請專利範圍第18項所述的互動式影音播放方法,其中被載入的該多個互動影音內容還包括至少一定時互動動畫,該定時互動動畫是在規定的播放時間點需播放的動畫。The interactive video and audio playback method of claim 18, wherein the loaded plurality of interactive audio and video content further includes at least a certain time interactive animation, wherein the timed interactive animation is an animation to be played at a specified playing time point. . 如申請專利範圍第13項所述的互動式影音播放方法,其中把載入的該主節目影音內容與選擇的該互動影音內容疊加之前,還包括對已選擇的該互動影音內容進行去除背景的處理,且於疊加時,是把載入的該主節目影音內容與已去除背景的該互動影音內容疊加。The interactive video playing method according to claim 13 , wherein before the loading of the main program audio and video content and the selected interactive video content, the method further comprises: removing the background of the selected interactive audio and video content. Processing, and when superimposing, superimposing the loaded video content of the main program with the interactive video content of the removed background. 如申請專利範圍第13項所述的互動式影音播放方法,其中接收該標的樂聲的步驟包括接收至少一麥克風輸入。The interactive video playback method of claim 13, wherein the step of receiving the target music comprises receiving at least one microphone input. 如申請專利範圍第13項所述的互動式影音播放方法,其中擷取該標的樂聲的該特徵的步驟,包括按照一單位時間把該標的樂聲分割成多個部分來擷取,且對該標的樂聲的該評價為按照該單位時間而作成。The interactive video and audio playback method of claim 13, wherein the step of capturing the feature of the target music comprises dividing the target music into a plurality of parts according to a unit time, and This evaluation of the target music is made in accordance with the unit time. 如申請專利範圍第13項所述的互動式影音播放方法,其中作成對該標的樂聲的該評價之後,還包括當接收到一顯示分數的指令時,即時將該評價輸出到一顯示單元。The interactive video playback method according to claim 13, wherein after the evaluation of the target music is performed, the method further includes outputting the evaluation to a display unit when receiving an instruction to display the score.
TW98140002A 2009-11-24 2009-11-24 Interactive video playing system and method TWI382401B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW98140002A TWI382401B (en) 2009-11-24 2009-11-24 Interactive video playing system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW98140002A TWI382401B (en) 2009-11-24 2009-11-24 Interactive video playing system and method

Publications (2)

Publication Number Publication Date
TW201118855A TW201118855A (en) 2011-06-01
TWI382401B true TWI382401B (en) 2013-01-11

Family

ID=44935889

Family Applications (1)

Application Number Title Priority Date Filing Date
TW98140002A TWI382401B (en) 2009-11-24 2009-11-24 Interactive video playing system and method

Country Status (1)

Country Link
TW (1) TWI382401B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113470613A (en) * 2021-07-16 2021-10-01 北京达佳互联信息技术有限公司 Chorus sound mixing method and device, electronic equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200518040A (en) * 2003-11-28 2005-06-01 Mediatek Inc Method and apparatus for karaoke scoring
CN201035969Y (en) * 2007-04-29 2008-03-12 王文科 Image processing equipment of vocal accompaniment machine
TW200934199A (en) * 2008-01-30 2009-08-01 Inventec Besta Co Ltd On-line karaoke interactive system and method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200518040A (en) * 2003-11-28 2005-06-01 Mediatek Inc Method and apparatus for karaoke scoring
CN201035969Y (en) * 2007-04-29 2008-03-12 王文科 Image processing equipment of vocal accompaniment machine
TW200934199A (en) * 2008-01-30 2009-08-01 Inventec Besta Co Ltd On-line karaoke interactive system and method thereof

Also Published As

Publication number Publication date
TW201118855A (en) 2011-06-01

Similar Documents

Publication Publication Date Title
US20120014673A1 (en) Video and audio content system
JP2002287746A (en) Automatic musical composition device, automatic composition method, automatic composition program and memory medium
US20120309527A1 (en) Audio Visual Game System and Computer Implemented Game Method
Booth et al. More than Bollywood: Studies in Indian popular music
JP5151245B2 (en) Data reproducing apparatus, data reproducing method and program
JP3542821B2 (en) Karaoke device with features in video compositing system
TWI382401B (en) Interactive video playing system and method
JP6219750B2 (en) Singing battle karaoke system
US20110124412A1 (en) Media reproduction device
JP6110731B2 (en) Command input recognition system by gesture
JP3799359B2 (en) REPRODUCTION DEVICE, REPRODUCTION METHOD, AND PROGRAM
JP6642367B2 (en) Karaoke device and karaoke program
CN104219556A (en) Use method of four-soundtrack karaoke identification playing system
JP2008197268A (en) Data reproduction device, data reproduction method, and program
JP5342842B2 (en) Karaoke device that changes karaoke video works of choral songs according to the user's singing part
KR100973868B1 (en) Apparatus for matching video and lyric in Karaoke system
JP4128326B2 (en) GAME DEVICE, GAME DEVICE CONTROL METHOD, AND RECORDING MEDIUM CONTAINING THE PROGRAM
JP2003271158A (en) Karaoke device having image changing function and program
JP2000200089A (en) Communication karaoke sing-along system
JP4108887B2 (en) Karaoke device with dance game function
JP2008197272A (en) Data reproducer, data reproducing method and program
JP5039609B2 (en) Karaoke equipment
JP2008026674A (en) Karaoke on demand distribution system
JP2605454B2 (en) Karaoke equipment
JP4109631B2 (en) Music player

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees