TW408284B

TW408284B - Method and apparatus for displaying characters with voice therefore

Info

Publication number: TW408284B
Application number: TW87121312A
Authority: TW
Inventors: Jeff Song; Kuang-Shin Lin; Jian-Shiung Duan
Original assignee: Inventec Corp
Priority date: 1998-12-21
Filing date: 1998-12-21
Publication date: 2000-10-11

Abstract

The invention is a method for displaying characters with voice and apparatus therefore, which discloses a technique that determines the operation content for character display (such as color change or agitation) according to the character voice length of each character section to adjust the speed and rhyme of display operation automatically; according to the technique disclosed in the invention, it includes: a memory unit which stores the respective data of the characters and one table for the voice of characters (such as the vowel of English characters), a logical process unit which is used to look up the voice length corresponding to the presently displayed character from the voice length table corresponding to each character before scanning, and calculate the display operation speed of each word in the display with respect to the related data of other displays, display each word on the display with respect to the respective voice speed via a display unit (such as the vowel of English characters).

Description

408234 五、發明說明（1) 【發明之範圍】本發明係為一種伴隨發音顯示字幕的方法及其裝置，特別是一種適用於對字幕顯示操作的技術領域中，依據每個單字中字元的發音長度，加以計算每個單字的顯示速度，再對每個單字以各自的顯示速度進行顯示操作的方法。【發明之背景】目前，在一些娛樂或學習的光碟或軟件產品中，經常需要一種讓使用者一邊伴隨影像、聲音等媒體的播放，一邊對字幕進行跟讀、跟錄的功能。在跟讀、跟錄的同時需要對字幕進行變色掃描，以引導使用者讀出正確的語速。而在一些多媒體教學光碟產品（如BBC英語）中，所使用的方法是對每一字幕進行等速掃描，即按字幕中每個單字的顯示長度（或字母個數）來平均分配掃描時間，比如掃描字幕11 T h i s i s a b ο 〇 k ":假設整句發音即掃描時間是1秒，因此句共有1 1個字母，若按上述掃描方法，則每個字母分配的掃描時間是1 / 1 1秒，因此M Th i s ”這個單字的掃描時間是 1 / 1 1 X 4 = 4 / 1 1 秒，同理，"i s 11 、11 a11 、" b ο 〇 k M的掃描速度分別是2 / 1 1秒、1 / 1 1秒、4 / 1 1秒，由此可看出” T h i S ”與” a ”的掃描時間之比為4 : 1 ，很明顯地，這兩個單字的實際發音時間長度並沒有如此大的差距，按這種速度跟讀會覺得"Th i s ”太長，而” a"太短。因此這種方法的缺點是：掃描速度與自然語速（實際發音速度）不一致，導致使用者不能按正確語速跟讀字幕408234 V. Description of the invention (1) [Scope of the invention] The present invention relates to a method and a device for displaying subtitles with pronunciation, especially a technical field suitable for displaying subtitles in a technical field, based on the pronunciation of characters in each word. The method of calculating the display speed of each word, and then performing the display operation on each word at its own display speed. [Background of the Invention] At present, in some entertainment or learning optical discs or software products, a function is often required for users to read and record subtitles while playing media such as video and audio. When reading and recording, it is necessary to scan the subtitles to change the color to guide the user to read the correct speech rate. In some multimedia teaching CD-ROM products (such as BBC English), the method used is to scan each subtitle at the same speed, that is, to average the scan time according to the display length (or number of letters) of each single word in the subtitle. For example, scanning subtitles 11 T hisisab ο 〇k ": Suppose the pronunciation of the entire sentence, that is, the scanning time is 1 second, so the sentence has a total of 11 letters. If you use the above scanning method, the scanning time assigned to each letter is 1/1 1 Seconds, so the scan time for the word "M Th is" is 1/1 1 X 4 = 4/1 1 second. Similarly, " is 11 、 11 a11 、 " b ο 〇k M's scan speed is 2 / 1 1 second, 1/1 1 second, 4/1 1 second, it can be seen that the scan time ratio of "T hi S" to "a" is 4: 1. Obviously, the two single-word There is no such big difference in the actual pronunciation time length. Reading at this speed will feel that "Th is" too long and "a" is too short. Therefore, the disadvantage of this method is that the scanning speed and natural speech speed (actually Pronunciation speed) are inconsistent, causing users to fail to follow the correct speaking rate Subtitle

第4頁 408284 五、發明說明（2) 為了改善上述的缺點，習知需使用人工編輯方式，亦即由人工聽著字幕發音逐句進行控制並記錄變色的掃描速度，並且每一句字幕都要經過反覆調整，才能使掃描進度與自然語速相同，但很明顯地，此種工作非常繁複且工作量大。【發明之目的及概述】因此，本發明的主要目的在於提供一種可以伴隨發音顯示字幕的方法，本發明所揭露的方法可以自動調整掃描速度與節奏（亦即是前述的顯示操作速度），同時也可以引導使用者跟隨字幕的掃描速度而以自然語速進行跟讀或跟唱，可以改善習知使用人工編輯的變色掃描方式，需花費相當多的時間在調整掃描速度的不便。根據本發明之技術，其中揭露了一種可根據每一字幕中的字元（可為英文、中文或其它語言的字元）的發音長度來決定顯示的操作内容（如變色或跳現），以達到自動調整顯示操作之速度與節奏的技術；根據本發明所揭露的. 技術，包括有：提供一記憶單元，其中儲存有字幕的相關資料（包括有每一字幕段落中的句子、單字、及其相應的_ 發音符號、每一字幕段落的起始播放時間以及結束播放時間值）以及一字元的發音長度表（例如英文字母發音長度表），提供一邏輯處理單元，用以在未進行掃描之前，依照該字幕段落中每個單字（係由一個以上的字元所組成）從一字元的發音長度表中查出相應的發音長度單位數，再配合其它字幕的相關資料，而計算出字幕中每個單字的顯Page 4 408284 V. Description of the invention (2) In order to improve the above-mentioned shortcomings, it is necessary to use manual editing methods, that is, to listen to the pronunciation of the subtitles and control the scanning speed of color changes one by one. After repeated adjustments, the scanning progress can be made at the same speed as natural speech, but it is clear that this kind of work is very complicated and heavy. [Objective and Summary of the Invention] Therefore, the main object of the present invention is to provide a method for displaying subtitles with pronunciation. The method disclosed in the present invention can automatically adjust the scanning speed and rhythm (that is, the aforementioned display operation speed), and at the same time Users can also be guided to follow the scanning speed of subtitles to follow or sing at the natural language speed, which can improve the conventional color-changing scanning method using manual editing, which requires considerable time to adjust the inconvenience of scanning speed. According to the technology of the present invention, it is disclosed that a display operation content (such as color change or pop-up) can be determined according to the pronunciation length of characters in each subtitle (which can be English, Chinese or other language characters), so as to A technology for automatically adjusting the speed and tempo of the display operation according to the present invention. The technology includes the following: providing a memory unit in which related data of subtitles are stored (including sentences, words, and The corresponding _ pronunciation symbol, the start time and end time value of each subtitle paragraph) and a one-character pronunciation length table (such as the English alphabet sound length table) provide a logical processing unit for Before scanning, find out the corresponding number of pronunciation length units from the pronunciation length table of a character according to each single character (consisting of more than one character) in the subtitle paragraph, and calculate it in accordance with the relevant data of other subtitles. Display the display of each word in the subtitles

408284 五、發明說明（3) 示操作速度，透過控制一顯示單元對字幕中的每個單字依其各自的發音速度進行顯示操作（如變色或跳現處理）。為讓本創作之上述和其他目的、特徵和優點能更明顯易懂，下文特舉一較佳實施例，並配合所附圖式，作詳細說明如下：【圖式簡單說明】第1圖，係為本發明之伴隨發音顯示字幕的裝置的第一實施例方塊圖。第2圖，係為本發明之伴隨發音顯示字幕的裝置的第一實施例方塊圖。第3圖，係為本發明之伴隨發音顯示字幕的方法的作動流程圖。第4圖，顯示尚未對"Th i s i s s b ο 〇 k ”此字幕段落進行變色掃描。第5圖，顯示正在對"book”這個單字進行掃描。第6圖，顯示已對"This is s book"此字幕段落進行完變色掃描。【實施例說明】有關後續說明中的名詞意義先說明如下：像素點：為螢幕中構成影像的最小單位；單字的顯示長度：係指單字在螢幕上的顯示長度，其以像素點（p i X e 1 )為單位；掃描速度：其單位為毫秒/像素點（毫秒/ p i X e 1 )，係408284 V. Description of the invention (3) Display operation speed. By controlling a display unit, each word in the subtitle is displayed according to its own sounding speed (such as color changing or popping processing). In order to make the above and other purposes, features, and advantages of this creation more comprehensible, a preferred embodiment is given below in conjunction with the accompanying drawings for detailed description as follows: [Schematic description of the drawings] Figure 1, It is a block diagram of the first embodiment of the apparatus for displaying subtitles with pronunciation according to the present invention. Fig. 2 is a block diagram of a first embodiment of a device for displaying subtitles with pronunciation according to the present invention. Fig. 3 is an operation flowchart of the method for displaying subtitles with pronunciation in accordance with the present invention. Figure 4 shows that the "Thi s i s s b ο ○ k" color scan has not been scanned. Figure 5 shows that the word "book" is being scanned. Figure 6 shows that "This is s book" has been scanned for color changes. [Explanation of the embodiment] The meanings of the nouns in the subsequent description are explained as follows: Pixels: the smallest unit constituting an image on the screen; the display length of a word: the length of a word displayed on the screen, which is expressed in pixels (pi X e 1) is the unit; scanning speed: its unit is milliseconds / pixels (milliseconds / pi X e 1), which is

408234 五、發明說明（4) 指每掃描一個像素點所花費的時間。請參閱「第1圖」，其中揭露實現本發明之方法的裝置，其包括有：一記憶單元1 0 ，用以儲存字幕的相關資料，其中字幕可為英文、中文或是其它語言的字幕，而在本發明所揭露的實施例中則以英文字幕為例說明之，至於其它語言字幕的實施手段則與英文相類似，在此不另外多加詳談，在本實施例中將英文字幕的相關資料分別儲存成三個資料庫，分別是一字幕庫，如「表1 J所示，其中包含字幕段落中的英文句以及每一字幕段落的起始播放時間、結束播放時間；一字典庫，「如表2」所示，其中包含字幕段落中的英文單字及相對應的音標；以及一英文母音發音長度表，「如表3」所示，其中包括所有英文母音的發音長度單位數，而關於英文母音的發音長度單位數制定規則是：以母音【I】的發音長度為比對標準，將其定為1個發音長度單位（也可定為其它數值），再對其它母音的發音長度進行測量並與【I】的發音長度進行比較，則可以得到其它母音的發音長度數，當然在此並不限於一定要以母音【I】為比對標準，也可以其它母音為比對標準，至於是那一個母音，則視使用者而定。408234 V. Description of the invention (4) Refers to the time taken to scan each pixel. Please refer to "Fig. 1", which discloses a device for implementing the method of the present invention, which includes: a memory unit 10 for storing related data of subtitles, wherein the subtitles can be English, Chinese, or other language subtitles, In the embodiment disclosed in the present invention, English subtitles are used as an example. As for the implementation methods of subtitles in other languages, they are similar to English. I will not go into details here. In this embodiment, the English subtitles are related. The data is stored into three databases, each of which is a subtitle database, as shown in "Table 1 J, which contains the English sentences in the subtitle paragraphs, and the start and end playback time of each subtitle paragraph; a dictionary library, "As shown in Table 2", which contains the English words and corresponding phonetic symbols in the subtitle paragraphs; and an English vowel sound length table, as shown in "Table 3", which includes the number of pronunciation length units for all English vowels, and Regarding the number of vowel length units of English vowels, the rule is: take the vowel length of vowel [I] as the comparison standard, and set it as one vowel length unit (also Set to other values), and then measure the pronunciation length of other vowels and compare with the pronunciation length of [I], you can get the pronunciation length of other vowels. Of course, it is not limited to using the vowel [I] as The comparison standard can also be other vowels as the comparison standard. As for which vowel, it depends on the user.

_408284 五、發明說明（5) 表1」每一字幕段落起始時間（秒）結束時間（秒） This is a book. 15:00 16:30 That is a pencil. 18:00 19:35 表2」單字音標 a 【9】 book [buk】 is 【iz】 pencil 【p£ns!】 that 【紅t】 this 【仙】【…】_408284 V. Description of the invention (5) Table 1 ”The start time (seconds) and end time (seconds) of each subtitle paragraph This is a book. 15:00 16:30 That is a pencil. 18:00 19:35 Table 2 "Single word phonetic symbol a [9] book [buk] is [iz] pencil [p £ ns!] That [red t] this [sen] […]

第8頁 408234 五、發明說明（6) 「表3 母音母音發音長度單位數 i: 1.5 a: 1.4 Ό： 1.5 u: 1.5 孓 1.4 I 1 e 1 ae 1 Λ 1 0 1 u 1 a 1 el 1 al 1.3 Ol 1.3 su 1.3 au 1.3 Id 1.3 QB 1.3 ua 1.3 1111 408234 五、發明說明（7) 一邏輯處理單元3 0 ，用以從該記憶單元1 0中提取資料並依本發明所揭露之方法計算每個單字（係由一個以上的英文字母所組成者）的顯示操作速度； —顯示單元4 0 ，可為螢幕，液晶螢幕，觸控式螢幕或是其他功能類似之一者，用以對各個單字以各自的發音速度進行顯示操作（可為變色或跳現處理）。當然在上述的裝置中還可增加一些單元，以提升本發明之優點，例如可設置一輸出單元5 0 ，用以在顯示單元 4 0對字幕進行顯示操作的同時，輸出相對應的讀音，以教導使用者讀出正確的讀音：或是設置一内存記憶單元6 0 ，用以儲存顯示單元4 0已進行顯示操作之字幕段落的相關資料，以更增加邏輯處理單元3 0提取資料的速度，如「第2圖」所示。另外，若是為了要增加視覺或聽覺效果，可在記憶單元中 1 0儲存一MPEG (Movie Picture Expert Group ，一種影像壓縮格式標準）影像媒體，藉由顯示單元4 0或輸出單元5 0顯示或輸出相對應的影像或聲音，以當成導引晝面或背景音樂。現以「第1圖」的裝置，再配合「第3圖」的流程圖來說明其中整個裝置的作動情形：步驟1 :程序開始步驟2:將一字幕庫、一字典庫以及一字元的發音長度表（如英文母音的發音長度表）儲存至一記憶單元中，Page 8 408234 V. Description of the invention (6) "Table 3 Number of vowel vowel sound length units i: 1.5 a: 1.4 Ό: 1.5 u: 1.5 孓 1.4 I 1 e 1 ae 1 Λ 1 0 1 u 1 a 1 el 1 al 1.3 Ol 1.3 su 1.3 au 1.3 Id 1.3 QB 1.3 ua 1.3 1111 408234 V. Description of the invention (7) A logical processing unit 3 0 is used to extract data from the memory unit 10 and calculate according to the method disclosed in the present invention. Display speed of each single character (composed of more than one English letter);-Display unit 40, which can be a screen, LCD screen, touch screen, or one of other functions similar to each other Single words are displayed at their respective pronunciation speeds (can be changed color or pop-up processing). Of course, some units can be added to the above device to enhance the advantages of the present invention. For example, an output unit 50 can be provided for While the display unit 40 performs a display operation on the subtitles, a corresponding pronunciation is output to teach the user to read the correct pronunciation: or a memory storage unit 60 is provided to store the display unit 40 which has been displayed. Display the relevant data of the subtitle section of the operation to increase the speed of data extraction by the logical processing unit 30, as shown in "Figure 2". In addition, if it is to increase the visual or auditory effect, an MPEG (Movie Picture Expert Group, an image compression format standard) image medium can be stored in the memory unit 10, and displayed or output by the display unit 40 or the output unit 50. The corresponding image or sound is used as a guide to the day or background music. The operation of the entire device will be described with the device of "Figure 1" and the flow chart of "Figure 3": Step 1: Start the program Step 2: Put a subtitle library, a dictionary library, and a character The pronunciation length table (such as the pronunciation length table of English vowels) is stored in a memory unit.

第10頁五、發明說明（8) 將當前字幕段落號N設為1 ，其中若是在記憶單元中有儲存Μ P E G影像媒體時，可以在此開始播放媒體；步驟3 :邏輯處理單元會開始不停地將當前的時間與記憶單元中每一字幕段落的起始播放時間相比對，若是當前時間大於等於（>=)某一字幕段落的起始播放時間，則進行下一步驟，反之，則繼續執行步驟3 ;其中在此若有播放MPEG影像媒體時，邏輯處理單元會依照當前的播放時間與記憶單元中每一字幕段落的起始時間相比對，以判斷媒體播放時間是否大於等於（>=)其中一字幕段落的起始時間，若為是，進行下一步驟，若為否，則繼續執行此步驟3 ; 步驟4:顯示單元會顯示該字幕段落中所有的字元；步驟5 :邏輯處理單元會依照該字幕段落中每個單字 (係由一個以上的字元所組·成）從一字元的發音長度表中查出相應的發音長度，再配合其它字幕段落的相關資料 (例如字幕庫、字典庫的資料），從而計算出字幕段落中每個單字的顯示操作速度；步驟6 :顯示單元會對該字幕段落中每個單字以各自的發音速度進行顯示操作，此時如果有輸出單元，則此輸出單元會在顯示單元進行顯示操作的同時播出相對應的讀音或音樂；步驟7:邏輯處理單元會判斷該字幕段落是否為最後的字幕段落，若為是，則執行步驟9 ，若為否，則繼續下一步驟；Page 10 V. Description of the invention (8) Set the current subtitle paragraph number N to 1, where if the PEG image media is stored in the memory unit, the media can be played here; Step 3: The logic processing unit will start Stop comparing the current time with the start playback time of each subtitle section in the memory unit. If the current time is greater than or equal to (> =) the start playback time of a subtitle section, proceed to the next step, and vice versa , Then proceed to step 3; if there is an MPEG video media playing, the logical processing unit will compare the current playing time with the start time of each subtitle paragraph in the memory unit to determine whether the media playing time is greater than Equal to (> =) the start time of one of the subtitle paragraphs, if yes, proceed to the next step, if no, continue to this step 3; step 4: the display unit will display all the characters in the subtitle paragraph ; Step 5: The logical processing unit will find the corresponding pronunciation from the pronunciation length table of one character according to each single word in the subtitle paragraph (which is composed of more than one character). Length, together with the relevant data of other subtitle paragraphs (such as the data of the subtitle library and dictionary database), so as to calculate the display operation speed of each word in the subtitle paragraph; Step 6: the display unit will Display operations are performed at respective pronunciation speeds. At this time, if there is an output unit, the output unit will play the corresponding pronunciation or music while the display unit performs the display operation. Step 7: The logic processing unit will determine whether the subtitle paragraph is The last subtitle paragraph, if yes, go to step 9, if no, continue to the next step;

第11頁 408284 五、發明說明（9) 步驟8 :將字幕段落號N +1 = 2，回到步驟3 ; 步驟9 ·結束。其中關於步驟5從一字元的發音長度表計算每個單字之顯示操作速度的詳細步驟流程如下所述：其中為了便於了解下述公式的解釋，茲先將有關的符號作一解釋說明： C 字幕段落的播放時間 B :字幕段落的起始播放時間 S:字幕段落的播放長度 E :字幕段落播放的結束播放時間 A:該字幕段落令所有單字之發音長度單位個數之和 A1 :第1個單字的發音長度單位數 A2:第2個單字的發音長度單位數 A3:第3個單字的發音長度單位數Page 11 408284 V. Description of the invention (9) Step 8: Set the subtitle paragraph number N +1 = 2 and return to Step 3; Step 9 · End. The detailed steps for calculating the display operation speed of each word from the pronunciation length table of one character in step 5 are as follows: In order to facilitate the understanding of the following formulas, we will first explain the relevant symbols: C Subtitle paragraph playing time B: Subtitle paragraph starting playback time S: Subtitle paragraph playing length E: Subtitle paragraph playing end time A: This subtitle paragraph makes the sum of the number of pronunciation length units of all words A1: No. 1 Number of pronunciation length units per word A2: Number of pronunciation length units per second word A3: Number of pronunciation length units per third word

An :第η個單字的發音長度單位數 t :該字幕段落中一個字元發音長度單位的時間長度 t 1 :第1個單字的顯示操作時間 t 2 :第2個單字的顯示操作時間 t 3 :第3個單字的顯示操作時間 t η :第η個單字的顯示操作時間 1 1 :第1個單字的顯示長度 1 2 :第2個單字的顯示長度 i 3 :第3個單字的顯示長度 1 η :第η個單字的顯示長度An: the number of sound length units of the ηth character t: the time length of the sound length unit of a character in the subtitle paragraph t1: the display operation time of the first character t2: the display operation time of the second character t3 : Display operation time of the third character t η: Display operation time of the nth character 1 1: Display length of the first character 1 2: Display length of the second character i 3: Display length of the third character 1 η: display length of the ηth word

第12頁 408284 五、發明說明（ίΟ) V 1 第 1 個單字的顯示操作速度 V 2 第 2 個單字的顯示操作速度 V 3 第 3 個單字的顯示操作速度 V η 第 η 個單字的顯示操作速度步驟 1 計算該字幕段落的播放長度 ( S〕，其計算公式為： S = Ε - -B 步驟 2 依昭字元的發音長度表計算該字幕段洛所有單字的發音長度單位個數之和 ( A ) 此係由字典庫中找到每個單字的發音符號統計其包含的發音符號種類數量妷後通過查找字元的發音長度表計算其所包含的單字發音長度單位個數其計算公式為 A = A 1 + A 2 + A 3 + + A η 步驟 3 計算該字幕段落中一個字元發音長度單位的時間長度 ( t ) 其計算公式為 t = S / A 步驟 4 計算該字幕段 Α-Α 洛中每個單字的顯示操作時間其計算公式為 t 1 = A 1 X t t 2 = A 2 X t t 3 = A 3 X t t η = A η X t 步驟 5 計算該字幕段落中每個單字的顯示操作速度其計算公式為 ·· V 1 = 1 1 / t 1 V 2 1 2 / t 2 V 3 = 1 3 / t 3 V η = 1 η / t η 〇Page 12 408284 V. Description of the invention (ίΟ) V 1 Display operation speed of the first single character V 2 Display operation speed of the second single character V 3 Display operation speed of the third single character V η Display operation of the n single character Speed Step 1 Calculate the playback length (S) of the subtitle paragraph, which is calculated as: S = Ε--B Step 2 Calculate the sum of the pronunciation length units of all the words in the subtitle paragraph according to the pronunciation length table of the Zhao character (A) This system finds the pronunciation symbols of each word in the dictionary library and counts the number of types of pronunciation symbols it contains. Then, it searches the pronunciation length table of the character to calculate the number of units of pronunciation length contained in it. Its calculation formula is A = A 1 + A 2 + A 3 + + A η Step 3 The length of time (t) is calculated as t = S / A. Step 4 Calculate the display operation time of each word in the subtitle segment Α-Α. The calculation formula is t 1 = A 1 X tt 2 = A 2 X tt 3 = A 3 X tt η = A η X t Step 5 Calculate the display operation speed of each single word in the subtitle paragraph. The calculation formula is: V 1 = 1 1 / t 1 V 2 1 2 / t 2 V 3 = 1 3 / t 3 V η = 1 η / t η 〇

第13頁 408284 }内來iss}起預放為幕變幕每如 η的例s i^)的落播間螢的字算驟 1元施hllsM落段為時在續該計步 -單實"TTh色段幕能束先後示先算 .示一>=^''變幕字可結會讓顯需演 •顯以間要是字此秒，元要來，其 3由現時表匕此，5}單了色前， 1接，的戈b尋示1面示為顏之法、直程前IJMC找所前晝顯中的描方 2可過當，乍中1中導，其暗掃算 1此算斷爿喿η表其引時，較始計、因計判夺ql如C等秒字以該的 1 ，的元始I表，秒樂5單是而述 1關述單起亍Γ間5音1有此，上 C有上理的以從時1景第所在示照度度明處落落會放第背在的，所依長析說輯Mr -兀播為是時中顯 J， -不解楚邏早束間或此Ϊ洛明ffl度顯的清設字字理結時，，段更4速字元。更假一一處與的落秒幕能第描 11)單單知要，這這輯間出段5字程Γ掃 Η個示得了明ΜΙΓ.邏時播幕.此過如的奶每顯定為說okok先放始字6示描，字 Μ中與設以bobo首播開一 1顯掃落單： Μ其是部加aa，始定另第上色段一下Page 13 408284} Neilaiiss} pre-play as the screen change screen (such as η example si ^) the word calculation step of the broadcast room fire 1 yuan Shi hllsM falling segment is the time to continue the step-Shan Shi " TTh color segment curtain energy can be shown first and then counted. Show one > = ^ '' Changing the screen word can make the show need to be performed. • If the word is in this second, the yuan will come, and its 3 will be represented by the current table. 5} Go to the front of the color, 1 pick up, and go to show 1 on the other side as Yan Zhifa. Before going straight, IJMC finds the place 2 in the day before the display, which can be taken too seriously. 1 This calculation indicates that the time of the 爿喿 η table is compared with the time of the first count, the number of seconds such as C, such as C, and the beginning of the I. The second chart of 5 is only 1 and the second list is from 亍 Γ The 5th tone 1 has this, the upper C is reasonable, and it will be placed in the light from the location where the 1st scene is located. The long-distance analysis series Mr-Wubo is the time. J, -Understanding the clear logic of Chuluo early in the morning, or this clear-cut character in Luoming ffl, the paragraph is more 4-speed characters. Let ’s take a closer look at the falling second scene. 11) Just know what you want. This 5 episodes of this series can be seen from the beginning. It ’s clear when the logic is broadcast. In order to say okok, the first word 6 is shown, and the word M and the first broadcast with bobo will open a 1-sweep order: Μ It is a department plus aa, let ’s set another color segment.

第14頁 408284 五、發明說明（12) = 1 + 1 + 1 + 1.5 = 4.5 ； 3 、此字幕段落中一個母音長度單位的時間長度（t )=S/A =1.5/4.5 = 0.33 秒； 4 、該字幕段落中每個單字的掃描時間：Page 14 408284 V. Description of the invention (12) = 1 + 1 + 1 + 1.5 = 4.5; 3. The time length of a vowel length unit in this subtitle paragraph (t) = S / A = 1.5 / 4.5 = 0.33 seconds; 4. The scanning time of each word in the subtitle paragraph:

This ：掃描時間（t 1 ) = 1 X 0 . 3 3 = 0 _ 3 3 秒； i s :掃描時間（t 2 ) = 1 X 〇 . 3 3 = 0 3 3 秒； a :掃描時間（t 3 )二 1 X 0 . 3 3 = 0 . 3 3 秒； book :掃描時間（t 4 ) =1.5x0. 33 = 0.5 秒； 5 、每個單字的顯示長度分別為： T h i s ·_ 1 1 = 2 0個像素點； i s : 1 2 = 1 0個像素點； a : 1 3 = 5個像素點； book : 1 4=20個像素點；因此每個單字的掃描速度分別為：This: scan time (t 1) = 1 X 0. 3 3 = 0 _ 3 3 seconds; is: scan time (t 2) = 1 X 〇. 3 3 = 0 3 3 seconds; a: scan time (t 3 ) 2 1 X 0. 3 3 = 0.3 3 seconds; book: scan time (t 4) = 1.5x0. 33 = 0.5 seconds; 5. The display length of each single word is: T his · _ 1 1 = 20 pixels; is: 1 2 = 10 pixels; a: 1 3 = 5 pixels; book: 1 4 = 20 pixels; therefore, the scanning speed of each single word is:

This : V 1 = 2 0 / 0, 3 3 =像素點/16. 5 毫秒； is : V 2=10/0.33 =像素點/33 毫秒； a : V 3=5/0. 33 =像素點/66毫秒；以及 book : V 4 = 20/0. 5二像素點/25 毫秒。根據計算得到的掃描速度，顯示單元會分別以每 1 6. 5、3 3、6 6、2 5毫秒掃描一個像素點的速度對每個單字進行逐點掃描，其掃描過程如「第4、5、6圖」所示，其中尚未進行變色掃描之時，顯示單元會以暗色顯示將 "This is a book"此字幕段落顯示（如圊4所示），而進行變色掃描時會以較亮的顏色依續對每個單字掃描一次，This: V 1 = 2 0/0, 3 3 = pixels / 16. 5 ms; is: V 2 = 10 / 0.33 = pixels / 33 ms; a: V 3 = 5/0. 33 = pixels / 66 milliseconds; and book: V 4 = 20/0. 5 two pixels / 25 milliseconds. According to the calculated scanning speed, the display unit scans each single word point by point at the speed of scanning one pixel point every 16.5, 3, 3, 6, 6, and 25 milliseconds. The scanning process is as described in "4. As shown in Figures 5 and 6, when the color scan has not yet been performed, the display unit will display "This is a book" in a dark color (as shown in Figure 4). Bright colors are scanned once for each word,

第15頁 408284 五、發明說明（13) 如圖5所示，顯示單元已分別以每1 6. 5、3 3、6 6毫秒掃描一個像素點的速度對” Th i s π 、” i s n、" a "這三個單字進行變色掃描完畢，現正以2 5毫秒掃描一個像素點的速度掃描 n b ο 〇 k "這個單字，圖6則表示"b ο 〇 k ”這個單字已變色掃描完畢，亦即這一字幕段落的變色掃描過程已完全進行完畢Page 15 408284 V. Description of the invention (13) As shown in Fig. 5, the display unit has scanned the pixels at a speed of "Th is π", "isn", "" a " These three characters have been scanned for color change, and they are now scanning nb ο 〇k at a speed of 25 milliseconds to scan one pixel. Figure 6 shows that the word "&b; b ο 〇k" has changed color. Scanning is complete, that is, the color scanning process of this subtitle paragraph is completely completed

# ,at會方，，示其要例施定發可1'aTh統描式替顯，只C實界L 其中在上述掃描過程中，若是有設置一輸出單元時，由此輸出單元在顯示單元依序掃描” Th i s π 、” i s p、、"b ο o k "的同時輸出相對應的讀音。其中若在"T h i s i s a b ο 〇 k ”此字幕段落後尚還有” is a pencil"這一字幕段落（如表1所示）時，系根據此字幕段落的資料，再重複以上的記算方式與掃式，直到最後一個字幕段落為止。當然上述的變色掃描方式只是其中一種顯示操作方使用者端可視其需求，而改以其它的顯示操作方式代例如跳線或是其它的操作方式。另外，雖然本發明所揭露的實施例是對英文字幕進行操作，但這並不代表本發明的技術只能針對英文字幕它例如中文、日文或是其它的語言也都是可以實施，依照本發明所揭露之技術，再針對所選用的字幕種類如中文或日文），在實施方法上做些小修改，都可以，因此本發明之保護範圍當視後附之申請專利範圍所者為準。明之功效】#, at 会方，， Shows its examples can be issued in 1'aTh system description, only C real world L Where in the scanning process, if there is an output unit, the output unit in the display unit according to Sequential scan "Th is π", "isp,", " b ο ok " and output the corresponding pronunciation at the same time. Among them, if " T hisisab ο 〇k "is still a subtitle paragraph" is a pencil "(as shown in Table 1), based on the data of this subtitle paragraph, repeat the above calculation Mode and sweep until the last subtitle paragraph. Of course, the above-mentioned color-changing scanning method is only one of the display operators. According to their needs, the user terminal can change to other display operation methods such as jumpers or other operation methods. In addition, although the embodiments disclosed in the present invention operate on English subtitles, this does not mean that the technology of the present invention can only be implemented for English subtitles. For example, Chinese, Japanese, or other languages can also be implemented. According to the present invention The disclosed technology can be modified according to the type of subtitle used (such as Chinese or Japanese). Therefore, the scope of protection of the present invention shall be determined by the scope of the attached patent application. Ming effect

第16頁 408284Page 16 408284

第17頁Page 17

Claims

408284 六'申請專利範圍 1 、一種伴隨發音顯示字幕的方法，用以將當前顯示於顯示單元之字幕，按其中所含字元的發音速度控制其顯示之操作内容，包含： (1 )儲存一字幕庫、一字典庫以及一字元的發音長度表至一記憶單元中； (2 )判斷當前的時間是否大於等於某一該字幕段落的起始播放時間，若為是，進行下一步驟，若為否，則繼續執行此步驟； (3)顯示該字幕段落於一顯示單元； (4 )依照該字幕段落中每個單字所含的字元從該字元發音長度表中查出相應的發音長度，再配合其它字幕段落的相關資料，計算出字幕段落中每個單字的顯示操作速度； (5 )透過一顯示單元對該字幕段落中的每個單字依其各自的發音速度進行顯示操作；以及 (6 )判斷該字幕段落是否為最後的字幕段落，若為是、則結束作業，若為否，則返回至步驟（2 )° 2 、如申請專利範圍第1項所述之伴隨發音顯示字幕的方法，其中該顯示單元之顯示操作係為對該字幕進行變色或跳現處理。 '3 、如申請專利範圍第1項所述之伴隨發音顯示字幕的方法，其中該字元可為英文字元。 4 、如申請專利範圍第1項所述之伴隨發音顯示字幕的方408284 Six 'Patent Application Scope 1. A method for displaying subtitles with pronunciation, used to display the subtitles currently displayed on the display unit, and control the display operation content according to the pronunciation speed of the characters contained therein, including: (1) A subtitle database, a dictionary database, and a character's pronunciation length table into a memory unit; (2) judging whether the current time is greater than or equal to the starting playback time of a certain subtitle paragraph, and if yes, proceed to the next step, If not, continue with this step; (3) display the subtitle paragraph in a display unit; (4) find out the corresponding length from the character pronunciation length table according to the characters contained in each single word in the subtitle paragraph The length of the pronunciation, together with the relevant data of other subtitle paragraphs, calculate the display operation speed of each word in the subtitle paragraph; (5) Display each word in the subtitle paragraph according to its own pronunciation speed through a display unit ; And (6) determine whether the subtitle paragraph is the last subtitle paragraph, if yes, end the job, if no, return to step (2) ° 2, as applied Please refer to the method of displaying subtitles accompanied by pronunciation as described in item 1 of the patent scope, wherein the display operation of the display unit is to change the color or pop-up of the subtitles. '3. The method of displaying subtitles with pronunciation as described in item 1 of the scope of patent application, wherein the character can be an English character. 4. The method of displaying subtitles with pronunciation as described in item 1 of the scope of patent application

第18頁 408284 六、申請專利範圍法，其中該字元的發音長度表可為一英文母音發音長度表。 5 、如申請專利範圍第1項所述之伴隨發音顯示字幕的方法，其中取得該顯示速度的計算方法包括有： a 、取得該字幕段落的播放長度； b 、取得該字幕段落所有該字元的發音長度單位個數之和； c 、取得該字幕段落中一個字元發音長度單位的時間長度； d 、取得該字幕段落中每個單字的顯示時間；以及 e 、取得該字幕段落中每個單字的該顯示操作速度。 6 、如申請專利範圍第1項所述之伴隨發音顯示字幕的方法，其中該字幕庫包含每一字幕段落中的句子以及每一字幕段落的起始播放時間與結束播放時間值。 7 、如申請專利範圍第1項所述之伴隨發音顯示字幕的方法，其中該字典庫包含每一字幕段落中的所有單字及相對應的發音符號。 8 、如申請專利範圍第1項所述之伴隨發音顯示字幕的方法，其中該字元的發音長度表中包括所有字元的發音長度單位數。 9 、如申請專利範圍第8項所述之伴隨發音顯示字幕的方法，其中該字元的發音長度表係藉由下列方法完成的，包括有： A、選擇其中一個字元的發音長度設定為一標準值；Page 18 408284 6. The scope of patent application method, in which the pronunciation length table of the character can be an English vowel pronunciation length table. 5. The method for displaying subtitles accompanied by pronunciation as described in item 1 of the scope of patent application, wherein the calculation method for obtaining the display speed includes: a. Obtaining the play length of the subtitle paragraph; b. Obtaining all the characters of the subtitle paragraph The sum of the number of pronunciation length units; c, obtaining the time length of the pronunciation length unit of a character in the subtitle paragraph; d, obtaining the display time of each word in the subtitle paragraph; and e, obtaining each of the subtitle paragraphs This display operation speed for single words. 6. The method for displaying subtitles with pronunciation as described in item 1 of the scope of the patent application, wherein the subtitle library contains sentences in each subtitle paragraph and the start and end playback time values of each subtitle paragraph. 7. The method of displaying subtitles with pronunciation as described in item 1 of the scope of patent application, wherein the dictionary library contains all the words in each subtitle paragraph and the corresponding pronunciation symbols. 8. The method for displaying subtitles with accompanying pronunciation as described in item 1 of the scope of patent application, wherein the pronunciation length table of the character includes the number of pronunciation length units of all the characters. 9. The method for displaying subtitles accompanied by pronunciation as described in item 8 of the scope of the patent application, wherein the pronunciation length table of the character is completed by the following methods, including: A. Select the pronunciation length of one character to A standard value;

第19頁 408284 、申請專利範圍以及 B 、對其它字元的發音長度進行測量並與該標準值的發音長度進行比較，並記錄其它字元的發音長度值。 1 0 、一種伴隨發音顯示字幕的方法，用以將當前顯示於顯示單元之字幕，按其中所含字元的發音速度控制其顯示之操作内容，其中該方法包括： (1 )依照該字幕段落中每個單字所含的字元從一字元的發音長度表中查出相應的發音長度單位數，再配合其它字幕的相關資料，從而計算出字幕中每個單字的顯示操作速度；以及 (2 )透過一顯示單元對該字幕段落中的每個單字依其各自的發音速度進行該顯示操作。 11、如申請專利範圍第ΓΟ項所述之伴隨發音顯示字幕的方法，其中該字元可為英文字元。 1 2 、如申請專利範圍第1 0項所述之伴隨發音顯示字幕的方法，其中該字元的發音長度表可為一英文母音發音長度表。 1 3 、如申請專利範圍第1 0項所述之伴隨發音顯示字幕的方法，其中該顯示單元之顯示操作可為對該字幕進行變色或跳現處理。 1 4 、如申請專利範圍第1 0項所述之伴隨發音顯示字幕的方法，其中該字元的發音長度表中包括所有字元的發音長度單位數。Page 19, 408284, the scope of patent application, and B. The pronunciation length of other characters is measured and compared with the pronunciation length of the standard value, and the pronunciation length values of other characters are recorded. 1 0. A method for displaying subtitles with pronunciation, used to display the subtitles currently displayed on the display unit, and control the operation content of the subtitles according to the pronunciation speed of the characters contained therein. The method includes: (1) According to the subtitle paragraph The characters contained in each single character in the character are used to find the corresponding number of pronunciation length units from the one-character pronunciation length table, and then cooperate with other subtitle-related data to calculate the display operation speed of each single character in the subtitle; and ( 2) The display operation is performed on each word in the subtitle paragraph according to its own pronunciation speed through a display unit. 11. The method for displaying subtitles with accompanying pronunciation as described in item Γ0 of the scope of patent application, wherein the character can be an English character. 12. The method for displaying subtitles with accompanying pronunciation as described in item 10 of the scope of patent application, wherein the pronunciation length table of the character can be an English vowel pronunciation length table. 13. The method for displaying subtitles with pronunciation as described in item 10 of the scope of patent application, wherein the display operation of the display unit may be to change the color of the subtitles or pop-up processing. 14. The method for displaying subtitles with accompanying pronunciation as described in Item 10 of the scope of patent application, wherein the pronunciation length table of the character includes the number of pronunciation length units of all the characters.

第20頁 408284 六、申請專利範圍 1 5 、如申請專利範圍第1 4項所述之伴隨發音顯示字幕的方法，其中該字元的發音長度表係藉由下列方法完成的，包括有： A、選擇其中一個字元的發音長度設定為一標準值 :以及 - B 、對其它字元的發音長度進行測量並與該標準值 · 的發音長度進行比較，並記錄其它字元的發音長度值。 1 6 、如申請專利範圍第1 0項所述之伴隨發音顯示字幕的方法，其中取得該顯示速度的計算方法包括有： a 、取得該字幕段洛的播放長度； b 、取得該字幕段落所有該字元的發音長度單位個數之和； c 、取得該字幕段落中一個字元發音長度單位的時間長度； d、取得該字幕段落中每個單字的顯示操作時間；-以及 e 、取得該字幕段落中每個單字的該顯示操作速 — 度。 1 7 、一種伴隨發音顯示字幕的裝置，用以將當前顯示於顯示單元之字幕，按其中包含字元的發音速度控制其顯示之操作内容，其中該裝置包括有：一記憶單元，用以儲存該字幕的相關資料，其中至少包括一字幕庫、一字典庫以及一字元的發音長Page 20, 408284 VI. Patent application scope 15, the method for displaying subtitles with accompanying pronunciation as described in item 14 of the patent application scope, wherein the pronunciation length table of the character is completed by the following methods, including: A 1. Select the pronunciation length of one of the characters and set it to a standard value: and-B. Measure the pronunciation length of other characters and compare it with the standard value · and record the pronunciation length of the other characters. 16. The method for displaying subtitles accompanied by pronunciation as described in Item 10 of the scope of patent application, wherein the calculation method for obtaining the display speed includes: a. Obtaining the playback length of the subtitle segment; b. Obtaining all of the subtitle segment The sum of the number of pronunciation length units of the character; c. Obtaining the time length of the pronunciation length unit of a character in the subtitle paragraph; d, obtaining the display operation time of each single word in the subtitle paragraph; and e, obtaining the The speed of this display operation for each word in a subtitle paragraph—degrees. 17. A device for displaying subtitles with pronunciation, used to display the subtitles currently displayed on the display unit, and control the operation content of the subtitles according to the pronunciation speed of the characters contained therein. The device includes: a memory unit for storing The subtitle-related information includes at least a subtitle library, a dictionary library, and a character's pronunciation length

第21頁 408284 六、申請專利範圍度表，一邏輯處理單元，用以計算該字幕段落中每個單字的顯示操作速度，以及 —顯示單元，用以對該字幕段落中的每個單字依其各自的發音速度進行顯示操作。 1 8 、如申請專利範圍第1 7項所述之伴隨發音顯示字幕的裝置，其中該字元可為英文字元。 1 9 、如申請專利範圍第1 7項所述之伴隨發音顯示字幕的裝置，其中該字元的發音長度表可為一英文母音發音長度表。 2 〇、如申請專利範圍第1 7項所述之伴隨發音顯示字幕的裝置，其中該字幕庫包含每一字幕段落中的句子以及每一字幕段落的起始播放時間與結束播放時間〇 " 2 1 、如申請專利範圍第1 7項所述之伴隨發音顯示字幕的裝置，其中該字典庫包含每一字幕段落中的所有單字及其相應的發音符號。 2 2 、如申請專利範圍第1 7項所述之伴隨發音顯示字幕的裝置，其中該字元的發音長度表中包括所有字元的發音長度單位數。 2 3 、如申請專利範圍第2 2項所述之伴隨發音顯示字幕的裝置，其中該字元的發音長度表係藉由下列步驟完成的，包括有： A、選擇其中一個字元的發音長度設定為一標準Page 21 408284 VI. Patent application scope table, a logical processing unit for calculating the display operation speed of each word in the subtitle paragraph, and a display unit for each word in the subtitle paragraph according to it Display operations are performed at respective pronunciation speeds. 18. The device for displaying subtitles with pronunciation as described in item 17 of the scope of patent application, wherein the character can be an English character. 19. The device for displaying subtitles accompanied by pronunciation as described in item 17 of the scope of patent application, wherein the pronunciation length table of the character can be an English vowel pronunciation length table. 2 〇 The device for displaying subtitles with pronunciation as described in item 17 of the scope of the patent application, wherein the subtitle library contains sentences in each subtitle paragraph and the start and end playback time of each subtitle paragraph. 0 " 2 1. The device for displaying subtitles with pronunciation as described in item 17 of the scope of the patent application, wherein the dictionary library contains all words in each subtitle paragraph and their corresponding pronunciation symbols. 22. The device for displaying subtitles with pronunciation as described in item 17 of the scope of patent application, wherein the pronunciation length table of the character includes the number of pronunciation length units of all the characters. 2 3. The device for displaying subtitles with pronunciation as described in item 22 of the scope of patent application, wherein the pronunciation length table of the character is completed by the following steps, including: A. Select the pronunciation length of one character Set as a standard

第22頁 408284 六、申請專利範圍值；以及 B 、對其它字元的發音長度進行測量並與該標準值的發音長度進行比較，並記錄其它字元的發音長度值。 2 4 、如申請專利範圍第1 7項所述之伴隨發音顯示字幕的裝置，其中該裝置還可包含一輸出單元，用以在該顯示單元對字幕進行顯示操作的同時，輸出相對應的讀音。 2 5 、如申請專利範圍第1 7項所述之伴隨發音顯示字幕的裝置，其中該裝置還可包括一内存記憶單元，用以儲存已顯示之該字幕字幕段落的相關資料。 2 6 、如申請專利範圍第1 7項所述之伴隨發音顯示字幕的裝置，其中該顯示單元可為螢幕，液晶螢暮，觸控式螢幕或是其他功·能類似者。Page 22 408284 VI. Value of the scope of patent application; and B. Measure the pronunciation length of other characters and compare the pronunciation length with the standard value, and record the pronunciation length values of other characters. 24. The device for displaying subtitles with pronunciation as described in item 17 of the scope of patent application, wherein the device may further include an output unit for outputting corresponding pronunciations while the display unit performs a display operation on the subtitles. . 25. The device for displaying subtitles with pronunciation as described in item 17 of the scope of patent application, wherein the device may further include a memory memory unit for storing the related data of the subtitle and subtitle paragraphs that have been displayed. 26. The device for displaying subtitles with pronunciation as described in item 17 of the scope of patent application, wherein the display unit may be a screen, an LCD screen, a touch screen, or other similar functions.

第23頁Page 23