TW518890B - System and method for automatic content enhancement of multimedia output device - Google Patents

System and method for automatic content enhancement of multimedia output device Download PDF

Info

Publication number
TW518890B
TW518890B TW90105695A TW90105695A TW518890B TW 518890 B TW518890 B TW 518890B TW 90105695 A TW90105695 A TW 90105695A TW 90105695 A TW90105695 A TW 90105695A TW 518890 B TW518890 B TW 518890B
Authority
TW
Taiwan
Prior art keywords
media
content
output
user
data
Prior art date
Application number
TW90105695A
Other languages
Chinese (zh)
Inventor
Nevenka Dimitrova
Lalitha Agnihotri
Thomas F Mcgee
Nicholas J Mankovich
Original Assignee
Koninkl Philips Electronics Nv
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninkl Philips Electronics Nv filed Critical Koninkl Philips Electronics Nv
Application granted granted Critical
Publication of TW518890B publication Critical patent/TW518890B/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/26603—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25883—Management of end-user data being end-user demographical data, e.g. age, family status or address
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25891—Management of end-user data being end-user preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2668—Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4381—Recovering the multiplex stream from a specific network, e.g. recovering MPEG packets from ATM cells
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/454—Content or additional data filtering, e.g. blocking advertisements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/4667—Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782—Web browsing, e.g. WebTV
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64322—IP
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6582—Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/812—Monomedia components thereof involving advertisement data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
    • H04N7/165—Centralised control of user terminal ; Registering at central
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17345—Control of the passage of the selected programme
    • H04N7/17354—Control of the passage of the selected programme in an intermediate station common to a plurality of user terminals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Signal Processing For Recording (AREA)
  • Circuits Of Receivers In General (AREA)

Abstract

A media display system enhances content by recognizing patterns in the media signal and modifying the media signal responsively to the recognized patterns. For example, in a television broadcast environment, the media signal could be a television program. At one instant, the television could include a logo of a car company. The system would recognize the logo and correlate it with enhanced content stored locally or by using additional input. Based on user preferences (e.g., whether the user is interested in that particular car company) and the correlated enhanced content, the system would modify the broadcast signal in appropriate way. For example, the enhanced content could be a commercial video clip or the phone number of a local car dealer. The modification to the broadcast signal could, in such a case, include overlaying the local car dealer's number on the video signal or buffering the broadcast signal and playing the commercial video clip to perform content enhancement.

Description

518890518890

五、發明說明（1) 發明範疇 本發明與一種用來辨識數位影像中模式的視訊系統，尤 其丄ΐ啦明與α、隔離符號或連續符號（例如，視訊資料流中 文字字元及/或商標）以及根據使用者的偏好設定來顯示資 訊或播放關於符號夕Μ立μ β u ^ a ^ m 丁观之耷日的糸統有關。本發明也與一種用 來處理音訊輸入的备从士 、，_ 的糸統有關，諸如，臺詞、音樂或其他聲 音’並措由顯示二蒼士口 +從 貝成或播放關於音訊輸入的聲音來響應音 訊輸入。V. Description of the invention (1) The scope of the present invention The present invention relates to a video system for identifying patterns in digital images, especially doramin and alpha, isolation symbols or continuous symbols (for example, text characters in a video data stream and / or Trademarks) and display information or play back the system of the day of the symbol μ β u ^ a ^ m DING Guanzhi according to user preferences. The present invention also relates to a system for preparing audio input, such as lines, music, or other sounds used to process audio input, such as lines, music, or other sounds. To respond to audio input.

熟知技藝人士 ρ外A ,> 热知本文件中的文字辨識。可根據類似 的技術來辨識符妒。今# ^ rnrp. „ ^ P ^ ^ 文件知睹器及關聯的光學字元辨識 (OCR)軟體已廣泛谨田 _ , t . 達用亚已小所皆知。但是，對於視訊訊 框中文字與其他符 θ ^ ^ ^ ^ 仃就的偵測及辨識仍然是獨特的問題，並 1¾要完全不同於斜< 法。印刷文件中的』Πί 字之偵測及辨識的方 色文字，並且通於位於-貫背景(純紙)的單 心旦 ,L /、而要間易型門限演算法來分開文字與 月尔。相比之下，f , //X ,, 細小型視訊影像中的符號會遭遇到各種 布隹汛成份，包括不夸枷 動廿曰々々啼叮又&制的照明條件。再者’背景經常移 勤亚且付號可能有不· … 等。 +冋顏色、大小、方向、字型樣式等 Φ 發明背景 為觀眾提供教育藝 括：即時廣播、類值之視訊來源的少數例子包 或重複引起觀眾對4寺ί =帶及數位視訊。.這些來源可引起 知可能會鼓動觀眾對BMW⑧汽車的性能 面上顯示的BMW®商4或產品感興趣。例如’視訊晝Those skilled in the art ρwai A, > Know the text recognition in this document. Fu jealousy can be identified by similar techniques.今 # ^ rnrp. „^ P ^ ^ Document readers and associated Optical Character Recognition (OCR) software have been widely used, _, t. Darwin is known to all. However, for text in video frames The detection and recognition of θ ^ ^ ^ ^ and other characters is still a unique problem, and it is completely different from the oblique < method. The squared text of the "Πί" detection and recognition in printed documents, and In the single-hearted, L /, and -three-way threshold algorithm that separates text from the moon on a -through background (pure paper). In contrast, f, // X ,, in small video images The symbol will encounter a variety of cloth floods, including lighting conditions that are not exaggerated, and that the background is often shifted, and the number may not be ... etc. + 冋Color, size, orientation, font style, etc. Φ The background of the invention provides viewers with educational arts including: a few examples of real-time broadcasts, similar value video sources, or repetitions that cause viewers to listen to 4 temples = bands and digital video. These sources can be Informed BMW® dealers 4 or products that might arouse viewers to the performance of BMW⑧ cars Interested. For example, 'Video Day

518890 五、發明說明（2) 感興趣，或對當地或國内BM W⑰授權經銷商的地點感興 趣。 觀眾可能只有短暫的興趣並且很快忘記。觀眾可能不情 願對最近引發興趣採取行動，尤其如果採取行動會中斷對 目前節目播放的享受。例如，顯示可口可樂商標會引發對 一罐12盎司可口可樂中的卡路里熱量有興趣，但是不足以 刺激觀眾拿一罐可口可樂來找出此項資訊並滿足其興趣。 如果未立即著手進行，之後就會很快忘記。 發明概述 簡言之，本發明揭示一種增強内容之多媒體顯示系統， 其方式是辨識多媒體信號中的模式並響應所辨識之模式來 修改多媒體信號。例如，在電視廣播環境中，多媒體信號 可能是電視節目。有時候，電視可能包含汽車公司的商 標。本系統可辨識商標並將之與本機儲存的增強内容關 聯。根據使用者偏好設定（例如，使用者對特定汽車公司 感興趣）並關聯的增強内容，系統能夠用適當的方法來修 改廣播信號。例如，增強内容可能是商業廣告短片或當地 汽車經銷商的電話號碼。在此情況下，修改廣播信號可能 包括將當地汽車經銷商的電話號碼重疊在視訊信號上，或 者緩衝廣播信號並播放商業廣告短片。 本發明辨識視訊及/或音訊中的模式，並根據所辨識的 模式來擷取及輸出額外資訊。可使用各種已知的信號處理 技術的任何一種來辨識模式。本發明的方法會分類模式、 查詢資料庫中信號的識別類別並輸出對應於所辨識之類別518890 V. Description of Invention (2) Interested or interested in the location of local or domestic BM W⑰ authorized distributor. Viewers may have only a brief interest and soon forget it. Viewers may be reluctant to take action on recent interest, especially if action would interrupt the enjoyment of the current show. For example, displaying the Coca-Cola logo sparked interest in the calories in a 12-ounce can of Coca-Cola, but it was not enough to stimulate viewers to find a piece of Coca-Cola to find this information and satisfy their interest. If you don't start immediately, you will soon forget. SUMMARY OF THE INVENTION Briefly, the present invention discloses a multimedia display system for enhancing content by identifying a pattern in a multimedia signal and modifying the multimedia signal in response to the identified pattern. For example, in a television broadcast environment, the multimedia signal may be a television program. Occasionally, a television may include a trademark of a car company. The system recognizes trademarks and associates them with enhancements stored locally. Based on user preferences (for example, users interested in a particular car company) and associated enhanced content, the system can modify the broadcast signal in an appropriate way. For example, enhanced content might be a commercial or a phone number of a local car dealer. In this case, modifying the broadcast signal may include superimposing the phone number of the local car dealer on the video signal, or buffering the broadcast signal and playing a commercial commercial video. The present invention identifies patterns in video and / or audio, and retrieves and outputs additional information based on the identified patterns. Patterns can be identified using any of a variety of known signal processing techniques. The method of the present invention classifies the patterns, queries the identification categories of the signals in the database, and outputs the corresponding categories.

第7頁 518890 五、發明說明（3) 的額外内容與現行視訊/音訊信號，藉此來增強内容。例 如，如果在視訊資料流中辨識到汽車公司的商標並且在資 料庫中找到其對應的類別，則系統會找出對應於該商標的 額外資料，例如，當地經銷商的名稱及地址，並將此資料 以視訊資料流上的重疊文字形式輸出。可根據使用者的偏 好設定來自動系統的響應。例如，雖然可能使用系統所採 用之符號類別資料庫來分類汽車公司商標，但是使用者可 能對汽車沒興趣，並且會關閉一些總開始，所以不會發生 内容增強。使用者特有的偏好設定資料可採用配合總分類 資料庫使用之分開的資料庫形成，其中總分類資料庫包含 大量符號的分類資料，其中包含使用者不感興趣的資料。 或者，可利用使用者個人資料來建立符號分類資料庫，使 得資料庫中只儲存特定使用者感興趣的類別。後項的優點 在於可減少本機儲存的資料量。 申請中的美國專利申請案號0 9 / 3 7 0, 9 3 1、0 9/ 44 1，94 3及 0 9/44 1，949中發表用來分類視訊資料流中的符號（特別是 文字及文字區塊）之方法及裝置。前述的美國專利申請案 號將以提及的方式併入本文，就如同在本文中完全提出Y 基於實施本發明的目的，可採用辨識視訊資料流中符號的 同一方法或任何其他適合的方法。語音辨識是不斷精益求 精的成熟技術領域。可辨識語音的軟體已充分發展到可辨 識各種臺詞，特別是商標聲音或具有熟知特徵的聲音，諸 如與榖類早餐關聯之老虎Tony的著名聲音。語音辨識所使 用的同一基礎技術也適用於分類其他聲音。因此，還可分Page 7 518890 5. The additional content of the invention description (3) and the current video / audio signal to enhance the content. For example, if a car company's trademark is identified in the video stream and its corresponding category is found in the database, the system will find additional information corresponding to the trademark, such as the name and address of a local dealer, and This data is output as overlay text on the video data stream. The system's response can be automated based on user preferences. For example, although a database of symbol categories used by the system may be used to categorize car company trademarks, users may not be interested in cars and will close some general start-ups, so content enhancements will not occur. The user-specific preference setting data can be formed by using a separate database in conjunction with the general classification database. The general classification database contains a large number of symbolic classification data, which contains data that the user is not interested in. Alternatively, a user's personal data can be used to create a database of symbol classifications, so that only the categories of interest to specific users can be stored in the database. The latter item has the advantage of reducing the amount of data stored on the unit. U.S. Patent Application Nos. 0 9/3 7 0, 9 3 1, 0 9/44 1,94 3, and 0 9/44 1,949 published to categorize symbols in video streams (especially text) And text blocks). The aforementioned U.S. patent application numbers will be incorporated herein by reference, as if fully set forth herein. For the purposes of implementing the present invention, the same method of identifying symbols in a video stream or any other suitable method may be employed. Speech recognition is a mature technology area that is constantly improving. Speech-recognizing software has been fully developed to recognize various lines, especially trademark sounds or sounds with well-known features, such as the famous sound of the tiger Tony associated with 榖 breakfast. The same basic technology used for speech recognition is also applicable to classify other sounds. Therefore, it can be divided

第8頁 五、發明說明（4) 類汽車加速聲、 内容增強可辣^業廣告叮噹聲等等。 結，並且作為畫面斗广形式。例如，可調用網際網路連 用者指示出網際網^ =號或合成語音辭令等等，以便為使 統可提供允許使用結。然後，諸如Web-TV®之類的李 播放與所辨識之极=立即調用連結的支援。或者，系統可 其方式是利用複弋 < 有關的聲音羿輯。系統可自動運作， 統所辨識的符鱿^ =叶系統直接顯示資訊一次，以響應系 辨識到臺詞、辭U $陣列。還可利用程式來設計^二在 能模式包括所I員示或^曰日τ自動響應。例如，可辨識的可 音樂音符。所顯^ : Θ 所說的辭令、商標或一連串的 文字資訊、聲音貧訊可能係由與所辨識的模式相關的 (聲音、視覺等耸1 ^物體、面孔、圖片或任何媒體形成 可將資訊重疊在：： 其他貧訊所組成。 容，且同時接收額：：；面亡，使觀眾可繼續接收節目内 員外储存的貪訊。或者，可能自動緩衝儲 士 貝、机使額外内容不會干擾使用者享受進行中的 連縯鏡頭。美國專利申請案號5, 418, 576標題 「Television Receiver with Perceived Contrast — reduction in a Predetermined Area of a Picture where Text is Superimposed」中已發表在晝面上重疊文 字之方法的詳細說明。可採用同一技術來***其他的視覺 資訊，諸如，圖片、現有視覺資訊的變形（例如，圖像上 現有視覺範圍的浮雕）。 下列是本發明系統處理方式的範例。Page 8 V. Description of the invention (4) Acceleration sounds of automobile types, content enhancement, jingle of advertising, etc. Knot, and as a picture Dou Guang form. For example, the Internet user can be called to indicate the Internet ^ = sign or synthesized speech dictionaries, etc., in order to provide the system with the permission to use it. Then, Lee Play, such as Web-TV®, and the identified pole = immediately call the linked support. Alternatively, the system can do this by using the < related sound compilation. The system can operate automatically, and the system recognizes the character ^ = The system directly displays the information once, in response to the system identifying the lines and phrases U $ array. Programs can also be used to design the ^ two active modes including all the instructions or ^ day τ automatic response. For example, identifiable musical notes. Displayed ^: Θ The words, trademarks, or a series of textual information, sounds, and sounds may be related to the identified pattern (sound, visual, etc. ^ objects, faces, pictures, or any media can form information Overlaid on :: Other poor news. Content and simultaneous receiving amount ::; The death, so that the audience can continue to receive corruption news stored inside and outside the program. Or, it may automatically buffer the storage of spades and machines so that the extra content will not interfere with the use Those who enjoy continuous acting footage. US Patent Application No. 5, 418, 576 title "Television Receiver with Perceived Contrast — reduction in a Predetermined Area of a Picture where Text is Superimposed" has been published on the day Detailed description of the method. The same technique can be used to insert other visual information, such as pictures, deformations of existing visual information (for example, reliefs of existing visual range on images). The following is an example of the system processing method of the present invention.

518890 五、發明說明（5) 1·觀眾在電視螢幕上觀看Mercedes Benz⑧商業廣告。 系統透過視訊輸入來辨識M e r c e d e s商標，並藉由在電視螢 幕上重豐資訊的方式來顯示最新M e r c e d e s汽車相關資訊。 2·系統接收到右下方具有文字字元rMartifl Luther K 1 ng」的視訊輸入。系統辨識到這些字元是民權領袖的名 字並且播放其「I have a dream」演說的聲音剪輯。 3 ·糸統接收並處理音訊輸入，以辨識特定臺詞、辭令或 聲音。在一項範例中，處理Inte；[⑰c〇rp〇rati〇n的商標配 樂可觸發系統擷取Intel董事會成員的名字。當透過語音 轉文子轉換杰辨識時，音訊輸入Μ丨c r 〇 s 〇 f t⑱會觸發系統 掏取關於W i 1 1 i a m G a t e s I I I的個人資料。 4 ·另個範例是系統可辨識E i n s t e i n的面孔並自動取得 物理學W e b網站的連結。 5·例如’增強内容來源可能是Web統一資源定址器 (URLs)、web網頁、電影資料庫、股票交易資料庫、線上 購物型錄、博物館資訊、線上書店、字典或百科全書。 、可根據使用者的偏好設定，利用程式來設計系統所要辨 ，的顯示資訊及不同的模式。纟某些情況中，t好可限於 斤f 模式的數量，讓觀眾不會不斷看到其不感興趣的 題貧訊。此類的限制條件可採用限制每設定時間範圍的 曰應數量，或只響應所選取的特定模式。 在一項具體實施例中，可從網際網路下載可辨識的模式 ^ =存的對應資訊。在此方式中，可透過外部來源定期 ’、斤貝汛，以便將更新後的資訊提供給觀眾。可利用程式518890 V. Description of Invention (5) 1. The audience watched the Mercedes Benz⑧ commercial advertisement on the TV screen. The system uses the video input to identify the Merce c d e s trademark, and displays the latest Merce c d e s car-related information by means of heavy information on the TV screen. 2. The system receives a video input with the text character rMartifl Luther K 1 ng "at the bottom right. The system recognized these characters as names of civil rights leaders and played a sound clip of their "I have a dream" speech. 3. The system receives and processes audio input to identify specific lines, words, or sounds. In one example, processing Inte; [； c〇rp〇rati〇n's trademark soundtrack can trigger the system to capture the names of Intel board members. When voice recognition is converted, the audio input Μ 丨 c 〇 〇 〇 f t⑱ will trigger the system to extract personal information about Wi i 1 1 i a m G a t e s I I I. 4 · Another example is that the system can recognize the face of E i n s t e i n and automatically obtain a link to the website of Physics Web. 5. For example, the source of enhanced content may be Web Uniform Resource Locators (URLs), web pages, movie databases, stock exchange databases, online shopping catalogs, museum information, online bookstores, dictionaries or encyclopedias. According to the user's preference settings, the program can be used to design the display information and different modes to be identified by the system.纟 In some cases, t can be limited to the number of f-modes, so that viewers will not constantly see the poor news that they are not interested in. Such restrictions can be used to limit the number of responses per set time range, or only respond to the specific mode selected. In a specific embodiment, the recognizable pattern ^ = corresponding information stored can be downloaded from the Internet. In this way, you can regularly update the information from external sources to provide viewers with updated information. Available programs

518890 五、發明說明（6) 來設計系統要求使用者回應，並照著增強内容或更新個人 資料。或者，可利用程式來設計系統允許使用者在安裝程 序期間明確設定參數。 系統還可併入關閉此功能或登入功能的軟體開關，讓系 統能夠根據目前登入之使用者的偏好設定來運作。當單筆 辨識模式有一組以上資訊可供使用時，則使用者還可選擇 每筆模式輪入的顯示資訊類型。例如，如果系統具有所辨 識之T i f f any，s模式的地點資訊及股價資訊，則系統可根 據使用者的偏好設定來顯示其中一項可供使用的資訊或顯 示這兩項資訊。 除了為觀眾提供有用的資訊以外，對廣告商而言，系統 還具有直接向感興趣的使用者播出廣告的優點。因此，直 效廣告資訊可包括與所辨識的模式有關的產品或服務的特 殊價格。可透過網際網路來管理廣告商透過系統傳遞給使 用者視訊轉換器（Set Top Box)的内容。使用者將新内容 動態更新到視訊轉換器。·系統服務供應商可允許由内容廣 告商及某些顯示規則來進行動態更新。 可根據當季季節（例如，冬季不會本機儲存烤肉内容，…518890 V. Description of Invention (6) To design the system to require users to respond and to enhance the content or update personal information. Alternatively, the system can be programmed to allow users to explicitly set parameters during the installation process. The system can also incorporate software switches that turn this feature off or the login feature so that the system can operate according to the preferences of the currently logged in user. When more than one set of information is available in the single recognition mode, the user can also choose the type of display information to be rotated in each mode. For example, if the system has the identified location information and stock price information of the T f f any, s mode, the system can display one of the available information or both of them according to the user's preference settings. In addition to providing viewers with useful information, for advertisers, the system also has the advantage of showing ads directly to interested users. Therefore, direct advertising information may include special prices for products or services related to the identified patterns. The Internet can be used to manage the content that advertisers pass to the user's Set Top Box through the system. Users dynamically update new content to the video converter. • System service providers can allow dynamic updates by content advertisers and certain display rules. Depending on the season of the season (for example, winter will not store local barbecue contents, ...

而夏季不會本機儲存剷雪服務内容）、根據廣告商進行中 的廣告活動等等，以及根據使用者的本機偏好設定來動態 控制本機内容。 系統退可改或利用程式故意設計視訊或音訊輸入觸發 回應例士視σί1/音訊輸入供應商可提供強調可辨識之 模式的程式設言十，例如，在白色背景的晝面上放置所預期And in the summer, the content of the snow removal service is not stored locally), the local content is dynamically controlled according to the advertiser's ongoing advertising campaigns, etc., and according to the user's local preference settings. The system can be changed or the program can be designed to trigger on video or audio input intentionally. Response example Vision 1 / Audio input supplier can provide programs that emphasize recognizable patterns. For example, place the expected

518890 五、發明說明（7) 的視訊模式。可利用並作為可點選的連結來識別增強項 目，也就是本機儲存的項目、線上儲存的連線等等。此項 功能可能會受到顯示類型或某種其他參數（例如，幾點 鐘、頻道等等）影響，所以不會一直出現。例如，訪談節 目中的人穿著特定設計師所設計的名牌衣服，則可顯示於 何處購買該設計師商品的商店，或以其他方式來透過連結 來取得相關資訊。 將藉由本發明的較佳示範性具體實施例並參考附圖來說 明本發明，以便更完全明白本發明。 關於圖式，在此強調所顯示的特殊項目僅僅是藉由範例 以及作為解說本發明較佳具體實施例的圖解，並且，是為 了提供所認為最有用的範例及更容易瞭解本發明的說明及 概念觀點所提出的範例。就這一點而言，並未嘗試更詳細 提供根本瞭解本發明所需的本發明結構細節，以圖式為例 的說明可讓熟知技藝人士明白可實際具體化本發明的數種 形成。 圖式簡單描述 圖1顯示用來解說可用來實施本發明之組件的圖式。… 圖2顯示根據本發明一項具體實施例來實施本發明所使 用之功能元件的方塊圖。 圖3顯示根據本發明一項具體實施例之基本内容增強方 法的流程圖。 ， 圖4顯示可觸發内容增強之兩種可辨識符號的象徵性顯 示影像。518890 V. Video mode of invention description (7). It can be used as a clickable link to identify enhanced items, that is, items stored locally, connections stored online, and so on. This feature may be affected by the type of display or some other parameter (for example, time, channel, etc.), so it does not appear all the time. For example, when people in an interview program wear designer clothes designed by a particular designer, they can show where to buy the designer ’s goods, or use other links to get relevant information. The invention will be explained by means of preferred exemplary embodiments thereof with reference to the accompanying drawings in order to make the invention more fully understood. Regarding the drawings, it is emphasized that the particular items shown are merely examples and diagrams illustrating the preferred embodiments of the present invention, and are provided to provide the most useful examples and to make it easier to understand the description and Paradigm presented by conceptual point of view. In this regard, no attempt has been made to provide the structural details of the present invention required for a fundamental understanding of the present invention in more detail. The illustrations using the drawings as examples can make those skilled in the art understand that several forms of the present invention can be practically embodied. Brief Description of the Drawings Figure 1 shows a drawing that illustrates components that can be used to implement the invention. … FIG. 2 shows a block diagram of functional elements used to implement the present invention according to a specific embodiment of the present invention. FIG. 3 shows a flowchart of a basic content enhancement method according to a specific embodiment of the present invention. Figure 4 shows a symbolic display image of two identifiable symbols that can trigger content enhancement.

第12頁 518890 五、發明說明（8) 圖5顯示用來解說一種增強内容 體顯示的方法，用以在視訊影像上不/中斷進行中多媒 徵性顯示影像。 更®顯示web網站的象 圖6顯示用來解說另一種增強内办 媒體顯示的方法，用以在視訊影像不晶曰中一斷進行中多 (Picture - In-Picture)顯示幕上§員-广一、、、員7r的晝中晝 示影像。 .、、、l7Fweb網站的象徵性顯 圖式詳細說明 考圖1，可配合具有網際網路功能的電 用本發明。在圖1所示的呈體實 兄木 1扁、、， J /、虹貝她例中，電腦24 0將節目資 Λ傳送到電視2 3 〇。電腦2 4 0能夠技w、日 ._ 、 约接收視訊信號270並控制 功此，以及提供網際網路瀏覽器功能。可經由記 或磁碟22〇、遙控器21Q(經由紅外線（IR)連接淳215 妾）或鍵盤212或經由網路連線下載命令，並將命令輸入 到=腦24G中。資料連結26G提供網際網路連線，而天線、 電、’見線或衛星連結2 7 〇提供音訊及/或視訊資料。這可能是 3連接到網際網路服務供應商的電話線或某種其他適用的 貧料連接。請注意，資料連結2 6 0及音訊/視訊連結270可^ · 包括相同的實體頻道。電腦240最好具有大量儲存裝置 2 3 2例如’硬碟機），用以儲存節目時間表資訊、應用程 式旦升、’及以及其他資訊。可經由諸如記憶體卡或磁碟2 2 0 之類的可抽換式媒體，將關於使用者偏好設定及其他資料 的貧訊上載到電腦2 4 0。 請注意’前面的示範性硬體環境有許多代替方案，並且 518890 五、發明說明（9) 所f的代替方案都可配合 有處理功能的視訊轉換器。^ :起使用。電腦可能是具 記憶體來取代大量儲存裝 。發性記憶體或非揮發性 資料。事實上，可用透過遠二^ =本機或遠端方式來儲存 取代整個電腦24〇。這些、，D。。碓站方式運作的伺服器來 不同於載送視訊的實體頻二可透—過資料頻道2 6 0 (可能 而不是使用遙控器21〇或鍵般°二贯體頻道）傳送命令， 2 4 0。可藉由電纜線、衛星、〃 ^ °卩，傳廷到電腦 頻道，或是從大量儲存裝、可1RF)或任何其他的實體 訊27。或其他内容。可利置或可：換式儲存媒體來載送視 頻道、諸如ATM的虛擬之類的交換式實體 其他網路來載送視訊270或其他内容。二 式並且容許漏失訊息，所以可使用現代的_路疋非另门二 可用來接收程式設計内容的線路内容可能是音訊、交談資 料、web網站或可能進行各種選擇的任何其他種類的内、 容。可透過除了分開的資料連結2 6 〇之外的頻道接收資 料。例如，可透過與視訊或其他内容相同的實體頻道來接 收資料。甚至於可透過諸如記憶卡或磁碟22〇之類的可抽I 換式資料儲存裝置來提供資料。可用鍵盤、語音命令介 面、3 D滑鼠、控制桿或任何其他適用的輸入裝置來取代遙 控器2 1 0。進行選擇的方式可能是移動反白的指示項、識 別象徵性選擇（例如，藉由名稱或號碼），_或是透過資料傳 輸或經由可抽換式媒體的批次形成進行選擇。在後者的情 況中，一項或一項以上的選取内容可能以某種形式儲存或 518890 五、發明說明（ίο) 傳輸到電腦2 4 0中，而完全忽略顯示幕丨7 〇。例如，批次資 料可來自於攜帶型儲存裝置（例如，個人數位助理、記憶 卡或智慧卡或下載）。此類的裝置中可能已儲存配合各種 環境使用的許多偏好設定，以自訂要使用的電腦設備。 在圖1的具體實施例中，廣告商使用者介面以廣告商用 戶端處理序1 7 0的形成將資料提供給主伺服器丨7 5。主伺服 為1 7 5傳送資料給電腦2 4 〇，由電腦將此資料有選擇地儲存 在本機資料儲存體上，例如，磁碟2 3 5。廣告商用戶端處 理序1 7 0可經由劉覽器作業階段實施，在此期間，想要透 過本發明一項具體實施例所提供的直效廣告頻道來提供内 容增強的廣告商可上載包含多媒體内容及各種控制資料的 貪料。所上載的資料係儲存在服務主伺服器丨7 5上，用以 控制並定期更新觀眾系統2〇〇。 清蒼考圖2 ’某些來源3丨〇會將視訊、音訊及/或其他媒 體貝料供應給輸出裝置3 5 0。硬碟錄影機、可讀寫型影音 ，碟機（DVD-RW)或WebTV轉換器或多媒體輸出組合器/交換 口口/、、爰衝☆ / 用戶端（Media 〇utpUt c〇mbiner/Switch/ Buf/er/Client) 3 9 0會傪改、置換及/或儲存多媒體信號 功$連接電腦24 0的視訊轉換器（圖中未顯示）可提供後項 力此、付號分類為、3 3 0接收媒體資料並剖析信號，以搜尋 可辨f的元素。這些元素可能是圖形影像、影像、音訊序 ，、聲紋或任何其他分類的信號。符號分類器3 3 〇將類別 識別項輸出到增強内容處理器3 6 〇。使用者個人資料庫3 2 〇 儲存關於可顯示之增強多媒體内容的使用者偏好設定。例Page 12 518890 V. Description of the invention (8) Figure 5 shows a method for enhancing the display of the content, which is used to display the video on the video without interruption / interruption. Show more like a web site. Figure 6 shows another way to enhance the display of the internal media display, which is used to display a picture-in-picture picture on the video screen. Day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, month, month, month, month, month, month, month, month, month, month, month, month, month, month, month, month, month, month, day to day, day to day of the 7th member of the Hiroichi. . ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, During, Up, and Designing the Symbolic Schematic Diagram of the 7Fweb Site, Figure 1, can be used in conjunction with the Internet-enabled power invention. In the example shown in FIG. 1, Xiong Mu 1, Bian, J, and Hongbei, the computer 24 0 transmits the program data Λ to the TV 2 3 0. The computer 240 can receive video signals 270, control them, and provide Internet browser functions. Commands can be downloaded via the magnetic disk 22, remote control 21Q (connected to 215 妾 via infrared (IR)) or the keyboard 212, or via a network connection, and the commands can be entered into the brain 24G. The data link 26G provides an Internet connection, while the antenna, power, 'line or satellite link 270 provides audio and / or video data. This may be a telephone line connected to an Internet service provider or some other suitable lean connection. Please note that data link 260 and audio / video link 270 may include the same physical channel. The computer 240 preferably has a large number of storage devices 2 3 2 (e.g., a ' hard disk drive) for storing program schedule information, application programs, ' and other information. Poor information about user preferences and other data can be uploaded to a computer 2 4 0 via removable media such as a memory card or disk 2 2 0. Please note that there are many alternatives to the previous exemplary hardware environment, and the alternatives described in (5) of 518890 can be used with video converters with processing functions. ^: From use. The computer may have memory instead of a mass storage device. Memory or non-volatile data. In fact, it can be stored locally or remotely to replace the entire computer 24. These, D. . The server operating in the station mode is different from the physical frequency of the video transmission. It is transparent—transmitting commands through the data channel 2 60 (possibly instead of using the remote control 21 ° or the key channel), 2 4 0 . It can be transmitted by cable, satellite, 〃 ^ ° 卩, to the computer channel, or from mass storage, 1RF) or any other physical communication27. Or other content. Can be used or can be: swappable storage media to carry video channels, exchangeable entities such as ATM virtual other networks to carry video 270 or other content. Type 2 and allows missing information, so you can use modern _ 疋 疋 non-other two. The line content that can be used to receive programming content may be audio, chat data, web sites or any other kind of content that may make various choices. . Data can be received through channels other than separate data links 26. For example, data can be received through the same physical channel as video or other content. It is even possible to provide data through a removable data storage device such as a memory card or magnetic disk 22. The remote control 2 1 0 can be replaced with a keyboard, voice command interface, 3D mouse, joystick or any other suitable input device. The choice can be made by moving highlighted indicators, identifying symbolic choices (for example, by name or number), or by data transfer or by batch formation of removable media. In the latter case, one or more of the selected content may be stored in some form or 518890. 5. The description of the invention (ίο) is transmitted to the computer 240, and the display screen is completely ignored. For example, batch data can come from portable storage devices (for example, personal digital assistants, memory cards or smart cards or downloads). Many of these devices may have preferences stored in them to customize the computer equipment to be used. In the specific embodiment of FIG. 1, the advertiser user interface provides data to the host server 75 using the formation of the advertiser client processing sequence 170. The main server sends data to the computer 24 0 for 175, and the computer selectively stores the data on the local data storage, such as disk 2 35. Advertiser client-side processing sequence 170 can be implemented through the operation phase of the Liu browser. During this period, advertisers who want to provide enhanced content through direct-effect advertising channels provided by a specific embodiment of the present invention can upload multimedia content. Content and various control information. The uploaded data is stored on the service master server 75, which is used to control and regularly update the audience system 2000. Qing Cang examines Figure 2 'Some sources 3 丨 〇 will supply video, audio and / or other media shell materials to the output device 3 50. Hard disk video recorder, rewritable video and audio, DVD player (DVD-RW) or WebTV converter or multimedia output combiner / exchange port / ,, 爰 ☆ / Client (Media 〇utpUt c〇mbiner / Switch / Buf / er / Client) 3 9 0 will modify, replace, and / or store multimedia signal functions. $ The video converter (not shown in the figure) connected to the computer 24 0 can provide the latter power. The pay number is classified as 3 3 0 Receives media data and analyzes signals to search for recognizable elements of f. These elements may be graphic images, images, audio sequences, voiceprints, or any other classified signal. The symbol classifier 3 3 0 outputs the category identification item to the enhanced content processor 3 6 0. The user profile database 3 2 0 stores user preferences regarding displayable enhanced multimedia content. example

第15頁 518890 五、發明說明（11) 如’使用者個人資料可包含指示使用者對跑車感興趣並且 不介意中斷廣播媒體以便從涉及跑車的廣告商接收增強内 容。增強内容處理器3 6 0將來自於符號分類器的類別識別 項傳送給類別/增強内容關聯性資料庫3 7 0，以尋找增強内 容資料庫3 4 0中所包含之多媒體内容的指標。類別識別項 與增強内容資料庫3 4 0中所包含之多媒體内容的指標會組 合來自於使用者個人資料庫3 2 0的使用者個人資料，以決 定是否應進行内容增強。這是由增強内容處理器3 6 〇負責 進行決萊並產生控制蒼數’用以指不組合要傳送到增強内 容輸出控制器3 9 5之增強内容與媒體資料的内容及指令。 接著，增強内容輸出控制器3 9 5採用來自於增強内容資料 庫340的增強内容，產生多媒體輸出組合器/交換器39〇的 ，令，以響應來自於增強内容處理器的指令及來^於輸入 裝置35 5的命令。然後，增強内容輸出控制器3 9 5輸出所選 出的夕媒版内谷及多媒體輸出組合器/交換器Μ 〇的指令， ^ Ϊ改媒體資料流，之後才在輸出裝置350上顯示媒 =二使用者輸入裝置355也允許更新使用者個人資 料庫3 2 0中的使用者個人資料。 … —:?分類器可利用任何適合的機件來分類媒體資料信號 貝枓。例如，可使用申請中的美國 0 9/ 3 70, 9 3 1、〇q/441 n， 月木 ι “41，94 3及0 9/4 4 1，94 9中所發表之用來分 = = t ;中的符號(特別是文字及文字區塊)之方法， 虻’ $ ^項專利申請中所發表之中立網路方法及系統 杈仏。g辨識是不斷精益求精的成熟技術領域。可辨識Page 15 518890 V. INTRODUCTION TO THE INVENTION (11) For example, 'user profile may contain instructions indicating that the user is interested in sports cars and does not mind interrupting the broadcast media in order to receive enhanced content from advertisers involved in sports cars. The enhanced content processor 3 6 0 transmits the category identification items from the symbol classifier to the category / enhanced content relevance database 3 7 0 to find an index of the multimedia content contained in the enhanced content database 3 4 0. The category identifier and the multimedia content indicators included in the enhanced content database 3 4 0 will be combined with the user personal data from the user personal database 3 2 0 to determine whether content enhancement should be performed. This is where the enhanced content processor 36 is responsible for performing the decision and generating the control number ′ to refer to the content and instructions of the enhanced content and the media data to be transmitted to the enhanced content output controller 3 95. Next, the enhanced content output controller 395 uses the enhanced content from the enhanced content database 340 to generate a multimedia output combiner / exchanger 39, which responds to instructions from the enhanced content processor and from Enter a command for device 35 5. Then, the enhanced content output controller 3 9 5 outputs the command of the selected media version of the inner valley and the multimedia output combiner / exchanger M 0, and changes the media data stream before displaying the media on the output device 350 = 2 The user input device 355 also allows updating the user profile in the user profile database 320. … — :? The classifier can use any suitable mechanism to classify media data signals. For example, the US 0 9/3 70, 9 3 1, 0q / 441 n, moon wood “41,94 3 and 0 9/4 4 1,94 9 in the application can be used to divide = = t; the method of symbols (especially text and text blocks), 虻 '$ ^ neutral network methods and systems published in patent applications. g identification is a mature technology field that continuously strives for excellence. Recognizable

第16頁 518890 五、發明說明（12) 語音的軟體已充分發展到可辨識各種臺詞。符號分類器 3 3 0可使用相同或相關的信號處理技術，例如，可用來識 別特別個中的語音之聲紋技術。類別可能是商標聲音或具 有熟知特徵的聲音’諸如與穀類早餐關聯之老虎Τ ο n y的者 名聲音。還可定義汽車加速聲、商業廣告叮噹聲等等之類 聲音的類別。 使用者個人資料庫3 2 0可包含各種使用者可修改參數的 任一項，這些參數可用來告知圖2所示之具體實施例中使 用的控制處理序。使用者個人資料可包含下列或其他適用 參數的任何參數。 1) 適用於諸如Web網站商業廣告、文字或音效剪輯等等之 類各種增強内容類型的增強技術，例如，個人資料可指示 a)是否應緩衝媒體資料並變更顯示内容，以調用對應於 所分類之多媒體元素的web網站； b )當在視訊影像上顯示we b網站顯示幕時，應使視訊影 像成為背景重像並繼績播放（請參閱有關圖5的說明）； c) 然後，應在顯示幕上放置可選取的連結（例如，使用 指標及遙控器2 1 0上的按鈕）； ―’ d) 晝中晝顯示幕（請參閱有關圖6的說明）上可顯示額外 内容，諸如商業廣告、w e b網站等等 e) 文字最好是重疊在高頻寬項目上，諸如商業廣告或訪 談節目 2) 允許將增強内容加入書籤以利未來顯示之用的儲存選 項0Page 16 518890 V. Description of the invention (12) The software for speech has been fully developed to recognize various lines. The symbol classifier 3 3 0 can use the same or related signal processing techniques, for example, a voiceprint technique that can be used to identify particular voices. The category may be a trademark sound or a sound with a well-known feature ' such as the name of a tiger τ ο n y associated with a cereal breakfast. You can also define categories of sounds such as car acceleration, commercial clink, and so on. The user personal database 3 2 0 may contain any one of various user-modifiable parameters that can be used to inform the control processing sequence used in the specific embodiment shown in FIG. 2. The user profile may include any of the following or other applicable parameters. 1) Enhancement technology applicable to various enhanced content types such as web site commercials, text or sound effects editing, for example, personal data may indicate a) whether media data should be buffered and display content changed to call corresponding Web site with multimedia elements; b) when the web site display screen is displayed on the video image, the video image should be made into a background image and be played continuously (see the description of Figure 5); c) then, it should be Place selectable links on the display (for example, using a pointer and buttons on the remote control 2 10); ― 'd) Daytime display (see description for Figure 6) can display additional content, such as business Advertising, web sites, etc. e) Text is best superimposed on high-bandwidth items, such as commercials or interviews 2) Storage options that allow enhanced content to be bookmarked for future display0

第17頁 518890 五、發明說明（13) 3) 應如何識別所分類的項目，諸如將負感濾光器套用到視 訊顯示幕的一部份並暫停（及緩衝器視訊顯示幕、增加對 比度或切換到另一個檢視畫面。 4) 使用者感興趣的内容類型，例如，跑車、啤酒、婚禮、 商業、技術、文學、天氣等等。 a)這可包括不同的興趣等級。例如，使用者本身通常不 會對天氣特別感興趣，則使用者可指示只有發佈使用者當 地的天氣報告時，才有興趣接收增強内容。 5) 什麼資料來源可用來擷取額外的使用者個人資料，例 如，用來利用電視來檢視增強型電子節目指南資訊的視訊 轉換器可儲存關於節目類型、幾點鐘、最愛頻道及節目等 等的使用者偏好設定，因此可用來將資料提供給使用者個 人資料庫3 2 0。 類別/增強内容關聯性資料庫3 7 0可能是查詢表資料，用 來指示所辨識之類別與可輸出之增強内容間的對應性。類 別/增強内容關聯性資料庫3 7 0還可能包含從服務主伺服器 1 7 5下載源自於廣告商用戶端處理序1 7 0的資料，用以指示 關於該内容的某些特定指令，諸如，競赛的截止期、在輪’ 出内容之前應先獲得天氣狀況（例如，只有下雪時才會顯 示剷雪服務的廣告）等等。類別/增強内容關聯性資料庫 3 70負責儲存資料，以此方式指向增強内容資料庫3 40的特 定項目。 增強内容處理器3 6 0採用來自於使用者個人資料的指 令，以及符號分類器3 3 0所提供的類別識別項。增強内容Page 17 518890 V. Description of the invention (13) 3) How should the classified items be identified, such as applying a negative filter to a part of the video display and pausing (and buffering the video display, increasing the contrast or Switch to another view. 4) The type of content the user is interested in, such as sports car, beer, wedding, business, technology, literature, weather, etc. a) This may include different levels of interest. For example, users themselves are usually not particularly interested in the weather, and the users may indicate that they will be interested in receiving enhanced content only if the user's local weather report is published. 5) What data sources can be used to capture additional user personal information, for example, a video converter for viewing enhanced electronic program guide information on a TV can store information about program type, time of day, favorite channels and programs, etc. User preferences of, so it can be used to provide data to the user profile 3 2 0. The category / enhanced content relevance database 3 7 0 may be a lookup table data to indicate the correspondence between the identified category and the enhanced content that can be output. The category / enhancement content database 3 7 0 may also include downloading data from the service client server 1 7 5 that originated from the advertiser client process 1 7 0 to indicate certain specific instructions regarding the content, Such as the deadline for the competition, weather conditions should be obtained before the content is turned on (for example, ads for snow removal services will only be displayed when it snows), and so on. The category / enhancement content database 3 70 is responsible for storing data and in this way points to specific items of the enhanced content database 3 40. The enhanced content processor 360 uses instructions from the user's personal data and the category identification items provided by the symbol classifier 360. Enhanced content

第18頁 518890 五、發明說明U4) 處理器獲取要尋找相關内容資料所需的向量，並且將該向 量及控制資訊提供給增強内容輸出控制器3 9 5。請參考圖2 到6，於步驟A- 1 ’由符號分類器3 3 0負責取樣及處理媒體 資料。於步驟A-2，符號分類器3 3 0嘗試分類整個或部份媒 體資料’直接識別及分類模式。於步驟A — 3，將類別識別 項提供給增強内容處理器3 6 0。接著，於步驟^4，增強内 容處理器3 6 0套用使用者個人資料及類別/增強内容關聯性 資料庫370中所儲存之内容供應商（例如，廣告商）資料的 條件及規則’ α決定是否有及有什麼確切的内容應用來增 強媒體資料流。於步驟Α-5，如旲右扣-咖—广并 制權進行到步驟Α-6，由辦強不内容增強’則控 多媒體輸出組合器/交換心強緩内二輸出控制器3 9 5負責控制 指示來增強多媒體信號戶端39°，以便按照 到媒體資料中有汽車公司商]二7果符號分類器33〇識別 供給增強内容處理器3 6 〇。Π… 則會將類別識別項提 別/增強内容關聯性資料庫批使用者個人貧料庫3 2 0及類 能是Web網站重疊3 25。或者所獲得的規則而定，結果可 的天氣警告訊息315，Μ晝中奎二果整個畫面顯示鑲嵌樣，式 用的天氣資訊web網站或可_ t ΙΡ)視窗330會指示可# 能夠切換到額外内容。不的另一廣播頻道，讓觀眾 請注意，如上文所述，增 式、可提供額外多媒體内容：的概念可包括附加的圖 體資料流上附加内m ^擇項目或可能直接在原媒 銷商的電話號石馬，以響應福J ::能會重疊福特當地經 哥商業廣告或商標。因此，增Page 18 518890 V. Description of the invention U4) The processor obtains the vector needed to find relevant content data, and provides the vector and control information to the enhanced content output controller 3 9 5. Please refer to Figs. 2 to 6. In step A-1 ', the symbol classifier 3 3 0 is responsible for sampling and processing the media data. At step A-2, the symbol classifier 3 3 0 attempts to classify all or part of the media data 'directly to identify and classify the pattern. In steps A-3, the category identification item is provided to the enhanced content processor 360. Next, in step ^ 4, the enhanced content processor 3 600 applies the user's personal data and category / enhanced content provider data (eg, advertisers) data stored in the enhanced content relevance database 370. Conditions and rules' α decision Is there and what exact content should be used to enhance the media stream. In step A-5, if the right-click-coffee-wide merger control is passed to step A-6, the content is enhanced by the office and the content output controller is controlled by the multimedia output combiner / exchange core and internal output controller 3 9 5 Responsible for controlling the instruction to enhance the multimedia signal client 39 °, so as to identify and supply the enhanced content processor 3 6 0 according to the car company in the media materials. Π ... will identify the category identification items / enhance the content relevance database and approve users ’personal data bases 3 2 0 and the category can be Web site overlap 3 25. Or depending on the rules obtained, the weather warning message 315 that can be obtained as a result, the whole screen of the daytime Kui Erguo displays a mosaic pattern, the weather information web site or the web site can be used to display 330 can indicate that you can switch to Extra content. Not another broadcast channel, let viewers please note that, as mentioned above, the concept of augmented, can provide additional multimedia content: the concept can include additional graphics data stream additional options or may be directly in the original media distributor Shima's phone number in response to Fu J :: Can Overlapping Ford's Local Business Advertising or Trademark. Therefore, increase

518890 五、發明說明（15) 強内容的構想可包括互動元件，讓使用者能夠透過互動元 $來控制增強内容的時間選擇、内容、範疇等等，以響應 多媒體元素分類。因此，例如，使用者可決定是否要連妗 到額外天氣資訊，只要選擇短暫的連結（ριρ視窗33〇)或、= 略連結即可。與使用者忽略連結相比，如果使用者選擇^ 結，則會顯示更多的多媒體内容。另外，如果連結是線上 web網站，則不會透過增強内容資料庫34〇來提供 媒體内容。 夕 增強内容輸出控制器3 9 5會響應增強内容處理器3 6 〇所浐 供的控制參數。控制參數可包含基本處理序，之後接著= 強内容輸出控制器3 9 5與一組指標，用以指向增強内容次曰 料庫34 0内的特定内容項目。例如，基本處理序可反= =幕特定區域達指定的時間，以定義顯示幕上的可選k 2，並在經由輸入裝置3 55選取該區域中隨即觸aweb °° =多媒體内容可能是肌、視訊剪輯、聲音或一段 -ii字内容連同用來修改媒體資料流的詳細二 39〇 ,多媒體輸出組合器/交換器/緩衝器/用戶端 來自於辩強內六趴山緩衝以用戶端39〇根tf . 緩衝媒：，；出控制器3 9 5的命令，執行重疊文件 ΛΑ某月且貝枓、棱供網際網路用戶端服務、，田κ 的指今。士主、、丈立 而服办 5周用w e b網站 以卜μ,明思’增強内容輸出控制器395可能傳逆 以上的指令及多媒妒 此得运一組 是產生web連、结，則口~皇於田°t果初步增強内容階段 雕次Μ 則只會傳輸用來定義重疊遠έ士 Μ 1 & 體貢料及指令。在桩收Μ ^ & Μ 我里且運結的連結媒 在接收到經由輸入裝置355 518890 五、發明說明（16) 後，隨即將諸如UR L的進一步内容輸出到多媒體輸出組合 器/交換器/緩衝器/用戶端3 9 0。 請注意，可使用各種輸入及輸出裝置來實施本發明。輸 入裝置3 5 5可能是光筆、電視型遙控器、鍵盤、滑鼠或用 來產生命令之任何其他適合的裝置。輸出裝置350可能是 電視、監視器、電視牆、廣播或多點廣播頻道、交談用戶 端、網際網路控制台或任何其他適合的裝置。媒體資料可 包括任何類型的資訊内容，包含文字、視訊、音訊、閉路 電視系統的現場資料、交談資料、I P封包等等。輸出裝置 3 5 0還可包含一個以上的實體裝置。例如，可能是多台監 視器，其中一台係用來輸出增強内容，而另一台係用來輸 出原始媒體資料。 請注意，增強内容處理器3 6 0可使用其他資料3 3 2來進行 決策。例如，電子節目指南資料可指示媒體資料流的節目 類型（例如，喜劇電視廣播）。可能與供應增強内容決策有 關的其他資料可包含幾點鐘、幾月幾日、現在天氣、多媒 體信號中出現的廣告項目名稱等等。 請注意，可將視訊或其他即收即播資訊的處理作為後¥ 處理序來執行，而不是在用戶端上執行（例如，遠端終端 機或在觀眾附近的電視視訊轉換器）。在此類的實施中， 只需要將控制資訊傳輸給用戶端處理序，並且可減少處理 及儲存容量。亦即，可在後端處理器上儲存用來分類原始 資料之所有可能的符號類別及資訊。只需要傳輸用來產生 内容增強的必要資料。可使用任何適合的處理序（諸如，518890 V. Description of the invention (15) The concept of strong content can include interactive elements, allowing users to control the time selection, content, category, etc. of enhanced content through interactive elements $, in response to the classification of multimedia elements. Therefore, for example, the user can decide whether or not to link to additional weather information by selecting a short link (ριρWindow 33〇) or, = slightly link. Compared with users ignoring the link, if the user chooses ^ knot, more multimedia content will be displayed. In addition, if the link is an online web site, media content will not be provided through the enhanced content database 34. The enhanced content output controller 3 95 will respond to the control parameters provided by the enhanced content processor 36. The control parameters may include the basic processing sequence, followed by = strong content output controller 3 9 5 and a set of indicators to point to specific content items in the enhanced content library 34 0. For example, the basic processing sequence can be reversed == a specific area of the curtain for a specified time to define the optional k 2 on the display, and then touch aweb in the area selected via the input device 3 55 °° = multimedia content may be muscle , Video clips, sounds or a -ii word content together with the details used to modify the media data stream 39, the multimedia output combiner / switcher / buffer / client comes from the debate inside the six strong buffers to the client 39 〇root tf. Buffer media:,; Issue the command of the controller 395, execute the overlapping file ΛΑ for a month, and be used for Internet client service, and the instruction of Tian κ. Scholars, and stand up and serve for 5 weeks. Use the web site to understand μ, Mingsi's enhanced content output controller 395 may pass the above instructions and the media is jealous. This is a group that produces web connections and connections.口 ～ 皇 于田 ° In the initial enhancement content stage, the carving time M will only transmit the materials and instructions used to define the overlapping distance M 1 & After receiving ^ ^ & Μ 内 and the connected media received via the input device 355 518890 V. Invention Description (16), then further content such as UR L is output to the multimedia output combiner / exchanger / Buffer / user end 3 9 0. Please note that the present invention can be implemented using various input and output devices. The input device 3 5 5 may be a light pen, a TV-type remote control, a keyboard, a mouse, or any other suitable device for generating commands. Output device 350 may be a television, monitor, video wall, broadcast or multicast channel, chat client, Internet console, or any other suitable device. Media data can include any type of information content, including text, video, audio, live data from CCTV systems, chat data, IP packets, and more. The output device 350 may also include more than one physical device. For example, there may be multiple monitors, one of which is used to output enhanced content and the other is used to output raw media material. Please note that the Enhanced Content Processor 360 can use other materials 332 to make decisions. For example, electronic program guide material may indicate the program type of a media stream (for example, a comedy television broadcast). Other materials that may be relevant to the decision to supply enhanced content can include the time of day, the days of the month, the current weather, the name of the advertising item appearing in the multimedia signal, and so on. Note that processing of video or other on-demand information can be performed as a post-processing sequence rather than on the client (for example, a remote terminal or a television video converter near the viewer). In this type of implementation, only the control information needs to be transmitted to the client process, and processing and storage capacity can be reduced. That is, all possible symbol classes and information used to classify the original data can be stored on the back-end processor. Only the data necessary to produce content enhancements need to be transmitted. Any suitable processing sequence can be used, such as

第21頁 518890 五、發明說明（17) 視訊浮水印、插 增強作為嵌入式 含MPEG-7 、 ATSC (meta)標準來傳 熟知技藝人士 施例的細節，並 體化，而不會脫 方面，本發明具 範疇如隨附的申 所示，因此，本 的所有變更。 入到垂直消隱間隔的資料等等），將内容 控制資訊進行傳輸。還可能藉由XML或包 、D V B等等之媒體資料封包的其他中繼 遞控制資料。 應明白，本發明不限於前面說明之具體實 且應明白本發明可能用其他特定形式來具 離本發明的精神或基本特性。因此，在各 體實施例應視為解說而非限制，本發明的 請專利範圍所示，而不是如前面的說明書 發明包含申請專利範圍之同等意義及範圍 #Page 21 518890 V. Description of the invention (17) Video watermarking and interpolation enhancement as embedded MPEG-7 and ATSC (meta) standards to convey the details of skilled artisans' implementation and integration, without losing sight. The scope of the present invention is as shown in the attached application. Therefore, all changes of the present invention are possible. Data into vertical blanking intervals, etc.) to transmit content control information. It is also possible to relay control data via XML or other media data packets such as DVB, etc. It should be understood that the present invention is not limited to the specific embodiments described above and it should be understood that the invention may take other specific forms to depart from the spirit or essential characteristics of the invention. Therefore, the embodiments should be regarded as illustrative rather than limiting. The patent scope of the present invention is shown instead of the foregoing description. The invention includes the same meaning and scope as the scope of patent application. #

第22頁Page 22

Claims (1)

518890 申請專利範圍 步驟： 種用以增強視訊輸出内容的方法，該方法包括下 列 在一伺 將該增 將連接 類 流 響應個 以產生 輸出該 2 ·如申請 辨識一圖形 3. 如申請 附加對應於 上視覺或聽 4. 如中請 辨識語音。 5 · 一種用 括： 一輸出 一信號 料信號傳送 一使用 人資料； 服器（1 7 5 )上儲存該增強内容之資料； 強内谷貝料了載到_用戶端系統（2 4 〇，工7 5 ); 到該用戶端系統的一媒體資料流的一部份作分 人資料及該增強内容資料來修改該媒體資料 增強之媒體資料；以及 增強之媒體資料流。 專利範圍第1項之方法，其中該分類步驟包括 模式（3 1 0，3 1 5 )。 專利範圍第1項之方法，其中該修改步驟包括 了 web網站（ 3 25 )之可選擇連結之一項或一項以 覺元素的至少其中一項。 專利範圍第1項之方法，其中該分類步驟包括 來增強廣播媒體資料流内容的系統，該系統包 裝置（230); 修改裝置（2 4 0，1 7 5 )，被連接用來將一媒體資 給該輸出裝置，並用來接收該廣播資料流； 者個人資料庫（175，235)，用來儲存使用者個 # 一媒體内容資料庫（175，235)，用來儲存媒體内容項518890 Patent Application Steps: A method for enhancing the content of video output, the method includes the following steps: responding to the connection class stream to generate an output 2. If an application identifies a graphic 3. If the application is attached to correspond to See or listen 4. If yes, please recognize the voice. 5 · One kind of use includes: an output, a signal, a signal, and a user's data; a server (175) stores the data of the enhanced content; a strong inner valley shell is loaded into the _user system (2 4 0, labor 7 5); a portion of a media data stream to the client system is used as the person data and the enhanced content data to modify the enhanced media data of the media data; and the enhanced media data stream. The method of item 1 of the patent scope, wherein the classification step includes a pattern (3 1 0, 3 1 5). The method of item 1 of the patent scope, wherein the modifying step includes at least one of the optional links or one of the elements of the web site (325). The method of item 1 of the patent, wherein the classification step includes a system for enhancing the content of the broadcast media data stream, the system package device (230); modification device (2 40, 17 5) is connected to use a media To the output device and used to receive the broadcast data stream; or a personal database (175, 235) to store a user's media content database (175, 235) to store media content items 第24頁 518890 六、申請專利範圍 a ; 一控制器，其連接到該使用者個人資料庫及該多媒體 内容資料庫，並被程式設計來辨識該廣播資料流的一部 份； 該控制器被程式設計來控制該信號修改裝置，以響應 該使用者個人資料及該等媒體内容項目。 6. 如申請專利範圍第5項之系統，其中該廣播媒體資料 流包括一視訊資料流，該等媒體内容項目包括文字，以及 該控制器被程式化以控制該信號修改裝置，用以在該視訊 資料流上重疊對應於該文字的影像。 7. 如申請專利範圍第5項之系統，其中該輸出裝置是電 視（ 2 3 0 )。 8. 如申請專利範圍第5項之系統，其中該廣播媒體資料 流是一電視廣播信號，以及該部份包括通常作為可視元素 所顯示之電視信號的一部份。 9. 如申請專利範圍第5項之系統，其中該輸出裝置包括 至少兩個分開的視訊顯示幕，並且會在該等至少兩個分開 之視訊顯示幕的至少其中一個上輸出該等多媒體内容項… 目，以及在該等至少兩個分開之視訊顯示幕的另一個上輸 出該廣播資料流。 1 0. —種用以增強視訊輸出内容的方法，該方法包括下 列步驟： 將可傳遞到一用戶端系統的一媒體資料流的部份作分 類；Page 24 518890 VI. Application scope a; a controller connected to the user's personal database and the multimedia content database, and programmed to identify a part of the broadcast data stream; the controller is Programming to control the signal modification device in response to the user's personal data and the media content items. 6. If the system of claim 5 is applied, the broadcast media data stream includes a video data stream, the media content items include text, and the controller is programmed to control the signal modification device for use in the An image corresponding to the text is superimposed on the video data stream. 7. The system as claimed in claim 5, wherein the output device is a television (230). 8. The system of claim 5 in which the broadcast media stream is a television broadcast signal, and the portion includes a portion of the television signal that is usually displayed as a visual element. 9. If the system of claim 5, the output device includes at least two separate video displays, and the multimedia content items are output on at least one of the at least two separate video displays. ... and output the broadcast data stream on the other of the at least two separate video displays. 1 0. A method for enhancing the content of video output, the method includes the following steps: classifying a portion of a media data stream that can be passed to a client system; 第25頁 518890 六、申請專利範圍 分類該媒體資料流中的特徵； 產生控制信號，以響應該分類步驟； 修改該媒體資料流，以響應該等控制信號及定義使用 者類別偏好設定的個人資料； 輸出該修改步驟的結果。 1 1.如申請專利範圍第1 0項之方法，其中會在一伺服器 (1 7 5 )上產生該等控制信號的至少其中一個，並嵌入在該 媒體資料流中以傳$到該用戶端。 12. —種用來在一置（ 23 0 )上顯示媒體内容的裝 置，該裝置包括： Y 一模式分類器，被連接用以接收一媒體廣播信號並輸 出類別識別項，以響應在該媒體廣播信號中辨識的模式； 一媒體内容資料庫（1 7 5，2 3 5 )，其包含該媒體内容； 一使用者個人資料庫（1 7 5，2 3 5 )，用來保存使用者偏 好設定資料； 一控制器（2 4 0，1 7 5 )，可被程式化以在該輸出裝置上 輸出該媒體内容的所選取部份，以響應該使用者個人資料 及該類別識別項。 ~ 1 3.如申請專利範圍第1 2項之裝置，其中該控制器可被 程式化以組合該媒體的所選取部份與該廣播信號，以產生 組合的輸出信號並輸出到該輸出裝置。Page 25 518890 VI. Classification of patent media features in the media data stream; Generate control signals to respond to the classification steps; Modify the media data stream to respond to these control signals and define personal data preferences of user categories ; Output the result of this modification step. 1 1. The method according to item 10 of the scope of patent application, wherein at least one of the control signals is generated on a server (175), and is embedded in the media data stream to pass $ to the user end. 12. A device for displaying media content on a device (23 0), the device includes: Y a pattern classifier, which is connected to receive a media broadcast signal and output a category identification item in response to the media Patterns identified in the broadcast signal; a media content database (175, 2 3 5) containing the media content; a user personal database (175, 2 3 5) to save user preferences Setting data; a controller (240, 175) can be programmed to output the selected part of the media content on the output device in response to the user's personal data and the category identification item. ~ 1 3. The device according to item 12 of the scope of patent application, wherein the controller can be programmed to combine the selected part of the media with the broadcast signal to generate a combined output signal and output to the output device. 第26頁Page 26
TW90105695A 2000-03-21 2001-03-12 System and method for automatic content enhancement of multimedia output device TW518890B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US53284500A 2000-03-21 2000-03-21

Publications (1)

Publication Number Publication Date
TW518890B true TW518890B (en) 2003-01-21

Family

ID=24123412

Family Applications (1)

Application Number Title Priority Date Filing Date
TW90105695A TW518890B (en) 2000-03-21 2001-03-12 System and method for automatic content enhancement of multimedia output device

Country Status (4)

Country Link
EP (1) EP1205075A2 (en)
JP (1) JP2003528498A (en)
TW (1) TW518890B (en)
WO (1) WO2001072040A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI484831B (en) * 2008-11-13 2015-05-11 Mstar Semiconductor Inc Multimedia broadcasting method and multimedia broadcasting device thereof

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1311124A1 (en) * 2001-11-13 2003-05-14 Matsushita Electric Industrial Co., Ltd. Selective protection method for images transmission
FR2832580B1 (en) * 2001-11-16 2004-01-30 Thales Sa BROADCAST PROGRAM SIGNAL WITH ORDER, ORDER RECORDING AND READING SYSTEMS, RELATED PRODUCTION AND BROADCAST CHAIN
US8261306B2 (en) * 2001-12-11 2012-09-04 Koninklijke Philips Electronics N.V. System for and method of shopping through television
GB2387984B (en) * 2002-03-07 2005-11-09 Chello Broadband N V Display of enhanced content
GB2387730B (en) 2002-03-07 2006-01-04 Chello Broadband N V Media playout system
US7373336B2 (en) 2002-06-10 2008-05-13 Koninklijke Philips Electronics N.V. Content augmentation based on personal profiles
FR2841724A1 (en) * 2002-06-28 2004-01-02 Thomson Licensing Sa SYNCHRONIZATION SYSTEM AND METHOD FOR AUDIOVISUAL PROGRAMS, DEVICES AND RELATED METHODS
FR2848767B1 (en) * 2002-12-17 2005-04-15 Nptv VIDEO BROADCAST
KR20060135598A (en) * 2003-08-25 2006-12-29 코닌클리케 필립스 일렉트로닉스 엔.브이. Real-time media dictionary
US7966552B2 (en) 2006-10-16 2011-06-21 Sony Corporation Trial selection of STB remote control codes
US8077263B2 (en) 2006-10-23 2011-12-13 Sony Corporation Decoding multiple remote control code sets
US7689613B2 (en) 2006-10-23 2010-03-30 Sony Corporation OCR input to search engine
US7991271B2 (en) 2007-02-14 2011-08-02 Sony Corporation Transfer of metadata using video frames
US7814524B2 (en) 2007-02-14 2010-10-12 Sony Corporation Capture of configuration and service provider data via OCR
US8763038B2 (en) 2009-01-26 2014-06-24 Sony Corporation Capture of stylized TV table data via OCR
US8438589B2 (en) 2007-03-28 2013-05-07 Sony Corporation Obtaining metadata program information during channel changes
US7987478B2 (en) * 2007-08-28 2011-07-26 Sony Ericsson Mobile Communications Ab Methods, devices, and computer program products for providing unobtrusive video advertising content
JP5116492B2 (en) * 2008-01-15 2013-01-09 三菱電機株式会社 Application execution terminal
US8320674B2 (en) 2008-09-03 2012-11-27 Sony Corporation Text localization for image and video OCR
US8035656B2 (en) 2008-11-17 2011-10-11 Sony Corporation TV screen text capture
JP2010266880A (en) * 2010-06-23 2010-11-25 Sony Corp Mobile terminal device, information processing method, and program
KR101450491B1 (en) * 2010-08-27 2014-10-13 인텔 코오퍼레이션 Transcoder enabled cloud of remotely controlled devices
US8655805B2 (en) 2010-08-30 2014-02-18 International Business Machines Corporation Method for classification of objects in a graph data stream
US10070201B2 (en) * 2010-12-23 2018-09-04 DISH Technologies L.L.C. Recognition of images within a video based on a stored representation
GB2500653A (en) * 2012-03-28 2013-10-02 Sony Corp Broadcast audio video content distribution system with associated metadata defining links to other content
DE102012212435A1 (en) * 2012-07-16 2014-01-16 Axel Springer Digital Tv Guide Gmbh Receiving- and reproducing apparatus for e.g. contents of TV set, has display element in which apparatus displays characteristic portions based on request of user about interaction options parallel to reproduction of media content
US20140255003A1 (en) * 2013-03-05 2014-09-11 Google Inc. Surfacing information about items mentioned or presented in a film in association with viewing the film
US9658994B2 (en) 2013-05-20 2017-05-23 Google Inc. Rendering supplemental information concerning a scheduled event based on an identified entity in media content
KR20150107464A (en) * 2014-03-14 2015-09-23 삼성전자주식회사 Apparatus for processing contents and method for providing event thereof
WO2015144248A1 (en) * 2014-03-28 2015-10-01 Arcelik Anonim Sirketi Image display device with automatic subtitle generation function
WO2016012875A1 (en) 2014-07-23 2016-01-28 Comigo Ltd. Reducing interference of an overlay with underlying content

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4204689A1 (en) * 1992-02-17 1993-08-19 Peter Biet Automatic recording control circuitry for domestic video recorder - allows interruption of recording mode for blanking out advertising slots inserted in transmitted programme.
US5614940A (en) * 1994-10-21 1997-03-25 Intel Corporation Method and apparatus for providing broadcast information with indexing
US5929849A (en) * 1996-05-02 1999-07-27 Phoenix Technologies, Ltd. Integration of dynamic universal resource locators with television presentations
BR9714949A (en) * 1996-12-20 2005-04-12 Princeton Video Image Inc Superior adjustment device for targeted electronic insertion of video indications
GB9715228D0 (en) * 1997-07-18 1997-09-24 Sertway Limited Communications system and method
CA2302031A1 (en) * 1997-08-27 1999-03-04 Starsight Telecast, Incorporated Systems and methods for replacing television signals
US6029045A (en) * 1997-12-09 2000-02-22 Cogent Technology, Inc. System and method for inserting local content into programming content
IL127790A (en) * 1998-04-21 2003-02-12 Ibm System and method for selecting, accessing and viewing portions of an information stream(s) using a television companion device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI484831B (en) * 2008-11-13 2015-05-11 Mstar Semiconductor Inc Multimedia broadcasting method and multimedia broadcasting device thereof

Also Published As

Publication number Publication date
EP1205075A2 (en) 2002-05-15
WO2001072040A3 (en) 2002-03-21
WO2001072040A2 (en) 2001-09-27
JP2003528498A (en) 2003-09-24

Similar Documents

Publication Publication Date Title
TW518890B (en) System and method for automatic content enhancement of multimedia output device
US8375406B2 (en) Information processing apparatus and method, and program
US10567834B2 (en) Using an audio stream to identify metadata associated with a currently playing television program
JP5121367B2 (en) Apparatus, method and system for outputting video
CN100525430C (en) Information processing apparatus, method and program
US8296185B2 (en) Non-intrusive media linked and embedded information delivery
JP4603660B2 (en) Broadcast receiving apparatus and method for controlling broadcast receiving apparatus
US8554752B2 (en) Information providing system, information receiving apparatus, information providing apparatus, information providing method and program
US8281340B2 (en) Information processing apparatus and method, and program
US8930992B2 (en) TV social network advertising
EP2293301A1 (en) Method for generating streaming media increment description file and method and system for cutting in multimedia in streaming media
KR20010089778A (en) Fusion of media for information sources
CN105939495A (en) Electronic device, computer implementation method and non-volatile computer-readable media
US20090313324A1 (en) Interactive viewing of media content
KR20130133918A (en) Systems and methods for selecting media assets for display in a screen of an interactive media guidance application
JP2006518063A (en) Bookmarks and watchpoints for media stream selection and performance
WO1999011066A1 (en) Information transmitting method and television broadcast receiver
JP2010098730A (en) Link information providing apparatus, display device, system, method, program, recording medium, and link information transmitting/receiving system
US20090037387A1 (en) Method for providing contents and system therefor
US20090133067A1 (en) Multi-media enhancement channel
US20030072558A1 (en) Method and apparatus for reproducing television broadcast program digest
JP2010124319A (en) Event-calendar display apparatus, event-calendar display method, event-calendar display program, and event-information extraction apparatus
JP2010165354A (en) Transmission and reception system of link information and display device of link information
JP4991064B2 (en) Method and apparatus for displaying multimedia information together with a broadcast program
WO2022019951A1 (en) Systems and methods for simultaneous content presentation

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent
MM4A Annulment or lapse of patent due to non-payment of fees