TWI483130B - Multimedia data evaluation method - Google Patents

Multimedia data evaluation method Download PDF

Info

Publication number
TWI483130B
TWI483130B TW101133116A TW101133116A TWI483130B TW I483130 B TWI483130 B TW I483130B TW 101133116 A TW101133116 A TW 101133116A TW 101133116 A TW101133116 A TW 101133116A TW I483130 B TWI483130 B TW I483130B
Authority
TW
Taiwan
Prior art keywords
multimedia
feature
evaluating
attention
prompt
Prior art date
Application number
TW101133116A
Other languages
Chinese (zh)
Other versions
TW201411377A (en
Original Assignee
Univ Yuan Ze
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Yuan Ze filed Critical Univ Yuan Ze
Priority to TW101133116A priority Critical patent/TWI483130B/en
Publication of TW201411377A publication Critical patent/TW201411377A/en
Application granted granted Critical
Publication of TWI483130B publication Critical patent/TWI483130B/en

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Description

多媒體資料評價方法Multimedia data evaluation method

本發明係一種多媒體資料評價方法,特別是自動地擷取多媒體資料中可引起使用者關注的關鍵片段的方法。The invention relates to a multimedia material evaluation method, in particular to a method for automatically capturing key segments of a multimedia material that can attract user attention.

習知技術中,隨著網際網路與電視電影廣播技術的演進,多樣化的多媒體資料來源亦隨之日益普遍。In the conventional technology, with the evolution of the Internet and TV movie broadcasting technology, diversified sources of multimedia data have become increasingly common.

舉例而言,在網際網路上的演進係提供使用者更為寬廣的頻寬,使得使用者可以在該網際網路直接地使用該多媒體資料(例如影像、聲音或文字等所組成的多媒體資料),而不用將所有的該多媒體資料下載至使用者端之後才能進行觀看。其中,該多媒體資料係一般以串流的方式進行傳輸,而該串流傳輸的方式係可在極小的時間差之下,同步地且即時地提供該多媒體資料的傳輸。For example, the evolution on the Internet provides users with a wider bandwidth, allowing users to directly use the multimedia material (such as multimedia, video, voice or text) on the Internet. Instead of having to download all of the multimedia material to the user, you can watch it. The multimedia data is generally transmitted in a streaming manner, and the streaming transmission method can provide the transmission of the multimedia data synchronously and instantaneously under a minimum time difference.

然而,由於使用者僅能以有限的時間觀看眾多的該多媒體資料,使得如何能在有限的時間裡,能夠快速的且精準地自該多媒體資料中尋找到使用者所關注的關鍵片段以及在該多媒體資料尋找到某些值得使用者關注的關鍵片段就變得十分重要。舉例而言,在實況轉播的運動比賽當中,比賽的比數係有可能因為比分過於接近或是相同分的狀態下而能獲得使用者更多的關注。However, since the user can only view a large amount of the multimedia material in a limited time, how can the key piece of the user's attention be quickly and accurately found in the multimedia material in a limited time and in the time limit? It is important to find some key pieces worthy of user attention in multimedia materials. For example, in a live broadcast sports competition, the game's odds ratio may be more focused by the user because the score is too close or the same.

故有需要透過本發明所提出關鍵多媒體資料評價方法,用以提供使用者可輕易地實現上述的目的。Therefore, there is a need for a key multimedia data evaluation method proposed by the present invention to provide a user with the above objects easily.

本發明之一目的係提供一種多媒體資料評價方法,可藉由選定一多媒體資料的部分做為關鍵片段而引起使用者的關注的目的。An object of the present invention is to provide a multimedia data evaluation method, which can attract the user's attention by selecting a portion of a multimedia material as a key segment.

本發明之另一目的係根據上述的方法,藉由語意描述(semantic description)的方式使得該多媒體資料中的部分片段具有意義。Another object of the present invention is to make a partial segment of the multimedia material meaningful by means of a semantic description according to the above method.

本發明之又一目的係根據上述的方法,係可提供使用者根據不同的多媒體資料分別地設定不同的關注的項目,用以達到精確地且有彈性地獲得使用者的關注。According to another aspect of the present invention, the user can separately set different items of interest according to different multimedia materials, so as to obtain the user's attention accurately and flexibly.

為達到上述目的與其它目的,本發明係提供一種多媒體資料評價方法,係擷取一多媒體資料中的至少一部分做為關鍵片段用以引起使用者的關注(attention),其包含步驟(a)串流地接收該多媒體資料,以自該多媒體資料中解析出複數多媒體框架(frame);步驟(b),係分析每一該等多媒體框架,並自每一該等多媒體框架中選擇性地取得提示特徵(annotative feature);步驟(c),係將對應於該提示特徵的該多媒體框架附加一語意描述(semantic description),以使該多媒體框架具有語意意義(semantic meaning);步驟(d),係形成具有該語意意義的關注模組,以使該關注模組根據該語意意義追蹤與該提示特徵相關的該等多媒體框架;以及步驟(f),係評價該提示特徵,以建立具有該意義的該關鍵片段。In order to achieve the above and other objects, the present invention provides a multimedia data evaluation method, which captures at least a portion of a multimedia material as a key segment for causing a user's attention, which includes the step (a) string. Streaming the multimedia material to parse a plurality of multimedia frames from the multimedia material; and step (b) analyzing each of the multimedia frames and selectively obtaining prompts from each of the multimedia frames An optional feature; step (c), attaching a semantic description to the multimedia frame corresponding to the prompt feature, so that the multimedia frame has a semantic meaning; step (d), Forming a module of interest having the semantic meaning such that the module of interest tracks the multimedia frames associated with the prompt feature according to the semantic meaning; and step (f) evaluating the prompt feature to establish a meaning The key piece.

與習知技術相較,本發明之多媒體資料評價方法係用 以分析所接收到具有複數多媒體框架的多媒體資料,並且在該等多媒體框架中係根據可獲得使用者關注的部分,在每一多媒體框架中擷取出對應的影像與文字之至少其一者,並將所擷取出的該提示特徵透過本發明進一步以附加語意描述的方法,使得該提示特徵具有可供評價的意義,且再藉由追蹤該提示特徵,使得在該多媒體資料可建立獲得使用者關注的該關鍵片段的部分。換言之,本發明係提供可藉由快速地分析該多媒體資料,用於提供使用者可正確地自該多媒體框架中獲得值得關注的該關鍵片段。Compared with the prior art, the multimedia data evaluation method of the present invention is used Receiving, by the analysis, multimedia materials having a plurality of multimedia frames, and extracting at least one of the corresponding images and characters in each multimedia frame according to the portion of the multimedia frame that is available to the user, and The prompt feature extracted by the present invention is further described in an additional semantic manner by the method of the present invention, so that the prompt feature has a meaning for evaluation, and by tracking the prompt feature, the multimedia material can be established to obtain user attention. The part of the key fragment. In other words, the present invention provides for providing the user with the key piece of interest that can be correctly obtained from the multimedia framework by quickly analyzing the multimedia material.

為充分瞭解本發明之目的、特徵及功效,茲藉由下述具體之實施例,並配合所附之圖式,對本發明做一詳細說明,說明如後:參考第1圖,係本發明一實施例之多媒體資料評價方法的流程示意圖。於第1圖中,該多媒體資料評價方法係擷取多媒體資料的至少一部分做為關鍵片段用以引起使用者的關注。In order to fully understand the object, features and advantages of the present invention, the present invention will be described in detail by the following specific embodiments and the accompanying drawings. A schematic diagram of the flow of the multimedia material evaluation method of the embodiment. In the first figure, the multimedia data evaluation method extracts at least a part of the multimedia material as a key segment to attract the user's attention.

其中,該多媒體資料係可為具有該影像及/或該文字所組成的新聞節目、電視電影節目或運動節目,且該多媒體資料係可為即時(live)播放節目亦或者完整已存在的節目。The multimedia material may be a news program, a television movie program or a sports program having the image and/or the text, and the multimedia material may be a live broadcast program or a complete existing program.

再者,該關鍵片段的定義,係指在多媒體資料中可引起使用者注意的片段,例如在該新聞節目中若字幕出現地震、颱風等災難的訊息、該電視電影節目中出現具有爭吵 或甜言蜜語等事件的腳本、或在比賽節目中主場與客場之間的比分係十分接近或是相同時,都會引起該使用者的關注,也是使用者想特別關注的部分。Furthermore, the definition of the key segment refers to a segment that can be noticed by the user in the multimedia material, for example, if the subtitle has a disaster such as an earthquake or a typhoon in the news program, there is a quarrel in the television movie program. Or the script of events such as sweet talk, or the score between the home game and the away game in the game show is very close or the same, it will cause the user's attention, and is also the part that the user wants to pay special attention to.

此外,值得注意的是,該關鍵片段係可為靜止的多媒體資料或是持續一段時間的動態多媒體資料。In addition, it is worth noting that the key segment can be static multimedia material or dynamic multimedia material for a period of time.

該關鍵多媒體資料評價方法係起始於步驟S11,係串流地接收該多媒體資料,以自該多媒體資料中解析出複數多媒體框架。於此步驟,係接收欲進行分析的該多媒體資料。再者,該多媒體資料係由該等多媒體框架所組成。其中,該多媒體資料係為具有影像與文字之至少其一者。The key multimedia data evaluation method starts in step S11, and the multimedia data is received in a stream to parse a plurality of multimedia frames from the multimedia data. In this step, the multimedia material to be analyzed is received. Furthermore, the multimedia material is composed of the multimedia frameworks. The multimedia data is at least one of an image and a text.

舉例而言,該多媒體資料係以即時的棒球比賽的運動節目為例說明。在該棒球比賽中,該多媒體資料除了比賽的影像畫面外,係更包含具有文字與標記的記分板,關於主場隊伍分數、客場隊伍分數、局數、好球數、壞球數與出局數的文字表示SCB(superimposed caption box)與上壘狀態運動標記資料SSI(sport symbol information)等記分板資料,而該等資料係可作為提示特徵,例如第2圖中該記分板的資料。此外,於第2圖中,該提示特徵亦可為某一特定球員(例如背號為“8”號的WING)上場時,可根據背號及其所產生的相關動作標記為該提示特徵。For example, the multimedia material is exemplified by a sports program of an instant baseball game. In the baseball game, in addition to the video image of the game, the multimedia material includes a scoreboard with text and markup, regarding the home team score, the away team score, the number of games, the number of good balls, the number of bad balls and the number of outs. The text indicates the scoreboard data such as the SCB (superimposed caption box) and the upper symbol state INS (sport symbol information), and the data can be used as a reminder feature, such as the scoreboard data in FIG. In addition, in FIG. 2, the prompt feature may also be marked as the prompt feature according to the back number and related actions generated when a certain player (for example, WING with a back number of "8") is present.

於另一實施例中,當該多媒體資料的內容係為該電視電影節目時,分析每一該等多媒體框架中與該文字,以取得與劇情腳本(scripts)相關的該提示特徵。In another embodiment, when the content of the multimedia material is the television movie program, the text in each of the multimedia frames is analyzed to obtain the prompt feature related to scripts.

於另一實施例中,當該多媒體資料的內容係為該新聞 節目時,分析每一該等多媒體框架中與該文字,以取得與新聞字幕(News subtitle)、主播播報的關鍵字(語意)相關的該提示特徵。In another embodiment, when the content of the multimedia material is the news At the time of the program, the text in each of the multimedia frames is analyzed to obtain the prompt feature related to the news subtitle (the title of the news subtitle) and the anchor broadcast (speech).

接著步驟S12,係分析每一該等多媒體框架,並自每一該等多媒體框架中選擇性地取得提示特徵。於此步驟,係根據該等多媒體框架的種類(例如影像及/或文字)取得相對應的視覺特徵與文字特徵。其中,該視覺特徵係更包含空間特徵圖像(spatial feature map)、時間特徵圖像(temporal feature map)與臉部特徵圖像(face feature map),以及該文字特徵係更包含文字與標記(symbol)。Next, in step S12, each of the multimedia frames is analyzed, and the prompt features are selectively obtained from each of the multimedia frames. In this step, corresponding visual features and text features are obtained according to the types of the multimedia frames (eg, images and/or text). The visual feature further includes a spatial feature map, a temporal feature map, and a face feature map, and the text feature further includes text and a mark ( Symbol).

接續上述例子,自該多媒體框架中取得關於主場隊伍分數、客場隊隊伍分數、局數、好球數、壞球數與出局數的文字部分以作為該文字特徵,以及上壘狀態的影像作為運動標記資料。再者,於該多媒體框架中亦包含該棒球比賽時的人、事或物等影像物件,其係可辨識例如該人的臉部以作為該臉部特徵圖像。當投手、守壘者、內外野手、打擊者等守隊與攻隊係背對鏡頭時,係可藉由判斷背號用以取得該提示特徵。Following the above example, the text portion of the home team score, the away team score, the number of games, the number of good balls, the number of bad balls, and the number of outs are obtained from the multimedia frame as the character of the character, and the image of the upper base state as an exercise. Mark the data. Furthermore, the multimedia frame also includes an image object such as a person, a thing, or an object during the baseball game, which can recognize, for example, the face of the person as the facial feature image. When the defender, the defender, the inside and outside field, the striker, and the defending team are facing the camera, the back number can be used to obtain the prompt feature.

於一實施例中,可透過辨識該多媒體框架中具有文字或運動標記的部分,並且將該多媒體框架中的該文字或運動標記擷取下來以作為該提示特徵。In an embodiment, the portion having the text or the motion mark in the multimedia frame can be recognized and the text or motion mark in the multimedia frame can be extracted as the prompt feature.

接著步驟S13,係將對應於該提示特徵的該多媒體框架附加語意描述(semantic description),以使該多媒體框架具有語意意義(semantic meaning)。於此,由於該提示特徵 取出時僅是具有影像或是文字的該提示特徵,並無實質上的意思,故可藉由使用者根據該影像或是該文字賦予相關的意義。Next, in step S13, the multimedia framework corresponding to the prompt feature is attached with a semantic description to make the multimedia framework have semantic meaning. Here, due to the prompt feature When the image is taken out, it has only the image or the character of the prompt feature, and has no substantial meaning. Therefore, the user can give relevant meaning according to the image or the text.

接續上述的例子,取出的該提示特徵係分別地根據影像或是文字,進行語意描述的附加,用以使得所擷取的該影像或是該文字具有可供判斷的該意義。Following the above example, the prompt feature extracted is separately added to the semantic description according to the image or the text, so that the captured image or the text has the meaning to be judged.

再接著步驟S14,係形成具有該語意意義的該關注模組,以使該關注模組根據該語意意義追蹤與該提示特徵相關的該等多媒體框架。於此,根據上述步驟對於該提示特徵所進行的語意描述,使得可自該多媒體框架中根據提示特徵進行關注的追蹤,用以紀錄與該提示特徵相關的該影像或該文字。值得注意的是,該提示特徵係可為單一或是複數個事件,其係相依於該多媒體影像中所產生該等事件的次數與時間長度。Then, in step S14, the attention module having the meaning of the semantics is formed, so that the attention module tracks the multimedia frames related to the prompt features according to the meaning of the semantics. Herein, the semantic description of the prompt feature according to the above steps makes it possible to track the attention from the multimedia frame according to the prompt feature, and record the image or the text related to the prompt feature. It should be noted that the prompt feature may be a single or a plurality of events depending on the number and duration of the events generated in the multimedia image.

接續上述的例子,當主場隊伍與客場隊伍的比分係十分接近(例如僅1分的差距)的狀態時,則判斷該狀態係為使用者所十分關注的部分,則本發明之該步驟中係會持續地追蹤該狀態的變化,以此類推可根據主場隊伍與客場隊伍進行投擲與揮擊時的好球、壞球與出局數等進行追蹤。Following the above example, when the score of the home team and the away team is very close (for example, a gap of only 1 point), it is judged that the state is a part that the user is very concerned about, and the step of the present invention is It will continue to track changes in the status, and so on, based on the good and bad balls and the number of outs and throws in the throw and swing of the home team and the away team.

在接著步驟S15,係評價該提示特徵,以建立具有該語意意義的該關鍵片段。於此,該步驟係根據該關鍵模組中的該等提示特徵進行評價,給定例如以分數的高低進行評價,使得可根據評價的結果建立該關鍵片段,並讓使用者可直接地透過該評價而獲得所需的該關鍵片段。In the next step S15, the prompt feature is evaluated to establish the key segment having the semantic meaning. In this case, the step is evaluated according to the prompt features in the key module, and the evaluation is performed, for example, by the level of the score, so that the key segment can be established according to the result of the evaluation, and the user can directly pass the Evaluate to get the key piece you need.

參考第3圖,係本發明一實施例之多媒體資料評價方法的流程示意圖。於第3圖中,該多媒體資料評價方法係同樣選定多媒體資料的部分做為關鍵片段以引起使用者的關注,於本實施例中係同樣包含前述實施例之步驟S11~S15,不同的是該關鍵多媒體資料評價方法係更可包含步驟S31、步驟S32與步驟S33。Referring to FIG. 3, a flow chart of a multimedia material evaluation method according to an embodiment of the present invention is shown. In the third embodiment, the multimedia data evaluation method also selects a portion of the multimedia material as a key segment to attract the user's attention. In this embodiment, the steps S11 to S15 of the foregoing embodiment are also included, the difference being that The key multimedia data evaluation method may further include step S31, step S32, and step S33.

在步驟S11之前執行步驟S31,係預先地建立該語意描述與該提示特徵之間的相關聯,以供將該語意描述附加至該提示特徵。於此步驟中,係藉由使用者自行建立所需的該提示特徵,以在步驟S11~S15之後,可根據所自行定義的該提示特徵進行該關鍵片段的建立。於一實施例中,預先地建立該語意描述與該提示特徵之間的相關聯係包含該計分表上得分資料、比分資料、時間資料與局數資料Step S31 is performed before step S11, and an association between the semantic description and the prompt feature is established in advance for attaching the semantic description to the prompt feature. In this step, the user can establish the required prompt feature by himself, and after step S11~S15, the key segment can be established according to the prompt feature that is defined by himself. In an embodiment, pre-establishing a correlation between the semantic description and the prompt feature includes score data, score data, time data, and office data on the score sheet.

再者,該多媒體資料評價方法係更包含步驟S32,係該關注模組更包含將該提示特徵分類成正面關注(proportionally)事件、特別關注(specifically)事件與負面(inversely)關注事件,以供根據不同的關注事件評價該提示特徵而決定該使用者的關注的程度。Furthermore, the multimedia data evaluation method further includes step S32, wherein the attention module further comprises classifying the prompt feature into a positively focused event, a specificly targeted event, and an inversely focused event. The degree of attention of the user is determined by evaluating the prompt feature according to different events of interest.

此外,在該步驟S32之後更包含步驟S33,係根據不同的該等關注事件施以權重修正(weight modification),以調整對於該等關注事件對於該使用者的關注程度。In addition, after step S32, step S33 is further included, and weight modification is applied according to different of the attention events to adjust the degree of attention to the user for the attention events.

於一實施例中,在評價該提示特徵之後,提取評價該提示特徵係屬於該正面關注事件與該特別關注事件於該使用者以引起關注。In an embodiment, after evaluating the prompt feature, extracting and evaluating the prompt feature belongs to the positive attention event and the special attention event to the user to cause attention.

與習知技術相較,本發明之多媒體資料評價方法係用以分析所接收到具有複數多媒體框架的多媒體資料,並且在該等多媒體框架中係根據可獲得使用者關注的部分,在每一多媒體框架中擷取出對應的影像與文字之至少其一者,並將所擷取出的該提示特徵透過本發明進一步以附加語意描述的方法,使得該提示特徵具有可供評價的意義,且再藉由追蹤該提示特徵,使得在該多媒體資料可建立獲得使用者關注的該關鍵片段的部分。換言之,本發明係提供可藉由快速地分析該多媒體資料,用於提供使用者可正確地自該多媒體框架中獲得值得關注的該關鍵片段。Compared with the prior art, the multimedia data evaluation method of the present invention is for analyzing multimedia materials received with a plurality of multimedia frames, and in each multimedia frame, according to the part that can obtain user attention, in each multimedia. Extracting at least one of the corresponding image and the text in the frame, and further extracting the prompt feature extracted by the present invention by an additional semantic description method, so that the prompt feature has a meaning for evaluation, and further The hint feature is tracked such that a portion of the key piece that is of interest to the user can be established at the multimedia material. In other words, the present invention provides for providing the user with the key piece of interest that can be correctly obtained from the multimedia framework by quickly analyzing the multimedia material.

本發明在上文中已以較佳實施例揭露,然熟習本項技術者應理解的是,該實施例僅用於描繪本發明,而不應解讀為限制本發明之範圍。應注意的是,舉凡與該實施例等效之變化與置換,均應設為涵蓋於本發明之範疇內。因此,本發明之保護範圍當以申請專利範圍所界定者為準。The invention has been described above in terms of the preferred embodiments, and it should be understood by those skilled in the art that the present invention is not intended to limit the scope of the invention. It should be noted that variations and permutations equivalent to those of the embodiments are intended to be included within the scope of the present invention. Therefore, the scope of protection of the present invention is defined by the scope of the patent application.

S11~S15‧‧‧方法步驟S11~S15‧‧‧ method steps

S31~S33‧‧‧方法步驟S31~S33‧‧‧ method steps

第1圖係本發明一實施例之多媒體資料評價方法的流程示意圖;第2圖係說明該多媒體資料評價方法之多媒體資料的狀態示意圖;以及第3圖係本發明另一實施例之多媒體資料評價方法的流程示意圖。1 is a schematic flow chart of a multimedia data evaluation method according to an embodiment of the present invention; FIG. 2 is a schematic diagram showing a state of multimedia data of the multimedia data evaluation method; and FIG. 3 is a multimedia data evaluation of another embodiment of the present invention. Schematic diagram of the process.

S11~S15‧‧‧方法步驟S11~S15‧‧‧ method steps

Claims (13)

一種多媒體資料評價方法,係對不具關連性之複數多媒體資料進行評價以引起使用者的關注(attention),該多媒體資料評價方法係對每一多媒體資料擷取至少一部分做為關鍵片段以進行評價,各該多媒體資料的評價方法包含以下步驟:串流地自不具關連性之該等多媒體資料接收該多媒體資料,以自該多媒體資料中解析出複數多媒體框架(frame);分析每一該等多媒體框架,並自每一該等多媒體框架中選擇性地取得提示特徵(annotative feature);將對應於該提示特徵的該多媒體框架附加一語意描述(semantic description),以使該多媒體框架具有語意意義(semantic meaning);形成具有該語意意義的關注模組,以使該關注模組根據該語意意義追蹤與該提示特徵相關的該等多媒體框架;以及評價該提示特徵,以建立具有該語意意義的該關鍵片段。 A multimedia data evaluation method is to evaluate a plurality of multimedia materials that are not related to each other to cause a user's attention. The multimedia data evaluation method extracts at least a part of each multimedia material as a key segment for evaluation. Each of the methods for evaluating the multimedia material includes the steps of: streaming the multimedia material from the non-connected multimedia materials to parse a plurality of multimedia frames from the multimedia data; analyzing each of the multimedia frames And selectively obtaining an annotation feature from each of the multimedia frameworks; appending a semantic description to the multimedia framework corresponding to the prompt feature to make the multimedia framework semantically meaningful (semantic Meaning; forming a module of interest having the semantic meaning such that the module of interest tracks the multimedia frameworks associated with the hint features in accordance with the semantic meaning; and evaluating the hint features to establish the key with the semantic meaning Fragment. 如申請專利範圍第1項所述的多媒體資料評價方法,更包含預先地建立該語意描述與該提示特徵之間的相關聯,以供將該語意描述附加至該提示特徵。 The multimedia material evaluation method according to claim 1, further comprising pre-establishing an association between the semantic description and the prompt feature for attaching the semantic description to the prompt feature. 如申請專利範圍第1項所述的多媒體資料評價方法,其中該關注模組更包含將該提示特徵分類成正面關注事件、特 別關注事件與負面關注事件,以供根據不同的關注事件評價該提示特徵而決定該使用者的關注的程度。 The multimedia material evaluation method according to claim 1, wherein the attention module further comprises classifying the prompt feature into a positive attention event, Don't pay attention to the event and the negative attention event, so as to determine the degree of attention of the user according to the different attention events. 如申請專利範圍第3項所述的多媒體資料評價方法,更包含根據不同的該等關注事件施以權重修正(weight modification)的加權。 The method for evaluating multimedia materials according to item 3 of the patent application scope further includes weighting weighting according to different events of interest. 如申請專利範圍第3項所述的多媒體資料評價方法,其中該多媒體資料係為具有影像與文字之至少其一者。 The method for evaluating multimedia materials according to claim 3, wherein the multimedia data has at least one of an image and a text. 如申請專利範圍第5項所述的多媒體資料評價方法,其中該提示特徵的取得係更包含在該多媒體框架中取得視覺特徵與文字特徵之至少其一者。 The method for evaluating a multimedia material according to claim 5, wherein the obtaining of the prompt feature further comprises acquiring at least one of a visual feature and a character feature in the multimedia frame. 如申請專利範圍第6項所述的多媒體資料評價方法,其中該視覺特徵係更包含空間特徵圖像(spatial feature map)、時間特徵圖像(temporal feature map)與臉部特徵圖像(face feature map)。 The multimedia material evaluation method according to claim 6, wherein the visual feature system further comprises a spatial feature map, a temporal feature map, and a face feature image. Map). 如申請專利範圍第6項所述的多媒體資料評價方法,其中該多媒體資料的內容係為具有該影像與該文字之至少其一者所組成的新聞節目、電視電影節目或運動節目。 The multimedia material evaluation method according to claim 6, wherein the content of the multimedia material is a news program, a television movie program or a sports program composed of at least one of the image and the text. 如申請專利範圍第8項所述的多媒體資料評價方法,其中當該多媒體資料的內容係為該新聞節目時,分析每一該等多媒體框架中與該文字,以取得與新聞字幕(News subtitle)及口述文字語意相關的該提示特徵。 The method for evaluating multimedia materials according to claim 8, wherein when the content of the multimedia material is the news program, analyzing the text in each of the multimedia frames to obtain a news subtitle (News subtitle) And the prompt feature related to the spoken text semantics. 如申請專利範圍第8項所述的多媒體資料評價方法,其中當該多媒體資料的內容係為該電視電影節目時,分析每一該等多媒體框架中與該文字,以取得與劇情腳本(scripts) 相關的該提示特徵。 The method for evaluating multimedia materials according to claim 8 , wherein when the content of the multimedia material is the television movie program, analyzing the text in each of the multimedia frames to obtain scripts with scripts Related to this hint feature. 如申請專利範圍第8項所述的多媒體資料評價方法,其中當該多媒體資料的內容係為該運動節目時,分析每一該等多媒體框架中的該文字,以取得與計分板(superimposed caption box)及/或與影像相關的標記資料(notation information)之至少其一者相關的該提示特徵。 The method for evaluating multimedia materials according to claim 8, wherein when the content of the multimedia material is the sports program, the text in each of the multimedia frames is analyzed to obtain a superimposed caption. Box) and/or the prompt feature associated with at least one of the image-related notation information. 如申請專利範圍第11項所述的多媒體資料評價方法,其中預先地建立該語意描述與該提示特徵之間的相關聯係包含該計分表上得分資料、比分資料、時間資料與局數資料。 The multimedia material evaluation method according to claim 11, wherein the correlation between the semantic description and the prompt feature is pre-established to include score data, score data, time data, and office data on the score sheet. 如申請專利範圍第9、10或11項所述的多媒體資料評價方法,更包含在評價該提示特徵之後,提取評價該提示特徵係屬於該正面關注事件與該特別關注事件於該使用者以引起關注。 The method for evaluating multimedia materials according to claim 9, 10 or 11, further comprising: after evaluating the prompt feature, extracting and evaluating the prompt feature belongs to the positive attention event and the special attention event to the user to cause attention.
TW101133116A 2012-09-11 2012-09-11 Multimedia data evaluation method TWI483130B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW101133116A TWI483130B (en) 2012-09-11 2012-09-11 Multimedia data evaluation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW101133116A TWI483130B (en) 2012-09-11 2012-09-11 Multimedia data evaluation method

Publications (2)

Publication Number Publication Date
TW201411377A TW201411377A (en) 2014-03-16
TWI483130B true TWI483130B (en) 2015-05-01

Family

ID=50820851

Family Applications (1)

Application Number Title Priority Date Filing Date
TW101133116A TWI483130B (en) 2012-09-11 2012-09-11 Multimedia data evaluation method

Country Status (1)

Country Link
TW (1) TWI483130B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060253780A1 (en) * 1998-12-25 2006-11-09 Mastushita Electric Industrial Co., Ltd. Data processing device and method for selecting media segments on the basis of a score
TW200915789A (en) * 2007-06-25 2009-04-01 Yahoo Inc Social mobilized content sharing
TW200951832A (en) * 2008-04-15 2009-12-16 Novafora Inc Universal lookup of video-related data
US20120227078A1 (en) * 2007-03-20 2012-09-06 At&T Intellectual Property I, L.P. Systems and Methods of Providing Modified Media Content

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060253780A1 (en) * 1998-12-25 2006-11-09 Mastushita Electric Industrial Co., Ltd. Data processing device and method for selecting media segments on the basis of a score
US20120227078A1 (en) * 2007-03-20 2012-09-06 At&T Intellectual Property I, L.P. Systems and Methods of Providing Modified Media Content
TW200915789A (en) * 2007-06-25 2009-04-01 Yahoo Inc Social mobilized content sharing
TW200951832A (en) * 2008-04-15 2009-12-16 Novafora Inc Universal lookup of video-related data

Also Published As

Publication number Publication date
TW201411377A (en) 2014-03-16

Similar Documents

Publication Publication Date Title
US10757359B1 (en) System and methods providing sports event related media to internet-enabled devices synchronized with a live broadcast of the sports event
US10616663B2 (en) Computer-implemented capture of live sporting event data
CN110505519B (en) Video editing method, electronic equipment and storage medium
CN101303695B (en) Device for processing a sports video
US7657836B2 (en) Summarization of soccer video content
Bettadapura et al. Leveraging contextual cues for generating basketball highlights
EP1907076A1 (en) A method for analyzing the motion of a person during an activity
CN110381366A (en) Race automates report method, system, server and storage medium
US20080269924A1 (en) Method of summarizing sports video and apparatus thereof
JP2010509830A (en) Method and apparatus for generating a summary of a video data stream
CN106658030A (en) Method and device for playing composite video comprising single-path audio and multipath videos
TW201044868A (en) Method for scaling video content according to bandwidth rate
CN112312142B (en) Video playing control method and device and computer readable storage medium
WO2017056387A1 (en) Information processing device, information processing method and program
TWI483130B (en) Multimedia data evaluation method
CN112287771A (en) Method, apparatus, server and medium for detecting video event
Fujisawa et al. Automatic live sport video streams curation system from user generated media
Strickland Facebook takes on deepfakes
US11290766B2 (en) Automatic generation of augmented reality media
EP3905701A1 (en) Moving image tagging device and moving image tagging method
US20140180450A1 (en) Video and audio evaluation method and system
Zhao et al. Highlight summarization in soccer video based on goalmouth detection
US20170099363A1 (en) Electronic virtual sports scoreboard system that provides event alerts, video highlights and statistics to social media and other web-based distributions systems with minimal effort required of the scorekeeper
Seweryniak The application of computer and electronic tools during a sports spectacle in volleyball on the example of PlusLiga
Riley et al. Analysis architecture of a mobile sports replay system

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees