WO2014032420A1 - Method and system for obtaining interaction information - Google Patents

Method and system for obtaining interaction information Download PDF

Info

Publication number
WO2014032420A1
WO2014032420A1 PCT/CN2013/072618 CN2013072618W WO2014032420A1 WO 2014032420 A1 WO2014032420 A1 WO 2014032420A1 CN 2013072618 W CN2013072618 W CN 2013072618W WO 2014032420 A1 WO2014032420 A1 WO 2014032420A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
television
image
module
video stream
Prior art date
Application number
PCT/CN2013/072618
Other languages
French (fr)
Chinese (zh)
Inventor
邹仕洪
曾阳
Original Assignee
北京网秦天下科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京网秦天下科技有限公司 filed Critical 北京网秦天下科技有限公司
Publication of WO2014032420A1 publication Critical patent/WO2014032420A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/951—Indexing; Web crawling techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43—Querying
    • G06F16/432—Query formulation
    • G06F16/434—Query formulation using image data, e.g. images, photos, pictures taken by a user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/903—Querying
    • G06F16/9032—Query formulation

Definitions

  • the invention belongs to the technical field of mobile terminals, and in particular relates to a method and system for obtaining interactive information. Background technique
  • the object of the present invention is to provide a method and system for obtaining interactive information, by collecting, extracting and analyzing graphic information in a television program, and searching by using the graphic information to find corresponding interactive information, and completing User interaction with TV shows or other viewers.
  • the present invention provides a method for obtaining interactive information for a mobile terminal including a camera module and a display module, the method comprising:
  • the mobile terminal starts a camera module, captures or records a picture image or a video stream currently played by the television program, and uploads the image or video stream to the server;
  • the information processing step the server end detects and sorts the image or the video stream, and obtains graphic and text information
  • the server side performs identification according to the graphic information, obtains television column information, and retrieves interaction information corresponding to the television column information.
  • the information processing step further includes:
  • the icon and the text image information are respectively compared with the atlas and the text set in the map library, and the recognition result is classified and sorted to obtain the graphic information.
  • the atlas comprises a station logo of the television station
  • the set of characters comprises Chinese characters, letters, numbers.
  • the identifying and retrieving step further includes: identifying, according to the graphic information, the television column information corresponding to the graphic information on the server side, and searching according to the television column information Corresponding interactive information;
  • the interactive information includes: forum address, program introduction, contact information, and questionnaire survey.
  • the step of identifying and retrieving further comprises: if the corresponding television column information is not recognized on the server side, searching is performed through a network, where the network comprises a broadcast television network and an IP network.
  • the method further includes:
  • the processing step is to display the interaction information returned by the server for the user to process the interaction information, and the processing includes: participating in a discussion, a program broadcast, a contact interaction, and a response questionnaire.
  • the present invention provides a system for obtaining interactive information, wherein the system includes a mobile terminal and a server.
  • the mobile terminal includes: a camera module, a display module, an input module, and a communication module, wherein the input module is configured to start the camera module, and capture or record a picture image or a video stream currently played by the television program;
  • the communication module is configured to send the image or video stream to the server, and receive interactive information returned by the server;
  • the server side includes: a communication module, an information processing module, and an identification and retrieval module.
  • the communication module is configured to receive image or video stream data sent by the mobile terminal;
  • the information processing module is configured to detect, organize, and obtain image information of the image or video stream;
  • the identification and retrieval module is configured to perform identification according to the graphic information, and obtain television column information. And retrieve interactive information corresponding to the TV column information.
  • the communication module is further configured to send the interactive information identified by the identification and retrieval module to the mobile terminal.
  • the camera module comprises a front camera and/or a rear camera.
  • the information processing module is further configured to:
  • the icon and the text image information are respectively compared with the atlas and the text set in the map library, and the recognition result is classified and sorted to obtain the graphic information.
  • the atlas comprises a station logo of the television station
  • the set of characters includes Chinese characters, letters, and numbers.
  • the identification and retrieval module is further configured to: according to the graphic information, identify, by the server, the television column information corresponding to the graphic information, and retrieve the corresponding information according to the television column information.
  • Interactive information
  • the interactive information includes: forum address, program introduction, contact information, and questionnaire survey.
  • the identification and retrieval module is further configured to perform a search through a network if the corresponding television column information is not recognized on the server side, and the network includes a broadcast television network and an IP network.
  • the mobile terminal further includes a processing module, configured to display the interaction information returned by the server, for the user to process the interaction information, where the processing includes: participating in a discussion, a program Broadcast, contact interaction, reply questionnaire.
  • the invention provides a method and system for obtaining interactive information, which collects images and video streams through a mobile terminal device, and the server side extracts and analyzes graphic and text information in a television program, and searches and identifies on the server side by using the read graphic information.
  • the TV station's logo and corresponding interactive information through which users can easily interact with TV programs and interact with other viewers.
  • FIG. 1 is a flowchart of a method of obtaining interactive information according to an embodiment of the present invention
  • FIG. 2 is a flow chart of a specific method of obtaining interactive information according to an embodiment of the present invention
  • FIG. 3 is a flow chart showing a process of obtaining interactive information by a server side according to an embodiment of the present invention
  • FIG. 4 is a block diagram of a system for obtaining interactive information according to an embodiment of the present invention.
  • step S110 an input step
  • step S120 an information processing step
  • step S130 a recognition retrieval step
  • step S110 the mobile terminal starts the camera module, captures or records the picture image or video stream currently played by the television program, and uploads the image or video stream to the server.
  • step S120 the server detects and organizes the image or video stream to obtain graphic information.
  • step S130 the server side identifies according to the graphic information, obtains the television column information, and retrieves the interaction information corresponding to the television column information.
  • the mobile terminal of the present invention includes a smart mobile terminal such as a mobile phone or a tablet computer, and has a camera module and is capable of performing basic shooting or recording operations.
  • a method of obtaining interactive information is described in detail by taking a mobile phone as an example.
  • FIG. 2 there is illustrated a flow diagram of a particular method of obtaining interactive information in accordance with an embodiment of the present invention.
  • step 210 the mobile phone client is started, and the camera of the mobile phone is started, and a picture image or a video stream currently being played by the television program is captured or recorded.
  • the user wants to record and save the information or interact with the TV program through the information.
  • Mobile client shooting directly via mobile phone containing this A television picture of the information, or a video stream containing the information.
  • the camera of the mobile phone includes a front camera and/or a rear camera.
  • step 220 the mobile client saves the image captured by the mobile phone or the recorded video stream, and completes the collection of the information.
  • the mobile client uploads the image or video stream to the server.
  • step 240 the server detects, organizes, identifies, and retrieves the image or video stream to obtain interactive information corresponding to the television column information, and returns the obtained interactive information to the mobile phone client.
  • FIG. 3 is a flow chart showing a process of obtaining interactive information by a server side according to an embodiment of the present invention.
  • step 310 the server receives image or video stream data uploaded by the mobile phone.
  • the server detects icon and text image information from the image or video.
  • the server extracts key frames containing important information from the video stream, and detects the icons contained in the image or key frames according to a certain method (such as a color-based connected component method) or an algorithm (such as a texture-based segmentation algorithm). And the text area; Then, the text image of the text area is segmented from the background of the screen to obtain text image information.
  • a certain method such as a color-based connected component method
  • an algorithm such as a texture-based segmentation algorithm
  • step 330 the server side compares the icon and the text image information with the map library, and classifies and sorts the recognition result to obtain the graphic information.
  • the server side compares the icon and text image information with the atlas and text set in the library.
  • the atlas includes the logo of each TV station
  • the text set includes but is not limited to: Chinese characters, letters, numbers, and the like.
  • the server-side atlas and text set can also be downloaded and updated periodically from the network. By comparing the icon with the most similar pattern in the set, the graphic corresponding to the captured icon is determined. At the same time, the stroke feature of the text in the text image information can be compared with the text set in the map library to retrieve the most similar font. Finally, the results of the recognition are sorted and sorted to obtain graphic information.
  • Step 340 Identify, according to the graphic information, the television column information corresponding to the graphic information on the server side, and retrieve the corresponding interactive information according to the television column information. This interactive information can be returned to the mobile client
  • the server side can save the logo of all current TV stations for comparison identification.
  • the television station logo corresponding to the icon in the current graphic information is identified, and the accurate content of the television program corresponding to the logo is recognized by the text information in the graphic information, so that the accurate and useful television column information can be obtained, and then
  • the TV column information retrieves the corresponding interactive information.
  • This interactive information includes but is not limited to: forum address, program introduction, contact information, questionnaires, etc.
  • the interactive information may be a forum address link, a group address, a story introduction, a program schedule, a program hotline, a program mailbox address, a questionnaire content, and the like.
  • the network can be searched, and the network includes a broadcast television network, an IP network, and the like.
  • the processing steps of obtaining the TV column information can be completed in the mobile terminal, and the mobile terminal saves the logo information of all the TV stations in advance to form an atlas.
  • the mobile terminal detects the icon from the image or the video, and compares and recognizes the icon according to the icon and the atlas, wherein the atlas includes the logo of each television station. By comparing the icon with the most similar television station logo in the map set, the logo corresponding to the photographed icon is determined and the TV column information result is formed. Finally, the results are displayed to the user.
  • the atlas saved by the mobile terminal can be downloaded and updated periodically via the network.
  • the network includes a broadcast television network, an IP network, and the like.
  • step 250 the mobile client receives the interactive information returned by the server.
  • the mobile phone After receiving the returned interactive information, the mobile phone can display interactive information through the display screen for the user to view, thereby selecting the required information. At this point, the user can process the interactive information.
  • the mobile terminal provides a function for the user to process interactive information.
  • the treatment methods include but are not limited to: participation in discussion, program broadcast, contact interaction, reply questionnaire, and the like.
  • the user can complete the need by selecting different processing methods, which can be:
  • related forums related groups, etc.
  • users can choose "related forums” or “related groups”, enter the forum address related to TV programs to participate in the forum discussion or join the corresponding Group to come and express their opinions;
  • the user can directly respond to the answer to the questionnaire and reflect the participation by answering the questionnaire.
  • the system 400 includes a mobile terminal 400a and a server terminal 400b.
  • the mobile terminal 400a includes: a camera module 410, a display module 420, an input module 430, and a communication module 440.
  • the input module 430 is used to activate the camera module 410 to capture or record a picture image or video stream currently played by the television program.
  • the communication module 440 is configured to send an image or video stream to the server end 400b, and receive the interactive information returned by the server end 400b;
  • the server side 400b includes a communication module 460, an information processing module 470, and an identification retrieval module 480.
  • the communication module 460 is configured to receive image or video stream data sent by the mobile terminal 400a, and transmit the interactive information retrieved by the recognition search module 480 to the mobile terminal 400a.
  • the information processing module 470 is configured to detect and organize the image or video stream uploaded by the mobile terminal 400a to obtain graphic information.
  • the identification retrieval module 480 is configured to identify based on the graphic information, obtain the television column information, and retrieve the interactive information corresponding to the television column information.
  • the information processing module 470 is further configured to detect icon and text image information from the image or video stream, and compare the icon and the text image information with the atlas and the text set in the library.
  • the Atlas includes the logo of each TV station, and the text set includes but is not limited to: Chinese characters, letters, numbers, and so on.
  • the server-side atlas can also be downloaded and updated periodically from the network. By comparing the icon with the most similar pattern in the set, the graphic corresponding to the captured icon is determined. At the same time, the stroke feature of the text in the text image information is compared with the text set in the library, and the most similar font is retrieved. Finally, the comparison classifies and sorts the results of the recognition to obtain graphic information.
  • the identification and retrieval module 480 is further configured to compare the television column information corresponding to the graphic information on the server end 400b according to the graphic information, and retrieve an interactive letter corresponding to the television column information.
  • Interest The server side 400b can save the logos of all current television stations for comparison identification use. The comparison can identify the TV station logo corresponding to the icon in the current graphic information, and identify the accurate content of the TV program corresponding to the logo through the text information in the graphic information, thereby obtaining accurate and useful TV column information. Then, according to the TV column information, the corresponding interactive information is retrieved.
  • This interactive information includes but is not limited to: forum address, program introduction, contact information, questionnaires, etc.
  • the interactive information may be a forum address link, a group address, a story introduction, a program schedule, a program hotline, a program mailbox address, a questionnaire content, and the like.
  • the identification retrieval module 480 is further configured to perform a search through the network if the corresponding television column information is not recognized on the server side.
  • the network includes, but is not limited to, a broadcast television network, an IP network.
  • the mobile terminal 400a further includes a processing module 450 for displaying interactive information returned by the server 400b for the user to process the interactive information.
  • Processing methods include, but are not limited to, participation in discussions, program broadcasts, contact interactions, response questionnaires, and the like. If the user chooses to contact, the following options are available for the user to select: send SMS, call, save to address book, and more. Users can participate in live discussions through the "Call" hotline, or participate in the voting of the program by "sending a text message", or save the program hotline or program mailbox by "storing to the address book". For example, if the user is participating in a television program voting activity, the user can directly edit the person name or television program name supported by the user and send a text message after extracting the hotline of the television program.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present invention provides a method and a system for obtaining interaction information. The method comprises: an inputting step, that is, starting a camera module by a mobile terminal, to shoot or record an image or a video stream currently played in a television program, and uploading the image or video stream to a server end; an information processing step, that is, performing, by the server end, detection and collation on the image or video stream to obtain graphics and text information; and an identification and retrieval step, that is, performing, by the server end, identification according to the graphics and text information to obtain television column information, and retrieving interaction information corresponding to the television column information. According to the present invention, the mobile terminal collects the image and video stream, the server end extracts and analyzes the graphics and text information in the television program, reading the graphics and text information is performed to search in the server end, and a logo and corresponding interaction information of the television station are identified. With the information, a user may conveniently interacts with the television program, and interact with other televiewers.

Description

一种获得互动信息的方法和*** 技术领域  Method and system for obtaining interactive information
本发明属于移动终端技术领域， 尤其涉及一种获得互动信息的方法和系 统。 背景技术  The invention belongs to the technical field of mobile terminals, and in particular relates to a method and system for obtaining interactive information. Background technique
对于传统的电视收看方式，人们能和电视节目进行互动的有效方式是， 用 户需要凭记忆记住或通过文字方式记录下电视节目中的相关信息， 比如： 记录 电视节目的热线电话号码， 然后再通过拨打该热线电话参与电视节目，从而完 成互动。这种方式在信息快速传递的时代显示出极大的不便。现在随着手机的 应用， 各种信息融合在一起， 使得人们能更好的利用从电视中获取到的信息。 但是，如果用户需要通过手机参与问卷调查之类的电视互动节目，这时要利用 电视节目中的通讯地址等信息。如果人为记忆和手动输入地址信息，这会使得 效率很低并且很不方便。 发明内容  For traditional TV viewing methods, an effective way for people to interact with TV programs is that users need to remember or record the relevant information in the TV program by means of memory, such as: recording the hotline number of the TV program, and then Engage in the TV program by dialing the hotline to complete the interaction. This method shows great inconvenience in the era of rapid information transmission. Now with the application of mobile phones, various information is combined to make people better use the information obtained from the TV. However, if the user needs to participate in a TV interactive program such as a questionnaire through a mobile phone, it is necessary to use information such as a mailing address in the television program. If you artificially enter and manually enter address information, this can be inefficient and inconvenient. Summary of the invention
有鉴于此，本发明的目的是提供一种获得互动信息的方法和***，通过采 集、提取和分析电视节目中的图文信息， 并利用读图文信息进行搜索， 找到对 应的互动信息， 完成用户与电视节目或其他收视者之间的互动。  In view of this, the object of the present invention is to provide a method and system for obtaining interactive information, by collecting, extracting and analyzing graphic information in a television program, and searching by using the graphic information to find corresponding interactive information, and completing User interaction with TV shows or other viewers.
本发明提供一种获得互动信息的方法，用于包含摄像头模块和显示模块的 移动终端， 该方法包括：  The present invention provides a method for obtaining interactive information for a mobile terminal including a camera module and a display module, the method comprising:
输入步骤， 所述移动终端启动摄像头模块，拍摄或录制电视节目当前播放 的画面图像或视频流， 并将所述图像或视频流上传至服务器端；  In the input step, the mobile terminal starts a camera module, captures or records a picture image or a video stream currently played by the television program, and uploads the image or video stream to the server;
信息处理步骤， 所述服务器端对所述图像或视频流进行检测、 整理， 得到 图文信息； 以及  The information processing step, the server end detects and sorts the image or the video stream, and obtains graphic and text information;
识别检索步骤， 所述服务器端依据所述图文信息进行识别，获得电视栏目 信息， 并检索出与所述电视栏目信息相对应的互动信息。  Identifying the retrieval step, the server side performs identification according to the graphic information, obtains television column information, and retrieves interaction information corresponding to the television column information.
根据上述的方法， 其中， 所述摄像头模块包括前置摄像头和 /或后置摄像 根据上述的方法， 其中， 所述信息处理步骤进一步包括： According to the above method, wherein the camera module comprises a front camera and/or a rear camera According to the above method, the information processing step further includes:
从所述图像或视频流中检测出图标和文字图像信息；  Detecting icon and text image information from the image or video stream;
将所述图标和文字图像信息分别与图文库中的图集和文字集进行比对识 别， 对比对识别的结果进行分类、 整理后获得图文信息。  The icon and the text image information are respectively compared with the atlas and the text set in the map library, and the recognition result is classified and sorted to obtain the graphic information.
根据上述的方法， 其中， 所述图集包括电视台的台标， 所述文字集包括汉 字、 字母、 数字。  According to the above method, wherein the atlas comprises a station logo of the television station, and the set of characters comprises Chinese characters, letters, numbers.
根据上述的方法， 其中， 所述识别检索步骤进一步包括： 根据所述图文信 息，在所述服务器端比对识别出与图文信息相对应的电视栏目信息， 并依据所 述电视栏目信息检索出对应的互动信息；  According to the above method, the identifying and retrieving step further includes: identifying, according to the graphic information, the television column information corresponding to the graphic information on the server side, and searching according to the television column information Corresponding interactive information;
所述互动信息包括： 论坛地址、 节目介绍、 联系方式、 问卷调查。  The interactive information includes: forum address, program introduction, contact information, and questionnaire survey.
根据上述的方法， 其中， 所述识别检索步骤还包括， 如果在所述服务器端 没有识别到对应的电视栏目信息， 则通过网絡进行搜索， 所述网絡包括广播电 视网、 IP网各。  According to the above method, the step of identifying and retrieving further comprises: if the corresponding television column information is not recognized on the server side, searching is performed through a network, where the network comprises a broadcast television network and an IP network.
根据上述的方法， 其中， 所述方法进一步包括：  According to the above method, the method further includes:
处理步骤，显示所述服务器端返回的所述互动信息， 以供用户对所述互动 信息进行处理， 所述处理包括： 参与讨论、 节目播报、 联系互动、 回复问卷。  The processing step is to display the interaction information returned by the server for the user to process the interaction information, and the processing includes: participating in a discussion, a program broadcast, a contact interaction, and a response questionnaire.
本发明提供一种获得互动信息的***，其特征在于， 所述***包括移动终 端和服务器端，  The present invention provides a system for obtaining interactive information, wherein the system includes a mobile terminal and a server.
所述移动终端包括： 摄像头模块、 显示模块、 输入模块和通讯模块， 所述输入模块， 用于启动所述摄像头模块，拍摄或录制电视节目当前播放 的画面图像或视频流；  The mobile terminal includes: a camera module, a display module, an input module, and a communication module, wherein the input module is configured to start the camera module, and capture or record a picture image or a video stream currently played by the television program;
所述通讯模块， 用于将所述图像或视频流发送到所述服务器端， 并接收所 述服务器端返回的互动信息；  The communication module is configured to send the image or video stream to the server, and receive interactive information returned by the server;
所述服务器端包括： 通讯模块、 信息处理模块、 识别检索模块，  The server side includes: a communication module, an information processing module, and an identification and retrieval module.
所述通讯模块， 用于接收所述移动终端发送的图像或视频流数据； 所述信息处理模块， 用于对所述图像或视频流进行检测、 整理， 得到图文 信息；  The communication module is configured to receive image or video stream data sent by the mobile terminal; the information processing module is configured to detect, organize, and obtain image information of the image or video stream;
所述识别检索模块，用于依据所述图文信息进行识别，获得电视栏目信息， 并检索出与电视栏目信息对应的互动信息， The identification and retrieval module is configured to perform identification according to the graphic information, and obtain television column information. And retrieve interactive information corresponding to the TV column information.
其中，所述通讯模块还用于将所述识别检索模块检索识别到的互动信息发 送到所述移动终端。  The communication module is further configured to send the interactive information identified by the identification and retrieval module to the mobile terminal.
根据上述的***， 其中， 所述摄像头模块包括前置摄像头和 /或后置摄像 头。  According to the above system, wherein the camera module comprises a front camera and/or a rear camera.
根据上述的***， 其中， 所述信息处理模块进一步用于：  According to the above system, the information processing module is further configured to:
从所述图像或视频流中检测出图标和文字图像信息；  Detecting icon and text image information from the image or video stream;
将所述图标和文字图像信息分别与图文库中的图集和文字集进行比对识 别， 对比对识别的结果进行分类、 整理后获得图文信息。  The icon and the text image information are respectively compared with the atlas and the text set in the map library, and the recognition result is classified and sorted to obtain the graphic information.
根据上述的***， 其中， 所述图集包括电视台的台标， 所述文字集包括汉 字、 字母、 数字。  According to the above system, wherein the atlas comprises a station logo of the television station, and the set of characters includes Chinese characters, letters, and numbers.
根据上述的***， 其中， 所述识别检索模块进一步用于， 根据所述图文信 息，在所述服务器端比对识别出与图文信息对应的电视栏目信息， 并依据电视 栏目信息检索出对应的互动信息；  According to the above system, the identification and retrieval module is further configured to: according to the graphic information, identify, by the server, the television column information corresponding to the graphic information, and retrieve the corresponding information according to the television column information. Interactive information;
所述互动信息包括： 论坛地址、 节目介绍、 联系方式、 问卷调查。  The interactive information includes: forum address, program introduction, contact information, and questionnaire survey.
根据上述的***， 其中， 所述识别检索模块还用于， 如果在所述服务器端 没有识别到对应的电视栏目信息， 则通过网絡进行搜索， 所述网絡包括广播电 视网、 IP网各。  According to the above system, the identification and retrieval module is further configured to perform a search through a network if the corresponding television column information is not recognized on the server side, and the network includes a broadcast television network and an IP network.
根据上述的***， 其中， 所述移动终端进一步包括处理模块， 用于显示所 述服务器端返回的所述互动信息， 以供用户对所述互动信息进行处理， 所述处 理包括： 参与讨论、 节目播报、 联系互动、 回复问卷。  According to the above system, the mobile terminal further includes a processing module, configured to display the interaction information returned by the server, for the user to process the interaction information, where the processing includes: participating in a discussion, a program Broadcast, contact interaction, reply questionnaire.
本发明提供的一种获得互动信息的方法和***，通过移动终端设备采集图 像和视频流，服务器端提取和分析电视节目中的图文信息，并利用读图文信息 在服务器端进行搜索，识别到电视台的台标和对应的互动信息，通过这些信息 用户能方便地与电视节目进行互动， 并能与其他收视者交互。  The invention provides a method and system for obtaining interactive information, which collects images and video streams through a mobile terminal device, and the server side extracts and analyzes graphic and text information in a television program, and searches and identifies on the server side by using the read graphic information. The TV station's logo and corresponding interactive information, through which users can easily interact with TV programs and interact with other viewers.
附图说明 DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施 例或现有技术描述中所需要使用的附图作筒单的介绍。显而易见地， 下面描述 中的附图仅仅是本发明的一些实施例，对于本领域内普通技术人员来说，在不 付出创造性劳动的前提下， 还可以根据这些附图获得其他的附图。 在附图中： 图 1是根据本发明实施例的获得互动信息的方法的流程图； In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be described below. Obviously, the following describes The drawings in the drawings are merely some of the embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative work. In the drawings: FIG. 1 is a flowchart of a method of obtaining interactive information according to an embodiment of the present invention;
图 2是根据本发明实施例的获得互动信息的具体方法的流程图；  2 is a flow chart of a specific method of obtaining interactive information according to an embodiment of the present invention;
图 3是根据本发明实施例的服务器端获得互动信息的处理的流程图；以及 图 4是根据本发明实施例的获得互动信息的***的框图。 具体实施方式  3 is a flow chart showing a process of obtaining interactive information by a server side according to an embodiment of the present invention; and FIG. 4 is a block diagram of a system for obtaining interactive information according to an embodiment of the present invention. detailed description
为了使本发明实施例的目的、技术方案和优点更加清楚明白， 下面结合附 图对本发明实施例做进一步详细说明。在此，本发明的示意性实施例及其说明 用于解释本发明， 但并不作为对本发明的限定。  In order to make the objects, technical solutions and advantages of the embodiments of the present invention more clearly, the embodiments of the present invention will be further described in detail below. The illustrative embodiments of the invention and the description thereof are intended to be illustrative of the invention, and are not intended to limit the invention.
图 1示出了 居本发明实施例的获得互动信息的方法的流程图。该方法包 括输入步骤（步骤 S110 )、 信息处理步骤（步骤 S120 )和识别检索步骤（步骤 S130 )。  1 is a flow chart showing a method of obtaining interactive information in an embodiment of the present invention. The method includes an input step (step S110), an information processing step (step S120), and a recognition retrieval step (step S130).
在步骤 S110, 移动终端启动摄像头模块， 拍摄或录制电视节目当前播放 的画面图像或视频流， 并将图像或视频流上传至服务器端。  In step S110, the mobile terminal starts the camera module, captures or records the picture image or video stream currently played by the television program, and uploads the image or video stream to the server.
在步骤 S120, 服务器端对图像或视频流进行检测、 整理， 得到图文信息。 在步骤 S130, 服务器端依据图文信息进行识别， 获得电视栏目信息， 并 检索出与电视栏目信息对应的互动信息。  In step S120, the server detects and organizes the image or video stream to obtain graphic information. In step S130, the server side identifies according to the graphic information, obtains the television column information, and retrieves the interaction information corresponding to the television column information.
本发明的移动终端包括手机、平板电脑等智能移动终端，具备有摄像头模 块， 并能进行基本拍摄或录制操作。在以下实施例中以手机为例对获得互动信 息的方法进行详细描述。  The mobile terminal of the present invention includes a smart mobile terminal such as a mobile phone or a tablet computer, and has a camera module and is capable of performing basic shooting or recording operations. In the following embodiments, a method of obtaining interactive information is described in detail by taking a mobile phone as an example.
参见图 2， 其中示意了根据本发明实施例的获得互动信息的具体方法的流 程图。  Referring to Figure 2, there is illustrated a flow diagram of a particular method of obtaining interactive information in accordance with an embodiment of the present invention.
在步骤 210, 启动手机客户端， 同时启动手机的摄像头， 拍摄或录制电视 节目当前播放的画面图像或视频流。  In step 210, the mobile phone client is started, and the camera of the mobile phone is started, and a picture image or a video stream currently being played by the television program is captured or recorded.
在电视节目播放过程中， 如果出现用户需要的重要信息， 如： 电视剧、 实 时新闻、联系电话和通讯地址等， 用户想记录并保存这些信息或是通过这些信 息和电视节目进行互动的话，可以启动手机客户端，通过手机直接拍摄包含这 些信息的电视画面， 或是录取一段包含这些信息的电视视频流。 其中， 手机的 摄像头包括前置摄像头和 /或后置摄像头。 During the broadcast of a TV program, if important information required by the user, such as: TV drama, real-time news, contact telephone number, and mailing address, appears, the user wants to record and save the information or interact with the TV program through the information. Mobile client, shooting directly via mobile phone containing this A television picture of the information, or a video stream containing the information. Among them, the camera of the mobile phone includes a front camera and/or a rear camera.
在步骤 220， 手机客户端对手机拍摄的图像或录制的视频流进行保存， 完 成信息的采集。  In step 220, the mobile client saves the image captured by the mobile phone or the recorded video stream, and completes the collection of the information.
在步骤 230, 手机客户端将图像或视频流上传到服务器端。  At step 230, the mobile client uploads the image or video stream to the server.
在步骤 240，服务器端对图像或视频流进行检测、整理、识别和检索操作， 以获得与电视栏目信息相对应的互动信息，并将所获得的互动信息返回给手机 客户端。  In step 240, the server detects, organizes, identifies, and retrieves the image or video stream to obtain interactive information corresponding to the television column information, and returns the obtained interactive information to the mobile phone client.
服务器端对图像或视频流进行处理后获得互动信息的过程具体如图 3 所 示。 图 3示出了根据本发明实施例的服务器端获得互动信息的处理的流程图。  The process of obtaining interactive information after the server side processes the image or video stream is specifically shown in FIG. 3 . FIG. 3 is a flow chart showing a process of obtaining interactive information by a server side according to an embodiment of the present invention.
在步骤 310, 服务器端接收手机上传的图像或视频流数据。  In step 310, the server receives image or video stream data uploaded by the mobile phone.
在步骤 320， 服务器端从图像或视频中检测出图标和文字图像信息。  At step 320, the server detects icon and text image information from the image or video.
首先，服务器端从视频流中提取包含重要信息的关键帧， 并依据图像或关 键帧按照一定方法（如基于颜色的连通分量方法）或算法（如基于紋理的分割 算法）检测出其中包含的图标和文字区域； 然后， 将文字区域的文字图像从画 面背景中分割出来得到文字图像信息。  First, the server extracts key frames containing important information from the video stream, and detects the icons contained in the image or key frames according to a certain method (such as a color-based connected component method) or an algorithm (such as a texture-based segmentation algorithm). And the text area; Then, the text image of the text area is segmented from the background of the screen to obtain text image information.
在步骤 330, 服务器端将图标和文字图像信息与图文库进行比对识别， 对 比对识别结果进行分类、 整理后获得图文信息。  In step 330, the server side compares the icon and the text image information with the map library, and classifies and sorts the recognition result to obtain the graphic information.
服务器端将图标和文字图像信息分别与图文库中的图集和文字集进行比 对识别。 其中， 图集包括各电视台的台标， 而文字集包括但不限于： 汉字、 字 母、 数字等。 服务器端的图集和文字集还可以定期从网絡上进行下载更新。 通 过将图标和图集中的最相似图形进行比对， 判断出拍摄的图标所对应的图形。 同时， 可以依据文字图像信息中文字的笔画特征与图文库中的文字集进行比 对， 检索出最相似字形的文字。 最后， 对比对识别的结果进行分类、 整理， 以 获得图文信息。  The server side compares the icon and text image information with the atlas and text set in the library. Among them, the atlas includes the logo of each TV station, and the text set includes but is not limited to: Chinese characters, letters, numbers, and the like. The server-side atlas and text set can also be downloaded and updated periodically from the network. By comparing the icon with the most similar pattern in the set, the graphic corresponding to the captured icon is determined. At the same time, the stroke feature of the text in the text image information can be compared with the text set in the map library to retrieve the most similar font. Finally, the results of the recognition are sorted and sorted to obtain graphic information.
步骤 340， 根据图文信息， 在服务器端比对识别出与图文信息对应的电视 栏目信息， 并依据电视栏目信息检索出对应的互动信息。该互动信息可以返回 给手机客户端  Step 340: Identify, according to the graphic information, the television column information corresponding to the graphic information on the server side, and retrieve the corresponding interactive information according to the television column information. This interactive information can be returned to the mobile client
服务器端可以保存所有当前电视台的台标以供比对识别使用。通过比对可 以识别出当前图文信息中的图标所对应的电视台台标，并通过图文信息中的文 字信息识别出台标对应的电视台节目的准确内容，从而能获取到准确有用的电 视栏目信息，再依据电视栏目信息检索出对应的互动信息。该互动信息包括但 不限于： 论坛地址、 节目介绍、 联系方式、 问卷调查等。 例如， 该互动信息可 以是论坛地址链接、 群地址、 剧情介绍、 节目时间表、 节目热线电话、 节目信 箱地址、 问卷内容等。 The server side can save the logo of all current TV stations for comparison identification. By comparison The television station logo corresponding to the icon in the current graphic information is identified, and the accurate content of the television program corresponding to the logo is recognized by the text information in the graphic information, so that the accurate and useful television column information can be obtained, and then The TV column information retrieves the corresponding interactive information. This interactive information includes but is not limited to: forum address, program introduction, contact information, questionnaires, etc. For example, the interactive information may be a forum address link, a group address, a story introduction, a program schedule, a program hotline, a program mailbox address, a questionnaire content, and the like.
如果在服务器端没有识别到对应的电视栏目信息， 可以通过网絡进行搜 索， 网络包括广播电视网、 IP网絡等。  If the corresponding TV column information is not recognized on the server side, the network can be searched, and the network includes a broadcast television network, an IP network, and the like.
需要说明的是，如果用户只是想要获取电视台台标， 则获取电视栏目信息 的处理步骤可以在移动终端中完成，移动终端事先将所有电视台的台标信息进 行保存形成图集。移动终端从图像或视频中检测出图标，依据图标与图集进行 比对识别， 其中， 图集包括各电视台的台标。 通过将图标和图集中的最相似电 视台台标进行比对， 判断出拍摄的图标所对应的台标并形成电视栏目信息结 果。 最后， 将结果整理显示给用户。 移动终端保存的图集可以定期通过网絡进 行下载更新。 网絡包括广播电视网、 IP网絡等。  It should be noted that if the user only wants to obtain the TV station logo, the processing steps of obtaining the TV column information can be completed in the mobile terminal, and the mobile terminal saves the logo information of all the TV stations in advance to form an atlas. The mobile terminal detects the icon from the image or the video, and compares and recognizes the icon according to the icon and the atlas, wherein the atlas includes the logo of each television station. By comparing the icon with the most similar television station logo in the map set, the logo corresponding to the photographed icon is determined and the TV column information result is formed. Finally, the results are displayed to the user. The atlas saved by the mobile terminal can be downloaded and updated periodically via the network. The network includes a broadcast television network, an IP network, and the like.
在步骤 250, 手机客户端接收到服务器端返回的互动信息。  In step 250, the mobile client receives the interactive information returned by the server.
在接收到返回的互动信息后，手机可通过显示屏进行显示互动信息， 以供 用户进行查看， 从而选择需要的信息。 此时， 用户可以对互动信息进行处理。  After receiving the returned interactive information, the mobile phone can display interactive information through the display screen for the user to view, thereby selecting the required information. At this point, the user can process the interactive information.
移动终端提供用户处理互动信息的功能。 其中， 处理方式包括但不限于： 参与讨论、 节目播报、 联系互动、 回复问卷等。 用户可以通过选择不同的处理 方式来完成需要， 具体可以是：  The mobile terminal provides a function for the user to process interactive information. Among them, the treatment methods include but are not limited to: participation in discussion, program broadcast, contact interaction, reply questionnaire, and the like. The user can complete the need by selecting different processing methods, which can be:
今选择参与讨论， 则提供以下选项供用户选择： 相关论坛、 相关群等， 用户可以选择 "相关论坛" 或 "相关群"， 进入到与 电视节目相关的论坛地址参与论坛讨论或加入到相应的群中来 发表自己的观点；  Now choose to participate in the discussion, the following options are available for users to choose: related forums, related groups, etc., users can choose "related forums" or "related groups", enter the forum address related to TV programs to participate in the forum discussion or join the corresponding Group to come and express their opinions;
今选择节目播报， 则提供以下选项供用户选择： 查看剧情、 节目时间表等， 用户可以选择 "查看剧情" 来获取剧情列表链接 以查看电视剧情， 而选择 "节目时间表" 可以获取到电视节目的 播放时间表； 今选择联系互动， 则提供以下选项供用户选择： 发送短信、 呼叫、 存入通讯录等， 用户可以通过 "呼叫" 节目热线电话参与 现场讨论， 或通过 "发送短信" 参与节目的投票， 或通过 "存入 通讯录" 保存节目热线电话或节目信箱地址， 比如： 如果用户正 在参与电视节目投票活动， 则可以在提取到电视节目的热线电话 后直接编辑自己支持的人名或电视节目名并发送短信即可； If you choose to broadcast the program today, you can choose the following options: View the story, program schedule, etc. The user can select "View Story" to get the story list link to view the TV story, and select "Program Schedule" to get the TV program. Play schedule Now choose to contact, you can choose the following options: Send SMS, call, save to address book, etc. Users can participate in live discussion through "Call" program hotline, or participate in voting by "send SMS", or pass "Save in Address Book" Save the program hotline or program mailbox address, for example: If the user is participating in the TV program voting activity, you can directly edit the name of the person or TV program you support and send the text message after extracting the hotline of the TV program. Yes;
今选择回复问卷， 用户可直接回复问卷的答案，通过回答问 卷调查来体现参与度。  Now choose to reply to the questionnaire, the user can directly respond to the answer to the questionnaire and reflect the participation by answering the questionnaire.
参见图 4， 示出了根据本发明实施例的获得互动信息的*** 400的框图。 该*** 400包括移动终端 400a和 I务器端 400b。  Referring to Figure 4, a block diagram of a system 400 for obtaining interactive information in accordance with an embodiment of the present invention is shown. The system 400 includes a mobile terminal 400a and a server terminal 400b.
移动终端 400a包括： 摄像头模块 410、 显示模块 420、 输入模块 430和通 讯模块 440。 输入模块 430用于启动摄像头模块 410， 拍摄或录制电视节目当 前播放的画面图像或视频流。 通讯模块 440, 用于将图像或视频流发送到服务 器端 400b, 并接收服务器端 400b返回的互动信息；  The mobile terminal 400a includes: a camera module 410, a display module 420, an input module 430, and a communication module 440. The input module 430 is used to activate the camera module 410 to capture or record a picture image or video stream currently played by the television program. The communication module 440 is configured to send an image or video stream to the server end 400b, and receive the interactive information returned by the server end 400b;
服务器端 400b包括通讯模块 460、信息处理模块 470和识别检索模块 480。 通讯模块 460用于接收移动终端 400a发送的图像或视频流数据， 并将识别检 索模块 480检索到的互动信息发送到移动终端 400a。 信息处理模块 470用于 对移动终端 400a上传的图像或视频流进行检测、 整理， 得到图文信息。 识别 检索模块 480用于依据图文信息进行识别，获得电视栏目信息， 并检索出与电 视栏目信息对应的互动信息。  The server side 400b includes a communication module 460, an information processing module 470, and an identification retrieval module 480. The communication module 460 is configured to receive image or video stream data sent by the mobile terminal 400a, and transmit the interactive information retrieved by the recognition search module 480 to the mobile terminal 400a. The information processing module 470 is configured to detect and organize the image or video stream uploaded by the mobile terminal 400a to obtain graphic information. The identification retrieval module 480 is configured to identify based on the graphic information, obtain the television column information, and retrieve the interactive information corresponding to the television column information.
信息处理模块 470 进一步用于从图像或视频流中检测出图标和文字图像 信息， 并将图标和文字图像信息分别与图文库中的图集和文字集进行比对识 别。 图集包括各电视台的台标， 而文字集包括但不限于： 汉字、 字母、数字等。 服务器端的图集还可以定期从网絡上进行下载更新。通过将图标和图集中的最 相似图形进行比对， 判断出拍摄的图标所对应的图形。 同时， 将文字图像信息 中文字的笔画特征与图文库中的文字集进行比对， 检索出最相似字形的文字。 最后， 对比对识别的结果进 分类、 整理， 以获得图文信息。  The information processing module 470 is further configured to detect icon and text image information from the image or video stream, and compare the icon and the text image information with the atlas and the text set in the library. The Atlas includes the logo of each TV station, and the text set includes but is not limited to: Chinese characters, letters, numbers, and so on. The server-side atlas can also be downloaded and updated periodically from the network. By comparing the icon with the most similar pattern in the set, the graphic corresponding to the captured icon is determined. At the same time, the stroke feature of the text in the text image information is compared with the text set in the library, and the most similar font is retrieved. Finally, the comparison classifies and sorts the results of the recognition to obtain graphic information.
识别检索模块 480进一步用于根据图文信息， 在服务器端 400b比对识别 出与图文信息对应的电视栏目信息， 并检索出与电视栏目信息对应的互动信 息。 服务器端 400b可以保存所有当前电视台的台标以供比对识别使用。 通过 比对可以识别出当前图文信息中的图标对应的电视台台标，并通过图文信息中 的文字信息识别出台标所对应的电视台节目的准确内容，从而能获取到准确有 用的电视栏目信息，再依据电视栏目信息检索出对应的互动信息。该互动信息 包括但不限于： 论坛地址、 节目介绍、 联系方式、 问卷调查等。 例如， 该互动 信息可以是论坛地址链接、 群地址、 剧情介绍、 节目时间表、 节目热线电话、 节目信箱地址、 问卷内容等。 The identification and retrieval module 480 is further configured to compare the television column information corresponding to the graphic information on the server end 400b according to the graphic information, and retrieve an interactive letter corresponding to the television column information. Interest. The server side 400b can save the logos of all current television stations for comparison identification use. The comparison can identify the TV station logo corresponding to the icon in the current graphic information, and identify the accurate content of the TV program corresponding to the logo through the text information in the graphic information, thereby obtaining accurate and useful TV column information. Then, according to the TV column information, the corresponding interactive information is retrieved. This interactive information includes but is not limited to: forum address, program introduction, contact information, questionnaires, etc. For example, the interactive information may be a forum address link, a group address, a story introduction, a program schedule, a program hotline, a program mailbox address, a questionnaire content, and the like.
识别检索模块 480还用于，如果在服务器端没有识别到对应的电视栏目信 息， 则通过网絡进行搜索。 网絡包括但不限于， 广播电视网、 IP网絡。  The identification retrieval module 480 is further configured to perform a search through the network if the corresponding television column information is not recognized on the server side. The network includes, but is not limited to, a broadcast television network, an IP network.
移动终端 400a进一步包括处理模块 450, 用于显示服务器端 400b返回的 互动信息，以供用户对互动信息进行处理。处理方式包括但不限于：参与讨论、 节目播报、 联系互动、 回复问卷等。 如果用户选择联系互动， 则提供以下选项 供用户选择： 发送短信、 呼叫、 存入通讯录等。 用户可以通过 "呼叫" 热线电 话参与现场讨论， 或通过 "发送短信"参与节目的投票， 或通过 "存入通讯录" 保存节目热线电话或节目信箱。 例如， 如果用户正在参与电视节目投票活动， 则用户可以在提取到电视节目的热线电话后直接编辑自己支持的人名或电视 节目名并发送短信即可。  The mobile terminal 400a further includes a processing module 450 for displaying interactive information returned by the server 400b for the user to process the interactive information. Processing methods include, but are not limited to, participation in discussions, program broadcasts, contact interactions, response questionnaires, and the like. If the user chooses to contact, the following options are available for the user to select: send SMS, call, save to address book, and more. Users can participate in live discussions through the "Call" hotline, or participate in the voting of the program by "sending a text message", or save the program hotline or program mailbox by "storing to the address book". For example, if the user is participating in a television program voting activity, the user can directly edit the person name or television program name supported by the user and send a text message after extracting the hotline of the television program.
以上所述的具体实施例，对本发明的目的、技术方案和有益效果进行了进 一步详细说明， 所应理解的是， 以上所述仅为本发明的具体实施例而已， 并不 用于限定本发明的保护范围，凡在本发明的精神和原则之内，所做的任何修改、 等同替换、 改进等， 均应包含在本发明的保护范围之内。  The above described specific embodiments of the present invention are further described in detail, and it is to be understood that the foregoing description is only All modifications, equivalents, improvements, etc., made within the spirit and scope of the invention are intended to be included within the scope of the invention.

Claims

权利 要求 书 Claim
1、 一种获得互动信息的方法， 用于包含摄像头模块和显示模块的移动终 端， 其特征在于， 所述方法包括： A method for obtaining interactive information, comprising: a mobile terminal comprising a camera module and a display module, wherein the method comprises:
输入步骤， 所述移动终端启动摄像头模块，拍摄或录制电视节目当前播放 的画面图像或视频流， 并将所述图像或视频流上传至服务器端；  In the input step, the mobile terminal starts a camera module, captures or records a picture image or a video stream currently played by the television program, and uploads the image or video stream to the server;
信息处理步骤， 所述服务器端对所述图像或视频流进行检测、 整理， 得到 图文信息； 以及  The information processing step, the server end detects and sorts the image or the video stream, and obtains graphic and text information;
识别检索步骤， 所述服务器端依据所述图文信息进行识别，获得电视栏目 信息， 并检索出与所述电视栏目信息相对应的互动信息。  Identifying the retrieval step, the server side performs identification according to the graphic information, obtains television column information, and retrieves interaction information corresponding to the television column information.
2、 根据权利要求 1所述的方法， 其特征在于， 所述摄像头模块包括前置 摄像头和 /或后置摄像头。  2. The method of claim 1 wherein the camera module comprises a front camera and/or a rear camera.
3、 根据权利要求 1所述的方法， 其特征在于， 所述信息处理步骤进一步 包括：  3. The method according to claim 1, wherein the information processing step further comprises:
从所述图像或视频流中检测出图标和文字图像信息；  Detecting icon and text image information from the image or video stream;
将所述图标和文字图像信息分别与图文库中的图集和文字集进行比对识 别， 对比对识别的结果进行分类、 整理后获得图文信息。  The icon and the text image information are respectively compared with the atlas and the text set in the map library, and the recognition result is classified and sorted to obtain the graphic information.
4、 根据权利要求 3所述的方法， 其特征在于， 所述图集包括电视台的台 标， 所述文字集包括汉字、 字母、 数字。  4. The method according to claim 3, wherein the atlas comprises a logo of a television station, and the set of characters comprises Chinese characters, letters, and numbers.
5、 根据权利要求 1所述的方法， 其特征在于， 所述识别检索步骤进一步 包括： 根据所述图文信息，在所述服务器端比对识别出与图文信息相对应的电 视栏目信息， 并依据所述电视栏目信息检索出对应的互动信息；  The method according to claim 1, wherein the step of identifying and retrieving further comprises: identifying, according to the graphic information, the television column information corresponding to the graphic information on the server side, And retrieving corresponding interactive information according to the television column information;
所述互动信息包括： 论坛地址、 节目介绍、 联系方式、 问卷调查。  The interactive information includes: forum address, program introduction, contact information, and questionnaire survey.
6、 根据权利要求 5所述的方法， 其特征在于， 所述识别检索步骤还包括， 如果在所述服务器端没有识别到对应的电视栏目信息， 则通过网絡进行搜索， 所述网络包括广播电视网、 IP网絡。  The method according to claim 5, wherein the step of identifying and retrieving further comprises: if the corresponding television column information is not recognized at the server end, searching is performed through a network, where the network comprises a broadcast television Network, IP network.
7、 根据权利要求 1所述的方法， 其特征在于， 所述方法进一步包括： 处理步骤，显示所述服务器端返回的所述互动信息， 以供用户对所述互动 信息进行处理， 所述处理包括： 参与讨论、 节目播报、 联系互动、 回复问卷。 The method according to claim 1, wherein the method further comprises: a processing step of displaying the interaction information returned by the server, for the user to process the interaction information, the processing Including: Participate in discussions, program broadcasts, contact interactions, and respond to questionnaires.
8、 一种获得互动信息的***， 其特征在于， 所述***包括移动终端和服 务器端， 8. A system for obtaining interactive information, characterized in that the system comprises a mobile terminal and a server end,
所述移动终端包括： 摄像头模块、 显示模块、 输入模块和通讯模块， 所述输入模块， 用于启动所述摄像头模块，拍摄或录制电视节目当前播放 的画面图像或视频流；  The mobile terminal includes: a camera module, a display module, an input module, and a communication module, wherein the input module is configured to start the camera module, and capture or record a picture image or a video stream currently played by the television program;
所述通讯模块， 用于将所述图像或视频流发送到所述服务器端， 并接收所 述服务器端返回的互动信息；  The communication module is configured to send the image or video stream to the server, and receive interactive information returned by the server;
所述服务器端包括： 通讯模块、 信息处理模块、 识别检索模块，  The server side includes: a communication module, an information processing module, and an identification and retrieval module.
所述通讯模块， 用于接收所述移动终端发送的图像或视频流数据； 所述信息处理模块， 用于对所述图像或视频流进行检测、 整理， 得到图文 信息；  The communication module is configured to receive image or video stream data sent by the mobile terminal; the information processing module is configured to detect, organize, and obtain image information of the image or video stream;
所述识别检索模块，用于依据所述图文信息进行识别，获得电视栏目信息， 并检索出与电视栏目信息对应的互动信息，  The identification and retrieval module is configured to perform identification according to the graphic information, obtain television column information, and retrieve interactive information corresponding to the television column information,
其中，所述通讯模块还用于将所述识别检索模块检索识别到的互动信息发 送到所述移动终端。  The communication module is further configured to send the interactive information identified by the identification and retrieval module to the mobile terminal.
9、 根据权利要求 8所述的***， 其特征在于， 所述摄像头模块包括前置 摄像头和 /或后置摄像头。  9. The system of claim 8 wherein the camera module comprises a front camera and/or a rear camera.
10、 根据权利要求 8所述的***， 其特征在于， 所述信息处理模块进一步 用于：  The system according to claim 8, wherein the information processing module is further configured to:
从所述图像或视频流中检测出图标和文字图像信息；  Detecting icon and text image information from the image or video stream;
将所述图标和文字图像信息分别与图文库中的图集和文字集进行比对识 别， 对比对识别的结果进行分类、 整理后获得图文信息。  The icon and the text image information are respectively compared with the atlas and the text set in the map library, and the recognition result is classified and sorted to obtain the graphic information.
11、 根据权利要求 10所述的***， 其特征在于， 所述图集包括电视台的 台标， 所述文字集包括汉字、 字母、 数字。  11. The system according to claim 10, wherein the atlas comprises a station logo of the television station, and the set of characters comprises Chinese characters, letters, numbers.
12、 根据权利要求 8所述的***， 其特征在于， 所述识别检索模块进一步 用于，根据所述图文信息，在所述服务器端比对识别出与图文信息对应的电视 栏目信息， 并依据电视栏目信息检索出对应的互动信息；  The system according to claim 8, wherein the identification and retrieval module is further configured to: according to the graphic information, identify, by the server, the television column information corresponding to the graphic information, And corresponding to the interactive information according to the television column information;
所述互动信息包括： 论坛地址、 节目介绍、 联系方式、 问卷调查。  The interactive information includes: forum address, program introduction, contact information, and questionnaire survey.
13、 根据权利要求 12所述的***， 其特征在于， 所述识别检索模块还用 于，如果在所述服务器端没有识别到对应的电视栏目信息，则通过网絡进行搜 索， 所述网络包括广播电视网、 IP网絡。 13. The system according to claim 12, wherein the identification and retrieval module is further used If the corresponding TV column information is not recognized on the server end, the search is performed through a network, and the network includes a broadcast television network and an IP network.
14、 根据权利要求 8所述的***， 其特征在于， 所述移动终端进一步包括 处理模块， 用于显示所述服务器端返回的所述互动信息， 以供用户对所述互动 信息进行处理， 所述处理包括： 参与讨论、 节目播报、 联系互动、 回复问卷。  The system according to claim 8, wherein the mobile terminal further comprises a processing module, configured to display the interaction information returned by the server, for the user to process the interaction information, The processing includes: participation in discussions, program broadcasts, contact interactions, and responses to questionnaires.
PCT/CN2013/072618 2012-08-31 2013-03-14 Method and system for obtaining interaction information WO2014032420A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210319727.7A CN103686256A (en) 2012-08-31 2012-08-31 Method and system for displaying interactive information
CN201210319727.7 2012-08-31

Publications (1)

Publication Number Publication Date
WO2014032420A1 true WO2014032420A1 (en) 2014-03-06

Family

ID=50182435

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/072618 WO2014032420A1 (en) 2012-08-31 2013-03-14 Method and system for obtaining interaction information

Country Status (2)

Country Link
CN (1) CN103686256A (en)
WO (1) WO2014032420A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105007535A (en) * 2015-07-27 2015-10-28 天脉聚源（北京）科技有限公司 Method and device for generating interaction information of interaction television system

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103957324B (en) * 2014-05-17 2016-10-26 高伟 By the method and system that mobile communication terminal and TV programme are mutual
WO2015188753A1 (en) * 2014-06-13 2015-12-17 Tencent Technology (Shenzhen) Company Limited Interaction method based on multimedia programs and terminal device
CN104159136B (en) * 2014-05-29 2016-01-13 腾讯科技（深圳）有限公司 The acquisition methods of interactive information, terminal, server and system
CN104023250B (en) * 2014-06-13 2015-10-21 腾讯科技（深圳）有限公司 Based on the real-time interactive method and system of Streaming Media
CN104135671A (en) * 2014-07-25 2014-11-05 宁波创视信息技术有限公司 Television video content interactive question and answer method
CN105072567B (en) * 2015-08-10 2020-09-25 联想(北京)有限公司 Information processing method and electronic equipment
CN105187890A (en) * 2015-08-24 2015-12-23 天脉聚源（北京）科技有限公司 Method for generating television interactive system terminal interface
CN105100962A (en) * 2015-08-29 2015-11-25 天脉聚源（北京）科技有限公司 Method and device for generating interaction signal parallel-series single
CN105100918A (en) * 2015-08-29 2015-11-25 天脉聚源（北京）科技有限公司 Method and device for displaying interaction result
CN105979280A (en) * 2015-12-18 2016-09-28 乐视致新电子科技（天津）有限公司 Intelligent television program recognizing method and device
CN106060673A (en) * 2016-06-28 2016-10-26 无锡天脉聚源传媒科技有限公司 Method and robot device for assisting interaction between user and television
CN106851333A (en) * 2017-02-20 2017-06-13 浙江博通影音科技股份有限公司 Value-added service pusher and method
CN108763491B (en) * 2018-05-30 2020-06-26 Oppo广东移动通信有限公司 Picture processing method and device and terminal equipment
CN110533026A (en) * 2019-07-18 2019-12-03 西安电子科技大学 The competing image digitization of electricity based on computer vision and icon information acquisition methods
CN110555471B (en) * 2019-08-26 2022-09-13 珠海格力电器股份有限公司 Mobile terminal and target object searching method
CN111428121B (en) * 2020-03-17 2021-07-02 百度在线网络技术（北京）有限公司 Method and device for searching information

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127871A (en) * 2007-09-27 2008-02-20 北京中星微电子有限公司 A new method and device for interactive watching of TV programs
CN102185878A (en) * 2011-02-18 2011-09-14 华为技术有限公司 Method and system for obtaining television program information

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002335513A (en) * 2001-05-09 2002-11-22 Sony Corp Interactive television system set for each user based on user identification
KR100754656B1 (en) * 2005-06-20 2007-09-03 삼성전자주식회사 Method and system for providing user with image related information and mobile communication system
CN101771752A (en) * 2009-12-29 2010-07-07 中兴通讯股份有限公司 Mobile phone TV text information extraction method and mobile terminal with same
CN101867776B (en) * 2010-04-15 2013-04-24 西安酷派软件科技有限公司 Method and system for interaction of mobile television programs, mobile terminal and playing system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127871A (en) * 2007-09-27 2008-02-20 北京中星微电子有限公司 A new method and device for interactive watching of TV programs
CN102185878A (en) * 2011-02-18 2011-09-14 华为技术有限公司 Method and system for obtaining television program information

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105007535A (en) * 2015-07-27 2015-10-28 天脉聚源（北京）科技有限公司 Method and device for generating interaction information of interaction television system

Also Published As

Publication number Publication date
CN103686256A (en) 2014-03-26

Similar Documents

Publication Publication Date Title
WO2014032420A1 (en) Method and system for obtaining interaction information
CN102868934B (en) Video object information search method and device based on intelligent television
US9621950B2 (en) TV program identification method, apparatus, terminal, server and system
CN102298533B (en) Method for activating application program and terminal equipment
US11409817B2 (en) Display apparatus and method of controlling the same
CN103581705A (en) Method and system for recognizing video program
KR101846756B1 (en) Tv program identification method, apparatus, terminal, server and system
CN202998337U (en) Video program identification system
JP6474393B2 (en) Music playback method, apparatus and terminal device based on face album
CN105095873A (en) Picture sharing method and apparatus
CN105122242A (en) Methods, systems, and media for presenting mobile content corresponding to media content
CN105653276A (en) Method and apparatus for language setting
CN103377268B (en) System for carrying out target identification and event reproduction by using post-set data
CN113014854B (en) Method, device, equipment and medium for generating interactive record
CN101605178A (en) Use the method for the image information in the portable terminal
CN108289057B (en) Video editing method and device and intelligent mobile terminal
WO2020078215A1 (en) Video-based information acquisition method and device
CN102638711A (en) Multi-functional display device having a channel scan interface and a method for controlling the same
CN107491997A (en) Information-pushing method and system
CN102638712A (en) Multi-functional display device an method for contolling the same
CN107463681B (en) Method and device for identifying questions to be searched
CN107231569B (en) Method and system for generating personalized interface
CN101867776B (en) Method and system for interaction of mobile television programs, mobile terminal and playing system
CN108848404B (en) Two-dimensional code information sharing system of mobile terminal
CN113784156A (en) Live broadcast method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13832095

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13832095

Country of ref document: EP

Kind code of ref document: A1