WO2015196749A1 - 基于场景识别的信息推荐方法及装置 - Google Patents
基于场景识别的信息推荐方法及装置 Download PDFInfo
- Publication number
- WO2015196749A1 WO2015196749A1 PCT/CN2014/093401 CN2014093401W WO2015196749A1 WO 2015196749 A1 WO2015196749 A1 WO 2015196749A1 CN 2014093401 W CN2014093401 W CN 2014093401W WO 2015196749 A1 WO2015196749 A1 WO 2015196749A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- scene
- feature
- scene feature
- video stream
- recommendation
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000010586 diagram Methods 0.000 description 16
- 230000003993 interaction Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 238000007781 pre-processing Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 230000003139 buffering effect Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 235000013305 food Nutrition 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000008685 targeting Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
Definitions
- the present invention relates to the field of communications, and in particular to a method and apparatus for recommending information based on scene recognition.
- IPTV Internet Protocol Television
- OTT-TV Over The Top TV
- traditional business recommendations are either
- the service recommendation link is directly configured on the Electronic Program Guide (EPG) interface for recommendation, and the user can enter the specific page to view the recommendation information; or the recommendation information is pushed to the EPG interface through some message systems, and the scheduled display is performed.
- EPG Electronic Program Guide
- the present invention provides a method and device for recommending information based on scene recognition to solve at least the above problems.
- a method for information recommendation based on scene recognition including: matching a video stream with a preset scene feature to obtain a scene feature corresponding to the video stream; and according to the scene feature and the recommendation information Corresponding relationship, obtaining recommendation information corresponding to the video stream.
- the matching the video stream with the preset scene feature comprises: encoding the video stream to obtain a feature object to be matched; and matching the to-be-matched feature object with the scene feature object to obtain the video stream.
- Corresponding scene feature wherein the scene feature object is obtained by encoding the preset scene feature in advance.
- matching the to-be-matched feature object with the scene feature object to obtain the scene feature corresponding to the video stream includes: matching the to-be-matched feature object with the scene feature object; if the to-be-matched The similarity between the feature object and the scene feature object satisfies a preset condition, and the scene feature corresponding to the scene feature object is used as the scene feature corresponding to the video stream.
- encoding the preset scene feature in advance comprises: encoding the preset scene feature according to a scene mode corresponding to the preset scene feature.
- the scene mode of the preset scene feature comprises at least one of the following: a video scene, a voice scene, a subtitle scene, and a scenario scene.
- the format of the preset scene feature includes at least one of the following: a picture, a text, and a voice.
- the preset scene feature includes: a first scene feature and/or a second scene feature, wherein the first scene feature is a general scene feature, and the second scene feature is the video stream Dedicated scene features.
- the presenting the recommendation information corresponding to the video stream comprises: presenting the recommendation information corresponding to the video stream at a preset time.
- the method further includes: presenting recommendation information corresponding to the video stream.
- the video stream is a cached video stream to be played
- the recommendation information corresponding to the video stream is: when the video stream is played, the recommended information corresponding to the video stream is presented.
- the recommendation information is set with a recommendation identification code, and the recommendation identification code is used to distinguish recommendation information; the correspondence between the scene feature and the recommendation information is a correspondence between the scene feature and the recommendation identification code.
- an information recommendation device based on scene recognition including: a matching module, configured to match a video stream with a preset scene feature to obtain a scene feature corresponding to the video stream;
- the obtaining module is configured to obtain the recommendation information corresponding to the video stream according to the corresponding relationship between the scene feature and the recommendation information.
- the matching module includes: an encoding unit configured to encode the video stream to obtain a feature object to be matched; and a matching unit configured to match the to-be-matched feature object with a scene feature object to obtain a The scene feature corresponding to the video stream, wherein the scene feature object is obtained by encoding the preset scene feature in advance.
- the coding unit is further configured to perform coding on the preset scene feature according to the scene mode corresponding to the preset scene feature, to obtain the scene feature object.
- the scene mode of the preset scene feature comprises at least one of the following: a video scene, a voice scene, a subtitle scene, and a scenario scene.
- the format of the preset scene feature includes at least one of the following: a picture, a text, and a voice.
- the preset scene feature includes: a first scene feature and/or a second scene feature, wherein the first scene feature is a general scene feature, and the second scene feature is the video stream Dedicated scene features.
- the presentation module is configured to present recommendation information corresponding to the video stream at a preset time.
- the method further includes: a presentation module, configured to present recommendation information corresponding to the video stream
- the video stream is a cached video stream to be played
- the presentation module is configured to present recommendation information corresponding to the video stream when the video stream is played.
- the recommendation information is set with a recommendation identification code, and the recommendation identification code is used to distinguish recommendation information; the correspondence between the scene feature and the recommendation information is a correspondence between the scene feature and the recommendation identification code.
- the video stream is matched with the preset scene feature to obtain the scene feature corresponding to the video stream; the recommendation information corresponding to the video stream is obtained according to the corresponding relationship between the scene feature and the recommendation information; and the recommendation information corresponding to the video stream is presented. , based on the video scene can be more accurate recommendation information.
- FIG. 1 is a flowchart 1 of a method for recommending information based on scene recognition according to an embodiment of the present invention
- FIG. 2 is a structural block diagram of an information recommendation apparatus based on scene recognition according to an embodiment of the present invention
- FIG. 3 is a second flowchart of a method for recommending information based on scene recognition according to an embodiment of the present invention
- FIG. 4 is a structural block diagram 1 of a first device according to an embodiment of the present invention.
- FIG. 5 is a structural block diagram 2 of a first device according to an embodiment of the present invention.
- FIG. 6 is a flowchart 3 of a method for recommending information based on scene recognition according to an embodiment of the present invention
- FIG. 7 is a structural block diagram 1 of a second device according to an embodiment of the present invention.
- FIG. 8 is a structural block diagram 2 of a second device according to an embodiment of the present invention.
- FIG. 9 is a schematic diagram of a preferred scene recognition based information recommendation system according to an embodiment of the present invention.
- FIG. 10 is a structural block diagram of a preferred scene recognition based information recommendation system according to an embodiment of the present invention.
- FIG. 11 is a flowchart of scene feature delivery according to an embodiment of the present invention.
- FIG. 12 is a flowchart of scene feature generation according to an embodiment of the present invention.
- FIG. 13 is a flowchart of scene feature matching according to an embodiment of the present invention.
- FIG. 17 is a flowchart of an information recommendation method according to Embodiment 3 of the present invention.
- Figure 18 is a flowchart of an information recommendation method according to Embodiment 4 of the present invention.
- the first device may be various types of devices, such as a set top box, a mobile terminal, a home server, a router, and the like.
- the second device may be a server, a cluster with servers, or the like. It is to be expected that the methods and apparatus of the following embodiments can be implemented by a computer program.
- FIG. 1 is a flowchart 1 of a method for recommending information based on scene recognition according to an embodiment of the present invention. As shown in FIG. 1, the method includes steps S102 to S104.
- step S102 the video stream is matched with the preset scene feature to obtain a scene feature corresponding to the video stream.
- Step S104 Acquire recommendation information corresponding to the video stream according to the correspondence between the scene feature and the recommendation information.
- the recommendation information corresponding to the video stream may also be presented.
- the scene mode of the preset scene feature may include at least one of the following: a video scene, a voice scene, a subtitle scene, and a scenario scene.
- the format of the preset scene feature may include at least one of the following: a picture, a text, and a voice.
- the scene feature is related to the content of the video, and may be information such as an image, a dialogue, a plot, an actor, a movie release time, or a theme included in the video content.
- the scene of the video content is effectively and intelligently recognized, and then the interactive recommendation based on the images, dialogues, plots, actors and the like included in the video content can well solve the recommended targeting. , the relevance problem, enhance the user's interaction, and truly achieve specific services such as recommending advertisements and shopping according to the user's manipulation of a certain content.
- the video stream may be encoded to obtain a feature object to be matched, and the feature object to be matched is matched with the scene feature object to obtain a scene feature corresponding to the video stream, where
- the scene feature object is obtained by pre-coding the preset scene features.
- different coding methods are used, and different coding modes are used, and the coding may not be performed.
- the preset feature features are encoded, and the scene features in the form of pictures and voice texts may be encoded to obtain a vector that is convenient for comparison.
- the video stream is encoded by extracting images, subtitles, voices, etc. from the video stream, and encoding the information into corresponding vectors.
- the feature object to be matched may be matched with the scene feature object; if the similarity between the feature object to be matched and the scene feature object satisfies a preset condition, the scene feature object is correspondingly The scene feature is used as the scene feature corresponding to the video stream.
- the preset scene feature is encoded in advance, and the preset scene feature may be encoded according to the preset scene mode corresponding to the scene feature.
- different encoding methods are used for images and speech.
- the preset scene feature may include: a first scene feature and/or a second scene feature, where the first scene feature is a general scene feature, and the second scene feature is a video stream.
- Dedicated scene features may be scene features applicable to all videos, or may be scene features applicable to a type of video.
- the dedicated scene features described above may be scene features set for a single video, or may be scene features set for certain videos.
- the recommendation information corresponding to the presentation video stream may be a link for displaying the recommendation information on the screen, or may directly display the recommendation information.
- the presentation time of the recommendation information may be set, and the recommendation information corresponding to the video stream is presented at a preset time.
- the video stream may be a cached video stream to be played, and the recommended information corresponding to the video stream may be presented when the video stream is played. For example, performing scene matching on the cached video stream to be played, and obtaining recommendation information corresponding to the video stream, and presenting the recommendation information when the video is in the private room. For example, in the cached video stream, when a conference scene appears in a certain period of time, the conference-related recommendation information, such as office equipment advertisement, conference hotel information, etc., may be presented while playing the video of the time period.
- the conference-related recommendation information such as office equipment advertisement, conference hotel information, etc.
- the recommendation information may be set with the recommendation identifier, and the recommendation identifier is used to distinguish the recommendation information; the correspondence between the scene feature and the recommendation information is the correspondence between the scene feature and the recommendation identifier.
- the device mainly includes: a matching module 10 and an obtaining module 20.
- the matching module 10 is configured to match the video stream with the preset scene feature to obtain a scene feature corresponding to the video stream.
- the obtaining module 20 is configured to obtain the recommendation information corresponding to the video stream according to the corresponding relationship between the scene feature and the recommendation information.
- the matching module 10 includes: an encoding unit configured to encode a video stream to obtain a feature object to be matched; and a matching unit configured to match the to-be-matched feature object with the scene feature object Obtaining a scene feature corresponding to the video stream, wherein the scene feature object is obtained by encoding the preset scene feature in advance.
- the coding unit is further configured to perform coding on a preset scene feature according to a preset scene mode corresponding to the scene feature, to obtain a scene feature object.
- the scene mode of the preset scene feature includes at least one of the following: a video scene, a voice scene, a subtitle scene, and a scenario scene.
- the format of the preset scene feature includes at least one of the following: a picture, a text, and a voice.
- the preset scene feature includes: a first scene feature and/or a second scene feature, where the first scene feature is a common scene feature, and the second scene feature is a video stream.
- Dedicated scene features are included in the preset scene feature.
- the method may further include: a presentation module, configured to present recommendation information corresponding to the video stream.
- the presentation module is configured to present recommendation information corresponding to the video stream at a preset time.
- the video stream is a cached video stream to be played
- the presentation module is configured to present the recommended information corresponding to the video stream when the video stream is played.
- the recommendation information may be set with a recommendation identification code, and the recommendation identification code is used to distinguish the recommendation information; the correspondence between the scene feature and the recommendation information is a correspondence between the scene feature and the recommendation identification code.
- the foregoing method and apparatus of the embodiments of the present invention may be implemented in one device or may be implemented through multiple devices.
- the modules of the above devices may be located in one device or distributed on different devices. This embodiment of the present invention does not limit this.
- FIG. 3 is a second flowchart of a method for recommending information based on scene recognition according to an embodiment of the present invention. As shown in FIG. 3, the method includes steps S302 to S306.
- Step S302 The first device matches the video stream with the preset scene feature to obtain a scene feature corresponding to the video stream.
- Step S304 The first device acquires the recommendation information corresponding to the video stream from the second device according to the scene feature corresponding to the video stream.
- Step S306 the first device presents the recommendation information corresponding to the video stream.
- the foregoing first device may be a device such as a set top box or a mobile terminal.
- the first device may locally match the video stream with preset scene features.
- the first device may perform the foregoing step S302 by using the second device, where the first device may encode the video stream, obtain the feature object to be matched, send the feature object to be matched to the second device, and receive the second device according to the to-be-matched
- the feature object matches the scene feature corresponding to the obtained video stream.
- the first device performing local matching may include: the first device encodes the video stream to obtain a feature object to be matched; and the first device matches the to-be-matched feature object with the scene feature object. Obtaining a scene feature corresponding to the video stream, wherein the scene feature object is obtained by pre-coding the preset scene feature.
- the scene feature object is obtained by pre-coding the preset scene feature.
- the first device may acquire a preset scene feature from the second device, where the preset scene feature includes a first scene feature and/or a second scene feature, where the first scene feature is a common scene feature
- the second scene feature is a dedicated scene feature of the video stream.
- the first device may send a request message to the second device, where the request message carries a first update time of a pre-stored scene feature in the first device, where the first device receives the preset scene feature. And the second device sends the preset scene feature in the case that the first update is not later than the second update time of the scene feature on the second device.
- the update time By carrying the update time, the information interaction between the first device and the second device can be reduced, and if the scene feature is updated, the updated scene feature is sent.
- the first device pre-stores the foregoing first scene feature, and the first device may acquire the second scene feature from the second device.
- the foregoing first scenario may be that the first device requests to be sent from another device, or the other device may be actively configured to the first device, and the other device may include the foregoing second device.
- the first device may send the scenario feature corresponding to the video stream to the second device, and receive the recommendation information corresponding to the video stream sent by the second device, where the second device The device is configured to obtain the recommendation information corresponding to the video stream according to the corresponding relationship between the scene feature and the recommendation information.
- the first device may determine, according to the correspondence between the scene feature and the recommendation identifier of the recommendation information, the recommended identifier corresponding to the scene feature corresponding to the video stream, and Sending the determined recommendation identifier to the second device, and receiving the recommendation information corresponding to the video stream sent by the second device, where the second device is configured to obtain the recommendation information corresponding to the video stream according to the correspondence between the recommendation identifier and the recommendation information, where The recommended identification code is used to identify the recommended information.
- the first device may present the recommendation information according to a preset time.
- the above video stream may be a cached video to be played, and the recommended information may be presented when the video stream is played.
- the recommendation information may be presented on the first device, or the first device may present the recommendation information through other devices.
- the first device can present recommendation information on the television terminal of the set top box.
- FIG. 4 is a structural block diagram of a first device according to an embodiment of the present invention.
- the first device mainly includes: a matching module 402, a first obtaining module 404, and a rendering module 406.
- the matching module 402 is configured to match the video stream with the preset scene feature to obtain a scene feature corresponding to the video stream.
- the first obtaining module 404 is connected to the matching module 402 and configured to be based on the scene feature corresponding to the video stream.
- the recommendation information corresponding to the video stream is obtained from the second device; and the presentation module 406 is connected to the first acquisition module 404 and configured to present the recommendation information corresponding to the video stream.
- the matching module 402 is configured to match the video stream with the preset scene feature on the first device; and/or, the matching module 402 may include: a coding unit, set to be The video stream is encoded to obtain a feature object to be matched; the sending unit is configured to send the feature object to be matched to the second device, and the receiving unit is configured to receive the scene feature corresponding to the video stream obtained by the second device according to the matching feature object to be matched.
- the first device may further include: a second acquiring module, configured to acquire a preset scene feature from the second device, where the preset scene feature includes the first scene feature and And a second scene feature, wherein the first scene feature is a general scene feature and the second scene feature is a dedicated scene feature of the video stream.
- a second acquiring module configured to acquire a preset scene feature from the second device, where the preset scene feature includes the first scene feature and And a second scene feature, wherein the first scene feature is a general scene feature and the second scene feature is a dedicated scene feature of the video stream.
- the second obtaining module includes: a sending unit, configured to send a request message to the second device, where the request message carries a feature of the scene feature pre-stored in the first device An update time; the receiving unit is configured to receive the second device, and send the preset scene feature in a case that the first update time is not later than the second update time of the scene feature on the second device.
- the first device may pre-store the first scene feature
- the second acquiring module is configured to acquire the second scene feature from the second device.
- the first acquiring module 404 may include: a first acquiring unit, configured to send a scene feature corresponding to the video stream to the second device, and receive recommendation information corresponding to the video stream sent by the second device, where the second device is configured according to Corresponding relationship between the scene feature and the recommendation information acquires recommendation information corresponding to the video stream.
- the second obtaining unit is configured to: according to the correspondence between the scene feature and the recommendation identifier of the recommendation information, determine a recommendation identifier corresponding to the scene feature corresponding to the video stream, and send the determined recommendation identifier to the second device, and receive The recommendation information corresponding to the video stream sent by the second device, wherein the second device is configured to obtain the recommendation information corresponding to the video stream according to the correspondence between the recommendation identifier and the recommendation information, where the recommendation identifier is used to identify the recommendation information.
- the first device includes: a communication interface 502 configured to communicate with a second device and at least one third device; at least one process
- the device 504 is configured to match the video stream with the preset scene feature to obtain a scene feature corresponding to the video stream, and obtain, according to the scene feature corresponding to the video stream, the recommendation information corresponding to the video stream from the second device; The recommended information corresponding to the video stream.
- FIG. 6 is a flowchart 3 of a method for recommending information based on scene recognition according to an embodiment of the present invention. As shown in FIG. 6, the method includes steps S602 to S604.
- Step S602 The second device, in response to the first request of the first device, matches the video stream requested by the first device with a preset scene feature, to obtain a scene feature corresponding to the video stream.
- Step S604 The second device sends the recommendation information corresponding to the video stream to the first device according to the corresponding feature of the scene and the recommendation information according to the corresponding feature of the video stream.
- the first request carries a to-be-matched feature object of the video stream, where the to-be-matched feature object is encoded by the first device.
- the second device may send the recommendation information corresponding to the video stream to the first device according to the corresponding relationship between the scene feature and the recommendation information; or the second device may be based on the correspondence between the scene feature and the recommendation information. Acquiring the recommendation information corresponding to the video stream; the second device sends the recommended identifier of the obtained recommendation information to the first device, where the recommendation identifier is used to distinguish the recommendation information.
- the method may further include: the second device responding to the second request of the first device, and sending, according to the recommended identifier carried in the second request, the carried identifier code to the first device.
- Recommended information when receiving the multiple recommended identifiers, the first device may request the second device to obtain the recommended information, or may receive the recommended identifier to obtain the corresponding recommended information.
- the method may further include: responding to the third request of the first device by the second device, according to the first update time carried in the third request and the feature of the scene on the second device
- the second update time is sent to the first device, where the first update time is an update time of the scene feature stored on the first device; wherein the first update time is earlier than the second update time, and the second device is The first device sends a scene feature.
- the preset scene feature may include: a first scene feature and/or a second scene feature, where the first scene feature is a general scene feature, and the second scene feature is a dedicated scene feature of the video stream.
- first scene feature and the second scene feature refer to the foregoing description of the embodiments of the present invention, and details are not described herein again.
- the third message is used to request the second scene feature, wherein the first device stores the first scene feature in advance.
- FIG. 7 is a structural block diagram 1 of a second device, including: a matching module 702 and a first sending module 704, according to an embodiment of the present invention.
- the matching module 702 is configured to: in response to the first request of the first device, match the video stream requested by the first device with the preset scene feature to obtain a scene feature corresponding to the video stream; the first sending module 704, and the matching
- the module 702 is connected to be configured to send the recommendation information corresponding to the video stream to the first device according to the corresponding relationship between the scene feature and the recommendation information according to the corresponding feature of the video stream.
- the first request carries the to-be-matched feature object of the video stream, where the to-be-matched feature object is obtained by encoding the video stream by the first device.
- the first sending module 704 may include: a first sending unit, configured to send the recommended information corresponding to the video stream to the first device according to the corresponding relationship between the scene feature and the recommendation information; or
- the second sending unit is configured to acquire the recommended information corresponding to the video stream according to the corresponding relationship between the scene feature and the recommendation information, and send the recommended identifier of the obtained recommended information to the first device, where the recommended identifier is used to distinguish the recommended information.
- the second device may further include: a second sending module, configured to send the carried to the first device according to the second identifier that is sent in response to the second request The recommended information corresponding to the identification code.
- the second device may further include: a third sending module, configured to respond to the third request of the first device, according to the first update time carried in the third request, and the second device The second update time of the scene feature is sent to the first device, where the first update time is an update time of the scene feature stored on the first device; wherein, if the first update time is earlier than the second The update time, the third sending module sends the scene feature to the first device.
- a third sending module configured to respond to the third request of the first device, according to the first update time carried in the third request, and the second device The second update time of the scene feature is sent to the first device, where the first update time is an update time of the scene feature stored on the first device; wherein, if the first update time is earlier than the second The update time, the third sending module sends the scene feature to the first device.
- the preset scene feature includes: a first scene feature and/or a second scene feature, where the first scene feature is a common scene feature, and the second scene feature is a dedicated scene feature of the video stream.
- first scenario feature and the second scenario feature refer to the foregoing description of the embodiments of the present invention, and details are not described herein again.
- the third message is used to request the second scene feature, wherein the first device may pre-store the first scene feature.
- FIG. 8 is a block diagram showing the structure of a second device according to an embodiment of the present invention.
- the second device may include: a communication interface 802 connected to at least one processor 804, configured to be associated with the first device and at least a third device communication; the at least one processor 804 is configured to: in response to the first request of the first device, match the video stream requested by the first device with a preset scene feature, to obtain a scene feature corresponding to the video stream; The stream corresponds to the scene feature, and the recommendation information corresponding to the video stream is sent to the first device according to the corresponding relationship between the scene feature and the recommendation information.
- the video stream is matched with the preset scene feature to obtain the scene feature corresponding to the video stream; and the recommendation information corresponding to the video stream is obtained according to the corresponding relationship between the scene feature and the recommendation information; and the video stream corresponding to the video stream is presented.
- Recommended information, based on the video scene can be more accurate recommendation information.
- FIG. 9 is a schematic diagram of a preferred scene recognition based information recommendation system, as shown in FIG. 9, in accordance with an embodiment of the present invention.
- the system mainly includes: a recommendation server (corresponding to the second device described above) 1 , which is responsible for presetting the scene mode and scene feature information (also referred to as a scene feature in the above embodiment), and giving a specific service recommendation according to the recommendation identification code.
- a recommendation server (corresponding to the second device described above) 1 , which is responsible for presetting the scene mode and scene feature information (also referred to as a scene feature in the above embodiment), and giving a specific service recommendation according to the recommendation identification code.
- set top box (equivalent to the first device described above) 2, responsible for generating and storing scene feature information, code stream buffering and identification, feature matching and recommendation identification code generation
- IPTV/OTT system mainly providing basic video playback Function
- third-party system 4 mainly provides specific presentation of various recommended services.
- the above-mentioned system mainly includes the following interaction process: the scenario is sent, and the recommendation server 1 delivers the scene feature according to the preset scene mode; the scenario generation, the set top box 2 encodes the scene feature, and generates the generated scene feature object and recommendation recognition.
- the code is stored in the scene feature library; the scene recognition 2, the set top box 2 performs code stream buffering when playing the video from the IPTV/OTT system 3, pre-analyzes the cached code stream, and analyzes the result to perform intelligent matching. If the matching is successful, the recommended feature is output.
- the service recommendation, the set top box 2 initiates a request to the recommendation server according to the recommended identification code, and displays the recommendation page according to the returned recommendation information, thereby redirecting to the third party system.
- the scene of the video content in the IPTV system is effectively and intelligently recognized, and then the interactive recommendation based on the images, dialogues, plots, actors and the like included in the video content is good. Solve the targeted and relevant issues of recommendation, enhance the user's interaction, and truly achieve specific services such as recommending advertisements and shopping according to the user's manipulation of a certain content.
- FIG. 10 is a structural block diagram of a preferred scene recognition based information recommendation system according to an embodiment of the present invention.
- the system includes a set top box 2, a recommendation server 1, an IPTV/OTT system 3, and a third party system 4.
- the set top box 2 includes a scene generation module 210, a scene feature library 220, a code stream identification module 230, a feature matching module 240, and a service recommendation module 250.
- the video scene is mainly a picture information of actors, costumes, articles, foods, etc. that need to be matched in the recorded video
- the scene is mainly the keywords in the dialogue and the narration that need to be matched in the recorded video
- the subtitle scene is mainly the subtitle keyword that needs to be matched in the recorded video
- the scenario of the scenario is mainly the preset plot time point that needs to be matched in the recorded video
- a recommendation identifier is bound to each scene feature information in the recommendation server to establish an association relationship between the scene feature and the recommendation identifier; and the relationship between the recommendation identifier and the recommendation information is maintained for identification of the recommendation information;
- the scene generation module in the set top box accepts scene feature information (including the recommendation identification code) from the recommendation server, and encodes and generates specific semantics according to different scene modes, such as a video scene, a voice scene, a subtitle scene, and a scenario scene. Scene feature objects and save to the scene feature library;
- the code stream identification module in the set top box is responsible for pre-resolving the code stream in the cache to generate a feature object to be matched;
- the feature matching module in the set top box performs the operation matching between the feature object to be matched and the scene feature database. If the feature to be matched includes a certain scene feature in the scene feature database, the corresponding identification code corresponding to the scene feature is obtained.
- the service recommendation module in the set top box is responsible for requesting the recommendation server to obtain the recommendation information, and displaying the recommendation information to the user in a predetermined format, and the user can jump to the third party system by displaying the recommendation information. To obtain more detailed business information and complete the entire process of business recommendation.
- the method for implementing service recommendation based on scene intelligent identification in the embodiment of the present invention includes the following steps:
- Step A The server is recommended to maintain and deliver the scene features.
- Step B The set top box receives the scene features from the recommendation server to generate scene features.
- Step C The set top box receives the video stream from the IPTV/OTT system and performs scene recognition matching.
- Step D The set top box generates recommendation information according to the matching result.
- FIG. 11 is a flowchart of scene feature delivery according to an embodiment of the present invention, which is executed in the above step A, and the implementation steps are as follows:
- Step S1102 The scene information of the scene is included in the recommendation server, including but not limited to a video scene, a voice scene, a subtitle scene, a scenario scene, and the like; the scene feature information may be bound to a specific video, or may be a full video adaptation.
- Step S1104 The service recommendation information is entered in the recommendation server, and a unique recommendation identification code is generated for each service recommendation information.
- Step S1106 The recommendation server binds the scene feature information and the service recommendation information, and the binding relationship is established by the recommendation identification code, so that bidirectional access can be implemented.
- Step S1108 Before the set-top box reads the video, the set-top box obtains the request for the common scene feature information from the recommendation server, and carries the user information and the timestamp.
- the behavior can be obtained according to the actual demand and is obtained when the set-top box is started up to reduce the viewing. Frequently acquired repeated scene feature information before the video.
- Step S1110 The recommendation server detects the validity of the user. If the detection is passed and the latest timestamp on the server is updated with the comparison of the timestamp field, the video feature information and the recommendation identifier are sent to the set-top box, and the delivered protocol can be based on Not limited to the HTTP protocol.
- Step S1112 The set-top box obtains a request for the specific video scene feature information from the recommendation server before playing the video, and carries the user information, the content number, and the delivery time stamp.
- Step S1114 The recommendation server detects the validity of the user. If the detection is passed and the latest timestamp on the server is updated with the comparison of the timestamp field, the specific video scene feature information and the recommended identification code are sent to the set top box, and the issued protocol may be Based on, but not limited to, the HTTP protocol.
- FIG. 12 is a flowchart of scene feature generation according to an embodiment of the present invention, which is executed in the above step B, and the implementation steps are as follows:
- Step S1202 The set top box receives the scene feature information from the recommendation server.
- Step S1204 The scene generation module of the set top box encodes the scene feature information according to the scene mode, and generates a scene feature object of a specific semantic.
- Step S1206 The scene generation module of the set top box establishes an association relationship between the scene feature object and the recommendation identifier.
- Step S1208 The set top box stores the generated scene feature object and the association relationship with the recommended identification code into the scene feature database, and stores the time stamp.
- FIG. 13 is a flowchart of scene feature matching according to an embodiment of the present invention, which is executed in the above step C, and the implementation steps are as follows:
- Step S1302 The set top box plays the video code stream from the IPTV/OTT system, and buffers the code stream.
- Step S1304 The code stream identification module of the set top box identifies the cached code stream, and can identify each frame of the video, a piece of voice, a subtitle, and a play time, and encode to form a specific semantics. Match the feature object and pass it to the feature matching module.
- voice and subtitle mainly form text
- the playing time is mainly absolute time and relative time
- the absolute time format adopts year, month, day, hour, minute and second
- the relative time format adopts hour and minute.
- Step S1306 The feature matching template in the set top box performs an operation matching operation between the to-be-matched feature object and the scene feature library.
- Step S1308 If the feature to be matched includes a certain scene feature in the scene feature library, such as the feature included in the image and the image feature object in the scene feature library reach a threshold, the voice and subtitle in the code stream are included in the scene feature library. Corresponding to the text keyword, if the preset story time point arrives, the matching is successful, then step S1305 is performed, and if the matching fails, the processing is directly discarded.
- a certain scene feature in the scene feature library such as the feature included in the image and the image feature object in the scene feature library reach a threshold
- the voice and subtitle in the code stream are included in the scene feature library.
- step S1305 is performed, and if the matching fails, the processing is directly discarded.
- Step S1310 The feature matching template acquires the corresponding feature identifier of the scene feature from the scene feature database.
- Step S1312 At the same time, the feature matching template records the playing time of the video code stream, and sets the recommended triggering time to the service recommendation module, and prepares to trigger the service recommendation process.
- FIG. 14 is a flowchart of information recommendation according to an embodiment of the present invention, which is performed in the above step D, and the implementation steps are as follows:
- Step S1402 The service recommendation module in the set top box determines whether the recommended trigger time arrives; if yes, proceeds to step S1404.
- Step S1404 The service recommendation module assembly request message in the set top box initiates a request to the recommendation server, where the request message carries the user information and the recommendation identification code.
- Step S1406 After receiving the request of the set top box, the recommendation server detects the validity of the user. If the detection passes, the specific recommendation information is returned according to the recommended identification code, and generally includes the interface display information and the URL thereof.
- Step S1408 After receiving the recommendation information, the service recommendation module in the set top box parses and assembles according to a predetermined template format.
- Step S1410 After the service recommendation information is parsed and assembled, the service recommendation page is formed, and the service recommendation page is displayed to the user.
- Step S1412 After viewing the recommendation page, the user may select whether to jump from the recommendation page to the third-party system for shopping or the like according to his or her hobbies.
- the scene generation module, the scene feature library, the code stream identification module, the feature matching library, and the service recommendation module of the set top box in the schematic diagram are all built in the set top box to perform scene recognition matching, as shown in FIG.
- the steps are as follows:
- Step S1502 The user clicks on the video, and the set top box requests the recommendation server to deliver the scene feature.
- Step S1504 The set top box performs scene feature coding and stores it in the scene feature library.
- Step S1506 When the user watches the video, the set top box requests the video in the IPTV/OTT system and receives the video code stream.
- Step S1508 The set top box caches the code stream, and identifies and codes the cache code stream to generate an identifiable feature object to be matched.
- Step S1510 The set top box identifies and matches the to-be-matched feature object and the feature matching library, and obtains the recommended identification code.
- Step S1512 The set top box carries the recommended identification code to obtain recommendation information from the recommendation server.
- Step S1514 The set top box parses the recommendation information returned by the recommendation server and presents it to the user.
- the scene generation module, the scene feature library, and the feature matching module of the set top box are moved to the recommendation server in the schematic diagram, and the recommendation server is used as the scene recognition processing in the cloud, and the code stream identification module and the service recommendation module continue to be placed.
- the report and recommendation request are reported in the set top box feature, as shown in FIG. 16, and the steps include:
- Step S1602 The recommendation server encodes the scene features and stores them in the scene feature library.
- Step S1604 When the user watches the video, the set top box requests the video in the IPTV/OTT system and receives the video code stream.
- Step S1606 The set top box caches the code stream, and identifies and codes the cache code stream to generate an identifiable feature object to be matched.
- Step S1608 The set top box sends the to-be-matched feature object to the recommendation server for cloud matching.
- Step S1610 The recommendation server identifies and matches the to-be-matched feature object and the feature matching library, and obtains the recommended identification code.
- Step S1612 The recommendation server returns the recommendation identification code to the set top box.
- Step S1614 The set top box carries the recommended identification code to obtain recommendation information from the recommendation server.
- Step S1616 The set top box parses the recommendation information returned by the recommendation server and presents it to the user.
- the mobile terminal Based on the scene recognition of the mobile terminal (such as a mobile phone, a Pad, etc.), all the corresponding modules in the set top box can be transplanted to the mobile terminal to implement scene recognition and service recommendation of the mobile terminal.
- the mobile terminal is mainly accessed through the wireless network and is connected to the Wifi mode.
- the process of the specific embodiment can be performed by referring to the first embodiment, and the scenario is matched in the mobile terminal; when accessing the 3G/4G mode, more needs to be considered.
- the network interaction and the data traffic are reduced. Therefore, in combination with the cloud processing mode of the embodiment 2, the video segment is identified on the cloud server side, and all the recommended identification codes of the video segment are returned after the matching is identified, as shown in FIG. :
- Step S1702 The recommendation server encodes the scene features and stores them in the scene feature library.
- Step S1704 When the user watches the video, the mobile terminal requests the video in the IPTV/OTT system and receives the video code stream.
- Step S1706 The mobile terminal initiates a feature matching request to the recommendation server, where the request is for a video code stream time period.
- Step S1708 The recommendation server performs matching identification on the requested video code stream time period in the cloud, and generates multiple recommendation identification codes.
- Step S1710 The recommendation server returns multiple recommendation identification codes to the mobile terminal.
- Step S1712 The mobile terminal records each recommendation identification code and its recommended trigger time.
- Step S1714 After the recommended trigger time arrives, the mobile terminal carries the recommended identification code to obtain recommendation information from the recommendation server.
- Step S1716 The mobile terminal parses the recommendation information returned by the recommendation server and presents it to the user.
- Step S1718 The mobile terminal starts the feature matching request of the next video stream according to the video viewing progress, and repeats step S1706.
- this mode mainly performs matching matching on the video in advance in the cloud.
- the main advantage is that the matching is fast, the requirements on the terminal are not high, and the versatility is good, because the video is released when the IPTV/OTT system is released. All the scene matching has been pre-processed, and the recommended identifier of the video and the recommended trigger time have been generated. However, due to the pre-processing, it is impossible to pay attention to the matching of the personality characteristics of the user. As shown in Figure 18, the steps include:
- Step S1802 The recommendation server performs batch pre-processing on the video in the IPTV/OTT system, matches the scene feature library, and identifies the videos one by one.
- Step S1804 The recommendation identifier generated by the recommendation server according to the result of the matching identification and the recommended triggering time are stored in correspondence with the video.
- Step S1806 When the user watches the video, the set top box mobile terminal requests the video in the IPTV/OTT system and receives the video code stream.
- Step S1808 The set top box/mobile terminal initiates a feature matching request to the recommendation server.
- Step S1810 The recommendation server queries the stored pre-processing matching result, and if it hits, returns the result.
- Step S1812 The recommendation server returns all the recommended identification codes of the video to the set top box/mobile terminal.
- Step S1814 The set top box/mobile terminal records each recommendation identification code and its recommended trigger time.
- Step S1816 After the recommended trigger time arrives, the set top box/mobile terminal carries the recommended identification code to obtain recommendation information from the recommendation server.
- Step S1818 The mobile terminal parses the recommendation information returned by the recommendation server and presents it to the user.
- the present invention achieves the following technical effects to solve the existing information and service recommendation information and association and interaction in the video, and the plurality of video sharing service recommendation information, so that the user can watch
- relevant recommendation information is obtained as the video scene changes, the user's interaction is enhanced, and the pertinence and versatility of the service recommendation are enhanced; in the IPTV/OTT system, the intelligent recognition based on the video content is
- the field of business recommendation has universal practical application significance.
- modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device, thereby Storing them in a storage device is performed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that herein, or separately fabricated into individual integrated circuit modules, or Multiple of these modules or steps are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.
- the video stream is matched with the preset scene feature to obtain a scene feature corresponding to the video stream; and the recommendation information corresponding to the video stream is obtained according to the corresponding relationship between the scene feature and the recommendation information;
- the recommendation information corresponding to the video stream is presented, and the information can be more accurately recommended based on the video scene.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明公开了一种基于场景识别的信息推荐方法及装置,其中,基于场景识别的信息推荐方法,包括:将视频流与预设的场景特征进行匹配,得到所述视频流对应的场景特征;根据场景特征与推荐信息的对应关系,获取所述视频流对应的推荐信息;以及,呈现所述视频流对应的推荐信息。通过本发明,提高了信息推荐的准确性,能够实现根据视频场景推荐信息。
Description
本发明涉及通信领域,具体而言,涉及一种基于场景识别的信息推荐方法及装置。
目前,在交互式网络电视(Internet Protocol Television,简称为IPTV)/基于开放互联网的视频服务(Over The Top TV,简称为OTT-TV)***中,传统的业务推荐(如广告、购物)要么是直接在电子节目指南(Electronic Program Guide,简称为EPG)界面上配置业务推荐链接进行推荐,用户进入到具体页面才能观看推荐信息;要么是通过一些消息***推送推荐信息到EPG界面上,定时定点展示给终端用户。
但是这些业务推荐都是相对独立的,作为独立的业务形式在进行运作,被推送的可能是一些用户毫无兴趣的推荐信息。
发明内容
针对相关技术中信息推荐不准确的问题,本发明提供了一种基于场景识别的信息推荐方法及装置,以至少解决上述问题。
根据本发明的一个实施例,提供了一种基于场景识别的信息推荐方法,包括:将视频流与预设的场景特征进行匹配,得到所述视频流对应的场景特征;根据场景特征与推荐信息的对应关系,获取所述视频流对应的推荐信息。
优选地,将视频流与预设的场景特征进行匹配,包括:对所述视频流进行编码,得到待匹配特征对象;将所述待匹配特征对象与场景特征对象进行匹配,得到所述视频流对应的场景特征,其中,所述场景特征对象由预先对所述预设的场景特征编码得到。
优选地,将所述待匹配特征对象与场景特征对象进行匹配,得到所述视频流对应的场景特征,包括:将所述待匹配特征对象与所述场景特征对象进行匹配;如果所述待匹配特征对象与所述场景特征对象的相似度满足预设条件,将所述场景特征对象对应的场景特征作为所述视频流对应的场景特征。
优选地,预先对所述预设的场景特征编码,包括:按照所述预设的场景特征对应的场景模式,分类对所述预设的场景特征进行编码。
优选地,所述预设的场景特征的场景模式包括以下至少之一:视频场景、语音场景、字幕场景,剧情场景。
优选地,所述预设的场景特征的格式包括以下至少之一:图片、文本、语音。
优选地,所述预设的场景特征,包括:第一场景特征和/或第二场景特征,其中,所述第一场景特征为通用场景特征,所述第二场景特征为所述视频流的专用场景特征。
优选地,呈现所述视频流对应的推荐信息,包括:在预设的时间呈现所述视频流对应的推荐信息。
优选地,还包括,呈现所述视频流对应的推荐信息。
优选地,所述视频流为缓存的待播放的视频流,呈现所述视频流对应的推荐信息包括:在播放所述视频流时,呈现所述视频流对应的推荐信息。
优选地,所述推荐信息设置有推荐识别码,所述推荐识别码用于区分推荐信息;所述场景特征与推荐信息的对应关系为场景特征与推荐识别码的对应关系。
根据本发明的又一个实施例,提供了一种基于场景识别的信息推荐装置,包括:匹配模块,设置为将视频流与预设的场景特征进行匹配,得到所述视频流对应的场景特征;获取模块,设置为根据场景特征与推荐信息的对应关系,获取所述视频流对应的推荐信息。
优选地,所述匹配模块,包括:编码单元,设置为对所述视频流进行编码,得到待匹配特征对象;匹配单元,设置为将所述待匹配特征对象与场景特征对象进行匹配,得到所述视频流对应的场景特征,其中,所述场景特征对象由预先对所述预设的场景特征编码得到。
优选地,所述编码单元,还设置为按照所述预设的场景特征对应的场景模式,分类对所述预设的场景特征进行编码,得到所述场景特征对象。
优选地,所述预设的场景特征的场景模式包括以下至少之一:视频场景、语音场景、字幕场景,剧情场景。
优选地,所述预设的场景特征的格式包括以下至少之一:图片、文本、语音。
优选地,所述预设的场景特征,包括:第一场景特征和/或第二场景特征,其中,所述第一场景特征为通用场景特征,所述第二场景特征为所述视频流的专用场景特征。
优选地,所述呈现模块,设置为在预设的时间呈现所述视频流对应的推荐信息。
优选地,还包括:呈现模块,设置为呈现所述视频流对应的推荐信息
优选地,所述视频流为缓存的待播放的视频流,所述呈现模块,设置为在播放所述视频流时,呈现所述视频流对应的推荐信息。
优选地,所述推荐信息设置有推荐识别码,所述推荐识别码用于区分推荐信息;所述场景特征与推荐信息的对应关系为场景特征与推荐识别码的对应关系。
通过本发明,将视频流与预设的场景特征进行匹配,得到视频流对应的场景特征;根据场景特征与推荐信息的对应关系,获取视频流对应的推荐信息;并呈现视频流对应的推荐信息,基于视频场景能够更为准确的推荐信息。
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:
图1是根据本发明实施例的基于场景识别的信息推荐方法的流程图一;
图2是根据本发明实施例的基于场景识别的信息推荐装置的结构框图;
图3是根据本发明实施例的基于场景识别的信息推荐方法的流程图二;
图4是根据本发明实施例的第一设备的结构框图一;
图5是根据本发明实施例的第一设备的结构框图二;
图6是根据本发明实施例的基于场景识别的信息推荐方法的流程图三;
图7是根据本发明实施例的第二设备的结构框图一;
图8是根据本发明实施例的第二设备的结构框图二;
图9是根据本发明实施例优选的基于场景识别的信息推荐***的示意图;
图10是根据本发明实施例优选的基于场景识别的信息推荐***的结构框图;
图11是根据本发明实施例的场景特征下发的流程图;
图12是根据本发明实施例的场景特征生成的流程图;
图13是根据本发明实施例的场景特征匹配的流程图;
图14是根据本发明实施例的信息推荐的流程图;
图15是根据本发明实施例1的信息推荐方法的流程图;
图16是根据本发明实施例2的信息推荐方法的流程图;
图17是根据本发明实施例3的信息推荐方法的流程图;以及
图18是根据本发明实施例4的信息推荐方法的流程图。
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。
在以下实施例中,第一设备可以是各种类型的设备,例如,机顶盒、移动终端、家庭服务器、路由器等。第二设备可以是服务器、有服务器组成的集群等。可以预料的是,以下实施例的方法及装置可以通过计算机程序实现。
图1是根据本发明实施例的基于场景识别的信息推荐方法的流程图一,如图1所示,该方法包括步骤S102至步骤S104。
步骤S102,将视频流与预设的场景特征进行匹配,得到该视频流对应的场景特征。
步骤S104,根据场景特征与推荐信息的对应关系,获取上述视频流对应的推荐信息。
本发明实施例中,还可以呈现上述视频流对应的推荐信息。
在本发明实施例中,上述预设的场景特征的场景模式可以包括以下至少之一:视频场景、语音场景、字幕场景、剧情场景。预设的场景特征的格式可以包括以下至少之一:图片、文本、语音。
在本发明实施例中,上述场景特征与视频的内容相关,可以是视频内容包含的图像、对白、剧情、演员、电影的上映时间/主题等信息。在用户选择观看某部视频时,对视频内容的场景进行有效的智能识别,进而根据视频内容中包含的图像、对白、剧情、演员等信息进行互动推荐,则可以很好的解决推荐的针对性,关联性问题,提升用户的互动性,真正达到根据用户操控某个内容就能自动进行推荐广告、购物等具体的业务。
在本发明实施例的一个实施方式中,上述步骤S102,可以对视频流进行编码,得到待匹配特征对象;将待匹配特征对象与场景特征对象进行匹配,得到视频流对应的场景特征,其中,场景特征对象由预先对预设的场景特征编码得到。当然,采用不同的匹配方式有不同的编码方式,甚至可以不进行编码,本发明实施例对此不作限定。
在本发明实施例中,对预先预设的场景特征编码,可以是对图片、语音文本形式的场景特征进行编码,得到便于对比的矢量。相应的,对视频流进行编码,可以是从视频流中提取图像、字幕、语音等,将这些信息编码成对应的矢量。
在本发明实施例的一个实施方式中,上述步骤S102,可以将待匹配特征对象与场景特征对象进行匹配;如果待匹配特征对象与场景特征对象的相似度满足预设条件,将场景特征对象对应的场景特征作为视频流对应的场景特征。
在本发明实施例的一个实施方式中,预先对预设的场景特征编码,可以按照预设的场景特征对应的场景模式,分类对预设的场景特征进行编码。例如,对于图像、语音采用不同的编码方法。
在本发明实施例的一个实施方式中,上述预设的场景特征可以包括:第一场景特征和/或第二场景特征,其中,第一场景特征为通用场景特征,第二场景特征为视频流的专用场景特征。上述的通用场景特征可以是对所有视频均适用的场景特征,也可以是是对一类视频适用的场景特征。上述的专用场景特征可以是针对单个视频设置的场景特征,也可以是针对某些视频设置的场景特征。
在本发明实施例中,上述呈现视频流对应的推荐信息可以是在屏幕上显示推荐信息的链接,也可以是直接显示推荐信息。
在本发明实施例的一个实施方式中,可以设定推荐信息的呈现时间,在预设的时间呈现视频流对应的推荐信息。
在本发明实施例的一个实施方式中,视频流可以是缓存的待播放的视频流,可以在播放该视频流时,呈现该视频流对应的推荐信息。例如,对缓存的待播放的视频流进行场景匹配,得到视频流对应的推荐信息,在包房该视频时,呈现该推荐信息。例如,在于缓存的视频流,识别到其中某一时间段出现了会议场景,则在播放该时间段的视频的同时,可以呈现与会议相关的推荐信息,例如办公器材广告、会议酒店信息等。
在本发明实施例的一个实施方式中,还可以为推荐信息设置有推荐识别码,推荐识别码用于区分推荐信息;场景特征与推荐信息的对应关系为场景特征与推荐识别码的对应关系。
图2是根据本发明实施例的基于场景识别的信息推荐装置的结构框图,如图2所示,该装置主要包括:匹配模块10、获取模块20。匹配模块10,设置为将视频流与预设的场景特征进行匹配,得到视频流对应的场景特征;获取模块20,设置为根据场景特征与推荐信息的对应关系,获取视频流对应的推荐信息。
在本发明实施例的一个实施方式中,匹配模块10,包括:编码单元,设置为对视频流进行编码,得到待匹配特征对象;匹配单元,设置为将待匹配特征对象与场景特征对象进行匹配,得到视频流对应的场景特征,其中场景特征对象由预先对预设的场景特征编码得到。
在本发明实施例的一个实施方式中,上述编码单元,还设置为按照预设的场景特征对应的场景模式,分类对预设的场景特征进行编码,得到场景特征对象。
在本发明实施例的一个实施方式中,预设的场景特征的场景模式包括以下至少之一:视频场景、语音场景、字幕场景,剧情场景。
在本发明实施例的一个实施方式中,上述预设的场景特征的格式包括以下至少之一:图片、文本、语音。
在本发明实施例的一个实施方式中,预设的场景特征,包括:第一场景特征和/或第二场景特征,其中,第一场景特征为通用场景特征,第二场景特征为视频流的专用场景特征。
在本发明实施例中,还可以包括:呈现模块,设置为呈现视频流对应的推荐信息。
在本发明实施例的一个实施方式中,呈现模块,设置为在预设的时间呈现所述视频流对应的推荐信息。
在本发明实施例的一个实施方式中,视频流为缓存的待播放的视频流,呈现模块,设置为在播放视频流时,呈现视频流对应的推荐信息。
在本发明实施例中,推荐信息可以设置有推荐识别码,推荐识别码用于区分推荐信息;场景特征与推荐信息的对应关系为场景特征与推荐识别码的对应关系。
本发明实施例的上述方法和装置,可以在一个设备中实现,也可以通过多个设备交互实现。上述装置的各个模块,可以位于一个设备中,也可以分布在不同的设备上。本发明实施例对此不做限定。
图3是根据本发明实施例的基于场景识别的信息推荐方法的流程图二,如图3所示,该方法包括步骤S302至步骤S306。
步骤S302,第一设备将视频流与预设的场景特征进行匹配,得到该视频流对应的场景特征。
步骤S304,第一设备根据视频流对应的场景特征,从第二设备获取视频流对应的推荐信息。
步骤S306,第一设备呈现上述视频流对应的推荐信息。
在本发明实施例中,上述的第一设备可以是机顶盒、移动终端等设备。上述步骤S302中,第一设备可以在本地将视频流与预设的场景特征进行匹配。另外,第一设备也可以通过第二设备执行上述步骤S302,第一设备可以对视频流进行编码,得到待匹配特征对象,向第二设备发送待匹配特征对象,并接收第二设备根据待匹配特征对象匹配得到的视频流对应的场景特征。通过在第二设备上实现匹配,可以降低对第一设备的性能要求,第一设备不需要做复杂的处理。
在本发明实施例的一个实施方式中,第一设备在本地进行匹配可以包括:第一设备对视频流进行编码,得到待匹配特征对象;第一设备将待匹配特征对象与场景特征对象进行匹配,得到视频流对应的场景特征,其中,场景特征对象由预先对预设的场景特征编码得到。编码可以参考本发明实施例的前述描述,在此不再赘述。
上述步骤S302之前,第一设备可以从第二设备获取预设的场景特征,其中,预设的场景特征包括第一场景特征和/或第二场景特征,其中,第一场景特征为通用场景特征,第二场景特征为视频流的专用场景特征。
为了从第二设备获取预设的场景特征,第一设备可以向第二设备发送请求消息,其中该请求消息中携带有第一设备中预先存储的场景特征的第一更新时间;第一设备接收第二设备,在第一更新不晚于第二设备上的场景特征的第二更新时间的情况下,发送的预设的场景特征。通过携带更新时间,可以降低第一设备和第二设备之间的信息交互,在场景特征有更新的情况下,发送更新的场景特征。
在本发明实施例的一个优选实施方式中,第一设备预先存储有上述第一场景特征,第一设备可以从第二设备获取第二场景特征。上述的第一场景可以是第一设备请求从其他设备上发送的,也可以是其他设备主动配置到第一设备的,其他设备可以包括上述第二设备。
在本发明实施例的一个实施方式中,上述步骤S304中,第一设备可以向第二设备发送视频流对应的场景特征,并接收第二设备发送的视频流对应的推荐信息,其中,第二设备设置为根据场景特征与推荐信息的对应关系获取所述视频流对应的推荐信息。
在本发明实施例的另一个实施方式中,上述步骤S304中,第一设备可以根据场景特征与推荐信息的推荐识别码的对应关系,确定视频流对应的场景特征所对应的推荐识别码,并向第二设备发送确定的推荐识别码,接收第二设备发送的视频流对应的推荐信息,其中,第二设备设置为根据推荐识别码与推荐信息的对应关系获取视频流对应的推荐信息,其中,推荐识别码用于标识推荐信息。
在本发明实施例中,上述步骤S306,第一设备可以按照预设的时间呈现推荐信息。上述的视频流可以是缓存的待播放的视频,可以在播放该视频流时呈现推荐信息。另外,可以是在第一设备上呈现推荐信息,也可以是第一设备通过其他设备呈现推荐信息。例如,对于第一设备为机顶盒的情况,第一设备可以在机顶盒的电视终端上呈现推荐信息。
图4是根据本发明实施例的第一设备的结构框图一,如图4所示,第一设备主要包括:匹配模块402、第一获取模块404和呈现模块406。其中,匹配模块402,设置为将视频流与预设的场景特征进行匹配,得到视频流对应的场景特征;第一获取模块404,与匹配模块402相连接,设置为根据视频流对应的场景特征,从第二设备获取视频流对应的推荐信息;以及,呈现模块406,与第一获取模块404相连接,设置为呈现视频流对应的推荐信息。
在本发明实施例的一个实施方式中,匹配模块402,设置为在第一设备上将视频流与预设的场景特征进行匹配;和/或,匹配模块402可以包括:编码单元,设置为对
视频流进行编码,得到待匹配特征对象;发送单元,设置为向第二设备发送待匹配特征对象;接收单元,设置为接收第二设备根据待匹配特征对象匹配得到的视频流对应的场景特征。
在本发明实施例的一个实施方式中,上述第一设备还可以包括:第二获取模块,设置为从第二设备获取预设的场景特征,其中,预设的场景特征包括第一场景特征和/或第二场景特征,其中,第一场景特征为通用场景特征,第二场景特征为上述视频流的专用场景特征。
在本发明实施例的一个实施方式中,第二获取模块,包括:发送单元,设置为向第二设备发送请求消息,其中所述请求消息中携带有第一设备中预先存储的场景特征的第一更新时间;接收单元,设置为接收第二设备,在第一更新时间不晚于第二设备上的场景特征的第二更新时间的情况下,发送的预设的场景特征。
在本发明实施例中,第一设备可以预先存储第一场景特征,第二获取模块,设置为从第二设备获取第二场景特征。
上述第一获取模块404可以包括:第一获取单元,设置为向第二设备发送视频流对应的场景特征,并接收第二设备发送的视频流对应的推荐信息,其中,第二设备设置为根据场景特征与推荐信息的对应关系获取所述视频流对应的推荐信息。或者,第二获取单元,设置为根据场景特征与推荐信息的推荐识别码的对应关系,确定视频流对应的场景特征所对应的推荐识别码,并向第二设备发送确定的推荐识别码,接收第二设备发送的视频流对应的推荐信息,其中,第二设备设置为根据推荐识别码与推荐信息的对应关系获取视频流对应的推荐信息,其中,推荐识别码用于标识推荐信息。
图5是根据本发明实施例的第一设备的结构框图二,如图2所示,该第一设备包括:通信接口502,设置为与第二设备及至少一个第三设备通信;至少一个处理器504,设置为将视频流与预设的场景特征进行匹配,得到视频流对应的场景特征;根据视频流对应的场景特征,从第二设备获取所述视频流对应的推荐信息;以及,呈现视频流对应的推荐信息。
上述的至少一个处理器504还可以执行本发明实施例的上述方法,在此不再赘述。
图6是根据本发明实施例的基于场景识别的信息推荐方法的流程图三,如图6所示,该方法包括步骤S602至步骤S604。
步骤S602,第二设备响应第一设备的第一请求,将第一设备所请求的视频流与预设的场景特征匹配,得到视频流对应的场景特征。
步骤S604,第二设备根据视频流对应场景特征,按照场景特征与推荐信息的对应关系,向第一设备发送视频流对应的推荐信息。
在本发明实施例的一个实施方式中,上述步骤S602中,第一请求中携带有视频流的待匹配特征对象,其中,待匹配特征对象由第一设备对视频流进行编码得到。
在上述步骤S604中,第二设备可以按照所述场景特征与推荐信息的对应关系,向第一设备发送视频流对应的推荐信息;或者,第二设备可以根据场景特征与推荐信息的对应关系,获取视频流对应的推荐信息;第二设备向第一设备发送获取的推荐信息的推荐识别码,其中,推荐识别码用于区分推荐信息。
在本发明实施例的一个实施方式中,上述方法还可以包括:第二设备响应第一设备的第二请求,根据第二请求中携带的推荐识别码,向第一设备发送携带的标识码对应的推荐信息。在本发明实施例中,第一设备可以在接收到多个推荐识别码时,向第二设备请求获取推荐信息,也可以收到一个推荐识别码就获取对应的推荐信息。
在本发明实施例的一个实施方式中,上述方法还可以包括:第二设备响应第一设备的第三请求,根据第三请求中携带的第一更新时间与第二设备上的场景特征的第二更新时间,向第一设备发送场景特征,其中,第一更新时间为第一设备上存储的场景特征的更新时间;其中,所述第一更新时间早于第二更新时间,第二设备向第一设备发送场景特征。
在本发明实施例中,上述预设的场景特征可以包括:第一场景特征和/或第二场景特征,其中,第一场景特征为通用场景特征,第二场景特征为视频流的专用场景特征。关于第一场景特征和第二场景特征参见本发明实施例前述描述,在此不再赘述。
优选地,第三消息用于请求第二场景特征,其中,第一设备预先存储有第一场景特征。
图7是根据本发明实施例的第二设备的结构框图一,包括:匹配模块702和第一发送模块704。其中,匹配模块702,设置为响应第一设备的第一请求,将第一设备所请求的视频流与预设的场景特征匹配,得到视频流对应的场景特征;第一发送模块704,与匹配模块702相连接,设置为根据视频流对应场景特征,按照场景特征与推荐信息的对应关系,向第一设备发送视频流对应的推荐信息。
在本发明实施例中,第一请求中携带有视频流的待匹配特征对象,其中,待匹配特征对象由第一设备对视频流进行编码得到。
在本发明实施例的一个实施方式中,第一发送模块704可以包括:第一发送单元,设置为按照场景特征与推荐信息的对应关系,向第一设备发送视频流对应的推荐信息;或者,第二发送单元,设置为根据场景特征与推荐信息的对应关系,获取视频流对应的推荐信息;向第一设备发送获取的推荐信息的推荐识别码,其中,推荐识别码用于区分推荐信息。
在本发明实施例的一个实施方式中,上述第二设备还可以包括:第二发送模块,设置为响应的第二请求,根据第二请求中携带的推荐识别码,向第一设备发送携带的标识码对应的推荐信息。
在本发明实施例的一个实施方式中,上述第二设备还可以包括:第三发送模块,设置为响应第一设备的第三请求,根据第三请求中携带的第一更新时间与第二设备上的场景特征的第二更新时间,向第一设备发送场景特征,其中,第一更新时间为所述第一设备上存储的场景特征的更新时间;其中,如果第一更新时间早于第二更新时间,第三发送模块向第一设备发送场景特征。
在本发明实施例中,预设的场景特征包括:第一场景特征和/或第二场景特征,其中,第一场景特征为通用场景特征,第二场景特征为所述视频流的专用场景特征。对于第一场景特征和第二场景特征参见本发明实施例的前述描述,在此不再赘述。
优选地,第三消息用于请求第二场景特征,其中,第一设备可以预先存储第一场景特征。
图8是根据本发明实施例的第二设备的结构框图二,如图8所示,第二设备可以包括:通信接口802,与至少一个处理器804相连接,设置为与第一设备及至少一个第三设备通信;至少一个处理器804,设置为响应第一设备的第一请求,将第一设备所请求的视频流与预设的场景特征匹配,得到视频流对应的场景特征;根据视频流对应场景特征,按照场景特征与推荐信息的对应关系,向所述第一设备发送所述视频流对应的推荐信息。
至少一个处理器804还可以执行本发明实施例的上述方法,在此不再赘述。
通过本发明实施例,将视频流与预设的场景特征进行匹配,得到视频流对应的场景特征;根据场景特征与推荐信息的对应关系,获取视频流对应的推荐信息;并呈现视频流对应的推荐信息,基于视频场景能够更为准确的推荐信息。
下面对本发明实施例的优选实施方式进行描述。
图9是根据本发明实施例优选的基于场景识别的信息推荐***的示意图,如图9所示。该***主要包括:推荐服务器(相当于上述的第二设备)1,负责预置场景模式和场景特征信息(上述实施例中也称为场景特征),并根据推荐识别码给出具体的业务推荐形式;机顶盒(相当于上述的第一设备)2,负责生成和存储场景特征信息、码流的缓存和识别、特征匹配和推荐识别码的生成;IPTV/OTT***3,主要提供基本的视频播放功能;第三方***4,主要提供各种推荐业务的具体呈现。
上述***主要包括以下交互过程:场景下发,主要是推荐服务器1根据预置的场景模式,下发场景特征;场景生成,机顶盒2对场景特征进行编码,并将生成的场景特征对象和推荐识别码存储到场景特征库;场景识别,机顶盒2在播放来自IPTV/OTT***3的视频时进行码流缓存,对缓存码流进行预解析,解析结果进行智能匹配,如果匹配成功,则输出推荐特征码;业务推荐,机顶盒2根据推荐识别码向推荐服务器发起请求,并根据返回的推荐信息展示推荐页面,进而重定向到第三方***。
例如,在用户选择观看某部视频时,对IPTV***中的视频内容的场景进行有效的智能识别,进而根据视频内容中包含的图像、对白、剧情、演员等信息进行互动推荐,可以很好的解决推荐的针对性,关联性问题,提升用户的互动性,真正达到根据用户操控某个内容就能自动进行推荐广告、购物等具体的业务。
图10是根据本发明实施例优选的基于场景识别的信息推荐***的结构框图,如图10所示,该***包括机顶盒2、推荐服务器1、IPTV/OTT***3、第三方***4。机顶盒2包括:场景生成模块210、场景特征库220、码流识别模块230、特征匹配模块240和业务推荐模块250。
(1)在推荐服务器中维护场景特征信息,如视频场景、语音场景、字幕场景,剧情场景等,其中,视频场景主要是录入视频中需要匹配的演员、服装、物品、食品等图片信息;语音场景主要是录入视频中需要匹配的对白、旁白中的关键字;字幕场景主要是录入视频中需要匹配的字幕关键字、剧情场景主要是录入视频中需要匹配的预置剧情时间点;
(2)在推荐服务器中对每个场景特征信息都会绑定一个推荐识别码,建立场景特征和推荐识别码的关联关系;同时维护推荐识别码与推荐信息的关系,用于推荐信息的识别;
(3)机顶盒中的场景生成模块接受来自推荐服务器的场景特征信息(包括推荐识别码),根据不同的场景模式,如视频场景、语音场景、字幕场景、剧情场景等,进行编码生成特定语义的场景特征对象,并保存到场景特征库;
(4)机顶盒中的码流识别模块负责预解析缓存中的码流,生成待匹配特征对象;
(5)机顶盒中的特征匹配模块将待匹配特征对象与场景特征库进行运算匹配,如果待匹配特征包含场景特征库中的某个场景特征,则获取该场景特征对应推荐识别码;
(6)机顶盒中的业务推荐模块在获取到推荐识别码后,负责向推荐服务器请求获取推荐信息,并将推荐信息通过预定的格式展示给用户,用户可以通过展示推荐信息跳转到第三方***,获取更详细的业务信息,完成业务推荐的全流程。
基于图1所示的实现原理,本发明实施例中实现基于场景智能识别的业务推荐的方法,包括以下几个步骤:
步骤A:推荐服务器进行场景特征维护和下发。
步骤B:机顶盒接收来自推荐服务器的场景特征,生成场景特征。
步骤C:机顶盒接收来自IPTV/OTT***的视频流,并进行场景识别匹配。
步骤D:机顶盒根据匹配结果,生成推荐信息。
图11是根据本发明实施例的场景特征下发的流程图,在上述步骤A中执行,其实施步骤如下:
步骤S1102:推荐服务器中录入场景特征信息,包括但不限于视频场景、语音场景、字幕场景,剧情场景等;场景特征信息可以和具体视频绑定,也可以是全视频适配。
步骤S1104:推荐服务器中录入业务推荐信息,并为每个业务推荐信息生成一个唯一的推荐识别码。
步骤S1106:推荐服务器中对场景特征信息和业务推荐信息进行绑定,绑定关系通过推荐识别码建立,可以实现双向查阅。
步骤S1108:机顶盒在观看视频前,向推荐服务器获取通用场景特征信息的请求,并携带上用户信息和下发时间戳;该行为可以根据实际需求,提前到机顶盒开机启动时进行获取,以减少观看视频前的频繁获取重复的场景特征信息。
步骤S1110:推荐服务器检测用户合法性,如果检测通过并且服务器上的最新时间戳与下发时间戳场对比有更新,则下发视频特征信息和推荐识别码给机顶盒,下发的协议可以基于但不限于HTTP协议。
步骤S1112:机顶盒在播放视频前,向推荐服务器获取具体视频场景特征信息的请求,并携带上用户信息、内容编号和下发时间戳。
步骤S1114:推荐服务器检测用户合法性,如果检测通过并且服务器上的最新时间戳与下发时间戳场对比有更新,则下发具体视频景特征信息和推荐识别码给机顶盒,下发的协议可以基于但不限于HTTP协议。
图12是根据本发明实施例的场景特征生成的流程图,在上述步骤B中执行,其实施步骤如下:
步骤S1202:机顶盒接收到来自推荐服务器的场景特征信息。
步骤S1204:机顶盒的场景生成模块对场景特征信息,按照场景模式,分类进行编码,生成特定语义的场景特征对象。
步骤S1206:机顶盒的场景生成模块建立场景特征对象和推荐识别码的关联关系。
步骤S1208:机顶盒将生成的场景特征对象及与推荐识别码的关联关***一存储到场景特征库,并存储下发时间戳。
图13是根据本发明实施例的场景特征匹配的流程图,在上述步骤C中执行,其实施步骤如下:
步骤S1302:机顶盒播放来自IPTV/OTT***的视频码流,并对码流进行缓存。
步骤S1304:机顶盒的码流识别模块对缓存码流进行识别,可以针对视频的每帧图像、一段语音、一句字幕、播放时间进行识别,并进行编码形成符合特定语义的待
匹配特征对象,并传给特征匹配模块。其中语音和字幕主要形成文字,播放时间主要是绝对时间和相对时间,绝对时间格式采用年月日时分秒,相对时间格式采用时分秒。
步骤S1306:机顶盒中的特征匹配模板将待匹配特征对象与场景特征库进行运算匹配运算。
步骤S1308:如果待匹配特征包含场景特征库中的某个场景特征,如图像中包含的特征与场景特征库中图片特征对象比值达到阀值,码流中的语音和字幕含有场景特征库中的对应文字关键字,预置的剧情时间点到达,则匹配成功,则走步骤S1305,如果匹配失败,直接丢弃处理。
步骤S1310:特征匹配模板从场景特征库获取该场景特征对应推荐识别码。
步骤S1312:同时,特征匹配模板记录下视频码流的播放时间,并设置推荐触发时间给业务推荐模块,准备触发业务推荐流程。
图14是根据本发明实施例的信息推荐的流程图,在上述步骤D中执行,其实施步骤如下:
步骤S1402:机顶盒中的业务推荐模块判断推荐触发时间是否到达;如果到达,则进入步骤S1404。
步骤S1404:机顶盒中的业务推荐模块组装请求消息,向推荐服务器发起请求,请求消息中携带用户信息和推荐识别码。
步骤S1406:推荐服务器收到机顶盒请求后,检测用户合法性,如果检测通过,则根据推荐识别码,返回具体的推荐信息,一般包括界面展示信息及其URL。
步骤S1408:机顶盒中的业务推荐模块接收到推荐信息后,进行解析,并按照预定的模板格式组装。
步骤S1410:业务推荐信息解析组装完成之后,业务推荐页面形成,并将该业务推荐页面展示给用户。
步骤S1412:用户在观看到推荐页面后,可以根据自己的兴趣爱好,选择是否从推荐页面跳转到第三方***进行购物等行为。
为了便于更好的理解本本发明实施例提供的方案和原理,下面通过几个具体的实施例,来对本发明做详细说明。
实施例1
基于机顶盒本地场景识别,所述原理图中的机顶盒的场景生成模块、场景特征库、码流识别模块、特征匹配库、业务推荐模块均内置在机顶盒中,以进行场景识别匹配,如图15所示,其步骤包括:
步骤S1502:用户点击视频,机顶盒向推荐服务器请求下发场景特征。
步骤S1504:机顶盒进行场景特征编码,并存储到场景特征库。
步骤S1506:用户观看视频时,机顶盒请求IPTV/OTT***中的视频,并接收视频码流。
步骤S1508:机顶盒对码流进行缓存,并对缓存码流进行识别编码,生成可识别的待匹配特征对象。
步骤S1510:机顶盒将待匹配特征对象与特征匹配库进行识别匹配,获取推荐识别码。
步骤S1512:机顶盒携带推荐识别码向推荐服务器获取推荐信息。
步骤S1514:机顶盒解析推荐服务器返回的推荐信息,并呈现给用户。
实施例2
基于云端的场景识别,所述原理图中机顶盒的场景生成模块、场景特征库、特征匹配模块上移到推荐服务器,推荐服务器作为云端的场景识别处理,而码流识别模块和业务推荐模块继续放置在机顶盒特征上报和推荐请求,如图16所示,其步骤包括:
步骤S1602:推荐服务器进行场景特征的编码,并存储到场景特征库。
步骤S1604:用户观看视频时,机顶盒请求IPTV/OTT***中的视频,并接收视频码流。
步骤S1606:机顶盒对码流进行缓存,并对缓存码流进行识别编码,生成可识别的待匹配特征对象。
步骤S1608:机顶盒将待匹配特征对象发送给推荐服务器进行云端匹配。
步骤S1610:推荐服务器将待匹配特征对象与特征匹配库进行识别匹配,获取推荐识别码。
步骤S1612:推荐服务器返回推荐识别码给机顶盒。
步骤S1614:机顶盒携带推荐识别码向推荐服务器获取推荐信息。
步骤S1616:机顶盒解析推荐服务器返回的推荐信息,并呈现给用户。
实施例3
基于移动终端(如手机、Pad等)的场景识别,可以将机顶盒中对应的模块,全部移植到移动终端,实现移动终端的场景识别和业务推荐。移动终端主要通过无线网络接入,针对Wifi方式接入,具体实施例的流程可以参照实施例1进行即可,在移动终端做场景匹配;针对3G/4G模式接入时,更多的需要考虑减少网络交互和数据流量,因此需要结合实施例2的云端处理模式,在云端服务器侧针对视频段进行识别,识别匹配后返回该视频段的所有推荐识别码,如图17所示,其步骤包括:
步骤S1702:推荐服务器进行场景特征的编码,并存储到场景特征库。
步骤S1704:用户观看视频时,移动终端请求IPTV/OTT***中的视频,并接收视频码流。
步骤S1706:移动终端向推荐服务器发起特征匹配请求,该请求针对视频码流时间段。
步骤S1708:推荐服务器对请求的视频码流时间段,在云端进行匹配识别,并生成多个推荐识别码。
步骤S1710:推荐服务器返回多个推荐识别码给移动终端。
步骤S1712:移动终端记录每个推荐识别码及其推荐触发时间。
步骤S1714:移动终端在推荐触发时间到达后,携带推荐识别码向推荐服务器获取推荐信息。
步骤S1716:移动终端解析推荐服务器返回的推荐信息,并呈现给用户。
步骤S1718:移动终端根据视频观看进度,启动下一段视频码流的特征匹配请求,重复步骤S1706。
实施例4
基于视频预处理模式的场景识别,该模式主要针对视频提前在云端全部进行匹配识别,主要优点是匹配快速,对终端要求不高,有很好的通用性,因为视频在IPTV/OTT***发布时,已经全部预处理了各种场景匹配,并生成了视频的推荐识别码和推荐触发时间,但是由于是预处理,无法关注兼顾到用户的个性特征匹配。如图18所示,其步骤包括:
步骤S1802:推荐服务器针对IPTV/OTT***中的视频进行批量预处理,与场景特征库中进行匹配,对视频逐个进行识别。
步骤S1804:推荐服务器根据匹配识别的结果生成的推荐识别码和推荐触发时间,并与视频对应进行存储。
步骤S1806:用户观看视频时,机顶盒移动终端请求IPTV/OTT***中的视频,并接收视频码流。
步骤S1808:机顶盒/移动终端向推荐服务器发起特征匹配请求。
步骤S1810:推荐服务器查询存储的预处理匹配结果,如果命中,则返回结果。
步骤S1812:推荐服务器返回该视频全部的推荐识别码给机顶盒/移动终端。
步骤S1814:机顶盒/移动终端记录每个推荐识别码及其推荐触发时间。
步骤S1816:机顶盒/移动终端在推荐触发时间到达后,携带推荐识别码向推荐服务器获取推荐信息。
步骤S1818:移动终端解析推荐服务器返回的推荐信息,并呈现给用户。
从以上的描述中,可以看出,本发明实现了如下技术效果很好的解决了视频中已有信息和业务推荐信息和关联和互动,以及多个视频共享业务推荐信息,让用户可以在观看视频的过程中,随着视频场景的变化而获取相关的推荐信息,提升了用户的互动性,也增强了业务推荐的针对性和通用性;在IPTV/OTT***中对于基于视频内容智能识别以及业务推荐领域具有普遍的实际应用意义。
显然,本领域的技术人员应该明白,上述的本发明的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以
将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明不限制于任何特定的硬件和软件结合。
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。
基于本发明实施例提供的上述技术方案,将视频流与预设的场景特征进行匹配,得到视频流对应的场景特征;根据场景特征与推荐信息的对应关系,获取视频流对应的推荐信息;并呈现视频流对应的推荐信息,基于视频场景能够更为准确的推荐信息。
Claims (14)
- 一种基于场景识别的信息推荐方法,包括:将视频流与预设的场景特征进行匹配,得到所述视频流对应的场景特征;根据场景特征与推荐信息的对应关系,获取所述视频流对应的推荐信息。
- 根据权利要求1所述的方法,其中,将视频流与预设的场景特征进行匹配,包括:对所述视频流进行编码,得到待匹配特征对象;将所述待匹配特征对象与场景特征对象进行匹配,得到所述视频流对应的场景特征,其中,所述场景特征对象由预先对所述预设的场景特征编码得到。
- 根据权利要求2所述的方法,其中,将所述待匹配特征对象与场景特征对象进行匹配,得到所述视频流对应的场景特征,包括:将所述待匹配特征对象与所述场景特征对象进行匹配;如果所述待匹配特征对象与所述场景特征对象的相似度满足预设条件,将所述场景特征对象对应的场景特征作为所述视频流对应的场景特征。
- 根据权利要求2所述的方法,其中,预先对所述预设的场景特征编码,包括:按照所述预设的场景特征对应的场景模式,分类对所述预设的场景特征进行编码。
- 根据权利要求1或4所述的方法,其中,所述预设的场景特征的场景模式包括以下至少之一:视频场景、语音场景、字幕场景,剧情场景。
- 根据权利要求1所述的方法,其中,所述预设的场景特征的格式包括以下至少之一:图片、文本、语音。
- 根据权利要求1所述的方法,其中,所述预设的场景特征,包括:第一场景特征和/或第二场景特征,其中,所述第一场景特征为通用场景特征,所述第二场景特征为所述视频流的专用场景特征。
- 根据权利要求1所述的方法,其中,还包括:呈现所述视频流对应的推荐信息。
- 根据权利要求1所述的方法,其中,所述视频流为缓存的待播放的视频流,呈现所述视频流对应的推荐信息包括:在播放所述视频流时,呈现所述视频流对应的推荐信息。
- 根据权利要求1所述的方法,其中,所述推荐信息设置有推荐识别码,所述推荐识别码用于区分推荐信息;所述场景特征与推荐信息的对应关系为场景特征与推荐识别码的对应关系。
- 一种基于场景识别的信息推荐装置,包括:匹配模块,设置为将视频流与预设的场景特征进行匹配,得到所述视频流对应的场景特征;获取模块,设置为根据场景特征与推荐信息的对应关系,获取所述视频流对应的推荐信息。
- 根据权利要求11所述的装置,其中,所述匹配模块,包括:编码单元,设置为对所述视频流进行编码,得到待匹配特征对象;匹配单元,设置为将所述待匹配特征对象与场景特征对象进行匹配,得到所述视频流对应的场景特征,其中,所述场景特征对象由预先对所述预设的场景特征编码得到。
- 根据权利要求12所述的装置,其中,所述编码单元,还设置为按照所述预设的场景特征对应的场景模式,分类对所述预设的场景特征进行编码,得到所述场景特征对象。
- 根据权利要求11所述的装置,其中,还包括:呈现模块,设置为呈现所述视频流对应的推荐信息。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410300737.5A CN105227973A (zh) | 2014-06-27 | 2014-06-27 | 基于场景识别的信息推荐方法及装置 |
CN201410300737.5 | 2014-06-27 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015196749A1 true WO2015196749A1 (zh) | 2015-12-30 |
Family
ID=54936658
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2014/093401 WO2015196749A1 (zh) | 2014-06-27 | 2014-12-09 | 基于场景识别的信息推荐方法及装置 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN105227973A (zh) |
WO (1) | WO2015196749A1 (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110827099A (zh) * | 2018-08-07 | 2020-02-21 | 北京优酷科技有限公司 | 一种家居商品推荐方法、客户端及服务器 |
CN111797309A (zh) * | 2020-06-19 | 2020-10-20 | 一汽奔腾轿车有限公司 | 一种基于出行模式的车载智能推荐装置及方法 |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105744355A (zh) * | 2016-01-28 | 2016-07-06 | 宇龙计算机通信科技(深圳)有限公司 | 一种视频预提醒处理的方法、装置以及终端 |
CN110149558B (zh) * | 2018-08-02 | 2023-03-28 | 腾讯科技(深圳)有限公司 | 一种基于内容识别的视频播放实时推荐方法及*** |
CN109670106B (zh) * | 2018-12-06 | 2022-03-11 | 百度在线网络技术(北京)有限公司 | 基于场景的事物推荐方法和装置 |
CN109640189A (zh) * | 2018-12-19 | 2019-04-16 | 聚好看科技股份有限公司 | 信息显示方法及装置 |
CN110097102A (zh) * | 2019-04-22 | 2019-08-06 | 上海车轮互联网服务有限公司 | 适用于不同业务场景的数据配置方法及装置 |
CN111091099A (zh) * | 2019-12-20 | 2020-05-01 | 京东方科技集团股份有限公司 | 一种场景识别模型的构建方法、场景识别方法及设备 |
CN113923523B (zh) * | 2021-10-11 | 2023-03-24 | 深圳创维-Rgb电子有限公司 | 视频推送方法、装置、设备及存储介质 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040139173A1 (en) * | 2002-12-11 | 2004-07-15 | Jeyhan Karaoguz | Media processing system automatically offering access to newly available media in a media exchange network |
WO2010017379A2 (en) * | 2008-08-06 | 2010-02-11 | Invidi Technologies Corporation | Third party data matching for targeted advertising |
CN101668165A (zh) * | 2008-09-05 | 2010-03-10 | 华为技术有限公司 | Iptv中广告实现的方法及装置和*** |
CN103763589A (zh) * | 2014-01-10 | 2014-04-30 | 北京酷云互动科技有限公司 | 视频广告扩展信息推送方法和装置 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070186243A1 (en) * | 2006-02-08 | 2007-08-09 | Sbc Knowledge Ventures, Lp | System and method of providing television program recommendations |
JP5322550B2 (ja) * | 2008-09-18 | 2013-10-23 | 三菱電機株式会社 | 番組推奨装置 |
CN103475910B (zh) * | 2013-08-27 | 2018-01-05 | 四川长虹电器股份有限公司 | 一种用于智能电视端的机顶盒节目推荐方法及*** |
CN103544216B (zh) * | 2013-09-23 | 2017-06-06 | Tcl集团股份有限公司 | 一种结合图像内容和关键字的信息推荐方法及*** |
CN103501449A (zh) * | 2013-10-08 | 2014-01-08 | 十分(北京)信息科技有限公司 | 与电视节目关联的视频源推荐方法及推荐装置 |
-
2014
- 2014-06-27 CN CN201410300737.5A patent/CN105227973A/zh active Pending
- 2014-12-09 WO PCT/CN2014/093401 patent/WO2015196749A1/zh active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040139173A1 (en) * | 2002-12-11 | 2004-07-15 | Jeyhan Karaoguz | Media processing system automatically offering access to newly available media in a media exchange network |
WO2010017379A2 (en) * | 2008-08-06 | 2010-02-11 | Invidi Technologies Corporation | Third party data matching for targeted advertising |
CN101668165A (zh) * | 2008-09-05 | 2010-03-10 | 华为技术有限公司 | Iptv中广告实现的方法及装置和*** |
CN103763589A (zh) * | 2014-01-10 | 2014-04-30 | 北京酷云互动科技有限公司 | 视频广告扩展信息推送方法和装置 |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110827099A (zh) * | 2018-08-07 | 2020-02-21 | 北京优酷科技有限公司 | 一种家居商品推荐方法、客户端及服务器 |
CN110827099B (zh) * | 2018-08-07 | 2022-05-13 | 阿里巴巴(中国)有限公司 | 一种家居商品推荐方法、客户端及服务器 |
CN111797309A (zh) * | 2020-06-19 | 2020-10-20 | 一汽奔腾轿车有限公司 | 一种基于出行模式的车载智能推荐装置及方法 |
CN111797309B (zh) * | 2020-06-19 | 2024-04-16 | 一汽奔腾轿车有限公司 | 一种基于出行模式的车载智能推荐装置及方法 |
Also Published As
Publication number | Publication date |
---|---|
CN105227973A (zh) | 2016-01-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2015196749A1 (zh) | 基于场景识别的信息推荐方法及装置 | |
US11477506B2 (en) | Method and apparatus for generating interactive programming in a communication network | |
CN103024464B (zh) | 提供与视频播放内容相关信息的***和方法 | |
US8583555B1 (en) | Synchronizing multiple playback device timing utilizing DRM encoding | |
EP2433423B1 (en) | Media content retrieval system and personal virtual channel | |
US9788043B2 (en) | Content interaction methods and systems employing portable devices | |
AU2011376198B2 (en) | Method for capturing video related content | |
US20030097301A1 (en) | Method for exchange information based on computer network | |
US11463741B2 (en) | Methods and systems for dynamic routing of content using a static playlist manifest | |
CN103026681A (zh) | 基于视频的增值业务实现方法、服务器和*** | |
CN101272477A (zh) | 一种iptv***、媒体服务器和iptv节目搜索、定位方法 | |
US10419825B2 (en) | Queue to display information for entities during video playback | |
WO2001060071A2 (en) | Interactive multimedia user interface using affinity based categorization | |
KR102110623B1 (ko) | 송신 장치, 정보 처리 방법, 프로그램, 수신 장치 및 애플리케이션 연동 시스템 | |
CN104427350A (zh) | 关联内容处理方法及*** | |
WO2015188565A1 (zh) | 一种基于移动终端的iptv视频推送点播的方法及装置 | |
US8756630B2 (en) | Imaging distribution apparatus and imaging distribution method | |
KR20100100405A (ko) | 댓글 입력이 가능한 쌍방향 동영상 제공 시스템 및 그 방법 | |
US20220232292A1 (en) | Ordering a service using the processing of a stream comprising multimedia data | |
CN108989857A (zh) | 大数据电视*** |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14895997 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14895997 Country of ref document: EP Kind code of ref document: A1 |