Interactive approach and system based on video surveillance
Technical field
It a kind of is broadcast the present invention relates to a kind of interactive approach based on video surveillance and system more particularly to according to television terminal
Put the method and system that program is interacted.
Background technique
With the development of technology, television terminal is more and more, and technology is also increasingly advanced.In the prior art, in video section
In mesh playing process, needs to provide two-way interaction according to programme content by video program provider, generally use artificial control
Interaction time and content.Interaction mode, which generallys use, announces telephone number, note number and mailbox, then by television terminal
User sends corresponding contents and interacts.With the appearance of two dimensional code, many television terminals especially television terminal is used aobvious
Show that two dimensional code is arranged in region, interactive interface is then carried out by the scanning input two dimensional code and is interacted, interaction has been detached from this time
Television terminal, and the modes such as individual mobile phone is used to be interacted.The interaction of both modes is all will be mutual to interact provider
Dynamic relevant information is provided with video program arrives television terminal, is then interacted by user with other tool.It is this mutual
Flowing mode has following defect: 1, mostly providing interaction mode by video program side and carry out simple unidirectional upload, be not real meaning
On two-way interaction;2, for playing back or playing the video program of storage medium, it is unable to accurate judgement current video content section
Mesh, and cannot be interacted according to the actual program;It 3, is not but to be relied on really using television terminal as interaction tools
Other tools such as other mobile phone are interacted.
Summary of the invention
A kind of the method that is interacted of program is played according to television terminal and is technical problem solved by the present invention is constructing
System, the program for overcoming the prior art truly bi-directional cannot interact and cannot play completely according to television terminal are interacted.
The technical scheme is that providing a kind of interactive approach based on video surveillance, including server end and TV
Terminal, the interactive approach include the following steps:
Upload information and data: the television terminal acquisition simultaneously uploads current video program information and video spy to server
Levy data;
Obtain video program: the video frequency feature data of the server end storage video program and information to be supplied;Prison
It surveys the video program that multiple channels play and obtains video program information;The view that the server end uploads the television terminal
Frequency programme information is compared analysis with the video program information that the server end monitors and uploads the television terminal
The video frequency feature data of video program that stores of video frequency feature data and the server end of video program be compared point
Analysis, obtains the currently playing video program of the television terminal;
Interaction: according to the currently playing video program of the television terminal, the server end is mentioned to the television terminal
For interaction content, the television terminal is interacted with the server end.
A further technical solution of the present invention is: the television terminal acquires and the video program information uploaded includes video
The channel information of program, the name information of video program, video program content information in it is one or more.
A further technical solution of the present invention is: the television terminal acquisition video program information includes being adopted according to set-top box
Collect video program information, record acquisition according to logo Image Acquisition and identification acquisition video program information and according to video playing
Video program information.
A further technical solution of the present invention is: the server end includes to the interaction content that the television terminal provides
Interaction content using audio-frequency information output and the interaction content using display output.
A further technical solution of the present invention is: the television terminal is interacted by remote controller key.
A further technical solution of the present invention is: the display area of the television terminal includes the area of display interaction label
The display area in domain, the interaction label is overlapped on the display area of video program.
A further technical solution of the present invention is: the server end end further includes the real-time video programme to multiple channels
Monitoring, the television terminal acquisition channel information and video frequency feature data simultaneously upload to the server end, if the server
In end search less than with the consistent video frequency feature data of the video frequency feature data of upload, then according to the television terminal upload frequency
Road information and the server end determine the corresponding video program of the video frequency feature data to the real-time monitoring result of channel, by this
Video frequency feature data is stored in the server end.
The technical scheme is that constructing a kind of interaction systems based on video surveillance, including server end and TV
Terminal, the server end includes monitoring analysis module, memory module, comparative analysis module, interaction content generation module, described
Television terminal includes the video program information acquisition module for acquiring video program information, the video for acquiring video program feature data
Characteristic acquisition module, uploading module, interactive module, the video features number for the video program that the memory module storage obtains
According to the monitoring analysis module deposits the video frequency feature data for the video program that the television terminal uploads and the server end
The video frequency feature data of the video program of storage is compared analysis, the video section that the uploading module acquires the television terminal
The video frequency feature data of mesh information and video program uploads to the server end, and the comparative analysis module is whole by the TV
The video program information that end uploads is compared with the video program information that the server end monitors to be analyzed and by the electricity
Depending on the video frequency feature data and the video frequency feature data of the video program of server end storage of the video program that terminal uploads
It is compared analysis, obtains the currently playing video program of the television terminal;The interaction content generation module is according to
The currently playing video program of television terminal generates interaction content, and the server end provides in interaction to the television terminal
Hold, the television terminal is interacted by the interactive module with the server end.
A further technical solution of the present invention is: the server end further includes the server end for acquiring video frequency feature data
Acquisition module.
A further technical solution of the present invention is: the television terminal includes that channel information obtains module.
A further technical solution of the present invention is: the interactive module includes in voice input module and keyboard input module
It is one or more.
The solution have the advantages that: the present invention construct it is a kind of according to television terminal play the method that is interacted of program and
System, the television terminal acquisition simultaneously upload current video program information and video frequency feature data to server;The server
The video frequency feature data of end storage video program and information to be supplied;It monitors the video program that multiple channels play and obtains view
Frequency programme information;The video frequency feature data for the video program that the server end uploads the television terminal and the server
The video frequency feature data of the video program of storage is held to be compared analysis and the video program for uploading television terminal letter
It ceases the video program information monitored with the server end and is compared analysis, obtain the currently playing video of the television terminal
Program;According to the currently playing video program of the television terminal, the server end provides in interaction to the television terminal
Hold, the television terminal is interacted with the server end.The present invention uploads view being played on by the television terminal
Frequency program-related information, the server end determine institute according to the video program and received video program relevant information of monitoring
Television terminal video program being played on is stated, then the server is with the television terminal according to the view of the television terminal
Frequency program establishes interaction, realizes television terminal with server end really according to the mutual of the video program progress of the television terminal
It is dynamic, realize interaction truly.
Detailed description of the invention
Fig. 1 is the structural diagram of the present invention.
Specific embodiment
Combined with specific embodiments below, further explanation of the technical solution of the present invention.
As shown in Figure 1, a specific embodiment of the invention is: a kind of interactive approach based on video surveillance is provided, including
Server end 1 and television terminal 2, the interactive approach include the following steps:
Upload information and data: the acquisition of television terminal 2 simultaneously uploads current video program information and video to server
Characteristic.
Specific implementation process is as follows: for television terminal 2 when opening, the television terminal 2 acquires currently playing video program
Then information uploads onto the server the video program information of acquisition end 1.The video that the television terminal 2 is acquired and uploaded
Programme information include the channel information of video program, the name information of video program, video program content information in it is a kind of or
It is a variety of.Meanwhile the television terminal 2 acquires the video frequency feature data of currently playing video program, then by the video of acquisition
The video frequency feature data of program is uploaded onto the server end 1.
Obtain video program: the video frequency feature data of the storage of server end 1 video program and information to be supplied;Prison
It surveys the video program that multiple channels play and obtains video program information;The server end 1 uploads the television terminal 2
Video program information is compared analysis with the video program information that the server end 1 monitors and by the television terminal 2
The video frequency feature data for the video program that the video frequency feature data of the video program of upload is stored with the server end 1 is compared
Compared with analysis, the currently playing video program of the television terminal 2 is obtained.
Specific implementation process is as follows: the server end 1 stores the video frequency feature data of video program, the video program
Video frequency feature data from collection of server video program feature, can be from outside be transmitted on server
Video program feature data.The server end 1 stores the video frequency feature data of video program.That is, this feature data correspond to
Its corresponding video program may know that its corresponding video program by this feature data.Video frequency feature data is video
The set of characteristics of image indicates the data of this section of video program feature.Video frequency feature data includes various video characteristics of image
Comprehensive characteristics set, such as average gray feature, color moment characteristics, HOG feature etc., average gray feature, which represents, indicates video figure
The intensity profile situation of picture, in color moment character representation video image the case where color component variation, HOG character representation video figure
As in the case where grey scale change.By the video features of each frame image in Continuous plus video flowing, and by these characteristics
According to preserving, so that it may the video frequency feature data stream of video is obtained, to indicate the video.In usual algorithm, average gray
Feature is the average gray value of image, and the mean value of the cumulative sum of all gray values, puts down in the average gray value of image i.e. some region
Equal gray value characterizes the average color depth degree of the area pixel point, value range [0,255].Entire image is come
It says, this is the feature of one 9 dimension (each piece has 1 average gray value).
HOG feature is the feature based on gray level image, for pixel, calculates gradient direction k and amplitude by formula
S, specific calculating are as follows:
Color moment in color moment characteristics has the good characteristics such as translation, rotation, scaling invariance, calculates its first three rank
Central moment, for entire image, conventional algorithm is the feature of a 3*3*9=81 dimension, and specific calculating is as follows:
The server end 1 stores the video frequency feature data of video program, and server end 1 monitors the view that multiple channels play
Frequency program, multiple channels of monitoring include television channel and network direct broadcasting channel.In the video section for monitoring multiple channels broadcastings
During mesh, the video frequency feature data of the video program including being stored by server end 1 is monitored, such as: to current prison
The program of survey with the video frequency feature data of video program in server end 1 using being compared, so that it is determined that the currently monitored view
Frequency program.Corresponding video program library, the video program can also be constructed directly according to the programs of a plurality of channels of real time monitoring
Library include video program title, play time, place channel.Meanwhile the video program library further includes the correlation of video program
Content.
The video program information that the upload of television terminal 2 current video program information is monitored with server end 1 is compared,
If the video program information of the upload is consistent with the video program information that the monitoring of server end 1 obtains, and television terminal 2 is current
The video program of broadcasting is the program that server end 1 monitors, for example, television terminal 2 acquires the program that current video plays
It is currently playing to obtain the television terminal 2 according to the currently playing video program of the channel of the monitoring of server end 1 for channel
Video program is the currently playing video program of the channel of the monitoring of server end 1.If 2 current playing program of television terminal is
Video program video playing of the playback program perhaps in storage medium cannot collect the relevant information of current video program or
The information of acquisition and the video program that the current channel that server end 1 monitors plays are wrong, acquire currently using by television terminal 2
The video frequency feature data of the video program of broadcasting and the video frequency feature data of the video program of server end 1 compare, if one
It causes, then confirms that the current video program of television terminal 2 is the video program for this feature data that server end 11 stores.
Interaction: according to the currently playing video program of the television terminal 2, the server end 1 is to the television terminal 2
Interaction content is provided, the television terminal 2 is interacted with the server end 1.
Specific implementation process is as follows: the server end 1 is generated according to the currently playing video program of the television terminal 2
Then interactive information is transmitted to the television terminal 2 by the server end 1, by the television terminal 2 by clicking interaction
Then information realization interaction, or input interactive information upload to the server end 1 and realize interaction.
The preferred embodiment of the present invention is: it includes being adopted according to set-top box that the television terminal 2, which acquires video program information,
Collect video program information, record acquisition according to logo Image Acquisition and identification acquisition video program information and according to video playing
Video program information.After television terminal 2 is opened, the position of current video program image logo is captured, the platform of video program is acquired
Then logo image identifies the logo of the video program using image recognition technology, by the logo and be pre-stored in television terminal 2
Logo be compared, determine the program channel where current video program.Then the video playing program channel is uploaded to
Server, server determine the video section being played on of television terminal 2 according to the broadcasting program of the program channel of monitoring
Mesh.2 order video program of television terminal records the program channel for obtaining the video program according to program request.Include in program request record
The information such as title, the play time of request program of the program of program request, television terminal 2 upload to service after collecting these information
Device, by the information, server is the video program that may know that the television terminal 2 and play.Television terminal 2 is obtained by set-top box
Video programming signal selects to obtain video program by set top box channel according to the arrangement of program channel in local set-top box
Program channel.Then the video playing program channel is uploaded onto the server, server is broadcast according to the program channel of monitoring
Program is put, determines the video program being played on of television terminal 2.
The preferred embodiment of the present invention is: the server end 1 includes to the interaction content that the television terminal 2 provides
The interaction content exported using audio-frequency information, such as the information exported with voice signal, when interaction, television terminal 2 passes through input
Then voice messaging uploads, the voice interface with the server end 1 is realized after identified.Further include the server end 1 to
The interaction content that the television terminal 2 provides includes being specifically included using the interaction content of display output: video, network linking,
One of voice, text, picture or plurality of kinds of contents are presented on the television terminal 2 with display mode.In specific embodiment,
The display area of the television terminal 2 includes the region of display interaction label, and the display area of the interaction label, which is overlapped, to be regarded
On the display area of frequency program.The display content is presented by clicking the label, or by the program request label, it is mutual into voice
Flowing mode shields the voice of video program.In interactive process, the television terminal 2 is interacted by remote controller key.
The preferred embodiment of the present invention is: 1 end of server end further includes the real-time video programme to multiple channels
Monitoring, the channel include cable television channels and channels of network TV, i.e. the multiple channels of 1 real-time monitoring of server end
Video program play situation.The television terminal 2 acquires channel information, passes through set-top box or TV station symbol recognition and interactive mode etc.
Current channel information is acquired, the server end 1 is then uploaded to.The server end 1 according to channel real-time monitoring as a result,
In conjunction with the channel information that the television terminal 2 uploads, the television terminal 2 video program being played on can be obtained.It is described
Television terminal 2 acquires simultaneously and uploaded videos characteristic, if searching in the server end 1 less than the video features with upload
The consistent video frequency feature data of data, then the channel information and the server end 1 uploaded according to the television terminal 2 is to channel
Real-time monitoring as a result, obtain the corresponding video program of the video frequency feature data, which is stored in the clothes
The video frequency feature data being engaged in device end 1 as video program.In this way, the server end 1 has the function of study, pass through
Habit enriches its video features library, further to obtain the video program of the television terminal 2, thus to the television terminal 2
Information is provided.
The technical scheme is that constructing a kind of interaction systems based on video surveillance, including server end 1 and TV
Terminal 2, the server end 1 include monitoring analysis module 11, memory module 12, comparative analysis module 15, interaction content generation
Module 17, the television terminal 2 include the video program information acquisition module 21 of acquisition video program information, acquisition video program
The video frequency feature data acquisition module 23 of characteristic, uploading module 22, interactive module 26, the storage of memory module 12 obtain
Video program video frequency feature data, the monitoring analysis module 11 monitors the video program that multiple channels play, it is described on
The video frequency feature data of the video program information acquired of television terminal 2 and video program is uploaded to the clothes by transmission module 22
Business device end 1, the video frequency feature data and the clothes of the video program that the comparative analysis module 15 uploads the television terminal 2
The video that the video frequency feature data for the video program that business device end 1 stores is compared analysis and uploads the television terminal 2
Programme information is compared analysis with the video program information that the server end 1 monitors, and obtains the television terminal 2 and currently broadcasts
The video program put;The interaction content generation module 26 generates mutual according to the currently playing video program of the television terminal 2
Dynamic content, the server end 1 provide interaction content to the television terminal 2, and the television terminal 2 passes through the interactive module
26 are interacted with the server end 1.
Specific implementation process of the invention is: when opening, the television terminal 2 acquires currently to be broadcast the television terminal 2
Video program information is put, then the video program information of acquisition is uploaded onto the server end 1.Video program information acquisition module
21 acquisition video program informations, the video frequency feature data for the video program that video frequency feature data acquisition module 23 acquires, by upper
Transmission module 22 is uploaded onto the server end 1.Video program information includes the title letter of the channel information of video program, video program
It ceases, is one or more in the content information of video program.The memory module 12 of the server end stores the video of video program
Characteristic and information to be supplied;Monitoring analysis module 11 monitors the video program that multiple channels play.The memory module
The video frequency feature data of the video program of 12 storages can be from from the video program feature of collection of server in outside
The video program feature data being transmitted on server.Video frequency feature data corresponds to its corresponding video program, by this
Characteristic may know that its corresponding video program.The server end 1 stores the video frequency feature data of video program, service
Device end 1 monitors the video program that multiple channels play, and multiple channels of monitoring include television channel and network direct broadcasting channel.?
During monitoring the video program that multiple channels play, including the video features number of the video program stored by server end 1
According to being monitored, such as: the currently monitored program is used and is compared with the video frequency feature data of video program in server end 1
Compared with so that it is determined that the currently monitored video program.Can also be directly according to the programs of a plurality of channels of real time monitoring, building corresponds to
Video program library, the video program library include video program title, play time, place channel.Meanwhile the video program
Library further includes the related content of video program.Uploading module 22 uploads current video program information and monitoring analysis module 11 monitors
Video program information compare, if the video program information of the upload and server end 1 monitoring obtain video program believe
Breath is consistent, then is the program that server end 1 monitors by the currently playing video program of television terminal 2, for example, television terminal
The program channel that 2 acquisition current videos play is obtained according to the currently playing video program of the channel of the monitoring of server end 1
The currently playing video program of the television terminal 2 is the currently playing video program of the channel that monitors of server end 1.If
Television terminal current playing program is the video program in playback program or storage medium, and video playing cannot collect currently
The relevant information of video program or the information of acquisition and the video program that the current channel that server end 2 monitors plays are wrong,
Using the video of the video program for the video frequency feature data and server end that television terminal 2 is acquired to currently playing video program
Characteristic compares, if unanimously, confirming that the current video program of television terminal 2 is this feature that server end 1 stores
The video program of data.Interaction content generation module 17 generates interaction according to the currently playing video program of the television terminal 2
Then information is transmitted to the television terminal 2 by the server end 1, by the television terminal 2 by clicking interactive information
Realize then interaction, or input interactive information upload to the server end 1 and realize interaction.
The preferred embodiment of the present invention is: the server end 1 further includes the acquisition module for acquiring video frequency feature data
14.Then acquisition module 14 is stored, as new view using the video frequency feature data of the video program of monitoring by memory module 12
Frequency characteristic is with to be used.Video frequency feature data is the set of video image characteristic, indicates the number of this section of video program feature
According to.Video frequency feature data includes the comprehensive characteristics set of various video characteristics of image, such as average gray feature, color moment spy
Sign, HOG feature etc., average gray feature represent the intensity profile situation for indicating video image, color moment character representation video figure
As in the case where color component variation, in HOG character representation video image the case where grey scale change.Pass through Continuous plus video flowing
In each frame image video features, and these characteristics are preserved, so that it may obtain the characteristic data flow of video,
To indicate the video.In usual algorithm, average gray feature is the average gray value of image, the average gray value of image i.e. certain
The mean value of the cumulative sum of all gray values, average gray value characterize the average color depth journey of the area pixel point in a region
Degree, value range [0,255].For entire image, this is that (each piece has 1 average gray to one 9 feature tieed up
Value).HOG feature is the feature based on gray level image, for pixel, calculates gradient direction k and amplitude S by formula.Face
Color moment in colour moment feature has the good characteristics such as translation, rotation, scaling invariance, calculates the central moment of its first three rank, right
In entire image, conventional algorithm is the feature of a 3*3*9=81 dimension.
As shown in Figure 1, preferred implementation process of the invention is: the television terminal 2 includes obtaining the television terminal 2 to broadcast
The channel information for putting program channel information obtains module 25.It includes according to machine top that the television terminal 2, which acquires video program information,
Box acquisition video program information is recorded according to logo Image Acquisition and identification acquisition video program information and according to video playing
Acquire video program information.After television terminal 2 is opened, the position of current video program image logo is captured, acquires video program
Logo image, the logo of the video program is then identified using image recognition technology, by the logo and is pre-stored in TV end
Logo in end 2 is compared, and channel information obtains the program channel where the determining current video program of module 25.Then should
Video playing program channel is uploaded onto the server, and server end determines the electricity according to the broadcasting program of the program channel of monitoring
Depending on terminal video program being played on.Television terminal order video program records the section for obtaining the video program according to program request
Mesh channel.It include that information, the television terminals such as title, the play time of request program of program of program request collect in program request record
It uploads onto the server after these information, by the information, server is the video program that may know that the television terminal and play.TV
Terminal obtains video programming signal by set-top box, and according to the arrangement of program channel in local set-top box, channel information obtains mould
Block 25 selects to obtain the program channel of video program by set top box channel.Then the video playing program channel is uploaded into clothes
Business device, server end 1 determine television terminal video section being played on according to the broadcasting program of the program channel of monitoring
Mesh.
As shown in Figure 1, preferred implementation process of the invention is: the interactive module 26 includes voice input module and key
It is one or more in input module.Voice interface is realized by voice input module, and voice input module is arranged on a remote control
Or on television terminal 1.Realize that the selection and input of information, keyboard input module setting are set in remote control by keyboard input module
It is standby upper.
The solution have the advantages that: the present invention construct it is a kind of according to television terminal play the method that is interacted of program and
System, the television terminal acquisition simultaneously upload current video program information and video frequency feature data to server;The server
The video frequency feature data of end storage video program and information to be supplied;Monitor the video program that multiple channels play;The clothes
The video frequency feature data for the video program that business device end uploads the television terminal and the video program of server end storage
Video frequency feature data be compared analysis and the video program information that uploads the television terminal and the server end
The video program information of monitoring is compared analysis, obtains the currently playing video program of the television terminal;According to the electricity
Depending on the currently playing video program of terminal, the server end provides interaction content, the television terminal to the television terminal
It is interacted with the server end.The present invention uploads video program relevant information being played on by the television terminal,
The server end is determining the television terminal according to the video program and received video program relevant information of monitoring
The video program of broadcasting, then the server and the television terminal are established mutual according to the video program of the television terminal
It is dynamic, it realizes television terminal and is really interacted according to what the video program of the television terminal carried out with server end, realized true
Interaction in positive meaning.
The above content is a further detailed description of the present invention in conjunction with specific preferred embodiments, and it cannot be said that
Specific implementation of the invention is only limited to these instructions.For those of ordinary skill in the art to which the present invention belongs, exist
Under the premise of not departing from present inventive concept, a number of simple deductions or replacements can also be made, all shall be regarded as belonging to of the invention
Protection scope.