CN104683781B - Video playback processing method and processing device - Google Patents
Video playback processing method and processing device Download PDFInfo
- Publication number
- CN104683781B CN104683781B CN201310608680.0A CN201310608680A CN104683781B CN 104683781 B CN104683781 B CN 104683781B CN 201310608680 A CN201310608680 A CN 201310608680A CN 104683781 B CN104683781 B CN 104683781B
- Authority
- CN
- China
- Prior art keywords
- video
- sensory experience
- instruction
- mobile terminal
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a kind of video playback processing method and processing device, wherein method includes: obtain the scene information of the 3D video that mobile terminal is play；According to described scene information, configuring the 4D sensory experience instruction that the described currently playing scene of 3D video is corresponding, the instruction of described 4D sensory experience performs corresponding 4D action when playing described 3D video according to different scenes for mobile terminal.Or including: the scene information of the 3D video that offer mobile terminal is play；Obtain the 4D sensory experience instruction that the described currently playing scene of 3D video configured according to described scene information is corresponding；When playing described 3D video, perform the 4D action of described 4D sensory experience instruction instruction according to different scenes.The present invention can provide 4D interaction sensory experience at mobile terminal, and realizes the real-time interactive with user.
Description
Technical field
The present invention relates to video technique field, particularly relate to video playback processing method and processing device.
Background technology
The development of technology brings new video viewing experience.Such as, part cinema achieves 3D (three-dimensional) broadcasting
Or 4D (four-dimensional) plays, cinema 3D plays the experience being visually brought solid；The 4D of cinema
Play, by the chair of cinema and outside arrange vibrations, blow, the mode such as water spray strengthens the telepresenc of spectators.This
A kind of experience when participating in the cintest is as fourth dimension, so claiming 4D to play.
Existing mobile terminal, can play the video file processed through 3D, but cannot provide the interaction in addition to 3D video
Sensory experience.Further, traditional cinema 4D plays, and is by special staff, film to be carried out 4D in advance to play volume
System, to decide when jet to be carried out or vibrations etc..This can only be by the mode of special staff establishment, it is impossible to
Realize and the interaction of user.
Summary of the invention
The embodiment of the present invention provides a kind of video playback processing method, in order to provide 4D interaction sensory experience at mobile terminal,
And realize the real-time interactive with user, the method includes:
Obtain the scene information of the 3D video that mobile terminal is play；
According to described scene information, configure the 4D sensory experience instruction that the described currently playing scene of 3D video is corresponding, described
The instruction of 4D sensory experience performs corresponding 4D action when playing described 3D video according to different scenes for mobile terminal；
Described scene information includes: obtain the barrage message that mobile terminal reports when playing described 3D video；
According to described scene information, configure described 4D sensory experience instruction, including: described barrage message is carried out screening and
Editor, it is determined whether editor's 4D sensory experience instruction；Additional 4D sensory experience is being needed to instruct through screening and edit validation
Additional described 4D sensory experience instruction in barrage message, described barrage message includes: cryptographic Hash that described 3D video is corresponding,
Barrage content and timestamp；
Described method also includes: when 3D video is again by program request, provides to the mobile terminal of request and addition of 4D sense organ body
Test the barrage message of instruction.
In one embodiment, it is thus achieved that the scene information of the 3D video that mobile terminal is play, including: obtain mobile terminal and exist
The acoustic information detected during playing described 3D video；
According to described scene information, configure the instruction of described 4D sensory experience, including: set up sound and instruct with 4D sensory experience
Mapping library, carries out voice recognition to the acoustic information obtained, and matches the instruction of 4D sensory experience according to mapping library.
In one embodiment, it is thus achieved that the scene information of the 3D video that mobile terminal is play, also include: obtain mobile terminal
The classification information of the described 3D video play；
According to described scene information, configure the instruction of described 4D sensory experience, including: according to the classification information of described 3D video,
The 4D sensory experience instruction corresponding to described 3D video configuration.
The embodiment of the present invention also provides for a kind of video playback processing method, in order to provide 4D interaction sensory experience at mobile terminal,
And realize the real-time interactive with user, the method includes:
The scene information of the 3D video that offer mobile terminal is play；
Obtain the 4D sensory experience instruction that the described currently playing scene of 3D video configured according to described scene information is corresponding；
When playing described 3D video, perform the 4D action of described 4D sensory experience instruction instruction according to different scenes；
Described scene information includes: report barrage message when 3D video described in mobile terminal playing, in described barrage message
Including: cryptographic Hash, barrage content and the timestamp that described 3D video is corresponding；
Obtain the described 4D sensory experience instruction configured according to described scene information, including: obtain and work as according to described 3D video
Front broadcasting scene adds the described barrage message of described 4D sensory experience instruction.
In one embodiment, it is provided that the scene information of the 3D video that mobile terminal is play, including: in mobile terminal playing
Acoustic information is detected during the described currently playing scene of 3D video；
Obtain the described 4D sensory experience instruction configured according to described scene information, including: set up sound and 4D sensory experience
Command mappings storehouse, carries out voice recognition to the acoustic information obtained, and matches the instruction of 4D sensory experience according to mapping library.
In one embodiment, it is provided that the scene information of the 3D video that mobile terminal is play, also include: obtain mobile terminal
The classification information of the described 3D video play；
The 4D sensory experience instruction corresponding to described 3D video configuration, including: according to the classification information of described 3D video,
The 4D sensory experience instruction corresponding to described 3D video configuration.
The embodiment of the present invention also provides for a kind of video playback processing means, in order to provide 4D interaction sensory experience at mobile terminal,
And realize the real-time interactive with user, this device includes:
Obtain module, for obtaining the scene information of the 3D video that mobile terminal is play；
Configuration module, for according to described scene information, configures the 4D sense organ body that the described currently playing scene of 3D video is corresponding
Testing instruction, the instruction of described 4D sensory experience performs correspondence when playing described 3D video according to different scenes for mobile terminal
4D action；
Described acquisition module specifically for: obtain mobile terminal barrage message of reporting when playing described 3D video；
Described configuration module specifically for: described barrage message is screened and is edited, it is determined whether editor 4D sense organ body
Test instruction；At described 4D sense organ body additional in the barrage message that screening and edit validation need additional 4D sensory experience to instruct
Testing instruction, described barrage message includes: cryptographic Hash, barrage content and the timestamp that described 3D video is corresponding；When 3D regards
When frequency is again by program request, provide the barrage message that addition of the instruction of 4D sensory experience to the mobile terminal of request.
In one embodiment, described acquisition module specifically for: obtain mobile terminal and playing during described 3D video
The acoustic information detected；
Described configuration module specifically for: set up sound and 4D sensory experience command mappings storehouse, the acoustic information obtained entered
Row voice recognition, matches the instruction of 4D sensory experience further according to mapping library.
In one embodiment, described acquisition module is additionally operable to: obtain the classification letter of the described 3D video that mobile terminal is play
Breath；
Described configuration module specifically for: according to the classification information of described 3D video, corresponding to described 3D video configuration
4D sensory experience instructs.
The embodiment of the present invention also provides for a kind of video playback processing means, in order to provide 4D interaction sensory experience at mobile terminal,
And realize the real-time interactive with user, including:
Module is provided, is used for the scene information of the 3D video providing mobile terminal to be play；
Obtain module, for obtaining the 4D sense that the described currently playing scene of 3D video configured according to described scene information is corresponding
Official's experience instruction；
Perform module, for when playing described 3D video, perform the instruction instruction of described 4D sensory experience according to different scenes
4D action；
Described offer module specifically for: report barrage message, described barrage to disappear when 3D video described in mobile terminal playing
Breath includes: cryptographic Hash, barrage content and the timestamp that described 3D video is corresponding；
Described acquisition module specifically for: obtain and add described 4D sensory experience according to the described currently playing scene of 3D video and refer to
The described barrage message of order.
In one embodiment, described offer module specifically for: in the currently playing scene of 3D video described in mobile terminal playing
During detect acoustic information, it is thus achieved that the classification information of the described 3D video that mobile terminal is play；
Described acquisition module specifically for: set up sound and 4D sensory experience command mappings storehouse, the acoustic information obtained entered
Row voice recognition, according to mapping library and the classification information of described 3D video, matches the instruction of 4D sensory experience.
In the embodiment of the present invention, during mobile terminal playing 3D video, the 3D video play according to mobile terminal
Scene information, configure the 4D sensory experience instruction that this currently playing scene of 3D video is corresponding, make the mobile terminal can be according to this
The instruction of 4D sensory experience performs corresponding 4D action when playing this 3D video, thus provides except 3D regards at mobile terminal
Interactive sensory experience beyond Pin, and, 4D sensory experience therein instructs without being carried out in advance by special staff
Establishment, can be by information or the transmission of instruction on mobile terminal, it is achieved with the real-time interactive of user.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing skill
In art description, the required accompanying drawing used is briefly described, it should be apparent that, the accompanying drawing in describing below is only the present invention
Some embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to root
Other accompanying drawing is obtained according to these accompanying drawings.In the accompanying drawings:
Fig. 1 is the process chart of video playback processing method in the embodiment of the present invention；
Fig. 2 is the process chart of video playback processing method in the embodiment of the present invention；
Fig. 3 is the system construction drawing in the embodiment of the present invention in video playback processing method instantiation；
Fig. 4 is the flow chart carrying out voice recognition in the embodiment of the present invention based on method for mode matching；
Fig. 5 is the structural representation of video playback processing means in the embodiment of the present invention；
Fig. 6 is the structural representation of video playback processing means in the embodiment of the present invention.
Detailed description of the invention
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, real to the present invention below in conjunction with the accompanying drawings
Execute example to be described in further details.Here, the schematic description and description of the present invention is used for explaining the present invention, but not
As limitation of the invention.
Providing a kind of video playback processing method in the embodiment of the present invention, Fig. 1 is the process stream of this video playback processing method
Cheng Tu.As it is shown in figure 1, this video playback processing method may include that
The scene information of the 3D video that step 101, acquisition mobile terminal are play；
Step 102, according to described scene information, the 4D sensory experience configuring the described currently playing scene of 3D video corresponding refers to
Order, described 4D sensory experience instructs and performs correspondence when playing described 3D video according to different scenes for mobile terminal
4D action.
Flow process is it is known that in the embodiment of the present invention as shown in Figure 1, during mobile terminal playing 3D video, and can
To obtain the scene information of the 3D video that mobile terminal is play, configure this currently playing field of 3D video according to this scene information
The 4D sensory experience instruction that scape is corresponding, enables mobile terminal according to the instruction of this 4D sensory experience when playing this 3D video
Perform corresponding 4D action according to different scenes, thus provide the 4D interaction sense organ body in addition to 3D video at mobile terminal
Test, and, 4D sensory experience therein instructs without being worked out in advance by special staff, can be according to mobile whole
The information that end provides configures in real time, and realizes the real-time interactive with user by the process of information and instruction transmission, the most effectively
Solve the 3D video playback of traditional mobile terminal the problem of sensory experience cannot be provided, also solve tradition 4D and only play
By special staff, film can be carried out 4D in advance and play the deficiency of establishment.
Additionally providing a kind of video playback processing method in the embodiment of the present invention, Fig. 2 is the process of this video playback processing method
Flow chart.As in figure 2 it is shown, this video playback processing method may include that
The scene information of the 3D video that step 201, offer mobile terminal are play；
Step 202, obtain the 4D sense organ body that the described currently playing scene of 3D video configured according to described scene information is corresponding
Test instruction；
Step 203, when playing described 3D video, perform the 4D of described 4D sensory experience instruction instruction according to different scenes
Action.
Flow process is it is known that in the embodiment of the present invention as shown in Figure 2, during mobile terminal playing 3D video, and can
Scene information with the 3D video that offer mobile terminal is play, it is thus achieved that current according to this 3D video that this scene information configures
Play the 4D sensory experience instruction that scene is corresponding, perform corresponding 4D action when playing this 3D video according to different scenes,
Thus provide the 4D interaction sensory experience in addition to 3D video at mobile terminal, and, 4D sensory experience therein instructs
Without being worked out in advance by special staff, can configure in real time according to the information that mobile terminal provides, and pass through information
Realizing the real-time interactive with user with the process of instruction transmission, the 3D video not only efficiently solving traditional mobile terminal is broadcast
Put the problem that sensory experience cannot be provided, also solve tradition 4D and play by special staff, film to be entered in advance
Row 4D plays the deficiency of establishment.
When being embodied as, flow process shown in Fig. 1 can be implemented by the equipment being capable of its function, and such as this equipment can be to regard
Frequently Play Server, 3D Resource Server etc., be to say as a example by 3D Resource Server in the description of the embodiments below
Bright.Flow process shown in Fig. 2 can by be capable of its function equipment implement, such as this equipment can be mobile terminal, with
Under embodiment describe in be to illustrate as a example by mobile terminal.The 4D that mobile terminal can perform when playing 3D video
Action includes: start one of the electromagnetic shaker of mobile terminal, acoustical generator, flash lamp etc. or combination, realizes the mutual dynamic of 4D
Official experiences.
When being embodied as, the above-mentioned video playback processing method of the embodiment of the present invention can be real by the way of online interaction is play
Existing.Such as, user watches 3D video by mobile terminal, and user finds excellent scene when watching 3D video, passes through
Mobile terminal transmission barrage message, to 3D Resource Server, after 3D Resource Server receives barrage message, is regarded by concrete
Frequently scene plus 4D sensory experience instruction (as vibrations, flash of light etc. instruct) and is saved in 3D Resource Server to barrage message
On.When user plays this video again, it is (the most logical that mobile terminal can obtain barrage message from 3D Resource Server
Cross network communication mode), when time point in video playback to barrage message, barrage message shows in broadcasting pictures,
And perform the 4D sensory experience instruction in barrage message, to realize 4D broadcasting.
Concrete, when realizing the video playback processing method of the embodiment of the present invention by the way of online interaction is play, at Fig. 1
In shown flow process, obtain the scene information of the 3D video that mobile terminal is play from mobile terminal, may include that reception moves
The barrage message that dynamic terminal reports when playing described 3D video；According to described scene information, configure described 3D video current
Play the 4D sensory experience instruction that scene is corresponding, may include that according to the described currently playing scene of 3D video, at described bullet
Additional described 4D sensory experience instruction in curtain message.
In flow process shown in Fig. 2, it is provided that the scene information of the 3D video that mobile terminal is play, may include that and moving
Barrage message is reported during 3D video described in terminal plays；Obtain the described 3D video configured according to described scene information currently to broadcast
Put the 4D sensory experience instruction that scene is corresponding, may include that acquisition is additional described according to the described currently playing scene of 3D video
The described barrage message of 4D sensory experience instruction.
When being embodied as, in the mode that above-mentioned online interaction is play, 3D Resource Server passes through mobile terminal receiving user
After the barrage message reported, it is also possible to by staff, barrage message is screened and edited, screening operation personnel think smart
Color, barrage message accurately, staff will be through screening with edited add to barrage message by concrete video scene
4D sensory experience instructs and is saved on 3D Resource Server.Concrete, this can be embodied as in flow process shown in Fig. 1: connects
After receiving the barrage message that mobile terminal reports when playing described 3D video, also include: described barrage message is sieved
Choosing and editor, it is determined whether editor's 4D sensory experience instruction；Additional described 4D sensory experience instruction in described barrage message,
Including: in described 4D sensory experience additional in the barrage message that screening and edit validation need additional 4D sensory experience to instruct
Instruction.When 3D video is again by program request, the barrage that addition of the instruction of 4D sensory experience is provided to disappear to the mobile terminal of request
Breath.
When being embodied as, above-mentioned barrage message may include that cryptographic Hash that described 3D video is corresponding, barrage content and
Timestamp.
When being embodied as, the above-mentioned video playback processing method of the embodiment of the present invention can also be known otherwise automatically by sound
Realize.Such as, user watches 3D video by mobile terminal, by the sound recognition module on mobile terminal, detects
Playing sound during this 3D video, determine wherein specific sound, this specific sound corresponds to specific 3D video scene,
Determine this 3D video uses the 4D sensory experience of what effect again, realize 4D and play.One example is: in mobile terminal
When playing terrified video, if be detected that shriek, then it is assumed that it is a scene that should use vibration command, at this moment can realize
In film, personage screams and mobile terminal vibrations are carried out, to strengthen user's fear simultaneously.
Concrete, when automatically knowing, by sound, the video playback processing method realizing the embodiment of the present invention otherwise, at Fig. 2
In shown flow process, it is provided that the scene information of the 3D video that mobile terminal is play, may include that acquisition mobile terminal is being broadcast
The acoustic information detected during putting described 3D video；Obtain the described 3D video pair configured according to described scene information
The 4D sensory experience instruction answered, may include that and set up sound and 4D sensory experience command mappings storehouse, to the sound letter obtained
Breath carries out voice recognition, matches the instruction of 4D sensory experience according to mapping library.
When being embodied as, it is also possible to when user is by mobile terminal viewing 3D video, it is thus achieved that the classification information of this video,
Such as this classification information can be included in the label of this video, obtains the classification of this video by obtaining the label of this video
Information.Follow-up can determine this 3D video uses the 4D sensory experience of what effect according to the classification information of this video.Depending on
Frequency division class refers to comedy, terror, love etc., and such as this video belongs to terrified classification, then the music that can add terror strengthens
User's fear.
Being embodied as of in embodiment of the present invention video playback processing method is exemplified below.This example provides and realizes this
The system structure of video playback processing method in bright embodiment, as it is shown on figure 3, can include 3D resource in this system structure
Server, barrage message server, the mobile client of band network, sound scenery identification module, 4D sense organ module, wherein
3D Resource Server, barrage message server are positioned at server end, can implement flow process shown in Fig. 1, the mobile client of band network
End, sound scenery identification module, 4D sense organ module are positioned at mobile terminal, may be implemented in flow process shown in Fig. 2.
Concrete, 3D Resource Server can be used for being converted to the video resource file of 2D the video resource file of 3D, with
Ask for mobile terminal video data.Barrage message server be mainly used in preserve user upload, edit through staff
Barrage message.Mobile client with network for the reception of 3D video and broadcasting, the transmission of barrage message, acquisition and
Display.Sound scenery identification module is for when playing, detecting decoded audio data stream, to identify specific video field
Scape.4D sense organ module refers to the equipment such as the flash lamp of mobile terminal, electromagnetic shaker.
When the video resource file of 2D is converted to the video resource file of 3D by its amount 3D Resource Server, space division can be used
The multiple technologies such as method, the most flash technology, complementary color technology, time-sharing procedure, raster pattern, sight screen formula, holographic formula.Existing
In regular display, general employing complementary color technology realizes solid and plays, and plays simply, and macyscope cost is the lowest
Honest and clean.The 3D video that presently, there are is the most few, and main cause is parallax to be considered, background effect, the bat when shooting of 3D video
Take the photograph the restriction of the many factors such as cost；Ordinary two dimensional video conversion is that the method for 3 D stereo video is the most varied, algorithm
Complexity, and effect is not obviously improved, it may be considered that main use 2D based on complementary color technology to turn 3D technology.
The complementary present comparative maturity of aberration technology, the reddest indigo plant, the red various modes such as green, but the principle used is just as
's.As a example by red basket, logical picture is separated into red by rgb, blue two pictures, then formed different by translation, scaling
Parallax, during broadcasting puts two pictures together.By the glasses of red indigo plant during viewing, red eyeglass only sees red picture,
Green len only sees green picture.Two different pictures arrived soon form stereoscopic picture plane in the brain.
On the basis of 3D player method, add that 4D sense organ module just can have the effect that 4D plays.This example can moved
Dynamic terminal and server end interaction are set up 4D and are experienced parameter library.Download 4D when playing and experience parameter.Again in playing process
4D sense organ module is controlled, to realize 4D result of broadcast according to playing progress rate.
By online interaction broadcast mode realize 4D play time, can use 3D Resource Server, barrage message storage server,
Mobile client and 4D sense organ module with network are implemented.Have this flow process such as:
User A is obtaining to obtain certain video 3D video resource VA by 3D Resource Server, when viewing, finds excellent regarding
Frequently scene, sends barrage message by the mobile client of band network to 3D Resource Server.The subsidiary information of barrage message is extremely
Include less: unique hash value, user's barrage content and time that video is corresponding cut.
3D Resource Server receives barrage message, staff compare barrage message and video VA, screen excellent,
Barrage message accurately.Determine to increase the instructions such as vibrations, flash lamp to barrage message by concrete scene again, be used for controlling to move
The 4D sense organ module of terminal.And these barrage message are preserved.
User B, also viewing video VA (can also be user A second time viewing), be contrasted by hash, determines
Whether have correspondence on 3D Resource Server passes through screening and the barrage message of editor.If it has, fetch barrage message.When broadcasting
When the time specified being put in barrage message carries, barrage message will be shown, and control by the control instruction according to barrage
4D sense organ module, to realize 4D result of broadcast.
When realizing 4D broadcasting by scene voice recognition, the module related to and server include 3D Resource Server, band net
The mobile client of network, sound scenery identification module, 4D sense organ module.Specifically handling process is such as:
User A is obtaining to obtain the data of certain video 3D video resource VA by 3D Resource Server, and gets simultaneously
The label of file, label is pointed out the classification (comedy, terror or love etc.) of this video.
User is during playing video VA, and sound scenery identification module can be classified by current video, looks in video
With the voice data of sample audio coupling, once it is found that the data of coupling, by the rule reserved before to control 4D sense organ
Module.The definition of rule is fairly simple, first the scene classification of response, then determines which type of 4D is these scenes to be and move
Make.The most in dark conditions, if the scene of terror, can glisten.
When carrying out voice recognition, typically can use following three kinds of technology: speech recognition based on channel model, template
The method joined and the method utilizing artificial neural network.For at present, Technical comparing based on template matching is ripe, and
Module knows the technology used in method for distinguishing dynamic time warping (DWT), HMM (HMM), vows
Amount quantization (VQ) three kinds.Such as can carry out the voice recognition in the embodiment of the present invention based on HMM.Fig. 4
In show the general flow carrying out voice recognition based on method for mode matching:
First acoustical signal is carried out pretreatment, carries out feature extraction afterwards, carry out acoustic pattern coupling by identification, according to mould
Formula matching result makes decisions and exports result, needs to mate with sample form, for sample mould in pattern matching process
Plate, can carry out learning training to sound clip to be identified, obtain mapping library.In enforcement, sample form can be for wanting
The scene sound identified, makes in advance and leaves mobile terminal in.When playing during video, mobile terminal can directly use
The sample made in advance mates.
When being embodied as, sound recognition module carries out voice recognition except the above-described mobile terminal that is placed on.Can also be put into
Server end, is carried out scene Recognition by server, then recognition result and file is sent jointly to mobile terminal sound, from
And reduce the cpu load that mobile terminal requires because carrying out sound scenery identification.In the above-described embodiment, mobile terminal
According to the result of voice recognition, the 4D sensory experience instruction that the configuration currently playing scene of 3D video is corresponding, can also during enforcement
By server end according to the result of voice recognition, configure the 4D sensory experience instruction that the currently playing scene of 3D video is corresponding.Tool
Body, in flow process shown in Fig. 1, obtain the scene information of the 3D video that mobile terminal is play from mobile terminal, permissible
Including: obtain, from mobile terminal, the acoustic information that mobile terminal detects during playing described 3D video；According to institute
State scene information, configure the 4D sensory experience instruction that the described currently playing scene of 3D video is corresponding, may include that and set up sound
Sound and 4D sensory experience command mappings storehouse, carry out voice recognition to the acoustic information obtained, and it is right to configure according to mapping library
The 4D sensory experience instruction answered.
Further, concrete, in flow process shown in Fig. 1, it is provided that the scene information of the 3D video that mobile terminal is play, also
May include that the classification information obtaining the described 3D video that mobile terminal is play；Corresponding to described 3D video configuration
4D sensory experience instructs, and may include that the classification information according to described 3D video, corresponding to described 3D video configuration
4D sensory experience instructs.
Based on same inventive concept, the embodiment of the present invention also provides for a kind of video playback processing means, such as the following examples
Described.Owing to the principle of video playback processing means solution problem is similar to video playback processing method, therefore at video playback
The enforcement of reason device may refer to the enforcement of video playback processing method, repeats no more in place of repetition.
Fig. 5 is the structural representation of video playback processing means in the embodiment of the present invention.As it is shown in figure 5, the embodiment of the present invention
Middle video playback processing means may include that
Obtain module 501, for obtaining the scene information of the 3D video that mobile terminal is play；
Configuration module 502, for according to described scene information, configuring the 4D sense that the described currently playing scene of 3D video is corresponding
Official's experience instruction, the instruction of described 4D sensory experience performs according to different scenes when playing described 3D video for mobile terminal
Corresponding 4D action.
When being embodied as, described acquisition module 501 specifically may be used for: obtains mobile terminal when playing described 3D video
The barrage message reported；
Described configuration module 502 specifically may be used for: described barrage message is screened and edited, it is determined whether editor 4D
Sensory experience instructs；At described 4D additional in the barrage message that screening and edit validation need additional 4D sensory experience to instruct
Sensory experience instructs, and described barrage message includes: cryptographic Hash, barrage content and the timestamp that described 3D video is corresponding；
When 3D video is again by program request, provide the barrage message that addition of the instruction of 4D sensory experience to the mobile terminal of request.
When being embodied as, described acquisition module 501 specifically may be used for: obtains mobile terminal and is playing described 3D video
During the acoustic information that detects；
Described configuration module 502 specifically may be used for: sets up sound and 4D sensory experience command mappings storehouse, to the sound obtained
Message breath carries out voice recognition, matches the instruction of 4D sensory experience further according to mapping library.
When being embodied as, described acquisition module 501 can be also used for: the described 3D video that acquisition mobile terminal is play
Classification information；
Described configuration module 502 specifically may be used for: according to the classification information of described 3D video, to described 3D video configuration
Corresponding 4D sensory experience instruction.
Fig. 6 is the structural representation of video playback processing means in the embodiment of the present invention.As shown in Figure 6, the embodiment of the present invention
Middle video playback processing means may include that
Module 601 is provided, is used for the scene information of the 3D video providing mobile terminal to be play；
Obtain module 602, corresponding for obtaining the described currently playing scene of 3D video configured according to described scene information
4D sensory experience instructs；
Perform module 603, for when playing described 3D video, perform the instruction of described 4D sensory experience according to different scenes
The 4D action of instruction.
When being embodied as, described offer module 601 specifically may be used for: reports when 3D video described in mobile terminal playing
Barrage message, described barrage message includes: cryptographic Hash, barrage content and the timestamp that described 3D video is corresponding；
Described acquisition module 602 specifically may be used for: obtains and adds described 4D sense according to the described currently playing scene of 3D video
The described barrage message of official's experience instruction.
When being embodied as, described offer module 601 specifically may be used for: currently broadcasts at 3D video described in mobile terminal playing
Acoustic information is detected, it is thus achieved that the classification information of the described 3D video that mobile terminal is play during putting scene；
Described acquisition module 602 specifically may be used for: sets up sound and 4D sensory experience command mappings storehouse, to the sound obtained
Message breath carries out voice recognition, according to mapping library and the classification information of described 3D video, matches the instruction of 4D sensory experience.
In sum, in the embodiment of the present invention, during mobile terminal playing 3D video, broadcast according to mobile terminal
The scene information of the 3D video put, configures the 4D sensory experience instruction that this currently playing scene of 3D video is corresponding, makes mobile
Terminal can perform corresponding 4D action when playing this 3D video according to different scenes according to the instruction of this 4D sensory experience, from
And provide interactive sensory experience except 3D video in addition at mobile terminal, and, 4D sensory experience therein instruct without by
Special staff works out in advance, can be by information or the transmission of instruction on mobile terminal, it is achieved video viewers is mutual
The dynamic 4D of participation plays.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or computer program product
Product.Therefore, the reality in terms of the present invention can use complete hardware embodiment, complete software implementation or combine software and hardware
Execute the form of example.And, the present invention can use at one or more computers wherein including computer usable program code
The upper computer journey implemented of usable storage medium (including but not limited to disk memory, CD-ROM, optical memory etc.)
The form of sequence product.
The present invention is with reference to method, equipment (system) and the flow chart of computer program according to embodiments of the present invention
And/or block diagram describes.It should be understood that can be by each flow process in computer program instructions flowchart and/or block diagram
And/or the flow process in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided to refer to
Order arrives the processor of general purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device to produce
One machine so that the instruction performed by the processor of computer or other programmable data processing device is produced and is used for realizing
The device of the function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and computer or other programmable data processing device can be guided with certain party
In the computer-readable memory of formula work so that the instruction being stored in this computer-readable memory produces and includes instruction dress
The manufacture put, this command device realizes one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple side
The function specified in frame.
These computer program instructions also can be loaded in computer or other programmable data processing device so that at computer
Or on other programmable devices perform sequence of operations step to produce computer implemented process, thus computer or other
The instruction performed on programmable device provides for realizing in one flow process of flow chart or multiple flow process and/or one side of block diagram
The step of the function specified in frame or multiple square frame.
Particular embodiments described above, has been carried out the most specifically the purpose of the present invention, technical scheme and beneficial effect
Bright, be it should be understood that the specific embodiment that the foregoing is only the present invention, the protection being not intended to limit the present invention
Scope, all within the spirit and principles in the present invention, any modification, equivalent substitution and improvement etc. done, should be included in
Within protection scope of the present invention.
Claims (11)
1. a video playback processing method, it is characterised in that including:
Obtain the scene information of the 3D video that mobile terminal is play；
According to described scene information, configuring the 4D sensory experience instruction that the described currently playing scene of 3D video is corresponding, the instruction of described 4D sensory experience performs corresponding 4D action when playing described 3D video according to different scenes for mobile terminal；
Described scene information includes: obtain the barrage message that mobile terminal reports when playing described 3D video；
According to described scene information, configure the instruction of described 4D sensory experience, including: described barrage message is screened and edited, it is determined whether editor's 4D sensory experience instruction；In described 4D sensory experience instruction additional in the barrage message that screening and edit validation need additional 4D sensory experience to instruct, described barrage message includes: cryptographic Hash, barrage content and the timestamp that described 3D video is corresponding；
Described method also includes: when 3D video is again by program request, provides the barrage message that addition of the instruction of 4D sensory experience to the mobile terminal of request.
2. the method for claim 1, it is characterised in that obtain the scene information of the 3D video that mobile terminal is play, including: obtain the acoustic information that mobile terminal detects during playing described 3D video；
According to described scene information, configure the instruction of described 4D sensory experience, including: set up sound and 4D sensory experience command mappings storehouse, the acoustic information obtained is carried out voice recognition, match the instruction of 4D sensory experience according to mapping library.
3. method as claimed in claim 2, it is characterised in that obtain the scene information of the 3D video that mobile terminal is play, also include: obtain the classification information of the described 3D video that mobile terminal is play；
According to described scene information, configure the instruction of described 4D sensory experience, including: according to the classification information of described 3D video, the 4D sensory experience instruction corresponding to described 3D video configuration.
4. a video playback processing method, it is characterised in that including:
The scene information of the 3D video that offer mobile terminal is play；
Obtain the 4D sensory experience instruction that the described currently playing scene of 3D video configured according to described scene information is corresponding；
When playing described 3D video, perform the 4D action of described 4D sensory experience instruction instruction according to different scenes；
Described scene information includes: report barrage message, described barrage message to include when 3D video described in mobile terminal playing: cryptographic Hash, barrage content and the timestamp that described 3D video is corresponding；
Obtain the described 4D sensory experience instruction configured according to described scene information, including: obtain the described barrage message adding the instruction of described 4D sensory experience according to the described currently playing scene of 3D video.
5. method as claimed in claim 4, it is characterised in that the scene information of the 3D video that offer mobile terminal is play, including: during the currently playing scene of 3D video described in mobile terminal playing, detect acoustic information；
Obtain the described 4D sensory experience instruction configured according to described scene information, including: set up sound and 4D sensory experience command mappings storehouse, the acoustic information obtained is carried out voice recognition, match the instruction of 4D sensory experience according to mapping library.
6. method as claimed in claim 5, it is characterised in that the scene information of the 3D video that offer mobile terminal is play, also includes: obtain the classification information of the described 3D video that mobile terminal is play；
The 4D sensory experience instruction corresponding to described 3D video configuration, including: according to the classification information of described 3D video, the 4D sensory experience instruction corresponding to described 3D video configuration.
7. a video playback processing means, it is characterised in that including:
Obtain module, for obtaining the scene information of the 3D video that mobile terminal is play；
Configuration module, for according to described scene information, configuring the 4D sensory experience instruction that the described currently playing scene of 3D video is corresponding, the instruction of described 4D sensory experience performs corresponding 4D action when playing described 3D video according to different scenes for mobile terminal；
Described acquisition module specifically for: obtain mobile terminal barrage message of reporting when playing described 3D video；
Described configuration module specifically for: described barrage message is screened and is edited, it is determined whether editor 4D sensory experience instruction；In described 4D sensory experience instruction additional in the barrage message that screening and edit validation need additional 4D sensory experience to instruct, described barrage message includes: cryptographic Hash, barrage content and the timestamp that described 3D video is corresponding；When 3D video is again by program request, provide the barrage message that addition of the instruction of 4D sensory experience to the mobile terminal of request.
8. device as claimed in claim 7, it is characterised in that described acquisition module specifically for: obtain the acoustic information that mobile terminal detects during playing described 3D video；
Described configuration module specifically for: set up sound and 4D sensory experience command mappings storehouse, the acoustic information obtained carried out voice recognition, match the instruction of 4D sensory experience further according to mapping library.
9. device as claimed in claim 8, it is characterised in that described acquisition module is additionally operable to: obtain the classification information of the described 3D video that mobile terminal is play；
Described configuration module specifically for: according to the classification information of described 3D video, the 4D sensory experience instruction corresponding to described 3D video configuration.
10. a video playback processing means, it is characterised in that including:
Module is provided, is used for the scene information of the 3D video providing mobile terminal to be play；
Obtain module, for obtaining the 4D sensory experience instruction that the described currently playing scene of 3D video configured according to described scene information is corresponding；
Perform module, for when playing described 3D video, perform the 4D action of described 4D sensory experience instruction instruction according to different scenes；
Described offer module specifically for: report barrage message, described barrage message to include when 3D video described in mobile terminal playing: cryptographic Hash, barrage content and the timestamp that described 3D video is corresponding；
Described acquisition module specifically for: obtain according to the described currently playing scene of 3D video add described 4D sensory experience instruction described barrage message.
11. devices as claimed in claim 10, it is characterised in that described offer module specifically for: during the currently playing scene of 3D video described in mobile terminal playing detect acoustic information, it is thus achieved that the classification information of the described 3D video that mobile terminal is play；
Described acquisition module specifically for: set up sound and 4D sensory experience command mappings storehouse, the acoustic information obtained carried out voice recognition, according to mapping library and the classification information of described 3D video, match the instruction of 4D sensory experience.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310608680.0A CN104683781B (en) | 2013-11-26 | 2013-11-26 | Video playback processing method and processing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310608680.0A CN104683781B (en) | 2013-11-26 | 2013-11-26 | Video playback processing method and processing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104683781A CN104683781A (en) | 2015-06-03 |
| CN104683781B true CN104683781B (en) | 2016-08-17 |
Family
ID=53318271
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310608680.0A Active CN104683781B (en) | 2013-11-26 | 2013-11-26 | Video playback processing method and processing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104683781B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104980500B (en) * | 2015-06-08 | 2019-01-04 | 腾讯科技（北京）有限公司 | A kind of information display method and terminal |
| CN105551407A (en) * | 2016-02-18 | 2016-05-04 | 南京科之普教育科技有限公司 | Multimedia live-action control device |
| CN106657975A (en) * | 2016-10-10 | 2017-05-10 | 乐视控股（北京）有限公司 | Video playing method and device |
| CN109451154B (en) * | 2018-10-31 | 2021-04-23 | 维沃移动通信有限公司 | Method for setting multimedia file and terminal equipment |
| CN109862176A (en) * | 2018-12-27 | 2019-06-07 | 努比亚技术有限公司 | Terminal and its special efficacy auxiliary implementation method and computer readable storage medium |
| CN110798737A (en) * | 2019-11-29 | 2020-02-14 | 北京达佳互联信息技术有限公司 | Video and audio synthesis method, terminal and storage medium |
| CN113411558A (en) * | 2021-06-18 | 2021-09-17 | 湖南快乐阳光互动娱乐传媒有限公司 | Multi-sense viewing experience enhancement method and device |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101237289A (en) * | 2006-11-03 | 2008-08-06 | Lg电子株式会社 | Broadcast terminal and method of controlling vibration of broadcast terminal |
| CN101299809A (en) * | 2006-07-03 | 2008-11-05 | 沈丽玉 | Interactive video display system and a method thereof |
| CN201181446Y (en) * | 2007-12-19 | 2009-01-14 | 苏州达方电子有限公司 | Interactive computer peripheral |
| CN101416139A (en) * | 2006-04-06 | 2009-04-22 | 伊梅森公司 | Systems and methods for enhanced haptic effects |
| CN101828382A (en) * | 2007-10-16 | 2010-09-08 | 伊梅森公司 | Haptic effect data in the media transport stream synchronously |
| CN102597914A (en) * | 2009-10-29 | 2012-07-18 | 伊梅森公司 | Systems and methods for haptic augmentation of voice-to-text conversion |
| CN101222286B (en) * | 2006-11-03 | 2012-08-15 | Lg电子株式会社 | Apparatus for transmitting broadcast signals and method of transmitting and receiving broadcast signals |
| CN102671397A (en) * | 2012-04-16 | 2012-09-19 | 宁波新文三维股份有限公司 | Seven-dimensional cinema and interaction method thereof |
| CN102724522A (en) * | 2011-03-29 | 2012-10-10 | 雷欧尼斯（北京）信息技术有限公司 | Method and system for realizing 4D digital film based on DCI standard |
| WO2013096327A1 (en) * | 2011-12-21 | 2013-06-27 | Qualcomm Incorporated | Using haptic technologies to provide enhanced media experiences |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008085515A (en) * | 2006-09-27 | 2008-04-10 | Hitachi Ltd | Content receiving terminal system and content receiving terminal |
-
2013
- 2013-11-26 CN CN201310608680.0A patent/CN104683781B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101416139A (en) * | 2006-04-06 | 2009-04-22 | 伊梅森公司 | Systems and methods for enhanced haptic effects |
| CN101299809A (en) * | 2006-07-03 | 2008-11-05 | 沈丽玉 | Interactive video display system and a method thereof |
| CN101237289A (en) * | 2006-11-03 | 2008-08-06 | Lg电子株式会社 | Broadcast terminal and method of controlling vibration of broadcast terminal |
| CN101222286B (en) * | 2006-11-03 | 2012-08-15 | Lg电子株式会社 | Apparatus for transmitting broadcast signals and method of transmitting and receiving broadcast signals |
| CN101828382A (en) * | 2007-10-16 | 2010-09-08 | 伊梅森公司 | Haptic effect data in the media transport stream synchronously |
| CN201181446Y (en) * | 2007-12-19 | 2009-01-14 | 苏州达方电子有限公司 | Interactive computer peripheral |
| CN102597914A (en) * | 2009-10-29 | 2012-07-18 | 伊梅森公司 | Systems and methods for haptic augmentation of voice-to-text conversion |
| CN102724522A (en) * | 2011-03-29 | 2012-10-10 | 雷欧尼斯（北京）信息技术有限公司 | Method and system for realizing 4D digital film based on DCI standard |
| WO2013096327A1 (en) * | 2011-12-21 | 2013-06-27 | Qualcomm Incorporated | Using haptic technologies to provide enhanced media experiences |
| CN102671397A (en) * | 2012-04-16 | 2012-09-19 | 宁波新文三维股份有限公司 | Seven-dimensional cinema and interaction method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104683781A (en) | 2015-06-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104683781B (en) | Video playback processing method and processing device | |
| CN112562433B (en) | Working method of 5G strong interaction remote delivery teaching system based on holographic terminal | |
| CN106303555B (en) | A kind of live broadcasting method based on mixed reality, device and system | |
| CN106789991B (en) | Multi-person interactive network live broadcast method and system based on virtual scene | |
| CN108920937A (en) | It throws screen system, throw screen method and apparatus | |
| CN105872569A (en) | Video playing method and system, and devices | |
| CN104333800B (en) | The Bluetooth audio frequency player method and device of a kind of display system, display system | |
| CN106375789B (en) | Medium living broadcast method and apparatus | |
| CN104811774B (en) | Advertisement, the accurate put-on method of information and system in a kind of audio and video live TV stream | |
| CN106686397A (en) | Multi-person network broadcasting method and device and electronic equipment thereof | |
| CN109275130A (en) | A kind of throwing screen method, apparatus and storage medium | |
| CN105072189B (en) | A kind of desktop area sharing method and system | |
| CN107396167B (en) | Floated menu display method and smart television based on smart television signal source | |
| US20160342202A1 (en) | Virtual reality apparatus, feedback apparatus, and system and method for providing realistic service | |
| CN105898341A (en) | Method and mobile client enabling simultaneous video live broadcast by two persons | |
| CN106534879A (en) | Live broadcasting switching method and system based on attention | |
| CN108282598A (en) | A kind of software director system and method | |
| JP2013093840A (en) | Apparatus and method for generating stereoscopic data in portable terminal, and electronic device | |
| CN104394437A (en) | Live broadcasting method and system | |
| CN106791580A (en) | A kind of meeting processing method and processing device | |
| US20230039530A1 (en) | Automated generation of haptic effects based on haptics data | |
| CN105872537A (en) | Video playing method, device and system | |
| CN106101808A (en) | A kind of net cast method and device | |
| KR102276193B1 (en) | Method and Apparatus for Providing multiview | |
| CN104185068A (en) | Method for switching contextual models automatically according to television programs and television |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200612 Address after: No.266 Chuangyan Road, Qilin science and Technology Innovation Park, Jiangning District, Nanjing City, Jiangsu Province Patentee after: Nanjing Qianying Technology Development Co.,Ltd. Address before: 518057 Guangdong city of Shenzhen province Nanshan District Gao Xin Road No. 009 China Technology Development Institute Technology Park building three, 22 layers of A Patentee before: SHENZHEN QVOD TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201102 Address after: 233000 No.10, building 32, Zone 8, Guangcai market, bengshan District, Bengbu City, Anhui Province Patentee after: Bengbu Shangwei Intellectual Property Operations Co.,Ltd. Address before: No.266 Chuangyan Road, Qilin science and Technology Innovation Park, Jiangning District, Nanjing City, Jiangsu Province Patentee before: Nanjing Qianying Technology Development Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220719 Address after: 518000 unit 619, 6th floor, halo Plaza Phase I, No. 8, Liyuan Road, Sunxi community, Sungang street, Luohu District, Shenzhen, Guangdong Province Patentee after: Shenzhen Yuntian Changxiang Information Technology Co.,Ltd. Address before: 233000 No.10, building 32, Zone 8, Guangcai market, bengshan District, Bengbu City, Anhui Province Patentee before: Bengbu Shangwei Intellectual Property Operations Co.,Ltd. |