CN103747287A - Video playing speed regulation method and system applied to flash - Google Patents

Video playing speed regulation method and system applied to flash Download PDF

Info

Publication number
CN103747287A
CN103747287A CN201410013756.XA CN201410013756A CN103747287A CN 103747287 A CN103747287 A CN 103747287A CN 201410013756 A CN201410013756 A CN 201410013756A CN 103747287 A CN103747287 A CN 103747287A
Authority
CN
China
Prior art keywords
video
frame
audio sample
playing duration
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410013756.XA
Other languages
Chinese (zh)
Other versions
CN103747287B (en
Inventor
王少刚
曾坤
姚键
潘柏宇
卢述奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Alibaba Music Technology Co Ltd
Original Assignee
1Verge Internet Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 1Verge Internet Technology Beijing Co Ltd filed Critical 1Verge Internet Technology Beijing Co Ltd
Priority to CN201410013756.XA priority Critical patent/CN103747287B/en
Publication of CN103747287A publication Critical patent/CN103747287A/en
Application granted granted Critical
Publication of CN103747287B publication Critical patent/CN103747287B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a video playing speed regulation method and a video playing speed regulation system applied to flash. The method comprises the following steps of acquiring video frames, audio frames and timestamps of the video frames in a video file data stream by using a browser; identifying corresponding playing speed regulation values according to obtained regulation indication information, modifying the timestamps of the video frames which are not played by taking the playing speed regulation values as acceleration multiples or deceleration multiples, generating the regulated timestamps of the video frames, and determining the playing time lengths of the video frames by utilizing the regulated timestamps of the video frames; dividing all the audio frames which are not played into a plurality of groups of audio samples according to a preset time interval, deleting or copying the audio samples according to the playing time lengths of the video frames, and regulating accumulated playing time lengths corresponding to the audio samples to be consistent with the playing time lengths of the video frames; establishing association between time sequences corresponding to the regulated timestamps of the audio samples and the video frames for audio and video decoding. According to the method and the system, the problem of video playing speed regulation incapability of a flash acquisition unit in the browser during online video watching is solved.

Description

Be applied to the method and system of the video playout speed adjustment of flash
Technical field
The application relates to video data process field, specifically, relates to the method and system of the video playout speed adjustment of a kind of flash of being applied to.
Background technology
Along with the fast development of Internet technology, the mode of people's obtaining information changes: from modes such as traditional books, newspaper, TV, broadcast, then become by the Internet and obtain.Especially the abundant comprehensive Internet video resource of movie and video programs, news, advertisement, chat video, game video, monitor video etc. is shared in the Internet, thereby video has become people's study, social activity and amusement and recreation and irreplaceable important way, abundant video is provided in corresponding video website by Video service business, so that people share, watches.
The appearance of video website, having changed traditional people can only watch and can not electively watch mode according to TV programme.By video website, people video resource download can be watched or direct-on-line is watched video (being video-on-demand service).And when displaying video, people can arbitrarily adjust the broadcasting speed of video, as: user, when watching video, can save the time that the process of watching spends by accelerating video playout speed; And for example: for language learner, can carry out aural learning by reducing video playout speed.
At present, most websites (comprising video website), all adopt HTML(Hypertext Markup Language, HTML) web page contents is compiled, restriction due to HTML self-characteristic, be difficult to realize the dynamic effect in webpage, so, the common operative norm adopting based on the interactive polar plot of flash(and network animation of video website) Pages Design, the browser that user uses also possesses corresponding flash plug-in unit (comprising flash acquiring unit), thereby, user is by browser access video website, just can see animation in webpage, the dynamic effect of video etc.
But, when user watches video online by browser, flash acquiring unit can not directly be adjusted video playout speed, can only take to revise the more complicated schemes such as video information and audio-frequency information, for example: revise video (comprising audio frequency) broadcasting speed, audio frequency is carried out to special processing.Such scheme has increased the processing load of browser, causes the video play in browser to occur card, even plays the phenomenon such as make mistakes.
In sum, how to solve while watching video online flash acquiring unit in browser and can not adjust video playout speed, just become technical problem urgently to be resolved hurrily.
Summary of the invention
In view of this, the application's technical problem to be solved has been to provide the method and system that the video playout speed of a kind of flash of being applied to is adjusted, and while watching video online to solve, in browser, flash acquiring unit can not be adjusted the problem of video playout speed.
In order to solve the problems of the technologies described above, the application discloses the method for the video playout speed adjustment of a kind of flash of being applied to, it is characterized in that, comprising:
Browser obtains frame of video and the audio frame in video file data flow, and obtains the timestamp of described frame of video; Wherein, described timestamp is the label of the play time of preset described frame of video;
Described browser is according to the adjustment indication information obtaining, identify corresponding broadcasting speed adjusted value, using described broadcasting speed adjusted value as the timestamp that accelerates multiple or deceleration multiple and revise the described frame of video of not playing, generates and utilize the timestamp of the described frame of video after adjustment to determine the playing duration of described frame of video;
Described browser is divided into many group audio sample according to the preset time interval by all audio frames of not playing, according to the playing duration of described frame of video, described audio sample is deleted or replication processes, accumulative total playing duration corresponding to described audio sample is adjusted into consistent with the playing duration of described frame of video;
By the described audio sample after described adjustment and described frame of video, with the time sequencing that the timestamp of this frame of video after adjusting is corresponding, set up association, carry out described audio/video coding.
Preferably, identify corresponding broadcasting speed adjusted value, the described broadcasting speed adjusted value of usining is revised the not timestamp of the described frame of video of broadcasting as accelerating multiple or deceleration multiple, is further:
When described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being less than 1 value, described browser according to this broadcasting speed adjusted value as deceleration multiple, the timestamp of all described frame of video of not playing, all divided by this deceleration multiple, is generated to the video frame time stamp after slowing down;
When described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being greater than 1 value, described browser according to this broadcasting speed adjusted value as accelerating multiple, the timestamp of all described frame of video of not playing is all accelerated to multiple divided by this, generate the video frame time stamp after accelerating.
Preferably, according to the playing duration of described frame of video, described audio sample is deleted or replication processes, accumulative total playing duration corresponding to described audio sample is adjusted into consistent with the playing duration of described frame of video, be further:
When the playing duration of playing duration corresponding to described audio frame and the frame of video of determining according to the video frame time stamp after slowing down is inconsistent, according to described deceleration multiple, copy described audio sample, accumulative total playing duration corresponding to all described audio sample is extended for consistent with the playing duration of described frame of video.
Preferably, according to the playing duration of described frame of video, described audio sample is deleted or replication processes, accumulative total playing duration corresponding to described audio sample is adjusted into consistent with the playing duration of described frame of video, be further:
When the playing duration of playing duration corresponding to described audio frame and the frame of video of determining according to the video frame time stamp after accelerating is inconsistent, according to described acceleration multiple, delete described audio sample, accumulative total playing duration corresponding to all described audio sample shortened to consistent with the playing duration of described frame of video.
Preferably, according to described deceleration multiple, copy described audio sample, be further: the quantity of the described audio sample before copying, divided by described deceleration multiple, is obtained to the quantity of the described audio sample after copying;
According to described acceleration multiple, delete described audio sample, be further: the quantity of the described audio sample before deleting is multiplied by described acceleration multiple, obtains the quantity of the described audio sample after deleting.
In order to solve the problems of the technologies described above, disclosed herein as well is the system of the video playout speed adjustment of a kind of flash of being applied to, couple mutually with browser, it is characterized in that, comprising: acquiring unit, frame of video unit, audio frame unit and output unit, wherein,
Described acquiring unit, for obtaining frame of video and the audio frame of video file data flow, and obtains the timestamp of described frame of video; Wherein, described timestamp is the label of the play time of preset described frame of video;
Described frame of video unit, for the adjustment indication information obtaining according to described browser, identify corresponding broadcasting speed adjusted value, using described broadcasting speed adjusted value as the timestamp that accelerates multiple or deceleration multiple and revise the described frame of video of not playing, generates and utilize the timestamp of the described frame of video after adjustment to determine the playing duration of described frame of video;
Described audio frame unit, for all audio frames of not playing being divided into many group audio sample according to the preset time interval, according to the playing duration of described frame of video, described audio sample is deleted or replication processes, accumulative total playing duration corresponding to described audio sample is adjusted into consistent with the playing duration of described frame of video;
Described output unit, for by the described audio sample after described adjustment and described frame of video, sets up association with the time sequencing that the timestamp of this frame of video after adjusting is corresponding, carries out described audio/video coding.
Preferably, described frame of video unit, is further used for:
When described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being less than 1 value, described browser according to this broadcasting speed adjusted value as deceleration multiple, the timestamp of all described frame of video of not playing, all divided by this deceleration multiple, is generated to the video frame time stamp after slowing down;
When described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being greater than 1 value, described browser according to this broadcasting speed adjusted value as accelerating multiple, the timestamp of all described frame of video of not playing is all accelerated to multiple divided by this, generate the video frame time stamp after accelerating.
Preferably, described audio frame unit, is further used for:
When the playing duration of playing duration corresponding to described audio frame and the frame of video of determining according to the video frame time stamp after slowing down is inconsistent, according to described deceleration multiple, copy described audio sample, accumulative total playing duration corresponding to all described audio sample is extended for consistent with the playing duration of described frame of video.
Preferably, described audio frame unit, is further used for:
When the playing duration of playing duration corresponding to described audio frame and the frame of video of determining according to the video frame time stamp after accelerating is inconsistent, according to described acceleration multiple, delete described audio sample, accumulative total playing duration corresponding to all described audio sample shortened to consistent with the playing duration of described frame of video.
Preferably, according to described deceleration multiple, copy described audio sample, be further: the quantity of the described audio sample before copying, divided by described deceleration multiple, is obtained to the quantity of the described audio sample after copying;
According to described acceleration multiple, delete described audio sample, be further: the quantity of the described audio sample before deleting is multiplied by described acceleration multiple, obtains the quantity of the described audio sample after deleting.
Compared with prior art, the method and system that a kind of video playout speed that is applied to flash described in the application is adjusted, have reached following effect:
1) the application adjusts according to the adjusted value of broadcasting speed for frame of video and audio frame respectively, the timestamp of frame of video is modified, according to the timestamp of amended frame of video, the audio sample of dividing is copied or deleted again, guaranteed the correspondence of audio frequency and video, can not have influence on the broadcasting of video file, efficiently solve while watching video online the problem that flash acquiring unit in browser can not be adjusted video playout speed.
2) the application can maintain the details characteristic of image and sound when video file speed change is play, the viewing effect that provides user's fast browsing and emphasis to play.
Certainly, arbitrary product of enforcement the application must not necessarily need to reach above-described all technique effects simultaneously.
 
Accompanying drawing explanation
Accompanying drawing described herein is used to provide further understanding of the present application, forms the application's a part, and the application's schematic description and description is used for explaining the application, does not form the improper restriction to the application.In the accompanying drawings:
Fig. 1 is the flow chart of the method for the video playout speed adjustment that is applied to flash described in the embodiment of the present application one;
Fig. 2 is the flow chart of the method for the video playout speed adjustment that is applied to flash described in the embodiment of the present application two;
Fig. 3 is the structured flowchart of the system of the video playout speed adjustment that is applied to flash described in the embodiment of the present application four.
 
Embodiment
As used some vocabulary in the middle of specification and claim, censure specific components.Those skilled in the art should understand, and hardware manufacturer may be called same assembly with different nouns.This specification and claims are not used as distinguishing the mode of assembly with the difference of title, but the difference in function is used as the criterion of distinguishing with assembly.If " comprising " mentioned in the middle of specification and claim is in the whole text an open language, therefore should be construed to " comprise but be not limited to "." roughly " refer to that in receivable error range, those skilled in the art can solve the technical problem within the scope of certain error, reach described technique effect substantially.In addition, " couple " word and comprise directly any and electric property coupling means indirectly at this.Therefore, if describe a first device in literary composition, be coupled to one second device, represent that described first device can directly be electrically coupled to described the second device, or be indirectly electrically coupled to described the second device by other devices or the means that couple.Specification subsequent descriptions is for implementing the application's better embodiment, and right described description is to illustrate that the application's rule is object, not in order to limit the application's scope.The application's protection range is when being as the criterion depending on the claims person of defining.
 
As shown in Figure 1, the method flow diagram of the method for adjusting for the video playout speed that is applied to flash described in the application one embodiment, comprising:
Step 101, browser obtains frame of video and the audio frame in video file data flow, and obtains the timestamp of described frame of video; Wherein, described timestamp is the label of the play time of preset described frame of video.
In step 101, when user watches video by described browser in corresponding video website, video file is transferred in the client of user's use from corresponding video server, video file is not whole video file overall coordination transmission in transmitting procedure, but video file is formed to data sequence according to a definite sequence, the form of data flow is transmitted.For video file, by the frame of video of representative image picture and the audio frame of representative voice, formed, so, when described video file transmission, in formed data flow, can get described frame of video and audio frame.
For described frame of video, in its frame data, include the timestamp being set in advance by described video server, represent time point when this frame of video will be play, so when video playback, all described frame of video are successively play according to the time sequencing of its timestamp, have formed coherent video.In the present embodiment, described frame of video and described audio frame possess corresponding relation, and this corresponding relation arranges when described video file generates, and described in each, audio frame, corresponding to a frame of video, has represented sound corresponding to this image frame.Certainly, the corresponded manner of described frame of video and audio frame can also be that corresponding timestamp is set in described audio frame, by timestamp, set up the corresponding relation of described frame of video and audio frame, this is in the present embodiment, a kind of mode of described frame of video and audio frame corresponding relation, can also adopt other modes, not form the restriction to the application.
Step 102, described browser is according to the adjustment indication information obtaining, identify corresponding broadcasting speed adjusted value, using described broadcasting speed adjusted value as the timestamp that accelerates multiple or deceleration multiple and revise the described frame of video of not playing, generates and utilize the timestamp of the described frame of video after adjustment to determine the playing duration of described frame of video.
In step 102, described adjustment indication information is specifically as follows and accelerates broadcasting indication information and slow down to play indication information, and when described adjustment indication information is play indication information for acceleration, corresponding described broadcasting speed adjusted value is greater than 1; When described adjustment indication information is play indication information for slowing down, corresponding described broadcasting speed adjusted value is less than 1.Generally, it is 2,4,8 and 16 that described broadcasting speed adjusted value corresponding to indication information play in described acceleration, represent to accelerate to play with the broadcasting speed of 2 times, 4 times, 8 times and 16 times, certainly, in actual applications, the multiple that accelerates to play is generally no more than 2 times, otherwise, there will be serious frame losing phenomenon; Equally, described broadcasting speed adjusted value corresponding to indication information play in described deceleration can use negative or decimal, represents that in actual applications, the multiple of deceleration broadcasting is generally also no more than 2 times with broadcastings of slowing down of corresponding multiple.
For step 102, the timestamp of described frame of video changes according to described broadcasting speed adjusted value, just means that the playing duration of described video changes according to described broadcasting speed adjusted value.As: when as described in the timestamp of frame of video while becoming original 2 times, the duration of this video has also become original 2 times, described video has carried out slowing down and has play, so increased the duration of video.
Step 103, described browser is divided into many group audio sample according to the preset time interval by all audio frames of not playing, according to the playing duration of described frame of video, described audio sample is deleted or replication processes, accumulative total playing duration corresponding to described audio sample is adjusted into consistent with the playing duration of described frame of video.
In step 103, the described preset time interval can be arranged by described browser, as: using 40ms(millisecond) as described in the preset time interval, described audio sample carries out the increase of quantity or the change of minimizing according to the playing duration of video corresponding to described frame of video.
It should be noted that, because described audio sample is to divide according to the time interval, so the quantity of described audio sample just reflects the playing duration that described audio frame is corresponding, be about to all described audio sample cumulative after, just can obtain the accumulative total duration of described audio frame.
Step 104, by the described audio sample after described adjustment and described frame of video, sets up association with the time sequencing that the timestamp of this frame of video after adjusting is corresponding, carries out described audio/video coding.
 
As shown in Figure 2, the method flow diagram of the method for adjusting for the video playout speed that is applied to flash described in the embodiment of the present application two, comprising:
Step 201, browser obtains frame of video and the audio frame in video file data flow, and obtains the timestamp of described frame of video.
The corresponding form of described audio frame includes but not limited to clear stereo, Dolby Surround, Dolby Digital 5.1, Dolby Digital EX, DTS(Digital Theatre System, digitlization cinema system) digital rings is expanded surround sound around, DTS ES() 6.1 or MPEG(Moving Pictures Experts Group/Motion Pictures Experts Group, dynamic image expert group) multi-channel audio etc.
Step 202, described browser receives user's adjustment indication information, when described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being less than 1 value, described browser according to this broadcasting speed adjusted value as deceleration multiple, the timestamp of all described frame of video of not playing, all divided by this deceleration multiple, is generated to the video frame time stamp after slowing down; When described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being greater than 1 value, described browser according to this broadcasting speed adjusted value as accelerating multiple, the timestamp of all described frame of video of not playing is all accelerated to multiple divided by this, generate the video frame time stamp after accelerating, according to the video frame time stamp after adjusting, determine the playing duration of frame of video.
Step 203, described browser is divided into many group audio sample according to the preset time interval by all audio frames of not playing, and the playing duration of the frame of video of determining according to the video frame time stamp after adjusting deletes or replication processes described audio sample, accumulative total playing duration corresponding to all described audio sample is adjusted into consistent with the playing duration of described frame of video.
In step 203, the described preset time interval can be 10ms(millisecond), 40ms, 60ms, 1s(second) etc. the multiple time interval, certainly, due to the audio frame that contains enormous amount in high-quality audio frequency, so as preferably, the described preset time interval is no more than 100ms, take 40ms as best.
It should be noted that, no matter acceleration is play or slowed down is play, the timestamp of the described frame of video after adjusting can reflect the playing duration of video, for example: a certain duration of not playing is in the video of 10 minutes, the timestamp of last frame of video is 0:10:00, represent that this frame of video will play in the time of the 10th minute, if (multiple that slows down is 0.5) play in the deceleration of now carrying out 2 times, the timestamp of described frame of video is that 0:10:00 will be divided by 0.5, the timestamp of playing this frame of video after adjusting through slowing down becomes 0:20:00, so, this video is lengthened to 20 minutes.That is to say, according to the described timestamp of described frame of video, just can determine its playing duration.
So, while playing when slowing down, for step 203, the playing duration of the frame of video of determining according to the video frame time stamp after adjusting is deleted or replication processes described audio sample, accumulative total playing duration corresponding to all described audio sample is adjusted into consistent with the playing duration of described frame of video, be specially: when the playing duration of playing duration corresponding to described audio frame and the frame of video of determining according to the video frame time stamp after slowing down is inconsistent, according to described deceleration multiple, copy described audio sample, accumulative total playing duration corresponding to all described audio sample is extended for consistent with the playing duration of described frame of video.
When accelerating to play, for step 203, the playing duration of the frame of video of determining according to the video frame time stamp after adjusting is deleted or replication processes described audio sample, accumulative total playing duration corresponding to all described audio sample is adjusted into consistent with the playing duration of described frame of video, be specially: when the playing duration of playing duration corresponding to described audio frame and the frame of video of determining according to the video frame time stamp after accelerating is inconsistent, according to described acceleration multiple, delete described audio sample, accumulative total playing duration corresponding to all described audio sample shortened to consistent with the playing duration of described frame of video.
Step 204, by the described audio sample after described adjustment and described frame of video, sets up association with the time sequencing that the timestamp of this frame of video after adjusting is corresponding, carries out exporting after described audio/video coding.
 
Embodiment tri-
Aforesaid operations how to realize the application is described with next application example.
Set: video A is that duration is 10 minutes videos, and the quantity of its frame of video is 12W frame, do not considering under the impact of network bandwidth condition, video A can be downloaded buffer memory fast to the client of user's use.
Step 1, user watches video A by the flash player in browser, and now, described browser obtains frame of video and the audio frame in the video file data flow of transmitting from video website, and obtains the timestamp of described frame of video.
Step 2, user is when watching, in order not hear the statement in video A, user selects to slow down broadcasting, the deceleration that user can carry out video by respective selection in this flash player of mouse control is play, now, browser receives the deceleration broadcasting indication information that user sends, and identify corresponding broadcasting speed adjusted value, this adjusted value is 0.5, the deceleration that expression is carried out video A with 0.5 times of speed is play, described browser is according to this broadcasting speed adjusted value 0.5, by the timestamp of all described frame of video of not playing all divided by 0.5, the timestamp that is described frame of video is that 0:10:00 will be divided by 0.5, the timestamp of playing the frame of video after adjusting through slowing down becomes 0:20:00, so, video A has just been lengthened to 20 minutes.That is to say, slowing down to play just means that the whole reproduction time of video A will extend.
Step 3, now, frame of video has been adjusted complete, described browser is adjusted audio frame, browser is according to preset time interval 1s, all audio frames of not playing are divided into many group audio sample, have 600 groups, before not adjusting, the accumulative total duration that these 600 groups of audio sample are corresponding is 10 minutes, and the playing duration of the frame of video that browser is determined according to the video frame time stamp after adjusting is 20 minutes, that is to say, for the video duration after adjusting, audio sample is less, so, browser will carry out replication processes to described audio sample, 600 groups of quantity that are about to audio sample are broadcasting speed adjusted value divided by 0.5(), obtain 1200 groups of audio sample (each audio sample copies once), and the cumulative time of these 1200 groups of audio sample is 20 minutes, so that can be corresponding with the playing duration of video A.
Step 4, by the described audio sample after described adjustment and described frame of video, sets up association with the time sequencing that the timestamp of this frame of video after adjusting is corresponding, carries out exporting after described audio/video coding.
 
Embodiment tetra-
As shown in Figure 3, the system for the video playout speed that is applied to flash described in the embodiment of the present application four is adjusted, couples mutually with browser, comprising: acquiring unit 401, frame of video unit 402, audio frame unit 403 and output unit 404; Wherein,
Described acquiring unit 401, couples mutually with described frame of video unit 402, for obtaining frame of video and the audio frame of video file data flow, and obtains the timestamp of described frame of video; Wherein, described timestamp is the label of the play time of preset described frame of video.
Described frame of video unit 402, couple mutually with described acquiring unit 401, audio frame unit 403 and output unit 404, be used for according to the user's of described browser reception adjustment indication information, identify the broadcasting speed adjusted value that this adjustment indication information is corresponding, according to described broadcasting speed adjusted value, as accelerating multiple or deceleration multiple, revise the not timestamp of the described frame of video of broadcasting, generate the video frame time stamp after adjusting, according to the video frame time stamp after adjusting, determine the playing duration of frame of video.
Described audio frame unit 403, couple mutually with described acquiring unit 401, frame of video unit 402 and output unit 404, for all audio frames of not playing being divided into many group audio sample according to the preset time interval, and the playing duration of the frame of video of determining according to the video frame time stamp after adjusting deletes or replication processes described audio sample, accumulative total playing duration corresponding to all described audio sample is adjusted into consistent with the playing duration of described frame of video.
Described output unit 404, couple mutually with described audio frame unit 403 and frame of video unit 402, for by the described audio sample after described adjustment and described frame of video, with the time sequencing that the timestamp of this frame of video after adjusting is corresponding, set up association, carry out described audio/video coding.
Described frame of video unit 402, specifically for:
When described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being less than 1 value, described browser according to this broadcasting speed adjusted value as deceleration multiple, the timestamp of all described frame of video of not playing, all divided by this deceleration multiple, is generated to the video frame time stamp after slowing down;
When described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being greater than 1 value, described browser according to this broadcasting speed adjusted value as accelerating multiple, the timestamp of all described frame of video of not playing is all accelerated to multiple divided by this, generate the video frame time stamp after accelerating.
Wherein, for described frame of video, in its frame data, include the timestamp being set in advance by described video server, represent time point when this frame of video will be play, so when video playback, all described frame of video are successively play according to the time sequencing of its timestamp, have formed coherent video.In the present embodiment, described frame of video and described audio frame possess corresponding relation, and this corresponding relation arranges when described video file generates, and described in each, audio frame, corresponding to a frame of video, has represented sound corresponding to this image frame.Certainly, the corresponded manner of described frame of video and audio frame can also be that corresponding timestamp is set in described audio frame, by timestamp, set up the corresponding relation of described frame of video and audio frame, this is in the present embodiment, a kind of mode of described frame of video and audio frame corresponding relation, can also adopt other modes, not form the restriction to the application.
For described audio frame, its corresponding form includes but not limited to clear stereo, Dolby Surround, Dolby Digital 5.1, Dolby Digital EX, DTS(Digital Theatre System, digitlization cinema system) digital rings is expanded surround sound around, DTS ES() 6.1 or MPEG(Moving Pictures Experts Group/Motion Pictures Experts Group, dynamic image expert group) multi-channel audio etc.
It should be noted that, no matter acceleration is play or slowed down is play, the timestamp of the described frame of video after adjusting can reflect the playing duration of video, for example: a certain duration of not playing is in the video of 10 minutes, the timestamp of last frame of video is 0:10:00, represent that this frame of video will play in the time of the 10th minute, if (multiple that slows down is 0.5) play in the deceleration of now carrying out 2 times, the timestamp of described frame of video is that 0:10:00 will be divided by 0.5, the timestamp of playing this frame of video after adjusting through slowing down becomes 0:20:00, so, this video is lengthened to 20 minutes.That is to say, according to the described timestamp of described frame of video, just can determine its playing duration.
So, while playing when slowing down, described audio frame unit 403, when inconsistent with the playing duration of stabbing the frame of video of determining according to the video frame time after slowing down specifically for playing duration corresponding to described audio frame, according to described deceleration multiple, copy described audio sample, accumulative total playing duration corresponding to all described audio sample is extended for consistent with the playing duration of described frame of video.
When accelerating to play, described audio frame unit 403, when inconsistent with the playing duration of stabbing the frame of video of determining according to the video frame time after accelerating specifically for playing duration corresponding to described audio frame, according to described acceleration multiple, delete described audio sample, accumulative total playing duration corresponding to all described audio sample shortened to consistent with the playing duration of described frame of video.
 
Because method part have been described in detail the embodiment of the present application, here the expansion of the method and system corresponding part relating in embodiment is described and omitted, repeat no more.Description for particular content in system can, with reference to the content of described embodiment of the method, no longer specifically limit here.
 
Compared with prior art, the method and system that a kind of video playout speed that is applied to flash described in the application is adjusted, have reached following effect:
1) the application adjusts according to the adjusted value of broadcasting speed for frame of video and audio frame respectively, the timestamp of frame of video is modified, according to the timestamp of amended frame of video, the audio sample of dividing is copied or deleted again, guaranteed the correspondence of audio frequency and video, can not have influence on the broadcasting of video file, efficiently solve while watching video online the problem that flash acquiring unit in browser can not be adjusted video playout speed.
2) the application can maintain the details characteristic of image and sound when video file speed change is play, the viewing effect that provides user's fast browsing and emphasis to play.
Those skilled in the art should understand, the application's embodiment can be provided as method, device or computer program.Therefore, the application can adopt complete hardware implementation example, implement software example or in conjunction with the form of the embodiment of software and hardware aspect completely.And the application can adopt the form that wherein includes the upper computer program of implementing of computer-usable storage medium (including but not limited to magnetic disc store, CD-ROM, optical memory etc.) of computer usable program code one or more.
Above-mentioned explanation has illustrated and has described some preferred embodiments of the application, but as previously mentioned, be to be understood that the application is not limited to disclosed form herein, should not regard the eliminating to other embodiment as, and can be used for various other combinations, modification and environment, and can, in invention contemplated scope described herein, by technology or the knowledge of above-mentioned instruction or association area, change.And the spirit and scope that the change that those skilled in the art carry out and variation do not depart from the application, all should be in the protection range of the application's claims.

Claims (10)

1. a method that is applied to the video playout speed adjustment of flash, is characterized in that, comprising:
Browser obtains frame of video and the audio frame in video file data flow, and obtains the timestamp of described frame of video; Wherein, described timestamp is the label of the play time of preset described frame of video;
Described browser is according to the adjustment indication information obtaining, identify corresponding broadcasting speed adjusted value, using described broadcasting speed adjusted value as the timestamp that accelerates multiple or deceleration multiple and revise the described frame of video of not playing, generates and utilize the timestamp of the described frame of video after adjustment to determine the playing duration of described frame of video;
Described browser is divided into many group audio sample according to the preset time interval by all audio frames of not playing, according to the playing duration of described frame of video, described audio sample is deleted or replication processes, accumulative total playing duration corresponding to described audio sample is adjusted into consistent with the playing duration of described frame of video;
By the described audio sample after described adjustment and described frame of video, with the time sequencing that the timestamp of this frame of video after adjusting is corresponding, set up association, carry out described audio/video coding.
2. the method that the video playout speed that is applied to flash as claimed in claim 1 is adjusted, it is characterized in that, identify corresponding broadcasting speed adjusted value, the described broadcasting speed adjusted value of usining is revised the not timestamp of the described frame of video of broadcasting as accelerating multiple or deceleration multiple, is further:
When described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being less than 1 value, described browser according to this broadcasting speed adjusted value as deceleration multiple, the timestamp of all described frame of video of not playing, all divided by this deceleration multiple, is generated to the video frame time stamp after slowing down;
When described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being greater than 1 value, described browser according to this broadcasting speed adjusted value as accelerating multiple, the timestamp of all described frame of video of not playing is all accelerated to multiple divided by this, generate the video frame time stamp after accelerating.
3. the method that the video playout speed that is applied to flash as claimed in claim 2 is adjusted, it is characterized in that, according to the playing duration of described frame of video, described audio sample is deleted or replication processes, accumulative total playing duration corresponding to described audio sample is adjusted into consistent with the playing duration of described frame of video, is further:
When the playing duration of playing duration corresponding to described audio frame and the frame of video of determining according to the video frame time stamp after slowing down is inconsistent, according to described deceleration multiple, copy described audio sample, accumulative total playing duration corresponding to all described audio sample is extended for consistent with the playing duration of described frame of video.
4. the method that the video playout speed that is applied to flash as claimed in claim 2 is adjusted, it is characterized in that, according to the playing duration of described frame of video, described audio sample is deleted or replication processes, accumulative total playing duration corresponding to described audio sample is adjusted into consistent with the playing duration of described frame of video, is further:
When the playing duration of playing duration corresponding to described audio frame and the frame of video of determining according to the video frame time stamp after accelerating is inconsistent, according to described acceleration multiple, delete described audio sample, accumulative total playing duration corresponding to all described audio sample shortened to consistent with the playing duration of described frame of video.
5. the method for adjusting as the video playout speed that is applied to flash as described in arbitrary in claim 3 or 4, is characterized in that,
According to described deceleration multiple, copy described audio sample, be further: the quantity of the described audio sample before copying, divided by described deceleration multiple, is obtained to the quantity of the described audio sample after copying;
According to described acceleration multiple, delete described audio sample, be further: the quantity of the described audio sample before deleting is multiplied by described acceleration multiple, obtains the quantity of the described audio sample after deleting.
6. a system that is applied to the video playout speed adjustment of flash, couples mutually with browser, it is characterized in that, comprising: acquiring unit, frame of video unit, audio frame unit and output unit, wherein,
Described acquiring unit, for obtaining frame of video and the audio frame of video file data flow, and obtains the timestamp of described frame of video; Wherein, described timestamp is the label of the play time of preset described frame of video;
Described frame of video unit, for the adjustment indication information obtaining according to described browser, identify corresponding broadcasting speed adjusted value, using described broadcasting speed adjusted value as the timestamp that accelerates multiple or deceleration multiple and revise the described frame of video of not playing, generates and utilize the timestamp of the described frame of video after adjustment to determine the playing duration of described frame of video;
Described audio frame unit, for all audio frames of not playing being divided into many group audio sample according to the preset time interval, according to the playing duration of described frame of video, described audio sample is deleted or replication processes, accumulative total playing duration corresponding to described audio sample is adjusted into consistent with the playing duration of described frame of video;
Described output unit, for by the described audio sample after described adjustment and described frame of video, sets up association with the time sequencing that the timestamp of this frame of video after adjusting is corresponding, carries out described audio/video coding.
7. the system that the video playout speed that is applied to flash as claimed in claim 6 is adjusted, is characterized in that, described frame of video unit, is further used for:
When described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being less than 1 value, described browser according to this broadcasting speed adjusted value as deceleration multiple, the timestamp of all described frame of video of not playing, all divided by this deceleration multiple, is generated to the video frame time stamp after slowing down;
When described browser identifies the broadcasting speed adjusted value that described adjustment indication information is corresponding, be while being greater than 1 value, described browser according to this broadcasting speed adjusted value as accelerating multiple, the timestamp of all described frame of video of not playing is all accelerated to multiple divided by this, generate the video frame time stamp after accelerating.
8. the system that the video playout speed that is applied to flash as claimed in claim 7 is adjusted, is characterized in that, described audio frame unit, is further used for:
When the playing duration of playing duration corresponding to described audio frame and the frame of video of determining according to the video frame time stamp after slowing down is inconsistent, according to described deceleration multiple, copy described audio sample, accumulative total playing duration corresponding to all described audio sample is extended for consistent with the playing duration of described frame of video.
9. the system that the video playout speed that is applied to flash as claimed in claim 7 is adjusted, is characterized in that, described audio frame unit, is further used for:
When the playing duration of playing duration corresponding to described audio frame and the frame of video of determining according to the video frame time stamp after accelerating is inconsistent, according to described acceleration multiple, delete described audio sample, accumulative total playing duration corresponding to all described audio sample shortened to consistent with the playing duration of described frame of video.
10. the system of adjusting as the video playout speed that is applied to flash as described in arbitrary in claim 8 or 9, is characterized in that,
According to described deceleration multiple, copy described audio sample, be further: the quantity of the described audio sample before copying, divided by described deceleration multiple, is obtained to the quantity of the described audio sample after copying;
According to described acceleration multiple, delete described audio sample, be further: the quantity of the described audio sample before deleting is multiplied by described acceleration multiple, obtains the quantity of the described audio sample after deleting.
CN201410013756.XA 2014-01-13 2014-01-13 Be applied to the method and system of the video playout speed adjustment of flash Expired - Fee Related CN103747287B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410013756.XA CN103747287B (en) 2014-01-13 2014-01-13 Be applied to the method and system of the video playout speed adjustment of flash

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410013756.XA CN103747287B (en) 2014-01-13 2014-01-13 Be applied to the method and system of the video playout speed adjustment of flash

Publications (2)

Publication Number Publication Date
CN103747287A true CN103747287A (en) 2014-04-23
CN103747287B CN103747287B (en) 2015-09-23

Family

ID=50504269

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410013756.XA Expired - Fee Related CN103747287B (en) 2014-01-13 2014-01-13 Be applied to the method and system of the video playout speed adjustment of flash

Country Status (1)

Country Link
CN (1) CN103747287B (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104918064A (en) * 2015-05-27 2015-09-16 努比亚技术有限公司 Rapid video play method and device of mobile terminal
CN106713941A (en) * 2017-01-04 2017-05-24 北京百度网讯科技有限公司 Audio and video live broadcast implementation method and server
CN106791994A (en) * 2016-12-30 2017-05-31 北京奇艺世纪科技有限公司 A kind of low delay quickly starts broadcasting method and device
CN106851337A (en) * 2017-02-21 2017-06-13 聚好看科技股份有限公司 Video buffer control method and device
CN106998485A (en) * 2016-01-25 2017-08-01 百度在线网络技术(北京)有限公司 Net cast method and device
CN107122001A (en) * 2017-03-31 2017-09-01 武汉斗鱼网络科技有限公司 A kind of application program method and device synchronous with server time
CN107566918A (en) * 2017-09-21 2018-01-09 中国电子科技集团公司第二十八研究所 A kind of low delay under video distribution scene takes the neutrel extraction of root
CN107690073A (en) * 2016-08-05 2018-02-13 阿里巴巴集团控股有限公司 A kind of net cast method and Living streaming server
CN109328384A (en) * 2016-05-24 2019-02-12 帝威视有限公司 For providing the system and method for variable velocity in trickplay modes
CN110534085A (en) * 2019-08-29 2019-12-03 北京百度网讯科技有限公司 Method and apparatus for generating information
CN110704015A (en) * 2019-09-29 2020-01-17 珠海格力电器股份有限公司 Speed regulation method for audio playing, storage medium and electronic equipment
CN111787268A (en) * 2020-07-01 2020-10-16 广州视源电子科技股份有限公司 Audio signal processing method and device, electronic equipment and storage medium
CN112507147A (en) * 2020-11-30 2021-03-16 广州酷狗计算机科技有限公司 Text data display method, device, equipment and storage medium
CN112738607A (en) * 2020-12-29 2021-04-30 广州酷狗计算机科技有限公司 Playing method, device, equipment and storage medium
CN113382212A (en) * 2021-08-13 2021-09-10 深圳市有为信息技术发展有限公司 Method and device for playing real-time audio and video stream and electronic equipment
CN113572954A (en) * 2021-06-15 2021-10-29 荣耀终端有限公司 Video recording method, electronic device, medium, and program product
CN114630193A (en) * 2022-03-29 2022-06-14 湖南大众传媒职业技术学院 Method and system for optimizing picture in short video

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1396742A (en) * 2002-08-02 2003-02-12 清华大学 Speed-variable playing method based on stream medium technique for player
US20040267952A1 (en) * 2003-06-24 2004-12-30 He Li-Wei Variable play speed control for media streams
CN101075949A (en) * 2006-05-15 2007-11-21 中兴通讯股份有限公司 Method for changing fluid-medium file broadcasting speed
CN101996662A (en) * 2010-10-22 2011-03-30 深圳市万兴软件有限公司 Method and device for connecting and outputting video files
CN102404650A (en) * 2011-11-30 2012-04-04 江苏奇异点网络有限公司 Method for synchronously controlling audio and video of online video

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1396742A (en) * 2002-08-02 2003-02-12 清华大学 Speed-variable playing method based on stream medium technique for player
US20040267952A1 (en) * 2003-06-24 2004-12-30 He Li-Wei Variable play speed control for media streams
CN101075949A (en) * 2006-05-15 2007-11-21 中兴通讯股份有限公司 Method for changing fluid-medium file broadcasting speed
CN101996662A (en) * 2010-10-22 2011-03-30 深圳市万兴软件有限公司 Method and device for connecting and outputting video files
CN102404650A (en) * 2011-11-30 2012-04-04 江苏奇异点网络有限公司 Method for synchronously controlling audio and video of online video

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104918064A (en) * 2015-05-27 2015-09-16 努比亚技术有限公司 Rapid video play method and device of mobile terminal
CN104918064B (en) * 2015-05-27 2019-07-05 努比亚技术有限公司 A kind of method and device that mobile terminal video quickly plays
CN106998485A (en) * 2016-01-25 2017-08-01 百度在线网络技术(北京)有限公司 Net cast method and device
CN106998485B (en) * 2016-01-25 2020-03-06 百度在线网络技术(北京)有限公司 Video live broadcasting method and device
CN109328384A (en) * 2016-05-24 2019-02-12 帝威视有限公司 For providing the system and method for variable velocity in trickplay modes
US11895348B2 (en) 2016-05-24 2024-02-06 Divx, Llc Systems and methods for providing variable speeds in a trick-play mode
CN107690073A (en) * 2016-08-05 2018-02-13 阿里巴巴集团控股有限公司 A kind of net cast method and Living streaming server
CN106791994A (en) * 2016-12-30 2017-05-31 北京奇艺世纪科技有限公司 A kind of low delay quickly starts broadcasting method and device
CN106791994B (en) * 2016-12-30 2020-11-24 北京奇艺世纪科技有限公司 Low-delay quick broadcasting method and device
CN106713941A (en) * 2017-01-04 2017-05-24 北京百度网讯科技有限公司 Audio and video live broadcast implementation method and server
CN106851337A (en) * 2017-02-21 2017-06-13 聚好看科技股份有限公司 Video buffer control method and device
CN106851337B (en) * 2017-02-21 2019-12-24 聚好看科技股份有限公司 Video buffering control method and device
CN107122001B (en) * 2017-03-31 2019-06-04 武汉斗鱼网络科技有限公司 A kind of method and device that application program is synchronous with server time
CN107122001A (en) * 2017-03-31 2017-09-01 武汉斗鱼网络科技有限公司 A kind of application program method and device synchronous with server time
CN107566918B (en) * 2017-09-21 2019-08-13 中国电子科技集团公司第二十八研究所 A kind of low delay under video distribution scene takes the neutrel extraction of root
CN107566918A (en) * 2017-09-21 2018-01-09 中国电子科技集团公司第二十八研究所 A kind of low delay under video distribution scene takes the neutrel extraction of root
CN110534085A (en) * 2019-08-29 2019-12-03 北京百度网讯科技有限公司 Method and apparatus for generating information
CN110534085B (en) * 2019-08-29 2022-02-25 北京百度网讯科技有限公司 Method and apparatus for generating information
CN110704015A (en) * 2019-09-29 2020-01-17 珠海格力电器股份有限公司 Speed regulation method for audio playing, storage medium and electronic equipment
CN110704015B (en) * 2019-09-29 2020-10-02 珠海格力电器股份有限公司 Speed regulation method for audio playing, storage medium and electronic equipment
CN111787268A (en) * 2020-07-01 2020-10-16 广州视源电子科技股份有限公司 Audio signal processing method and device, electronic equipment and storage medium
CN111787268B (en) * 2020-07-01 2022-04-22 广州视源电子科技股份有限公司 Audio signal processing method and device, electronic equipment and storage medium
CN112507147A (en) * 2020-11-30 2021-03-16 广州酷狗计算机科技有限公司 Text data display method, device, equipment and storage medium
CN112738607A (en) * 2020-12-29 2021-04-30 广州酷狗计算机科技有限公司 Playing method, device, equipment and storage medium
CN113572954A (en) * 2021-06-15 2021-10-29 荣耀终端有限公司 Video recording method, electronic device, medium, and program product
CN113382212A (en) * 2021-08-13 2021-09-10 深圳市有为信息技术发展有限公司 Method and device for playing real-time audio and video stream and electronic equipment
CN113382212B (en) * 2021-08-13 2021-11-16 深圳市有为信息技术发展有限公司 Method and device for playing real-time audio and video stream and electronic equipment
CN114630193A (en) * 2022-03-29 2022-06-14 湖南大众传媒职业技术学院 Method and system for optimizing picture in short video

Also Published As

Publication number Publication date
CN103747287B (en) 2015-09-23

Similar Documents

Publication Publication Date Title
CN103747287B (en) Be applied to the method and system of the video playout speed adjustment of flash
EP3170311B1 (en) Automatic detection of preferences for subtitles and dubbing
US9473548B1 (en) Latency reduction in streamed content consumption
JP2020102228A (en) Methods and systems for displaying contextually relevant information regarding media asset
EP3357253B1 (en) Gapless video looping
US9183753B2 (en) Variation and control of sensory work playback
EP3531707A1 (en) Audio content playback control
CN106789976A (en) The player method of media file, service end, client and system
CN104093084A (en) Method and apparatus for playing video
US11997062B2 (en) Methods, systems, and media for identifying and presenting video objects linked to a source video
CN104994429B (en) A kind of method and device playing video
KR102137327B1 (en) System for providing live thumbnail of streaming video
CN114245198B (en) Method and device for processing media content, electronic equipment and storage medium
JP7190589B2 (en) Pattern specification for session-based DASH behavior
CN112188256B (en) Information processing method, information providing device, electronic device, and storage medium
CN111869225B (en) Information processing apparatus, information processing method, and non-transitory computer readable storage medium
US11882326B2 (en) Computer system and method for broadcasting audiovisual compositions via a video platform
Bomcke et al. An interactive video streaming architecture for H. 264/AVC compliant players
US20230276105A1 (en) Information processing apparatus, information processing apparatus, and program
CN116965008A (en) Auxiliary MPD for MPEG DASH to support front, middle and end tiles with stacking features
CN116547960A (en) Method and apparatus for supporting MPEG DASH for pre-and mid-set content during media playback
Dubinsky SyncWords: A platform for semi-automated closed captioning and subtitles
Song et al. Web-based interactive media authoring system with multimodal interaction
KR20230086792A (en) Method and Apparatus for Supporting Pre-Roll and Mid-Roll During Media Streaming and Playback
JP2023520757A (en) Method and apparatus for dynamically adaptive streaming over HTTP

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: 100080 Beijing Haidian District city Haidian street A Sinosteel International Plaza No. 8 block 5 layer A, C

Patentee after: Youku network technology (Beijing) Co.,Ltd.

Address before: 100080 Beijing Haidian District city Haidian street A Sinosteel International Plaza No. 8 block 5 layer A, C

Patentee before: 1VERGE INTERNET TECHNOLOGY (BEIJING) Co.,Ltd.

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20200317

Address after: Room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province

Patentee after: Alibaba (China) Co.,Ltd.

Address before: 100080 Beijing Haidian District city Haidian street A Sinosteel International Plaza No. 8 block 5 layer A, C

Patentee before: Youku network technology (Beijing) Co.,Ltd.

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20210301

Address after: 100020 room 801, 8th floor, building 9, District 4, Wangjing East Garden, Chaoyang District, Beijing

Patentee after: Beijing Alibaba Music Technology Co.,Ltd.

Address before: Room 508, 5th floor, building 4, No.699 Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province, 310025

Patentee before: Alibaba (China) Co.,Ltd.

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150923

Termination date: 20220113