CN106982376B - A kind of time line control method that multimedia content personalization is presented - Google Patents

A kind of time line control method that multimedia content personalization is presented Download PDF

Info

Publication number
CN106982376B
CN106982376B CN201610031034.6A CN201610031034A CN106982376B CN 106982376 B CN106982376 B CN 106982376B CN 201610031034 A CN201610031034 A CN 201610031034A CN 106982376 B CN106982376 B CN 106982376B
Authority
CN
China
Prior art keywords
mpu
media
presented
time
presentation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610031034.6A
Other languages
Chinese (zh)
Other versions
CN106982376A (en
Inventor
徐异凌
张文军
朱文婕
陈浩
孙军
柳宁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiaotong University
Original Assignee
Shanghai Jiaotong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to CN201910549398.7A priority Critical patent/CN110225370B/en
Application filed by Shanghai Jiaotong University filed Critical Shanghai Jiaotong University
Priority to CN201610031034.6A priority patent/CN106982376B/en
Priority to PCT/CN2016/073167 priority patent/WO2016127862A1/en
Priority to KR1020177024204A priority patent/KR101988454B1/en
Priority to JP2017541331A priority patent/JP6567064B2/en
Priority to CA3004644A priority patent/CA3004644C/en
Priority to KR1020197003889A priority patent/KR102378107B1/en
Priority to US15/550,789 priority patent/US10433029B2/en
Publication of CN106982376A publication Critical patent/CN106982376A/en
Application granted granted Critical
Publication of CN106982376B publication Critical patent/CN106982376B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/23439Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2355Processing of additional data, e.g. scrambling of additional data or processing content descriptors involving reformatting operations of additional data, e.g. HTML pages
    • H04N21/2358Processing of additional data, e.g. scrambling of additional data or processing content descriptors involving reformatting operations of additional data, e.g. HTML pages for generating different versions, e.g. for different recipient devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84Generation or processing of descriptive data, e.g. content descriptors
    • H04N21/8402Generation or processing of descriptive data, e.g. content descriptors involving a version number, e.g. version number of EPG data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84Generation or processing of descriptive data, e.g. content descriptors
    • H04N21/8405Generation or processing of descriptive data, e.g. content descriptors represented by keywords
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8543Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8549Creating video summaries, e.g. movie trailer

Abstract

The present invention provides the time line control methods that a kind of multimedia content personalization is presented, the method is during multimedia resource is presented, utilize the Duration Information of media data units and the initial time of presentation, the presentation time of association content is controlled, so that the different associated versions of different media resource or same media resource have corresponding presentation timeline.The present invention can guarantee the smooth viewing experience of user while meeting users ' individualized requirement, using the relevance of same programs, on the basis of saving memory space.

Description

A kind of time line control method that multimedia content personalization is presented
Technical field
The present invention relates to one kind to transmit in internet (Internet), stores and multimedia framework is presented, specifically, It is related to a kind of time line control method that multimedia content personalization is presented.
Background technique
With the rapid development of digital media transport network, traditional broadcast television transmissions system has been unable to meet user day The demand that benefit increases.Existing broadband server has media resource abundant, by the novel heterogeneous network for combining broadband transmission Network, user can get the media resource of magnanimity.Existing multi-media protocol only focuses on the adaptation between data field network mostly, But for diversified media content, presentation mode still is limited to traditional video-see mode, not in view of media data The use environments such as attribute itself and viewing equipment, are unable to satisfy the individual demand of user.
Through retrieving, a kind of media timeline sorting of the patent disclosure: patent of invention CN200680013422.6 is realized one In, a kind of method includes that a media timeline is received in application programming interface, and wherein the media timeline includes multiple Time line object.The one or more of these time line objects quotes the one of corresponding of multiple media.Multiple segments are from the media It generates in timeline for sequential reproduction, so that reproduce during the segment durations one group of each segment reference is specific Time line object.Above-mentioned patent mainly for the timeline for switching broadcasting between different media resources, each media fragment without It is interrelated.
Although current multimedia system can realize the preliminary classification of content, be different user have different selection and Content Ad hoc mode, even for the various combination mode of same resource.It is higher in order to meet the individual demand of user The transmission media resource in media network of effect, realizes that the media content of different editions can be consistently presented, and needs corresponding Presentation timeline instruct the presentation of media content.Future Media transmission technology is quickly grown, and user can be by broadband networks, wide It broadcasts and nets the media data that different medium transmission systems obtains magnanimity.Content supplier and operator also more exist striving for providing Line media resource, while enriching traditional programme televised live.Whether demand (telecommunication) service or direct broadcast service require to meet user's Personalized presentation demand.In view of the development of the characteristic and heterogeneous network transmission of broadband networks and radio network, in different applications Different schemes can be used in scene and carry out presentation control.
Summary of the invention
For the defects in the prior art, the object of the present invention is to provide the times that a kind of multimedia content personalization is presented Line control method meets the individual demand of user.
In order to achieve the above object, the present invention provides a kind of time line control method that multimedia content personalization is presented, institute State method: multimedia resource present during, using media data units Duration Information and presentation it is initial when Between, the presentation time of association content is controlled, so that the different associations of different media resource or same media resource Version has corresponding presentation timeline.
Further, the method specific steps include:
S1: the media data units that the association contents version according to the media resource of user's selection is included, to each matchmaker Volume data unit obtains its corresponding Duration Information;
S2: in VoD according to user select media resource when time determine broadcast start time, in broadcast service by Service provider determines broadcast start time, and broadcast start time is identified in signaling information;
S3: according to broadcast start time and the corresponding media data units duration being associated in contents version in S2 The cumulative absolute presentation time for obtaining corresponding media data units, maintenance is corresponding accordingly is presented timeline to instruct media content Presentation.
Further, in S1, the association contents version refers to: being identified according to user demand to media resource, root Different associated version contents, corresponding different edit list are generated according to its edit id identified.
Further, the presentation timeline, refers to: the media data units that the media content chosen includes it is absolute The combination of temporal information is presented.
Preferably as one, using being marked in MPU timestamp descriptor, descriptor defined in MMT The time is absolutely presented in MPU corresponding label mpu_sequence_number and corresponding UTC in a media resource;When When the association contents version of one media resource of customer consumption, the associated version that server is requested according to user obtains the version In include media data units label and corresponding Duration Information, generate corresponding descriptor.
Preferably as one, MPU timestamp descriptor is defined, according to the association content of same media resource And its set of corresponding MPU defines edit list, assigns independent edit id to the association content of each version, Described in descriptor all MPU for including in each edit list mpu_sequence_number and corresponding presentation Temporal information;User selects the association content of a certain version, parses media data units therein according to corresponding edit_id MPU and corresponding absolute presentation time mpu_presentation_time, the timeline for generating corresponding version are presented to control.
Preferably as one, described in the signaling, and believed the duration of each MPU in some media resource by signaling At the beginning of learning the media resource in breath, the time is absolutely presented in the UTC that each MPU is calculated;In transmission media content During, according to the media content that user selects, its corresponding media data units MPU is selected, parses its duration letter Duration is ceased, while generating guidance and information, i.e. the label mpu_sequence_number of MPU and corresponding is presented Duration information.
The invention proposes the time line methods that multimedia content personalization is presented, since personalization is presented according to user's Demand carrys out the corresponding media data of tissue, for same media resource, program stream of the same data cell in each version In the presentation time be different.Therefore, in the service that personalization is presented, corresponding timeline controlling mechanism is necessary. The present invention can be suitable for including broadband networks, and the presentation of a variety of Transmission systems such as radio network or heterogeneous network controls.
Compared with prior art, the present invention have it is following the utility model has the advantages that
It, can be for the incomplete of mechanism be presented in existing multi-media protocol, sufficiently using technical solution of the present invention In view of the push-mechanism based on the presentation mechanism of user's decision and broadcast, real-time live broadcast service of order program service, and association The presentation service of content.For the association contents version of same media resource, when the presentation of each media data units therein Between be different from, by extract media data units duration, according to user selection version and playing process in not Biconditional operation, at the beginning of in signaling information on the basis of add up duration of media data units generate corresponding version The presentation timeline of media content;Or the absolute presentation time of media data units is generated while signaling generates, according to The selection of user generates corresponding presentation timeline information.
The present invention is empty saving storage using the relevance of same programs while meeting users ' individualized requirement Between on the basis of, guarantee the smooth viewing experience of user.Due to media presentation timeline information with signaling information neatly It sends, aiming at the problem that delay and packet loss occurred during consuming media resource causes user experience to reduce, if presenting Packet loss event is detected before time, may wait for the reacquisition of media resource, or repeats that previous media data list is presented The content of member guarantees user experience to prevent from playing Caton.Continue to present according to the instruction that timeline is presented, specific implementation It does not provide herein.
Detailed description of the invention
Upon reading the detailed description of non-limiting embodiments with reference to the following drawings, other feature of the invention, Objects and advantages will become more apparent upon:
Fig. 1 is that the VoD in multi-media transmission system services schematic diagram;
Fig. 2 is that schematic diagram is presented in the differentiation in the case of equipment low battery;
Fig. 3 is multi-angle of view real-time live broadcast schematic diagram;
Fig. 4 is the presentation timeline schematic diagram for being associated with the different editions of content;
Fig. 5 is the implementation flow chart of one embodiment of the invention.
Specific embodiment
The present invention is described in detail combined with specific embodiments below.Following embodiment will be helpful to the technology of this field Personnel further understand the present invention, but the invention is not limited in any way.It should be pointed out that the ordinary skill of this field For personnel, without departing from the inventive concept of the premise, various modifications and improvements can be made.These belong to the present invention Protection scope.
Server provides the user with relevance by the way that the mapping table of media content and media description is transferred to user The option of media content.User can request the different editions of identical content, or a certain media money of request according to their own needs A variety of appearance forms such as the association content in source.In order to save storage resource, differentiation transmission is realized, same set of media resource is not With including shared data cell in version.But existing system can not carry out the presentation time to the content of different editions Control, may cause media play and the segment of vacancy occurs, influence user experience.Each data are provided using existing system The Duration Information of unit, it is contemplated that the characteristic of different transmission networks, for example, VoD (Video on Demand) be according to Family selection section object time determines the initial presentation time of media resource, and broadcasting with real-time live broadcast is then in the defined time It is synchronous in each equipment to present, but there is still a need for the real-times considered the problems of in random access and real-time live broadcast.Therefore, this hair Different personalized presentation timeline controlling mechanisms is introduced in bright by taking the transmission network in the case of three kinds as an example.
Using one: VoD
VoD service in, after user has selected some multimedia content, server responds the demand, according to The version of family selection reads the duration of corresponding media data units, generates corresponding guidance and message file and signaling is presented Information.
By taking the classification of identical content is presented as an example, to Mr. Yu's movie program, it is assumed that it is asset1.First version video For scaled-down version film clips, duration 5 minutes, the inside only included the excellent picture in film;Second version video is shearing version, duration 30 minutes, the inside only included the important scene of photoplay plot;Third version video is full version, duration 120 minutes, inner Face includes complete plot;4th version is extended edition, and duration 150 minutes, the inside included removing complete plot Except expansion content, such as behind-the-scene footage, as shown in Figure 1.
Using two: broadcast program
In broadcast service, server transmits media data flow according to scheduled the rendition list.In view of user connects at random Enter problem, relevant information carousel will be presented in server needs.User can be in access according to the current presentation received Timeline starts to watch media content.Meanwhile switching viewing in real time according to indexs such as the state such as charge levels of viewing equipment Mode, provide more preferably user experience in the case where adapting to equipment state.
By taking the ball match program by broadcast transmission as an example, when user watches ball match on the mobile apparatus, equipment need to be considered Remaining capacity.When generating media data units, classified according to the importance of media data units, such as splendid moment and Goal etc. camera lens is the different association contents of the program, assigns different marks respectively, as shown in Figure 2.The electricity of user Situation is roughly divided into Full Charge Capacity, the grade of medium electricity and low battery.
When the remaining capacity of equipment reaches corresponding grade, then sending request accordingly, to server, server is cut automatically Change hair video media content and complete audio content, and the synchronization of the time line traffic control media content according to transmission.? In the case where translator unit video media content, the temporal information inside video data unit can not be parsed.Therefore, pass through parsing The relevant signaling of timeline obtains temporal information accordingly, realizes that the program for adapting to status of equipment is presented.
Using three: real-time live broadcast
In the service of real-time live broadcast, media data is conveyed directly to client after recording processing, therefore to real-time Requirement it is very high.In order to guarantee that the individual demand of the user in real-time live broadcast is also able to achieve, the association for media resource Content, which requires to quickly generate independent timeline, to be controlled.
For example, most of user also wishes to watch programme content (such as by the service of multi-angle of view when watching real-time live broadcast Shown in Fig. 3).Stablize real-time multi-angle of view service to save network bandwidth and provide, the content for servicing offer passes through broadcast Net is transferred to user, the simultaneous transmission media resource relevant content presentation timeline information.Due to each association content Total duration and comprising media data units the presentation time it is different, carried out so needing to generate the different timeline of more sets Control is presented.
Media resource is divided into the independent media units that can be solved by the present invention, using the incidence relation of media units, according to use The different video versions of family selection automatically generate corresponding presentation timeline.Therefore, presentation mechanism of the invention and existing skill Art is compared to more flexible.
Some embodiments of the invention are described in detail below.
User when watching media content, tend not to it is all interested in whole section of programme content, may only in program Some personage or some scene are interested.Smart media Transmission system can carry out the classification of different angle to media content, that is, beat Upper different label provides possibility for the individual demand of user.When personalization is presented, the association content packet of different editions Containing shared media data units, but presentation time of these data cells in each version is different, and therefore, it is necessary to be directed to Each version generates different presentation timelines to control and play.
In the above example, the MPU in each version (media processing units) media data units It is as shown in Figure 4 that the time is presented.Wherein, duri indicates the duration of i-th of MPU.As shown, in a media resource, The presentation time of identical MPU is different.Therefore, independent timeline is required to refer to the different associated versions of same media resource Lead presentation.
In order to guarantee the user experience in personalized service, to the difference of different media resource or same media resource The content of version provides corresponding presentation timeline, enables media content according in timeline one by one presentation user's selection Hold.The present invention is come by increasing new descriptor or increasing the signaling informations such as other tutorial messages such as message, table newly It realizes the transmission that timeline is presented, and is introduced by taking following three kinds of schemes as an example.
Scheme one:
Using MPU timestamp descriptor defined in MMT.MPU is marked in the descriptor at one The time is absolutely presented in corresponding label mpu_sequence_number and corresponding UTC in media resource;The descriptor's Syntactic structure is as shown in the table.
Descriptor_tag-defines the label of the descriptor type.
Descriptor_length-defines the length of the descriptor.
Mpu_sequence_number-lists the label for all MPU for including in corresponding media resource, N in order Indicate the number of MPU.
Mpu_presentation_time-lists all MPU that the corresponding media resource of the descriptor includes The time is absolutely presented in UTC.
During transmission media content, according to the media content that user selects, its corresponding media data list is selected First MPU parses its Duration Information duration.It is each to be associated with contents version institute if selecting the association content of media resource The MPU that includes has repetition, i.e., same MPU may have the different absolute presentation time in different association contents versions, then take Business device obtains the Duration Information of corresponding MPU according to the version that user selects.The media play time selected in conjunction with user Or media play time as defined in system is calculated each by the duration of all MPU before cumulative specified MPU Time, the mpu_presentation_time in as descriptor is absolutely presented in the corresponding UTC of MPU.
Some descriptive descriptor are defined in the signaling message of existing MMT protocol definition, such as Therefore dependency descriptor and MPU_timestamp_descriptor can define an offer media content With the corresponding descriptor that relevant temporal information is presented.There is asset_descriptors field in MP table, it can be with Correlation descriptor is added in asset_descriptors as needed.It, can should when using multimedia service Descriptor, which is added in asset_descriptors, realizes presentation.
But order program service is user-driven, needs to consider operation of the user in watching process, such as pause and fast Into etc..It in this case, can not be correctly if the time is absolutely presented in the UTC that server only provides corresponding each MPU Continue to play, needs server to regenerate and timeline information is presented is transmitted again, cause biggish computation burden and superfluous Surplus also will cause certain delay and influence user experience.Time, that is, mpu_ is absolutely presented using UTC in broadcast service Presentation_time is a kind of convenient and fast mode, because play time of the selected media content in direct broadcast service is Fixed.User receives a certain media resource and selects its association service, while receiving corresponding MPU_timestamp_ Descriptor, the temporal information that the media data units foundation of the content of each associated section describes in son are at a fixed time It is existing.
Scheme two:
Define MPU timestamp descriptor.According to the association content of same media resource and its corresponding MPU Set define edit list, assign independent edit id to the association content of each version.It is described in descriptor The mpu_sequence_number for all MPU for including in each edit list and corresponding presentation temporal information;It should The syntactic structure of descriptor is as shown in the table.
Descriptor_tag-defines the label of the descriptor type.
Descriptor_length-defines the length of the descriptor.
Edit_list_number-defines the association content of media resource, and N1 indicates its number.
Edit_id-defines the label of each version of the association content of media resource.
Mpu_sequence_number-lists the label for all MPU for including in corresponding media resource, N in order Indicate the number of MPU.
Mpu_presentation_time-lists all MPU that the corresponding media resource of the descriptor includes The time is absolutely presented in UTC.
During transmission media content, according to the media content that user selects, the institute of the media resource selected The UTC of relevant content is absolutely presented time mpu_presentation_time and writes in the descriptor (time acquisition Mode is referring to scheme one).During consuming media content, server sends above-mentioned descriptor to visitor with signaling information Family end.User selects the association content of a certain version, parses media data units therein according to its corresponding edit_id MPU and corresponding absolute presentation time mpu_presentation_time, the timeline for generating corresponding version are presented to control. The presentation time of the media content of each associated version, and personalized user can be more conveniently obtained by such method Demand instructs to present by identical descriptor information, is more convenient for controlling.
Scheme three:
Described in the signaling, and by CI (Composition the duration of each MPU in some media resource Information at the beginning of learning the media resource in), the time is absolutely presented in the UTC that each MPU can be calculated.
Descriptor_tag-defines the label of the descriptor type.
Descriptor_length-defines the length of the descriptor.
Mpu_sequence_number-lists the label for all MPU for including in corresponding media resource, N in order Indicate the number of MPU.
The UTC that mpu_duration-lists all MPU that the corresponding media resource of the descriptor includes is absolute The time is presented.
During transmission media content, according to the media content that user selects, its corresponding media data list is selected First MPU parses its Duration Information duration, while generating guidance and information, i.e. the label mpu_ of MPU is presented Sequence_number and corresponding duration information.
In view of a variety of different transmission network situations, such scheme can generate and packaged media data cell it is same When, its corresponding duration duration information is obtained, therefore real-time demand can be better meet, can met in real time The application demand of live streaming.Replaced by transmission duration information and the time is absolutely presented, enabled a client to more flexiblely Self-organizing media content.Meanwhile in the business of broadband program request, user can also be supported to carry out input operation at any time, meet user Individual demand.
Three of the above scheme can cover including multiple multi-media transmission systems such as broadband networks and radio network even heterogeneous network, We can also be by being presented policy paper CI or the other positions of transmission signaling information are added and corresponding the time are presented Personalized presentation service equally may be implemented in line.
During controlling presentation, since broadcast and real-time live broadcast service are since user's current turn-on time It plays.In order to save the storage resource of bandwidth resources and client and calculate consumption, only write in above-mentioned descriptor These two types of temporal informations (are referred to as correlation below by the presentation temporal information or duration information for entering the MPU not consumed also Temporal information), without the correlation time of the corresponding all MPU of transmission media resource.In this manner, although increasing generation The complexity of signaling information, but transmission network bandwidth and the limited computing capability of client is greatly saved.Further, since program request Service be not present random access problems, therefore user start service when can transmit accordingly finite number MPU phase Temporal information is closed, and transmits the correlation time information of subsequent MPU in time according to the viewing progress of user.For the stream for guaranteeing viewing Smooth property, when needing to timely respond to the operation of user in viewing, the correlation time information of transmission updates and timeline is presented.
It is raw below as the description method of above scheme three more clearly to describe implementation proposed by the present invention At MPU_presentation_descriptor, the personalized presentation TimeLine Mechanism in VoD service, citing description are constructed One concrete implementation process:
As shown in figure 5, be introduced by taking above-mentioned scheme three as an example, provide that a kind of multimedia content personalization is presented when Between line control method, this method process specifically:
When receiving end request VoD service, transmitting terminal will send signaling information, and receiving end passes through the PI_ judged in MPI table Content_type_length_byte field receives MUR, CI and html file, while will be updated and generate local maintenance MPU storing data library MySQL;When user requests scaled-down version video, receiving end is associated with the edit_ of media content by inquiry List signaling information obtains the mark edit_id=00 of edit_list corresponding with scaled-down version video, media wherein included The mpu_seq_number of unit is 1,9, the media content of the edit_id=00 of receiving end request at this time.Transmitting terminal analysis request It obtains corresponding mpu_seq_number and parses media data units MPU and obtain its corresponding duration duration letter Breath generates MPU_presentation_descriptor signaling.Receiving end receives corresponding signaling, according to MPU_ The absolute presentation time of each MPU is generated at the beginning of in presentation_descriptor and CI, the time is presented in maintenance Line.Receiving media data, which is stored in, simultaneously locally plays to user, and updates local data base.When user then requests to shear When version video, the edit_id=00U01 of version video is sheared.By the edit_list signaling and the local that check association media content MPU existing for database, to the media resource of transmitting terminal request edit_id=01.Receiving end receive signaling and media data it It parses afterwards and obtains the media data units mpu_seq_number in resource, and according to MPU_presentation_ Duration information in descriptor signaling recalculates the presentation time for the MPU that shearing version video is included, and update is in Existing timeline.The MPU that mpu_seq_number is 4,6 is received simultaneously is stored into local.
It is heretofore described by taking MMT as an example, illustrate proposed solution, but these schemes equally can be used for Other Document encapsulations, in Transmission system and agreement.
Specific embodiments of the present invention are described above.It is to be appreciated that the invention is not limited to above-mentioned Particular implementation, those skilled in the art can make various deformations or amendments within the scope of the claims, this not shadow Ring substantive content of the invention.

Claims (6)

1. the time line control method that a kind of multimedia content personalization is presented, which is characterized in that the method specifically: more During media resource is presented, using the Duration Information of media data units and the initial time of presentation, in association The presentation time of appearance is controlled, so that the different association contents versions of different media resource or same media resource have Corresponding presentation timeline;
The described method includes:
S1: the media data units that the association contents version according to the media resource of user's selection is included, to each media number Its corresponding Duration Information is obtained according to unit;
S2: time when media resource is selected to determine broadcast start time according to user in VoD, by servicing in broadcast service Provider determines broadcast start time, and broadcast start time is identified in signaling information;
S3: according to adding up for broadcast start time and corresponding media data units duration be associated in contents version in S2 Obtain the absolute presentation time of corresponding media data units, the corresponding presentation timeline of maintenance is in accordingly come instruct media resource It is existing.
2. the time line control method that multimedia content personalization according to claim 1 is presented, which is characterized in that S1 In, the association contents version refers to: media resource is identified according to user demand, it is raw according to the edit_id of its mark At different association contents versions, corresponding different edit_list.
3. the time line control method that multimedia content personalization according to claim 1 is presented, which is characterized in that described Timeline is presented, refers to: the combination of the absolute presentation temporal information for the media data units that the media resource chosen includes.
4. the time line control method that multimedia content personalization according to claim 1-3 is presented, feature It is, using MPU is marked in MPU timestamp descriptor, descriptor defined in MMT in a media The time is absolutely presented in corresponding label mpu_sequence_number and corresponding UTC in resource;When one media of customer consumption When the association contents version of resource, the association contents version that server is requested according to user obtains the media for including in the version The label of data cell and corresponding Duration Information, generate corresponding descriptor.
5. the time line control method that multimedia content personalization according to claim 1-3 is presented, feature It is, MPU timestamp descriptor is defined, according to the association content of same media resource and its collection of corresponding MPU It closes and defines edit_list, assign independent edit_id to the association content of each version, described in descriptor each The mpu_sequence_number for all MPU for including in edit_list and corresponding presentation temporal information;User selects certain The association content of one version parses media data units MPU therein and corresponding absolute presentation according to corresponding edit_id Time mpu_presentation_time, the timeline for generating corresponding version are presented to control.
6. the time line control method that multimedia content personalization according to claim 1-3 is presented, feature It is, describes the duration of each MPU in some media resource in the signaling, and by learning that the media provide in signaling information At the beginning of source, the time is absolutely presented in the UTC that each MPU is calculated;During transmission media resource, according to user The media resource of selection selects its corresponding media data units MPU, parses its Duration Information duration, raw simultaneously Information, i.e. the label mpu_sequence_number of MPU and corresponding duration information is presented at guidance.
CN201610031034.6A 2015-02-13 2016-01-18 A kind of time line control method that multimedia content personalization is presented Active CN106982376B (en)

Priority Applications (8)

Application Number Priority Date Filing Date Title
CN201610031034.6A CN106982376B (en) 2016-01-18 2016-01-18 A kind of time line control method that multimedia content personalization is presented
CN201910549398.7A CN110225370B (en) 2016-01-18 2016-01-18 Timeline control method for personalized presentation of multimedia content
KR1020177024204A KR101988454B1 (en) 2015-02-13 2016-02-02 Realization method and application of multimedia contents presentation
JP2017541331A JP6567064B2 (en) 2015-02-13 2016-02-02 Realization method of customized display of related multimedia contents and its application
PCT/CN2016/073167 WO2016127862A1 (en) 2015-02-13 2016-02-02 Method for implementing personalized presentation of associated multimedia content, and application
CA3004644A CA3004644C (en) 2015-02-13 2016-02-02 Implementing method and application of personalized presentation of associated multimedia content
KR1020197003889A KR102378107B1 (en) 2015-02-13 2016-02-02 Method for implementing personalized presentation of associated multimedia content, and application
US15/550,789 US10433029B2 (en) 2015-02-13 2016-02-02 Implemental method and application of personalized presentation of associated multimedia content

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610031034.6A CN106982376B (en) 2016-01-18 2016-01-18 A kind of time line control method that multimedia content personalization is presented

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201910549398.7A Division CN110225370B (en) 2016-01-18 2016-01-18 Timeline control method for personalized presentation of multimedia content

Publications (2)

Publication Number Publication Date
CN106982376A CN106982376A (en) 2017-07-25
CN106982376B true CN106982376B (en) 2019-07-19

Family

ID=59341032

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201610031034.6A Active CN106982376B (en) 2015-02-13 2016-01-18 A kind of time line control method that multimedia content personalization is presented
CN201910549398.7A Active CN110225370B (en) 2016-01-18 2016-01-18 Timeline control method for personalized presentation of multimedia content

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201910549398.7A Active CN110225370B (en) 2016-01-18 2016-01-18 Timeline control method for personalized presentation of multimedia content

Country Status (1)

Country Link
CN (2) CN106982376B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112584239B (en) * 2019-09-30 2023-05-09 西安诺瓦星云科技股份有限公司 Program preview method and program preview device
CN111669621B (en) * 2020-04-30 2022-04-12 聚好看科技股份有限公司 Media asset data issuing method, server and display device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101164055A (en) * 2005-04-20 2008-04-16 微软公司 Media timeline sorting
JP2011029948A (en) * 2009-07-27 2011-02-10 Hitachi Consumer Electronics Co Ltd Content processing apparatus
CN103491457A (en) * 2012-06-11 2014-01-01 Rgb网络有限公司 Methods and apparatus for combining assets for streaming video signal
WO2015039888A1 (en) * 2013-09-20 2015-03-26 Koninklijke Kpn N.V. Correlating timeline information between media streams

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102447818A (en) * 2010-09-30 2012-05-09 上海维阔信息技术有限公司 Playing method of video copyright protection and classification watching
KR20120119790A (en) * 2011-04-22 2012-10-31 삼성전자주식회사 Method and apparatus for media data transmission, and method and apparatus for media data reception
WO2012161125A1 (en) * 2011-05-20 2012-11-29 日本放送協会 Receiver, program and receiving method
KR20120138319A (en) * 2011-06-14 2012-12-26 삼성전자주식회사 Apparatus and method for transmitting data packet of multimedia service using transport characteristics
KR101501344B1 (en) * 2012-05-02 2015-03-10 삼성전자주식회사 Method and apparatus for transmitting and receiving multimedia service
US9544641B2 (en) * 2012-05-10 2017-01-10 Humax Co., Ltd. Hybrid transmission method through MMT packet format extension
JP2015015706A (en) * 2013-07-03 2015-01-22 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America Data transmission method, data reproduction method, data transmitter and data reproducer

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101164055A (en) * 2005-04-20 2008-04-16 微软公司 Media timeline sorting
JP2011029948A (en) * 2009-07-27 2011-02-10 Hitachi Consumer Electronics Co Ltd Content processing apparatus
CN103491457A (en) * 2012-06-11 2014-01-01 Rgb网络有限公司 Methods and apparatus for combining assets for streaming video signal
WO2015039888A1 (en) * 2013-09-20 2015-03-26 Koninklijke Kpn N.V. Correlating timeline information between media streams

Also Published As

Publication number Publication date
CN106982376A (en) 2017-07-25
CN110225370A (en) 2019-09-10
CN110225370B (en) 2021-04-02

Similar Documents

Publication Publication Date Title
US10433029B2 (en) Implemental method and application of personalized presentation of associated multimedia content
JP4813001B2 (en) Media resynchronization during streaming
CN101202900B (en) Method for switching living broadcast and playback of digital television and video server
JP4640723B2 (en) Stream a single media track to multiple clients
RU2526744C2 (en) Method for network-wide storage and distribution of data and system for internet protocol television
US11044497B1 (en) Method of unified video switching and advertisement splicing within consumer devices
US20200288197A1 (en) Efficient Insertion of Media Items in Media Streams
JP6043089B2 (en) Broadcast communication cooperative receiver
KR20170074866A (en) Receiving device, transmitting device, and data processing method
CN102075795A (en) Method and system for releasing focus television programs
CN107534793B (en) Receiving apparatus, transmitting apparatus, and data processing method
CN101448134A (en) Broadcast receiver and method for receiving adaptive broadcast signal
EP2680599A1 (en) Provision of a personalized media content
CN110381340A (en) Video file processing system
CN106982376B (en) A kind of time line control method that multimedia content personalization is presented
US10567098B2 (en) Reception apparatus, transmission apparatus, and data processing method
US20190014366A1 (en) Transmission apparatus, reception apparatus, and data processing method
KR20180113514A (en) Receiving device, transmitting device and data processing method
CN107534792B (en) Receiving apparatus, transmitting apparatus, and data processing method
GB2507764A (en) Recording and playback using a review buffer for different content segments
CN105653530B (en) Efficient and scalable multimedia transmission, storage and presentation method
WO2019188485A1 (en) Information processing device, information processing device, and program
US20140222961A1 (en) Reproduction apparatus, reproduction method, distribution apparatus, distribution system, reproduction program, and storage medium
CN106341740A (en) Multi-media content classification technology realizing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant