CN105191323B - Method for sending media data in multi-media transmission system - Google Patents

Abstract

A kind of method for sending media data in multimedia system is provided, the method includes：At least one multi-medium data grouping associated with multimedia transmission unit is generated, each multi-medium data grouping includes packet header and payload；And send at least one multi-medium data grouping；Wherein, the payload header being included in the payload includes：The identification information of identification multimedia transmission unit corresponding with the payload；Indicate that the segmentation with the relevant information of segmentation of the data cell in the payload indicates information；Indicate whether the data cell of polymerization is included in the label in the payload, with the relevant Counter Value of quantity of the follow-up payload for being segmented from the multimedia transmission unit, instruction is included in the type information of the type of the data in the payload.

Description

Method for sending media data in multi-media transmission system

Technical field

This disclosure relates to for multimedia transmission to be generated and sent in the multi-media transmission system for providing multimedia service The devices and methods therefor of grouping.

Background technology

Usually, interactive service, such as multicast, broadcast and visual telephone, and stream service, such as video on demand (VOD) Service, is referred to as multimedia service.Multimedia service can be classified as real time multi-media services and non-real time multimedia service.It is real When multimedia service according to its number of users, unicast services, multicast service and broadcast service can be classified as.In addition, in real time Multimedia service can be classified as interactive service and stream services according to service type.

In the multi-media network of the relevant technologies, -2 transport stream (TS) of Motion Picture Experts Group (MPEG) is already used to pass Defeated multimedia content.MPEG-2TS has been used as in the transmission environment for providing the fixed-bandwidth with error more for sending The transmission technology of the bit stream of the multiplexing of a multimedia programming (for example, video bit stream of multiple codings).For example, in multimedia Epoch, MPEG-2TS have been suitably used in such as multimedia equipment of DTV (TV).

Fig. 1 shows the hierarchical structure for supporting MPEG-2TS according to the relevant technologies.

With reference to figure 1, for supporting that the layer of MPEG-2TS may include media coding layer 110, synchronous (sync) layer 120, biography Pass layer 130, network layer 140, data link layer 150 and physical layer 160.

Media coding layer 110 and layer, sync 120 can be configured with such format：Media data can be written wherein Format or can be readily utilized as transmission fundamental unit format.Transfer layer 130, network layer 140, data link Layer 150 and physical layer 160 can configure the data block (for example, access unit (AU)) of the format configured by layer, sync 120 to Individual recording medium will be written into or be grouped the multimedia transmission sent.The multimedia transmission grouping configured can lead to It crosses predetermined network and is sent to user terminal.

For this purpose, layer, sync 120 may include fragmented blocks 122 and access unit 124.Transfer layer 130 may include MPEG- File delivery (FLUTE) 132, the RTP/ hypertexts of 2TS/MP4 real-time transport protocol (RTP) payload format/one-way transmission Transport protocol (HTTP) 134 and User Datagram Protocol (UDP)/transmission control protocol (TCP) 136.

However, MPEG-2TS has several limitations in terms of supporting multimedia service.Specifically, the limitation of MPEG-2TS can To include one-way communication, audio/video is exclusively used in due to the inefficiency transmitted caused by fixed packet sizes, and using The unnecessary switching (handover) that transport protocol and Internet protocol (IP) may occur when carrying out transmission data.

Therefore, MPEG media transmissions (MMT) standard is proposed via MPEG recently, as being propped up based on MPEG technology Hold one of the multimedia transport technology of multimedia service.Particularly, MMT standards are proposed via MPEG to overcome MPEG-2TS's Limitation.

For example, MMT standards can be used to efficiently send mixing content by heterogeneous network.Term is " in mixing Hold ", as used herein, can refer to such as audio, video, using multimedia element content set.Term " heterogeneous network " can refer to the network for being wherein mixed with multi-media network, communication network etc. as used herein.

In addition, MMT standard targets be define IP close friends (IP-friendly) transmission technology, this now in Basic technology in the transmission network of multimedia service.

Therefore, to being transmitted for providing efficient MPEG in the typical multimedia service environment changed based on IP The MMT standards of technology have carried out lasting research and standardization.

Above- mentioned information is provided as background information, is intended merely to help understanding of this disclosure.About any of the above described interior Hold whether the applicable prior art for the disclosure, be not determined, also do not make and asserting.

Invention content

Technical problem

Particularly, in MMT standards, exist in hybrid network environment and in nearest multimedia service ring The demand of the mode of efficient MPEG transmission technologys is provided in border, in hybrid network environment, single terminal is connected to multiple Network simultaneously provides multimedia service, and multimedia service environment be designed to provide mixing content, the mixing content not only by Audio and video data forms, but also include apply, widget, image etc., and can be consumed in the terminal of user.

Technical solution

All aspects of this disclosure will solve at least the above and/or disadvantage, and provide at least the following advantages.Therefore, originally Disclosed one side provides more for being configured in the multimedia system for supporting multimedia service based on Internet protocol (IP) The method and apparatus of media transmission grouping.

Another aspect of the disclosure, which is provided, to be grouped for creating multimedia transmission based on multi-medium data and sends institute The method and apparatus of the multimedia transmission grouping of establishment, the multi-medium data are for being based on Motion Picture Experts Group (MPEG) Media transmission (MMT) technology and perhaps blended service in the mixing that creates.

According to one aspect of the disclosure, a kind of method for sending media data in multimedia system is provided, The method includes：Generate at least one multi-medium data grouping associated with multimedia transmission unit, each multimedia number Include packet header and payload according to grouping；And send at least one multi-medium data grouping；Wherein, it is included in institute The payload header stated in payload includes：The mark of identification multimedia transmission unit corresponding with the payload Information；Indicate that the segmentation with the relevant information of segmentation of the data cell in the payload indicates information；Indicate polymerization Whether data cell is included in the label in the payload, and follow-up for being segmented from the multimedia transmission unit The relevant Counter Value of quantity of payload, instruction are included in the type information of the type of the data in the payload.

Description of the drawings

From description below in conjunction with the accompanying drawings, the above-mentioned and other aspects of certain embodiment of the disclosure, feature and Advantage will be more clear, wherein：

Fig. 1 shows the classification for supporting -2 transport stream (TS) of Motion Picture Experts Group (MPEG) according to the relevant technologies Structure；

Fig. 2 shows according to an embodiment of the present disclosure for being sent by Internet protocol (IP) network in MMT systems MPEG media transmissions (MMT) based on more services/more contents are grouped the structure of the multimedia payload of (MMTP)；

Fig. 3 is the MMTP according to an embodiment of the present disclosure for configuring MMTP groupings in MMT systems and sending configuration The control flow chart of grouping；

Fig. 4 a schematically show the example of media processing units according to an embodiment of the present disclosure (MPU) configuration；

Fig. 4 b show it is according to an embodiment of the present disclosure can be based on the partitioning list of the MPU document creations in Fig. 4 a The example of the configuration of first (MFU)；

Fig. 4 c show the example of the detailed configuration of MFU according to an embodiment of the present disclosure；

Fig. 4 d show the MFU in the c according to an embodiment of the present disclosure based on Fig. 4 come the configuration of the payload configured Example；

The MPU/MFU that Fig. 5 shows the MPU files according to an embodiment of the present disclosure for from based on Fig. 4 a to configure The example of configuration payload and the method for creating MMTP groupings in structure block (building block)；

Fig. 6 a and Fig. 6 b show the example of the MPU configurations according to an embodiment of the present disclosure distinguished according to requirement of real time；

Fig. 7 shows according to an embodiment of the present disclosure real-time more in offer Fig. 6 a to configure as unit of payload The example of the MPU of media services；

Fig. 8 shows the non real-time more matchmakers according to an embodiment of the present disclosure come as unit of payload in configuration diagram 6b The example of body service；

Fig. 9 shows the sending entity according to an embodiment of the present disclosure for sending media data in MMT systems；With And

Figure 10 shows the receiving entity according to an embodiment of the present disclosure for the receiving media data in MMT systems.

Through attached drawing, similar reference label will be understood to refer to similar part, component and structure.

Specific implementation mode

Below with reference to the accompanying drawings description is provided to help the disclosure to defining by claims and its equivalent Various embodiments be fully understood by.It includes various details to help to understand, but these details will be considered only Only it is exemplary.Therefore, it will be appreciated by those of ordinary skill in the art that can be carried out to various embodiments described each Kind change and modification, without departing from the scope and spirit of the disclosure.In addition, for clarity and conciseness, for well-known functions and knot The description of structure can be omitted.

Be not limited to bibliography meaning in following term and word used in the specification and claims, but only by Inventor is used for making it possible the clear and consistent understanding for the disclosure.Therefore, it will be apparent to those skilled in the art that The purpose being merely illustrative is provided to the description of the various embodiments of the disclosure below, not for limitation by appended right The purpose of the disclosure defined in claim and their equivalent.

It will be understood that singulative " one " and "the" include plural referents, unless context clearly dictates otherwise.Cause This, for example, including the reference for surface as one or more for the reference of " assembly surface ".

Term " substantially " means accurately realize the feature, parameter or numerical value, but, deviation or change Change, including for example, tolerance well known by persons skilled in the art, measurement error, measurement accuracy limitation and other factors, it can be with The feature is not interfered to be intended to the quantity of the effect provided to occur.

In following embodiments of the disclosure, by hierarchical structure of the description defined in MPEG media transmissions (MMT) standard. In addition, in embodiment of the disclosure, providing the mode of configuration multimedia transmission grouping.Therefore, it will be described in and be used for The relevant behaviour of layer of multi-medium data grouping according to an embodiment of the present disclosure is created in hierarchical structure defined in MMT standards Make.In the disclosure, be used for MMT service multimedia transmission grouping (hereinafter referred to as " MMTP groupings ") will be defined as transmission from The grouping of the transmission payload configured in MMT contents.MMTP (MMT agreements) grouping according to an embodiment of the present disclosure can wrap It includes and the required relevant service quality of transmission information (QoS) information.

In embodiment of the disclosure, matching for the header information for creating MMTP groupings will be described in greater detail below It sets.Header information may include about by be segmented or combine it is for the MMTP payloads being grouped, in upper layer (upper Layer the multi-medium data provided as unit of predefined size in) configures the information of the multi-medium data of desired size.

Embodiment of the disclosure can include conceptually by multimedia system (the hereinafter referred to as MMT systems based on MMT standards System) MMT service.

Although ultra high-definition (UHD), video on demand (VOD), live TV stream, file, widget, electronics (E) book, metadata etc. will It is considered as the content serviced for MMT, but those of ordinary skill in the art will be clear that, can be represented as the institute of electric signal Other contents can be the content serviced for MMT.

It can be by configuring the MMT wrappers of MMTP groupings with predetermined for the multi-medium data of each in various contents Format encapsulates, and then, MMTP groupings can undergo mixing delivering by heterogeneous network by reach user terminal.Term " heterogeneous network Network " indicates the network of the transmission environment for being mixed with multi-media network, Internet protocol (IP) network etc..

When receiving the MMTP groupings for undergoing mixing delivering by heterogeneous network, user terminal can be grouped from MMTP Middle extraction multi-medium data corresponding with desired content, and provide a user corresponding with the multi-medium data extracted Video, audio, using etc..With provide for the video of specific content, audio, using etc. in corresponding multi-medium data Each will be defined as " assets ".In embodiment of the disclosure, can be interpreted as including can for term " user terminal " Support the most equipment of multimedia service.The typical case of user terminal can be Internet Protocol Television machine (TV), smart phone etc..

Therefore, the target that MMT services can be realized may include high-quality content delivering, the support of mixing content, hybrid network Network support etc..

Fig. 2 shows according to an embodiment of the present disclosure for being sent based on more clothes by heterogeneous network in MMT systems The example of the hierarchical structure of the MMTP groupings of business/content.

With reference to figure 2 multiple (examples are needed in order to configure MMTP groupings in MMT systems and send configured MMTP groupings Such as, seven) layer.Described seven layers may include that media coding layer 210, encapsulated layer (hereinafter referred to as " layer E ") 220, transfer layer are (following Referred to as " layer D " or " layer T ") 230 and 290, network layer 240, data link layer 250, physical layer 260 and control layer (hereinafter referred to as " layer C ") comprising, for example, MMT C.1 270 and MMT C.2 280.

In accordance with an embodiment of the present disclosure, the multi-medium data based on more service/contents can be by the matchmaker in described seven layers Body coding layer 210 and layer E 220 are created.Therefore, this two layers configuration for being considered " multi-medium data generation unit ".This Outside, because MMTP groupings are configured by the layer D 230 in described seven layers, layer D 230 is considered " multimedia point The configuration of group generation unit ".In other words, layer D corresponding with multimedia packets generation unit 230 can be by for knowing The packet identifier (ID) of other MMTP grouping, the connection in network layer service quality and measure end-to-end (end-to- End) information required by network performance carrys out configuration header information, and can be by combining header information with multi-medium data To configure MMTP groupings.

In described seven layers, layer E 220, layer D 230, layer D.3 290, layer C.1 270 and layer C.2 280 be and MMT Standard has very high correlation.Layer E 220 is responsible for the generation of mixing content, and D.3 layer D 230 and layer 290 be responsible for passing through isomery Created content is transmitted to network-efficient, and C.1 C.2 270 and MMT 280 is responsible for mixing the consumption pipe of content MMT The overall operation of reason and transfer management.

Layer E 220 may include E.3 E.2 E.1 layer 226 layer 224 and MMT layer 222, MMT MMT.E.3 layer 222 can by MMT Using the multi-medium data by using the coding provided from media coding layer 210 as input, generation services basic as MMT The media data of unit is segmented or the segmentation (for example, partitioning unit (MFU)) of media processing units.E.2 layer 224 can by MMT It is generated for the MMT media manipulation units serviced or media processing units by the MMT MFU that E.3 layer 222 generates with using (MPU).E.1 layer 226 can generate mixing content to MMT by combining and being segmented from the MMT MPU that E.2 layer 224 provides, and And format for storing and sending generated mixing content can be generated.

For MPU for configuring assets, multi-medium data, multi-medium data is data (timed data) or the non-timed of timing Data (non-timed data).Single assets are the set (collection) of one or more MPU, and therefore, MPU is to use In the container that can carry out decoded timing or the non-timed data independently of other MPU.Specifically, if it is the number of timing According to video is provided to receiving entity, for example, the video includes one or more images, for handling matching for each image Confidence ceases.Each image is configured to MFU, and MFU is delivered to receiving entity.MPU is segmented into data cell, MFU, Less than AU.

Layer D 230 may include D.1 D.2 layer 234 layer 232 and MMT MMT.D.1 responsible will constitute of layer 232 will by MMT The MFU of the object unit (for example, MPU) of transmission is configured to grouping payload, and the grouping payload is built as corresponding to In the structure of MMTP groupings.D.2 layer 234 is responsible for application protocol (AP) to MMT, plays the part of and real-time transport protocol (RTP) or super literary The similar role of this transport protocol (HTTP).D.3, MMT layers 290 execute each layer for constituting layer E 220 and constitute layer D The operation of optimization between 230 each layer.

MMT C.1 270 can provide with the generation that mixes content and the relevant information of consumption, and MMTC.2 280 can be with It provides and the relevant information of the transmission for mixing content.

Fig. 3 is according to an embodiment of the present disclosure for configuration MMTP to be grouped in MMT systems and transmission is configured The control flow chart of MMTP groupings.

D.2234, operation in Fig. 3 can be executed by the MMT of the layer D 230 in the layer that is formed in described in Fig. 2.

With reference to figure 3, D.2 234 D.1 232 multi-medium data can be received from MMT operating 310, MMT.It can provide From MMT D.1 232 enough multi-medium datas that blended service is provided or mixes content and with the multi-medium data In each corresponding MMT assets.

It D.2 234 can be based on being configured depending on the multi-medium data received in operation 310 operating 312, MMT Payload, to be configured to the header information of configuration MMTP groupings.Header information may include will be described in following table 5 MMTP packet headers region header information, and the information about the payload header that will be described in table 2 below.Report Header may include the packet ID that MMTP is grouped for identification, the quality and measurement end of the service of the connection in network layer To at least one of the information required by the network performance of end.

Operating 314, MMT, D.2 234 MMTP that may be configured to hybrid multimedia service are grouped.In other words, MMT D.2 234 can by combine 310 multi-medium data that receives of operation and the header information in 312 configuration of operation come Configure MMTP groupings.

After configuration MMTP groupings, 234 it can will be configured by heterogeneous network operating 316, MMT D.2 MMTP groupings are sent to user terminal.

It will be described in now according to an embodiment of the present disclosure for by being responsible for MMTP points for MMT services of transmission T.2, the method that the layer of group configures MMTP groupings.MMTP according to an embodiment of the present disclosure grouping may include Header Area and Payload region.In embodiment of the disclosure, it should the header information and will write that definition will be written in Header Area Enter the multi-medium data in payload region.MMTP groupings according to an embodiment of the present disclosure should be defined to ensure to be wanted The QoS asked.

Moreover, should also prepare the flow control for being able to carry out the MMTP groupings configured in accordance with an embodiment of the present disclosure The plan of system.In addition, the function that control flow according to an embodiment of the present disclosure and IP agreement are provided by QoS level should energy Enough it is replaced.

Finally, in embodiment of the disclosure, in order to send the object unit (for example, MPU) for it is expected to be sent, should also Define program for T.2 exchanging information with other layers by layer and the information exchanged due to described program content and its Delivering method.

Following table 1 shows the example of the structure of MMTP groupings according to an embodiment of the present disclosure.

Table 1

[table 1]

MMTP packet headers

MMTP payloads

Reference table 1, MMTP groupings may include MMTP packet headers region and MMTP payloads region.It is grouped in MMTP The control that can be written in Header Area and be used for receiving the multi-medium data for blended service/content sent by MMTP groupings The corresponding header information of information processed.The multimedia for blended service/content can be written in MMTP payloads region Data.MMTP payloads region may include payload header and effective load data.

Following table 2 shows the knot of the payload header in the MMTP payloads region for being written into and constituting MMTP groupings The example of structure.

Table 2

[table 2]

MMT payload headers

Reference table 2, payload header may include following information.Here title, digit and the value identified is only one Kind embodiment, and can change in the other embodiments of the disclosure.

Length (16)：This information represents the length of MMTP payloads.If pseudo- data are (for example, null, filling Data etc.) it is included in keep the length of MMTP payloads in MMTP payloads, then pseudo- data (fake data) can To be excluded.

Type (8)：This information represents the type for being included in the data in MMTP payloads.In table 3, the letter Breath represents the example for the type that can be included in the data in MMTP payloads.

Table 3

[table 3]

-MPU(0x00)：MPU can be configured as MMTP payloads without the internal structure for the MPU for considering it is expected to send Information.Therefore, MMTP payloads can be configured as including a MPU, or can be configured as including having than effective A part of the MPU of the length longer length of load.

- MPU metadata (0x02)：If it is considered that it is expected that the internal structural information of the MPU sent is effective to configure MMTP Load, then MMTP payloads may include MPU metadata.As the control for handling the MPU for constituting MMTP payloads The MPU metadata of information can correspond to the codecs parameter for encoding MFU.

Segment meta-data (0x03)：If it is considered that it is expected that the internal structural information of the MPU sent is effective to configure MMTP Load, then MMTP payloads may include segment meta-data.Segment meta-data can represent effectively negative for being included in MMTP The control information of the segmenting unit of each in MFU in load.

The MFU (0x04) of alignment：If it is considered that it is expected that the internal structural information of the MPU sent is effective to configure MMTP Load is then considered that the range of MFU to configure MMTP payloads.In other words, the " MFU (MFU of alignment Aligned it includes at least one MFU) " to represent MMTP payloads.Wherein, it is effectively negative to be aligned MMTP by least one MFU The boundary of load.

-MFU(0x05)：If it is considered that it is expected the internal structural information of the MPU sent to configure MMTP payloads, then MMTP payloads may include at least one MFU segmentations.Wherein, at least one FMU segmentations are configured without considering The length of MMTP payloads.Therefore, the length of the length ratio MMTP payloads of at least one FMU segmentation is shorter or more It is long.

As a specific example, MMTP payloads can be configured as including with longer long of the length than payload A part of the MFU of degree.

- f_i (2)：This information represents segment indicator, indicates the range of the unit of MMTP payloads.Below Table 4 shows the example of the value of segment indicator.

Table 4

[table 4]

Reference table 4, f_i=" 00 " can indicate the case where MMTP payloads include at least one complete DU, MPU.Root It can correspond to MFU or MPU depending on the feature of data according to the DU of embodiment of the disclosure.If it is assumed that DU is for real-time The DU of the data of multimedia service, then DU can correspond to MFU.In this case, f_i=" 00 " can indicate wherein MMTP The case where payload is configured as unit of MFU and includes at least one MFU.If it is assumed that DU is an image, then DU It can correspond to MPU.In this case, if there is f_i value " 00 ", MMTP payloads to be configurable to a MPU.This Outside, f_i=" 01 " can indicate that wherein MMTP payloads include the feelings for constituting first DU segmentations in the DU segmentations of DU Condition.In this case, it is assumed that DU is MFU, if f_i has a value " 01 ", MMTP payloads may include by by MFU First MFU segmentations in MFU segmentations that segmentation obtains.If f_i has value " 10 ", MMTP payloads may include structure At the DU segmentations other than first DU segmentation and the last one DU segmentations in the DU segmentations of DU.For example, it is assumed that DU packets Three DU segmentations are included, if it may include center (center) DU segmentations that f_i, which has value " 10 ", MMTP payloads,.Finally, If f_i=" 11 ", MMTP payloads may include the last one DU segmentations constituted in the DU segmentations of DU.

-fragmentation_flag(F:1)：If MMTP payloads send the MPU (for example, MFU) of segmentation, Fragmentation_flag can be designated as " 1 ".

-aggregation_flag(A:1)：If MMTP payloads send multiple MPU, aggregation_ Flag can be designated as " 1 ".

-RAP_flag(R:1)：If the data being included in MMTP payloads include allowing random-access data Unit (for example, random access point (RAP)), then RAP_flag can be designated as " 1 ".Data with RAP_flag=" 1 " can To be information that designation date can be directly decoded.For example it is assumed that MMTP payloads include and constitute the ten of arbitrary video Each corresponding MPU in the scene of a Time Continuous.In this case, payload header may include and MPU In each corresponding RAP_flag.As a specific example, the MPU with RAP_flag=" 1 " can correspond to constitute Interior coding (intra-coded) frame (I frames) being coded independently in the frame of video.

-payload_id(P:1)：If there is the media manipulation unit with the DU being included in MMTP payloads (for example, MPU) corresponding identifier information, then payload_id can be designated as " 1 ".

-extension_flag(E:1)：If the header information in the structure of MMTP payloads requires to be prolonged Long, then extension_flag can be designated as " 1 ".

- data_offset (8)：This information represents opening for the effective load data being included in MMTP payloads The address of initial point.

-fragment_counter(frag_count:8)：If MMTP payloads include by being segmented a MPU The MFU of acquisition, then fragment_counter can correspond to the quantity of payload, instruction is included in MMTP payloads In MPU MFU.

-number_data_unit(numDU:4)：If MMTP payloads include several data cells, for example, such as Fruit MMTP payloads include multiple MPU, then number_data_unit can indicate the quantity of MPU.

- DU_offset (16)：If MMTP payloads are sent by being made of multiple MPU, DU_offset The initial value of each in the MPU of MMTP payloads can be indicated to constitute.Here, DU can correspond to MPU.In replacement In embodiment, DU_offset can be substituted by the length of each MPU.In this case, numDU can not used.

- payload_id (32)：If MMTP payloads are made of at least one MFU by being segmented MPU acquisitions, Or if a MMTP payload is configured by combining multiple MPU, payload_id can indicate that MMTP is effectively negative The identifier for the MPU that load includes.If sending side to multi-medium data be segmented and send by multiple multimedia packets The multi-medium data of segmentation, then the identifier of MPU can be used for assemble (assemble) receiving side by the multiple more Multiple multi-medium datas that media packet receives.

-payload_sequence_flag(P:1)：This information is arranged with 1, to indicate MMTP payloads The presence of serial number.

- payload_sequence_number (32)：This information indicates the serial number of MMTP payloads.

It is corresponding with the order of the multimedia transmission grouping just sent to index the example that may be used as payload_id. In some cases, payload_id may be used as index corresponding with multimedia transmission grouping or the identifier of assets.

In addition, the MMTP that multiple datagrams (datagram) can be included in composition one multimedia transmission grouping is effective In load.In this case, corresponding with multiple services in one MMTP payload of write-in or each in content Multi-medium data can be separated (separated), and be considered that write-in header information in length, Jin Jinli Independent datagram is obtained with separated multi-medium data.Alternatively, can by with it is previously received or later will The multi-medium data of reception assembles to obtain datagram.

Following table 5 shows that write-in constitutes the example of the header information in the MMTP packet headers region of MMTP groupings.

MMP packet headers

Table 5

- packet_id (16)：This be MMTP grouping identifier, and only for identical media stream for Packet identifier having the same.In other words, this is assigned to each assets, with distinguish an assets grouping with it is another The grouping of a assets.

- packet_sequence_number (32)：The serial number of this instruction MMTP groupings, and serial number can be instructed to For sequentially increased number for each in all multimedia transmissions grouping just sent.In other words, serial number It can be the arbitrary value for being grouped and increasing by one for each MMTP.However, being pre-configured setting information by setting, serial number can be with needle Each multimedia transmission grouping of packet_id having the same is sequentially increased.Being pre-configured setting information can lead to It crosses to be included in and be sent in multi-medium data control information.

Time stamp (32)：This indicates based on Network Time Protocol (NTP) temporal information, transmission or delivering MMTP groupings Time instance.NTP temporal informations as world concordant time (Universal Time Coordinated, UTC) can be with It is used to measure end-to-end delay.Bit rate (bit rate) can be adjusted based on NTP temporal informations.

-QoS_classifier_flag(Q:1)：QoS classification device information is arranged with 1 in this.

-FEC_type(FEC:2)：This instruction forward error correction (FEC) relevant type information.

-type_of_bitrate(TB:3)：This information indicates the type of multimedia transmission grouping.Following table 6 is shown The example of the type of grouping.Here, the type of multimedia transmission grouping can rely on the bit rate of grouping to distinguish.Grouping Type can be used for receive terminal in or intermediary network device in reception buffer grouping and setting value scheduling.Example Such as, if the type of grouping is arranged to fixed bit rate (for example, " 000 "), buffer and the centre of terminal are received The packet scheduler of the network equipment, which can use, has fixed-size buffer for handling media, or can be arranged point The type of group is fixed value, is used for queue management.

Table 6

[table 6]

So far, it has been described that the structure of MMTP groupings and write-in constitute the header in the Header Area that MMTP is grouped The definition of each in information and configuration.

It will now be described according to an embodiment of the present disclosure for being carried based on MPU to configure MMTP payloads and generation The method of the MMTP groupings of MMTP payloads.

Fig. 4 a schematically show the example of MPU configurations according to an embodiment of the present disclosure.

With reference to figure 4a, the MPU files 400 that are created from MMT contents may include header information 402 and with media data phase Corresponding media data (MDAT) 404.Header information 402 may include indicate file type file type (FTYP), with The corresponding MMPU of configuration information of MPU, with for the corresponding MOOV of the codec setting information of media and with about The corresponding film segmentation (MOOF) of details of segmenting unit.MDAT 404 may include opposite with the media data of coding The video sample (VS) 406 answered and prompt sample (HS) 408 corresponding with the additional information for media are described additional The mutual priority of information media data, interdependency, size etc..As is shown in fig. 4 a, each in VS and HS It can include only the relevant VS in MDAT boxes (for example, MDAT 404), such as VS 406, and include only relevant HS, Such as HS 408.

In order to generate MMTP groupings, the MMTP payloads configured based on MPU files 400 can be by its configuration process In be divided into media data and structural information publicly to be configured.Structural information may include header information 402, such as FTYP, MMPU, MOOV, MOOF etc..

MPU/MFU structure blocks 410 for configuring MMTP groupings can be based on MPU files 400 and configure.MPU/MFU is built Block 410 may include an independent payload (for example, MPU metadata 412), and one independent payload includes Structural information and MFU, the MFU include HS and VS couples.

For example, a MFU 414 may include VS#1 and HS#1 in MDAT 404.In the alternative embodiment, MMTP Payload can be configured as matching or mismatch the segmenting unit (for example, MFU or MPU) of MDAT.For example, if MMTP has Effect load is configured as mismatching the segmenting unit of MDAT, then MMTP payloads may include with longer than its own length Length MFU segmentation.The configuration of MMTP payloads can be indicated by the type of above-mentioned payload header.Join below It examines Fig. 4 b and describes particular example.

Fig. 4 b show it is according to an embodiment of the present disclosure can be based on the configuration of the MFU of the MPU document creations in Fig. 4 a Example.

With reference to figure 4b, MMTP payloads #1 422 may include MPU metadata, and MPU metadata includes above-mentioned header letter The component (for example, FTYP, MMPU and MOOV) of breath.MPU metadata may include independent MPU.In this case, MMTP has The packet type of effect load #1 422 can be expressed as MPU.Packet type can as MMTP packet headers component by including. In addition, the value for " type " being included in the payload header of MMTP payloads #1 422 can be set in table 3 It represents " 0x01 " of " MPU metadata ".MMTP payloads #2 424 may include MOOF, and the header portion including MDAT Segment meta-data.In this case, the packet type of MMTP payloads #2 424 can correspond to MPU, and be included in " type " in the payload header of MMTP payloads #1422 can be set to " 0x02 " in table 3, instruction " point Section metadata ".As another example, MMTP payloads #3 426 can only include the VS in MDAT (for example, data sample VS#2, VS#3 and VS#4).In this case, be used for VS additional information (for example, priority corresponding with each VS, Interdependency information, designation date sample starting position counter etc.) can be configured as MMT cueing tracks (hint Track configuration information).MMT cueing tracks can be as the foremost for the MFU for positioned at (situated at) including VS The configuration information of (top front) MMT cueing tracks and by including.The example of the detailed configuration of MFU is described below with reference to Fig. 4 c.

Fig. 4 c show the example of the detailed configuration of MFU according to an embodiment of the present disclosure.

With reference to figure 4c, for example, a MFU 430 can be segmented into the multiple portions (section) with equal length. In the embodiment of replacement, MFU 430 can be segmented into the multiple portions with different length.First part in the part 432 may include the MMT cueing tracks for the data sample for constituting MFU 430.For each in other parts, MFU is constituted 430 VS can be distributed depending on the size of each in other parts.In this case, according to the implementation of the disclosure Example, each in other parts can be configured as including at least one VS, or can be configured as including VS A part.

Fig. 4 d show the MFU in the c according to an embodiment of the present disclosure based on Fig. 4 come the configuration of the payload configured Example.

With reference to figure 4d, for example, payload 440 may include opposite with one of the multiple portions of MFU that constitute in Fig. 4 c The part 444 answered.Part 444 can correspond to above-mentioned effective load data.It can be by the way that payload header 442 be attached to Part 444 generates a payload 440.Payload 440 can correspond to the MMTP payloads region in table 1.Have Effect load header 442 may include the starting position of the priority of part 444, interdependency information, designation date sample Counter etc..Therefore, if fruit part 444 is that constitute in the multiple portions of the MFU in Fig. 4 c include the of MMT cueing tracks A part, then payload header 442 may include the information for being overlapped (overlap) MMT cueing tracks.As fruit part 444 is One of the other parts of MFU in Fig. 4 c are constituted, then part 444 may include the priority of each, the phase in other parts Mutual dependency information, designation date sample starting position counter etc..Hereafter, if packet header 446 has been attached to Effect load 440, then MMTP groupings 448 are completed.As a result, MMTP groupings 448 may include packet header 446, payload report First 442 and part corresponding with effective load data 444.In the alternative embodiment, MMTP groupings 448 may include Multiple payloads 440.

The MPU/MFU that Fig. 5 shows the MPU files according to an embodiment of the present disclosure for from based on Fig. 4 a to configure The example of payload and the method for creating MMTP groupings is configured in structure block.

With reference to figure 4a and Fig. 5, the MPU metadata 412 configured according to the method described in fig.4 can be, for example, The component of one MMTP payload.In other words, MPU metadata 412 can correspond to effective load data, and MMTP is effective Load 515a can be generated by the way that payload header is attached to MPU metadata 412, such as described in figure 4d.

Similarly, above-mentioned MFU 414 can also be the component of a MMTP payloads 515b.MFU 414 can also be right Should be in effective load data, and MMTP payloads 515b can be generated by the way that payload header is attached to MFU 414, As described in Fig. 4 d.As another example, by the way that payload header is attached to MFU, one will can also be only included A MFU of a MOOF 420 is generated as a payload 515c.Payload header can configure as shown in table 2.

MMTP groupings 516 can be configured based at least one MMTP payloads generated as described above.In other words, MMTP groupings 516 can be generated by each that packet header is attached at least one MMTP payloads.Grouping Header can configure as shown in table 5.

Fig. 6 a and Fig. 6 b show the example of the MPU configurations according to an embodiment of the present disclosure distinguished according to requirement of real time.

Fig. 6 a show the example of the configuration of the MPU according to an embodiment of the present disclosure for providing real time multi-media services.

May include with reference to figure 6a, MPU, for example, ftyp/styp (stream type) box, sidx boxes, mmpu boxes, moov boxes, Moof boxes and mdat boxes.Ftyp boxes, mmpu boxes and moov boxes can be the components of MPU metadata, and sidx boxes can only needle It is optionally included to providing the MPU of real time multi-media services.Sidx boxes can be the index for the MFU for constituting MPU.By with The MPU of offer non-real time multimedia service in Fig. 6 b compares, and other than MMT cueing track information, moov boxes can be with Including media track (media track) information.MMT cueing tracks information can be each that instruction is included in MPU The information of the position of the MMT cueing tracks of MDAT.User can determine the position of MMT cueing tracks, and determined by use Position obtains the MMT cueing tracks of the mdat for that will receive.Media trace information can be instruction be included in it is every in MPU The information of the position of one MDAT.Similarly, for media trace information, user can determine each being included in MPU The position of MDAT, and receive mdat using identified position.What is substantially carried by MPU is corresponding with real time data Moof boxes may include at least one traf.Traf can provide the time for decoding the VS for constituting mdat.Comparatively, Fig. 6 b Show the example of the configuration for the MPU that non-real time multimedia service is provided.

May include ftyp boxes, mmpu boxes, moov boxes, meta boxes and project (item) box with reference to figure 6b, MPU.Moov boxes MMT cueing track information can be only included.MMT cueing tracks information can be the position for each project box that instruction will receive The information set.Meta boxes may include the information position (iloc) of the position for the project box that instruction constitutes MPU.

MPU according to another embodiment of the present disclosure can be configured according to data file or application.

Fig. 7 shows that the configuration according to an embodiment of the present disclosure as unit of payload provides real-time more matchmakers in Fig. 6 a The example of the MPU of body service.

With reference to figure 7, payload 700 can be by that will require the group of the MPU of the real time multi-media services in Fig. 6 a Ftyp boxes, mmpu boxes and moov boxes in part are defined as MPU metadata to configure.Payload 702 and 704 can use Mdat boxes and its location information configure.The mdat boxes of each constituted in payload 702 and 704 are represented for constituting it The segment meta-data of the MFU of payload, and each mdat box can be segmented into multiple MFU.

Fig. 8 shows the non real-time more matchmakers according to an embodiment of the present disclosure come as unit of payload in configuration diagram 6b The example of body service.

With reference to figure 8, a payload 800 can require the service of the non-real time multimedia in Fig. 6 b by that will constitute Ftyp boxes, mmpu boxes and the moov boxes of MPU is defined as MPU metadata to configure.Each as a MFU, in project box It may be constructed one of payload 802 and 804.

Fig. 9 shows the sending entity according to an embodiment of the present disclosure for sending media data in MMT systems.

With reference to figure 9, the sending entity 900 for sending media data in MMT systems includes controller 902, transceiver 904 and MMTP packet generators 906.Transceiver 910 under the control of controller 920, in MMT systems from multimedia The device that data set provider receives multi-medium data is communicated.Controller 902 controls MMTP packet generators 906 and executes here Description is used to generate the operation that MMTP is grouped, and then MMTP packet generators 906 are had based on what is configured according to multi-medium data Effect loads to be configured to the header information of configuration MMTP groupings.MMTP packet generators 906 can be by combination in operation 310 The multi-medium data of reception is grouped with the header information in 312 configuration of operation to configure one or more MMTP.It is generated MMTP groupings include packet header and payload, and payload includes payload header and effective load data.Header is believed Breath may include will be in the header information in the MMTP packet headers region described in following table 5, and about will be in following table 2 Described in payload header information.The header information being included in packet header and payload header, for example, header Information includes indicating that effective load data includes the information of MPU, if effective load data includes be segmented into MPU at least one MFU, header information include the location information of at least one MFU and the data type that is included in effective load data.Control Device (902) control transceiver 910 processed executes the operation described herein for sending media data in MMT systems.Device 900 May include other components, such as data configuration device and memory.

Figure 10 shows the receiving entity according to an embodiment of the present disclosure for the receiving media data in MMT systems.

With reference to figure 10, the receiving entity 1000 for the receiving media data in MMT systems includes controller 1002, transmitting-receiving Device 1004, MPU reconstruction units 1006 and display unit 1008.Transceiver 1010 under the control of the controller 1002 with for The device that media data is sent in MMT systems is communicated.If transceiver 1010 receives at least one MMTP groupings, control Header information is obtained in packet header and payload header that device 1002 is grouped from least one MMTP.For example, header information Include the information of MPU including instruction effective load data, if effective load data includes at least one MFU for being segmented into MPU, Header information includes the location information of at least one MFU and the data type that is included in effective load data.

Specifically, controller 1002 controls MPU reconstruction units 1006 and rebuilds to be included in based on the header information obtained and has Imitate the MPU or MFU in load data.Then, MPU reconstruction units 1006 are determined by using header information constitutes multi-medium data MPU or MFU.Then, controller (1002) uses identified MPU or MFU control display units, will pass through display screen curtain Image provides audio corresponding with multi-medium data, title etc..Then, display unit (1008) is by showing screen display institute State multi-medium data.Device 1000 may include other components, such as data configuration device and memory.

It can be clearly seen that embodiment of the disclosure can be provided for being configured to IP network in from the foregoing description Network sends the multimedia payload of blended service or content and for the side based on its generation and transmission multimedia packets Method, so that efficient MPEG can be supported to transmit in multimedia environment.

Method described here can be in the form of hardware, software or combination thereof in accordance with an embodiment of the present disclosure To implement.Any such software can be stored in, for example, volatibility or in non-volatile non-instantaneous storage device, it is all Such as read-only memory (ROM), such as memory of random access memory (RAM), memory chip, memory devices or collection Recordable and readable machine (for example, computer) medium at circuit (IC) or optically or magnetically, such as CD (CD), number Word versatile disc (DVD), disk or tape, the ability or its ability that can be newly recorded that can be wiped free of regardless of it.Together When, it will be understood that method described here can be implemented by computer or portable terminal in accordance with an embodiment of the present disclosure, The computer or portable terminal include controller and memory, and wherein memory can be machine readable non-instantaneous storage The example of medium is suitable for one or more programs that storage includes the instruction of certain embodiment for implementing the disclosure.

Therefore, embodiment of the disclosure includes program, and described program includes being wanted for implementing the right appended by this specification The code of any method defined in asking, and the storage medium readable for storing the non-instantaneous machine (computer)-of program.And And program can be by scheduled medium come electrical transmission, the predetermined medium such as passes through the logical of wired or wireless connection transmission Believe signal, and the disclosure uitably includes the equivalent of program.

Although the disclosure has been shown and described in the various embodiments by reference to the disclosure, those skilled in the art will manage Solution, can make the change on various forms and details herein, without departing from by appended claims and they be equal The spirit and scope of the present invention that object defines.

Claims (5)

1. a kind of method for sending media data in multimedia system, the method includes：

Multi-medium data grouping associated with multimedia transmission unit is generated, each multi-medium data grouping includes packet header And payload；And

Send the multi-medium data grouping；

Wherein, the payload header being included in the payload includes：

The identification information of identification multimedia transmission unit corresponding with the payload；

Indicate that the segmentation with the relevant information of segmentation of the data cell in the payload indicates information；

Indicate whether the data cell of polymerization is included in the label in the payload,

With the relevant Counter Value of quantity of the follow-up payload for being segmented from the multimedia transmission unit,

Indicate the type information of the type for the data being included in the payload.

2. it is the multimedia transmission unit that the method for claim 1, wherein the type information, which includes the data, Metadata, the data cell of the metadata of data cell including temporal information or the data cell in addition to temporal information One of value.

3. the method for claim 1, wherein the segmentation instruction information includes that instruction is included in the payload At least one data cell information.

4. the method for claim 1, wherein the segmentation instruction information includes that instruction is included in the payload Subdata unit information and the subdata unit being included in the payload location information.

5. method as claimed in claim 4, wherein one of location information instruction the following terms of the subdata unit：Number According to the first part of unit, data cell last part and neither the first part nor it is described last The position of partial subdata unit.