CN110225371B - Storage and transmission method for supporting space blocking based on media self-attribute - Google Patents
Storage and transmission method for supporting space blocking based on media self-attribute Download PDFInfo
- Publication number
- CN110225371B CN110225371B CN201910527137.5A CN201910527137A CN110225371B CN 110225371 B CN110225371 B CN 110225371B CN 201910527137 A CN201910527137 A CN 201910527137A CN 110225371 B CN110225371 B CN 110225371B
- Authority
- CN
- China
- Prior art keywords
- multimedia content
- block
- original
- space
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
- H04N21/26233—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving content or additional data duration or size, e.g. length of a movie, size of an executable file
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4335—Housekeeping operations, e.g. prioritizing content for deletion because of storage space restrictions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/4424—Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Transfer Between Computers (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a storage and transmission method for supporting space blocks based on media self-attributes, aiming at the space blocks of multimedia contents, block associated information is added in MMT, the block associated information is used for identifying the association relationship between the original multimedia contents and the space blocks thereof, and meanwhile, the block associated information is combined with the multimedia contents self-attributes. The invention is beneficial to accurately indexing the original multimedia content and the space block content thereof during storage and transmission, and overcomes the serious defect that the prior method depends on transmission to describe the correlation relationship of the original multimedia content and the space block content thereof.
Description
Technical Field
The present invention relates to a storage and transmission method of digital media technology, and more particularly, to a storage and transmission method for supporting spatial chunking based on the properties of multimedia contents themselves in the Internet (Internet).
Background
With the rapid development of digital media technology, multimedia content generated in the internet shows explosive growth, especially the wide application of 360-degree panoramic video and ultra-high resolution video services (such as 4K, 8K, etc.), and multimedia services impose an increasingly heavy burden on network bandwidth. Meanwhile, terminal presentation devices are increasingly diversified, such as ultra-high-definition televisions, tablet computers, smart phones and the like, and due to the limitation of hardware capability, part of the devices do not support decoding and presentation of ultra-high-resolution videos.
Some current multimedia protocols provide for blocking a video with ultrahigh resolution in space, constructing a blocked video independent of an original video codec, and explaining associated information between the original video and the blocked video in a transmission process in a form of a signaling table, so as to support complete presentation or partial presentation of the video with ultrahigh resolution for different terminal presentation devices and in combination with a network bandwidth condition. However, the form of the transmission signaling table is not considered in combination with the attributes of the multimedia content itself, and only the association relationship between the original video and the segmented video can be identified in the transmission process. Once the transmission is disconnected, the inherent spatial relationship between the original video and the block video cannot be reflected. Therefore, not only is the correlation system between the original video and the block video and between the block video and the block video damaged, and the management of the multimedia content after the video is blocked is not facilitated, but also the repeated transmission of the cached content can be caused, the efficiency of data transmission is reduced, and the pressure of network bandwidth is increased unnecessarily. In addition, the repeated media contents occupy a large amount of storage space, and there is a great waste in resource utilization.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a storage and transmission method for supporting space blocks based on the self-attributes of media, solves the problems caused by the prior method of describing the original multimedia content and the space block association relation thereof depending on transmission, and fully utilizes the self-attributes of the multimedia content to effectively store and efficiently transmit the space blocks.
In order to achieve the purpose, the invention adopts the following technical scheme:
the invention aims to provide a storage and transmission method for supporting space blocking based on the self-attribute of multimedia content, which specifically comprises the following steps: aiming at the multimedia content space block, adding block associated information in an MMT (multimedia terminal), wherein the block associated information is information for identifying the association relationship between the original multimedia content and the space block thereof, and simultaneously combining the block associated information with the multimedia content self attribute so as to accurately index the original multimedia content and the space block thereof during storage and transmission.
In the present invention, the information to be added for identifying the association relationship between the original multimedia content and the spatial partition thereof may be various, and preferably, the information may be implemented by taking the following group of information as an example:
information one: indicating whether the multimedia content is a multimedia content spatial partition;
and information II: scales for indicating the space size of the multimedia space content blocks and the relative position of the multimedia space content blocks and the original multimedia content;
and (3) information three: on the basis of the information II, indicating the height size of the multimedia content space block and the position of the multimedia content space block in the vertical direction relative to the original multimedia content;
and information four: and on the basis of the information three, indicating the width size of the multimedia content space block and the position of the multimedia content space block relative to the original multimedia content in the horizontal direction.
The multimedia content may be video, image, audio, etc.
In the present invention, there may be a plurality of methods for combining the block association information with the multimedia content property, and preferably, the following two methods are taken as examples, and the two methods may be used in combination:
the method comprises the following steps: the original multimedia content and the multimedia content space block are taken as the same Media resource Asset, block related information is added in a Media Processing Unit (MPU) package forming Asset, the block related information is fused into the inherent attribute of the MPU, and the inherent relation between the original multimedia content and the space block is established by combining the reference number MPU _ sequence _ number of the Media data Unit in Asset;
the second method comprises the following steps: the original multimedia content and the space blocks thereof are used as different Asset, a belief table or a descriptor is constructed, and the inherent relation between the original multimedia content and the space blocks thereof is established by combining the attribute of the MPU, namely the identifier Asset _ id of the Asset to which the MPU belongs.
Further, the first method specifically comprises the following steps: since the original MPU and its spatial partition MPU in the same Asset have the same MPU _ sequence _ number, if the original MPU and its spatial partition MPU are to be distinguished, partition-related information needs to be added, and the specific addition method may be various, and may be considered from the following points:
1. optionally, a chunk identifier field is set in a Media Processing Unit ("mmpu") Box in the MPU package format, the field indicating whether the multimedia content is a multimedia content space chunk.
2. Whether the original MPU or its spatial chunking MPU, a field is added in a mandatory or optional manner in a Media Processing Unit ("mmpu") Box in MPU package format to identify the association between the original multimedia content and its spatial chunking, so that the MPU can be uniquely identified when the spatial chunking is involved.
3. The method comprises the steps of classifying an original MPU and a space partitioning MPU thereof, and adding corresponding fields only to the multimedia content space partitioning MPU in a selectable mode by combining with classification identifiers, wherein the fields are used for identifying information of incidence relation between the original multimedia content and the space partitioning MPU thereof so as to uniquely identify the MPU when the space partitioning is related.
Further, the second method specifically comprises the following steps: the original MPU and the space block MPU in different Asset have the same MPU _ sequence _ number, the attribute asserted _ id of the MPU is used as the basis for identifying the incidence relation between the original Asset and the space block Asset, and the incidence relation between the original Asset and the space block Asset is constructed around the block incidence information. The expression form of the association relationship can be various, and can be considered by taking the following angle as an example:
1. optionally, a field is fetched or newly created in the reserved data describing Asset attributes, which is used to indicate whether the multimedia content is a space block Asset, to distinguish the original Asset from the space block Asset.
2. And constructing signaling information tile _ association _ message () for describing a spatial association relationship between the original Asset and the spatial block Asset of the media resource.
3. And constructing a signaling table tile _ association _ table () for describing a spatial association relationship between the original Asset and the spatial block Asset of the media resource.
4. And constructing a descriptor tile _ association _ descriptor () for describing a spatial association relationship between the original Asset and the spatial block Asset of the media resource.
Specifically, the method for supporting storage and transmission of spatial partitions based on the attributes of multimedia content itself includes the following steps:
s1: the server side prepares original multimedia content and space blocks thereof;
s2: identifying the incidence relation of the original multimedia content and the space blocks thereof on the space by using the block incidence information;
s3: a user requests a certain space block content of the original multimedia content, and the client stores the received MPU to the local and updates a local storage database;
s4: the user requests the content of other visual angles of the original multimedia content, the client checks the existing space block content in the local database, and requests the MPU (micro processing Unit) left in the space according to the user requirement and the block correlation information.
It should be noted that the codec capability of the terminal device limits the maximum viewing angle of the multimedia content that can be played by the client. The above steps are described by taking a client-side driving mode as an example, and the same method can also be implemented by adopting a server-side driving mode and the like, and the specific steps are as follows:
s1: the server side prepares original multimedia content and space blocks thereof;
s2: identifying the incidence relation of the original multimedia content and the space blocks thereof on the space by using the block incidence information;
s3: the server side obtains the encoding and decoding capacity of the terminal equipment of the user and sends a certain space block content of the adaptive original multimedia content;
s4: the client stores the received MPU to the local and updates a local storage database;
s5: when the server side needs to send the content of other visual angles of the original multimedia content to the user, the existing space block content in the local database of the client side is checked firstly, and then the MPU left in the space is sent according to the block correlation information.
Compared with the prior art, the invention has the following beneficial effects:
the invention provides a storage and transmission method for supporting space blocking based on the self-attribute of multimedia content. Aiming at the multimedia content space block, necessary information is added in the MMT to identify the incidence relation between the original multimedia content and the block thereof, and meanwhile, the block incidence information is combined with the self attribute of the multimedia content, so that the original multimedia content and the space block thereof can be accurately indexed during storage and transmission, and the serious defect that the existing correlation relation between the original multimedia content and the space block thereof is described depending on transmission is overcome.
Furthermore, by adopting the technology of the invention, because the self attribute of the multimedia content is combined into the description of the space block, the association system between the original multimedia content and the space block thereof and between the space block of the multimedia content and the space block of the multimedia content is maintained and established, even if the transmission is separated, the inherent relation in space between the original multimedia content and the space block thereof still exists, which is beneficial to the management of the multimedia content after the space block of the multimedia content, improves the efficiency of effective data storage and transmission, and relieves the pressure of network bandwidth.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
FIG. 1 is a diagram illustrating an example of block association information according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating an embodiment of building block associations according to the present invention;
FIG. 3 is a diagram of a second embodiment of building block association relationships in an embodiment of the present invention;
FIG. 4 is a diagram illustrating an example of modifying the structure of the payload header in an MMT protocol transport packet according to an embodiment of the present invention;
fig. 5 is a flow chart of an embodiment of implementing storage and transmission of partitioned content using the techniques of the present invention.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that variations and modifications can be made by persons skilled in the art without departing from the spirit of the invention. All falling within the scope of the present invention.
Nowadays, internet technology is rapidly developed, and ideas and technologies for fragmenting multimedia content in the time domain to support streaming transmission gradually mature. However, with the rise of 360-degree panoramic video and ultra-high resolution video traffic, multimedia services place an increasingly heavy burden on network bandwidth. Meanwhile, terminal presentation devices are diverse, and the decoding capabilities of the terminal presentation devices on ultrahigh resolution videos are uneven. Therefore, a technology for storing and transmitting multimedia content in a spatial domain in blocks has been a trend. How to identify the multimedia content fragments subjected to the block processing in the spatial domain as in the time domain and establish the inherent relation for storage and transmission is an urgent problem to be solved.
In particular, multimedia contents related to spatial blocking are various, including video, image, etc., and the present invention is described by taking video as an example. The server side stores the original video and the space block video thereof, tries to identify the incidence relation between the original video and the space block video and between the space block video and the space block video from the attribute of the multimedia content, and constructs a storage and transmission method suitable for the space block of the multimedia content. In combination with personal preferences, capabilities of the terminal rendering device, network bandwidth, etc., the user may request the original video or its segmented video. If a part of the video requested by the user is cached in the terminal equipment on the space and the rest part is stored independently at the server side, the system only needs to transmit the required content to the user through the space association relation based on the self attribute of the multimedia content.
In view of the above problems, the following method can be effectively used: reasonably adding block associated information for identifying the information of the association relationship between the original video and the spatial block video thereof, where the block associated information may be various, and may be implemented by, for example, the following group of information, where:
is _ tile: indicating whether the multimedia content is spatially chunked video;
tile _ scale _ height: scales used for indicating the space size of the space block video and the relative position of the space block video and the original video in height;
tile _ scale _ width: scales for indicating the space size of the space block video and the relative position of the space block video and the original video in width;
tile _ height _ top, tile _ height _ bottom: on the basis of tile _ scale _ height, indicating the height size of the space block video and the position of the space block video relative to the original video in the vertical direction;
tile _ width _ left, tile _ width _ right: on the basis of tile _ scale _ width, the width size of the spatially-blocked video and its position in the horizontal direction with respect to the original video are indicated.
For convenience of description, the foregoing description of a set of block association information is referred to in the following embodiments, but in other embodiments, other information may be or may be used.
Taking MMT as an example, reasonably adding block association information, namely is _ tile, tile _ scale _ height, tile _ scale _ width, tile _ height _ top, tile _ height _ bottom, tile _ width _ left and tile _ width _ right, and combining MPU self attribute asset _ id and MPU _ sequence _ number to construct an inherent association relation between multimedia content (taking video service as an example in the following) and spatial blocks thereof.
In certain embodiments of the invention, the implementations include the following two aspects:
establishing block related information
In order to describe the association relationship between the original video and the spatial block video, necessary identification information, i.e. block association information, must be added. Preferably, the following fields can be added as appropriate:
is _ tile (1 bit): indicating whether the MPU is a spatially chunked video.
The value is '1', which indicates that the MPU unit is a space partition of the complete video;
and the value is '0', which indicates that the MPU unit is a complete video.
Tile _ scale _ height (8 bits): and the scale is used for indicating the space size of the space partitioning MPU and the relative position of the space partitioning MPU and the complete MPU in height, and the value range is 1-255.
Tile scale width (8 bits): and the scale for indicating the space size of the space partitioning MPU and the relative position of the space partitioning MPU and the complete MPU on the width ranges from 1 to 255.
Tile _ height _ top (8 bits): on the basis of tile _ scale _ height, indicating the number of scale units of the upper edge of the space partitioning MPU relative to the upper edge of the complete MPU, wherein the value range is '0-254';
tile height bottom (8 bits): on the basis of tile _ scale _ height, the number of scale units of the lower edge of the space partitioning MPU relative to the upper edge of the complete MPU is indicated, and the value range is 1-255.
Tile _ width _ left (8 bits): on the basis of tile _ scale _ width, indicating the number of scale units of the left edge of the space partitioning MPU relative to the left edge of the complete MPU, wherein the value range is '0-254';
tile _ width _ right (8 bits): on the basis of tile _ scale _ width, the number of scale units on the right edge of the space partitioning MPU relative to the left edge of the complete MPU is indicated, and the value range is 1-255.
It should be noted that, in the present invention, the block association information is described only by taking the above fields as an example, and is not limited to the above fields and the sizes thereof. For a better understanding of the meaning of the above fields, reference is made to the example of application shown in fig. 1.
Second, constructing the incidence relation between the original video and the block video
In order to construct the association relationship between the original video and the spatial block video, the following two aspects can be considered:
1. adding inherent attributes of the MPU to identify the spatial block association relationship;
2. the existing attributes of the MPU are utilized, and the signaling information is combined to identify the spatial partitioning association relation.
Thus, specific embodiments may have the following two, and the two may be used in combination:
the first scheme is as follows: the original video and the spatial block video thereof are taken as the same Asset, as shown in fig. 2. Adding block association information in the MPU package, fusing the block association information into MPU inherent attributes, and establishing inherent relation between the original video and the spatial block video by combining MPU _ sequence _ number.
Since there are various specific adding manners of the blocking association information, it is preferable to consider from the following points:
1) a chunking identification field is selectively added to distinguish the original MPU from its spatially chunking MPUs. Taking is _ tile as the block identification field as an example, as a preferred mode, the following identification can be adopted:
2) regardless of the original MPU or its spatial chunking MPU, a corresponding field for identifying information of the association between the original multimedia content and its spatial chunking is added after MPU _ sequence _ number in the "mmpu" Box in a mandatory manner to uniquely identify the MPU when the spatial chunking is involved. Taking the added fields of tie _ scale _ height, tie _ scale _ width, tie _ height _ top, tie _ height _ bottom, tie _ width _ left, and tie _ width _ right as examples, as a preferred mode, the following can be used for identification:
3) the method comprises the steps of classifying an original MPU and a space partitioning MPU thereof, and adding corresponding fields only to the multimedia content space partitioning MPU in a selectable mode by combining with classification identifiers, wherein the fields are used for identifying information of incidence relation between the original multimedia content and the space partitioning MPU thereof so as to uniquely identify the MPU when the space partitioning is related. Taking is _ tile as a classification identifier and adding the fields tile _ scale _ height, tile _ scale _ width, tile _ height _ top, tile _ height _ bottom, tile _ width _ left, and tile _ width _ right as examples, as a preferred mode, the following identification can be adopted:
since the above fields are fused as their inherent attributes in the MPU's package, MPU _ sequence _ number is no longer sufficient to uniquely identify the MPU in Asset. Therefore, in the transmission process, if transmission is to be performed in units of MPUs, the above fields must be combined with MPU _ sequence _ number to uniquely identify the MPUs in the same Asset. For example, when the MMT protocol is used for packet transmission, a new field may be created in the payload header of the MMT protocol transmission packet, and corresponding block association information may be flexibly added according to application requirements. A specific example is shown in fig. 4, wherein "t" refers to the field is _ tile; "reserved" refers to a reserved field of 7 bits; "tile _ scale _ h" refers to the field tile _ scale _ height; "tile _ scale _ w" refers to the field tile _ scale _ width; "tile _ height _ t" refers to the field tile _ height _ top; "tile _ height _ b" refers to the field tile _ height _ bottom; "tile _ width _ l" refers to the field tile _ width _ left; "tile _ width _ r" tile _ width _ right.
Scheme II: the original video and its spatially blocked video are taken as different Asset as shown in fig. 3. The partitioning identification field can be selectively added, belief information, a signaling table or a descriptor is constructed, and the inherent relation between the original video and the space partitioning video of the original video is established by combining the MPU attribute asset _ id.
1) Block identification field
In the second scheme, the addition of the block identification field is flexible. An application example is given below, namely based on a signaling table MP _ table () that provides information required for consumption of a single data packet, a bit is taken out from a reserved field describing Asset as a block identification field is _ tile. As follows:
when the is _ tile value is "1", it represents that Asset belongs to a spatial partition.
2) Because the specific representation forms of the signaling information, the signaling table and the descriptor for representing the association relationship between the original video and the spatial block video thereof by combining the attributes of the multimedia content can be various, preferably, the following three forms can be respectively referred to:
the signaling information form is as follows: and constructing signaling information tile _ association _ message (), and describing the incidence relation between the original Asset and the spatial block Asset of the media resource. As a preferable mode, the following form can be adopted:
signaling table form: and constructing a signaling table tile _ association _ table (), and describing the incidence relation between the original Asset and the spatial block Asset of the media resource. As a preferable mode, the following form can be adopted:
in the above example of signaling information, signaling table, tiledasset _ number indicates the total number of original assets for a spatially chunked, in addition to the fields defined above; the first Asset _ id () indicates the Asset _ id of the original Asset to which the space partitioned Asset belongs; tile _ scale _ number indicates the number of scale types supported by the original Asset of the spatial partition; tile _ number indicates the number of spatial partitions based on a certain scale; the second Asset _ id () indicates the Asset _ id of the spatial partition Asset.
Descriptor form: a descriptor tile _ association _ descriptor () is added to identify the spatial association of a spatial partition Asset with the original Asset. As a preferred mode, the syntax of tile _ association _ descriptor () is defined as follows:
in the above example of a descriptor form, in addition to the fields for which definitions have been given above, Asset _ id () indicates the Asset _ id of the original Asset of the spatially partitioned block to which that Asset belongs. If the Asset itself is the original Asset before the space partition, it can be identified in various ways, for example, setting the field Asset _ id () to its own Asset _ id.
The specific addition position of the descriptor _ association _ descriptor () can be flexibly arranged according to the application. For example, tile _ association _ descriptor () may be added to Asset _ descriptors { } of MP _ table () to identify the spatial association of the spatial block Asset with the original Asset based on the signaling table MP _ table () that provides information required for single packet consumption.
Based on the above expression, a specific application example is given below:
to more clearly illustrate the storage and transmission method for supporting spatial partitioning based on the multimedia content self-attribute proposed in the present invention, fig. 5 illustrates a specific implementation procedure by combining the methods in the signaling information form in the above first and second schemes and using a client-driven mode.
As can be seen from fig. 5, the server spatially divides the complete video into four equal parts, which are respectively the spatial block videos 1, 2, 3, and 4, and the attributes of the videos are identified by the block association information.
When the client logs in the service, the server side sends signaling information, and then the client receives and analyzes the tile _ association _ message (), the CI and the HTML file, and updates the MPU storage database maintained locally.
When a user requests a video of a spatial partition 1, the client finds out Asset _ id () of Asset to which the spatial partition 1 belongs by checking tile _ association _ message (), requests an MPU under the Asset to the server and stores the MPU in local play to the user, and updates a local database.
When the video content requested by the user simultaneously comprises a space block 1 and a space block 2, the Asset _ id () of Asset belonging to the space block 2 is obtained by checking the tile _ association _ message () and a local database, and an MPU fragment belonging to the space block 2 is requested from a server side.
After receiving the video of the spatial block 2, the client side recombines the video of the spatial block 1 with the video of the spatial block 2 into the media content requested by the user.
The above embodiments of the invention illustrate the proposed solutions by way of example for MMT, but these solutions can also be used in other file encapsulation, transmission systems and protocols.
It should be understood that the above embodiments are some of the embodiments of the present invention directed to video multimedia content, and the present invention is also applicable to the storage and transmission of other multimedia content, such as images and the like. This can be achieved by a person skilled in the art.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes and modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention.
Claims (4)
1. A method for storing and transmitting multimedia contents, characterized in that,
indexing the original multimedia content and the multimedia content space blocks corresponding to the original multimedia content by adopting the block associated information so as to store and transmit the multimedia content,
the method comprises the steps that block associated information is combined with self attribute information of multimedia content, the original multimedia content and multimedia content space blocks are used as the same media resources, block associated information is added in a package of a multimedia processing unit, and the original multimedia content and the multimedia content space blocks are both composed of the multimedia processing unit;
the block association information is used for identifying the association relationship between the original multimedia content and the multimedia content space blocks thereof, and comprises the steps of taking the original multimedia content and the multimedia content space blocks as different media resources, constructing a belief table or a descriptor, and establishing the inherent relation between the original multimedia content and the multimedia content space blocks thereof through the identification of the media resources to which the multimedia processing unit belongs.
2. The method of claim 1, wherein the multimedia content is stored and transmitted,
and storing and transmitting the multimedia content as the original multimedia content and/or the multimedia content space block corresponding to the original multimedia content.
3. The method of claim 1, wherein the multimedia content is stored and transmitted,
the block association information includes:
information one: indicating whether the multimedia content is a multimedia content spatial partition;
and information II: and scales indicating the space size of the multimedia content space blocks and the relative position of the multimedia content space blocks and the original multimedia content.
4. The method of claim 3, wherein the multimedia content is stored and transmitted,
the method for indicating the space size of the multimedia content space block and the scale of the relative position of the multimedia content space block and the original multimedia content comprises the following steps: indicating the height dimension of the multimedia content space block and its position in the vertical direction relative to the original multimedia content, and indicating the width dimension of the multimedia content space block and its position in the horizontal direction relative to the original multimedia content.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910527137.5A CN110225371B (en) | 2016-01-27 | 2016-01-27 | Storage and transmission method for supporting space blocking based on media self-attribute |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610056411.1A CN107018431B (en) | 2016-01-27 | 2016-01-27 | A kind of storage and transmission method for supporting space separating based on media self attributes |
| CN201910527137.5A CN110225371B (en) | 2016-01-27 | 2016-01-27 | Storage and transmission method for supporting space blocking based on media self-attribute |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610056411.1A Division CN107018431B (en) | 2016-01-27 | 2016-01-27 | A kind of storage and transmission method for supporting space separating based on media self attributes |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110225371A CN110225371A (en) | 2019-09-10 |
| CN110225371B true CN110225371B (en) | 2020-11-06 |
Family
ID=59439558
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910527137.5A Active CN110225371B (en) | 2016-01-27 | 2016-01-27 | Storage and transmission method for supporting space blocking based on media self-attribute |
| CN201610056411.1A Active CN107018431B (en) | 2016-01-27 | 2016-01-27 | A kind of storage and transmission method for supporting space separating based on media self attributes |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610056411.1A Active CN107018431B (en) | 2016-01-27 | 2016-01-27 | A kind of storage and transmission method for supporting space separating based on media self attributes |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN110225371B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109525842B (en) * | 2018-10-30 | 2022-08-12 | 深圳威尔视觉科技有限公司 | Position-based multi-Tile permutation coding method, device, equipment and decoding method |
| CN115022715B (en) * | 2020-06-04 | 2023-07-25 | 腾讯科技（深圳）有限公司 | Data processing method and equipment for immersion media |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101056404A (en) * | 2007-04-26 | 2007-10-17 | 广东威创日新电子有限公司 | Multi-block parallel compression video data device based on the MCU and its compression method |
| CN101751659A (en) * | 2009-12-24 | 2010-06-23 | 北京优纳科技有限公司 | Large-volume rapid image splicing method |
| CN102123303A (en) * | 2011-03-25 | 2011-07-13 | 天脉聚源(北京)传媒科技有限公司 | Audio/video file playing method and system as well as transmission control device |
| CN102857702A (en) * | 2012-09-18 | 2013-01-02 | 广东威创视讯科技股份有限公司 | Video production method and system |
| CN103563327A (en) * | 2011-06-08 | 2014-02-05 | 皇家Kpn公司 | Locating and retrieving segmented content |
| CN104137564A (en) * | 2011-12-29 | 2014-11-05 | 皇家Kpn公司 | Controlled streaming of segmented content |
| CN104904225A (en) * | 2012-10-12 | 2015-09-09 | 佳能株式会社 | Method and corresponding device for streaming video data |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2692131A4 (en) * | 2011-03-29 | 2015-10-07 | Lyrical Labs LLC | Video encoding system and method |
-
2016
- 2016-01-27 CN CN201910527137.5A patent/CN110225371B/en active Active
- 2016-01-27 CN CN201610056411.1A patent/CN107018431B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101056404A (en) * | 2007-04-26 | 2007-10-17 | 广东威创日新电子有限公司 | Multi-block parallel compression video data device based on the MCU and its compression method |
| CN101751659A (en) * | 2009-12-24 | 2010-06-23 | 北京优纳科技有限公司 | Large-volume rapid image splicing method |
| CN102123303A (en) * | 2011-03-25 | 2011-07-13 | 天脉聚源(北京)传媒科技有限公司 | Audio/video file playing method and system as well as transmission control device |
| CN103563327A (en) * | 2011-06-08 | 2014-02-05 | 皇家Kpn公司 | Locating and retrieving segmented content |
| CN104137564A (en) * | 2011-12-29 | 2014-11-05 | 皇家Kpn公司 | Controlled streaming of segmented content |
| CN102857702A (en) * | 2012-09-18 | 2013-01-02 | 广东威创视讯科技股份有限公司 | Video production method and system |
| CN104904225A (en) * | 2012-10-12 | 2015-09-09 | 佳能株式会社 | Method and corresponding device for streaming video data |
Non-Patent Citations (1)
| Title |
|---|
| ATSC3.0关键技术介绍;何大治;《电视技术》;20150924;第39卷(第16期);第105-114页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107018431A (en) | 2017-08-04 |
| CN107018431B (en) | 2019-07-12 |
| CN110225371A (en) | 2019-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210105335A1 (en) | Processing and caching in an information-centric network | |
| RU2689140C1 (en) | Method, device and computer program for encapsulating segmented synchronized multimedia data | |
| US7986844B2 (en) | Optimized video compression using hashing function | |
| KR101330052B1 (en) | Method for providing content caching service in adapted content streaming and local caching device thereof | |
| US20140165119A1 (en) | Offline download method, multimedia file download method and system thereof | |
| CN105308916A (en) | Method and apparatus for controlling media delivery in multimedia transport network | |
| US10826956B2 (en) | Apparatus and method for providing content | |
| US20110082943A1 (en) | P2p network system and data transmitting and receiving method thereof | |
| TWI786572B (en) | Immersive media providing method and acquiring method, device, equipment and storage medium | |
| US11089285B2 (en) | Transmission device, transmission method, reception device, and reception method | |
| US20180343217A1 (en) | Providing video to subscribers of a messaging system | |
| CN115134632B (en) | Video code rate control method, device, medium and content delivery network CDN system | |
| US20140244763A1 (en) | Apparatus And Method For Level-Based Self-Adjusting Peer-to-Peer Media Streaming | |
| CN110225371B (en) | Storage and transmission method for supporting space blocking based on media self-attribute | |
| CN108810567B (en) | Audio and video visual angle matching method, client and server | |
| CN108551571B (en) | Monitoring video distribution method, device and system and distribution server | |
| CN102572604A (en) | Video on demand system and video on demand method based on P2P (peer-to-peer) network | |
| US10623463B2 (en) | Content supplying apparatus, content supplying method, program, terminal device, and content supplying system | |
| CN106791714A (en) | The matching process and equipment of IP Camera and server device | |
| CN109831467B (en) | Data transmission method, equipment and system | |
| CN103294683A (en) | Automatic subtitle matching system and method for video file | |
| US10587569B2 (en) | Streaming service providing method and device | |
| CN104573518A (en) | Method, device, server and system for scanning files | |
| US10893303B1 (en) | Streaming chunked media segments | |
| CN107784686B (en) | Multi-resolution-based multi-view media presentation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |