CN112839242A - Method for packaging audio/video media file - Google Patents
Method for packaging audio/video media file Download PDFInfo
- Publication number
- CN112839242A CN112839242A CN202011620928.1A CN202011620928A CN112839242A CN 112839242 A CN112839242 A CN 112839242A CN 202011620928 A CN202011620928 A CN 202011620928A CN 112839242 A CN112839242 A CN 112839242A
- Authority
- CN
- China
- Prior art keywords
- audio
- video
- frame
- packet
- media file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 15
- 238000004806 packaging method and process Methods 0.000 title claims description 18
- 238000005538 encapsulation Methods 0.000 claims abstract description 8
- 238000009432 framing Methods 0.000 claims description 6
- 238000005070 sampling Methods 0.000 claims description 4
- 230000002159 abnormal effect Effects 0.000 abstract description 6
- 230000005540 biological transmission Effects 0.000 abstract description 5
- 230000006378 damage Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64784—Data processing by the network
- H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention relates to the field of multimedia playing, in particular to an audio and video media file encapsulation implementation method, which divides an audio and video ES frame into data packets with fixed bytes and numbers the data packets in sequence, adds the heads of the fixed bytes to form new packets, realizes that each data packet contains necessary audio and video information, and solves the problems that the key information of the heads is lost or damaged due to abnormal power failure of a media file and the audio and video cannot be played due to loss of key description information during network transmission through the files consisting of the packets.
Description
Technical Field
The invention relates to the field of multimedia playing, in particular to an audio and video media file encapsulation implementation method.
Background
In recent years, a great deal of network cameras have been developed, real-time images and audio records need to be stored in the cameras, and higher requirements are made on the storage of the images and the audio records.
The conventional media packaging formats, such as the existing media formats of MP4, TS, AVI, RA, RM, RMVB, MPEG, DixX, 3GP, FLV, etc., take up too much CPU for some, some cannot quickly locate a time point specified by a user when the user selects review, some cannot meet the requirement of network streaming, and some may cause the destruction of critical information of the head to cause the inability to play the whole file due to abnormal power failure during recording and storage.
Therefore, a media format that can be quickly located to a specific time, supports streaming, can be played even if the head is missing, occupies less resources, and is suitable for embedded use is needed.
Disclosure of Invention
The technical problems solved by the invention are as follows: the method for packaging the audio/video media file solves the problems that the key information of the head is lost or damaged due to abnormal power failure of the media file and the audio/video cannot be played due to the loss of the key description information during network transmission.
The invention adopts the technical scheme for solving the technical problems that: the method for packaging the audio/video media file comprises the following steps:
s01, dividing the audio and video frame into fixed byte data packets, and numbering in sequence;
s02, adding a head with numbered fixed bytes to the data packet to form a packet;
s03, arranging the packets according to the serial number sequence to form a packaging frame;
and S04, composing the packaging frames into a file according to the time sequence of the frames.
Further, in S01, when the audio/video ES frame data is less than the fixed byte, the insufficient portion is filled with 0 to form a data packet; when the audio/video ES frame exceeds a fixed byte, the audio/video ES frame is divided into a plurality of data packets, and the insufficient part of the last data packet is filled with 0 to form the last data packet.
Further, in S02, the header of the fixed byte includes a sync word, and the sync word is used to detect the start and end of the determination packet.
Further, in S02, the fixed-length header includes re-framing information, and the re-framing information is used to restore the split audio/video ES frame.
Further, in S02, the fixed-length header includes time, encryption flag, reserve _1, reserve _2, payload type, coding type, audio sampling rate, audio channel, number of audio sample bits, current packet valid data length, key frame flag, number of key frame offset packets, and total number of packets in the frame where the data of the current packet is located.
The invention has the beneficial effects that: the audio and video media file packaging implementation method of the invention divides the audio and video ES frame into data packets with fixed bytes and numbers the data packets in sequence, adds the head of the fixed byte to form a new packet, realizes that each data packet contains necessary audio and video information, and solves the problems that the key information of the head is lost or damaged due to abnormal power failure of the media file and the audio and video cannot be played due to loss of key description information during network transmission through the file composed of the packets.
Drawings
Fig. 1 is a flowchart of an embodiment of a method for packaging an audio/video media file according to the present invention.
Fig. 2 is a schematic diagram of a packaged media file according to an embodiment of the method for packaging audio/video media files of the present invention.
Detailed Description
The invention provides a method for packaging audio/video media files, which divides an audio/video ES frame into data packets with fixed bytes and numbers the data packets in sequence, adds the heads of the fixed bytes to form new packets, realizes that each data packet contains necessary audio/video information, and solves the problems that the audio/video cannot be played due to the loss or damage of head key information caused by abnormal power failure of a media file and the loss of key description information during network transmission through the files formed by the packets, and comprises the following steps:
s01, dividing the audio and video frame into fixed byte data packets, and numbering in sequence;
s02, adding a head with numbered fixed bytes to the data packet to form a packet;
s03, arranging the packets according to the serial number sequence to form a packaging frame;
and S04, composing the packaging frames into a file according to the time sequence of the frames.
Further, in S01, when the audio/video ES frame data is less than the fixed byte, the insufficient portion is filled with 0 to form a data packet; when the audio/video ES frame exceeds a fixed byte, the audio/video ES frame is divided into a plurality of data packets, and the insufficient part of the last data packet is filled with 0 to form the last data packet.
Further, in S02, the header of the fixed byte includes a sync word, and the sync word is used to detect the start and end of the determination packet.
Further, in S02, the fixed-length header includes re-framing information, and the re-framing information is used to restore the split audio/video ES frame.
Further, in S02, the fixed-length header includes time, encryption flag, reserve _1, reserve _2, payload type, coding type, audio sampling rate, audio channel, number of audio sample bits, current packet valid data length, key frame flag, number of key frame offset packets, and total number of packets in the frame where the data of the current packet is located.
Example (b):
an embodiment of the present invention is provided below, in which a data packet is fixed with 320 bytes and a packet header is fixed with 16 bytes, as shown in fig. 1:
the first step is as follows: splitting audio and video frames into 320-byte data packets, and numbering the data packets in sequence; specifically, the number of data bytes of the frame is divided by 320, if the remainder is 0, the quotient is the total number of packets of the frame, otherwise, the quotient is added by 1 to be the total number of packets of the frame, the remainder is the effective data length of the last packet of the frame, and the packets are numbered in sequence, wherein the numbering starts from 0.
Secondly, the following steps: adding a head with numbered fixed bytes to a data packet to form a packet; specifically, the packet contains sync _ byte, version, encryption _ type, sync _ byte, reserve _1, payload _ type, audio _ type, video _ type, smaple _ rate, channels, bits, pack _ length, reserve _2, key _ frame _ flag, last _ key _ frame _ offset, current _ pack _ number, pack _ count, and time _ stamp;
sync _ byte is an 8-bit sync word 0x55 for detecting the start of a judgment packet;
version is 3 bits, the initial Version is 1, and the Version is increased after the format field is expanded;
encryption _ type is a 2-bit encryption flag, wherein 0 represents no encryption and 1 represents an encryption mode 1;
reserve _1 is a 3-bit reserved bit;
payload _ type is 1 bit, representing the payload type, where 0 represents audio and 1 represents video;
audio _ type is 3 bits, indicating the audio coding type, where 0 denotes G711A, 1 denotes AAC;
video _ type is 4 bits and represents a video coding type, wherein 0 represents h264 and 1 represents h 265;
a smaple _ rate of 3 bits, representing the audio sampling rate, in bps where 0 refers to 8000, 1 refers to 16000, 2 refers to 32000, 3 refers to 48000, 4 refers to 64000, and 5 refers to 96000;
channels represents audio Channels for 3 bits, where 0 represents mono, 1 represents stereo, and 2 represents 5.1 Channels;
bits is 2 Bits, which represents the number of Bits of the audio sample, where 0 represents 8 Bits, 1 represents 16 Bits, and 2 represents 24 Bits;
pack _ length is 12 bits, and represents the valid data length of the current packet, i.e. the remainder in step 1;
reserv _2 is a 3-bit reserved bit;
key _ frame _ flag is 1 bit, indicating a key frame flag, where 0 indicates a non-key frame and 1 indicates a key frame;
last _ key _ frame _ offset is 16 bits, representing the number of last key frame offset packets;
current _ pack _ number is 16 bits and indicates the number of the current packet in the frame, i.e. the number in step 1;
pack _ count is 16 bits, and represents the total number of packets in the frame where the current packet load is located, i.e. the quotient in step 1 or the quotient plus 1;
time _ stamp is 32 bits, representing time in milliseconds;
the file head information is not updated after one frame of data is written in when the real-time video is stored, the file head cannot be damaged to influence file playing due to abnormal power failure, and the file cannot be played due to loss of key description information in network transmission.
The third step is: arranging the packets according to the serial number sequence to form a packaging frame; the encapsulation frame corresponds to an audio-video frame, which may correspond to an encapsulation frame containing only one packet or a plurality of packets.
Fourthly, the packaging frames are combined into a file according to the corresponding frame sequence, and the file schematic diagram is shown as the attached figure 2.
According to the embodiment, the position of the key frame can be directly jumped to through the offset information of the nearest key frame in the header information of the packet, and the specified time is not required to be located by searching one by one, so that the operation is simple and quick, the video key frame can be quickly located, and the occupation of CPU and IO read-write resources is reduced.
Claims (5)
1. The method for packaging the audio/video media file is characterized by comprising the following steps of:
s01, dividing the audio and video frame into fixed byte data packets, and numbering in sequence;
s02, adding a head with numbered fixed bytes to the data packet to form a packet;
s03, arranging the packets according to the serial number sequence to form a packaging frame;
and S04, composing the packaging frames into a file according to the time sequence of the frames.
2. The method for implementing audio/video media file encapsulation according to claim 1, wherein in S01, when the audio/video ES frame data is less than the fixed byte, the insufficient portion is filled with 0 to form a data packet; when the audio/video ES frame exceeds a fixed byte, the audio/video ES frame is divided into a plurality of data packets, and the insufficient part of the last data packet is filled with 0 to form the last data packet.
3. The method for implementing encapsulation of an audio-video media file according to claim 1, wherein in S02, the header of the fixed byte includes a sync word, and the sync word is used to detect the start and end of the determination packet.
4. The method for implementing audio/video media file encapsulation according to any one of claims 1 to 3, wherein in S02, the header with a fixed length includes re-framing information, and the re-framing information is used to restore the split audio/video ES frames.
5. The method for implementing audio-video media file encapsulation according to any one of claims 1 to 3, wherein in S02, the fixed-length header includes time, encryption identifier, reserve _1, reserve _2, load type, coding type, audio sampling rate, audio channel, audio sample bit number, current packet valid data length, key frame identifier, key frame offset packet number, and total packet number of the frame where the data of the current packet is located.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011620928.1A CN112839242B (en) | 2020-12-31 | 2020-12-31 | Method for packaging audio/video media file |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011620928.1A CN112839242B (en) | 2020-12-31 | 2020-12-31 | Method for packaging audio/video media file |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112839242A true CN112839242A (en) | 2021-05-25 |
| CN112839242B CN112839242B (en) | 2023-02-28 |
Family
ID=75924140
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011620928.1A Active CN112839242B (en) | 2020-12-31 | 2020-12-31 | Method for packaging audio/video media file |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112839242B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000269905A (en) * | 1999-03-18 | 2000-09-29 | Hitachi Eng Co Ltd | Fm teletext transmitter and transmission method therefor |
| WO2007045140A1 (en) * | 2005-10-17 | 2007-04-26 | Huawei Technologies Co., Ltd. | A real-time method for transporting multimedia data |
| WO2008022501A1 (en) * | 2006-08-16 | 2008-02-28 | Zte Corporation | A realizing method of multi-video streams broadcast in mobile multimedia |
| CN102740064A (en) * | 2012-06-15 | 2012-10-17 | 福建星网视易信息***有限公司 | Packing method for streaming media transmission in intercom system |
| US8656442B1 (en) * | 2007-11-21 | 2014-02-18 | BitGravity, Inc. | Efficient video delivery |
| US20170064344A1 (en) * | 2015-08-31 | 2017-03-02 | Gopro, Inc. | Video encoding for reduced streaming latency |
| WO2018145301A1 (en) * | 2017-02-10 | 2018-08-16 | 广东欧珀移动通信有限公司 | Data transmission method and apparatus |
| US10582232B1 (en) * | 2018-10-31 | 2020-03-03 | Amazon Technologies, Inc. | Transcoding frame-synchronous metadata for segmented video delivery |
-
2020
- 2020-12-31 CN CN202011620928.1A patent/CN112839242B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000269905A (en) * | 1999-03-18 | 2000-09-29 | Hitachi Eng Co Ltd | Fm teletext transmitter and transmission method therefor |
| WO2007045140A1 (en) * | 2005-10-17 | 2007-04-26 | Huawei Technologies Co., Ltd. | A real-time method for transporting multimedia data |
| WO2008022501A1 (en) * | 2006-08-16 | 2008-02-28 | Zte Corporation | A realizing method of multi-video streams broadcast in mobile multimedia |
| US8656442B1 (en) * | 2007-11-21 | 2014-02-18 | BitGravity, Inc. | Efficient video delivery |
| CN102740064A (en) * | 2012-06-15 | 2012-10-17 | 福建星网视易信息***有限公司 | Packing method for streaming media transmission in intercom system |
| US20170064344A1 (en) * | 2015-08-31 | 2017-03-02 | Gopro, Inc. | Video encoding for reduced streaming latency |
| WO2018145301A1 (en) * | 2017-02-10 | 2018-08-16 | 广东欧珀移动通信有限公司 | Data transmission method and apparatus |
| US10582232B1 (en) * | 2018-10-31 | 2020-03-03 | Amazon Technologies, Inc. | Transcoding frame-synchronous metadata for segmented video delivery |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112839242B (en) | 2023-02-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8244108B2 (en) | After-recording apparatus | |
| US8218581B2 (en) | Method and apparatus for generating information signal to be recorded | |
| JP4953407B2 (en) | Combining video material and data | |
| US20030077071A1 (en) | Fast forward trick mode and reverse trick mode using an information file | |
| CA2541793A1 (en) | Method and device for recording digital data | |
| CN100416689C (en) | Reproducing apparatus and method, and recording medium | |
| CN112839242B (en) | Method for packaging audio/video media file | |
| TWI278834B (en) | Information storage medium storing multi angle data, and recording method and reproducing apparatus thereof | |
| US8238728B2 (en) | Recording/reproducing apparatus, recording medium and integrated circuit | |
| CN113747209B (en) | Method and device for reorganizing multi-channel TS (transport stream) programs | |
| KR100340753B1 (en) | Block forming method and apparatus of digital bit stream | |
| WO2004043065A1 (en) | Data processing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |