CN111182049A - Distributed transcoding method based on file analysis - Google Patents
Distributed transcoding method based on file analysis Download PDFInfo
- Publication number
- CN111182049A CN111182049A CN201911365610.0A CN201911365610A CN111182049A CN 111182049 A CN111182049 A CN 111182049A CN 201911365610 A CN201911365610 A CN 201911365610A CN 111182049 A CN111182049 A CN 111182049A
- Authority
- CN
- China
- Prior art keywords
- file
- files
- box
- contain
- illegal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000004458 analytical method Methods 0.000 title claims abstract description 13
- 238000001514 detection method Methods 0.000 claims abstract description 20
- 230000000694 effects Effects 0.000 claims abstract description 4
- 238000011144 upstream manufacturing Methods 0.000 claims abstract description 4
- 238000003708 edge detection Methods 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 230000009191 jumping Effects 0.000 claims description 2
- 238000004519 manufacturing process Methods 0.000 abstract description 6
- 238000011835 investigation Methods 0.000 abstract description 3
- 238000013024 troubleshooting Methods 0.000 abstract description 3
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a distributed transcoding method based on file analysis. The method specifically comprises the following steps: (1) the transcoding system analyzes the input files in various formats during demultiplexing and detects whether errors exist or not; (2) analyzing the file content after decoding, and judging whether the content influencing the film watching effect exists; (3) after the file coding is finished, further analyzing the generated file in a multiplexer, and checking whether the file meets the specification; (4) after the three parts of detection are finished, if the file has a problem, stopping the transcoding task, generating a detection report, and reporting that the upstream system file has a problem; otherwise, distributing the file to each platform. The invention has the beneficial effects that: specific developers do not need to be found for investigation, errors are directly submitted to a film source provider for troubleshooting, and production efficiency is greatly improved.
Description
Technical Field
The invention relates to the technical field related to new media and the broadcasting and television industry, in particular to a distributed transcoding method based on file analysis.
Background
Currently, very popular interactive on-demand services require different sources to be aggregated together for transcoding and then distributed to different platforms for playing. Due to the fact that a source file is not standard, such as frame loss, time stamp jumping, lack of audio or partial lack of audio of the file, abnormal playing on a terminal device is caused frequently, and customer experience is affected.
The general transcoding system flow is as follows: the system comprises a demultiplexer, a decoder, a coder and a multiplexer, wherein after a file enters a transcoder system, the file layer operation is carried out through the demultiplexer, audio and video information is analyzed and then sent to the decoder for decoding, then the coder codes data through coding parameters, and finally a target file is generated through the multiplexer for outputting. If the transcoded output file has problems (e.g., playcardon, mosaic, lack of sound, etc.), the end-client will feed back these problems, and the transcoder portion will investigate these problems through various analysis tools.
If the files are manually identified, a large amount of manpower and material resources are consumed, whether a mode is used for processing in transcoding or not is judged, and the production efficiency is improved.
Disclosure of Invention
The invention provides a distributed transcoding method based on file analysis, which can improve the production efficiency and overcome the defects in the prior art.
In order to achieve the purpose, the invention adopts the following technical scheme:
a distributed transcoding method based on file analysis specifically comprises the following steps:
(1) the transcoding system analyzes the input files in various formats during demultiplexing and detects whether errors exist or not;
(2) analyzing the file content after decoding, and judging whether the content influencing the film watching effect exists;
(3) after the file coding is finished, further analyzing the generated file in a multiplexer, and checking whether the file meets the specification;
(4) after the three parts of detection are finished, if the file has a problem, stopping the transcoding task, generating a detection report, and reporting that the upstream system file has a problem; otherwise, distributing the file to each platform.
By the method, the problem of the file with the problem is detected before distribution, and the reason of the error is searched for and solved. When the method is applied to an actual transcoding system, a maintainer can almost independently process the problem of the file, and the error is directly submitted to a film source provider for error checking without finding a specific developer for checking, so that the production efficiency is greatly improved.
Preferably, in step (1), the errors detected at the time of the demultiplexer are: the method comprises the steps of Video file data mass loss, timestamp jump, Audio data mass loss, Audio and Video timestamps are too large to be different, PAT CRC32 errors, PMTCRC32 errors, no moov box contained in an MP4 file, no mvhd box contained in an MP4 file, no trak box contained in an MP4 file, no tkhd box contained in an MP4 file, no mdhd box contained in an MP4 file, no stsd box contained in an MP4 file, no stts box contained in an MP4 file, no stsz box contained in an MP4 file, no stsc box contained in an MP4 file, no stso/co64 box contained in an MP 48 file, no illegal stsd contained in an MP4 file, illegal stts contained in an input MP4 file, illegal stsc 4 file, illegal MP4 file, illegal MP 638 file and illegal MP 638 file.
Preferably, in step (2), the content detected in the decoding stage includes: black frames, mosaics, special or sensitive pictures.
Preferably, in step (3), the errors detected at the multiplexer stage are the same as the errors detected at the demultiplexer stage.
Preferably, the detection method for the mosaic is as follows:
(21) reading an original image, preprocessing the original image, and detecting the edge of the preprocessed original image by using an edge detection method to obtain an edge comprising mosaic edges and non-mosaic edges;
(22) further processing the original image after edge detection by using a Hough line transformation algorithm, and finding out line segments in the horizontal direction and the vertical direction by using a heuristic rule to display the line segments on the image which has the same size as the original image and has all zero pixel values;
(23) detecting the angular points of the image in the previous step by using an angular point detection algorithm, and thresholding the image output by the angular point detection;
(24) and counting the number of the nonzero elements of the final output image to judge whether the image contains mosaic or not.
Preferably, the detection method for the special or sensitive picture is as follows: and establishing a material library in the background, comparing the extracted characteristic value of the face in the video with the face in the material library, and giving an alarm on the page if the matching degree is higher than a set threshold value.
The invention has the beneficial effects that: specific developers do not need to be found for investigation, errors are directly submitted to a film source provider for troubleshooting, and production efficiency is greatly improved.
Drawings
FIG. 1 is a flow chart of a method of the present invention;
Detailed Description
The invention is further described with reference to the following figures and detailed description.
In the embodiment shown in fig. 1, a distributed transcoding method based on file analysis specifically includes the following steps:
(1) the transcoding system analyzes the input files in various formats during demultiplexing and detects whether errors exist or not; errors detected at the demultiplexer are: video file data loss, time stamp jump, Audio data loss, Audio and Video time stamps are too different, PAT CRC32 error, PMT CRC32 error, MP4 file does not contain moov box, MP4 file does not contain mvhd box, MP4 file does not contain trak box, MP4 file does not contain tkhd box, MP4 file does not contain mdhd box, MP4 file does not contain stsd box, MP4 file does not contain stts box, MP4 file does not contain stsz box, MP4 file does not contain stsc box, MP4 file does not contain stso/64 box, MP4 file illegal stsd, input MP4 file stts, illegal stsz of input MP4 file, illegal stsc of input MP4 file, illegal MP4 file of illegal stsc/64;
(2) analyzing the file content after decoding, and judging whether the content influencing the film watching effect exists; the content detected in the decoding stage is as follows: black frames, mosaics, special or sensitive pictures;
the detection method for the mosaic is as follows:
(21) reading an original image, preprocessing the original image, and detecting the edge of the preprocessed original image by using an edge detection method to obtain an edge comprising mosaic edges and non-mosaic edges;
(22) further processing the original image after edge detection by using a Hough line transformation algorithm, and finding out line segments in the horizontal direction and the vertical direction by using a heuristic rule to display the line segments on the image which has the same size as the original image and has all zero pixel values;
(23) detecting the angular points of the image in the previous step by using an angular point detection algorithm, and thresholding the image output by the angular point detection;
(24) and counting the number of the nonzero elements of the final output image to judge whether the image contains mosaic or not.
The detection method for special or sensitive pictures is as follows: and establishing a material library in the background, comparing the extracted characteristic value of the face in the video with the face in the material library, and giving an alarm on the page if the matching degree is higher than a set threshold value.
(3) After the file coding is finished, further analyzing the generated file in a multiplexer, and checking whether the file meets the specification; the errors detected at the multiplexer stage are the same as those detected at the demultiplexer stage;
(4) after the three parts of detection are finished, if the file has a problem, stopping the transcoding task, generating a detection report, and reporting that the upstream system file has a problem; otherwise, distributing the file to each platform.
When the method is applied to an actual transcoding system, a maintainer can almost independently process the problem of the file, and the error is directly submitted to a film source provider for error troubleshooting without finding out specific developers for investigation, so that the processing efficiency of the whole transcoding error is improved, and the production efficiency is greatly improved.
Claims (6)
1. A distributed transcoding method based on file analysis is characterized by comprising the following steps:
(1) the transcoding system analyzes the input files in various formats during demultiplexing and detects whether errors exist or not;
(2) analyzing the file content after decoding, and judging whether the content influencing the film watching effect exists;
(3) after the file coding is finished, further analyzing the generated file in a multiplexer, and checking whether the file meets the specification;
(4) after the three parts of detection are finished, if the file has a problem, stopping the transcoding task, generating a detection report, and reporting that the upstream system file has a problem; otherwise, distributing the file to each platform.
2. The distributed transcoding method based on file analysis as claimed in claim 1, wherein in step (1), the errors detected at the demultiplexer are: the method comprises the steps of Video file data mass loss, time stamp jumping, Audio data mass loss, Audio and Video time stamps are greatly different, PAT CRC32 errors, PMT CRC32 errors, MP4 files do not contain moov box, MP4 files do not contain mvhd box, MP4 files do not contain trak box, MP4 files do not contain tkhd box, MP4 files do not contain mdhd box, MP4 files do not contain stsd box, MP4 files do not contain stts box, MP4 files do not contain stsz box, MP4 files do not contain stsc box, MP4 files do not contain stso/co64 box, MP4 files illegal stsd, input MP4 files, illegal stts of input MP 8 files, illegal stsz of illegal stsc of input MP4 files, illegal MP4 files of illegal MP 638 files, illegal MP 4/MP 686 files.
3. A distributed transcoding method based on file analysis as claimed in claim 1 or 2, wherein in step (2), the content detected in the decoding stage is: black frames, mosaics, special or sensitive pictures.
4. The distributed transcoding method of claim 2, wherein in step (3), the error detected in the multiplexer stage is the same as the error detected in the demultiplexer stage.
5. The distributed transcoding method based on file analysis of claim 3, wherein the detection method for the mosaic is as follows:
(21) reading an original image, preprocessing the original image, and detecting the edge of the preprocessed original image by using an edge detection method to obtain an edge comprising mosaic edges and non-mosaic edges;
(22) further processing the original image after edge detection by using a Hough line transformation algorithm, and finding out line segments in the horizontal direction and the vertical direction by using a heuristic rule to display the line segments on the image which has the same size as the original image and has all zero pixel values;
(23) detecting the angular points of the image in the previous step by using an angular point detection algorithm, and thresholding the image output by the angular point detection;
(24) and counting the number of the nonzero elements of the final output image to judge whether the image contains mosaic or not.
6. The distributed transcoding method based on file analysis of claim 3, wherein the detection method for the special or sensitive picture is as follows: and establishing a material library in the background, comparing the extracted characteristic value of the face in the video with the face in the material library, and giving an alarm on the page if the matching degree is higher than a set threshold value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911365610.0A CN111182049A (en) | 2019-12-26 | 2019-12-26 | Distributed transcoding method based on file analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911365610.0A CN111182049A (en) | 2019-12-26 | 2019-12-26 | Distributed transcoding method based on file analysis |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111182049A true CN111182049A (en) | 2020-05-19 |
Family
ID=70650458
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911365610.0A Pending CN111182049A (en) | 2019-12-26 | 2019-12-26 | Distributed transcoding method based on file analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111182049A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102024043A (en) * | 2010-12-12 | 2011-04-20 | 成都东方盛行电子有限责任公司 | Media data quality deep-detection and control method |
| CN102984546A (en) * | 2012-11-01 | 2013-03-20 | 上海文广互动电视有限公司 | Transcoding service system for distributed video transcoding |
| US20130077858A1 (en) * | 2011-09-22 | 2013-03-28 | Himax Imaging Limited | Image processing module and image processing method |
| CN106131668A (en) * | 2016-06-30 | 2016-11-16 | 杭州当虹科技有限公司 | A kind of audio-video monitoring warning system pushing alarm based on mobile device message |
| CN107818568A (en) * | 2017-09-29 | 2018-03-20 | 昆明理工大学 | A kind of video mosaic detection method |
| CN109787942A (en) * | 2017-11-14 | 2019-05-21 | 广州市动景计算机科技有限公司 | Multimedia file submission and dissemination method and device |
| US10310928B1 (en) * | 2017-03-27 | 2019-06-04 | Amazon Technologies, Inc. | Dynamic selection of multimedia segments using input quality metrics |
-
2019
- 2019-12-26 CN CN201911365610.0A patent/CN111182049A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102024043A (en) * | 2010-12-12 | 2011-04-20 | 成都东方盛行电子有限责任公司 | Media data quality deep-detection and control method |
| US20130077858A1 (en) * | 2011-09-22 | 2013-03-28 | Himax Imaging Limited | Image processing module and image processing method |
| CN102984546A (en) * | 2012-11-01 | 2013-03-20 | 上海文广互动电视有限公司 | Transcoding service system for distributed video transcoding |
| CN106131668A (en) * | 2016-06-30 | 2016-11-16 | 杭州当虹科技有限公司 | A kind of audio-video monitoring warning system pushing alarm based on mobile device message |
| US10310928B1 (en) * | 2017-03-27 | 2019-06-04 | Amazon Technologies, Inc. | Dynamic selection of multimedia segments using input quality metrics |
| CN107818568A (en) * | 2017-09-29 | 2018-03-20 | 昆明理工大学 | A kind of video mosaic detection method |
| CN109787942A (en) * | 2017-11-14 | 2019-05-21 | 广州市动景计算机科技有限公司 | Multimedia file submission and dissemination method and device |
Non-Patent Citations (2)
| Title |
|---|
| 李鑫: ""融媒体时期的云转码平台建设"", 《广播电视信息》 * |
| 林园: ""分布式视频转码***设计"", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11558659B2 (en) | Methods and apparatus to detect commercial advertisements associated with media presentations | |
| CN107483460B (en) | Method and system for multi-platform parallel broadcasting and stream pushing | |
| US9549197B2 (en) | Visual dynamic range timestamp to enhance data coherency and potential of metadata using delay information | |
| KR101367459B1 (en) | System and method for distributing auxiliary data embedded in video data | |
| CN107682352B (en) | Meter, method, storage medium and system for monitoring streaming media | |
| US11895361B2 (en) | Automatic content recognition and verification in a broadcast chain | |
| US11395036B2 (en) | Automatic annotation of video quality impairment training data for generating machine learning models of video quality prediction | |
| US10631023B2 (en) | Validating and calibrating splice points in interstitial content | |
| CN113382284B (en) | Pirate video classification method and device | |
| US20140176728A1 (en) | Receiver and a transmitter | |
| CN110896503A (en) | Video and audio synchronization monitoring method and system and video and audio broadcasting system | |
| US11356721B2 (en) | Techniques for automatically removing content from closed-caption data embedded in a video signal | |
| CN117981329A (en) | System and method for monitoring content display using embedded watermarks | |
| US20160042487A1 (en) | System and Method to detect video piracy | |
| CN111182049A (en) | Distributed transcoding method based on file analysis | |
| US11425452B2 (en) | Methods and apparatus to detect audio engineering problems using identification of isolated watermarks | |
| KR101372639B1 (en) | Method and apparatus for commercial detecting | |
| CN110381308B (en) | System for testing live video processing effect | |
| CN112653930A (en) | Video editing method and system | |
| CN102857812B (en) | A kind of fault-tolerance approach supporting TS files in stream media and system | |
| CN102647614A (en) | Method and device for achieving video high definition | |
| Kedačić et al. | Application for testing of video and subtitle synchronization | |
| US20230171449A1 (en) | Providing frame accurate replacement signals in content streams | |
| CN111885395B (en) | Video monitoring method, device and system | |
| KR101461513B1 (en) | Automaton Apparatus and Method of Image Quality Evaluation in Digital Cinema |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200519 |