CN110198458A - A kind of processing method and processing device of encrypted audio/video data - Google Patents
A kind of processing method and processing device of encrypted audio/video data Download PDFInfo
- Publication number
- CN110198458A CN110198458A CN201910472940.3A CN201910472940A CN110198458A CN 110198458 A CN110198458 A CN 110198458A CN 201910472940 A CN201910472940 A CN 201910472940A CN 110198458 A CN110198458 A CN 110198458A
- Authority
- CN
- China
- Prior art keywords
- data
- audio
- video
- encryption
- size
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 25
- 238000012545 processing Methods 0.000 title claims abstract description 19
- 230000000153 supplemental effect Effects 0.000 claims abstract description 44
- 230000003993 interaction Effects 0.000 claims abstract description 36
- 230000011664 signaling Effects 0.000 claims abstract description 35
- 239000013589 supplement Substances 0.000 claims abstract description 10
- 238000012790 confirmation Methods 0.000 claims abstract description 5
- 230000005540 biological transmission Effects 0.000 claims description 17
- 238000004422 calculation algorithm Methods 0.000 claims description 12
- 230000008901 benefit Effects 0.000 claims description 5
- 238000000605 extraction Methods 0.000 claims description 4
- 230000000295 complement effect Effects 0.000 claims description 3
- 241001269238 Data Species 0.000 claims description 2
- 238000007906 compression Methods 0.000 abstract description 12
- 230000006835 compression Effects 0.000 abstract description 12
- 238000000034 method Methods 0.000 abstract description 11
- 238000013144 data compression Methods 0.000 description 8
- 238000012546 transfer Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000001502 supplementing effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/633—Control signals issued by server directed to the network components or client
- H04N21/6332—Control signals issued by server directed to the network components or client directed to client
- H04N21/6334—Control signals issued by server directed to the network components or client directed to client for authorisation, e.g. by transmitting a key
- H04N21/63345—Control signals issued by server directed to the network components or client directed to client for authorisation, e.g. by transmitting a key by transmitting keys
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention discloses a kind of processing method and processing device of encrypted audio/video data, and wherein method is used for each terminal device, comprising: obtains audio/video flow data, and to audio/video flow data encoding；Feature frame data are extracted from the audio/video flow data after coding；Obtain the interaction request signaling that server is sent；Feature frame data and interaction request signaling are encrypted simultaneously and obtain encryption data；Encryption data is stored in the supplemental enhancement information unit of audio-video code stream data structure；Whether the size of data of the encryption data in confirmation supplemental enhancement information unit is less than preset data size；When the size of data of the encryption data in supplemental enhancement information unit is less than preset data size, progress character supplement is so that the size of data of encryption data reaches preset data size in supplemental enhancement information unit.The real-time of encryption can be improved in the present invention, can also further enhance the safety of information, while also reducing the compression time delay of data entirety, and improve compression efficiency.
Description
Technical field
The present invention relates to audio-video security technology areas, and in particular to a kind of processing method and dress of encrypted audio/video data
It sets.
Background technique
With the rapid development of network and multimedia technology, more and more audio, video datas start wide on the internet
General application, meanwhile, also with the continuous enhancing of the Copyright Awareness of people, people begin to focus on the copyright protection to audio, video data
And safe and secret problem.Therefore, the encipherment protection of audio, video data is more and more important in internet communication transmission.
Audio, video data in currently available technology in the process of encryption, usually to the audio-video document recorded
Total data information encrypted simultaneously as a whole, be based on identical key pair sound view using complicated Encryption Algorithm
Frequency file is encrypted, and never considers the type of data format of audio-video document, but since audio, video data is based on specific
What data format was encrypted simultaneously, therefore, this will lead to playing audio/video and can not carry out to the audio, video data encrypted
Normal decryption plays.In addition, in the prior art there is also being encrypted using the Encryption Algorithm of entropy coding to audio, video data,
Its in the process of encryption, only to the chrominance residual data encryption after colour switching, due to chrominance residual data only have it is several
Bit needs to continue that the bitstream data for 64 packet sizes that gather together enough is waited just to carry out data transmission, therefore, will lead to network biography
Defeated time delay increases, and the increase of data compression time delay and efficiency of data compression is caused to reduce.
Summary of the invention
Therefore, technical problems to be solved of the embodiment of the present invention are in the prior art since audio, video data is based on spy
What fixed data format was encrypted simultaneously, cause playing audio/video that can not carry out to the audio, video data encrypted normal
Decryption plays, also, in the process of encryption, needs to continue that the bitstream data for 64 packet sizes that gather together enough is waited just to be counted
According to transmission, network transfer delay increase will lead to, cause data compression time delay to increase reduces with efficiency of data compression.
For this purpose, the embodiment of the invention provides following technical solutions:
According in a first aspect, the embodiment of the present invention provides a kind of processing method of encrypted audio/video data, for each terminal
Equipment includes the following steps:
Audio/video flow data are obtained, and to the audio/video flow data encoding；
Feature frame data are extracted from the audio/video flow data after the coding；
Obtain the interaction request signaling that server is sent；
The feature frame data and the interaction request signaling are encrypted simultaneously and obtain encryption data；
The encryption data is stored in the supplemental enhancement information unit of audio-video code stream data structure；
It is big to confirm whether the size of data of the encryption data in the supplemental enhancement information unit is less than preset data
It is small；
When the size of data of the encryption data in the supplemental enhancement information unit is less than preset data size, in institute
It states and carries out character supplement in supplemental enhancement information unit so that the size of data of the encryption data reaches the present count
According to size.
With reference to first aspect, in first aspect first embodiment, the processing method of the encrypted audio/video data,
Further include:
When the encryption data in the supplemental enhancement information unit size of data be not less than preset data size, deposit
Store up the encryption data and as data to be sent.
With reference to first aspect, in first aspect second embodiment, the audio-video code stream data structure is H264 code
Stream data structure.
With reference to first aspect, in first aspect third embodiment, the supplemental enhancement information unit for user into
Row self-defining data Format Type.
With reference to first aspect, in the 4th embodiment of first aspect, the interaction request signaling includes heartbeat message, code
Stream adjusts information and code stream protocol address information.
With reference to first aspect, in the 5th embodiment of first aspect, the characteristic frame data include: intracoded frame and
Forward prediction frame.
With reference to first aspect, in first aspect sixth embodiment, using symmetric encipherment algorithm to the feature frame number
Encryption data is obtained according to encrypting simultaneously with the interaction request signaling.
According to second aspect, the embodiment of the present invention provides a kind of processing unit of encrypted audio/video data, is used for each terminal
Equipment, comprising:
First obtains module, for obtaining audio/video flow data, and to the audio/video flow data encoding；
Extraction module, for extracting feature frame data from the audio/video flow data after the coding；
Second obtains module, for obtaining the interaction request signaling of server transmission；
Encrypting module obtains encryption data for encrypting simultaneously to the feature frame data and the interaction request signaling；
Storage module, for the encryption data to be stored in the supplemental enhancement information unit of audio-video code stream data structure
In；
Whether confirmation module, the size of data for confirming the encryption data in the supplemental enhancement information unit are small
In preset data size；
Complementary module is less than default for the size of data when the encryption data in the supplemental enhancement information unit
Size of data carries out character supplement so that the size of data of the encryption data reaches in the supplemental enhancement information unit
To the preset data size.
According to the third aspect, the embodiment of the present invention provides a kind of storage medium, is stored thereon with computer instruction, the instruction
The processing of encrypted audio/video data described in first aspect or first aspect any embodiment is realized when being executed by processor
The step of method.
According to fourth aspect, the embodiment of the present invention provides a kind of terminal device, including memory, processor and is stored in
On reservoir and the computer program that can run on a processor, the processor realizes first aspect or the when executing described program
The step of processing method of encrypted audio/video data described in one side any embodiment.
Technical solution of the embodiment of the present invention, has the advantages that
The processing method and processing device of encrypted audio/video data in the embodiment of the present invention, wherein method, obtains sound view in real time
The real-time of encryption can be improved in frequency flow data, and at the same time the feature frame data and interaction request signaling to audio/video flow into
Row encryption, can further enhance the safety of information, and encrypted information is stored in supplemental enhancement information unit makes
It carries out data transmission in the case where reaching preset data size, the compression time delay of its data entirety can be improved compression
Efficiency, further supplementing the encryption data for being unsatisfactory for preset data size meets the requirements it, is convenient for data compression and data
It sends.
Detailed description of the invention
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art
Embodiment or attached drawing needed to be used in the description of the prior art be briefly described, it should be apparent that, it is described below
Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor
It puts, is also possible to obtain other drawings based on these drawings.
Fig. 1 is the flow chart of the processing method of encrypted audio/video data in the embodiment of the present invention；
Fig. 2 is the flow chart of symmetric encipherment algorithm in the embodiment of the present invention；
Fig. 3 is the structural block diagram of the processing unit of encrypted audio/video data in the embodiment of the present invention；
Fig. 4 is the hardware structural diagram of terminal device in the embodiment of the present invention.
Specific embodiment
It is clearly and completely described below in conjunction with technical solution of the attached drawing to the embodiment of the present invention, it is clear that described
Embodiment be a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, this field is general
Logical technical staff every other embodiment obtained without making creative work belongs to what the present invention protected
Range.
In the description of the embodiment of the present invention, it should be noted that term " center ", "upper", "lower", "left", "right",
The orientation or positional relationship of the instructions such as "vertical", "horizontal", "inner", "outside" is to be based on the orientation or positional relationship shown in the drawings,
It is merely for convenience of the description embodiment of the present invention and simplifies description, rather than the device or element of indication or suggestion meaning must have
There is specific orientation, be constructed and operated in a specific orientation, therefore is not considered as limiting the invention.In addition, term " the
One ", " second ", " third " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance.
In the description of the embodiment of the present invention, it should be noted that unless otherwise clearly defined and limited, term " peace
Dress ", " connected ", " connection " shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or integrally
Connection；It can be mechanical connection, be also possible to be electrically connected；Can be directly connected, can also indirectly connected through an intermediary,
It can also be the connection inside two elements, can be wireless connection, be also possible to wired connection.For the common skill of this field
For art personnel, the concrete meaning of above-mentioned term in the present invention can be understood with concrete condition.
As long as in addition, the non-structure each other of technical characteristic involved in invention described below different embodiments
It can be combined with each other at conflict.
Embodiment 1
The embodiment of the present invention provides a kind of processing method of encrypted audio/video data, is used for each terminal device, herein each
Terminal device can be video conference terminal or other types of mobile terminal device, and each terminal device is for the stream matchmaker with distal end
Body server sets up communication interaction.Specifically, the processing method of the encrypted audio/video data in the present embodiment, as shown in Figure 1,
Include the following steps:
Step S1: audio/video flow data are obtained, and to audio/video flow data encoding.Audio/video flow data herein indicate benefit
It is being recorded with stream media equipment and continuous audio data and/or video data, not stream media equipment has recorded
Audio, video data.Therefore, the audio/video flow data in the present embodiment are the audio data and/video data of real-time recording, such as:
Audio/video flow data can be MP3 audio data or MP4 video data.In order to which audio/video flow data can preferably carry out data
Transmission, needs to encode audio and video data streams, i.e., audio/video flow data is transformed into the coded data of binary form, this
Coding in embodiment uses h264 coded format, adds after being encoded in real time to audio/video flow data using h264 coded format
It is close.Obtaining audio/video flow data can be conducive to improve enciphering rate, guarantee the real-time of data encoding and encryption.
Step S2: feature frame data are extracted from the audio/video flow data after coding.Feature frame data herein are in frame
Coded frame, forward prediction frame, do not include bi-directional predicted frames, and wherein intracoded frame is the I frame in h264 coded format, forward in advance
Surveying frame is the P frame in h264 format, and bi-directional predicted frames are the B frame in h264 coded format.What is shown due to I frame, P frame is complete
Audio frame or video frame do not need to handle B frame to improve enciphering rate.The pass of I frame, P frame as audio/video flow
Key frame extracts I frame, the P frame of every frame audio/video flow data according to the frame identification for analyzing every frame audio/video flow data.Characteristic frame
Data are as the important information in audio/video flow data, as long as effectively being encrypted to these important informations, so that it may ensure sound
The safety of video stream data is encrypted without the whole content information to audio/video flow data, therefore, largely
On, the data encryption size of audio/video flow data can be reduced, the transmission speed for improving data is conducive to.
Step S3: the interaction request signaling that server is sent is obtained.Interaction request instruction herein includes heartbeat message, code
Stream adjusts information and code stream protocol address information.Wherein can heartbeat message lead to for detecting each terminal device and establish with server
Letter connection, code stream adjust information and are used to adjust the code rate of audio, video data or the command information of frame per second, code stream protocol address information
Predominantly each terminal device carries out plug-flow to server or draws the protocol address information of stream.
Step S4: feature frame data and interaction request signaling are encrypted simultaneously and obtain encryption data.Encryption herein is main
Feature frame data and interaction request signaling are encrypted simultaneously using symmetric encipherment algorithm and obtain encryption data, why by extraction
Feature frame data are encrypted simultaneously with interaction request signaling, be because of traditional audio, video data based on entropy coding, due to
Audio, video data after entropy coding is the brightness and chrominance residual data after prediction variation quantization, often only to chrominance residual number
According to being encrypted, but the chrominance residual data are only several bit streams, need the chrominance residual for continuing to wait next group at this time
Data, which gather together enough, just carries out data encryption to a certain size, it is clear that extends encryption times, results in whole data efficiency drop
It is low, also, next group of chrominance residual data are excessive, also the compression ratio of audio, video data can be made to change, and different
When will also result in network transmission delay, packet loss and congestion occur for the audio, video data of size of data to gather into a group encryption
The phenomenon that.In addition, if data encryption directly to several bit streams, it is clear that also result in encryption higher cost.
Interaction request signaling and feature frame data are encrypted the data for making it be unlikely to encryption as far as possible by the present embodiment simultaneously
It is too small, it further can be achieved to reduce encryption cost.The present embodiment uses symmetric encipherment algorithm, and symmetric encipherment algorithm belongs to more real
Data encryption algorithm, encryption precision are higher.
Specifically, feature frame data and interaction request signaling are encrypted using symmetric encipherment algorithm, as shown in Fig. 2,
That is the first step obtains K0=IP by a fixed initial permutation IP displacement K using the json plaintext of DIVUCSA specification
(K)=H0L0, H0 are high byte 32 of K0, and L0 is low byte 32 of K0；Second step carries out the 16 identical operations of wheel,
Data are combined with key herein, third step, and the inverse permutation for H16L16 application initial permutation IP obtains encryption data.
More specifically, the signaling for including in " interaction request signaling flow ", format use DIVUCSA agreement, encryption or in plain text transmission.
Interaction request signaling frame is as follows:
Wherein parameter is as follows:
(1)payload_type:
Plaintext transfer mode, payload_type are equal to 5.
Ciphertext transfer mode, payload_type are equal to 260 (255+X).
X value is as follows:
X=6:XOR
X=7:DES
X=8:AES
X=128: enciphered video data
X=129: encrypted audio data
X=other: retention
(2)UUID[16]
Plaintext transfer mode, UUID are random strings.
Ciphertext transfer mode, UUID are encrypted public key (most of Encryption Algorithm does not need public key).
(3)DIVUCSA
Plaintext transfer mode meets the JSON data of DIVUCSA specification.
Ciphertext transfer mode, the JSON data for meeting DIVUCSA specification after cryptographic calculation.
Basic format is as follows:
Step S5: encryption data is stored in the supplemental enhancement information unit of audio-video code stream data structure.Herein
Audio-video code stream data structure is the processing that the H264 bit stream data structure H264 bit stream data structure is convenient for audio, video data.This
The supplemental enhancement information unit at place is abbreviation SEI, and SEI is a part in H264 bit stream data structure, and SEI is mainly used for user
Self-defining data Format Type is carried out, since the data format of SEI uses the type of data format storing data of standard, not shadow
The decoding for ringing the audio, video data stored in H264 bit stream data structure plays.Also, SEI can be quickly recognized and H264 code
Flow data has the data of conflict.
Step S6: it is big whether the size of data of the encryption data in confirmation supplemental enhancement information unit is less than preset data
It is small.Preset data size herein is the size of data of 64 bit bytes, and certainly, preset data size can also be 128 bit bytes
Or the byte of other digits.Under normal conditions, the size of data of encrypted feature frame data and interaction request signaling be greater than or
Byte equal to 64, even if encrypted feature frame data and interaction request signaling but are also close to 64 less than 64 bit bytes
The size of bit byte.Confirm the purpose of encryption data in supplemental enhancement information unit herein in order to guarantee to believe supplement enhancing
The data of interest statement member storage carry out data transmission simultaneously, and then improve network transmission efficiency, in order to avoid occur during transmission
Data packetloss, and the data fundamental type of the storage in supplemental enhancement information unit is consistent, therefore, stores it in benefit
The compression ratio that data will not be changed is filled in enhancement information unit.
Step S7: when the encryption data in supplemental enhancement information unit size of data be less than preset data size, mending
It fills in enhancement information unit and carries out character supplement so that the size of data of encryption data reaches preset data size.Normal condition
Under, the byte data more than or equal to 64 is housed in supplemental enhancement information unit, is stored when in supplemental enhancement information unit
Byte of the data less than 64 can reach 64 in the head position of supplemental enhancement information unit or tail position secondary characters
Byte-sized, such as: for the encryption data of 00000001 beginning, if its size of data less than 64 bit bytes, leader knows+
Data can supplement into leader knowledge+data: 00... (N) ... 00, or FF reaches the size of 64 bit bytes to FF... (N) ....
The encryption data of feature frame data and interaction request signaling is encapsulated in supplemental enhancement information unit by the present embodiment, can be regarded with sound
The overall compression efficiency of frequency evidence, reduces the compression time delay of audio, video data, while having in the case where guaranteeing data security
There is very high real-time, is also convenient for each terminal device and broadcasting is decoded to the data stored in supplemental enhancement information unit.
Step S8: when the encryption data in supplemental enhancement information unit size of data be not less than preset data size, deposit
Store up encryption data and as data to be sent.I.e. encrypted feature frame data and interaction request signaling are to meet supplement to increase
The requirement of strong information unit storage information.SEI is a part in H264 bit stream data structure, and SEI is mainly used for user's progress
Self-defining data Format Type is not influenced since the data format of SEI uses the type of data format storing data of standard
The decoding of the audio, video data stored in H264 bit stream data structure plays.Therefore, encryption data is placed in SEI and is sealed
Efficiency of data compression largely can be improved convenient for data transmission and decoding terminals in dress storage.
Specifically, encryption data is packaged into SEI by following format.
Encrypted audio/video data will encapsulate as follows:
The processing method of encrypted audio/video data in the embodiment of the present invention obtains audio/video flow data, Ke Yiti in real time
The real-time of height encryption, and at the same time the feature frame data and interaction request signaling to audio/video flow encrypt, it can be into one
The safety of enhancement information is walked, and encrypted information, which is stored in supplemental enhancement information unit, makes it reach preset data
Data transmission is carried out in the case where size, can be by the compression time delay of its data entirety, raising compression efficiency, to being unsatisfactory for presetting
The encryption data of size of data, which is further supplemented, meets the requirements it, sends convenient for data compression and data.
Embodiment 2
The embodiment of the present invention provides a kind of processing unit of encrypted audio/video data, each terminal device is used for, such as Fig. 3 institute
Show, comprising:
First obtains module 31, for obtaining audio/video flow data, and to audio/video flow data encoding；
Extraction module 32, for extracting feature frame data from the audio/video flow data after coding；
Second obtains module 33, for obtaining the interaction request signaling of server transmission；
Encrypting module 34 obtains encryption data for encrypting simultaneously to feature frame data and interaction request signaling；
Storage module 35, for encryption data to be stored in the supplemental enhancement information unit of audio-video code stream data structure
In；
Confirmation module 36, for confirming it is default whether the size of data of the encryption data in supplemental enhancement information unit is less than
Size of data；
It is big to be less than preset data for the size of data when the encryption data in supplemental enhancement information unit for complementary module 37
It is small, character supplement is carried out in supplemental enhancement information unit so that the size of data of encryption data reaches preset data size.
The processing unit of encrypted audio/video data in the embodiment of the present invention, in Fig. 3, further includes:
Memory module 38 is not less than preset data for the size of data when the encryption data in supplemental enhancement information unit
Size stores encryption data and as data to be sent.
The processing unit of encrypted audio/video data in the embodiment of the present invention, audio-video code stream data structure are H264 code stream
Data structure.
The processing unit of encrypted audio/video data in the embodiment of the present invention, supplemental enhancement information unit are carried out for user
Self-defining data Format Type.
The processing unit of encrypted audio/video data in the embodiment of the present invention, interaction request signaling include heartbeat message, code
Stream adjusts information and code stream protocol address information.
The processing unit of encrypted audio/video data in the embodiment of the present invention, characteristic frame data include: intracoded frame and
Forward prediction frame.
The processing unit of encrypted audio/video data in the embodiment of the present invention, using symmetric encipherment algorithm to feature frame data
It is encrypted simultaneously with interaction request signaling and obtains encryption data.
The processing unit of encrypted audio/video data in the embodiment of the present invention obtains audio/video flow data, Ke Yiti in real time
The real-time of height encryption, and at the same time the feature frame data and interaction request signaling to audio/video flow encrypt, it can be into one
The safety of enhancement information is walked, and encrypted information, which is stored in supplemental enhancement information unit, makes it reach preset data
Data transmission is carried out in the case where size, can be by the compression time delay of its data entirety, raising compression efficiency, to being unsatisfactory for presetting
The encryption data of size of data, which is further supplemented, meets the requirements it, sends convenient for data compression and data.
Embodiment 3
The embodiment of the present invention provides a kind of storage medium, is stored thereon with computer instruction, which is executed by processor
In Shi Shixian embodiment 1 the step of the processing method of encrypted audio/video data.Audio-video fluxion is also stored on the storage medium
According to feature frame data, interaction request signaling, encryption data and preset data size etc..Wherein, storage medium can for magnetic disk,
CD, read-only memory (Read-Only Memory, ROM), random access memory (Random Access
Memory, RAM), flash memory (Flash Memory), hard disk (Hard Disk Drive, abbreviation: HDD) or solid state hard disk
(Solid-State Drive, SSD) etc.；The storage medium can also include the combination of the memory of mentioned kind.
It is that can lead to it will be understood by those skilled in the art that realizing all or part of the process in above-described embodiment method
Computer program is crossed to instruct relevant hardware and complete, program can be stored in a computer-readable storage medium, the journey
Sequence is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, storage medium can for magnetic disk, CD, read-only deposit
Store up memory body (ROM) or random access memory (RAM) etc..
Embodiment 4
The embodiment of the present invention provides a kind of terminal device, as shown in figure 4, including memory 420, processor 410 and storage
On memory 420 and the computer program that can run on the processor 410, processor 410 realize embodiment 1 when executing program
The step of processing method of middle encrypted audio/video data.
Fig. 4 is a kind of hardware knot of terminal device of the processing method of execution list items operation provided in an embodiment of the present invention
Structure schematic diagram, as shown in figure 4, the terminal device includes one or more processors 410 and memory 420, with one in Fig. 4
For processor 410.
The playback equipment for executing the processing method of list items operation can also include: input unit 430 and output device
440。
Processor 410, memory 420, input unit 430 and output device 440 can pass through bus or other modes
It connects, in Fig. 4 for being connected by bus.
Processor 410 can be central processing unit (Central Processing Unit, CPU).Processor 410 may be used also
Think other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit
(Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
The combination of the chips such as discrete hardware components or above-mentioned all kinds of chips.
Obviously, the above embodiments are merely examples for clarifying the description, and does not limit the embodiments.It is right
For those of ordinary skill in the art, can also make on the basis of the above description it is other it is various forms of variation or
It changes.There is no necessity and possibility to exhaust all the enbodiments.And it is extended from this it is obvious variation or
It changes still within the protection scope of the invention.
Claims (10)
1. a kind of processing method of encrypted audio/video data is used for each terminal device, which comprises the steps of:
Audio/video flow data are obtained, and to the audio/video flow data encoding；
Feature frame data are extracted from the audio/video flow data after the coding；
Obtain the interaction request signaling that server is sent；
The feature frame data and the interaction request signaling are encrypted simultaneously and obtain encryption data；
The encryption data is stored in the supplemental enhancement information unit of audio-video code stream data structure；
Confirm whether the size of data of the encryption data in the supplemental enhancement information unit is less than preset data size；
When the size of data of the encryption data in the supplemental enhancement information unit is less than preset data size, in the benefit
Fill in enhancement information unit carry out character supplement so that the size of data of the encryption data to reach the preset data big
It is small.
2. the processing method of encrypted audio/video data according to claim 1, which is characterized in that further include:
When the size of data of the encryption data in the supplemental enhancement information unit is not less than preset data size, storage institute
State encryption data and as data to be sent.
3. the processing method of encrypted audio/video data according to claim 1, which is characterized in that the audio-video code stream number
It is H264 bit stream data structure according to structure.
4. the processing method of encrypted audio/video data according to claim 1, which is characterized in that the supplemental enhancement information
Unit carries out self-defining data Format Type for user.
5. the processing method of encrypted audio/video data according to claim 1, which is characterized in that the interaction request signaling
Information and code stream protocol address information are adjusted including heartbeat message, code stream.
6. the processing method of encrypted audio/video data according to claim 1, which is characterized in that the characteristic frame data packet
It includes: intracoded frame and forward prediction frame.
7. the processing method of encrypted audio/video data according to claim 1, which is characterized in that utilize symmetric encipherment algorithm
The feature frame data and the interaction request signaling are encrypted simultaneously and obtain encryption data.
8. a kind of processing unit of encrypted audio/video data is used for each terminal device characterized by comprising
First obtains module, for obtaining audio/video flow data, and to the audio/video flow data encoding；
Extraction module, for extracting feature frame data from the audio/video flow data after the coding；
Second obtains module, for obtaining the interaction request signaling of server transmission；
Encrypting module obtains encryption data for encrypting simultaneously to the feature frame data and the interaction request signaling；
Storage module, for being stored in the encryption data in the supplemental enhancement information unit of audio-video code stream data structure；
Confirmation module, for confirming it is pre- whether the size of data of the encryption data in the supplemental enhancement information unit is less than
If size of data；
Complementary module is less than preset data for the size of data when the encryption data in the supplemental enhancement information unit
Size carries out character supplement so that the size of data of the encryption data reaches institute in the supplemental enhancement information unit
State preset data size.
9. a kind of storage medium, is stored thereon with computer instruction, which is characterized in that realize power when the instruction is executed by processor
Benefit requires the step of processing method of the described in any item encrypted audio/video datas of 1-7.
10. a kind of terminal device including memory, processor and stores the calculating that can be run on a memory and on a processor
Machine program, which is characterized in that the processor realizes claim 1-7 described in any item encryption sound views when executing described program
The step of processing method of frequency evidence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910472940.3A CN110198458B (en) | 2019-05-31 | 2019-05-31 | Processing method and device for encrypted audio and video data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910472940.3A CN110198458B (en) | 2019-05-31 | 2019-05-31 | Processing method and device for encrypted audio and video data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110198458A true CN110198458A (en) | 2019-09-03 |
| CN110198458B CN110198458B (en) | 2020-04-07 |
Family
ID=67753716
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910472940.3A Active CN110198458B (en) | 2019-05-31 | 2019-05-31 | Processing method and device for encrypted audio and video data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110198458B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111031378A (en) * | 2019-12-20 | 2020-04-17 | 山东云缦智能科技有限公司 | Method for dotting video and recording EPG (electronic program guide) information |
| CN111988624A (en) * | 2020-09-07 | 2020-11-24 | 北京达佳互联信息技术有限公司 | Video processing method, device, equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110188652A1 (en) * | 2008-10-15 | 2011-08-04 | Mitsubishi Electric Corporation | Encryption apparatus, decryption apparatus, encryption method, and decryption method |
| US20130064368A1 (en) * | 2011-09-12 | 2013-03-14 | Frédéric Lefebvre | Methods and devices for selective format-preserving data encryption |
| CN104363430A (en) * | 2014-12-04 | 2015-02-18 | 高新兴科技集团股份有限公司 | Augmented reality camera monitoring method and system thereof |
| CN105704545A (en) * | 2016-01-20 | 2016-06-22 | 中国科学院信息工程研究所 | Secret key synchronizing information transmission method based on H.264 video stream |
| CN106921827A (en) * | 2015-12-25 | 2017-07-04 | 北京计算机技术及应用研究所 | Secure network high-definition camera |
| CN109257325A (en) * | 2017-07-13 | 2019-01-22 | 北京陌陌信息技术有限公司 | Transmit the method, apparatus and computer readable storage medium of private information |
| CN109413444A (en) * | 2018-10-30 | 2019-03-01 | 苏州科达科技股份有限公司 | Completeness check data creation method, integrity checking method and the device of video |
| CN109618186A (en) * | 2018-11-15 | 2019-04-12 | 中国航空工业集团公司洛阳电光设备研究所 | A kind of H264/AVC video Supplemental Enhancement Information encapsulated circuit realized using FPGA |
-
2019
- 2019-05-31 CN CN201910472940.3A patent/CN110198458B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110188652A1 (en) * | 2008-10-15 | 2011-08-04 | Mitsubishi Electric Corporation | Encryption apparatus, decryption apparatus, encryption method, and decryption method |
| US20130064368A1 (en) * | 2011-09-12 | 2013-03-14 | Frédéric Lefebvre | Methods and devices for selective format-preserving data encryption |
| CN103002278A (en) * | 2011-09-12 | 2013-03-27 | 汤姆森特许公司 | Methods and devices for selective format-preserving data encryption |
| CN104363430A (en) * | 2014-12-04 | 2015-02-18 | 高新兴科技集团股份有限公司 | Augmented reality camera monitoring method and system thereof |
| CN106921827A (en) * | 2015-12-25 | 2017-07-04 | 北京计算机技术及应用研究所 | Secure network high-definition camera |
| CN105704545A (en) * | 2016-01-20 | 2016-06-22 | 中国科学院信息工程研究所 | Secret key synchronizing information transmission method based on H.264 video stream |
| CN109257325A (en) * | 2017-07-13 | 2019-01-22 | 北京陌陌信息技术有限公司 | Transmit the method, apparatus and computer readable storage medium of private information |
| CN109413444A (en) * | 2018-10-30 | 2019-03-01 | 苏州科达科技股份有限公司 | Completeness check data creation method, integrity checking method and the device of video |
| CN109618186A (en) * | 2018-11-15 | 2019-04-12 | 中国航空工业集团公司洛阳电光设备研究所 | A kind of H264/AVC video Supplemental Enhancement Information encapsulated circuit realized using FPGA |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111031378A (en) * | 2019-12-20 | 2020-04-17 | 山东云缦智能科技有限公司 | Method for dotting video and recording EPG (electronic program guide) information |
| CN111988624A (en) * | 2020-09-07 | 2020-11-24 | 北京达佳互联信息技术有限公司 | Video processing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110198458B (en) | 2020-04-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108965302B (en) | Media data transmission system, method, device and storage medium | |
| KR100927322B1 (en) | Digital content distribution system | |
| EP1645129B1 (en) | Method for encrypting an error-tolerance compressed audio or video stream | |
| KR101737299B1 (en) | Encoder, decoder and methods | |
| US8838954B2 (en) | Media processing devices for adaptive delivery of on-demand media, and methods thereof | |
| EP1995965A1 (en) | Method and apparatus for video frame marking | |
| EP3195519B1 (en) | Encoder, decoder and methods employing partial data encryption | |
| CN1633068B (en) | A method of media stream transmission in point-to-point communication | |
| US20100064138A1 (en) | Apparatus and method for providing security service of user interface | |
| WO2021072878A1 (en) | Audio/video data encryption and decryption method and apparatus employing rtmp, and readable storage medium | |
| CN105007465A (en) | Cipher-text H264 video live-broadcasting and on-demand platform based on live555 frame and ffmpeg library | |
| JP2005515702A (en) | Synchronous cipher design for wireless communication systems | |
| CN110198458A (en) | A kind of processing method and processing device of encrypted audio/video data | |
| CN113727058A (en) | Multimedia conference data processing method, system, equipment and storage medium | |
| US20230208615A1 (en) | Online-Streamer Image Model File Transmission in Co-Hosting During Livestreaming | |
| CN109788299A (en) | Video transmission method, system, equipment and computer media between a kind of mobile device | |
| WO2021196960A1 (en) | Encrypted video call method and apparatus, and device and storage medium | |
| CN100518280C (en) | Video encrypting/deciphering device and encrypting/deciphering method | |
| TW201734876A (en) | Data protection method | |
| CN201663660U (en) | Data encryption and data decryption system of digital video | |
| EP1499126A1 (en) | Encryption method for an audio or video compressed stream preserving the coding syntax | |
| KR20120138940A (en) | System and method implementing a selective encryption for mobile terminal | |
| JPH0646052A (en) | Encipherment system in high speed transport mechanism | |
| CN109561345B (en) | Digital movie packaging method based on AVS + coding format | |
| CN117857844A (en) | Video code stream encryption method, video code stream decryption method and related devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: 247100 workshop C2, science and Technology Incubation Park, Jiangnan industrial concentration zone, Chizhou City, Anhui Province Patentee after: Anhui Wenxiang Technology Co.,Ltd. Address before: 100176 11th floor, block B, AVIC Plaza, 15 ronghua South Road, economic and Technological Development Zone, Daxing District, Beijing Patentee before: BEIJING WENXIANG INFORMATION TECHNOLOGY Co.,Ltd. |
|
| CP03 | Change of name, title or address |