CN112087636B - Image coding processing method and device, storage medium and terminal - Google Patents
Image coding processing method and device, storage medium and terminal Download PDFInfo
- Publication number
- CN112087636B CN112087636B CN202010790097.6A CN202010790097A CN112087636B CN 112087636 B CN112087636 B CN 112087636B CN 202010790097 A CN202010790097 A CN 202010790097A CN 112087636 B CN112087636 B CN 112087636B
- Authority
- CN
- China
- Prior art keywords
- processing
- image
- mode
- image coding
- modes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title abstract description 20
- 238000012545 processing Methods 0.000 claims abstract description 267
- 238000000034 method Methods 0.000 claims abstract description 80
- 230000008569 process Effects 0.000 claims description 41
- 238000013139 quantization Methods 0.000 claims description 21
- 230000001360 synchronised effect Effects 0.000 claims description 16
- 241000023320 Luma <angiosperm> Species 0.000 claims description 10
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 6
- 238000009795 derivation Methods 0.000 claims description 6
- 238000004364 calculation method Methods 0.000 description 11
- 230000009466 transformation Effects 0.000 description 11
- 230000006870 function Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000013507 mapping Methods 0.000 description 4
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000005315 distribution function Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000011426 transformation method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/625—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Discrete Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a processing method, a device, a storage medium and a terminal of image coding, wherein the method comprises the following steps: selecting N to-be-processed modules with N processing modes from a mode set; under the condition of presetting time intervals at intervals, sequentially entering N to-be-processed modules with N processing modes into an image coding processing flow according to preset starting processing time, and carrying out image coding processing on each item of initialized image coded data to obtain a coded image. By adopting the embodiment of the application, different starting processing moments are pre-configured for a plurality of to-be-processed modules with different processing modes, and the image coding processing flow can be sequentially entered according to the preset time interval, namely: the multiple to-be-processed modules with different processing modes can synchronously perform image coding processing, so that the processing efficiency of image coding is finally improved.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and an apparatus for processing image coding, a storage medium, and a terminal.
Background
The image transformation itself can not compress data, but most of the energy of the transformed image is concentrated on a few transformation coefficients, and then the image can be effectively compressed by adopting proper quantization and entropy coding.
Research of information theory shows that the entropy value of a signal source is not changed by orthogonal transformation, the information quantity of images before and after transformation is not lost, and the original image value can be obtained completely through inverse transformation. However, after the image is subjected to orthogonal transformation, the image data originally dispersed in the original space is concentrated in a new coordinate space. For most images, a large number of transform coefficients are small, and compression encoding is performed by deleting coefficients close to 0 and coarsely quantizing the smaller coefficients while retaining coefficients containing image main information. When the reconstructed image is decoded (inverse transformed), the lost information is unimportant information, and image distortion is hardly caused, and the image is subjected to transform coding, namely, the image is compressed to obtain a compressed image with a high compression ratio.
The reference codes corresponding to the existing coding modes have a serial structure. If the source code of the serial structure is operated, the module calculation time is too long, and the following cannot be achieved: and finishing all the calculation tasks to be finished by the calculation module within a time period of preset time length.
Disclosure of Invention
The embodiment of the application provides a processing method and device for image coding, a storage medium and a terminal. The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed embodiments. This summary is not an extensive overview and is intended to neither identify key/critical elements nor delineate the scope of such embodiments. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.
In a first aspect, an embodiment of the present application provides a processing method for image coding, where the method includes:
performing parallel synchronous initialization processing on various image encoding data in a plurality of modules for performing image encoding processing on a current image to obtain various initialized image encoding data;
selecting N to-be-processed modules with N processing modes from a mode set, wherein N is a positive integer which is greater than or equal to 4 and less than or equal to 9;
under the condition of presetting time intervals at intervals, sequentially entering N to-be-processed modules with N processing modes into an image coding processing flow according to preset starting processing time, and carrying out image coding processing on each item of initialized image coded data to obtain a coded image.
In a second aspect, an embodiment of the present application provides an apparatus for processing image coding, where the apparatus includes:
the initialization processing module is used for carrying out parallel synchronous initialization processing on various image coding data in a plurality of modules for carrying out image coding processing on a current image to obtain various initialized image coding data;
a selecting module, configured to select N to-be-processed modules having N processing modes from a mode set, where N is a positive integer greater than or equal to 4 and less than or equal to 9;
and the image coding module is used for sequentially entering N to-be-processed modules with N processing modes into an image coding processing flow according to the preset starting processing time at each preset time interval, and carrying out image coding processing on each item of initialized image coded data obtained by the initialization processing module to obtain a coded image.
In a third aspect, embodiments of the present application provide a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the above-mentioned method steps.
In a fourth aspect, an embodiment of the present application provides a terminal, which may include: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the above-mentioned method steps.
The technical scheme provided by the embodiment of the application can have the following beneficial effects:
in the embodiment of the application, a plurality of modules for carrying out image coding processing on a current image are subjected to parallel synchronous initialization processing to obtain corresponding initialized modules; selecting N to-be-processed modules with N processing modes from a mode set; under the condition of presetting time intervals at intervals, sequentially entering N to-be-processed modules with N processing modes into an image coding processing flow according to preset starting processing time, and carrying out image coding processing on each item of initialized image coded data to obtain a coded image. Because this application has configured different start-up processing moments to a plurality of pending modules that have different processing modes in advance, and can enter into image coding processing procedure according to the time interval that predetermines, promptly: the plurality of to-be-processed modules with different processing modes can synchronously perform image coding processing on each item of initialized image coded data, so that the processing efficiency of image coding is finally improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a schematic flowchart of a processing method for image coding according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a processing method for image coding in a specific application scenario according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a processing apparatus for image coding according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a terminal according to an embodiment of the present application.
Detailed Description
The following description and the drawings sufficiently illustrate specific embodiments of the invention to enable those skilled in the art to practice them.
It should be understood that the described embodiments are only some embodiments of the invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
In the description of the present invention, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art. In addition, in the description of the present invention, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
So far, this scheme has a serial structure due to the reference code corresponding to the existing coding mode. If the source code of the serial structure is operated, the module calculation time is too long, and the following cannot be achieved: and finishing all the calculation tasks to be finished by the calculation module within a time period of preset time length. Therefore, the present application provides a processing method, an apparatus, a storage medium and a terminal for image coding to solve the above-mentioned problems in the related art. In the technical scheme provided by the application, N to-be-processed modules with N processing modes are selected from a mode set; under the condition of presetting time intervals at intervals, according to the preset starting processing time, N to-be-processed modules with N processing modes sequentially enter an image coding processing flow, and carry out image coding processing on various initialized image coded data to obtain coded images, and because the application presets different starting processing times for a plurality of to-be-processed modules with different processing modes, the image coding processing flow can be sequentially entered into according to the preset time intervals, namely: the plurality of to-be-processed modules with different processing modes can synchronously perform image coding processing on each item of initialized image coded data, so that the processing efficiency of image coding is finally improved, and the following description adopts an exemplary embodiment for detail.
The following describes in detail a processing method for image coding provided by an embodiment of the present application with reference to fig. 1 to fig. 2. The processing method of the image coding can be realized by relying on a computer program and can be run on a processing device of the image coding. The computer program may be integrated into the application or may run as a separate tool-like application. The processing device for image coding in the embodiment of the present application may be a user terminal, including but not limited to: personal computers, tablet computers, handheld devices, in-vehicle devices, wearable devices, computing devices or other processing devices connected to a wireless modem, and the like. The user terminals may be called different names in different networks, for example: user equipment, access terminal, subscriber unit, subscriber station, mobile station, remote terminal, mobile device, user terminal, wireless communication device, user agent or user equipment, cellular telephone, cordless telephone, Personal Digital Assistant (PDA), terminal equipment in a 5G network or future evolution network, and the like.
Referring to fig. 1, a flowchart of a processing method for image coding is provided in an embodiment of the present application. As shown in fig. 1, the processing method for image coding according to the embodiment of the present application may include the following steps:
s101, carrying out parallel synchronous initialization processing on each item of image coding data in a plurality of modules for carrying out image coding processing on a current image to obtain each item of initialized image coding data.
In this step, performing parallel synchronous initialization processing on each item of image encoding data in a plurality of modules for performing image encoding processing on the current image may be to acquire original pixel information of the current image; or synchronously acquiring a prediction mode corresponding to the current image in parallel; or adjacent pixel information of the current image can be synchronously acquired for parallel; or various items of reference pixel information in the reference pixel set of the current image can be synchronously acquired for parallel.
Through the initialization process, all image coding data which are in different periods and are to enter the image coding processing flow can be obtained, namely: and each item of initialized image coding data.
The above lists only common parallel synchronization initialization processing procedures, and may also introduce other parallel synchronization initialization processing procedures for different application scenarios, which is not described herein again.
The parallel synchronous initialization processing based on the above list is a conventional technical means, and is not described herein again.
In one possible implementation manner, performing parallel synchronous initialization processing on each item of image encoding data in a plurality of modules performing image encoding processing on a current image includes at least one of:
acquiring original pixel information of a current image; or,
synchronously acquiring a prediction mode corresponding to a current image in parallel; or,
synchronously acquiring adjacent pixel information of a current image in parallel; or,
and synchronously acquiring various items of reference pixel information in a reference pixel set of the current image in parallel.
S102, selecting N to-be-processed modules with N processing modes from the mode set, wherein N is a positive integer which is greater than or equal to 4 and less than or equal to 9.
In this step, the modes in the mode set may be based on respective modes in the first mode set corresponding to the intra prediction encoding mode of the luminance block, or may be based on respective modes in the second mode set corresponding to the modes of the chrominance block.
Wherein the first mode includes at least one of:
the mode type is a first DC prediction mode, the mode type is a Plane prediction mode, and the mode type is a plurality of angle prediction modes.
The second mode includes at least one of:
the mode type is a second DC prediction mode, the mode type is a horizontal prediction mode, the mode type is a vertical prediction mode, the mode type is a bilinear interpolation mode, and the mode type is a luma derivation mode.
Based on that each mode in the mode set is a conventional mode, detailed description is omitted here.
In practical application, each mode in the mode set may be configured according to different application scenarios. For example, in a specific application scenario, 4 patterns are preferred from existing patterns, and each pattern has a module to be processed with a one-to-one mapping relation with the pattern.
In practical applications, the method for selecting multiple modes from the mode set is often obtained based on the test results of multiple tests, and the method for selecting multiple modes is not particularly limited herein.
In one possible implementation, before selecting N to-be-processed modules having N processing modes from the mode set, the method further includes: reading the mode type of each mode in the mode set;
wherein the pattern type includes at least one of:
a first set of modes corresponding to intra prediction coding modes based on luma blocks, and a second set of modes corresponding to modes based on chroma blocks.
Specifically, the first mode includes at least one of:
the mode type is a first DC prediction mode, the mode type is a Plane prediction mode, and the mode type is a plurality of angle prediction modes.
The second mode includes at least one of:
the mode type is a second DC prediction mode, the mode type is a horizontal prediction mode, the mode type is a vertical prediction mode, the mode type is a bilinear interpolation mode, and the mode type is a luma derivation mode.
In one possible implementation, before reading the pattern type of each pattern in the pattern set, the method further includes the steps of:
configuring each first mode in the first mode set;
wherein the first mode includes at least one of:
the mode type is a first DC prediction mode, the mode type is a Plane prediction mode, and the mode type is a plurality of angle prediction modes.
In one possible implementation, before reading the pattern type of each pattern in the pattern set, the method further includes the steps of:
configuring each second mode in the second mode set;
wherein the second mode includes at least one of:
the mode type is a second DC prediction mode, the mode type is a horizontal prediction mode, the mode type is a vertical prediction mode, the mode type is a bilinear interpolation mode, and the mode type is a luma derivation mode.
S103, under the condition of presetting time intervals, sequentially entering an image coding processing flow by N to-be-processed modules with N processing modes according to a preset starting processing time, and carrying out image coding processing on each item of initialized image coded data to obtain a coded image; thus, different starting processing moments are configured in advance for a plurality of to-be-processed modules with different processing modes, and the to-be-processed modules can enter the image coding processing flow in sequence according to preset time intervals, namely: the plurality of to-be-processed modules with different processing modes can synchronously perform image coding processing on each item of initialized image coded data, so that the processing efficiency of image coding is finally improved.
In this step, the image encoding process flow includes a first process flow for performing a transform process, a second process flow for performing a quantization process, a third process flow for performing an inverse quantization process, and a fourth process flow for performing an inverse transform process.
The transform in the first process flow is a discrete cosine transform, converting an image from a color domain to a frequency domain. Converting the original image information block into a set of coefficients representing different frequency components by discrete cosine transformation has the advantage that, firstly, the signal always concentrates most of its energy in a small range of the frequency domain, and therefore only a few bits are needed to describe the unimportant components; second, frequency domain decomposition maps the processing of the human visual system and allows the subsequent quantization process to meet its sensitivity requirements.
The quantization in the second processing flow refers to a process of mapping a continuous value (or a large number of possible discrete values) of a signal to a finite plurality of discrete amplitudes, so as to implement many-to-one mapping of signal values. In video coding, after the residual signal is subjected to discrete cosine transform, the transform coefficients tend to have a large dynamic range. Therefore, the quantization of the transformation coefficient can effectively reduce the signal value space, and further obtain better compression effect. Meanwhile, due to the many-to-one mapping mechanism, distortion is inevitably introduced by the quantization process, and is also the root cause of the distortion generated in video coding. Since quantization affects both the quality and the bit rate of video, quantization is a very important link in video coding.
In the field of digital signal processing, quantization refers to the process of approximating a continuous value (or a large number of possible discrete values) of a signal to a finite number (or fewer) of discrete values. Quantization is mainly applied in the conversion of continuous signals into digital signals. The continuous signal is sampled into discrete signal, and the discrete signal is quantized into digital signal.
The inverse quantization in the third processing flow is the inverse of the quantization described above.
The inverse transformation in the fourth process flow is one of the most common and intuitive random variable generation methods. It is realized by inverse transformation of a distribution function based on the probability integral transformation theorem, and is therefore called an inverse transformation method.
In a possible implementation manner, the image encoding processing flow includes a first processing flow for performing transform processing, a second processing flow for performing quantization processing, a third processing flow for performing inverse quantization processing, and a fourth processing flow for performing inverse transform processing, and in the case of every preset time interval, according to a preset starting processing time, N to-be-processed modules having N processing modes sequentially enter the image encoding processing flow, and performing image encoding processing on each item of initialized image encoded data includes the following steps:
under the condition of presetting time intervals at intervals, according to the preset starting processing time, sequentially entering N to-be-processed modules with N processing modes into a first processing flow, a second processing flow, a third processing flow and a fourth processing flow of an image coding processing flow, and respectively carrying out image coding processing on each item of initialized image coded data.
In one possible implementation, selecting N to-be-processed modules having N processing modes from the mode set includes the following steps:
acquiring estimated time length for carrying out image coding processing on a current image;
and selecting N to-be-processed modules which are matched with the estimated duration and have N processing modes from the mode set according to the estimated duration.
In practical application, the longer the estimated duration of the image encoding processing performed on the current image is, the more N numbers corresponding to N to-be-processed modes having N processing modes and being selected from the mode set, where the N numbers are matched with the estimated duration, for example, in a specific application scenario, N may take 9 values.
Conversely, the shorter the estimated time length for performing image coding processing on the current image is, the fewer N numbers corresponding to N to-be-processed modes which are selected from the mode set and are matched with the estimated time length and have N processing modes are, for example, in a specific application scenario, N may take 4 values; therefore, the processing process of image coding can be simplified, and the processing time for coding the image of the current image can be greatly shortened, so that the processing efficiency for coding the image is finally improved.
In the embodiment of the application, parallel synchronous initialization processing is carried out on various image coding data in a plurality of modules for carrying out image coding processing on a current image, and various initialized image coding data are obtained; selecting N to-be-processed modules with N processing modes from a mode set; under the condition of presetting time intervals at intervals, sequentially entering N to-be-processed modules with N processing modes into an image coding processing flow according to preset starting processing time, and carrying out image coding processing on each item of initialized image coded data to obtain a coded image. Because this application has configured different start-up processing moments to a plurality of pending modules that have different processing modes in advance, and can enter into image coding processing procedure according to the time interval that predetermines, promptly: the plurality of to-be-processed modules with different processing modes can synchronously perform image coding processing on each item of initialized image coded data, so that the processing efficiency of image coding is finally improved.
Fig. 2 is a schematic flowchart illustrating a processing method for image coding in a specific application scenario according to an embodiment of the present application. For the method, please refer to the same or similar descriptions in the method embodiment shown in fig. 1, which are not repeated herein.
The following description is made with respect to fig. 2:
in the process of obtaining the reference pixel according to the mode in fig. 2, different calculation formulas are available based on different modes, and the calculation formulas corresponding to different modes are conventional technical means and are not described herein again. And fetching the data participating in the calculation from the random access memory into a register for standby.
And the calculation result is stored in a random access memory after the conversion, and is left for the next module to participate in calculation.
The following is an embodiment of a processing apparatus for image coding according to the present invention, which can be used to execute an embodiment of a processing method for image coding according to the present invention. For details that are not disclosed in the embodiment of the processing apparatus for image coding of the present invention, please refer to the embodiment of the processing method for image coding of the present invention.
Referring to fig. 3, a schematic structural diagram of a processing apparatus for image coding according to an exemplary embodiment of the present invention is shown. The image encoding processing means may be implemented as all or part of the terminal by software, hardware or a combination of both. The image coding processing device comprises an initialization processing module 10, a selecting module 20 and an image coding module 30.
Specifically, the initialization processing module 10 is configured to perform parallel synchronous initialization processing on each item of image encoded data in a plurality of modules that perform image encoding processing on a current image, so as to obtain each item of image encoded data after initialization;
a selecting module 20, configured to select N to-be-processed modules having N processing modes from a mode set, where N is a positive integer greater than or equal to 4 and less than or equal to 9;
the image encoding module 30 is configured to, at preset time intervals, sequentially enter an image encoding processing flow for N to-be-processed modules having N processing modes according to a preset start processing time, and perform image encoding processing on each item of initialized image encoded data to obtain an encoded image.
Optionally, the parallel synchronous initialization processing performed by the initialization processing module 10 on each item of image encoded data in a plurality of modules that perform image encoding processing on the current image includes at least one of:
acquiring original pixel information of a current image; or,
synchronously acquiring a prediction mode corresponding to a current image in parallel; or,
synchronously acquiring adjacent pixel information of a current image in parallel; or,
and synchronously acquiring various items of reference pixel information in a reference pixel set of the current image in parallel.
Optionally, the image encoding processing flow includes a first processing flow for performing transform processing, a second processing flow for performing quantization processing, a third processing flow for performing inverse quantization processing, and a fourth processing flow for performing inverse transform processing, and the image encoding module 30 is specifically configured to:
under the condition of presetting time intervals at intervals, according to the preset starting processing time, sequentially entering N to-be-processed modules with N processing modes into a first processing flow, a second processing flow, a third processing flow and a fourth processing flow of an image coding processing flow, and respectively carrying out image coding processing on each item of initialized image data.
Optionally, the apparatus further comprises:
a reading module (not shown in fig. 3) for reading the mode type of each mode in the mode set before the selecting module 20 selects N to-be-processed modules having N processing modes from the mode set;
wherein the mode type read by the reading module comprises at least one of the following:
a first set of modes corresponding to intra prediction coding modes based on luma blocks, and a second set of modes corresponding to modes based on chroma blocks.
Optionally, the apparatus further comprises:
a configuration module (not shown in FIG. 3) for the read module to configure each first pattern in the first set of patterns before the pattern type of each pattern in the set of read patterns;
wherein the first mode of configuration module configuration comprises at least one of:
the mode type is a first DC prediction mode, the mode type is a Plane prediction mode, and the mode type is a plurality of angle prediction modes.
Optionally, the configuration module is further configured to: before the reading module reads the mode type of each mode in the mode set, configuring each second mode in the second mode set;
wherein the second mode of configuration module configuration comprises at least one of:
the mode type is a second DC prediction mode, the mode type is a horizontal prediction mode, the mode type is a vertical prediction mode, the mode type is a bilinear interpolation mode, and the mode type is a luma derivation mode.
Optionally, the selecting module 20 is specifically configured to:
acquiring estimated time length for carrying out image coding processing on a current image;
and selecting N to-be-processed modules which are matched with the estimated duration and have N processing modes from the mode set according to the estimated duration.
It should be noted that, when the processing apparatus for image coding provided in the foregoing embodiment executes the processing method for image coding, only the division of the above functional modules is taken as an example, and in practical applications, the above functions may be distributed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions. In addition, the image coding processing apparatus and the image coding processing method provided in the above embodiments belong to the same concept, and details of the implementation process are shown in the image coding processing method embodiment, which is not described herein again.
In the embodiment of the application, an initialization processing module performs parallel synchronous initialization processing on various image coded data in a plurality of modules for performing image coding processing on a current image to obtain various initialized image coded data; the selection module selects N to-be-processed modules with N processing modes from the mode set; under the condition of every preset time interval, the image coding module sequentially enters an image coding processing flow by N to-be-processed modules with N processing modes according to the preset starting processing time, and performs image coding processing on each item of initialized image coded data to obtain a coded image. Because this application has configured different start-up processing moments to a plurality of pending modules that have different processing modes in advance, and can enter into image coding processing procedure according to the time interval that predetermines, promptly: the plurality of to-be-processed modules with different processing modes can synchronously perform image coding processing on each item of initialized image coded data, so that the processing efficiency of image coding is finally improved.
The present invention also provides a computer readable medium, on which program instructions are stored, which program instructions, when executed by a processor, implement the processing method of image coding provided by the above-mentioned various method embodiments.
The present invention also provides a computer program product containing instructions which, when run on a computer, cause the computer to perform the processing method for image coding described in the various method embodiments above.
Please refer to fig. 4, which provides a schematic structural diagram of a terminal according to an embodiment of the present application. As shown in fig. 4, the terminal 1000 can include: at least one processor 1001, at least one network interface 1004, a user interface 1003, memory 1005, at least one communication bus 1002.
Wherein a communication bus 1002 is used to enable connective communication between these components.
The user interface 1003 may include a Display screen (Display) and a Camera (Camera), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), among others.
The Memory 1005 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 1005 includes a non-transitory computer-readable medium. The memory 1005 may be used to store an instruction, a program, code, a set of codes, or a set of instructions. The memory 1005 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described above, and the like; the storage data area may store data and the like referred to in the above respective method embodiments. The memory 1005 may optionally be at least one memory device located remotely from the processor 1001. As shown in fig. 4, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and an image-coded processing application program.
In the terminal 1000 shown in fig. 4, the user interface 1003 is mainly used as an interface for providing input for a user, and acquiring data input by the user; and the processor 1001 may be configured to call a processing application for image encoding stored in the memory 1005, and specifically perform the following operations:
performing parallel synchronous initialization processing on various image encoding data in a plurality of modules for performing image encoding processing on a current image to obtain various initialized image encoding data;
selecting N to-be-processed modules with N processing modes from a mode set, wherein N is a positive integer which is greater than or equal to 4 and less than or equal to 9;
under the condition of presetting time intervals at intervals, sequentially entering N to-be-processed modules with N processing modes into an image coding processing flow according to preset starting processing time, and carrying out image coding processing on each item of initialized image coded data to obtain a coded image.
In one embodiment, the processor 1001 performs parallel synchronization initialization processing on each item of image encoding data in a plurality of modules performing image encoding processing on a current image, including at least one of:
acquiring original pixel information of a current image; or,
synchronously acquiring a prediction mode corresponding to a current image in parallel; or,
synchronously acquiring adjacent pixel information of a current image in parallel; or,
and synchronously acquiring various items of reference pixel information in a reference pixel set of the current image in parallel.
In one embodiment, the image encoding process flow includes a first process flow for performing a transform process, a second process flow for performing a quantization process, a third process flow for performing an inverse quantization process, and a fourth process flow for performing an inverse transform process, and when the processor 1001 executes the process that N to-be-processed modules having N processing modes sequentially enter the image encoding process flow for performing the image encoding process at preset start-up processing time intervals, the following operations are specifically executed:
under the condition of presetting time intervals at intervals, according to the preset starting processing time, sequentially entering N to-be-processed modules with N processing modes into a first processing flow, a second processing flow, a third processing flow and a fourth processing flow of an image coding processing flow, and respectively carrying out image coding processing on each item of initialized image coded data.
In one embodiment, before executing the selecting of the N pending modules having N processing modes from the mode set, the processor 1001 further performs the following operations:
reading the mode type of each mode in the mode set;
wherein the pattern type includes at least one of:
a first set of modes corresponding to intra prediction coding modes based on luma blocks, and a second set of modes corresponding to modes based on chroma blocks.
In one embodiment, the processor 1001 further performs the following operations before executing the mode types of the respective modes in the read mode set:
configuring each first mode in the first mode set;
wherein the first mode includes at least one of:
the mode type is a first DC prediction mode, the mode type is a Plane prediction mode, and the mode type is a plurality of angle prediction modes.
In one embodiment, the processor 1001 further performs the following operations before executing the mode types of the respective modes in the read mode set:
configuring each second mode in the second mode set;
wherein the second mode includes at least one of:
the mode type is a second DC prediction mode, the mode type is a horizontal prediction mode, the mode type is a vertical prediction mode, the mode type is a bilinear interpolation mode, and the mode type is a luma derivation mode.
In one embodiment, when the processor 1001 selects N to-be-processed modules having N processing modes from the mode set, the following operations are specifically performed:
acquiring estimated time length for carrying out image coding processing on a current image;
and selecting N to-be-processed modules which are matched with the estimated duration and have N processing modes from the mode set according to the estimated duration.
In the embodiment of the application, parallel synchronous initialization processing is carried out on various image coding data in a plurality of modules for carrying out image coding processing on a current image, and various initialized image coding data are obtained; selecting N to-be-processed modules with N processing modes from a mode set; under the condition of presetting time intervals at intervals, sequentially entering N to-be-processed modules with N processing modes into an image coding processing flow according to preset starting processing time, and carrying out image coding processing on each item of initialized image coded data to obtain a coded image. Because this application has configured different start-up processing moments to a plurality of pending modules that have different processing modes in advance, and can enter into image coding processing procedure according to the time interval that predetermines, promptly: the plurality of to-be-processed modules with different processing modes can synchronously perform image coding processing on each item of initialized image coded data, so that the processing efficiency of image coding is finally improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory or a random access memory.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present application and is not to be construed as limiting the scope of the present application, so that the present application is not limited thereto, and all equivalent variations and modifications can be made to the present application.
Claims (10)
1. A method for processing image coding, the method comprising:
performing parallel synchronous initialization processing on various image encoding data in a plurality of modules for performing image encoding processing on a current image to obtain various initialized image encoding data; the multiple modules for performing image coding processing on the current image are modules which are pre-configured with different starting processing moments and can sequentially enter an image coding processing flow according to a preset time interval;
selecting N to-be-processed modules with N processing modes from a mode set, wherein N is a positive integer which is greater than or equal to 4 and less than or equal to 9;
under the condition of presetting time intervals at intervals, sequentially entering N to-be-processed modules with N processing modes into an image coding processing flow according to preset starting processing time, and carrying out image coding processing on each item of initialized image coded data to obtain a coded image.
2. The method according to claim 1, wherein performing parallel synchronous initialization processing on each item of image encoding data in the plurality of modules performing image encoding processing on the current image comprises at least one of:
acquiring original pixel information of a current image; or,
synchronously acquiring a prediction mode corresponding to a current image in parallel; or,
synchronously acquiring adjacent pixel information of a current image in parallel; or,
and synchronously acquiring various items of reference pixel information in a reference pixel set of the current image in parallel.
3. The method according to claim 1, wherein the image encoding process flow includes a first process flow for performing transform processing, a second process flow for performing quantization processing, a third process flow for performing inverse quantization processing, and a fourth process flow for performing inverse transform processing, and the performing of image encoding processing on each item of initialized image encoded data includes, at preset time intervals, sequentially entering N to-be-processed modules having N processing modes into the image encoding process flow according to a preset start-up processing time:
under the condition of every preset time interval, according to the preset starting processing time, sequentially entering the first processing flow, the second processing flow, the third processing flow and the fourth processing flow of the image coding processing flow by N modules to be processed with N processing modes, and respectively carrying out image coding processing on each item of initialized image coded data.
4. The method of claim 1, wherein prior to said selecting N pending modules having N processing modes from the set of modes, the method further comprises: reading the mode type of each mode in the mode set;
wherein the pattern type comprises at least one of:
a first set of modes corresponding to intra prediction coding modes based on luma blocks, and a second set of modes corresponding to modes based on chroma blocks.
5. The method of claim 4, wherein prior to said reading the pattern type of each pattern in the pattern set, the method further comprises:
configuring each first mode in the first mode set;
wherein the first mode comprises at least one of:
the mode type is a first DC prediction mode, the mode type is a Plane prediction mode, and the mode type is a plurality of angle prediction modes.
6. The method of claim 4, wherein prior to said reading the pattern type of each pattern in the pattern set, the method further comprises:
configuring each second mode in the second mode set;
wherein the second mode comprises at least one of:
the mode type is a second DC prediction mode, the mode type is a horizontal prediction mode, the mode type is a vertical prediction mode, the mode type is a bilinear interpolation mode, and the mode type is a luma derivation mode.
7. The method of claim 1, wherein said selecting N pending modules having N processing modes from the mode set comprises:
acquiring estimated time length for carrying out image coding processing on a current image;
and selecting N to-be-processed modules which are matched with the estimated duration and have N processing modes from a mode set according to the estimated duration.
8. A processing apparatus for image coding, the apparatus comprising:
the initialization processing module is used for carrying out parallel synchronous initialization processing on various image coding data in a plurality of modules for carrying out image coding processing on a current image to obtain various initialized image coding data; the multiple modules for performing image coding processing on the current image are modules which are pre-configured with different starting processing moments and can sequentially enter an image coding processing flow according to a preset time interval;
a selecting module, configured to select N to-be-processed modules having N processing modes from a mode set, where N is a positive integer greater than or equal to 4 and less than or equal to 9;
and the image coding module is used for sequentially entering N to-be-processed modules with N processing modes into an image coding processing flow according to the preset starting processing time at each preset time interval, and carrying out image coding processing on each item of initialized image coded data obtained by the initialization processing module to obtain a coded image.
9. A computer storage medium, characterized in that it stores a plurality of instructions adapted to be loaded by a processor and to carry out the method steps according to any one of claims 1 to 7.
10. A terminal, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of any of claims 1 to 7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010790097.6A CN112087636B (en) | 2020-08-07 | 2020-08-07 | Image coding processing method and device, storage medium and terminal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010790097.6A CN112087636B (en) | 2020-08-07 | 2020-08-07 | Image coding processing method and device, storage medium and terminal |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112087636A CN112087636A (en) | 2020-12-15 |
CN112087636B true CN112087636B (en) | 2022-01-11 |
Family
ID=73735684
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010790097.6A Active CN112087636B (en) | 2020-08-07 | 2020-08-07 | Image coding processing method and device, storage medium and terminal |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112087636B (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105227959A (en) * | 2014-07-03 | 2016-01-06 | 深圳中兴力维技术有限公司 | For odd encoder point shuffling flowing water method and the device thereof of Video coding |
CN108932129A (en) * | 2018-06-26 | 2018-12-04 | 郑州云海信息技术有限公司 | A kind of acceleration system and method for WebP cataloged procedure medium entropy encryption algorithm |
CN110324631A (en) * | 2019-05-09 | 2019-10-11 | 湖南国科微电子股份有限公司 | A kind of image parallel processing method, device and electronic equipment |
CN110933436A (en) * | 2019-12-17 | 2020-03-27 | 展讯通信(上海)有限公司 | Image encoding method, image encoding device, computer device, and storage medium |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011091576A (en) * | 2009-10-21 | 2011-05-06 | Sony Corp | Coding apparatus and method |
CN110149554B (en) * | 2019-05-31 | 2021-06-15 | Oppo广东移动通信有限公司 | Video image processing method and device, electronic equipment and storage medium |
-
2020
- 2020-08-07 CN CN202010790097.6A patent/CN112087636B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105227959A (en) * | 2014-07-03 | 2016-01-06 | 深圳中兴力维技术有限公司 | For odd encoder point shuffling flowing water method and the device thereof of Video coding |
CN108932129A (en) * | 2018-06-26 | 2018-12-04 | 郑州云海信息技术有限公司 | A kind of acceleration system and method for WebP cataloged procedure medium entropy encryption algorithm |
CN110324631A (en) * | 2019-05-09 | 2019-10-11 | 湖南国科微电子股份有限公司 | A kind of image parallel processing method, device and electronic equipment |
CN110933436A (en) * | 2019-12-17 | 2020-03-27 | 展讯通信(上海)有限公司 | Image encoding method, image encoding device, computer device, and storage medium |
Non-Patent Citations (2)
Title |
---|
Thomas Sangild Sorensen ; David Atkinson ; Tobias Schaeffter ; .Real-Time Reconstruction of Sensitivity Encoded Radial Magnetic Resonance Imaging Using a Graphics Processing Unit.《 IEEE Transactions on Medical Imaging》.2009, * |
结合分类方法的并行分形图像编码算法研究;郭慧;贺杰;卢振坤;《湘潭大学自然科学学报》;20150315;全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN112087636A (en) | 2020-12-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10848787B2 (en) | Lossy image compression using palettization of locally mixed colors | |
JP2017192148A (en) | Significant map encoding with small calculation | |
CN102595109B (en) | Decoding method and device for JPEG image | |
CN109257609B (en) | Data processing method and device, electronic equipment and storage medium | |
CN109274976B (en) | Data processing method and device, electronic equipment and storage medium | |
CN107667532A (en) | Conversion for non-baseband signal code selects | |
US20230336733A1 (en) | Sample Adaptive Offset | |
CN112991497B (en) | Method, device, storage medium and terminal for coloring black-and-white cartoon video | |
CN114040246A (en) | Image format conversion method, device, equipment and storage medium of graphic processor | |
CN111654696B (en) | Intra-frame multi-reference-line prediction method and device, storage medium and terminal | |
CN112087636B (en) | Image coding processing method and device, storage medium and terminal | |
CN114788280A (en) | Video coding and decoding method and device | |
CN110677676A (en) | Video encoding method and apparatus, video decoding method and apparatus, and storage medium | |
JP4552400B2 (en) | Image display device, image display method, and image display program | |
US11695919B2 (en) | Lossy image compression using palettization of locally mixed colors | |
JP3633860B2 (en) | Image processing apparatus and image processing method | |
JP2005055825A (en) | Image display device, image display method and image display program | |
CN114170082A (en) | Video playing method, image processing method, model training method, device and electronic equipment | |
CN114419203A (en) | File processing method and device | |
CN114079823A (en) | Video rendering method, device, equipment and medium based on Flutter | |
CN114677464A (en) | Image processing method, image processing apparatus, computer device, and storage medium | |
CN104427334A (en) | Data processing method, image demonstration method, data processing device and demonstration equipment | |
CN112887726B (en) | Image processing method and apparatus, storage medium, and electronic device | |
CN113411611B (en) | Video image processing method and device and electronic device | |
CN113421312B (en) | Coloring method and device for black-and-white video, storage medium and terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |