CN114466244B - Ultrahigh-definition high-dynamic-range imaging rendering method and device - Google Patents
Ultrahigh-definition high-dynamic-range imaging rendering method and device Download PDFInfo
- Publication number
- CN114466244B CN114466244B CN202210093729.2A CN202210093729A CN114466244B CN 114466244 B CN114466244 B CN 114466244B CN 202210093729 A CN202210093729 A CN 202210093729A CN 114466244 B CN114466244 B CN 114466244B
- Authority
- CN
- China
- Prior art keywords
- multimedia
- rendering
- format
- target
- ultra
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000009877 rendering Methods 0.000 title claims abstract description 144
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000003384 imaging method Methods 0.000 title claims abstract description 20
- 238000006243 chemical reaction Methods 0.000 claims abstract description 43
- 230000000694 effects Effects 0.000 claims description 31
- 230000008569 process Effects 0.000 claims description 23
- 230000003139 buffering effect Effects 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 8
- 238000004590 computer program Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 238000013507 mapping Methods 0.000 description 5
- 238000013139 quantization Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 239000003086 colorant Substances 0.000 description 3
- 230000006872 improvement Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- FFBHFFJDDLITSX-UHFFFAOYSA-N benzyl N-[2-hydroxy-4-(3-oxomorpholin-4-yl)phenyl]carbamate Chemical compound OC1=C(NC(=O)OCC2=CC=CC=C2)C=CC(=C1)N1CCOCC1=O FFBHFFJDDLITSX-UHFFFAOYSA-N 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/324—Colour aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440236—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Generation (AREA)
Abstract
The embodiment of the invention provides an ultrahigh-definition high-dynamic-range imaging rendering method and device, which are used for acquiring at least one multimedia in real time; uniformly converting the color format of the multimedia into a target color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range; rendering a preset three-dimensional model by taking the multimedia in the target color format as a texture source to obtain a rendering result; and converting the rendering result into target multimedia in an ultra-high definition format supporting high dynamic range and outputting the target multimedia. Through carrying out unified conversion with the color format at first, can make the multimedia satisfy high dynamic range and super high definition demand simultaneously, can also be convenient for follow-up high-efficient rendering and video conversion to the multimedia of the super high definition three-dimensional picture and text of the high dynamic range of multiple format can be output in real time in the TV station program, the viewing demand of user is satisfied.
Description
Technical Field
The invention relates to the technical field of multimedia, in particular to an ultrahigh-definition high-dynamic-range imaging rendering method and an ultrahigh-definition high-dynamic-range imaging rendering device.
Background
The three-dimensional image-text system is a system applied to real-time processing of television station program digital signals, and can realize the functions of two-dimensional and three-dimensional caption graphic element creation, three-dimensional trick play, multitasking play and the like. At present, the digital signals of television stations gradually develop to ultra-high definition, and the digital signals of television stations can reach 4K or even 8K. However, with the ultra-high definition of the digital signal of the television station program, the increase of resolution and refresh frequency easily causes that the three-dimensional graphics and text system cannot well complete the graphics and text real-time rendering, so that the real-time processing of the digital signal of the television station program may be difficult to complete.
Disclosure of Invention
The embodiment of the invention provides a method, a device, electronic equipment and a computer readable storage medium for imaging and rendering high super-high definition and high dynamic range, which are used for solving the problem that a three-dimensional image-text system cannot well complete image-text real-time rendering.
The embodiment of the invention discloses a high ultra-high definition high dynamic range imaging rendering method, which comprises the following steps:
acquiring at least one multimedia in real time;
uniformly converting the color format of the multimedia into a target color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range;
Rendering a preset three-dimensional model by taking the multimedia in the target color format as a texture source to obtain a rendering result;
And converting the rendering result into target multimedia supporting an ultra-high definition format with a high dynamic range and outputting the target multimedia.
Optionally, the step of uniformly converting the color format of the multimedia into a target color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range includes:
And uniformly converting the color format of the multimedia into a floating point type color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range through a graphic processor.
Optionally, the step of rendering the preset three-dimensional model by using the multimedia in the target color format as a texture source to obtain a rendering result includes:
Selecting a three-dimensional model corresponding to a preset special effect;
And rendering the three-dimensional model corresponding to the preset special effect through a graphic processor by taking the multimedia in the target color format as a texture source to obtain a rendering result.
Optionally, the method further comprises:
and caching the rendering result in a memory corresponding to the graphic processor.
The embodiment of the invention discloses an ultrahigh-definition high-dynamic-range imaging rendering device, which comprises:
The acquisition module is used for acquiring at least one multimedia in real time;
The format conversion module uniformly converts the color format of the multimedia into a target color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range;
The rendering module is used for rendering a preset three-dimensional model by taking the multimedia in the target color format as a texture source to obtain a rendering result;
And the rendering result conversion module is used for converting the rendering result into target multimedia in an ultra-high definition format supporting a high dynamic range and outputting the target multimedia.
Optionally, the format conversion module includes:
The format conversion sub-module is used for uniformly converting the color format of the multimedia into a floating point type color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range through the graphic processor;
And the rendering result conversion sub-module is used for respectively converting the rendering result into different target multimedia supporting the ultra-high definition format with high dynamic range by adopting a plurality of processes by the graphic processor and outputting the target multimedia.
Optionally, the rendering module includes:
The model selecting sub-module is used for selecting a three-dimensional model corresponding to a preset special effect;
and the rendering sub-module is used for rendering the three-dimensional model corresponding to the preset special effect through the graphic processor by taking the multimedia in the target color format as a texture source to obtain a rendering result.
The embodiment of the invention also discloses an electronic device, which comprises:
One or more processors; and
One or more machine readable media having instructions stored thereon, which when executed by the one or more processors, cause the electronic device to perform a method according to any of the embodiments of the present invention.
Embodiments of the invention also disclose one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method according to any of the embodiments of the invention.
The embodiment of the invention has the following advantages:
according to the ultrahigh-definition high-dynamic-range imaging rendering method, at least one multimedia is obtained in real time; uniformly converting the color format of the multimedia into a target color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range; rendering a preset three-dimensional model by taking the multimedia in the target color format as a texture source to obtain a rendering result; and converting the rendering result into target multimedia in an ultra-high definition format supporting high dynamic range and outputting the target multimedia. The color formats are firstly subjected to unified conversion, so that the multimedia can meet the ultra-high definition requirement, and meanwhile, the subsequent efficient rendering and video conversion of the multimedia can be facilitated, so that the multimedia with the ultra-high definition three-dimensional graphics and texts with high dynamic range in various formats can be output in real time in a television station program, and the watching requirement of a user is met.
Drawings
FIG. 1 is a flow chart of steps of an ultrahigh-definition high-dynamic-range imaging rendering method provided in an embodiment of the invention;
FIG. 2 is a flow chart of steps of an ultrahigh-definition high-dynamic-range imaging rendering method provided in an embodiment of the invention;
fig. 3 is a block diagram of an ultrahigh-definition high-dynamic-range imaging rendering device according to an embodiment of the present invention.
Detailed Description
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.
One of the core concepts of the embodiment of the invention is that multimedia generated by a television station in real time is subjected to uniform color format conversion, a result obtained after the color format conversion is used as a texture source to be input into a rendering engine, the rendering engine renders the texture source based on a GPU floating point format, and the rendering result of the engine is converted into target output by utilizing the GPU, so that the rendering efficiency is improved to a certain extent and the requirements of users on different ultra-high definition pictures are met.
Referring to fig. 1, a step flowchart of an ultrahigh-definition high-dynamic-range imaging rendering method provided in an embodiment of the present invention is shown, which may specifically include the following steps:
step 101, acquiring at least one multimedia in real time;
In the embodiment of the invention, the method can be applied to 8k graphic products of television station programs, and has the functions of two-dimensional and three-dimensional subtitle graphic element creation, two-dimensional and three-dimensional subtitle static rendering and the like. In the process of rendering graphics context in real time, the multimedia needs to be acquired and processed in real time.
In particular, the multimedia may be generated in real-time during the production of the television station program, including images, audio, video, etc., as the invention is not limited in this regard.
In a specific implementation, in order to improve the acquisition efficiency, multiple paths of acquisition can be performed on the multimedia based on GPU scheduling and multithreading.
As an example of the present invention, the multi-path acquisition of multimedia based on GPU scheduling multithreading may be: GPU thread 1 can acquire video acquisition 1 with color formats of YUV, color depth 8bit and BT709 SDR; the GPU thread 2 can acquire video acquisition 2 with color formats of YUV, color depth 10bit and BT2110 HDR; the GPU thread 3 can acquire a picture 1 with a color format of BGRA, a color depth of 8bit and BT709 SDR; GPU thread 4 may obtain picture 2 in color format BGRA, color depth 10bit, BT2110 HDR.
Step 102, uniformly converting the color format of the multimedia into a target color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range;
In the embodiment of the invention, the multimedia can have a plurality of color formats, but if the multimedia with different color formats is taken as a texture source to enter a rendering engine, the multimedia with different color formats has different color gamuts, so that unified processing of the multimedia cannot be performed. And the color format may not meet the requirements of high dynamic range ultra-high definition multimedia, resulting in subsequent ultra-high definition multimedia supporting high dynamic range that may not be able to obtain better color effects.
Therefore, in order to facilitate the improvement of the rendering efficiency in the real-time multimedia output process, the color format of the multimedia can be firstly uniformly converted into a target color format corresponding to the ultra-high definition multimedia color space supporting the high dynamic range, so that the color format can meet the requirement of the ultra-high definition multimedia of the high dynamic range, and meanwhile, the subsequent rendering efficiency can be conveniently improved. There is a need for uniform conversion of color space for multimedia.
After the multimedia is obtained, the color format of the multimedia can be uniformly converted into a target color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range, and the target color format meets the requirements of supporting the high dynamic range and the ultra-high definition and is compatible with a plurality of color spaces, so that the multimedia supporting the high dynamic range, the ultra-high definition and being compatible with the plurality of color spaces can be obtained through further processing.
Specifically, the color format may include pixel format, color depth, color space, and the like.
Where pixel format may refer to a representation of pixel color, it may include BGRA, HIS, YUV, etc. BGRA is a way to represent color using Blue Green Red and Alpha; HIS is a way to represent color using Hue, saturation, and Intensity; YUV is a way to represent colors using "Y" to represent brightness (luminence), and "U" and "V" to represent chromaticity (Chrominance).
In a specific implementation, a corresponding conversion method can be obtained according to the color format of the original multimedia and the target color format corresponding to the ultra-high definition multimedia color space supporting the high dynamic range, and the color format of the multimedia is uniformly converted into the target color format corresponding to the ultra-high definition multimedia color space supporting the high dynamic range. In particular, color spaces are used to describe different display devices, or color ranges used or specified by different standards, and a mapping may be constructed between two different color spaces for conversion of the color space.
As an example of the present invention, the color space may be converted by bt.709 to an ultra high definition multimedia color space bt.2020 that supports a high dynamic range. The first step is inverse quantization, obtaining an analog signal value under the BT.709 standard; the second step is color gamut conversion, which converts the analog signal value under BT.709 into the analog signal value under BT.2020 standard; the third step is quantization to obtain a digital signal under the bt.2020 standard. The reason for choosing to perform gamut conversion in the analog domain rather than directly in the digital domain is to preserve more information and details. Since the quantization process may have a discard of information and the color gamut of bt.709 is smaller than bt.2020, if the conversion is directly performed with a digital signal, the image effect under the bt.2020 color gamut may be deteriorated. Therefore, the problem of poor image effect can be solved by recovering the relevant details of the image through the inverse quantization process and then performing the color gamut conversion of the analog signal.
Step 103, rendering a preset three-dimensional model by taking the multimedia in the target color format as a texture source to obtain a rendering result;
in the embodiment of the invention, in order to enable the program effect to meet the requirement of a user, three-dimensional graphics and texts are often added in the program production of a television station, so that three-dimensional model rendering is needed.
After the target color format corresponding to the ultra-high definition multimedia color space supporting the high dynamic range is obtained, the target color format can be used as a texture source to enter a rendering engine, and a preset three-dimensional model is rendered, so that a rendering result is obtained.
Specifically, the three-dimensional model is a three-dimensional model that a user presents in multimedia as needed, and the rendering result may be ultra-high definition multimedia supporting a high dynamic range for a plurality of different color spaces.
In a specific implementation, the GPU may be used as a rendering engine, and the multimedia in the target color format may be used as a texture source to render a preset three-dimensional model based on the GPU floating point format. When rendering the three-dimensional model, a group of texture coordinates need to be designated for each three-dimensional model vertex, the position of the vertex in the mapping is marked, so that a mapping relation between the three-dimensional model and a texture source is established, colors are picked up from the texture source according to the texture coordinates, and finally the rendered three-dimensional model is obtained.
And 104, converting the rendering result into target multimedia in an ultra-high definition format supporting a high dynamic range and outputting the target multimedia.
In the embodiment of the invention, after the rendering result is obtained, in order to meet the requirements of users on ultra-high definition programs with different formats, the rendering result is also required to be converted into target multimedia supporting an ultra-high definition format with a high dynamic range, and the target multimedia is output.
Specifically, the target multimedia is the final output multimedia that the user wishes to obtain, and the target multimedia may be one or more. When the target multimedia is multiple, multiple target multimedia supporting ultra-high definition formats with high dynamic range can be output according to the needs of the user. And the output signal format of the target multimedia may include an SDI signal, an IP signal, an HDMI signal, and the like.
As an example of the present invention, the IO card 1 may output an SDI signal, the IO card 2 may output an HDMI signal, and the IP stream 1 may output an IP signal.
In a specific implementation, the rendering result can be stored in a memory of a display card in a floating point structure, and can be converted into one or more target multimedia supporting an ultra-high definition format with a high dynamic range by utilizing a GPU single-process or multi-process mode, and output signals can be output according to a required output signal format.
According to the ultrahigh-definition high-dynamic-range imaging rendering method, at least one multimedia is obtained in real time; uniformly converting the color format of the multimedia into a target color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range; rendering a preset three-dimensional model by taking the multimedia in the target color format as a texture source to obtain a rendering result; and converting the rendering result into target multimedia in an ultra-high definition format supporting high dynamic range and outputting the target multimedia. Through carrying out unified conversion with the color format at first, can make the multimedia satisfy high dynamic range and super high definition demand simultaneously, can also be convenient for follow-up high-efficient rendering and video conversion to the multimedia of the super high definition three-dimensional picture and text of multiple format can be output in real time in the TV bench program, user's viewing demand is satisfied.
Referring to fig. 2, a step flowchart of a method for imaging and rendering a high ultra-high definition and high dynamic range provided in an embodiment of the present invention may specifically include the following steps:
step 201, obtaining at least one multimedia in real time;
In the embodiment of the invention, the method can be applied to 8k graphic products of television station programs, and has the functions of two-dimensional and three-dimensional subtitle graphic element creation, two-dimensional and three-dimensional subtitle static rendering and the like. In the process of rendering graphics and texts in real time, the multimedia needs to be acquired and processed in real time.
Specifically, the multimedia is a program signal which needs to be processed and finally output to obtain 8k graphic products, and may be an acquisition signal and a media file related to the program. The multimedia may include text, images, animations, sound, video images, etc.
In a specific implementation, in order to improve the acquisition efficiency, multiple paths of acquisition can be performed on the multimedia based on GPU scheduling and multithreading.
Step 202, uniformly converting the color format of the multimedia into a floating point type color format corresponding to the ultra-high definition multimedia color space through a graphic processor;
In the embodiment of the invention, compared with a CPU, the graphics processor has more excellent and flexible processing performance and highly parallelized processing capacity, so that the graphics processor is utilized for color format conversion in order to improve the conversion efficiency. And the floating point type color format has higher precision compared with the integer type color format, meets the precision requirement of 10bit quantized space rendering, and can obtain ultrahigh definition multimedia with better effect and high dynamic range support through subsequent processing.
And because the multimedia can have a plurality of color formats, if the multimedia with different color formats is taken as a texture source to enter a rendering engine, the multimedia with different color formats has different color gamuts, so that unified processing of the multimedia cannot be performed. And the color format may not meet the requirements of ultra-high definition multimedia, resulting in ultra-high definition multimedia that may not be better color effect later. Therefore, in order to facilitate the improvement of the rendering efficiency in the real-time multimedia output process, the color format of the multimedia can be firstly uniformly converted into a target color format corresponding to the ultra-high definition multimedia color space supporting the high dynamic range, so that the color format can meet the requirement of the ultra-high definition multimedia supporting the high dynamic range, and the subsequent rendering efficiency can be conveniently improved. There is a need for uniform conversion of color space for multimedia.
Specifically, the color format may include pixel format, color depth, color space, and the like. And the data types of the floating-point type color format include float (single-precision floating-point type), double (double-precision floating-point type), long double (long double-precision floating-point type), and the like.
In a specific implementation, the graphics processor may obtain a corresponding conversion method according to a color format of an original multimedia and a target color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range, and uniformly convert the color format of the multimedia into the target color format corresponding to the ultra-high definition multimedia color space supporting the high dynamic range. Specifically, to increase efficiency, the implementation process may be written using Shander or Cuda, and the color format of the output may be designated as floating point type.
Step 203, rendering a preset three-dimensional model by taking the multimedia in the target color format as a texture source to obtain a rendering result;
In an embodiment of the present invention, the step of rendering the preset three-dimensional model using the multimedia in the target color format as a texture source to obtain a rendering result includes:
S11, selecting a three-dimensional model corresponding to a preset special effect;
In the embodiment of the invention, the three-dimensional model corresponding to the preset special effect is selected for the subsequent rendering of the three-dimensional model, so that the image-text output of the three-dimensional model with the required special effect is obtained.
Specifically, the three-dimensional model corresponding to the special effect is a three-dimensional model with the corresponding special effect, which needs to be presented in multimedia in a television station program. The three-dimensional model may include cylinders, cones, tables, spheres, and the like.
In a specific implementation, according to the preset output program effect, the corresponding special effect and the three-dimensional model corresponding to the special effect are preset, when the three-dimensional model needs to be rendered, the three-dimensional model corresponding to the preset special effect can be selected, and subsequent rendering processing is performed.
And S12, rendering the three-dimensional model corresponding to the preset special effect by using the multimedia in the target color format as a texture source through a graphic processor to obtain a rendering result.
In the embodiment of the invention, compared with a CPU, the graphics processor has more excellent and flexible processing performance and highly parallelized processing capacity, so that the graphics processor is utilized for rendering in order to improve the rendering efficiency. And in order to achieve the effect of the three-dimensional model with the required special effect and the effect of meeting the program output, the multimedia in the target color format is required to be input into a graphic processor as a texture source for rendering.
Specifically, the multimedia in the target color format is a texture source that needs to be attached as a special effect to the corresponding three-dimensional model. The multimedia in the target color format may have a plurality of color formats, such as floating point BGRA, BT709 compatible color space and BT2020 color space, etc.
In a specific implementation, the graphics processor may be used as a rendering engine, and the graphics processor may render the three-dimensional model corresponding to the preset special effect by using the multimedia in the target color format as a texture source based on the GPU floating point format. When the three-dimensional model is rendered, a group of texture coordinates are required to be designated for each vertex, the position of the vertex in the mapping is designated, so that a mapping relation between the three-dimensional model and a texture source is established, colors are picked up from the texture source according to the texture coordinates, and the rendered three-dimensional model is finally obtained.
And 204, converting the rendering result into target multimedia supporting an ultra-high definition format with a high dynamic range and outputting the target multimedia.
In one embodiment of the invention, the method further comprises:
And S21, caching the rendering result in a memory corresponding to the graphic processor.
In the embodiment of the invention, in order to improve the rendering efficiency, facilitate the graphics processor to acquire the rendering result more quickly for processing, shorten the rendering processing time and improve the output instantaneity, after the rendering result is acquired, the rendering result can be cached in the memory corresponding to the graphics processor.
Specifically, the rendering results may be cached in the graphics processor memory in a floating point structure to meet the output precision requirements.
In one embodiment of the present invention, the step of converting the rendering result into a target multimedia supporting an ultra-high definition format of a high dynamic range and outputting the same includes:
S31, the graphic processor respectively converts the rendering result into target multimedia with different ultra-high definition formats by adopting a plurality of processes and outputs the target multimedia.
In the embodiment of the invention, in order to improve the conversion efficiency, a graphics processor can be used for conversion. And in order to meet the requirements of users on ultra-high definition programs supporting high dynamic range in different formats, the graphic processor can convert the rendering result into a plurality of different target multimedia supporting ultra-high definition formats supporting high dynamic range by adopting a plurality of processes and output the target multimedia.
Specifically, the graphics processor has more excellent and flexible processing performance and highly parallelized processing capability than the CPU, and therefore, in order to improve conversion efficiency, the graphics processor is used to convert rendering results. The different target multimedia supporting the high-dynamic-range ultra-high-definition format may be multimedia supporting the high-dynamic-range ultra-high-definition format with different resolutions and/or different color spaces. And in order to meet the requirement of simulcasting of different signal formats of the television station, the output signal format of the target multimedia may include an SDI signal, an IP signal, an HDMI signal, and the like.
In a specific implementation, the rendering result may be input to a plurality of graphics processor processes, each process performs different conversion processing on the rendering result according to different conversion methods, so each process may output the target multimedia corresponding to the ultra-high definition format supporting the high dynamic range.
As an example of the invention, after the rendering result is input into the graphics processor process 1 for conversion, the multimedia with 8K resolution, YUV format, 10BIT color depth and BT2020 HDR is output through the IO card 1; after the rendering result is input into the graphics processor process 2 for conversion, outputting multimedia with 4K resolution, YUV format, 10BIT color depth and BT2020 HDR through the IO card 2; after the rendering result is input into the graphics processor process 3 for conversion, outputting multimedia of HD resolution, YUV format, 8BIT color depth and BT709 SDR through the IO card 3; after the rendering result is input into the graphics processor process 4 for conversion, the multimedia with 4K resolution, YUV format, 10BIT color depth and BT2020 HDR is output through the IP stream 1.
It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.
Referring to fig. 3, a block diagram of a device for an ultrahigh-definition high-dynamic-range imaging rendering method provided in an embodiment of the present invention is shown, which may specifically include the following modules:
An acquisition module 301, configured to acquire at least one multimedia in real time;
the format conversion module 302 is configured to uniformly convert, by the graphics processor, the color format of the multimedia into a floating point color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range;
The rendering module 303 is configured to render a preset three-dimensional model by using the multimedia in the target color format as a texture source, so as to obtain a rendering result;
the rendering result conversion module 304 is configured to convert the rendering result into a target multimedia in an ultra-high definition format supporting a high dynamic range and output the target multimedia.
In one embodiment of the present invention, the format conversion module includes:
The format conversion sub-module is used for uniformly converting the color format of the multimedia into a floating point type color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range through the graphic processor;
And the rendering result conversion sub-module is used for respectively converting the rendering result into different target multimedia supporting the ultra-high definition format with high dynamic range by adopting a plurality of processes by the graphic processor and outputting the target multimedia.
In one embodiment of the present invention, the rendering module includes:
The model selecting sub-module is used for selecting a three-dimensional model corresponding to a preset special effect;
and the rendering sub-module is used for rendering the three-dimensional model corresponding to the preset special effect through the graphic processor by taking the multimedia in the target color format as a texture source to obtain a rendering result.
For the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.
The embodiment of the invention also provides electronic equipment, which comprises:
One or more processors; and
One or more machine readable media having instructions stored thereon, which when executed by the one or more processors, cause the electronic device to perform the method of embodiments of the present invention.
Embodiments of the invention also provide one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the methods described in embodiments of the invention.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.
It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or terminal device that comprises the element.
The invention provides an ultrahigh-definition high-dynamic-range imaging rendering method and an ultrahigh-definition high-dynamic-range imaging rendering device, which are described in detail, wherein specific examples are applied to illustrate the principle and the implementation of the invention, and the description of the above examples is only used for helping to understand the method and the core idea of the invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (4)
1. An ultrahigh-definition high-dynamic-range imaging rendering method is characterized by comprising the following steps of:
Scheduling multithreading based on a graphics processor to obtain at least one multimedia in real time;
Uniformly converting the color format of the multimedia into at least one target color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range; the target color format is compatible with at least one color space;
Rendering a preset three-dimensional model by taking the multimedia in the target color format as a texture source to obtain a rendering result;
Converting the rendering result into target multimedia supporting an ultra-high definition format with a high dynamic range and outputting the target multimedia;
Caching the rendering result in a memory corresponding to the graphic processor so as to improve rendering efficiency and output instantaneity;
the step of uniformly converting the color format of the multimedia into at least one target color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range comprises the following steps:
Uniformly converting the color format of the multimedia into a floating point type color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range through a graphic processor;
the step of rendering the preset three-dimensional model by taking the multimedia in the target color format as a texture source to obtain a rendering result comprises the following steps:
Selecting a three-dimensional model corresponding to a preset special effect;
Using the multimedia in the target color format as a texture source, and rendering the three-dimensional model corresponding to the preset special effect through a graphic processor to obtain a rendering result;
the step of converting the rendering result into target multimedia supporting ultra-high definition format with high dynamic range and outputting the target multimedia comprises the following steps:
The graphic processor adopts a plurality of processes to respectively convert the rendering result into a plurality of different target multimedia supporting the ultra-high definition format with high dynamic range and outputs the target multimedia.
2. An ultra-high definition high dynamic range imaging rendering device, comprising:
The acquisition module is used for scheduling multithreading based on the graphic processor to acquire at least one multimedia in real time;
The format conversion module is used for uniformly converting the color format of the multimedia into at least one target color format corresponding to the ultra-high definition multimedia color space supporting the high dynamic range; the target color format is compatible with at least one color space;
The rendering module is used for rendering a preset three-dimensional model by taking the multimedia in the target color format as a texture source to obtain a rendering result;
The rendering result conversion module is used for converting the rendering result into target multimedia supporting an ultra-high definition format with a high dynamic range and outputting the target multimedia;
The buffer module is used for buffering the rendering result in a memory corresponding to the graphic processor so as to improve the rendering efficiency and the output instantaneity;
wherein, the format conversion module includes:
The format conversion sub-module is used for uniformly converting the color format of the multimedia into a floating point type color format corresponding to an ultra-high definition multimedia color space supporting a high dynamic range through the graphic processor;
The rendering result conversion sub-module is used for respectively converting the rendering result into a plurality of different target multimedia supporting high-dynamic-range ultra-high definition formats by adopting a plurality of processes and outputting the target multimedia;
Wherein the rendering module comprises:
The model selecting sub-module is used for selecting a three-dimensional model corresponding to a preset special effect;
and the rendering sub-module is used for rendering the three-dimensional model corresponding to the preset special effect through the graphic processor by taking the multimedia in the target color format as a texture source to obtain a rendering result.
3. An electronic device, comprising:
One or more processors; and
One or more machine readable media having instructions stored thereon, which when executed by the one or more processors, cause the electronic device to perform the method of claim 1.
4. One or more machine readable media having instructions stored thereon that, when executed by one or more processors, cause the processors to perform the method of claim 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210093729.2A CN114466244B (en) | 2022-01-26 | 2022-01-26 | Ultrahigh-definition high-dynamic-range imaging rendering method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210093729.2A CN114466244B (en) | 2022-01-26 | 2022-01-26 | Ultrahigh-definition high-dynamic-range imaging rendering method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114466244A CN114466244A (en) | 2022-05-10 |
| CN114466244B true CN114466244B (en) | 2024-06-18 |
Family
ID=81410917
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210093729.2A Active CN114466244B (en) | 2022-01-26 | 2022-01-26 | Ultrahigh-definition high-dynamic-range imaging rendering method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114466244B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107465939A (en) * | 2016-06-03 | 2017-12-12 | 杭州海康机器人技术有限公司 | The processing method and processing device of vedio data stream |
| CN110149507A (en) * | 2018-12-11 | 2019-08-20 | 腾讯科技（深圳）有限公司 | Method for processing video frequency, data processing equipment and storage medium |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102722861A (en) * | 2011-05-06 | 2012-10-10 | 新奥特（北京）视频技术有限公司 | CPU-based graphic rendering engine and realization method |
| JP2017512393A (en) * | 2014-02-21 | 2017-05-18 | コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． | Video decoder enabling high resolution and high dynamic range |
| CN104244087B (en) * | 2014-09-19 | 2018-05-01 | 青岛海信移动通信技术股份有限公司 | A kind of method and apparatus of Video Rendering |
| US10192297B2 (en) * | 2016-02-12 | 2019-01-29 | Samsung Electronics Co., Ltd. | Method and apparatus for creating, streaming, and rendering HDR images |
| CN111383329B (en) * | 2020-03-06 | 2023-07-21 | 深圳市工之易科技有限公司 | Three-dimensional image display method and device based on browser and electronic equipment |
| CN112001975B (en) * | 2020-07-10 | 2024-05-28 | 浙江大华技术股份有限公司 | Image data conversion method, related equipment and device |
| CN112200753B (en) * | 2020-10-30 | 2023-02-10 | 青岛海泰新光科技股份有限公司 | Processing method for wide dynamic range of image |
| CN113450440B (en) * | 2021-06-22 | 2023-05-26 | 网易（杭州）网络有限公司 | Method, apparatus, computer-readable storage medium, and electronic device for rendering image |
-
2022
- 2022-01-26 CN CN202210093729.2A patent/CN114466244B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107465939A (en) * | 2016-06-03 | 2017-12-12 | 杭州海康机器人技术有限公司 | The processing method and processing device of vedio data stream |
| CN110149507A (en) * | 2018-12-11 | 2019-08-20 | 腾讯科技（深圳）有限公司 | Method for processing video frequency, data processing equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114466244A (en) | 2022-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7126184B2 (en) | DISPLAY DEVICE, CONVERSION DEVICE, DISPLAY METHOD, AND COMPUTER PROGRAM | |
| US20230171429A1 (en) | Color volume transforms in coding of high dynamic range and wide color gamut sequences | |
| US20200014880A1 (en) | Display method and display device | |
| US11132758B2 (en) | Embedding data in video without visible impairments | |
| JP5991502B2 (en) | Conversion method and conversion device | |
| JP6472429B2 (en) | Method, apparatus and system for determining LUMA values | |
| RU2737507C2 (en) | Method and device for encoding an image of a high dynamic range, a corresponding decoding method and a decoding device | |
| AU2016212243A1 (en) | A method and apparatus of encoding and decoding a color picture | |
| JP2014519620A (en) | High dynamic range image signal generation and processing | |
| KR102567633B1 (en) | Adaptive high dynamic range tone mapping using overlay instructions | |
| JP2023175868A (en) | Image processing method and apparatus | |
| US10019814B2 (en) | Method, apparatus and system for determining a luma value | |
| WO2014142635A1 (en) | Creating details in an image with adaptive frequency lifting | |
| JP2018511193A (en) | Method and apparatus for inverse tone mapping of pictures | |
| WO2016063475A1 (en) | Transmission method and reproduction device | |
| US10382735B2 (en) | Targeted display color volume specification via color remapping information (CRI) messaging | |
| WO2016181584A1 (en) | Display method and display device | |
| CN114466244B (en) | Ultrahigh-definition high-dynamic-range imaging rendering method and device | |
| CN114245027B (en) | Video data hybrid processing method, system, electronic equipment and storage medium | |
| US11094286B2 (en) | Image processing apparatus and image processing method | |
| WO2023150074A1 (en) | Beta scale dynamic display mapping | |
| Dai et al. | An overview of end-to-end HDR | |
| Pouli et al. | Hdr content creation: creative and technical challenges | |
| WO2023150193A1 (en) | Supporting multiple target display types | |
| JP2019110538A (en) | Luminance conversion method, luminance conversion device, and video display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |