CN112399228A - Video processing method, video processing device and video processing equipment - Google Patents
Video processing method, video processing device and video processing equipment Download PDFInfo
- Publication number
- CN112399228A CN112399228A CN201910738053.6A CN201910738053A CN112399228A CN 112399228 A CN112399228 A CN 112399228A CN 201910738053 A CN201910738053 A CN 201910738053A CN 112399228 A CN112399228 A CN 112399228A
- Authority
- CN
- China
- Prior art keywords
- decoding
- video
- display
- video frame
- sliced
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 94
- 238000003672 processing method Methods 0.000 title claims abstract description 41
- 238000000354 decomposition reaction Methods 0.000 claims description 14
- 230000008859 change Effects 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 11
- 239000012634 fragment Substances 0.000 claims description 3
- 238000000034 method Methods 0.000 abstract description 17
- 238000010586 diagram Methods 0.000 description 11
- 230000000694 effects Effects 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 230000006378 damage Effects 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application provides a video processing method, a video processing device and video processing equipment, and relates to the technical field of video processing. In the present application, first, a video frame to be processed is decomposed into a plurality of sliced video frames. Secondly, for each sliced video frame, a decoding channel is determined in a plurality of decoding channels according to the position information of the sliced video frame, wherein the decoding channels determined by different sliced video frames are different. Then, for each sliced video frame, decoding the sliced video frame through a decoding channel determined by the sliced video frame, and sending video data obtained by decoding to a display sub-window corresponding to the decoding channel for displaying, wherein different decoding channels correspond to different display sub-windows. By the method, the problem of low decoding capability of the video processing equipment in the prior art can be solved.
Description
Technical Field
The present application relates to the field of video processing technologies, and in particular, to a video processing method, a video processing apparatus, and a video processing device.
Background
High resolution video streams are widely used because they provide a wide field of view and a clear picture. For example, in an application scene of video monitoring, the monitoring scene may be subjected to image acquisition by the multi-view panoramic camera to obtain an 8K video code stream, so as to perform accurate and reliable monitoring analysis.
The inventor researches and discovers that in most existing video processing equipment (decoding chips), the high-resolution video code stream cannot be effectively decoded based on the existing decoding mechanism, so that the decoding capability is low.
Disclosure of Invention
In view of the above, an object of the present application is to provide a video processing method, a video processing apparatus and a video processing device, so as to solve the problem of low decoding capability of the video processing device in the prior art.
In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:
a video processing method applied to a video processing apparatus having a plurality of decoding channels, the video processing method comprising:
decomposing a video frame to be processed into a plurality of sliced video frames;
determining a decoding channel in a plurality of decoding channels according to the position information of each sliced video frame, wherein the decoding channels determined by different sliced video frames are different;
and for each sliced video frame, decoding the sliced video frame through a decoding channel determined by the sliced video frame, and sending video data obtained by decoding to a display sub-window corresponding to the decoding channel for displaying, wherein different decoding channels correspond to different display sub-windows.
In a preferred option of the embodiment of the present application, in the above video processing method, before the step of determining, for each of the sliced video frames, one decoding channel from among a plurality of decoding channels according to the position information of the sliced video frame, the video processing method further includes:
judging whether a plurality of display sub-windows which have corresponding relations with the decoding channels are established or not;
if the plurality of display sub-windows are not established, establishing a plurality of display sub-windows, and establishing a corresponding relation between each display sub-window and each decoding channel.
In a preferred option of the embodiment of the present application, in the video processing method, the step of establishing a plurality of display sub-windows includes:
acquiring the position information of the plurality of sliced video frames;
and establishing a plurality of display sub-windows according to the position information and a preset display window, wherein a display area formed by the plurality of display sub-windows is the same as a display area formed by the display window.
In a preferred choice of the embodiment of the present application, in the video processing method, the method further includes:
when a window change instruction is received, the size and/or position of the display area formed by the display window are changed, and the size and/or position of the display area formed by the plurality of display sub-windows are changed based on the change processing.
In a preferred choice of the embodiment of the present application, in the above video processing method, before the step of decomposing the video frame to be processed into a plurality of sliced video frames, the video processing method further includes:
judging whether the video frame to be processed carries identification information or not;
and if the video frame to be processed carries the identification information, executing the step of decomposing the video frame to be processed into a plurality of fragmented video frames.
In a preferred choice of the embodiment of the present application, in the video processing method, the method further includes:
if the video frame to be processed does not carry the identification information, judging whether a plurality of display sub-windows corresponding to the decoding channels are established or not;
if the plurality of display sub-windows are not established, decoding the video frame to be processed through a decoding channel corresponding to a preset display window, and sending the video data obtained through decoding to the preset display window for displaying.
In a preferred choice of the embodiment of the present application, in the video processing method, the method further includes:
if the plurality of display sub-windows are established, removing the corresponding relation between each display sub-window and each decoding channel, and establishing the corresponding relation between the display window and one decoding channel;
and decoding the video frame to be processed through a decoding channel corresponding to the display window, and sending the video data obtained by decoding to the display window for displaying.
An embodiment of the present application further provides a video processing apparatus, which is applied to a video processing device having multiple decoding channels, where the video processing apparatus includes:
the video frame decomposition module is used for decomposing a video frame to be processed into a plurality of fragment video frames;
a decoding channel determining module, configured to determine, for each of the sliced video frames, a decoding channel in a plurality of decoding channels according to the position information of the sliced video frame, where the decoding channels determined for different sliced video frames are different;
and the video frame decoding module is used for decoding each sliced video frame through a decoding channel determined by the sliced video frame and sending the video data obtained by decoding to a display sub-window corresponding to the decoding channel for displaying, wherein different decoding channels correspond to different display sub-windows.
On the basis, an embodiment of the present application further provides a video processing apparatus, including:
a memory storing a computer program;
at least one processor electrically connected to the memory, the at least one processor configured to execute the computer program to form a plurality of decoding channels, and to implement the video processing method described above.
In a preferred option of the embodiment of the present application, in the above video processing device, the at least one processor includes a master processor and at least one slave processor electrically connected to the master processor;
the master processor and each slave processor are respectively electrically connected with the memory and used for executing the computer program to form a plurality of decoding channels on the at least one slave processor and realize the video processing method.
According to the video processing method, the video processing device and the video processing equipment, the plurality of decoding channels are formed in the video processing equipment, the video frame with higher resolution is decomposed to obtain the plurality of sliced video frames, the decoding processing is respectively carried out through the different decoding channels, each decoding channel only needs to carry out decoding processing on one sliced video frame, the data volume needing to be processed by each decoding channel is reduced, and the decoding processing can be effectively carried out. In this way, the problem that in the prior art, the video frame with higher resolution is difficult to effectively decode due to the fact that the video frame is directly decoded through one decoding channel in the video processing device can be solved. That is to say, the decoding mechanism provided by the present application can improve the problem of low decoding capability of the existing video processing device, and has high practical value.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
Fig. 1 is a block diagram of a video processing apparatus according to an embodiment of the present application.
Fig. 2 is a schematic distribution diagram of a plurality of decoding channels according to an embodiment of the present application.
Fig. 3 is a schematic connection diagram of a master processor and a slave processor according to an embodiment of the present application.
Fig. 4 is a schematic interaction diagram of a video processing device and a network camera provided in an embodiment of the present application.
Fig. 5 is a schematic flowchart of a video processing method according to an embodiment of the present application.
Fig. 6 is a schematic diagram illustrating an effect of performing a decomposition process on a video frame to be processed according to an embodiment of the present application.
Fig. 7 is a schematic diagram illustrating an effect of performing another decomposition process on a video frame to be processed according to an embodiment of the present application.
Fig. 8 is a schematic diagram illustrating an effect of performing another decomposition process on a video frame to be processed according to an embodiment of the present application.
Fig. 9 is a schematic diagram illustrating an effect of executing a window change instruction according to an embodiment of the present application.
Fig. 10 is a schematic diagram illustrating another effect of executing a window change instruction according to an embodiment of the present application.
Fig. 11 is a schematic diagram illustrating a splicing effect of multiple displays according to an embodiment of the present application.
Fig. 12 is a block diagram illustrating functional modules included in a video processing apparatus according to an embodiment of the present disclosure.
Icon: 10-a video processing device; 12-a memory; 14-a processor; 15-a main processor; 16-a slave processor; 100-video processing means; 110-a video frame decomposition module; 120-a decoding channel determination module; 130-video frame decoding module.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
As shown in fig. 1, embodiments of the present application provide a video processing device 10 that may include a memory 12 and a processor 14 electrically connected, directly or indirectly, to the memory 12.
In detail, the memory 12 has stored thereon a computer program. Moreover, the computer program can be run on the processor 14, so as to form a plurality of decoding channels (as shown in fig. 2), and implement the video processing method provided by the embodiment of the present application. It should be noted that the computer program may be stored in the memory 12 in the form of a software functional module. Moreover, the software functional module may include the video processing apparatus 100 provided in the embodiment of the present application.
The Memory 12 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like.
The processor 14 may be a general-purpose processor including a Central Processing Unit (CPU) or the like, such as an N3160 chip. Moreover, the number of the processors 14 is not limited, and can be selected according to the actual application requirements.
For example, in one alternative example, the processor 14 may be one. That is to say, the computer program stored in the memory 12 is executed on the processor 14, so that the video frame to be processed is decomposed on the processor 14, and a plurality of decoding channels are formed on the processor 14 for decoding, thereby implementing the video processing method provided by the embodiment of the present application.
For another example, in another alternative example, in conjunction with FIG. 3, the processor 14 may include a master processor 15 and a slave processor 16 electrically connected, directly or indirectly, to the master processor 15. That is, the computer programs stored on the memory 12 may be run on the master processor 15 and the slave processor 16, respectively. For example, the video frame to be processed may be decomposed on the master processor 15, and then a plurality of decoding channels are formed on the slave processor 16 to decode a plurality of fragmented video frames obtained by decomposition, so as to implement the video processing method provided in the embodiment of the present application.
The number of the slave processors 16 is also not limited, and may be one or a plurality of.
That is, when there is one slave processor 16, the plurality of decoding channels may be all formed on the slave processor 16. When the number of the slave processors 16 is plural, the plural decoding channels may be formed on different slave processors 16 (for example, one decoding channel may be formed on one slave processor 16), and thus, a distributed hardware architecture including one master processor 15 and plural slave processors 16 may be formed inside the video processing apparatus 10.
It is understood that the structures shown in fig. 1-3 are only schematic, and the video processing device 10 may further include more components, for example, a communication unit for performing information interaction with other devices (such as a webcam shown in fig. 4, for capturing a target object to form the video frame to be processed).
With reference to fig. 5, an embodiment of the present application further provides a video processing method applicable to the video processing apparatus 10. The video processing method may include step S110, step S120, and step S130, which will be explained in detail with reference to fig. 5.
Step S110, decomposing the video frame to be processed into a plurality of sliced video frames.
In this embodiment, the video processing device 10 may be communicatively connected to a network Camera (IPC, IP Camera) (as shown in fig. 4) to obtain a to-be-processed video frame formed by shooting a target object by the network Camera. Then, after the video frame to be processed is obtained, the video frame to be processed may be decomposed to obtain a plurality of sliced video frames.
That is, the plurality of sliced video frames may be spliced to form the video frame to be processed.
Step S120, for each of the sliced video frames, determining a decoding channel from a plurality of decoding channels according to the position information of the sliced video frame.
In this embodiment, a plurality of decoding channels are formed in advance on the processor 14 of the video processing apparatus 10. Then, after the plurality of sliced video frames are obtained in step S110, the decoding channel corresponding to each sliced video frame is determined according to the position information of each sliced video frame.
Wherein the number of the plurality of decoding channels may be greater than or equal to the number of the plurality of sliced video frames, so that the decoding channels determined by different sliced video frames may be different.
Step S130, for each of the sliced video frames, performing decoding processing on the sliced video frame through a decoding channel determined by the sliced video frame, and sending the video data obtained by decoding to a display sub-window corresponding to the decoding channel for displaying.
In this embodiment, since different decoding channels correspond to different display sub-windows, in order to enable efficient tiled display of each of the sliced video frames through each display sub-window, it is necessary to determine the corresponding decoding channel based on the position information of the sliced video frame in step S120.
For example, if the corresponding position of one slice video frame in the video frame to be processed is the top left corner, the determined decoding channel should be the decoding channel having the corresponding relationship with the display sub-window located at the top left corner in the plurality of decoding channels. Therefore, when the display device is controlled to display through each display sub-window, the image content of the video frame to be processed can be effectively restored.
By the method, the video frame with higher resolution can be decomposed to obtain a plurality of sliced video frames, and the decoding processing is respectively carried out through different decoding channels, so that each decoding channel only needs to carry out decoding processing on one sliced video frame, the data volume required to be processed by each decoding channel is reduced, and the decoding processing can be effectively carried out on each sliced video frame.
Optionally, the method for performing the step S110 to decompose the video frame to be processed is not limited, and may be selected according to the actual application requirement.
For example, in an alternative example, after acquiring the to-be-processed video frame, the video processing device 10 may perform transcoding processing on the to-be-processed video frame to remove encapsulation information (such as timestamp information) carried therein, and obtain ES video bare data. Then, each small frame video frame in the ES video bare data is obtained to obtain a plurality of fragment video frames.
It should be noted that, when the target object is shot by the network camera to form the to-be-processed video frame, the video frame obtained by shooting the target object is decomposed into a plurality of small video frames, and then the plurality of small video frames are uniformly packaged, so that the video processing device 10 decomposes the obtained ES video bare data into a plurality of fragmented video frames after transcoding.
In the ES video bare data, each small frame video frame may have a frame header, and the frame header carries the position information and the frame sequence number information of the small frame video frame. Thus, the position information and the frame number information of each segmented video frame can be obtained by analyzing the frame header (the position information and the frame number information of each segmented video frame corresponding to the same video frame to be processed are different and the same).
In an alternative example, if the display resolution of the to-be-processed video frame is 8K, the to-be-processed video frame may be decomposed into 4 sliced video frames of 4K.
For example, in conjunction with fig. 6, in an alternative example, the 8K (8640 × 3840) video frame to be processed may be decomposed into 4 sliced video frames in a left-to-right direction, and the display resolution of each sliced video frame may be 2160 × 3840.
For another example, in combination with fig. 7, in another alternative example, the 8K (8640 × 3840) video frame to be processed may be decomposed into 4 sliced video frames according to a cross, and the display resolution of each sliced video frame may be 4320 × 1920.
For another example, in combination with fig. 8, in another alternative example, the 8K (8640 × 3840) video frame to be processed may be decomposed into 4 sliced video frames in a top-down direction, and the display resolution of each sliced video frame may be 8640 × 960.
It should be noted that the specific components for performing the above steps may be different according to the configuration of the processor 14 of the video processing apparatus 10.
For example, in an alternative example, if the video processing device 10 is a distributed device composed of a master processor 15 and a slave processor 16, the master processor 15 may perform transcoding, decomposition processing, and decoding channel determination processing on the to-be-processed video frame, and the slave processor 16 may perform decoding processing on the sliced video frame through decoding channels respectively formed on the slave processor 16.
Further, considering that there may be no display sub-window if the video data obtained by decoding each sliced video frame is displayed through the display sub-window for the first time or not through the display sub-window for the last time, the above steps are effectively performed to ensure that the video splicing display is effectively completed. In this embodiment, before performing step S120, the video processing method may further include the following steps.
Firstly, whether a plurality of display sub-windows which have corresponding relations with the decoding channels are established is judged. Secondly, if the plurality of display sub-windows are not established, a plurality of display sub-windows are established, a corresponding relationship is established between each display sub-window and each decoding channel, and then step S120 is executed. Alternatively, if the plurality of display sub-windows are established, step S120 may be directly performed.
The display sub-windows and the decoding channels can be in a one-to-one relationship, so that video processing obtained by decoding through one of the decoding channels can be directly sent to the uniquely determined display sub-window for display.
Optionally, the manner of establishing the plurality of display sub-windows is not limited, and may be selected according to the actual application requirements.
For example, in an alternative example, the step of establishing a plurality of display sub-windows may comprise the sub-steps of:
first, position information of the plurality of sliced video frames is acquired. Secondly, a plurality of display sub-windows can be established according to the position information and a preset display window, wherein a display area formed by the display sub-windows is the same as a display area formed by the display window.
For example, in the above examples of fig. 6 to 8, if the number of the sliced video frames is 4, 4 display sub-windows may be established. Also, the relative positional relationship between the display sub-windows may be the same as the relative positional relationship between the sliced video frames.
In detail, as in the example shown in fig. 8, the 4 sliced video frames may be distributed from top to bottom, and correspondingly, the 4 established display sub-windows may also be distributed from top to bottom.
Furthermore, considering that the video processing apparatus 10 may also directly perform decoding processing on the video frame to be processed through one decoding channel (for example, a part of the video frame with lower display resolution is not decomposed to obtain a plurality of fragmented video frames), a display window is also established in advance for displaying the video frame to be processed.
In this way, the problem of poor user experience due to different display areas when the display is performed through the display sub-window and the display is performed through the display window is avoided. In this embodiment, when the display sub-window is established, the information of the display window may be combined so that the display area formed by the plurality of display sub-windows is the same as the display area formed by the display window.
It should be noted that the display sub-window and the display window are located in different layers, that is, the layer number of the display sub-window is different from the layer number of the display window.
Wherein, in an alternative example, the layer number of the display sub-window may be greater than the layer number of the display window. In this way, the display sub-window can be made to cover the display window. Therefore, when the display is required to be displayed through the display sub-window, the destruction processing of the display window is not required.
Also, it is considered that the destruction processing is not performed on the display window, so that it can be kept all the time. Therefore, when the display sub-window is established, the display sub-window and the display window can be connected, so that the display sub-window can be conveniently communicated with the software layer through the display window, and the control of the display sub-window is realized.
That is, in the present embodiment, the video processing method may further include the following steps.
When a window change instruction is received, first, the size and/or position of a display area configured by the display window is changed. Then, the size and/or position of the display area constituted by the plurality of display sub-windows are changed based on the change processing.
The change processing performed on the display window is the same as the change processing performed on the display sub-window, so that the control on the display sub-window can be realized through the control on the display window.
According to the method, the size and/or the position of the display area formed by the plurality of display sub-windows can be changed, for example, the display area can be reduced or enlarged, and the position can be changed, so that the user experience is effectively improved.
For example, in an alternative example, referring to fig. 9, when the user watches a video, if the user is located on the left side of the display wall area of the display device, in this case, in order to ensure the watching effect of the user and avoid the damage to the eyes, the display area formed by the display sub-window may be moved from the center of the display wall area to the left side area of the display wall area based on the window change instruction.
For another example, in another alternative example, in combination with fig. 10, when the user watches a video, if the user is closer to the display device, in this case, in order to ensure the watching effect of the user and avoid the damage to the eyes, the display area formed by the display sub-window may be reduced by a certain ratio based on the window changing instruction.
The display wall area is an effective area in which a display can be performed in the display device, and the display area formed by the display sub-window is an area in which a video frame is currently actually displayed in the effective area.
That is, the display wall area is greater than or equal to the display area of the display sub-window. In actual display, the display effect presented in the region other than the display region constituted by the display sub-window in the display wall region is black.
Further, to increase the capabilities of the video processing device 10, for example, different processing may be performed for different video frames. In this embodiment, before performing step S110, the video processing method may further include the following steps.
Firstly, when a video frame to be processed is received, whether the video frame to be processed carries identification information can be judged. Next, if the video frame to be processed carries the identification information, step S110 is executed.
That is, only if the video frame to be processed has the identification information, the steps S110, S120 and S130 are executed continuously to perform the decomposition processing and the decoding processing through different decoding channels, respectively.
The specific content of the identification information is not limited, and can be selected according to the actual application requirements. For example, the identification information may be a display resolution of the video frame to be processed.
In an alternative example, the identification information may be used to indicate that the display resolution of the video frame to be processed is 8K (8640 × 3840). That is, only when the display resolution of the video frame to be processed is 8K, the corresponding processing is performed through step S110, step S120, and step S130.
It should be noted that the step of acquiring the identification information may include the following sub-steps:
and analyzing the SEI data to obtain the identification information based on the SEI data in the ES video bare data obtained by decoding the video frame to be processed.
Wherein the SEI data may be a type value type. Also, the SEI data carries the frame length of each small frame of video frame (i.e., each slice of video frame).
Further, when it is determined that the video frame to be processed does not have the identification information, the video frame to be processed may be selected to be transcoded and then directly decoded through a decoding channel.
For example, in an alternative example, for a video frame to be processed without identification information, the video processing method may further include the following steps.
Firstly, whether a plurality of display sub-windows which have corresponding relations with the decoding channels are established is judged. Secondly, if the plurality of display sub-windows are not established, decoding the video frame to be processed through a decoding channel corresponding to a preset display window, and sending the video data obtained through decoding to the preset display window for displaying.
It should be noted that, before the above steps are performed, a display window and a decoding channel are pre-established, and the display window and the decoding channel are associated with each other. Then, when the above steps are executed, if it is determined that the video frame to be processed does not have the identification information, the decoding process can be performed through the decoding channel.
For example, if the identification information indicates that the display resolution of the to-be-processed video frame is 8K, when the to-be-processed video frame with the display resolution of 4K is received, the to-be-processed video frame may be decoded through a pre-established decoding channel, and then displayed through the display window.
Therefore, the video processing device 10 can effectively process the video frames to be processed with identification information and without identification information, thereby ensuring that the video processing device 10 has higher adaptability and further improving the practical value.
When the above steps are executed to determine that a plurality of display sub-windows having a corresponding relationship with each decoding channel are established, the layer number of each display sub-window is generally higher than that of the display window (i.e., the display window is covered by the display sub-windows), so that the display window is difficult to display normally.
Therefore, in order to enable the display window to normally display, in this embodiment, a certain process may be performed on the display sub-window, so that the display window is not covered by the display sub-window.
For example, in an alternative example, the layer number of the display window or the layer number of each display sub-window may be modified such that the layer number of the display window is greater than the layer number of each display sub-window, thereby enabling normal display of the display window.
For another example, in another alternative example, each of the display sub-windows may be destroyed so that none of the display windows are covered by the display sub-window, thereby achieving normal display.
It should be noted that, in the first example, modifying the layer number of the display window or the display sub-window may refer to destroying the current display window or the display sub-window, and re-establishing the display window or the display sub-window with a different layer number.
In the second example, after destroying each display sub-window, it is further necessary to release the corresponding relationship between each display sub-window and each decoding channel, and establish a corresponding relationship between the display window and one decoding channel, so that the video frame to be processed can be decoded through the decoding channel having the corresponding relationship with the display window, and the video data obtained by decoding is sent to the display window for display.
The method for establishing the corresponding relationship between the display window and one decoding channel is not limited, and can be selected according to the actual application requirements.
For example, in an alternative example, when each of the display sub-windows is destroyed, each of the decoding channels having a correspondence relationship with each of the display sub-windows may also be destroyed. Then, a decoding channel is reestablished, and the corresponding relation between the decoding channel and the display window is established.
For another example, in another alternative example, when each of the display sub-windows is destroyed, one of the decoding channels corresponding to each of the display sub-windows may be retained, and the other decoding channels may be destroyed. And then, establishing a corresponding relation between one reserved decoding channel and the display window.
Based on the method, the video frames to be processed with or without the identification information (for example, the display resolution is 8K) can be effectively decoded and displayed correspondingly.
Further, when the display is performed through the display sub-window or the display window, the corresponding display device is actually controlled through the display sub-window or the display window.
It should be noted that the display device may be one device, or may be formed by splicing a plurality of devices. For example, in connection with fig. 11, the display device may be formed by splicing 3 displays.
The video processing device 10 may include 3 output ports, and is respectively in communication connection with 3 displays through the 3 output ports, so as to send the video data sent to each display sub-window or each display window to the 3 displays for mosaic display.
In an alternative example, a display wall area formed by splicing 3 displays may be { (0, 0), (5760, 1080) }, display areas corresponding to display windows may be { (1920, 300), (2880, 780) }, and display areas corresponding to 4 display sub-windows may be { (1920, 300), (720, 780) }, { (2640, 300), (720, 780) }, { (3360, 300), (720, 780) }, { (4080, 300), (720, 780) } respectively.
The resolution of each output port is 1920 × 1080, and correspondingly, when each output port forms an image, the range of each output port can be { (0, 0), (1920, 1080) }. In this way, when video data is output in each display sub-window, conversion processing is also required, for example, to enlarge the height of the ordinate from 720 to 1920 and the width of the abscissa from 780 to 1080.
Moreover, considering that the display areas of one of the display sub-windows are respectively on two displays, that is, the video data of one display sub-window needs to be sent to two displays through two output ports, the calculation of the video data to be imaged at each output port may also need to be performed.
For example, in the example shown in fig. 11, a part of the display area corresponding to the third display sub-window from left to right is located on the second display, and another part is located on the third display.
Thus, for the third display sub-window, the corresponding display area on the second display may be { (1440, 300), (1920, 780) }, and the corresponding display area on the third display may be { (0, 300), (240, 780) }.
For the first display sub-window, the corresponding display area on the second display may be { (0, 300), (720, 780) }.
For the second display sub-window, the corresponding display area on the second display may be { (720, 300), (1440, 780) }.
For the fourth display sub-window, the corresponding display area on the third display may be { (240, 300), (960, 780) }.
With reference to fig. 12, the present embodiment also provides a video processing apparatus 100 applicable to the video processing device 10. The video processing apparatus 100 may include a video frame decomposition module 110, a decoding channel determination module 120, and a video frame decoding module 130.
The video frame decomposition module 110 is configured to decompose a video frame to be processed into a plurality of fragmented video frames. In this embodiment, the video frame decomposition module 110 may be configured to execute step S110 shown in fig. 5, and reference may be made to the foregoing description of step S110 for relevant contents of the video frame decomposition module 110.
The decoding channel determining module 120 is configured to determine, for each of the sliced video frames, one decoding channel from among multiple decoding channels according to the position information of the sliced video frame, where the decoding channels determined by different sliced video frames are different. In this embodiment, the decoding channel determining module 120 may be configured to perform step S120 shown in fig. 5, and reference may be made to the foregoing description of step S120 for relevant contents of the decoding channel determining module 120.
The video frame decoding module 130 is configured to, for each sliced video frame, perform decoding processing on the sliced video frame through a decoding channel determined by the sliced video frame, and send video data obtained by decoding to a display sub-window corresponding to the decoding channel for display, where different decoding channels correspond to different display sub-windows. In this embodiment, the video frame decoding module 130 can be configured to perform step S130 shown in fig. 5, and reference may be made to the foregoing description of step S130 for relevant contents of the video frame decoding module 130.
Further, in order to improve the capability of the video processing device 10 to process the video frames to be processed, in this embodiment, the video processing apparatus 100 may further include a determining module.
In detail, the determining module is configured to determine whether the video frame to be processed carries the identification information. If the video frame to be processed carries the identification information, the video frame to be processed is decomposed into a plurality of fragmented video frames by the video frame decomposition module 110.
Or, if the video frame to be processed does not carry the identification information, it may be further determined whether a plurality of display sub-windows having a corresponding relationship with each of the decoding channels are established.
If the plurality of display sub-windows are not established, decoding processing can be performed on the video frame to be processed through a target decoding channel. And then sending the video data obtained by decoding to a preset display window for displaying, wherein the target decoding channel is one of the decoding channels which has a corresponding relation with the display window.
If the plurality of display sub-windows are established, the corresponding relation between each display sub-window and each decoding channel can be firstly released, and the corresponding relation between the display window and one decoding channel can be established. And then, decoding the video frame to be processed through a decoding channel corresponding to the display window, and sending the video data obtained by decoding to the display window for displaying.
In the above description, "a plurality" means two or more.
To sum up, according to the video processing method, the video processing apparatus 100 and the video processing device 10 provided by the present application, a plurality of decoding channels are formed in the video processing device 10, and a video frame with a higher resolution is decomposed to obtain a plurality of sliced video frames, so that the decoding processing is respectively performed through different decoding channels, and each decoding channel only needs to perform decoding processing on one sliced video frame, so that the data amount required to be processed by each decoding channel is reduced, and further, the decoding processing can be effectively performed. In this way, it is possible to improve the problem in the prior art that it is difficult to efficiently decode a video frame having a higher resolution due to the direct decoding process of the video frame by one decoding channel in the video processing apparatus 10. That is to say, the decoding mechanism provided by the present application can improve the problem of low decoding capability of the existing video processing device 10, and has high practical value.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A video processing method applied to a video processing apparatus having a plurality of decoding channels, the video processing method comprising:
decomposing a video frame to be processed into a plurality of sliced video frames;
determining a decoding channel in a plurality of decoding channels according to the position information of each sliced video frame, wherein the decoding channels determined by different sliced video frames are different;
and for each sliced video frame, decoding the sliced video frame through a decoding channel determined by the sliced video frame, and sending video data obtained by decoding to a display sub-window corresponding to the decoding channel for displaying, wherein different decoding channels correspond to different display sub-windows.
2. The video processing method according to claim 1, wherein before the step of determining, for each of the sliced video frames, one of a plurality of decoding channels according to the position information of the sliced video frame, the video processing method further comprises:
judging whether a plurality of display sub-windows which have corresponding relations with the decoding channels are established or not;
if the plurality of display sub-windows are not established, establishing a plurality of display sub-windows, and establishing a corresponding relation between each display sub-window and each decoding channel.
3. The video processing method according to claim 2, wherein the step of establishing a plurality of display sub-windows comprises:
acquiring the position information of the plurality of sliced video frames;
and establishing a plurality of display sub-windows according to the position information and a preset display window, wherein a display area formed by the plurality of display sub-windows is the same as a display area formed by the display window.
4. The video processing method of claim 3, further comprising:
when a window change instruction is received, the size and/or position of the display area formed by the display window are changed, and the size and/or position of the display area formed by the plurality of display sub-windows are changed based on the change processing.
5. The video processing method according to any of claims 1-4, wherein prior to the step of decomposing the video frame to be processed into a plurality of sliced video frames, the video processing method further comprises:
judging whether the video frame to be processed carries identification information or not;
and if the video frame to be processed carries the identification information, executing the step of decomposing the video frame to be processed into a plurality of fragmented video frames.
6. The video processing method of claim 5, further comprising:
if the video frame to be processed does not carry the identification information, judging whether a plurality of display sub-windows corresponding to the decoding channels are established or not;
if the plurality of display sub-windows are not established, decoding the video frame to be processed through a decoding channel corresponding to a preset display window, and sending the video data obtained through decoding to the preset display window for displaying.
7. The video processing method of claim 6, further comprising:
if the plurality of display sub-windows are established, removing the corresponding relation between each display sub-window and each decoding channel, and establishing the corresponding relation between the display window and one decoding channel;
and decoding the video frame to be processed through a decoding channel corresponding to the display window, and sending the video data obtained by decoding to the display window for displaying.
8. A video processing apparatus applied to a video processing device having a plurality of decoding channels, the video processing apparatus comprising:
the video frame decomposition module is used for decomposing a video frame to be processed into a plurality of fragment video frames;
a decoding channel determining module, configured to determine, for each of the sliced video frames, a decoding channel in a plurality of decoding channels according to the position information of the sliced video frame, where the decoding channels determined for different sliced video frames are different;
and the video frame decoding module is used for decoding each sliced video frame through a decoding channel determined by the sliced video frame and sending the video data obtained by decoding to a display sub-window corresponding to the decoding channel for displaying, wherein different decoding channels correspond to different display sub-windows.
9. A video processing apparatus, comprising:
a memory storing a computer program;
at least one processor electrically connected to the memory, the at least one processor configured to execute the computer program to form a plurality of decoding channels and to implement the video processing method of any of claims 1-7.
10. The video processing device of claim 9, wherein the at least one processor comprises a master processor and at least one slave processor electrically connected to the master processor;
wherein the master processor and each of the slave processors are electrically connected to the memory respectively, for executing the computer program to form a plurality of decoding channels on the at least one slave processor and implementing the video processing method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910738053.6A CN112399228A (en) | 2019-08-12 | 2019-08-12 | Video processing method, video processing device and video processing equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910738053.6A CN112399228A (en) | 2019-08-12 | 2019-08-12 | Video processing method, video processing device and video processing equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112399228A true CN112399228A (en) | 2021-02-23 |
Family
ID=74602136
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910738053.6A Pending CN112399228A (en) | 2019-08-12 | 2019-08-12 | Video processing method, video processing device and video processing equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112399228A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114245207A (en) * | 2021-12-16 | 2022-03-25 | 海宁奕斯伟集成电路设计有限公司 | Video display method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102377972A (en) * | 2010-08-23 | 2012-03-14 | 联想(北京)有限公司 | Image processing equipment and method |
| EP2575359A1 (en) * | 2011-09-26 | 2013-04-03 | Huawei Device Co., Ltd. | Method, apparatus and system for implementing picture in picture in home network |
| CN105791769A (en) * | 2016-03-11 | 2016-07-20 | 广东威创视讯科技股份有限公司 | Ultra-high-definition video display method and system of splicing wall |
| CN109996115A (en) * | 2017-12-29 | 2019-07-09 | 深圳华侨城卡乐技术有限公司 | Video broadcasting method, storage medium and player based on multiwindow rendering |
-
2019
- 2019-08-12 CN CN201910738053.6A patent/CN112399228A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102377972A (en) * | 2010-08-23 | 2012-03-14 | 联想(北京)有限公司 | Image processing equipment and method |
| EP2575359A1 (en) * | 2011-09-26 | 2013-04-03 | Huawei Device Co., Ltd. | Method, apparatus and system for implementing picture in picture in home network |
| CN105791769A (en) * | 2016-03-11 | 2016-07-20 | 广东威创视讯科技股份有限公司 | Ultra-high-definition video display method and system of splicing wall |
| CN109996115A (en) * | 2017-12-29 | 2019-07-09 | 深圳华侨城卡乐技术有限公司 | Video broadcasting method, storage medium and player based on multiwindow rendering |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114245207A (en) * | 2021-12-16 | 2022-03-25 | 海宁奕斯伟集成电路设计有限公司 | Video display method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110381322B (en) | Video stream decoding method and device, terminal equipment and storage medium | |
| US8462218B2 (en) | Real-time image stabilization | |
| EP3340623B1 (en) | Method of encoding an image including a privacy mask | |
| CN108650542B (en) | Method for generating vertical screen video stream and processing image, electronic equipment and video system | |
| CN108605090A (en) | Method for supporting the VR contents in communication system to show | |
| CN106550240A (en) | A kind of bandwidth conservation method and system | |
| WO2019184822A1 (en) | Multi-media file processing method and device, storage medium and electronic device | |
| CN105578129A (en) | Multipath multi-image video splicing device | |
| CN112399228A (en) | Video processing method, video processing device and video processing equipment | |
| CN106331530A (en) | Synchronous rapid display switching method for television wall and decoding equipment | |
| CN107580228B (en) | Monitoring video processing method, device and equipment | |
| CN111741247B (en) | Video playback method and device and computer equipment | |
| CN112347875A (en) | Edge cooperative target detection method and device based on region division | |
| EP3618442B1 (en) | An image capturing device, a method and computer program product for forming an encoded image | |
| CN110570614B (en) | Video monitoring system and intelligent camera | |
| CN107734278B (en) | Video playback method and related device | |
| CN112004065B (en) | Video display method, display device and storage medium | |
| EP4060997A1 (en) | Pre-processing immersive video | |
| CN112788349B (en) | Data stream pushing method, system, computer equipment and readable storage medium | |
| CN111711818A (en) | Video image coding transmission method and device thereof | |
| CN113068008B (en) | Decoding method, encoding method, code stream transmission method, electronic equipment and system | |
| CN114401445B (en) | Video processing control method, device, monitoring equipment, client and storage medium | |
| CN116684682A (en) | Video processing method, device, equipment and storage medium | |
| US9860542B2 (en) | Transcoder device and client-server architecture comprising the transcoder device | |
| CN116418939A (en) | Configuration method of video output picture, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |