CN114979666A - Intelligent window code stream ascending and descending method based on large-screen decoding capability - Google Patents
Intelligent window code stream ascending and descending method based on large-screen decoding capability Download PDFInfo
- Publication number
- CN114979666A CN114979666A CN202210528440.9A CN202210528440A CN114979666A CN 114979666 A CN114979666 A CN 114979666A CN 202210528440 A CN202210528440 A CN 202210528440A CN 114979666 A CN114979666 A CN 114979666A
- Authority
- CN
- China
- Prior art keywords
- code stream
- window
- screen
- upgrading
- fragments
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 18
- 230000001174 ascending effect Effects 0.000 title claims abstract description 14
- 239000012634 fragment Substances 0.000 claims abstract description 20
- 238000004364 calculation method Methods 0.000 claims abstract description 6
- 230000003247 decreasing effect Effects 0.000 claims description 2
- 230000008901 benefit Effects 0.000 abstract description 3
- 230000007547 defect Effects 0.000 abstract 1
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003908 quality control method Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/633—Control signals issued by server directed to the network components or client
- H04N21/6332—Control signals issued by server directed to the network components or client directed to client
- H04N21/6336—Control signals issued by server directed to the network components or client directed to client directed to decoder
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses an intelligent window code stream ascending and descending method based on large-screen decoding capability, which relates to the technical field of image processing, and aims at the defect that hardware stream selection can only stipulate one code stream for use and can not dynamically distribute code stream information according to global information, the method for intelligently ascending and descending the window code stream comprises the following steps: s1, selecting a code stream for calculation; s2, recording the current snapshot; s3, cutting the window fragments into a plurality of window fragments, and calculating the window display area on each display screen; s4, window fragments on each display screen preferentially occupy the layers in sequence; s5, initializing a window, and using a lowest-level code stream; s6, upgrading the code stream step by step, then judging whether to continue upgrading the code stream, if not, finishing upgrading the code stream, and if so, continuing upgrading the code stream; and S7, comparing the ascending or descending code stream with the snapshot, and finally ending. The method has the advantages that the code stream information can be dynamically distributed according to the global information, and the hardware capability can be reasonably exerted. Under the condition of limited hardware capability, the hardware capability is exerted to the maximum extent and the picture quality is ensured.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to an intelligent window code stream ascending and descending method based on large-screen decoding capacity.
Background
The code stream refers to the data flow rate of a video image in unit time after being coded and compressed, and is the most important part in picture quality control in video coding. For a static image, a higher image quality can be obtained by using a lower code stream; for moving images, a higher code stream needs to be configured. The code stream types generally comprise a main type, a middle type and a sub type, and the code stream resolution of each type is different. For the required decoding capability, the major type is larger than the minor type, and the minor type is larger than the minor type. In practical application, the code-changing rate needs to be configured to better adapt to scene changes. For example, the decoding method is used for a large screen, wherein the large screen is composed of a plurality of display screens, and each display screen corresponds to one decoding node. The coding node can code one video signal source into a plurality of video signal sources of code stream types. In the prior art, all code stream types are transmitted to a decoding node by windowing, and the decoding node can only stipulate one code stream type for use when selecting streams, cannot dynamically distribute code stream type information according to global information, and cannot reasonably exert hardware capability. Windowing is to select a signal source to draw an area on the virtual large screen to synchronize to the physical large screen. The decoding node can decode video signal sources of various code stream types.
Disclosure of Invention
The invention aims to provide an intelligent window code stream ascending and descending method based on large-screen decoding capability, so as to solve the problems in the prior art.
The invention relates to an intelligent window code stream ascending and descending method based on large-screen decoding capability, which comprises the following steps of: s1, selecting a code stream for calculation; s2, recording the current snapshot; s3, cutting the window fragments into a plurality of window fragments, and calculating the window display area on each display screen; s4, the window fragments on each display screen preferentially occupy the layer according to the Z sequence; s5, initializing a window, and using the lowest code stream; s6, upgrading the code stream step by step, then judging whether to continue upgrading the code stream, if not, finishing upgrading the code stream, and if so, continuing upgrading the code stream; and S7, comparing the ascending or descending code stream with the snapshot, and finally ending.
Preferably, in the step S3, the window is cut into a plurality of window fragments according to a window cross-screen situation.
Preferably, in the step S3, a scan line algorithm is used to calculate the window display area on each display screen.
Preferably, in the step S4, if the window does not occupy the layer, the display area is set to 0.
Preferably, in step S6, the code stream is sequentially updated step by step according to the area size.
Preferably, in step S6, any one of the following is satisfied, i.e. the code stream cannot be upgraded continuously: the code stream is upgraded to the highest code stream; exceeds large screen decoding capability; and finishing the window fragment corresponding to the window after the code stream is upgraded.
The intelligent window code stream ascending and descending method based on the large-screen decoding capability has the advantages that code stream information can be dynamically distributed according to global information, and the hardware capability can be reasonably exerted. Under the condition of limited hardware capability, the hardware capability is exerted to the maximum extent and the picture quality is ensured. Other chips are replaced under the condition of being influenced by the chips, the user experience is guaranteed not to be discounted under the condition that the hardware performance is influenced, meanwhile, the cost is reduced, and the benefit is improved. The configuration of the transcoding stream better meets the requirements of practical application.
Drawings
FIG. 1 is a schematic flow chart of an intelligent window code stream ascending and descending method based on large-screen decoding capability according to the present invention;
FIG. 2 is a schematic view of embodiment 1 of a large screen;
FIG. 3 is a schematic view of embodiment 2 of a large screen;
FIG. 4 is a schematic view of embodiment 3 of a large screen;
fig. 5 is a schematic view of embodiment 4 of a large screen.
Detailed Description
Example 1
As shown in fig. 1, the method for intelligently increasing and decreasing window code stream based on large screen decoding capability of the present invention includes the following steps: s1, selecting a code stream for calculation; s2, recording the current snapshot; s3, cutting the window into a plurality of window fragments according to the cross-screen condition of the window, and calculating the window display area on each display screen by using a scanning line algorithm; s4, window fragments on each display screen preferentially occupy the layer in sequence, and if the window does not occupy the layer, the display area is set to be 0; s5, initializing a window, and using the lowest code stream; s6, sequentially upgrading the code stream step by step according to the size of the display area, then judging whether to continue upgrading the code stream, if not, finishing upgrading the code stream, and if so, continuing upgrading the code stream; and S7, comparing the ascending or descending code stream with the snapshot, and finally ending. The number of layers determines how many real windows can be opened by one physical screen, each real window can occupy one or more layers, each layer on each physical screen can be used by only one window, and whether the window can be displayed on the physical screen is influenced. When a window spans multiple screens, the window is cut into multiple fragments to be distributed on each screen. The Z sequence is increased from 1, the layer with the large Z sequence is preferentially displayed on the upper layer and preferentially used on the physical screen, and whether the displayed window is displayed on the upper layer or the lower layer is influenced.
The snapshot in step S2 is in a window state. At this time, the window state is recorded so as to compare with the window state after calculation to determine whether the code stream is ascending or descending.
When the window fragment in step S3 is a window spanning multiple screens, the window may be cut into multiple fragments distributed on each screen.
In step S4, if the layer is used in the same window, the original layer is preferably reused, so that the stability of the large screen image can be ensured.
In step S6, the window with large display area is guaranteed to preferentially use the high-level code stream. Judging whether the code stream is continuously upgraded or not to meet any one of the following conditions, namely, the code stream cannot be continuously upgraded: the code stream is upgraded to the code stream of the highest level; exceeds large screen decoding capability; and finishing the window fragment corresponding to the window after the code stream is upgraded.
In practical application, the scene is dynamically changed, so that the transcoding stream, i.e. the up-streaming or down-streaming, needs to be configured. The code stream level is simply divided into a main code stream, a middle code stream and a low code stream, wherein the levels of the main code stream, the middle code stream and the low code stream are gradually reduced.
As shown in fig. 2, the large screen decoding capability is 4K, and normally, four windows, each of which is a 2K main code stream, may be opened on the large screen.
Example 2
As shown in fig. 3, the large screen decoding capability is 4K, 2K main code streams are respectively transmitted from the window 1 to the window 4, and the window 2 is completely blocked by the window 1, so that the layer is not occupied. The window 5 of the 2K main code stream can be normally displayed on a large screen.
Example 3
As shown in fig. 4, the large screen decoding capability is 4K, and the code streams in windows 1 to 3 are 2K. Wherein, the display area of the window 1 is the smallest, and the level of the used upgrade code stream is the lowest. The window 4 is a 4K intermediate code stream, and the intermediate code stream is attempted to be upgraded into a main code stream, but the requirement that the decoding capacity of the large screen in the code stream cannot be upgraded continuously is met. Then, windows 1 through 3 may be upgraded normally to the main stream.
Example 4
As shown in fig. 5, the large-screen decoding capability is 4K, and the windows 1 to 5 are all 2K main code streams. Suppose the large screen is divided equally into four small screens with window 5 spanning the four small screens, cut into four window fragments. The display area of the window 5 is the largest, so that on four small screens, calculation is performed according to the display area from large to small, and the window 5 can be preferentially calculated to update the code stream.
It will be apparent to those skilled in the art that various other changes and modifications may be made in the above-described embodiments and concepts and all such changes and modifications are intended to be within the scope of the appended claims.
Claims (6)
1. An intelligent window code stream ascending and descending method based on large-screen decoding capability is characterized by comprising the following steps: s1, selecting a code stream for calculation; s2, recording the current snapshot; s3, cutting the window fragments into a plurality of window fragments, and calculating the window display area on each display screen; s4, the window fragments on each display screen preferentially occupy the layer according to the Z sequence; s5, initializing a window, and using a code stream of the lowest level; s6, upgrading the code stream step by step, then judging whether to continue upgrading the code stream, if not, finishing upgrading the code stream, and if so, continuing upgrading the code stream; and S7, comparing the upgraded code stream with the snapshot or the downgraded code stream, and ending.
2. The method of claim 1, wherein in the step S3, the window is cut into a plurality of window fragments according to a window cross-screen condition.
3. The method of claim 1, wherein in step S3, a scan line algorithm is used to calculate the window display area on each display screen.
4. The method according to claim 1, wherein in step S4, if the window does not occupy the layer, the display area is set to 0.
5. The method of claim 1, wherein in step S6, the code stream is sequentially updated step by step according to the size of the display area.
6. The method for intelligently increasing and decreasing window code streams based on large-screen decoding capability according to claim 1, wherein the code streams cannot be continuously updated when any one of the following conditions is satisfied in step S6: the code stream is upgraded to the code stream of the highest level; exceeds large screen decoding capability; and finishing the window fragment corresponding to the window after the code stream is upgraded.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210528440.9A CN114979666A (en) | 2022-05-16 | 2022-05-16 | Intelligent window code stream ascending and descending method based on large-screen decoding capability |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210528440.9A CN114979666A (en) | 2022-05-16 | 2022-05-16 | Intelligent window code stream ascending and descending method based on large-screen decoding capability |
Publications (1)
Publication Number | Publication Date |
---|---|
CN114979666A true CN114979666A (en) | 2022-08-30 |
Family
ID=82983545
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210528440.9A Pending CN114979666A (en) | 2022-05-16 | 2022-05-16 | Intelligent window code stream ascending and descending method based on large-screen decoding capability |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114979666A (en) |
-
2022
- 2022-05-16 CN CN202210528440.9A patent/CN114979666A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7224731B2 (en) | Motion estimation/compensation for screen capture video | |
TWI391895B (en) | Display driving apparatus and method thereof | |
US7218790B2 (en) | Adaptive entropy encoding/decoding for screen capture content | |
US7200276B2 (en) | Rate allocation for mixed content video | |
CN105959700A (en) | Video image coding method and device | |
US8713472B2 (en) | Display apparatus, a method for a display control, and program | |
CN101883140B (en) | Coding system and method based on remote display as well as server | |
US20050213833A1 (en) | Image processing device and method for displaying images on multiple display devices | |
JPH08214316A (en) | Method and apparatus for predicting moving picture face | |
GB2489798A (en) | Reducing Write Transactions in a Windows Compositing System | |
KR20070037248A (en) | Image encoding apparatus and method, image decoding apparatus and method, and display driving circuit and method employing the same | |
US8749566B2 (en) | System and method for an optimized on-the-fly table creation algorithm | |
KR20080012908A (en) | Dpcm coding method of video signals | |
US8760366B2 (en) | Method and system for remote computing | |
CN101516007A (en) | Compression system for a bit-plane | |
CN115883899A (en) | Image on-screen playing method and system, electronic equipment and readable storage medium | |
US20100039517A1 (en) | Film cadence detection | |
US20190297333A1 (en) | Method and apparatus for image compression that employs multiple indexed color history buffers | |
US20050129323A1 (en) | System and method for processing image data | |
CN114979666A (en) | Intelligent window code stream ascending and descending method based on large-screen decoding capability | |
US7630577B2 (en) | Image processing apparatus using alpha plane and method thereof | |
US20080101463A1 (en) | Method and apparatus for decoding subscreen in portable terminal | |
CN111010606B (en) | Video processing method and device | |
US20110002538A1 (en) | Method and apparatus for graphical data compression | |
TWI410136B (en) | Data compression method and video processing system and display using thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |