CN113055729A - Cloud set top box image differential processing method and device - Google Patents

Cloud set top box image differential processing method and device Download PDF

Info

Publication number
CN113055729A
CN113055729A CN201911378200.XA CN201911378200A CN113055729A CN 113055729 A CN113055729 A CN 113055729A CN 201911378200 A CN201911378200 A CN 201911378200A CN 113055729 A CN113055729 A CN 113055729A
Authority
CN
China
Prior art keywords
data
alpha
frame
top box
rgb
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911378200.XA
Other languages
Chinese (zh)
Inventor
龚素灵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201911378200.XA priority Critical patent/CN113055729A/en
Publication of CN113055729A publication Critical patent/CN113055729A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • H04N21/4823—End-user interface for program selection using a channel name
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H04N21/8153—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics comprising still images, e.g. texture, background image

Abstract

The embodiment of the invention discloses a cloud set top box image differential processing method and a device, which relate to the technical field of multimedia terminals and cloud computing, and the method comprises the following steps: acquiring a UI image of a user interface according to a key instruction from the set top box, and separating the UI image to obtain transparency ALPHA data; performing differential processing on the ALPHA data to obtain ALPHA differential data; the ALPHA differential data is sent to the set top box, so that the image ALPHA data differential processing of the cloud set top box is realized, the data transmission quantity is reduced, and a more cool and rich UI interface is rapidly and smoothly tested on the set top box with limited performance.

Description

Cloud set top box image differential processing method and device
Technical Field
The invention relates to the technical field of multimedia terminals and cloud computing, in particular to a method and a device for differentially processing images of a cloud set top box.
Background
With the development of large video services becoming mature, users have higher and higher requirements for more cool UI (interface) and richer value-added service experience. Some household set top boxes are limited by insufficient hardware performance, complex software iteration and the like, and cannot experience diversified innovative services and intelligent UI interaction functions.
In order to solve the problem that the video experience difference of users of new and old set top boxes is huge, cloud intelligent set top boxes based on cloud computing and virtualization technologies are produced.
In a cloud set-top box, since UIs, services, games and the like are deployed in the cloud, pictures are sent to the set-top box in a desktop stream manner for display, which involves processing of rgba (Red, Green, Blue and Alpha transparency color space) data. In order to ensure that the television picture is clear and smooth, has no delay and is not stuck, the rgba data, especially the Alpha data, needs to be processed in an effective way.
Disclosure of Invention
The embodiment of the invention provides a cloud set top box image differential processing method and device, which at least solve the technical problems of large Alpha data volume and low transmission speed.
The embodiment of the invention provides a cloud set top box image differential processing method, which comprises the following steps:
acquiring a UI image of a user interface according to a key instruction from the set top box, and separating the UI image to obtain transparency ALPHA data;
performing differential processing on the ALPHA data to obtain ALPHA differential data;
transmitting ALPHA difference data to the set-top box so as to reduce data transmission amount.
Preferably, the differential processing of the ALPHA data to obtain ALPHA differential data includes:
for each frame of the UI image, judging whether the frame is a first frame;
if the frame is not the first frame, comparing the ALPHA data of the frame with the ALPHA data of the first frame to obtain ALPHA difference data of the frame.
Preferably, the comparing the ALPHA data of the frame with the ALPHA data of the first frame to obtain ALPHA difference data comprises:
dividing ALPHA data into N regions;
comparing ALPHA data of a region of the frame with ALPHA data of corresponding region of the first frame, and if there is one or more pixels at specified positions with different ALPHA data, using the ALPHA data of the region as ALPHA difference data of the region;
the ALPHA differential data for all regions of the frame are combined into ALPHA differential data for the frame.
Preferably, the transmitting the ALPHA differential data to the set-top box comprises:
judging whether the ALPHA difference data of the frame exceeds the designated ratio of ALPHA data of the frame;
if the judgment result is not over, the ALPHA differential data of the frame is compressed and then sent to the set-top box.
Preferably, the method further comprises:
separating the red, green and blue RGB data from the UI image;
performing differential processing on the RGB data to obtain RGB differential data;
and sending the RGB differential data to the set top box so as to reduce the data transmission quantity.
Preferably, the performing the differential processing on the RGB data to obtain the RGB differential data includes:
for each frame of the UI image, judging whether the frame is a first frame;
if the frame is not the first frame, comparing the RGB data of the frame with the RGB data of the first frame according to a preset sequence to obtain a boundary formed by different pixel points of the RGB data;
and taking the RGB data of all pixel points in the area enclosed by the boundary as the RGB differential data of the frame.
Preferably, the sending the RGB differential data to the set-top box includes:
and splicing the RGB differential data of the frame with the ALPHA differential data of the frame and then sending the spliced RGB differential data to the set top box.
The embodiment of the invention provides a cloud set-top box image differential processing device, which comprises:
the acquisition module is used for acquiring a UI image of the user interface according to a key instruction from the set top box and separating the UI image to obtain transparency ALPHA data;
the difference module is used for carrying out difference processing on the ALPHA data to obtain ALPHA difference data;
and the sending module is used for sending the ALPHA differential data to the set top box.
Preferably, the obtaining module is further configured to separate red, green and blue RGB data from the UI image; the difference module is also used for carrying out difference processing on the RGB data to obtain RGB difference data; the sending module is further configured to send the RGB differential data to the set top box.
The embodiment of the invention provides a cloud set-top box image differential processing device which comprises a memory, a processor and a computer program, wherein the computer program is stored on the memory and can run on the processor, and when being executed by the processor, the computer program realizes the steps of the cloud set-top box image differential processing method.
The embodiment of the invention provides a computer readable medium, wherein a cloud set-top box image differential processing program is stored on the computer readable medium, and when the cloud set-top box image differential processing program is executed by a processor, the steps of the cloud set-top box image differential processing method are realized.
The embodiment of the invention provides a cloud set-top box image differential processing method, a device, equipment and a computer readable medium, wherein a User Interface (UI) image is obtained according to a key instruction from a set-top box, and transparency ALPHA data is obtained by separating the UI image; performing differential processing on the ALPHA data to obtain ALPHA differential data; the ALPHA differential data is sent to the set top box, so that the image ALPHA data differential processing of the cloud set top box is realized, the data transmission quantity is reduced, and a more cool and rich UI interface is rapidly and smoothly tested on the set top box with limited performance.
Drawings
Fig. 1 is a schematic flowchart of a cloud set-top box image differential processing method according to an embodiment of the present invention;
FIG. 2 is a diagram of a cloud set-top box system architecture;
FIG. 3 is a diagram of the overall framework of a clouded set top box;
FIG. 4 is an overlay schematic of an ALPHA channel;
FIG. 5 is a flow chart of a common scenario for displaying an EPG (electronic program guide) by a cloud set-top box;
FIG. 6 is a schematic diagram of an RGB data differencing method;
FIG. 7 is a schematic diagram of an ALPHA data differencing method;
FIG. 8 is a schematic diagram of the stitching of RGB data and ALPHA data;
fig. 9 is a schematic structural diagram of an image difference processing apparatus of a cloud set-top box according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of an image differential processing device of a cloud set-top box according to an embodiment of the present invention.
Detailed Description
The embodiments of the present invention will be described in detail below with reference to the accompanying drawings, and it should be understood that the embodiments described below are only for illustrating and explaining the present invention and are not intended to limit the present invention.
Fig. 1 is a schematic flowchart of a cloud set-top box image difference processing method provided in an embodiment of the present invention, and as shown in fig. 1, the method may include:
step S101: acquiring a UI image of a user interface according to a key instruction from the set top box, and separating the UI image to obtain transparency ALPHA data;
step S102: performing differential processing on the ALPHA data to obtain ALPHA differential data;
step S103: transmitting ALPHA difference data to the set-top box so as to reduce data transmission amount.
According to the embodiment of the invention, the ALPHA data of each frame of image is subjected to differential processing, so that the problems of large data volume and low transmission and decompression speed when the ALPHA data of each frame of image is directly compressed and transmitted are solved, and the effects of reducing the data volume and improving the transmission and decompression speed are achieved.
Further, the differential processing of the ALPHA data to obtain ALPHA differential data includes: for each frame of the UI image, judging whether the frame is a first frame; if the frame is the first frame, the ALPHA data of the first frame is directly sent to the set-top box, namely the ALPHA data of the first frame is sent in full; if the frame is not the first frame, comparing the ALPHA data of the frame with the ALPHA data of the first frame to obtain ALPHA differential data of the frame, in one embodiment, the ALPHA data is divided into N regions, comparing the ALPHA data of one region of the frame with the ALPHA data of the corresponding region of the first frame, if the ALPHA data of one or more designated position pixel points are different, using the ALPHA data of the region as the ALPHA differential data of the region, combining the ALPHA differential data of all regions of the frame into the ALPHA differential data of the frame, and sending the ALPHA differential data of the frame to the set-top box.
Further, the transmitting the ALPHA differential data to the set-top box comprises: and transmitting all the ALPHA differential data of the frame to the set-top box, or compressing the ALPHA differential data of the frame and transmitting the compressed ALPHA differential data to the set-top box when judging that the ALPHA differential data of the frame does not exceed the designated proportion of the ALPHA data of the frame. For the latter, if the ALPHA difference data of the frame is judged to exceed the designated proportion of the ALPHA data of the frame, the ALPHA data of the frame is transmitted to the set-top box, namely, the whole amount is transmitted.
On the basis of the foregoing embodiment, in order to further reduce the data amount and speed up the data transmission speed, the method may further perform differential processing on the RGB data, and may include: separating the red, green and blue RGB data from the UI image; performing differential processing on the RGB data to obtain RGB differential data; and sending the RGB differential data to the set top box so as to reduce the data transmission quantity.
Further, the performing the differential processing on the RGB data to obtain the RGB differential data includes: for each frame of the UI image, judging whether the frame is a first frame; if the frame is the first frame, directly sending the RGB data of the first frame to the set top box, namely sending the RGB data of the first frame in full; if the frame is not the first frame, comparing the RGB data of the frame with the RGB data of the first frame in a predetermined order, for example, from left to right, from top to bottom, from right to left, from bottom to top, etc., to obtain a boundary formed by different pixel points of the RGB data; and taking the RGB data of all pixel points in the area enclosed by the boundary as the RGB differential data of the frame.
Further, the sending the RGB differential data to the set-top box includes: and splicing the RGB differential data of the frame with the ALPHA differential data of the frame and then sending the spliced RGB differential data to the set top box.
The embodiment of the invention solves the problems of large data volume and low transmission and decompression speed when the RGB data of each frame of image is directly subjected to video coding transmission by carrying out differential processing on the RGB data of each frame of image, and achieves the effects of reducing the data volume and improving the transmission speed.
According to the embodiment of the invention, the cloud set-top box is used for displaying desktop streams, and firstly, the set-top box and a cloud end establish data transmission channels such as a main channel, an input channel and a display channel; then the set-top box controls the remote controller, and the keys are transmitted into the cloud end through the input channel; after RGB difference and ALPHA difference processing are carried out on the UI picture by the cloud end, the UI picture is sent to the set-top box through a data transmission channel in a mode of splicing ALPHA data packets by RGB data streaming (such as an h264 video coding mode, but not limited to the mode); after receiving the data, the set-top box separates h264 stream and ALPHA data. Decoding, rendering and displaying the h264 stream, decompressing the ALPHA data, and performing superposition display.
The present invention will be described in detail below with reference to fig. 2 to 7.
Fig. 2 is a structural diagram of a cloud set-top box system, and as shown in fig. 2, the cloud set-top box system mainly comprises a virtual machine, a cloud platform server and a physical set-top box.
1. Physical set-top box: the client runs in the physical set-top box and is mainly responsible for establishing a channel with the cloud end and transmitting remote control
And a key instruction of the device or the handle is used for processing and displaying the UI stream sent by the cloud.
2. Cloud platform server: to virtualize various virtual machines and maintain communications with clients and virtual machines.
3. Virtual machines: the virtual machine is a virtual machine virtualized from a cloud platform, can be a system of win7, and can also be linux or linux
In the android X86 system, a virtual machine agent is an extension program running in the virtual machine.
Fig. 3 is an overall framework diagram of a cloud set-top box, as shown in fig. 3, including a cloud set-top box (tstbs), a cloud platform portal, a cloud platform, a CDN (content delivery network), and an SP platform, and the interaction process may be as follows:
1) a cloud set top box (tSTB) initiates authentication to a cloud platform portal and requests to allocate virtual machine resources;
2) distributing virtual machines by the cloud platform;
3) the tSTB is connected with the virtual machine, and a channel for vSTB (cloud end) desktop connection is established;
4) inputting an operation instruction by a user key;
5) and the cloud service responds to the user key and displays the UI.
6) And the cloud end performs streaming, compression and other processing on the UI interface and sends the UI interface to the tSTB.
7) the tstbs decompresses, decodes, renders, and displays the UI streams. the tstbs may support both the playing of video streams and the display of UI streams.
Fig. 4 is a schematic diagram of the superposition of ALPHA channels, as shown in fig. 4, involving a virtual set-top box and a physical set-top box, the superposition process may be as follows:
1) the physical set top box plays a video;
2) displaying by the UI layer of the virtual machine end, carrying the ALPHA data, and sending to the physical end;
3) and the physical end adds the UI layer with the ALPHA transparency on the video layer through the cloud desktop client end for displaying.
As can be seen from the above-described cloud set-top box UI desktop stream display embodiment, receiving a response from the set-top box key to the cloud, and then displaying the UI desktop stream on the set-top box, is an end-to-end process. The process involves the flows of data compression, transmission, decompression and the like, if RGB full-scale data and ALPHA full-scale data are adopted, the time is consumed, even obvious phenomena of unsmooth and unsmooth clamping occur, and the user experience is seriously influenced. Therefore, the end-to-end delay must be strictly controlled within a range that is not obvious to the user, so as to ensure that the requirements of the user experience are met. Therefore, the invention mainly provides a method for carrying out ALPHA differential processing on the images of the cloud set-top box, and also provides a method for carrying out RGB differential processing on the images of the cloud set-top box, so as to solve the problems of unsmooth pictures, unsmooth blocking and the like caused by overlarge end-to-end time delay in a cloud set-top box system. The difference method can be various, and a more typical difference method is as follows, 1) the cloud first separates the rgba data into rgb data and alpha data, and the rgb data and the alpha data are respectively subjected to difference processing; 2) rgb data differential: and traversing the pixel points of the current frame and the first frame to obtain a minimum area containing all difference data, which is called rgb incremental data. Then video coding is carried out on the rgb incremental data, such as h 264; 3) alpha data difference: dividing the alpha data of the current frame and the first frame into N small regions for comparison. And (3) placing the whole small area to which the single small area belongs into an alpha increment queue as long as the data of one pixel point is different. Thus obtaining a group of alpha incremental data which are arranged according to a certain sequence and rule; 4) splicing the alpha incremental data behind the xh264 data, and sending the alpha incremental data and the xh264 data to a cloud desktop client of the set top box.
Fig. 5 is a flowchart of a common scenario for displaying an EPG (electronic program guide) by a cloud set-top box, as shown in fig. 5, the method may include the following steps:
1) a user opens the set-top box;
2) the tSTB (physical set top box) initiates authentication to a cloud platform management portal and requests to allocate virtual machine resources;
3) a vSTB (cloud end) management platform distributes virtual machines;
4) the tSTB is connected with the virtual machine to establish a vSTB desktop connection channel;
5) the tSTB triggers and starts the service authentication of the virtual machine end through the main channel, and the virtual agent informs the service APK in the virtual machine to start the authentication after receiving the message;
6) a user operates a set-top box key;
7) the key is transmitted to the cloud server through the input channel and then to the virtual machine;
8) after receiving the key, the business application in the virtual machine responds to the page and displays the EPG;
9) processing the image by the android system to obtain RGBA data of the image, and putting the RGBA data into a memory cache area of the display card;
10) the cloud end processes the RGBA data, separates the RGB data and the ALPHA data from the RGBA data, and respectively performs differential processing. And performing video coding (such as h264) on the RGB incremental data, compressing the ALPHA incremental data, splicing the ALPHA incremental data behind the xh264 data, and sending the ALPHA incremental data as one frame of data to a client of the physical set top box.
11) After receiving the data, the cloud desktop client decodes the h264 data to obtain YUV (color coding method) data, converts the YUV data into RGB data through a system interface, and compares, renders and displays the RGB data with the data of the first frame. Then, the ALPHA data is decompressed and displayed in a superimposed manner.
In the above workflow, the differential processing of RGB data and the differential processing of ALPHA data are involved, and the following describes specific embodiments of these two processes.
Fig. 6 is a schematic diagram of an RGB data difference method, as shown in fig. 6, the process is as follows:
1) each cell in the diagram represents a pixel point, which is represented as P1, P2, P3,........ Pn; the small dots represent pixels with different RGB data of the current frame and the first frame.
2) And when the cloud end acquires the first frame of RGB data, the difference processing is not carried out, and the full data is sent to the client end.
3) When the cloud acquires the RGB data of the non-first frame, comparing the RGB data of the current frame with the RGB data of the first frame.
4) And traversing and comparing according to a certain sequence, such as from left to right, from top to bottom and the like, and determining the upper, lower, left and right boundaries of the incremental area.
5) A minimum rectangular area containing all the incremental data, i.e., the incremental RGB data (i.e., the foregoing RGB differential data), is obtained.
6) And performing video coding on the RGB incremental data, such as h264 coding and the like.
It should be noted that, RGB data of all pixels with different RGB data of the non-first frame may be used as the incremental RGB data, but since the RGB data of each pixel needs to be compared, the comparison throughput is increased, and the data processing speed is reduced, the embodiment of the present invention adopts a mode of "traversing and comparing according to a certain sequence, such as from left to right, from top to bottom, and the like, to determine the upper, lower, left, and right boundaries of the incremental area", after the boundaries are compared, the RGB numbers of other pixel points in the rectangular area enclosed by the boundaries do not need to be compared any more, the comparison throughput is reduced, and the data processing speed is increased.
Fig. 7 is a schematic diagram of the ALPHA data differencing method, as shown in fig. 7, the process is as follows:
1) each cell in the diagram represents a pixel point, which is represented as P1, P2, P3,....... times, Pmxn; each slightly larger square represents an area (e.g., a1, As), and the small dots represent different pixels of the current frame than the first frame ALPHA data.
2) And when the cloud acquires the first frame of ALPHA data, the cloud does not perform differential processing, and sends the full data to the client.
3) When the cloud acquires the non-first frame ALPHA data, the current frame ALPHA data is compared with the first frame ALPHA data.
4) The ALPHA data is divided into N regions (e.g., 8x8 regions), and the pixels are traversed. During traversal, sampling is performed in a mode of taking one point from a plurality of pixels (for example, taking one point from four pixels), so that the traversal speed is increased. If the ALPHA data of any one sampling point in the area A2 is different, the data of the whole area A2 is put into an ALPHA increment list. By analogy, as long as the data of one sampling point in the area is different, the whole area block is put into the ALPHA increment list in sequence. As shown in FIG. 7, the ALPHA delta list is A2A3A4A 5. When the ALPHA incremental data (i.e. the ALPHA differential data) exceeds a certain ratio (such as one third of the ALPHA data), the comparison is not performed, and the full data is directly sent to the client.
Fig. 8 is a schematic diagram of the RGB data and the ALPHA data splicing, and as shown in fig. 8, the processed RGB incremental data and ALPHA incremental data are spliced and explained:
1) the first part is an identification bit, indicating whether the full data or the incremental data.
2) The second part is RGB incremental data, such as h264 code stream.
3) The third part is ALPHA delta data, a sequence consisting of region size and region data of the incremental data.
4) The cloud sends the data to the client together in a frame code stream mode.
5) And after receiving the code stream, the client separates the h264 code stream and the ALPHA incremental data.
6) The client decodes the h264 data (such as media codec hard decoding) to obtain YUV data, converts the YUV data into RGB data through a rendering interface (such as openGL) of the android system, and performs rendering and display after comparing the RGB data with the first frame of full-scale data.
7) And the client decompresses to obtain the ALPHA incremental data, compares the ALPHA incremental data with the first frame of full data, and displays in an overlapping way.
Fig. 9 is a schematic structural diagram of an image difference processing apparatus of a cloud set-top box according to an embodiment of the present invention, and as shown in fig. 9, the apparatus includes:
the acquisition module 91 is used for acquiring a UI image of the user interface according to a key instruction from the set top box and separating the UI image to obtain transparency ALPHA data;
a difference module 92 for performing difference processing on the ALPHA data to obtain ALPHA difference data;
a sending module 93, configured to send the ALPHA differential data to the set-top box.
The difference module 92 of the embodiment of the invention performs difference processing on the ALPHA data of each frame of image, thereby solving the problems of large data volume and low transmission and decompression speed when the ALPHA data of each frame of image is directly compressed and transmitted, and achieving the effects of reducing the data volume and improving the transmission and decompression speed.
Further, for each frame of the UI image, determining whether the frame is a first frame; if the frame is the first frame, the difference module 92 does not perform difference processing, and the sending module 93 directly sends the ALPHA data of the first frame to the set-top box, that is, the ALPHA data of the first frame is sent in full; if the frame is not the first frame, the difference module 92 compares the ALPHA data of the frame with the ALPHA data of the first frame to obtain ALPHA difference data of the frame, in one embodiment, the ALPHA data can be divided into N regions, the ALPHA data of one region of the frame is compared with the ALPHA data of the corresponding region of the first frame, if the ALPHA data of one or more pixels at specified positions are different, the ALPHA data of the region is used as the ALPHA difference data of the region, then the ALPHA difference data of all regions of the frame are combined into the ALPHA difference data of the frame, and the ALPHA difference data of the frame is transmitted to the set-top box by the transmission module 93.
Further, the sending module 93 may send all the ALPHA differential data of the frame to the set-top box, or only when it is determined that the ALPHA differential data of the frame does not exceed the specified proportion of the ALPHA data of the frame, compress the ALPHA differential data of the frame and send the compressed ALPHA differential data to the set-top box. For the latter, when the ALPHA differential data of the frame is judged to exceed the designated proportion of the ALPHA data of the frame, the transmitting module 93 transmits the ALPHA data of the frame to the set-top box, namely, the whole quantity transmission.
On the basis of the above embodiment, in order to further reduce the data amount and speed up the data transmission speed, the acquisition module may be further configured to separate red, green, blue, RGB data from the UI image; the difference module can also be used for carrying out difference processing on the RGB data to obtain RGB difference data; the sending module may be further configured to send the RGB differential data to the set top box.
Further, for each frame of the UI image, determining whether the frame is a first frame; if the frame is the first frame, the difference module 92 does not perform difference processing, but the sending module 93 directly sends the RGB data of the first frame to the set-top box, that is, the RGB data of the first frame is sent in full; if the frame is not the first frame, the difference module 93 compares the RGB data of the frame with the RGB data of the first frame according to a predetermined sequence, for example, from left to right, from top to bottom, from right to left, from bottom to top, etc., to obtain a boundary formed by different pixels of the RGB data; and taking the RGB data of all pixel points in the area enclosed by the boundary as the RGB differential data of the frame.
Further, the sending module 93 sends the RGB differential data of the frame and the ALPHA differential data of the frame to the set-top box after splicing together.
The difference module 92 of the embodiment of the present invention performs difference processing on the RGB data of each frame of image, thereby solving the problems of large data volume and slow transmission and decompression speed when the RGB data of each frame of image is directly subjected to video coding transmission, and achieving the effects of reducing the data volume and increasing the transmission speed.
Fig. 10 is a schematic structural diagram of a cloud set-top box image difference processing apparatus according to an embodiment of the present invention, and as shown in fig. 10, the apparatus may include a memory 20, a processor 10, and a computer program stored on the memory 20 and operable on the processor 10, where the computer program, when executed by the processor 10, implements the steps of the cloud set-top box image difference processing method. The memory 20 may be RAM, ROM, EEPROM, flash memory or any other medium which can be used to store the desired information and which can be accessed by the computer. The processor 10 may be a central processing unit, a digital signal processor or a microprocessor, etc.
The invention further provides a computer readable medium, on which a program for cloud set-top box image differential processing is stored, and when the program for cloud set-top box image differential processing is executed by a processor, the steps of the method for cloud set-top box image differential processing are realized. It will be understood by those of ordinary skill in the art that all or some of the steps of the methods, systems, functional modules/units in the devices disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
In summary, after rgb difference and alpha difference processing, the embodiments of the present invention can achieve the following effects: 1) the occupancy rate of the CPU is reduced; 2) the efficiency of data transmission is improved; 3) the speed of data compression and decompression is improved; 4) and the fluency of picture display is improved.
Although the present invention has been described in detail hereinabove, the present invention is not limited thereto, and various modifications can be made by those skilled in the art in light of the principle of the present invention. Thus, modifications made in accordance with the principles of the present invention should be understood to fall within the scope of the present invention.

Claims (11)

1. A cloud set top box image differential processing method is characterized by comprising the following steps:
acquiring a UI image of a user interface according to a key instruction from the set top box, and separating the UI image to obtain transparency ALPHA data;
performing differential processing on the ALPHA data to obtain ALPHA differential data;
transmitting ALPHA difference data to the set-top box so as to reduce data transmission amount.
2. The method of claim 1, wherein the differentiating the ALPHA data to obtain ALPHA differential data comprises:
for each frame of the UI image, judging whether the frame is a first frame;
if the frame is not the first frame, comparing the ALPHA data of the frame with the ALPHA data of the first frame to obtain ALPHA difference data of the frame.
3. The method of claim 2, wherein comparing the ALPHA data of the frame with the ALPHA data of the first frame to obtain ALPHA difference data comprises:
dividing ALPHA data into N regions;
comparing ALPHA data of a region of the frame with ALPHA data of corresponding region of the first frame, and if there is one or more pixels at specified positions with different ALPHA data, using the ALPHA data of the region as ALPHA difference data of the region;
the ALPHA differential data for all regions of the frame are combined into ALPHA differential data for the frame.
4. The method of claim 3, wherein sending ALPHA difference data to the set top box comprises:
judging whether the ALPHA difference data of the frame exceeds the designated ratio of ALPHA data of the frame;
if the judgment result is not over, the ALPHA differential data of the frame is compressed and then sent to the set-top box.
5. The method according to any one of claims 1-4, further comprising:
separating the red, green and blue RGB data from the UI image;
performing differential processing on the RGB data to obtain RGB differential data;
and sending the RGB differential data to the set top box so as to reduce the data transmission quantity.
6. The method as claimed in claim 5, wherein the differentiating the RGB data to obtain RGB differential data comprises:
for each frame of the UI image, judging whether the frame is a first frame;
if the frame is not the first frame, comparing the RGB data of the frame with the RGB data of the first frame according to a preset sequence to obtain a boundary formed by different pixel points of the RGB data;
and taking the RGB data of all pixel points in the area enclosed by the boundary as the RGB differential data of the frame.
7. The method of claim 6, wherein sending the RGB differential data to the set top box comprises:
and splicing the RGB differential data of the frame with the ALPHA differential data of the frame and then sending the spliced RGB differential data to the set top box.
8. A cloud set-top box image differential processing device is characterized in that the device comprises:
the acquisition module is used for acquiring a UI image of the user interface according to a key instruction from the set top box and separating the UI image to obtain transparency ALPHA data;
the difference module is used for carrying out difference processing on the ALPHA data to obtain ALPHA difference data;
and the sending module is used for sending the ALPHA differential data to the set top box.
9. The apparatus of claim 8,
the acquisition module is also used for separating red, green and blue RGB data from the UI image;
the difference module is also used for carrying out difference processing on the RGB data to obtain RGB difference data;
the sending module is further configured to send the RGB differential data to the set top box.
10. A clouded set-top box image differential processing apparatus comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the clouded set-top box image differential processing method according to any one of claims 1 to 8.
11. A computer-readable medium, on which a program for cloud set-top box image differential processing is stored, which when executed by a processor, implements the steps of the cloud set-top box image differential processing method according to any one of claims 1 to 8.
CN201911378200.XA 2019-12-27 2019-12-27 Cloud set top box image differential processing method and device Pending CN113055729A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911378200.XA CN113055729A (en) 2019-12-27 2019-12-27 Cloud set top box image differential processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911378200.XA CN113055729A (en) 2019-12-27 2019-12-27 Cloud set top box image differential processing method and device

Publications (1)

Publication Number Publication Date
CN113055729A true CN113055729A (en) 2021-06-29

Family

ID=76506770

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911378200.XA Pending CN113055729A (en) 2019-12-27 2019-12-27 Cloud set top box image differential processing method and device

Country Status (1)

Country Link
CN (1) CN113055729A (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110179106A1 (en) * 2010-01-15 2011-07-21 Ibahn General Holdings Corporation Virtual user interface
CN102231834A (en) * 2011-06-27 2011-11-02 深圳市茁壮网络股份有限公司 Animated portable network graphics (APNG) file processing method and device for digital television system
CN102520898A (en) * 2011-11-18 2012-06-27 惠州华阳通用电子有限公司 Processing method for embedded operating system sequence diagrams
US20150186731A1 (en) * 2013-12-31 2015-07-02 Montage Technology (Shanghai) Co., Ltd. Full-automatic detection method and system for static characteristic information in dynamic image
CN104966309A (en) * 2015-06-25 2015-10-07 桂林力港网络科技有限公司 Automatic compression system and processing method for image with transparency
CN105760238A (en) * 2016-01-29 2016-07-13 腾讯科技（深圳）有限公司 Graphic instruction data processing method, device and system
CN106998479A (en) * 2016-01-22 2017-08-01 中兴通讯股份有限公司 A kind of methods, devices and systems for realizing set top box cloud
CN107241563A (en) * 2017-06-16 2017-10-10 深圳天珑无线科技有限公司 Method, intelligent mobile terminal and the device with store function of transmission of video
CN109510990A (en) * 2018-10-25 2019-03-22 深圳市腾讯信息技术有限公司 Image processing method and device, computer readable storage medium, electronic equipment
CN110113617A (en) * 2019-06-13 2019-08-09 腾讯科技（深圳）有限公司 A kind of method and device of compression of images and decompression

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110179106A1 (en) * 2010-01-15 2011-07-21 Ibahn General Holdings Corporation Virtual user interface
CN102231834A (en) * 2011-06-27 2011-11-02 深圳市茁壮网络股份有限公司 Animated portable network graphics (APNG) file processing method and device for digital television system
CN102520898A (en) * 2011-11-18 2012-06-27 惠州华阳通用电子有限公司 Processing method for embedded operating system sequence diagrams
US20150186731A1 (en) * 2013-12-31 2015-07-02 Montage Technology (Shanghai) Co., Ltd. Full-automatic detection method and system for static characteristic information in dynamic image
CN104966309A (en) * 2015-06-25 2015-10-07 桂林力港网络科技有限公司 Automatic compression system and processing method for image with transparency
CN106998479A (en) * 2016-01-22 2017-08-01 中兴通讯股份有限公司 A kind of methods, devices and systems for realizing set top box cloud
CN105760238A (en) * 2016-01-29 2016-07-13 腾讯科技（深圳）有限公司 Graphic instruction data processing method, device and system
CN107241563A (en) * 2017-06-16 2017-10-10 深圳天珑无线科技有限公司 Method, intelligent mobile terminal and the device with store function of transmission of video
CN109510990A (en) * 2018-10-25 2019-03-22 深圳市腾讯信息技术有限公司 Image processing method and device, computer readable storage medium, electronic equipment
CN110113617A (en) * 2019-06-13 2019-08-09 腾讯科技（深圳）有限公司 A kind of method and device of compression of images and decompression

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
冯海亮;王丰;王玮宏;施玉海;: "面向云计算的机顶盒终端设计和实现方法研究", 广播电视信息, no. 12, 15 December 2012 (2012-12-15) *

Similar Documents

Publication Publication Date Title
CN109040792B (en) Processing method for video redirection, cloud terminal and cloud desktop server
US9426476B2 (en) Video stream
KR101962990B1 (en) Low-complexity remote presentation session encoder
EP3177024B1 (en) Apparatus for cloud streaming service
CN110582012B (en) Video switching method, video processing device and storage medium
CN105262825A (en) SPICE cloud desktop transporting and displaying method and system on the basis of H.265 algorithm
CN111263243B (en) Video coding method and device, computer readable medium and electronic equipment
CN111031376B (en) Bullet screen processing method and system based on WeChat applet
US8731060B2 (en) Video encoding system and method
KR20120058227A (en) Image data encoding method for presentation virtualization and server therefor
CN113038220A (en) Program directing method, program directing system, program directing apparatus, and computer-readable storage medium
US10462200B2 (en) System for cloud streaming service, method for still image-based cloud streaming service and apparatus therefor
CN104067627A (en) Video redirecting method, device, system and computer readable medium
CN111031032A (en) Cloud video transcoding method and device, decoding method and device, and electronic device
CN113055729A (en) Cloud set top box image differential processing method and device
CN106575423B (en) Broadcast link service based on cloud streaming media, broadcast link service client device, and trigger content providing server
CN115174917A (en) H264-based video display method and device
KR101405865B1 (en) Method of presentation virtualization of set-top-box, and its system
CN114827620A (en) Image processing method, apparatus, device and medium
CN112788349B (en) Data stream pushing method, system, computer equipment and readable storage medium
CN111343475B (en) Data processing method and device, live broadcast server and storage medium
WO2016107174A1 (en) Method and system for processing multimedia file data, player and client
CN110007977A (en) One kind improving SPICE video broadcasting method based on feedback frame losing algorithm
CN113038277B (en) Video processing method and device
KR102273145B1 (en) System for cloud streaming service, method of image cloud streaming service using additional encoding and apparatus for the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination