CN115913939B - Real-time image data modification method and device in cloud desktop image transmission process - Google Patents
Real-time image data modification method and device in cloud desktop image transmission process Download PDFInfo
- Publication number
- CN115913939B CN115913939B CN202211367381.8A CN202211367381A CN115913939B CN 115913939 B CN115913939 B CN 115913939B CN 202211367381 A CN202211367381 A CN 202211367381A CN 115913939 B CN115913939 B CN 115913939B
- Authority
- CN
- China
- Prior art keywords
- image data
- data
- target area
- cloud desktop
- modifying
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 37
- 238000002715 modification method Methods 0.000 title claims description 7
- 230000004048 modification Effects 0.000 claims abstract description 33
- 238000012986 modification Methods 0.000 claims abstract description 33
- 238000000034 method Methods 0.000 claims abstract description 15
- 239000000872 buffer Substances 0.000 claims abstract description 14
- 230000006837 decompression Effects 0.000 claims abstract description 7
- 230000000694 effects Effects 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a method and a device for modifying image data in real time in a cloud desktop image transmission process, which relate to the technical field of image processing and comprise the following steps: acquiring screen image data to be transmitted at a server side and storing the screen image data in a memory buffer area; determining the position and the size of a target area to be modified in screen image data through a target area searching algorithm; carrying out real-time data modification on the target area with the determined position and size; compressing and transmitting the modified screen image to a client for decompression display; according to the method, the image data in the cloud desktop data transmission process are modified in real time, after the screen original data are obtained at the service end of the cloud desktop, the position of the image data is calculated in real time through a specific algorithm before the data are transmitted in an uncompressed mode, the data at the position are modified according to the parameters set in the earlier stage, and then the data are compressed and transmitted, so that the effect of dynamically modifying the screen data is finally achieved.
Description
Technical Field
The invention belongs to the technical field of image processing, and particularly relates to a method and a device for modifying image data in real time in a cloud desktop image transmission process.
Background
The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art.
In general, the image data of the cloud desktop does not need to be modified, and only the original data needs to be accurately displayed, but in some special cases, some parts of the original data need to be changed, so that the purpose may be for clearer display and also for protecting the data privacy.
The existing image data modification technology only modifies a fixed area of screen data, such as adding LOGO or copyright watermark, and cannot dynamically calculate the position of the data to be modified according to real-time data to carry out real-time modification, namely cannot dynamically modify the original data of the screen, so that the application effect of the image data is affected.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention provides a real-time image data modification method and device in the cloud desktop image transmission process, which are used for modifying image data in the cloud desktop image transmission process in real time, calculating the position of the image data in real time through a specific algorithm before uncompressed transmission of the data after acquiring the screen original data at the service end of the cloud desktop, correspondingly modifying the data at the position according to the modification parameters set in the prior art, and then compressing and transmitting the data, thereby finally achieving the effect of dynamically modifying the screen data.
To achieve the above object, one or more embodiments of the present invention provide the following technical solutions:
The first aspect of the invention provides a real-time image data modification method in a cloud desktop image transmission process;
a real-time image data modification method in a cloud desktop image transmission process comprises the following steps:
acquiring screen image data to be transmitted at a server side and storing the screen image data in a memory buffer area;
determining the position and the size of a target area to be modified in screen image data through a target area searching algorithm;
Carrying out real-time data modification on the target area with the determined position and size;
and compressing and transmitting the modified screen image to a client for decompression display.
Further, the screen image is acquired in a manner DXGI in Win10 and above, and the Win7 system is acquired in a manner MirrorDrive.
Further, the target area searching algorithm is dynamically generated through a modification strategy configured in an external configuration file.
Further, the position of the target area in the screen image data is calculated according to the offset of the position of the target area relative to the position of the screen image data.
Further, the size is the length and width of the target area.
Further, according to the modification strategy configured in the external configuration file, corresponding data modification is performed on the target area.
Further, the real-time data modification is that the delay of each frame of original data is less than 1ms when being modified, so that the data processing capacity of at least 30 frames per second is ensured.
The second aspect of the invention provides a device for modifying image data in real time in a cloud desktop image transmission process.
The real-time image data modifying device in the cloud desktop image transmission process comprises an image acquisition module, an area positioning module, an area modifying module and an image transmission module;
an image acquisition module configured to: acquiring screen image data to be transmitted at a server side and storing the screen image data in a memory buffer area;
A region location module configured to: determining the position and the size of a target area to be modified in screen image data through a target area searching algorithm;
A region modification module configured to: carrying out real-time data modification on the target area with the determined position and size;
an image transmission module configured to: and compressing and transmitting the modified screen image to a client for decompression display.
A third aspect of the present invention provides a computer readable storage medium having stored thereon a program which when executed by a processor performs steps in a method for modifying image data in real time during transmission of a cloud desktop image according to the first aspect of the present invention.
A fourth aspect of the present invention provides an electronic device, including a memory, a processor, and a program stored in the memory and executable on the processor, where the processor implements steps in a method for modifying image data in real time during transmission of a cloud desktop image according to the first aspect of the present invention when the program is executed by the processor.
The one or more of the above technical solutions have the following beneficial effects:
According to the method, the image data in the cloud desktop data transmission process are modified in real time, after the screen original data are obtained at the service end of the cloud desktop, the position of the image data is calculated in real time through a specific algorithm before the data are transmitted in an uncompressed mode, the data in the position are modified correspondingly according to the modification parameters set in the earlier stage, and then the data are compressed and transmitted, so that the effect of dynamically modifying the screen data is achieved finally.
The specific position and the specific modification mode of the modified data are defined in the modification strategy of the external configuration file, the time for modifying the data is a server before uncompressed data is acquired after original data are acquired, wherein the specific position of the modified data can be dynamically defined by the characteristic value of the modified area, so that the flexible and configurable real-time modification of the image data in the cloud desktop image transmission process is realized, and the high efficiency and convenience of configuration are improved.
Additional aspects of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention.
Fig. 1 is a schematic diagram of conventional screen image transmission in the first embodiment.
Fig. 2 is a flow chart of a method of the first embodiment.
Fig. 3 is a frame diagram of the application program implementing the capture function in the first embodiment.
Fig. 4 is a system configuration diagram of the second embodiment.
Detailed Description
The invention will be further described with reference to the drawings and examples.
It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the invention. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the present invention. As used herein, the singular is also intended to include the plural unless the context clearly indicates otherwise, and furthermore, it is to be understood that the terms "comprises" and/or "comprising" when used in this specification are taken to specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof.
Example 1
The embodiment discloses a real-time image data modification method in a cloud desktop image transmission process, which improves the conventional screen image transmission process shown in fig. 1, namely, modifies data in real time after a server acquires original data and before compression; the specific flow is shown in fig. 2, and includes:
step S1: acquiring screen image data to be transmitted at a server side and storing the screen image data in a memory buffer area;
And capturing images in a DXGI mode in a Win10 and above system, capturing images in a MirrorDrive mode in a Win7 system, and obtaining the captured images which are screen images.
The application program is adopted to realize the capture function, and the architecture is shown in fig. 3:
The application works to render frames and requires DXGI to render the frames to the output, in order to make the rendering faster, multiple buffers are set to temporarily store the screen image to be rendered, if the application has two buffers available, then the image of one buffer can be rendered while the image of the other buffer is rendered; the application may set more than two buffers depending on the time required to render the frame or the frame rate required for the presentation.
Step S2: determining the position and the size of a target area to be modified in screen image data through a target area searching algorithm;
Dynamically generating a target area searching algorithm through a modification strategy configured in an external configuration file, executing the algorithm to acquire the offset of a target area in a buffer area, and determining the position of the target area in the buffer area; the size of the region, i.e. the length and width of the target region, is then calculated.
The external configuration file is configured with a plurality of modification strategies, and the expression of the modification strategies is as follows: 0xffaabb =0 xccee00, i.e. the pixel color with value 0xffaabb is modified to 0xccee00, that is, the specific location of the modified data is dynamically defined with the feature value of the modified region.
The dynamic generation target area searching algorithm is to call different functions according to the modification strategy in the external configuration file.
Step S3: carrying out real-time data modification on the target area with the determined position and size;
According to the modification strategy configured in the external configuration file, corresponding data modification is performed on the target area, the delay of each frame of original data when modified is less than 1ms, and the data processing capability of at least 30 frames per second can be ensured, so that a better real-time effect is achieved.
Step S4: and compressing and transmitting the modified screen image to a client for decompression display.
And the screen image transmitted to the client is decompressed into the original RGB data, and the RGB data is bound into an image control for display.
Example two
The embodiment discloses a real-time image data modifying device in a cloud desktop image transmission process;
as shown in fig. 4, the device for modifying image data in real time in the cloud desktop image transmission process comprises an image acquisition module, a region positioning module, a region modifying module and an image transmission module;
an image acquisition module configured to: acquiring screen image data to be transmitted at a server side and storing the screen image data in a memory buffer area;
A region location module configured to: determining the position and the size of a target area to be modified in screen image data through a target area searching algorithm;
A region modification module configured to: carrying out real-time data modification on the target area with the determined position and size;
an image transmission module configured to: and compressing and transmitting the modified screen image to a client for decompression display.
Example III
An object of the present embodiment is to provide a computer-readable storage medium.
A computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements steps in a method for modifying image data in real time during cloud desktop image transmission as described in embodiment 1 of the present disclosure.
Example IV
An object of the present embodiment is to provide an electronic apparatus.
The electronic device includes a memory, a processor, and a program stored in the memory and executable on the processor, where the processor implements the steps in a method for modifying image data in real time during a cloud desktop image transmission process according to embodiment 1of the present disclosure when executing the program.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. The real-time image data modification method in the cloud desktop image transmission process is characterized by comprising the following steps of:
acquiring screen image data to be transmitted at a server side and storing the screen image data in a memory buffer area;
determining the position and the size of a target area to be modified in screen image data through a target area searching algorithm;
Carrying out real-time data modification on the target area with the determined position and size;
compressing and transmitting the modified screen image to a client for decompression display;
the screen image is acquired in a DXGI mode in Win10 and above systems, and the Win7 system is acquired in a MirrorDrive mode;
the target area searching algorithm is dynamically generated through a modification strategy configured in an external configuration file.
2. The method for modifying image data in real time during cloud desktop image transmission according to claim 1, wherein the position of the target area in the screen image data is calculated according to the offset of the position of the target area relative to the position of the screen image data.
3. The method for modifying image data in real time during transmission of cloud desktop images according to claim 1, wherein the size is a length and a width of the target area.
4. The method for modifying image data in real time in a cloud desktop image transmission process according to claim 1, wherein the target area is modified according to a modification policy configured in an external configuration file.
5. The method for modifying image data in real time in a cloud desktop image transmission process according to claim 1, wherein the real-time data modification is that a delay of modifying original data of each frame is less than 1ms, so as to ensure a data processing capability of at least 30 frames per second.
6. The real-time image data modifying device in the cloud desktop image transmission process is characterized by comprising an image acquisition module, an area positioning module, an area modifying module and an image transmission module;
an image acquisition module configured to: acquiring screen image data to be transmitted at a server side and storing the screen image data in a memory buffer area;
A region location module configured to: determining the position and the size of a target area to be modified in screen image data through a target area searching algorithm;
A region modification module configured to: carrying out real-time data modification on the target area with the determined position and size;
An image transmission module configured to: compressing and transmitting the modified screen image to a client for decompression display;
the screen image is acquired in a DXGI mode in Win10 and above systems, and the Win7 system is acquired in a MirrorDrive mode;
the target area searching algorithm is dynamically generated through a modification strategy configured in an external configuration file.
7. A computer readable storage medium having a program stored thereon, which when executed by a processor, implements the steps of a method for modifying image data in real time during transmission of a cloud desktop image according to any one of claims 1 to 5.
8. An electronic device comprising a memory, a processor and a program stored on the memory and executable on the processor, wherein the processor, when executing the program, implements the steps of a method for modifying image data in real time during transmission of a cloud desktop image according to any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211367381.8A CN115913939B (en) | 2022-11-02 | 2022-11-02 | Real-time image data modification method and device in cloud desktop image transmission process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211367381.8A CN115913939B (en) | 2022-11-02 | 2022-11-02 | Real-time image data modification method and device in cloud desktop image transmission process |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115913939A CN115913939A (en) | 2023-04-04 |
| CN115913939B true CN115913939B (en) | 2024-07-16 |
Family
ID=86482689
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211367381.8A Active CN115913939B (en) | 2022-11-02 | 2022-11-02 | Real-time image data modification method and device in cloud desktop image transmission process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115913939B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113573059A (en) * | 2021-09-23 | 2021-10-29 | 中兴通讯股份有限公司 | Image display method, image display apparatus, storage medium, and electronic apparatus |
| CN114629897A (en) * | 2022-03-08 | 2022-06-14 | 阿里巴巴（中国）有限公司 | Data processing method and system |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8392596B2 (en) * | 2009-05-26 | 2013-03-05 | Red Hat Israel, Ltd. | Methods for detecting and handling video and video-like content in remote display system |
| EP3026566A4 (en) * | 2013-07-22 | 2016-08-10 | Fujitsu Ltd | Information processing apparatus, method, and program |
| CN105072190A (en) * | 2015-08-21 | 2015-11-18 | 刘昌平 | Method and system for realizing real-time desktop cloud |
| CN109933394A (en) * | 2019-02-20 | 2019-06-25 | 深圳威尔视觉传媒有限公司 | Single-screen multiwindow low latency coding method and relevant apparatus |
| CN113360045A (en) * | 2021-04-23 | 2021-09-07 | 数坤(北京)网络科技股份有限公司 | Medical image processing and displaying method, processing device, display device and storage medium |
| CN114387155A (en) * | 2021-12-23 | 2022-04-22 | 北京旷视科技有限公司 | Image processing method, apparatus and storage medium |
-
2022
- 2022-11-02 CN CN202211367381.8A patent/CN115913939B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113573059A (en) * | 2021-09-23 | 2021-10-29 | 中兴通讯股份有限公司 | Image display method, image display apparatus, storage medium, and electronic apparatus |
| CN114629897A (en) * | 2022-03-08 | 2022-06-14 | 阿里巴巴（中国）有限公司 | Data processing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115913939A (en) | 2023-04-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8374444B2 (en) | Method and apparatus for providing higher resolution images in an embedded device | |
| CN108564551B (en) | Fisheye image processing method and fisheye image processing device | |
| US9083975B2 (en) | Moving image coding device | |
| CN109643528B (en) | Information processing apparatus, information processing method, and program | |
| US11010879B2 (en) | Video image processing method and apparatus thereof, display device, computer readable storage medium and computer program product | |
| CN108495054B (en) | Method and device for processing high dynamic range signal and computer storage medium | |
| CN114040246A (en) | Image format conversion method, device, equipment and storage medium of graphic processor | |
| US20090284538A1 (en) | Video streaming data processing method | |
| CN112565603B (en) | Image processing method and device and electronic equipment | |
| CN115913939B (en) | Real-time image data modification method and device in cloud desktop image transmission process | |
| US11991412B2 (en) | Standard dynamic range (SDR) / hybrid log-gamma (HLG) with high dynamic range (HDR) 10+ | |
| CN112911299B (en) | Video code rate control method and device, electronic equipment and storage medium | |
| CN111034187A (en) | Dynamic image generation method and device, movable platform and storage medium | |
| CN114820660A (en) | Image processing method, image processing apparatus, electronic device, storage medium, and program product | |
| CN110958460B (en) | Video storage method and device, electronic equipment and storage medium | |
| WO2022061723A1 (en) | Image processing method, device, terminal, and storage medium | |
| US20180225846A1 (en) | Method of converting data format | |
| CN108933945B (en) | GIF picture compression method, device and storage medium | |
| US8369637B2 (en) | Image processing apparatus, image processing method, and program | |
| CN109429067B (en) | Dynamic picture compression method and device, computer equipment and storage medium | |
| US20240290060A1 (en) | Image processing method and apparatus | |
| US20180286006A1 (en) | Tile reuse in imaging | |
| US5751858A (en) | Moving picture coding apparatus | |
| CN115623217B (en) | Image preprocessing method, device and system | |
| CN117278687A (en) | Image processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |