CN103412701A - Method and device for processing remote desktop images - Google Patents
Method and device for processing remote desktop images Download PDFInfo
- Publication number
- CN103412701A CN103412701A CN2012104305616A CN201210430561A CN103412701A CN 103412701 A CN103412701 A CN 103412701A CN 2012104305616 A CN2012104305616 A CN 2012104305616A CN 201210430561 A CN201210430561 A CN 201210430561A CN 103412701 A CN103412701 A CN 103412701A
- Authority
- CN
- China
- Prior art keywords
- cursor
- view data
- information
- type
- operation scenario
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method and device for processing remote desktop images, and relates to the technical field of remote desktops. The method for processing the remote desktop images comprises the steps of obtaining a graph command relevant to user operation in response to an input event triggered by the user operation, obtaining cursor information from the graph command, judging the type of a cursor according to the cursor information, and identifying the type of an operation scene of the user operation according to the cursor information and the judged type of the cursor. By means of the method and device, before the remote desktop images are processed, the type of the scene of the user operation can be identified, accordingly, unnecessary spending produced in the process of sending a large number of image data is effectively lowered, and the transmission bandwidth is optimized.
Description
Technical field
The present invention relates to the remote desktop technical field, relate in particular to a kind of remote desktop image processing method and device.
Background technology
The remote desktop technology makes to connect and control another equipment of having opened the Remote desk process function by network becomes possibility, the remote desktop technology not only comprises the demonstration of long-range desktop picture, also can comprise the transmission of remote sound and can plug mapping of hardware etc., therefore can provide and have desktop or the application program experience of enriching fidelity.Computing machine or the such client device of mobile device for enterprise's office, business hall, hospital etc., can be connected to the data center that has a large amount of servers by LAN (Local Area Network) or wide area network, the server of data center is opened the Remote desk process function, after with client device, erecting remote desktop system, each client device can pass through this remote desktop technology true-time operation server device, thus the resource at more convenient usage data neatly center.
After traditional remote desktop system is put up, the operation of server device response user on client device, desktop is shown to image compresses and caching process uniformly, and send to client device after encapsulation forms graphics command according to RDP.Client device is decoded to the graphics command received and view data is played up to a complete desktop and shows image, thereby shows a complete desktop picture on client device.
The type that shows image due to desktop is various, in prior art, various types of view data are all processed uniformly, and adopting the same compression algorithm to compress, this certainly will cause showing that for the desktop of certain or some type image can't reach expense minimum or efficiency optimization.
Summary of the invention
The problem that invention will solve
The technical problem to be solved in the present invention is: providing a kind of can, before desktop is shown to image is processed, carry out method and the device of identifying processing to the image of desktop demonstration.
For the scheme of dealing with problems
In order to address the above problem, first aspect, embodiments of the invention provide a kind of remote desktop image processing method, comprising:
Incoming event in response to being triggered by user's operation, obtain to the user and operate relevant graphics command;
From described graphics command, obtaining cursor information, judge the cursor type according to described cursor information;
Operation scenario according to described cursor information and the described user's operation of the cursor type identification judged.
In conjunction with first aspect, in the possible embodiment of the first, the method also comprises:
For to described user, operating relevant view data setting operation scene identity, described operation scenario sign is for meaning the type of the operation scenario identified.
In conjunction with the possible embodiment of the first of first aspect, in the possible embodiment of the second, also comprise:
According to the described operation scenario sign that described view data is carried, described view data is processed.
In conjunction with the possible embodiment of the second of first aspect, in the third possible embodiment, described described operation scenario sign of carrying according to described view data, process the view data of described operation scenario, specifically comprises:
According to described operation scenario sign, select corresponding image buffer storage mechanism and image compression algorithm, and according to described image buffer storage mechanism and described image compression algorithm, described view data is processed.
In conjunction with the second or the third possible embodiment of first aspect, in possible way of example, the method also comprises in the 4th:
According to RDP, the view data after encapsulation process also sends.
In conjunction with first aspect, in the 5th kind of possible embodiment, described cursor information comprises the shape of cursor and the dimension information of cursor;
The shape of described cursor and the dimension information of cursor are from obtaining in the DrvSetPointerShape instruction described graphics command.
In conjunction with first aspect, in the 6th kind of possible embodiment, described cursor information comprises the position of cursor and the information whether cursor is hidden;
The information whether positional information of described cursor and cursor are hidden is from obtaining in the DrvMovePointer instruction described graphics command.
In conjunction with first aspect, in the 7th kind of possible embodiment, described view data comprises the view data except described cursor shown on the view data of cursor and remote desktop.
Second aspect, the embodiment of the present invention provide a kind of remote desktop image processing apparatus, comprising:
The graphics command acquiring unit, the incoming event in response to being triggered by user's operation, obtain to described user and operate relevant graphics command, and described graphics command is sent to the cursor information acquisition unit;
The cursor information acquisition unit, for receiving the graphics command sent from described graphics command acquiring unit, from described graphics command, obtaining cursor information, according to described cursor information, judge the cursor type, and described cursor information and cursor type are sent to recognition unit;
Recognition unit, for receiving cursor information and the cursor type sent from described cursor information acquisition unit, according to the type of described cursor information and the described operation scenario of cursor type identification judged.
In conjunction with second aspect, in the possible embodiment of the first, this device also comprises:
Indexing unit, for the type of the described operation scenario according to described recognition unit identification, for to described user, operating relevant view data setting operation scene identity, described operation scenario sign is for meaning the type of the operation scenario identified.
In conjunction with the possible embodiment of the first of second aspect, in the possible embodiment of the second, also comprise:
The classification processing unit, for the described operation scenario sign of carrying according to described view data, process described view data.
In conjunction with the possible embodiment of the second of second aspect, in the third possible embodiment, described processing unit is specifically for according to described operation scenario sign, selecting image buffer storage mechanism and image compression algorithm, and according to described image buffer storage mechanism and described image compression algorithm, described view data processed.
The second or the third possible embodiment in conjunction with second aspect, in the 4th kind of possible embodiment, also comprise:
Encapsulation unit, for the view data from after described classification processing unit reception & disposal, according to view data the transmission after the described processing of RDP encapsulation.
The third aspect, the embodiment of the present invention also provides a kind of remote desktop server, comprise central processing unit and storer, described memory stores is carried out instruction, when described remote desktop server operation, between described central processing unit and described storer, communicate by letter, described central processing unit is carried out described execution instruction and is made described remote desktop server carry out the either method in above-mentioned first aspect embodiment.
Fourth aspect, the embodiment of the present invention also provide a kind of computer-readable medium, comprise computer executed instructions, and described computer executed instructions is for making the remote desktop server carry out the either method of above-mentioned first aspect embodiment.
The effect of invention
The method that the embodiment of the present invention provides and device, can be before desktop be shown to image is processed, by the incoming event in response to being triggered by user's operation, obtain to the user and operate relevant graphics command, and then obtain cursor information, according to cursor acquisition of information cursor type, in conjunction with cursor information and cursor type identification, go out the type of operation scenario, further according to the corresponding image buffer storage mechanism of the type selecting of operation scenario and image compression algorithm, thereby effectively reduced the unnecessary expense of great amount of images data in process of transmitting, and then can the optimized transmission bandwidth.
The accompanying drawing explanation
Fig. 1 a is virtual desktop architecture scene schematic diagram;
Fig. 1 b is Remote desk process service scenarios schematic diagram;
Fig. 2 a is the process flow diagram of the remote desktop image processing method of embodiment 1;
Fig. 2 b is another process flow diagram of the remote desktop image processing method of embodiment 1;
Fig. 3 a is the structured flowchart of the remote desktop image processing apparatus of embodiment 2;
Fig. 3 b is another structured flowchart of the remote desktop image processing apparatus of embodiment 2;
Fig. 4 a is the structural representation of the remote desktop server of embodiment 3 virtual desktop architecture scenes;
Fig. 4 b is the structural representation of the remote desktop server of embodiment 3 Remote desk process service scenarios.
Embodiment
Remote desktop image processing method of the present invention and device reach by reference to the accompanying drawings embodiment and are described in detail as follows.
The remote desktop technology can realize by network remote ground operation computing machine, and the content (being the remote desktop image) that the remote computer desktop is shown shows on local desktop.A kind of remote desktop scene is virtual desktop architecture (VirtualDesktop Infrastructure, VDI) scene.As shown in Figure 1a, this enforcement scene is only a kind of exemplary illustration to virtual desktop architecture scene, but is not the concrete restriction to the present invention's application, and in Fig. 1 a, has just provided the ingredient relevant to the embodiment of the present invention.In Fig. 1 a, left side is the client of virtual desktop, is commonly referred to thin-client (Thin Client, TC), and the apparatus-form of client can be common computer, panel computer, smart mobile phone etc.Client is used the service of RDP (Remote Desktop Protocol, RDP) access remote desktop by network.Server provides the carrier of remote desktop, and virtual desktop (Virtual Desktop) is present on server with the form of virtual machine (Virtual Machine, VM).The user is by the virtual desktop (being virtual machine) of distributing to this user on the client-access server, and the virtual machine of distributing to this user is transferred to client by virtual desktop (being remote desktop) and shows.
The another kind of scene of remote desktop is the Remote desk process service.As shown in Figure 1 b, after certain computing machine has been opened the Remote desk process function, just can at the other end, control this computing machine by network, by the remote desktop function can be real-time operation this opened the computing machine of Remote desk process function.Here, the computing machine that the Remote desk process function opened in title is server, and the computing machine that the other end is controlled this station server is client, and the apparatus-form of client can be common computer, panel computer, smart mobile phone etc.By the Remote desk process service, server desktop (being remote desktop) is transferred to client and shows.Common is Microsoft
The Remote desk process service that company provides.
Embodiment 1
The present embodiment provides a kind of remote desktop image processing method while realizing desktop image transmission, and as shown in Figure 2 a, the method comprises:
S1. graphics command obtaining step: the incoming event in response to being triggered by user's operation, obtain to described user and operate relevant graphics command.
As the user when client is carried out input operation by input equipments such as mouse or keyboards, server side is in response to the incoming event triggered by user's operation, obtain by operating system provide based on Graphics Device Interface (Graphics Device Interface, GDI) graphics command, wherein, graphics command comprises the vector plotting order; When the input in response to being triggered by user operation, can also obtain view data, view data comprises the view data except described cursor shown on the view data of cursor and remote desktop.
S2. cursor acquisition of information step, from described graphics command, obtaining cursor information, and judge that according to the cursor information of obtaining this user operates the type of relevant cursor.
S3. identification step, according to the type of the operation scenario of described cursor information, the described user's operation of cursor type identification judged.Wherein, the type of operation scenario can reflect that the user carries out the feature of the associated desktop image change that user's operation shows under current scene, and dissimilar operation scenario has different desktop picture variation characteristics.
The method that the embodiment of the present invention provides, can be before desktop be shown to image is processed, by the incoming event in response to being triggered by user's operation, obtain to the user and operate relevant graphics command, and then obtain cursor information, according to cursor acquisition of information cursor type, in conjunction with cursor information, cursor type identification, go out the type of operation scenario, thus can be according to the corresponding image buffer storage mechanism of the type selecting of the operation scenario identified and image compression algorithm.
The method that the embodiment of the present invention provides also can be used for according to step S3, the view data that identifies action type further being processed, and as shown in Figure 2 b, comprising:
S4. markers step, for to described user, operating relevant view data setting operation scene identity, described operation scenario sign is for meaning the type of the operation scenario that this view data is corresponding;
S5. the treatment step of classifying, according to the described operation scenario sign that described view data is carried, process described view data; And
S6. encapsulation step, according to RDP, encapsulate view data and the vector plotting order after step S5 processes and send.
The method that the embodiment of the present invention provides further, according to the corresponding image buffer storage mechanism of operation scenario type selecting and image compression algorithm, thereby effectively reduced the unnecessary expense of great amount of images data in process of transmitting, and then can the optimized transmission bandwidth.
Tool is sayed it, and in step S2, mainly from two kinds of instructions the GDI instruction, obtain cursor information: one is the DrvSetPointerShape instruction, and another is the DrvMovePointer instruction.When the operation as the user on client causes the conversion of cursor shape on remote desktop, will trigger this DrvSetPointerShape instruction, from this instruction, obtaining the specifying information of cursor, comprise: the shape of cursor, size (length and width) etc.; And user's operational light is marked on the movement on remote desktop, will trigger this DrvMovePointer instruction, the positional information of cursor on remote desktop and the information whether cursor is hidden are recorded in this instruction.In addition, in step S2, also comprise the cryptographic hash of using the image (comprising the image shown on cursor glyph and the remote desktop except cursor) comprised in Hash (hash) algorithm calculating remote desktop view data.According to the cursor information that above-mentioned two kinds of instructions obtain, can judge that in conjunction with the cryptographic hash of cursor glyph the user operates the type of corresponding cursor.
In the method for the present embodiment, preferably the cursor type is divided into to four kinds: Alpha cursor, polychrome cursor, monochromatic light is marked with and transparent cursor.Wherein:
The Alpha cursor only comprises a coloured image in the GDI instruction, the arrow shown on remote desktop, drag and the cursor shape of the operational correspondence such as stretching all belongs to this cursor.Four-headed arrow shape cursor and near the mouse pointing hand that while moving to link occur of common Alpha cursor when for example the unidirectional arrow shape cursor on remote desktop, window stretch, etc.
Polychromatic light is marked in the GDI instruction and comprises a coloured image and a monochrome image.Graphics command is done while playing up view data can be using monochrome image as mask figure, makes in the coloured image of this kind cursor only some color show.This cursor is very uncommon, only in some special application, there will be, the pointing hand that progress bar during such as click broadcasting media file in some playout softwares occurs, this pointing hand is different from the pointing hand of Alpha cursor type, it appears in some special software environments, this pointing hand is likely white, is likely also other special hand shape shape.
Monochromatic light is marked in the GDI instruction and only comprises a monochrome image.For example, when this cursor appears at text editing usually: while in office software, notepad, typewriting, cursor is shown as " I " shape, and while carrying out move operation, cursor may become other shape.The special vertical two-way triangle arrow-shaped cursor that " I " shape cursor when common monochromatic cursor is for example typewrited and various distortion thereof, the cursor when mouse is moved to the left side blank space and roll mouse pulley occur, etc.
Transparent optical is marked in the GDI instruction can not comprise any image, and when such cursor sent to client, client can make the transparent demonstration of cursor.
Below by the identifying of four kinds of different operation scenarios to step S 3, describe.It should be noted, the method for the present embodiment can be applied to other operation scenario as required, is not limited in this four kinds of scenes.These four kinds of different operation scenarios are respectively: typewriting scene, window stretching scene, video playback scene and rolling scene.
For the typewriting scene: according to cursor information, judge, if the cursor type is monochromatic cursor, now, certain corresponding is the state of text editing.Under this scene, when the user started to typewrite, cursor will disappear, and in the DrvMovePointer instruction, will occur that cursor hides Info.In other words, if monochromatic cursor type and the operation scenario that exists cursor to hide Info can to judge the user are the typewriting scene.
For window stretching scene: under the scene that window stretches, there will be the variation of cursor position.Therefore, if the cursor type is the Alpha cursor, the cryptographic hash of the cursor of the cryptographic hash of cursor glyph and oblique four-headed arrow shape is coincide, and variation has occurred in the position of cursor, and the operation scenario that can judge the user is the window scene that stretches.
For the video playback scene: under this scene, static mode of operation continues for some time rear cursor and will hide, with the impact of removing cursor when the video playback.Therefore, if the cursor type is the Alpha cursor, and exist cursor to hide Info, can judge that the scene that the user operates is the video playback scene.In the present embodiment, the video playback of indication comprises the video playback on PPT and ordinary meaning.
For the rolling scene: when the cursor type is monochromatic cursor, and the cryptographic hash of the two-way triangle arrow cursor of the cryptographic hash of cursor glyph and special shape coincide, and can judge scene that the user the operates rolling scene as mouse roller.In the present embodiment, the rolling scene of indication comprises the application such as text editing, PPT broadcasting and web page browsing.
After step S3 completes the identification to the operation scenario of user's operation, in step S4, this user is operated to the mark that relevant view data is carried out corresponding operation scenario, in the image data transmission process follow-up, can take different processing according to different scenes, and then reduce in the image data transmission process the unnecessary expense produced, with the optimized transmission bandwidth.
Tool is sayed it, in step S5, the operation scenario carried according to view data identifies, view data to this operation scenario is processed, specifically comprise: according to the operation scenario sign, select corresponding image buffer storage mechanism and image compression algorithm, and according to image buffer storage mechanism and image compression algorithm, this view data is processed.The four kinds of above-mentioned operation scenarios of still take are example:
For the typewriting scene: this operation scenario mainly occurs in the application of the editor such as word or notepad classes.In this operation scenario, remote desktop demonstration image mainly be take pictograph as main.For such scene, the method of the present embodiment shows that by whole larger remote desktop image is divided into the small images that a plurality of sizes are identical and carries out buffer memory, in addition, owing under this operation scenario, can there being a plurality of zones, be the white space of same color, also have word and color and the identical zone of another image block in an image block.Therefore, for same small images, will no longer transmit and the cryptographic hash of image in the transmitting image piece only.Simultaneously, for the view data under this kind operation scenario, the method of the present embodiment adopts the compression algorithm that is applicable to compression word picture, such as dictionary algorithm, zlib algorithm, and as JPEG, H.264 if this class image compression algorithm is used for compressing the word picture, not only can make the fuzzy almost illegible of font, and can't reach suitable bandwidth range, also waste very much the performance of service end.
For window stretching scene: under this operation scenario, on remote desktop, the scope of window can change, and its frame can amplify and dwindle according to certain proportion.But the white space of same color still can exist in a large number, so for the view data under this operation scenario, still adopt the piecemeal caching mechanism that cuts into little figure in the method for the present embodiment.But, under this operation scenario, do not have a large amount of word pictures, but the image of a lot of icon classes arranged, therefore, be not suitable for adopting the compression algorithm of word class, to this, the method of the present embodiment adopts the algorithm of compressed mixed image to compress the view data under this scene, for example the sfalic algorithm.
For the video playback scene: the method for the present embodiment preferably adopts inter prediction H.264 to encode to video to the view data under this operation scenario.
For the rolling scene: under this operation scenario, when pressing the mouse rollovers key and make current page occur roll, in fact full page has occurred on whole to move or move down, so when upgrading the page (also namely upgrade remote desktop and show image), in fact carry out be by row, increase as required below image or above a few row pixels, eliminate again top or following a few row pixel of image, because the distance of skew up or down is uncertain, therefore, be not suitable for adopting the caching mechanism of piecemeal.The method of the present embodiment carries out cutting apart by row the mode of buffer memory again for the remote desktop view data under this operation scenario, so more be conducive to receiving end and cut apart hitting of rear image, and this caching mechanism is also referred to as super buffer memory (supercache).
Embodiment 2
As shown in Figure 3 a, the present embodiment also provides a kind of remote desktop image processing apparatus, and this device comprises: graphics command acquiring unit 100, cursor information acquisition unit 200 and recognition unit 300.In the device of the present embodiment:
Graphics command acquiring unit 100, the incoming event in response to being triggered by user's operation, obtain to described user and operate relevant graphics command, and described graphics command is sent to cursor information acquisition unit 200.
As the user when client is carried out input operation by input equipments such as mouse or keyboards, server side is in response to the incoming event triggered by user's operation, the graphics command based on Graphics Device Interface (Graphics Device Interface, GDI) provided by operating system is provided.Wherein, graphics command comprises the vector plotting order.During the input that triggered by user operation in response, can also obtain view data, view data comprises the view data except described cursor shown on the view data of cursor and remote desktop.
Cursor information acquisition unit 200 is for receiving the graphics command sent from graphics command acquiring unit 100, from this graphics command, obtaining cursor information, according to the cursor information of obtaining, judge that this user operates the type of relevant cursor, and cursor information and cursor type are sent to recognition unit 300.
The remote desktop image processing apparatus that embodiment provides, can be before desktop be shown to image is processed, by the incoming event in response to being triggered by user's operation, obtain to the user and operate relevant graphics command, and then obtain cursor information, according to cursor acquisition of information cursor type, in conjunction with cursor information, cursor type identification, go out the type of operation scenario, thus can be according to the corresponding image buffer storage mechanism of the type selecting of the operation scenario identified and image compression algorithm.
On said apparatus embodiment basis, the present embodiment also provides another remote desktop image processing apparatus, and as shown in Fig. 3 b, this device also comprises indexing unit 400.
The remote desktop image processing apparatus that the present embodiment provides, on the basis that comprises indexing unit 400, also comprise classification processing unit 500, as shown in Fig. 3 b, the operation scenario sign of classification processing unit 500 for carrying according to this view data, process this view data.Wherein, classification processing unit 500 specifically for: according to this operation scenario sign, select corresponding image buffer storage mechanism and image compression algorithm, and according to this image buffer storage mechanism and this image compression algorithm, this view data processed.According to the corresponding image buffer storage mechanism of operation scenario type selecting and image compression algorithm, thereby effectively reduced the unnecessary expense of great amount of images data in process of transmitting, and then can the optimized transmission bandwidth.
The remote desktop image processing apparatus that the present embodiment provides, on the basis that comprises the processing unit 500 of classifying, also comprise encapsulation unit 600, as shown in Fig. 3 b.Encapsulation unit 600 is for the view data from after classification processing unit 500 reception & disposals, according to RDP, encapsulates view data transmission after this processings.
Embodiment 3
In conjunction with Fig. 1 a, the embodiment of the present invention provides a kind of remote desktop server 106a.As shown in Fig. 4 a, this remote desktop server 106a is comprised of three large ingredients, is respectively: hardware platform 150, virtual machine monitor platform (Hypervisor) 151 and virtual machine are carried out space 152.Wherein:
Hardware platform 150 comprises hard disk 160, CPU 161, network interface card 162 and the memory RAM 163 etc. in remote desktop server 106a physical arrangement.Virtual machine monitor platform 151 and virtual machine are carried out hardware platform and the software platform that space 152 provides respectively virtual machine.Virtual machine monitor platform 151 has comprised a plurality of virtual machine monitor 170a, 170b ... 170n, virtual machine monitor platform 151 are the middle layers between physical hardware and virtual machine, are responsible for coordinating the access of each virtual machine to server hardware.In virtual machine monitor (VMM) 170a, realize the virtual hardware platform 171 of virtual machine (VM) 180a, in virtual hardware platform 171, comprised virtual hard disk 172, CPU 173, memory RAM 174, video card 175 and network interface card 176 etc. out.The software systems of virtual machine 180a operate on virtual hardware platform 171.Virtual machine is carried out in space 152 and has been moved a plurality of virtual machine 180a, 180b ... 180n, client operating system 181 runs in virtual machine 180a, client operating system 181 has comprised a device drive layer 182, video driver 183 and network interface card driving 184 etc. have been installed, during at the client-access remote desktop, virtual machine 180a distributes to the user of this client as the user.
Use the remote desktop server 106a of the present embodiment to realize that the process of the method for the embodiment of the present invention 1 is: as the user when client is carried out input operation by input equipments such as mouse or keyboards, after the incoming event triggered by user operation sends to the remote desktop server side, distribute to client user's virtual machine 180a in response to this incoming event triggered by user's operation, the graphics command based on Graphics Device Interface (Graphics Device Interface, GDI) 186 provided by operating system 181 is provided video driver 183.Wherein, graphics command comprises the vector plotting order.When the input in response to being triggered by user operation, can also obtain view data, view data comprises the view data except described cursor shown on the view data of cursor and remote desktop.Video driver 183 is to this user, operating relevant graphics command the cursor information of obtaining, and judges that according to the cursor information of obtaining this user operates the type of relevant cursor; Operation scenario according to cursor information, the described user's operation of the cursor type identification judged, wherein, the type of operation scenario can reflect that the user operates the feature that desktop picture that VM 180a shows changes under current scene, and dissimilar operation scenario has different desktop picture variation characteristics; For to this user, operating relevant view data setting operation scene identity, this operation scenario sign is for meaning the type of the operation scenario that this view data is corresponding; And view data is sent to desktop protocol service end 187.The operation scenario sign that desktop protocol service end 187 is carried according to view data, this view data is processed, specifically comprise: according to the operation scenario sign, select corresponding image buffer storage mechanism and image compression algorithm, and according to image buffer storage mechanism and image compression algorithm, this view data is processed; According to RDP, encapsulation after treatment view data and vector plotting order and send to client and show.Specific implementation process refers to the specific descriptions of the embodiment of the present invention 1, does not repeat them here.
The computer instruction of storage in central processor CPU 161 execute stores 163 of the remote desktop server 106a that the embodiment of the present invention provides, thus make this remote desktop server 106a carry out the described method of the embodiment of the present invention.This computer instruction can be stored in computer-readable medium, and the present invention is not construed as limiting this to the computer-readable medium type.The embodiment of the present invention and accompanying drawing have only provided assembly related to the present invention and annexation, and other omissions of not describing assembly and annexation do not represent the concrete restriction to the present invention's application; Simultaneously, the embodiment of the present invention is just to the description of a kind of scene of virtual desktop architecture, applicable equally for virtual desktop scene the present invention of other type of architecture, does not repeat them here.
In conjunction with the another kind of remote desktop server 106b shown in Fig. 1 b and Fig. 4 b, as shown in Figure 4 b, i.e. remote desktop server 106b in Remote desk process service, use the remote desktop server 106b that the present embodiment provides to realize that the process of the method for the embodiment of the present invention 1 is: as the user when client is carried out input operation by input equipments such as mouse or keyboards, after the incoming event triggered by user operation sends to remote desktop server 106b, remote desktop server 106b is in response to this incoming event triggered by user's operation, video driver 204 obtain by operating system 202 provide based on Graphics Device Interface (Graphics Device Interface, GDI) 203 graphics command.Wherein, graphics command comprises the vector plotting order; When the input in response to being triggered by user operation, can also obtain view data, view data comprises the view data except described cursor shown on the view data of cursor and remote desktop.Video driver 204 is to this user, operating relevant graphics command the cursor information of obtaining, and judges that according to the cursor information of obtaining this user operates the type of relevant cursor; Operation scenario according to cursor information, the described user's operation of the cursor type identification judged, wherein, the type of operation scenario can reflect that the user operates the feature that desktop picture that remote desktop server 106b shows changes under current scene, and dissimilar operation scenario has different desktop picture variation characteristics; For to this user, operating relevant view data setting operation scene identity, this operation scenario sign is for meaning the type of the operation scenario that this view data is corresponding.The operation scenario carried according to view data identifies, this view data is processed, specifically comprise according to the operation scenario sign and select corresponding image buffer storage mechanism and image compression algorithm, and according to image buffer storage mechanism and image compression algorithm, this view data is processed.According to RDP, encapsulation after treatment view data and vector plotting order and by network interface card 4000, send to client and show.Specific implementation process refers to the specific descriptions of the embodiment of the present invention 1, does not repeat them here.
The computer instruction of storage in central processor CPU 3000 execute stores 2000 of the remote desktop server 106b that the embodiment of the present invention provides, thus make this remote desktop server 106b carry out the described method of the embodiment of the present invention one.This computer instruction can be stored in computer-readable medium, and the present invention is not construed as limiting this to the computer-readable medium type.
Those of ordinary skills can recognize, unit and the algorithm steps of each example of describing in conjunction with embodiment disclosed herein, can with electronic hardware or computer software and electronic hardware in conjunction with realizing.These functions are carried out with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.The professional and technical personnel can specifically should be used for realizing described function with distinct methods to each, but this realization should not thought and exceeds scope of the present invention.
If described function usings that the form of SFU software functional unit realizes and during as production marketing independently or use, can be stored in a computer read/write memory medium.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words or the part of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions are with so that a computer equipment (can be personal computer, server, or the network equipment etc.) carry out all or part of step of the described method of each embodiment of the present invention.And aforesaid storage medium comprises: various media that can be program code stored such as USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), magnetic disc or CDs.
Above embodiment is only be used to illustrating the present invention; and be not limitation of the present invention; the those of ordinary skill in relevant technologies field; without departing from the spirit and scope of the present invention; can also make a variety of changes and modification; therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.
Claims (13)
1. a remote desktop image processing method, is characterized in that, comprising:
Incoming event in response to being triggered by user's operation, obtain to described user and operate relevant graphics command;
From described graphics command, obtaining cursor information, and judge the cursor type according to described cursor information;
Type according to the operation scenario of described cursor information and the described user's operation of the cursor type identification judged.
2. the method for claim 1, is characterized in that, the method also comprises:
For to described user, operating relevant view data setting operation scene identity, described operation scenario sign is for meaning the type of the operation scenario identified.
3. method as claimed in claim 2, is characterized in that, also comprises:
According to the described operation scenario sign that described view data is carried, described view data is processed.
4. method as claimed in claim 3, is characterized in that, described described operation scenario sign of carrying according to described view data, process described view data, specifically comprises:
According to described operation scenario sign, select corresponding image buffer storage mechanism and image compression algorithm, and according to described image buffer storage mechanism and described image compression algorithm, described view data is processed.
5. method as described as claim 3 or 4, is characterized in that, the method also comprises:
According to RDP, the view data after encapsulation process also sends.
6. the method for claim 1, is characterized in that, described cursor information comprises the shape of cursor and the dimension information of cursor;
The shape of described cursor and the dimension information of cursor are from obtaining in the DrvSetPointerShape instruction described graphics command.
7. the method for claim 1, is characterized in that, described cursor information comprises the position of cursor and the information whether cursor is hidden;
The information whether positional information of described cursor and cursor are hidden is from obtaining in the DrvMovePointer instruction described graphics command.
8. the method for claim 1, is characterized in that, described view data comprises the view data except described cursor shown on the view data of cursor and remote desktop.
9. a remote desktop image processing apparatus, is characterized in that, comprising:
The graphics command acquiring unit, the incoming event in response to being triggered by user's operation, obtain to described user and operate relevant graphics command, and described graphics command is sent to the cursor information acquisition unit;
The cursor information acquisition unit, for receiving the graphics command sent from described graphics command acquiring unit, from described graphics command, obtaining cursor information, according to described cursor information, judge the cursor type, and described cursor information and cursor type are sent to recognition unit;
Recognition unit, for receiving cursor information and the cursor type sent from described cursor information acquisition unit, according to the type of the operation scenario of described cursor information and the described user's operation of cursor type identification judged.
10. device as claimed in claim 9, is characterized in that, this device also comprises:
Indexing unit, for the type of the described operation scenario according to described recognition unit identification, for to described user, operating relevant view data setting operation scene identity, described operation scenario sign is for meaning the type of the operation scenario identified.
11. device as claimed in claim 10, is characterized in that, also comprises:
The classification processing unit, for the described operation scenario sign of carrying according to described view data, process described view data.
12. device as claimed in claim 11, it is characterized in that, described classification processing unit is specifically for according to described operation scenario sign, selecting image buffer storage mechanism and image compression algorithm, and according to described image buffer storage mechanism and described image compression algorithm, described view data processed.
13. device as described as claim 11 or 12, is characterized in that, also comprises:
Encapsulation unit, for the view data from after described classification processing unit reception & disposal, according to view data the transmission after the described processing of RDP encapsulation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210430561.6A CN103412701B (en) | 2012-11-01 | 2012-11-01 | remote desktop image processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210430561.6A CN103412701B (en) | 2012-11-01 | 2012-11-01 | remote desktop image processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103412701A true CN103412701A (en) | 2013-11-27 |
| CN103412701B CN103412701B (en) | 2016-08-31 |
Family
ID=49605717
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210430561.6A Active CN103412701B (en) | 2012-11-01 | 2012-11-01 | remote desktop image processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103412701B (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104768009A (en) * | 2015-03-19 | 2015-07-08 | 中国科学院信息工程研究所 | Image transmission method under desktop virtual SPICE protocol |
| CN104765636A (en) * | 2014-01-02 | 2015-07-08 | 华为技术有限公司 | Remote desktop image synthesis method and device |
| WO2015196804A1 (en) * | 2014-06-23 | 2015-12-30 | 中兴通讯股份有限公司 | Virtual desktop image processing method and device, virtual desktop server and thin terminal |
| CN105978963A (en) * | 2016-05-09 | 2016-09-28 | 北京启迪思创科技有限公司 | Remote desktop display method, device and system |
| CN107343026A (en) * | 2017-06-12 | 2017-11-10 | 苏睿 | Remote processing method, apparatus and equipment |
| CN107608787A (en) * | 2017-08-28 | 2018-01-19 | 西安万像电子科技有限公司 | Server |
| WO2018103568A1 (en) * | 2016-12-08 | 2018-06-14 | 中兴通讯股份有限公司 | Methods of encoding and decoding cloud desktop content, device, and system |
| CN109701265A (en) * | 2018-12-04 | 2019-05-03 | 上海达龙信息科技有限公司 | Remote desktop cursor mode switching method, system, client and remote server |
| CN110392262A (en) * | 2019-07-03 | 2019-10-29 | 锐捷网络股份有限公司 | A kind of method and device for compressing virtual desktop image |
| CN110489188A (en) * | 2018-05-14 | 2019-11-22 | 施耐德电器工业公司 | The computer implemented method and system of mobile applications is generated by desktop application |
| CN110740316A (en) * | 2019-09-09 | 2020-01-31 | 西安万像电子科技有限公司 | Data coding method and device |
| CN111447450A (en) * | 2020-03-16 | 2020-07-24 | 西安万像电子科技有限公司 | Data processing method and device |
| CN111708533A (en) * | 2016-08-31 | 2020-09-25 | 华为技术有限公司 | Method and device for setting mouse display state in application thin client |
| CN113124986A (en) * | 2021-04-15 | 2021-07-16 | 天津港集装箱码头有限公司 | Remote virtual simulation method and system for truck scale |
| CN113625923A (en) * | 2020-05-06 | 2021-11-09 | 上海达龙信息科技有限公司 | Mouse processing method and device based on remote cloud desktop, storage medium and equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1538659A (en) * | 2003-04-17 | 2004-10-20 | �Ҵ���˾ | Remote support method and system for computer and other electronic device |
| CN1748196A (en) * | 2002-10-07 | 2006-03-15 | 米厄里戈有限公司 | Cursor for electronic devices |
| US20090113353A1 (en) * | 2007-10-31 | 2009-04-30 | Ravi Prakash Bansal | Cursor locator |
| CN101506791A (en) * | 2006-08-23 | 2009-08-12 | 论理工场株式会社 | Control method for controlling remote computer |
| CN102027464A (en) * | 2008-05-12 | 2011-04-20 | 微软公司 | Virtual desktop view scrolling |
-
2012
- 2012-11-01 CN CN201210430561.6A patent/CN103412701B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1748196A (en) * | 2002-10-07 | 2006-03-15 | 米厄里戈有限公司 | Cursor for electronic devices |
| CN1538659A (en) * | 2003-04-17 | 2004-10-20 | �Ҵ���˾ | Remote support method and system for computer and other electronic device |
| CN101506791A (en) * | 2006-08-23 | 2009-08-12 | 论理工场株式会社 | Control method for controlling remote computer |
| US20090113353A1 (en) * | 2007-10-31 | 2009-04-30 | Ravi Prakash Bansal | Cursor locator |
| CN102027464A (en) * | 2008-05-12 | 2011-04-20 | 微软公司 | Virtual desktop view scrolling |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104765636B (en) * | 2014-01-02 | 2018-05-04 | 华为技术有限公司 | A kind of synthetic method and device of remote desktop image |
| CN104765636A (en) * | 2014-01-02 | 2015-07-08 | 华为技术有限公司 | Remote desktop image synthesis method and device |
| WO2015196804A1 (en) * | 2014-06-23 | 2015-12-30 | 中兴通讯股份有限公司 | Virtual desktop image processing method and device, virtual desktop server and thin terminal |
| CN104768009A (en) * | 2015-03-19 | 2015-07-08 | 中国科学院信息工程研究所 | Image transmission method under desktop virtual SPICE protocol |
| CN104768009B (en) * | 2015-03-19 | 2018-01-05 | 中国科学院信息工程研究所 | A kind of image transfer method under desktop virtualization SPICE protocol |
| CN105978963A (en) * | 2016-05-09 | 2016-09-28 | 北京启迪思创科技有限公司 | Remote desktop display method, device and system |
| CN111708533A (en) * | 2016-08-31 | 2020-09-25 | 华为技术有限公司 | Method and device for setting mouse display state in application thin client |
| WO2018103568A1 (en) * | 2016-12-08 | 2018-06-14 | 中兴通讯股份有限公司 | Methods of encoding and decoding cloud desktop content, device, and system |
| CN108184118A (en) * | 2016-12-08 | 2018-06-19 | 中兴通讯股份有限公司 | Cloud desktop contents encode and coding/decoding method and device, system |
| CN107343026A (en) * | 2017-06-12 | 2017-11-10 | 苏睿 | Remote processing method, apparatus and equipment |
| CN107608787A (en) * | 2017-08-28 | 2018-01-19 | 西安万像电子科技有限公司 | Server |
| CN110489188A (en) * | 2018-05-14 | 2019-11-22 | 施耐德电器工业公司 | The computer implemented method and system of mobile applications is generated by desktop application |
| CN110489188B (en) * | 2018-05-14 | 2024-01-26 | 施耐德电器工业公司 | Computer-implemented method and system for generating mobile applications by desktop applications |
| CN109701265A (en) * | 2018-12-04 | 2019-05-03 | 上海达龙信息科技有限公司 | Remote desktop cursor mode switching method, system, client and remote server |
| CN110392262B (en) * | 2019-07-03 | 2022-04-26 | 锐捷网络股份有限公司 | Method and device for compressing virtual desktop image |
| CN110392262A (en) * | 2019-07-03 | 2019-10-29 | 锐捷网络股份有限公司 | A kind of method and device for compressing virtual desktop image |
| CN110740316A (en) * | 2019-09-09 | 2020-01-31 | 西安万像电子科技有限公司 | Data coding method and device |
| CN111447450A (en) * | 2020-03-16 | 2020-07-24 | 西安万像电子科技有限公司 | Data processing method and device |
| CN113625923A (en) * | 2020-05-06 | 2021-11-09 | 上海达龙信息科技有限公司 | Mouse processing method and device based on remote cloud desktop, storage medium and equipment |
| CN113124986A (en) * | 2021-04-15 | 2021-07-16 | 天津港集装箱码头有限公司 | Remote virtual simulation method and system for truck scale |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103412701B (en) | 2016-08-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103412701A (en) | Method and device for processing remote desktop images | |
| AU2010341605B2 (en) | Systems and methods for video-aware screen capture and compression | |
| CN105405325B (en) | Network teaching method and system | |
| KR101773638B1 (en) | Methods for interfacing with a virtualized computing service over a network using a lightweight client | |
| CN102164167B (en) | Method and system for remote-control classified transmission | |
| US8924502B2 (en) | System, method and computer program product for updating a user session in a mach-derived system environment | |
| US10885879B2 (en) | Media rendering with orientation metadata | |
| US20180113663A1 (en) | Browser based display system for displaying image data | |
| EP2975846B1 (en) | Image frame transmission method, mobile terminal and smart television | |
| CN101699395A (en) | Multi-window management method and multi-window browser | |
| CN112930537B (en) | Text detection, inserted symbol tracking, and active element detection | |
| CN104199723A (en) | Camera mapping method based on virtual equipment | |
| CN103873886A (en) | Image information processing method, device and system | |
| KR101728389B1 (en) | Accelerating bitmap remoting by identifying and extracting 2d patterns from source bitmaps | |
| CN1279430C (en) | Digital document processing | |
| CN112860366B (en) | System and method for realizing remote desktop information transmission based on pattern recognition technology | |
| CN103701791A (en) | Server, terminal equipment, visual desktop system and operation method thereof | |
| CN115052043B (en) | Video transmission method, electronic equipment, device and medium of cloud desktop | |
| Ku et al. | WARP: web-based adaptive remote-desktop protocol for VDI | |
| US20230083996A1 (en) | Access for resources during remote session | |
| CN111654702B (en) | Data transmission method and system | |
| KR102313530B1 (en) | System for cloud streaming service, method of image cloud streaming service using split screen and apparatus for the same | |
| CN1169067C (en) | Server structure supporting user's terminals | |
| US20240201930A1 (en) | Method and system for providing a content sharing window | |
| US9473407B2 (en) | Traffic controlling method and device based on remote application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220215 Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province Patentee after: Huawei Cloud Computing Technology Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd. |