CN102664924A - Method and apparatus for information processing during remote assistance process - Google Patents

Method and apparatus for information processing during remote assistance process Download PDF

Info

Publication number
CN102664924A
CN102664924A CN2012100888057A CN201210088805A CN102664924A CN 102664924 A CN102664924 A CN 102664924A CN 2012100888057 A CN2012100888057 A CN 2012100888057A CN 201210088805 A CN201210088805 A CN 201210088805A CN 102664924 A CN102664924 A CN 102664924A
Authority
CN
China
Prior art keywords
image
grabs
controlled terminal
scaling
instruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012100888057A
Other languages
Chinese (zh)
Other versions
CN102664924B (en
Inventor
高云峥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Qihoo Technology Co Ltd
Original Assignee
Beijing Qihoo Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qihoo Technology Co Ltd filed Critical Beijing Qihoo Technology Co Ltd
Priority to CN201210088805.7A priority Critical patent/CN102664924B/en
Publication of CN102664924A publication Critical patent/CN102664924A/en
Application granted granted Critical
Publication of CN102664924B publication Critical patent/CN102664924B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Controls And Circuits For Display Device (AREA)

Abstract

The invention provides a method and an apparatus for information processing during a remote assistance process. The method comprises the following steps that: image capture is carried out on a current screen state at a controlled terminal; preprocessing is carried out on the captured image and the preprocessed image is transmitted to a master control terminal, wherein the preprocessing includes resolution ratio reduction processing on the captured image according to a scaling ratio; when an instruction returned by the master control terminal is received, coordinate information contained in the instruction is converted according to the scaling ratio; and the instruction is executed based on the converted coordinate information. According to the invention, occupation on a transmission bandwidth during a remote assistance process can be reduced.

Description

Information processing method in the remote assistance process and device
Technical field
The present invention relates to field of computer technology, particularly relate to information processing method and device in the remote assistance process.
Background technology
The continuous development of Along with computer technology, computer equipments such as computer have almost become indispensable instrument in people's life.But, for a lot of users, the understanding of computer is only limited to application, but be ignorant of computer is safeguarded, in case computer break down, more at a loss what to do.For this reason; Some service providers provide the remote assistance service for the user; The user is as long as the remote assistance client that the build-in services merchant provides on the computer of oneself; Just can link up with the technician of service provider, the technician can help the common computer user to solve software and system problem, and for example system optimization, system mend upgrading, drive installation, malicious plugins cleaning, virus/wooden horse killing, system-based setting, software download, software are installed, network failure is debugged or the like.
In implementation procedure; The user can set up a session (session) through remote assistance client and technician; Take over operation by the technician then to user computer; At this moment, the remote assistance client of user side can with the screen state of user computer (for example icon on the wallpaper that uses of desktop, the desktop, when front opening which window or the like) send to the technician behind the sectional drawing, so just can on the computer of technician's side, demonstrate the screen state of user computer; The technician is when carrying out the remote assistance operation through mouse or keyboard etc.; The remote assistance client of technician's side can generate corresponding instruction with concrete operation; And instruction being sent to the computer of user side through network, corresponding instruction can resolved and carry out to the computer of user side; In the process of execution command; The screen state of user side computer can change again (for example newly opened certain window or closed certain window or clicked start menu or the like); Therefore, the remote assistance client of user side needs constantly to send to the technician behind the screen state grabgraf with user computer, and the technician carries out after the new operation; Can the instruction of correspondence be sent to user side again, move in circles with this.
It is thus clear that; Prior art is in the process that realizes remote assistance; Need constantly the screen state of user side is sent to technician's side with the mode of image; This will take bigger transmission bandwidth, under the transmission bandwidth condition of limited, may make the view data of technician's side can't in time send to problems such as technician's side.
Summary of the invention
The invention provides information processing method and device in the remote assistance process, can be reduced in taking transmission bandwidth in the remote assistance process.
The invention provides following scheme:
Information processing method in a kind of remote assistance process comprises:
At controlled terminal current screen state is carried out image-capture;
The said image that grabs is carried out preliminary treatment, and said pretreated image is transferred to the master control end; Said preliminary treatment comprises according to a scaling image that grabs is reduced resolution processes;
When receiving the instruction that the master control end passes back,, the coordinate information that comprises in the said instruction is changed according to said scaling;
Carry out said instruction based on the coordinate information after the said conversion.
Wherein, said preliminary treatment also comprises:
With said grab image carry out piecemeal and handle.
Wherein:
Said piecemeal is handled and after said reduction resolution processes, is carried out.
Wherein, saidly according to a scaling image that grabs is reduced resolution processes and comprises:
According to the original resolution of the image that grabs, the scaling that selection can be divided exactly the original image prime number that comprises in the said image that grabs;
Scaling according to said selection reduces resolution processes with the image that grabs.
Wherein, also comprise:
When controlled terminal carries out image-capture to current screen state, with the mouse icon blanking that shows on the said controlled terminal screen.
Information processor in a kind of remote assistance process comprises:
The image-capture unit is used at controlled terminal current screen state being carried out image-capture;
The image pretreatment unit is used for the said image that grabs is carried out preliminary treatment, and said pretreated image is transferred to the master control end; Said preliminary treatment comprises according to a scaling image that grabs is reduced resolution processes;
Coordinate transformation unit when being used to receive the instruction that the master control end passes back, according to said scaling, is changed the coordinate information that comprises in the said instruction;
Instruction execution unit is used for carrying out said instruction based on the coordinate information after the said conversion.
Wherein, said image pretreatment unit also is used for: the said image that grabs is carried out piecemeal handle.
Wherein:
Said image pretreatment unit carries out said piecemeal after said reduction resolution processes handles.
Wherein, said image pretreatment unit comprises:
Scaling chooser unit is used for the original resolution according to the image that grabs, the scaling that selection can be divided exactly the original image prime number that comprises in the said image that grabs;
The convergent-divergent subelement is used for according to the scaling of said selection the image that grabs being reduced resolution processes.
Wherein, also comprise:
Mouse icon blanking unit is used for when controlled terminal carries out image-capture to current screen state, with the mouse icon blanking that shows on the said controlled terminal screen.
According to specific embodiment provided by the invention, the invention discloses following technique effect:
Through the present invention, can after the image that grabs the controlled terminal screen state, at first reduce the resolution of image, and then carry out the transmission of image.Like this, owing to during images mainly be because the resolution decision of image to taking of bandwidth, therefore, after having reduced image resolution ratio, the bandwidth that takies in the time of just can reducing images.Simultaneously, because the master control end need not see the image that resolution is very high in fact, and to the instruction that relates to coordinate of master control end passback, be able to correct execution after also can passing through conversion, therefore, can guarantee the normal realization of remote assistance.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use among the embodiment below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the flow chart of the method that provides of the embodiment of the invention;
Fig. 2 is the schematic representation of apparatus that the embodiment of the invention provides;
Fig. 3 is another schematic representation of apparatus that the embodiment of the invention provides.
Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, the every other embodiment that those of ordinary skills obtained belongs to the scope that the present invention protects.
At first need to prove; In the remote assistance process; Technician's side is the equal of the master control end, and user side is the equal of a controlled terminal, and; The master control end just sends the instruction of keyboard and mouse to long-range controlled terminal computer, and the screen-picture of controlled terminal computer is come through the communication line passback simultaneously.That is to say; Operate at master control end control controlled terminal computer and to carry out on the computer seemingly before eyes; But essence is in long-range computer, to realize, no matter open file, still surf the web, download etc. all is to be stored in the long-range controlled terminal computer.
Wherein, The main control end program is to operate in the computer terminal that help is dealt with problems, and major function is the purpose that reaches the control remote computer through refreshing of the information transmission of the processing of picture, operation keyboard and the mouse of realization demonstration remote computer, incident, picture or the like.Specifically can be divided into:
1) attended operation
Can realize and being connected of controlled terminal through the transfer end.For example, after controlled terminal was connected to the transfer end, the master control end was connected to the transfer end; Select the controlled terminal that to control then; The input password carries out both sides' checking; Finally set up corresponding between master control and the controlled terminal.
2) picture shows
Set up local desktop window, initialization dependent picture information shows after the image information of long-range controlled terminal computer sends.
3) event handling
When the demonstration desktop window to this locality carried out various operations (like the input of mouse action, keyboard), program realized the seizure to event message, and was combined into packets of information according to specifying information and sends to long-range controlled terminal computer.
4) frame update
When local program receives message that long-range controlled terminal computer sends when being frame update, the program reception needs the image information content upgraded, makes up the subregion of realizing picture according to information and local display frame and upgrades operation.
The controlled terminal program is to operate in the computer terminal that need deal with problems, and major function is to reach and master control end assistance purpose through the simulation process of the transmission that realizes local image information, remote message incident, the processing of picture part area update or the like.Specifically can be divided into:
1) attended operation
, needs realize being connected to the master control end when assisting.During concrete the realization, can carry out transfer through the transfer end equally, as, controlled terminal can at first be connected to the transfer end, waits for that the master control end is connected to the transfer end; After the master control end has been selected this controlled terminal, require master control end input validation password then, finally set up corresponding between master control and the controlled terminal.
2) Message Processing
Reception is carried out the message of various operations (like mouse action, keyboard input) from long-range master control end to showing desktop window, carries out local simulation and triggering according to the concrete message that receives then.
3) upgrade the zone
When variation that the picture of controlled terminal takes place, generate the update area domain information, be combined into data message and send to the requirement of master control end it carries out corresponding frame updating and shows.
The inventor finds in realizing process of the present invention; So long as the screen state of controlled terminal changes; What send to the master control end from controlled terminal is the image of a frame one frame all just, and is directly to transmit according to the true resolution of controlled terminal screen.So-called resolution is exactly represent the precision of screen picture, be meant pixel that display screen can show how much.Because point, line and face on the screen all are made up of pixel, the displayable pixel of display is many more, and picture is just meticulous more, and the information that can show in the onesize screen area is also many more.When image being stored or transmit, need encode according to pixel to image; Therefore, for the image in the identical size area, the pixel count that comprises is many more; Image can be finer and smoother; But simultaneously, the data volume that obtains after this image encoded is also just big more, and storing required space and transmit shared bandwidth also all can be big more.Yet along with the progress of display screen technology, the resolution of user display screen generally all can be very high, because the size of resolution has determined the size of image data amount again; Usually; Image resolution ratio affects the size of file with proportionate relationship, i.e. square being directly proportional of file size and image resolution ratio is if keep picture size constant; Its resolution is risen to twice before; Then its file size can increase and is original four times, and therefore, the mode of this direct transmission high-definition picture of the prior art can take transmission bandwidth very much.
But in fact when the master control end shows the screen interface of controlled terminal; Do not need so high resolution, that is to say, in the remote assistance process; As long as the technician can tell the image of controlled terminal screen, needn't require the definition or the fine and smooth degree of image quality.
Therefore, in embodiments of the present invention, after controlled terminal grabs screen picture; Can at first reduce its resolution; And then the image of low resolution is transferred to the master control end, so just can reduce can not influence the realization of remote assistance simultaneously to the taking of transmission bandwidth yet.At length introduce in the face of concrete implementation method down.
Referring to Fig. 1, the embodiment of the invention provides the information processing method in a kind of remote assistance process, and this method may further comprise the steps:
S101: current screen state is carried out image-capture at controlled terminal;
Specifically when image is grasped, can adopt the method in the prior art.
S102: according to the scaling that presets, the image that grabs is reduced resolution processes, and the image after will handling is transferred to the master control end;
Wherein, When the image that grabs is reduced the processing of resolution, can from the original image that grabs, go out partial pixel, for example according to certain rule extraction; Because a complete image is made up of pixel on the horizontal direction and the pixel on the vertical direction; Therefore, every separated several pixels are extracted one or more pixels out in every row, also can whenever in every row go out one or more pixels at a distance from several pixel decimations simultaneously; With the pixel deletion that extracts, remaining pixel just can be formed the low image of differentiating.Certainly, in practical application, can also use more complicated more senior algorithm, reduce the resolution of image, and guarantee the identifiability of the main contents that image is expressed.In a word, the original resolution of supposing an image is 1440*900, also is that original number of pixels is 1440*900, extracts after some pixels, can be so that resolution be reduced to 800*600, in addition lower.
S103: when receiving the instruction that the master control end passes back,, the coordinate information that comprises in the said instruction is changed according to said scaling;
S104: carry out said instruction based on the coordinate information after the said conversion.
In the process of remote assistance, except the screen picture with controlled terminal sends to the master control end, also need instructions such as mouse, keyboard be sent to controlled terminal from the master control end.The master control end is when controlled terminal sends instruction; Relate to indication through regular meeting mouse is moved to certain position etc.; And this positional information generally is to represent through the coordinate on display screen, for example, and when needs indication controlled terminal moves to the Start menu place with mouse; Just possibly send the such instruction in certain coordinate place that mouse is moved to display screen, or the like.Yet the coordinate in the display screen is closely connected together with pixel again.Figuratively speaking, can be imagined as entire display screen is a large-scale chessboard, and the expression mode of resolution is exactly the number in all warps and parallel crosspoint; Each crosspoint corresponding a pixel; If with first point of the display screen upper left corner is that initial point is set up coordinate, then coordinate is the position that the point of (0,0) is just represented first pixel place in the upper left corner; Same, other each locations of pixels also can be come out through the coordinate representation in the coordinate system.And in embodiments of the present invention; The resolution with original image reduces; Make the resolution of the image that demonstrates at the master control end can not reflect really by the resolution of controlled terminal screen; But when controlled terminal sends instruction, is to send according to the image situation that the master control end demonstrates at the master control end.For example, the original resolution of controlled terminal is 1024*768, reduces resolution and has become 800*600 afterwards; Therefore; The screen resolution of the controlled terminal of seeing at the master control end is exactly 800*600, and the technician carries out operations such as rolling mouse on the screen that such resolution is 800*600, like this; The mouse position that the master control end captures also is that resolution with 800*600 is benchmark.Therefore, the master control end is when controlled terminal passback relates to the message of coordinate, and controlled terminal needs at first according to the scaling when the downscaled images coordinate to be converted, and recalculates coordinate figure, carries out corresponding instruction according to the coordinate after converting again.For example, dwindle 1/3 in the horizontal direction, dwindle 1/4 in vertical direction; Suppose to determine and need mouse be moved to coordinate (x according to the controlled terminal screen state that in its display screen, demonstrates (image after also promptly having reduced resolution) at the master control end; Y) locate, then controlled terminal need at first convert after receiving instruction, also is; Actual should be mouse to be moved to (3x/2 4y/3) locates when execution command.
Visible through the above, controlled terminal is when reducing image resolution ratio, and the ratio that image dwindles can be set arbitrarily.Certainly, in practical application, if reduce image resolution ratio according to the ratio of any setting, then when master control end passback order instruction, inaccurate phenomenon may appear.For example, still suppose to dwindle 1/3 on the horizontal direction, dwindle 1/4 in vertical direction; That is to say, need be from the pixel of each row deletion 1/3, from the pixel of each row deletion 1/4; But the sum of all pixels in the original image in every row may not be divided exactly by 3, and the sum of all pixels that comprises in each row also may not be divided exactly by 4; At this moment, when reducing image resolution ratio, just can only get approximation according to this ratio.Accordingly, when main control end passback instruction, if the coordinate position (for example 4y/3) after converting is not an integer, then controlled terminal still need be got approximation (because in instruction, can only represent aliquant mark with floating number) when execution command.Therefore,, just possibly cause the accumulation of error,, then may make call instruction can not get responding, operate thereby can't accomplish remote assistance if the coordinate position of indication in the instruction departs from physical location in the controlled terminal screen through after repeatedly approximate.Certainly, in practical application, this error also possibly can't influence the execution of instruction; This be because; When mouse is moved to certain position, normally will click operations such as certain patterned button (for example START button etc.), and this patterned button generally all can account for certain area; As long as mouse moves in this areal extent, when carrying out clicking operation, just can obtain identical result; Therefore, even controlled terminal in when execution command, has any to depart from the actual position that the technician clicks when sending instruction, can make the mouse of controlled terminal drop within the area at graphical button place basically, this just can not influence the execution of instruction yet.
But if technician's side when clicking certain button, has been clicked the marginal position of button, the ratio of perhaps when image is dwindled is very big, situation about can't normally carry out just possibly occur instructing.Therefore; For fear of above-mentioned situation takes place; In embodiments of the present invention, when controlled terminal carries out dwindling of image, can be according to the sum of all pixels that comprises respectively on horizontal direction in the original image and the vertical direction; The scaling that selection can be divided exactly can avoid occurring the phenomenon of aforementioned error accumulation like this.
Need to prove that in addition controlled terminal can comprise the icon of mouse in the image when grasping its screen state; And when master control end technician operates through rolling mouse, also can show the icon of a mouse on the master control end, that is to say; The icon that in fact two mouses are arranged on the display screen of master control end, only if not the convergent-divergent that has passed through image, the icon of two mouses can overlap; Letting the technician look, similarly is to have only the icon of a mouse the same.Another is convenient; The mouse of controlled terminal normally should be brought in control by master control, also promptly, moves on display screen though controlled terminal is found mouse; But the user of controlled terminal does not carry out the operation of rolling mouse, and this operation is by the technician of far-end operation.But in practical application, the user of controlled terminal also may rolling mouse carries out certain operation, and is nonoverlapping in the time of on the screen of master control end, will seeing the icon of two mouses at this moment, may influence technician's operation.And, in embodiments of the present invention, because controlled terminal is after grabbing the image of screen state; Can at first reduce the processing of resolution, also promptly therefrom delete some pixels, possibly comprised the pixel of mouse icon position in the pixel of deleting just; Therefore; In case the user of controlled terminal has carried out the operation of rolling mouse, the nonoverlapping phenomenon of then seeing at the master control end of mouse icon can be more obvious, even the phenomenons such as jump of mouse icon possibly occur.
For this reason, in embodiments of the present invention, for fear of the generation of above-mentioned phenomenon; Controlled terminal can also be when grabbing the screen state image; With mouse icon blanking (api function that can adopt operating system to provide is realized), do not comprise mouse icon in the feasible image that is truncated to, like this; Even the user of controlled terminal has moved mouse, can not produce two nonoverlapping phenomenons of mouse icon at the master control end yet.
In addition, in the prior art, can adopt the subregion update mode of picture to carry out the renewal of image usually; That is to say; Same to reducing the consideration of transmission bandwidth, if controlled terminal find with on one constantly compare, have only the image of subregion that variation has taken place in the screen; Other regional constant then can only be transferred to the master control end with this part area image that conversion has taken place.In order to realize the renewal of this subregion, need carry out piecemeal to image usually, also promptly before transmission; Earlier image is divided into fritter one by one; And then these fritters are sent to the master control end, to making up, obtain complete image at the master control end according to fritter.Like this; If controlled terminal finds only to have the image of subregion to change at next constantly; After just can image-capture being got off, according to last time during piecemeal same mode image is carried out piecemeal, the fritter that conversion will take place then sends to the master control end; The master control end just can make up fritter that changes that newly receives and the fritter that does not change that received originally, obtains complete image.
And in embodiments of the present invention; Owing to before sending image, also need reduce the processing of resolution to image; Therefore, when combining with above-mentioned subregion renewal technology, reducing resolution is the problem that needs consideration with the operating sequence of image being carried out piecemeal.If carry out piecemeal earlier, and then reduce resolution, then (for example horizontal direction is cut into 30 owing to when piecemeal, may carry out some approximate operations; But the size of horizontal direction may not be divided exactly by 30, therefore can only get approximation, or the like); Also may carry out some approximate operations () when reducing resolution of preamble, therefore, finally after the master control end makes up each fritter; May occur leaving the gap between fritter and the fritter, phenomenons such as overlapping perhaps occur.On the other hand; Because when image is reduced the processing of resolution; Basically all be that the image border part is least accurately, that is to say, for the core of image; The distortion meeting of marginal portion is serious relatively, even black surround or white edge or the like may appear in edge of image; And if piece image is divided into a plurality of fritters; Respectively each fritter is reduced resolution processes more afterwards; Then all can there be the serious relatively problem of distortion in the edge of each fritter, finally when technician's side makes up, and may be owing to the existence of this distortion; Cause obviously to see each fritter, influence visual effect in technician's side.Therefore, for fear of above-mentioned phenomenon occurring, in embodiments of the present invention, controlled terminal can reduce the operation of resolution earlier after grabbing image, again the image after the reduction resolution is carried out piecemeal afterwards, is transferred to the master control end afterwards again.
To sum up, the embodiment of the invention can at first reduce the resolution of image after the image that grabs the controlled terminal screen state, and then carries out the transmission of image.Like this, owing to during images mainly be because the resolution decision of image to taking of bandwidth, therefore, after having reduced image resolution ratio, the bandwidth that takies in the time of just can reducing images.Simultaneously, because the master control end need not see the image that resolution is very high in fact, and to the instruction that relates to coordinate of master control end passback, be able to correct execution after also can passing through conversion, therefore, can guarantee the normal realization of remote assistance.
Corresponding with the information processing method in the remote assistance process that the embodiment of the invention provides, the embodiment of the invention also provides the information processor in a kind of remote assistance process, and referring to Fig. 2, this device can comprise:
Image-capture unit 201 is used at controlled terminal current screen state being carried out image-capture;
Image pretreatment unit 202 is used for the said image that grabs is carried out preliminary treatment, and said pretreated image is transferred to the master control end; Said preliminary treatment comprises according to a scaling image that grabs is reduced resolution processes;
Coordinate transformation unit 203 when being used to receive the instruction that the master control end passes back, according to said scaling, is changed the coordinate information that comprises in the said instruction;
Instruction execution unit 204 is used for carrying out said instruction based on the coordinate information after the said conversion.
During concrete the realization, upgrade for the subregion of realizing image, image pretreatment unit 202 can also be used for: the said image that grabs is carried out piecemeal handle.
Wherein, in order to obtain good display at the master control end:
Image pretreatment unit 202 can carry out said piecemeal after said reduction resolution processes handles.
During concrete the realization, in order to reduce error, the instruction of avoiding the master control end to send can't be in the controlled terminal correct execution, and referring to Fig. 3, image pretreatment unit 202 can comprise:
Scaling chooser unit 2021 is used for the original resolution according to the image that grabs, the scaling that selection can be divided exactly the original image prime number that comprises in the said image that grabs;
Convergent-divergent subelement 2022 is used for according to the scaling of said selection the image that grabs being reduced resolution processes.
In addition, this device can also comprise:
Mouse icon blanking unit is used for when controlled terminal carries out image-capture to current screen state, with the mouse icon blanking that shows on the said controlled terminal screen.
In a word, the device through the embodiment of the invention provides can at first reduce the resolution of image, and then carry out the transmission of image after the image that grabs the controlled terminal screen state.Like this, owing to during images mainly be because the resolution decision of image to taking of bandwidth, therefore, after having reduced image resolution ratio, the bandwidth that takies in the time of just can reducing images.Simultaneously, because the master control end need not see the image that resolution is very high in fact, and to the instruction that relates to coordinate of master control end passback, be able to correct execution after also can passing through conversion, therefore, can guarantee the normal realization of remote assistance.
Description through above execution mode can know, those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential general hardware platform.Based on such understanding; The part that technical scheme of the present invention contributes to prior art in essence in other words can be come out with the embodied of software product; This computer software product can be stored in the storage medium, like ROM/RAM, magnetic disc, CD etc., comprises that some instructions are with so that a computer equipment (can be a personal computer; Server, the perhaps network equipment etc.) carry out the described method of some part of each embodiment of the present invention or embodiment.
Each embodiment in this specification all adopts the mode of going forward one by one to describe, and identical similar part is mutually referring to getting final product between each embodiment, and each embodiment stresses all is the difference with other embodiment.Especially, for device or system embodiment, because it is basically similar in appearance to method embodiment, so describe fairly simplely, relevant part gets final product referring to the part explanation of method embodiment.Apparatus and system embodiment described above only is schematic; Wherein said unit as the separating component explanation can or can not be physically to separate also; The parts that show as the unit can be or can not be physical locations also; Promptly can be positioned at a place, perhaps also can be distributed on a plurality of NEs.Can realize the purpose of present embodiment scheme according to the needs selection some or all of module wherein of reality.Those of ordinary skills promptly can understand and implement under the situation of not paying creative work.
More than to information processing method and device in the remote assistance process provided by the present invention; Carried out detailed introduction; Used concrete example among this paper principle of the present invention and execution mode are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, part all can change on embodiment and range of application.In sum, this description should not be construed as limitation of the present invention.

Claims (10)

1. the information processing method in the remote assistance process is characterized in that, comprising:
At controlled terminal current screen state is carried out image-capture;
The said image that grabs is carried out preliminary treatment, and said pretreated image is transferred to the master control end; Said preliminary treatment comprises according to a scaling image that grabs is reduced resolution processes;
When receiving the instruction that the master control end passes back,, the coordinate information that comprises in the said instruction is changed according to said scaling;
Carry out said instruction based on the coordinate information after the said conversion.
2. method according to claim 1 is characterized in that, said preliminary treatment also comprises:
With said grab image carry out piecemeal and handle.
3. method according to claim 2 is characterized in that:
Said piecemeal is handled and after said reduction resolution processes, is carried out.
4. according to each described method of claim 1 to 3, it is characterized in that, saidly according to a scaling image that grabs reduced resolution processes and comprise:
According to the original resolution of the image that grabs, the scaling that selection can be divided exactly the original image prime number that comprises in the said image that grabs;
Scaling according to said selection reduces resolution processes with the image that grabs.
5. according to each described method of claim 1 to 3, it is characterized in that, also comprise:
When controlled terminal carries out image-capture to current screen state, with the mouse icon blanking that shows on the said controlled terminal screen.
6. the information processor in the remote assistance process is characterized in that, comprising:
The image-capture unit is used at controlled terminal current screen state being carried out image-capture;
The image pretreatment unit is used for the said image that grabs is carried out preliminary treatment, and said pretreated image is transferred to the master control end; Said preliminary treatment comprises according to a scaling image that grabs is reduced resolution processes;
Coordinate transformation unit when being used to receive the instruction that the master control end passes back, according to said scaling, is changed the coordinate information that comprises in the said instruction;
Instruction execution unit is used for carrying out said instruction based on the coordinate information after the said conversion.
7. device according to claim 6 is characterized in that, said image pretreatment unit also is used for: the said image that grabs is carried out piecemeal handle.
8. device according to claim 7 is characterized in that:
Said image pretreatment unit carries out said piecemeal after said reduction resolution processes handles.
9. according to each described device of claim 6 to 8, it is characterized in that said image pretreatment unit comprises:
Scaling chooser unit is used for the original resolution according to the image that grabs, the scaling that selection can be divided exactly the original image prime number that comprises in the said image that grabs;
The convergent-divergent subelement is used for according to the scaling of said selection the image that grabs being reduced resolution processes.
10. according to each described device of claim 6 to 8, it is characterized in that, also comprise:
Mouse icon blanking unit is used for when controlled terminal carries out image-capture to current screen state, with the mouse icon blanking that shows on the said controlled terminal screen.
CN201210088805.7A 2012-03-29 2012-03-29 Information processing method in remote assistance process and device Active CN102664924B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210088805.7A CN102664924B (en) 2012-03-29 2012-03-29 Information processing method in remote assistance process and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210088805.7A CN102664924B (en) 2012-03-29 2012-03-29 Information processing method in remote assistance process and device

Publications (2)

Publication Number Publication Date
CN102664924A true CN102664924A (en) 2012-09-12
CN102664924B CN102664924B (en) 2016-01-13

Family

ID=46774333

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210088805.7A Active CN102664924B (en) 2012-03-29 2012-03-29 Information processing method in remote assistance process and device

Country Status (1)

Country Link
CN (1) CN102664924B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104010204A (en) * 2013-02-27 2014-08-27 ***通信集团公司 Image information processing method and apparatus
CN105681584A (en) * 2016-03-21 2016-06-15 珠海格力电器股份有限公司 Remote control method and device for mobile terminal
CN105763552A (en) * 2016-03-17 2016-07-13 北京小米移动软件有限公司 Transmission method, device and system in remote control
CN106886384A (en) * 2017-02-28 2017-06-23 宇龙计算机通信科技(深圳)有限公司 The method and double screen terminal of display image
CN108920225A (en) * 2018-05-03 2018-11-30 腾讯科技(深圳)有限公司 Remote assistant control method and device, terminal, storage medium
CN109165062A (en) * 2018-07-24 2019-01-08 苏宁易购集团股份有限公司 A kind of terminal remote assists control method and system
CN109614018A (en) * 2018-11-16 2019-04-12 广州中智达信科技有限公司 A kind of method and apparatus assisted with screen
CN111752510A (en) * 2019-03-29 2020-10-09 杭州海康威视***技术有限公司 Television wall playback method and device
WO2022095506A1 (en) * 2020-11-09 2022-05-12 北京达佳互联信息技术有限公司 Live broadcast method and apparatus

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1764103A (en) * 2004-10-20 2006-04-26 国际商业机器公司 Privacy protection method and apparatus for remote control
CN101673185A (en) * 2009-10-10 2010-03-17 广东威创视讯科技股份有限公司 Image display touch control method and system thereof
US7721204B2 (en) * 2004-07-29 2010-05-18 Xerox Corporation Client dependent image processing for browser-based image document viewer for handheld client devices
CN101964860A (en) * 2009-07-23 2011-02-02 孙博雅 Home theater server

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7721204B2 (en) * 2004-07-29 2010-05-18 Xerox Corporation Client dependent image processing for browser-based image document viewer for handheld client devices
CN1764103A (en) * 2004-10-20 2006-04-26 国际商业机器公司 Privacy protection method and apparatus for remote control
CN101964860A (en) * 2009-07-23 2011-02-02 孙博雅 Home theater server
CN101673185A (en) * 2009-10-10 2010-03-17 广东威创视讯科技股份有限公司 Image display touch control method and system thereof

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104010204A (en) * 2013-02-27 2014-08-27 ***通信集团公司 Image information processing method and apparatus
CN105763552A (en) * 2016-03-17 2016-07-13 北京小米移动软件有限公司 Transmission method, device and system in remote control
CN105763552B (en) * 2016-03-17 2020-09-08 北京小米移动软件有限公司 Transmission method, device and system in remote control
CN105681584A (en) * 2016-03-21 2016-06-15 珠海格力电器股份有限公司 Remote control method and device for mobile terminal
CN106886384A (en) * 2017-02-28 2017-06-23 宇龙计算机通信科技(深圳)有限公司 The method and double screen terminal of display image
CN108920225A (en) * 2018-05-03 2018-11-30 腾讯科技(深圳)有限公司 Remote assistant control method and device, terminal, storage medium
CN109165062A (en) * 2018-07-24 2019-01-08 苏宁易购集团股份有限公司 A kind of terminal remote assists control method and system
CN109614018A (en) * 2018-11-16 2019-04-12 广州中智达信科技有限公司 A kind of method and apparatus assisted with screen
CN109614018B (en) * 2018-11-16 2021-06-29 广州中智达信科技有限公司 Method and equipment for assisting in one-screen display
CN111752510A (en) * 2019-03-29 2020-10-09 杭州海康威视***技术有限公司 Television wall playback method and device
WO2022095506A1 (en) * 2020-11-09 2022-05-12 北京达佳互联信息技术有限公司 Live broadcast method and apparatus
US11663924B2 (en) 2020-11-09 2023-05-30 Beijing Dajia Internet Information Technology Co., Ltd. Method for live streaming

Also Published As

Publication number Publication date
CN102664924B (en) 2016-01-13

Similar Documents

Publication Publication Date Title
CN102664924A (en) Method and apparatus for information processing during remote assistance process
CN102662618B (en) Image processing method in remote assistance process and device
US7996776B2 (en) Shared telepointer
US20150212728A1 (en) Image display apparatus, image display system, and image display method
CN108282677A (en) Realize that content throws method, throwing screen device and the system of screen by client
CN105338318B (en) A kind of monitoring system and its long-range control method
CN103312814B (en) The method for building up of VNC concealed channel between cloud management platform and virtual machine terminal user
CN105992066B (en) A kind of characters input method and character entry apparatus applied to smart machine
CN107122148A (en) Remote cooperation method and system
CN103513858A (en) Remote assistance method and device
CN112099714B (en) Screenshot method and device, electronic equipment and readable storage medium
CN103959208A (en) Method of internet browser-based remote user interface virtual mouse cursor positioning
CN109803162A (en) Information sharing method, device and smart television
CN102438029B (en) Control method and system for realizing remote interaction of Android cell phones
CN109753315A (en) A kind of smart machine interactive content editor implementation method and storage medium
CN102662467B (en) Method and device for instruction control in remote assistance process
CN104252232B (en) Command control method and device during remote assistance
CN103201786A (en) Reshaping interfaces using content-preserving warps
CN112637409B (en) Content output method and device and electronic equipment
WO2021039680A1 (en) Information processing system and information processing method
CN101520719A (en) System and method for sharing display information
CN109960562B (en) Information display method and device and computer readable storage medium
US9141443B2 (en) Method and system for integrating visual controls with legacy applications
CN103853470A (en) Data processing and displaying method, device and system
JP4374013B2 (en) Relay device and relay method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant