WO2019192190A1 - Touch-back method and system for wireless screen mirroring - Google Patents

Touch-back method and system for wireless screen mirroring Download PDF

Info

Publication number
WO2019192190A1
WO2019192190A1 PCT/CN2018/117052 CN2018117052W WO2019192190A1 WO 2019192190 A1 WO2019192190 A1 WO 2019192190A1 CN 2018117052 W CN2018117052 W CN 2018117052W WO 2019192190 A1 WO2019192190 A1 WO 2019192190A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch
event
touch event
touch operation
wireless screen
Prior art date
Application number
PCT/CN2018/117052
Other languages
French (fr)
Chinese (zh)
Inventor
郭庆伟
Original Assignee
广州视源电子科技股份有限公司
广州视睿电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视睿电子科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2019192190A1 publication Critical patent/WO2019192190A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Definitions

  • the present application relates to the field of interactive smart tablets, for example, to a wireless screen touch back method and system.
  • Wireless screens are more and more widely used in conferences, education, etc.
  • Wireless screens usually refer to the screen of the sender (such as Windows, Mac or Chrome notebook) being screened wirelessly to the receiving end (for example, large size). Smart tablet or interactive tablet).
  • the existing wireless screen transmission scheme does not support touch back transmission, or only supports single click event back transmission, and does not support richer. The touchback of the action event.
  • the embodiment of the present application provides a wireless screen touchback method and system, which can support click, double click, long press, and drag. Touchback of richer operational events such as motion, zoom, and scroll.
  • the embodiment of the present application provides a wireless screen touch back transmission system, including a transmitting end and a receiving end, the receiving end is configured to receive a touch operation, and the receiving end is further configured to generate a touch event according to the touch operation, and The sending event is sent to the sending end; the sending end is configured to receive and parse the touch event to obtain the touch operation corresponding to the touch event; the sending end is further configured to perform the touch operation .
  • the touch operation includes at least one of the following: clicking, double clicking, long pressing, dragging, zooming, scrolling.
  • the touch event includes an abscissa, an ordinate, and an event type of the touch operation position.
  • the receiving end is configured to: when the touch operation is dragging, generate a first touch event, a second touch event, and at least one third touch event, where the first touch event includes the touch operation start position The abscissa, the ordinate, and the first event type, the second touch event includes an abscissa, an ordinate, and a second event type of the touch operation end position, the third touch event including the touch operation start position and end An abscissa, an ordinate, and a third event type of the touch position between the positions, the first event type is a left button press, the third event type is a move, and the second event type is a left button lift
  • the receiving end is further configured to sequentially send the first touch event, the third touch event, and the second touch event to the sending end.
  • the sending end is further configured to parse the left button into a left mouse button press, parse the movement into a mouse movement, and parse the left button into a left mouse button to raise.
  • the receiving end is further configured to: when the touch operation is zooming, set the generated event type of the touch event to zoom.
  • the sending end is configured to parse the zoom into a mouse wheel zoom.
  • the receiving end is further configured to: when the touch operation is at least two finger sliding, set the generated event type of the touch event as scrolling.
  • the sending end is configured to parse the scroll into mouse wheel scrolling.
  • the touch event generated by the receiving end further includes a lateral offset value of the touch operation position, a vertical offset value, and the number of the fingers; and the sending end is further configured to determine whether the touch event is a scroll event; The sending end is further configured to: when the touch event is a scrolling event, determine a scrolling rate according to the number of the fingers; perform a scrolling operation according to the horizontal offset value, the vertical offset value, and the scrolling rate.
  • the sending end is further configured to: when the number of the fingers is two, determine the scrolling rate as L; when the number of the fingers is three, determine the scrolling rate as nL; when the number of the fingers is four, the scroll rate is determined as kL, where k and n are both positive numbers.
  • the receiving end is further configured to add a timestamp to the touch event.
  • the embodiment of the present application provides a wireless screen receiving end, the receiving end is configured to receive a touch operation, and the receiving end is further configured to generate a touch event according to the touch operation, and send the touch event to the sending end.
  • the embodiment of the present application provides a wireless screen touchback method, including the steps of: receiving a touch operation; generating a touch event according to the touch operation; and transmitting the touch event to the sending end.
  • the touch operation includes at least one of the following: clicking, double clicking, long pressing, dragging, zooming, scrolling.
  • the touch event includes an abscissa, an ordinate, and an event type of the touch operation position.
  • the method further includes: when the touch operation is dragging, generating a first touch event, a second touch event, and at least one third touch event, where the first touch event includes an abscissa of a start position of the touch operation, The ordinate and the first event type, the second touch event includes an abscissa, an ordinate, and a second event type of the end position of the touch operation, the third touch event including between the start position and the end position of the touch operation Touching the abscissa, the ordinate, and the third event type of the position, the first event type is a left button press, the third event type is a move, and the second event type is a left button lift; The first touch event, the third touch event, and the second touch event are sequentially sent to the transmitting end.
  • the step of generating a touch event according to the touch operation includes: when the touch operation is zooming, setting the generated event type of the touch event to zoom.
  • the step of generating a touch event according to the touch operation includes: when the touch operation is at least two finger slides, setting the generated event type of the touch event to scrolling.
  • the touch event further includes a lateral offset value of the touch operation position, a longitudinal offset value, and the number of the fingers.
  • the step of generating a touch event according to the touch operation includes adding a time stamp to the touch event.
  • An embodiment of the present application provides a computer readable storage medium having stored thereon a computer program, the program being executed by a processor to implement the steps of any of the methods described above.
  • An embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, where the processor executes the program to implement the method of any of the above step.
  • the receiving end receives a touch operation of the user, such as a click, a double click, a long press, a drag, a zoom, a scroll, and the like, and the receiving end generates a touch operation according to the user's touch operation.
  • a touch operation of the user such as a click, a double click, a long press, a drag, a zoom, a scroll, and the like
  • the wireless screen touch back transmission system of the embodiment of the present application can support touch return of richer operation events such as click, double click, long press, drag, zoom, and scroll, and realize touch return of the user's diverse operation. Users are more convenient to use and have a higher experience.
  • FIG. 1 is a schematic structural diagram of a wireless screen touch back transmission system according to Embodiment 1 of the present application;
  • FIG. 2 is a flow chart of the operation of the wireless screen touch back transmission system shown in FIG. 1;
  • FIG. 3 is a schematic structural diagram of a wireless screen touch back transmission system according to Embodiment 2 of the present application.
  • FIG. 4 is a working flow chart of the wireless screen touch back transmission system shown in FIG. 3;
  • FIG. 5 is a schematic structural diagram of a wireless screen touch back transmission system according to Embodiment 3 of the present application.
  • FIG. 6 is a flow chart showing the operation of the wireless screen touch back transmission system shown in FIG. 5.
  • the terms "first” and “second” are used for the purpose of description only, and are not to be construed as indicating or implying a relative importance or a specific meaning.
  • the following description provides a plurality of embodiments of the present application, and various embodiments may be substituted or combined in combination, and thus the present application is also considered to include all possible combinations of the same and/or different embodiments described.
  • the application should also be considered to include one or more of all other possible combinations containing A, B, C, D.
  • the embodiment although this embodiment may not be explicitly described in the following.
  • the embodiment of the present application provides a wireless screen touch back transmission system, including a transmitting end and a receiving end.
  • the sending end may be, for example, a mobile phone, a tablet computer, a desktop computer, a Windows, a Mac, or a Chrome notebook.
  • the receiving end may be, for example, Interactive smart tablets, interactive tablets, monitors, or smart TVs.
  • the transmitting end is connected to the receiving end, and the transmitting end and the receiving end are connected by, for example, a socket (Socket), a network cable, a Bluetooth, a Wi-Fi, or a ZigBee protocol.
  • the sending end screens to the receiving end. For example, the sending end sends data containing the content of the current interface to the receiving end, and the receiving end receives the data and displays it, so that the interface content displayed by the receiving end is the same as the current interface content displayed by the sending end.
  • the wireless screen touch back transmission system of the embodiment of the present application includes a transmitting end and a receiving end, and the receiving end is configured to receive a touch operation; the receiving end is further configured to generate a touch event according to the touch operation, and send the touch event to the sending end; the sending end sets To receive and parse the touch event, to obtain a touch operation corresponding to the touch event; the sending end is further configured to perform a touch operation.
  • the receiving end receives a touch operation of the user, such as a click, a double click, a long press, a drag, a zoom, a scroll, and the like, and the receiving end generates a touch operation according to the user's touch operation.
  • a touch operation of the user such as a click, a double click, a long press, a drag, a zoom, a scroll, and the like
  • the wireless screen touch back transmission system of the embodiment of the present application can support touch return of richer operation events such as click, double click, long press, drag, zoom, and scroll, and realize touch return of the user's diverse operation. Users are more convenient to use and have a higher experience.
  • the wireless screen touch back transmission system of this embodiment includes a transmitting end 11 and a receiving end 10, for example, the receiving end 10 It can be an interactive smart tablet, interactive tablet, display or smart TV.
  • the sending end 20 can be, for example, a mobile phone, a tablet computer, a desktop computer, a Windows, a Mac, or a Chrome notebook.
  • the transmitting end 11 and the receiving end 10 are, for example, through a socket, a network cable, a Bluetooth, a Wi-Fi, or a Purple Peak protocol. ZigBee) and other ways to connect.
  • the transmitting end 11 and the receiving end 10 have formed a wireless screen transmission system, and the transmitting end 11 can be projected to the receiving end 10.
  • the transmitting end 11 is at least one.
  • the receiving end 10 of the embodiment is configured to receive a touch operation; the receiving end 10 is further configured to generate a touch event according to the touch operation, and send the touch event to the sending end 11; the sending end 11 is configured to receive and parse the touch event to obtain the touch event Corresponding touch operation; the transmitting end 11 is also arranged to perform a touch operation.
  • FIG. 2 is a flowchart of the operation of the wireless screen touch back transmission system according to the embodiment of the present invention. The working flow of the wireless screen touch back transmission system of this embodiment is described below with reference to FIG. 2 .
  • step 100 the receiving end receives a touch operation.
  • the receiving end 10 receives a touch operation of the user, and the touch operation of the user may be an operation of the user directly acting on the display interface (or screen) of the receiving end 10, or the user may use the controller, the mouse, and/or
  • the operation performed by the keyboard on the receiving end 10 may also be an operation performed by the user on the receiving end 10 by gesture.
  • the user's touch operation includes, for example, at least one of: click, double click, long press, drag, zoom, scroll, and the like.
  • the receiving end 10 is also capable of recognizing a user's touch operation, for example, an operation capable of recognizing whether the user's touch operation is a click, a double tap, a long press, a drag, a zoom, or a scroll.
  • one or more transmitting ends 11 are projected to the receiving end 10.
  • the receiving end 10 can display the content of the plurality of transmitting ends 11 in different areas, and the user's touch operation is at a certain transmitting end. 11 screened areas are carried out.
  • Step 101 The receiving end generates a touch event according to the touch operation, and sends the touch event to the sending end.
  • the receiving end 10 generates at least one touch event according to a touch operation of the user, and sequentially transmits the touch event to the transmitting end 11.
  • Touch events include, for example, the abscissa, ordinate, and event type of the touch operation location.
  • the receiving end 10 converts the user's touch operation into a touch event, and by the horizontal coordinate, the ordinate, and the event type of the touch operation position, it is possible to record at which position on the screen of the receiving end 10 the operation is performed.
  • the receiving end 10 when the touch operation of the user is a click, the receiving end 10 generates a first touch event and a second touch event, where the first touch event includes a touch operation position, that is, an abscissa of the user click position, The ordinate and the first event type, the second touch event includes a touch operation position, that is, an abscissa, an ordinate, and a second event type of the user click position, wherein the first event type may be, for example, a left button press, and a second event
  • the type can be, for example, a left button lift, that is, the first touch event and the second touch event are combined in order to record the user's click operation.
  • the first touch event generated by the receiving end 10 is (246, 1346, left key pressed), and the generated second touch event is (246). , 1346, left button lifted).
  • the receiving end 10 then sequentially transmits the first touch event and the second touch event to the transmitting end 11 so that the transmitting end 11 can correctly respond to the touch event.
  • the receiving end 10 when the touch operation of the user is a double tap, the receiving end 10 generates a first touch event, a second touch event, a third touch event, and a fourth touch event, the first touch event, the second
  • the touch event, the third touch event, and the fourth touch event each include a touch operation position, that is, an abscissa and an ordinate of the double-click position
  • the first touch event further includes a first event type, and the first event type may be, for example, a left button press
  • the second touch event further includes a second event type, the second event type may be, for example, a left button lift
  • the third touch event further includes a third event type, and the third event type may be, for example, a left button press
  • the fourth touch event A fourth event type is further included, and the fourth event type may be, for example, a left button lift, that is, the first touch event, the second touch event, the third touch event, and the fourth touch event are recorded in order.
  • the receiving end 10 when the touch operation of the user is a long press, the receiving end 10 generates a touch event, where the touch event includes an abscissa, an ordinate, and an event type of the user's long press position, wherein the event type may be, for example, For long press.
  • the receiving end 10 then transmits a touch event to the transmitting end 11.
  • the drag when the user's touch operation is dragging, the drag here can be understood as, for example, selecting a target (eg, a folder) and then moving the target to the destination, and the receiving end 10 generates the first A touch event, a second touch event, and at least one third touch event.
  • the first touch event includes an abscissa, an ordinate, and a first event type of a touch operation start position, that is, a position of the selected target
  • the second touch event includes an end position of the touch operation, that is, an abscissa, an ordinate, and a second event of the target position.
  • the third touch event includes a touch position between the touch operation start position and the end position, that is, an abscissa, an ordinate, and a third event type of the position during the movement, and the first event type may be, for example, a left button press,
  • the three event types can be, for example, a move, and the second event type can be, for example, a left button lift.
  • the third touch event may be one or more, that is, one or more locations in the moving process may be selected to generate a third touch event.
  • the first touch event, the third touch event, and the second touch event are combined in order to record the user's drag operation.
  • the receiving end 10 sequentially transmits the first touch event, the third touch event, and the second touch event to the transmitting end 11 so that the transmitting end 11 can correctly respond to the touch event.
  • the touch event generated by the receiving end 10 is introduced as an example.
  • the first touch event generated by the receiving end 10 is (246, 1346, left key pressed), and two third touches are generated.
  • the events are (248, 1349, move), (258, 1496, move), and the generated second touch event is (260, 1500, left button lift), where (246, 1346) is the drag start position.
  • the coordinates, (248, 1349) and (258, 1496) are the coordinates of the two positions during the dragging process, and (260, 1500) are the coordinates of the drag end position (ie the destination position).
  • the touch operation of the user when the touch operation of the user is zooming, the touch operation of the user here may be, for example, two fingers being pinched or separated outward, and the receiving end 10 generates a plurality of touch events, and the touch operation position is The abscissa and the ordinate may be, for example, the coordinates of the position of the user's finger, and the event type may be, for example, a zoom. Then, the receiving end 10 sequentially transmits the plurality of touch events to the transmitting end 11.
  • the touch operation of the user when the touch operation of the user is sliding, the touch operation of the user here may be, for example, two finger sliding, three finger sliding, four finger sliding or five finger sliding, etc.
  • receiving end 10 when the touch operation of the user is sliding, the touch operation of the user here may be, for example, two finger sliding, three finger sliding, four finger sliding or five finger sliding, etc.
  • receiving end 10 generates a plurality of touch events, and the abscissa and the ordinate of the touch operation position may be, for example, coordinates of the position where the user's finger slides, and the event type may be, for example, scrolling.
  • the receiving end 10 then transmits the plurality of touch events to the transmitting end 11 in sequence.
  • Step 102 The sending end receives and parses the touch event to obtain a touch operation corresponding to the touch event.
  • the transmitting end 11 receives and parses the touch event to obtain a touch operation corresponding to the touch event, and the position of the touch operation can be obtained by analyzing the touch event, and the position, the ordinate, and the event type can be determined by the event type.
  • the user's touch operation is a click, double click, long press, drag, zoom, or scroll.
  • the transmitting end 11 parses the event type of the touch event into a left mouse button press, and raises the event type left button to the left mouse button.
  • the transmitting end 11 parses the event type long press into a right mouse button press and a right mouse button lift.
  • the sender 11 parses the event type movement into a mouse movement.
  • the sender 11 parses the event type scaling into mouse wheel zoom.
  • mouse wheel zooming the user may use the mouse wheel to zoom a photo on a Windows notebook.
  • the sender 11 parses the event type into mouse wheel scrolling.
  • the mouse wheel scrolling the user may browse the webpage on a Windows notebook and scroll the mouse wheel to scroll the webpage.
  • the screen sizes of the transmitting end 11 and the receiving end 10 may be inconsistent, and thus the coordinate spaces of the transmitting end 11 and the receiving end 10 may also be inconsistent.
  • the coordinate space of the transmitting end 11 may be 1366 ⁇ 768.
  • the coordinate space of the receiving end 10 may be 1920x1080.
  • the transmitting end 11 and the receiving end 10 of the present embodiment convert the received coordinates relative to the own screen coordinate space to a larger coordinate space ( For example, the coordinates of 65535x65535), so that the transmitting end 11 and the receiving end 10 do not need to know the screen size of the other party.
  • the coordinates of one touch position (100, 200) of the receiving end 10 are converted into coordinates relative to the space of 65535 ⁇ 65535 (100/1920).
  • *65535,200/1080*65535) (3414,12136)
  • the coordinates (71, 142) are the coordinates in the coordinate system of the transmitting end 11 itself.
  • step 103 the transmitting end performs a touch operation.
  • the transmitting end 11 responds to the parsing result of the touch event, ie, performs a touch operation.
  • the sending end 11 performs an operation of pressing the left mouse button and lifting the left mouse button, that is, performing a click operation. .
  • the sending end 11 performs a left mouse button press, and the mouse The left button is raised, the left mouse button is pressed, and the left mouse button is raised, that is, the double click operation is performed.
  • the sending end 11 performs an operation of right mouse button pressing and right mouse button lifting, that is, performing a right click operation.
  • the transmitting end 11 performs an operation of pressing the left mouse button, moving, and lifting the left mouse button, that is, Drag operation.
  • the transmitting end 11 performs an operation of zooming the mouse wheel.
  • the transmitting end 11 performs an operation of scrolling the mouse wheel.
  • the receiving end 10 of the wireless screen touch back transmission system of the embodiment receives a touch operation of the user, such as a click, a double click, a long press, a drag, a zoom, and/or a scroll, etc., and then generates according to a user's touch operation.
  • a touch operation of the user such as a click, a double click, a long press, a drag, a zoom, and/or a scroll, etc.
  • At least one touch event that is, converting the touch operation into a touch event, and then transmitting the touch event to the transmitting end 11 in turn, after receiving the touch event, the transmitting end 11 parses the touch event and performs a touch operation, that is, performs a click and double click , long press, drag, zoom, scroll, etc., to achieve touch backhaul of click, double click, long press, drag, zoom and scroll.
  • the wireless screen touch back transmission system of the embodiment can support the touch return of a richer operation event, and the user is more convenient to
  • FIG. 3 is a schematic structural diagram of a wireless screen touch back transmission system according to an embodiment of the present invention.
  • the wireless screen touch back transmission system of the embodiment includes a transmitting end 21 and a receiving end 20, and the wireless screen touch back in this embodiment.
  • the transmission system is different from the first embodiment in that the touch event generated by the receiving end 20 further includes a lateral offset value, a vertical offset value, and a number of fingers of the touch operation position; the transmitting end 21 is further configured to determine whether the touch event is scrolling.
  • the event 21 is further configured to determine a scroll rate according to the number of fingers when the touch event is a scroll event; perform a scroll operation according to the horizontal offset value, the vertical offset value, and the scroll rate.
  • the transmitting end 21 is further configured to: when the number of the fingers is two, the scrolling rate is determined as L; when the number of the fingers is three, the scrolling rate is determined to be nL; When the number is four, the scroll rate is determined as kL, where k and n are both positive numbers.
  • the workflow of the wireless screen touch back transmission system of this embodiment includes steps 200-205:
  • step 200 the receiving end receives the touch operation, and the step is substantially the same as the step 100 in the first embodiment. Please refer to the introduction of the first embodiment.
  • Step 201 The receiving end 20 generates a touch event according to the touch operation, and sends the touch event to the sending end 21.
  • This step is different from the step 101 of the first embodiment in that the touch event generated by the receiving end 20 further includes a lateral shift of the touch operation position.
  • the lateral offset value may be, for example, the number of pixels in which the finger is laterally offset in units of pixels; and the longitudinal offset value may be, for example, the number of pixels in which the finger is shifted in the longitudinal direction in units of pixels.
  • the step 202 is basically the same as the step 102 of the first embodiment. Please refer to the introduction of the first embodiment.
  • step 203A it is determined whether the touch event is a scroll event.
  • the sending end 21 determines whether the touch event is a scrolling event. In an embodiment of the present application, the sending end 21 can determine whether it is a rolling event by the event type of the touch event.
  • step 203 if the touch event is not a scrolling event, the sending end 21 responds to the parsing result of the touch event.
  • This step is basically the same as step 103. Please refer to the introduction of the first embodiment.
  • Step 204 If the touch event is a scroll event, determine a scroll rate.
  • the transmitting end 21 determines the scrolling rate according to the number of fingers.
  • the scrolling rate can be understood, for example, as the distance that the page needs to be scrolled every time the finger is offset by one pixel when the user slides the page displayed by the transmitting end 21 with the finger (ie, The number of pixels).
  • the transmitting end 21 determines the scrolling rate as L; when the number of the fingers is three, the transmitting end 21 determines the scrolling rate as nL, for example, 2L; when the number of fingers is four, the transmitting end 21 determines the scrolling rate as kL, for example, 3L, and so on, where n and k are both positive numbers. Therefore, the user can control the scrolling rate by switching the number of touched fingers, that is, the scrolling rate can be controlled by switching the number of fingers at will, and the user is more convenient to use and the experience is better.
  • Step 207 performing a scrolling operation according to the lateral offset value, the vertical offset value, and the scroll rate.
  • the transmitting end 21 performs a scrolling operation based on the lateral offset value, the vertical offset value, and the scroll rate.
  • the wireless screen touchback system of the present embodiment not only has the effect of the first embodiment, but also the touch event generated by the receiving end 20 includes the lateral offset value, the vertical offset value, and the number of fingers of the touch operation position, and the transmitting end 21 receives After the touch event, it is determined whether the touch event is a scroll event. If it is a scroll event, the sending end 21 determines the scroll rate according to the number of fingers touched by the user, and then performs a scroll operation according to the horizontal offset value, the vertical offset value, and the scroll rate.
  • the scrolling rate is also changed accordingly, so that the scrolling rate of the scrolling event can be dynamically controlled, that is, the user can control the scrolling rate by randomly switching the number of touched fingers, and the use of the scrolling rate is controlled. Convenient and better.
  • FIG. 5 is a schematic structural diagram of a wireless screen touch back transmission system according to the embodiment.
  • the wireless screen touch back transmission system of this embodiment includes a transmitting end 31 and a receiving end 30, which are different from the first embodiment:
  • the receiving end 30 is also arranged to add a timestamp to the touch event to have a timestamp in the touch event.
  • FIG. 6 is a flowchart of the operation of the wireless screen touch back transmission system of the embodiment.
  • the workflow of the wireless screen touch back transmission system of this embodiment includes steps 300-303, wherein steps 300 and 303 are implemented.
  • the steps 100 and 103 of the first example are basically the same. Please refer to the introduction of the first embodiment. Steps 301 and 302 will be described below. Steps 301 and 302 will not be repeated in the same manner as steps 101 and 102 of the first embodiment. The differences will be mainly described below.
  • the step 301 of the embodiment is different from the step 101 of the first embodiment in that the receiving end 30 adds a time stamp to the touch event after generating the touch event, so that the touch event includes the time information of the touch operation.
  • the step 302 of the embodiment is different from the step 102.
  • the sequence of the plurality of touch events is determined according to the timestamp information, and the sequence is received and the touch event is received. The order is compared. If the two sequences are found to be inconsistent, the order of the touch events determined according to the timestamp information shall prevail.
  • the order of the multiple touch events may be confusing due to the abnormality of the communication, etc., causing the transmitting end 31 to perform an erroneous touch operation after receiving the touch event. Correcting the order of the plurality of touch events according to the time stamp information prevents the transmitting end 31 from performing an erroneous touch operation.
  • the wireless screen touch back transmission system of the embodiment not only has the effect of the first embodiment, but also the receiving end 30 adds a time stamp to the touch event, and the touch event includes time information of the touch operation, so that the transmitting end 31 can according to the time stamp.
  • the information corrects the order of the plurality of touch events, and prevents the transmitting end 31 from performing an erroneous touch operation, which is more convenient and efficient to use.
  • the embodiment of the present application further provides a wireless screen receiving end, the receiving end is configured to receive a touch operation, and the receiving end is further configured to generate a touch event according to the touch operation, and send the touch event to the sending end.
  • the touch operation includes at least one of: clicking, double clicking, long pressing, dragging, zooming, scrolling.
  • the touch event includes an abscissa, an ordinate, and an event type of the touch operation location.
  • the receiving end is configured to: when the touch operation is dragging, generate a first touch event, a second touch event, and at least one third touch event, where the first touch event includes an abscissa of a touch operation start position, The ordinate and the first event type, the second touch event includes an abscissa, an ordinate, and a second event type of the end position of the touch operation, and the third touch event includes an abscissa of the touch position between the start position and the end position of the touch operation,
  • the ordinate and the third event type the first event type is a left button press, the third event type is a move, the second event type is a left button lift; the first touch event, the third touch event, and the second touch event Send to the sender in turn.
  • the receiving end is configured to set the event type of the generated touch event to zoom when the touch operation is zooming.
  • the receiving end is configured to set the event type of the generated touch event to scrolling when the touch operation is at least two finger sliding.
  • the touch event further includes a lateral offset value of the touch operation position, a longitudinal offset value, and a number of fingers.
  • the receiving end is configured to: add a timestamp to the touch event.
  • the embodiment of the present application further provides a wireless screen touchback method, including the steps of: receiving a touch operation; generating a touch event according to the touch operation; and transmitting the touch event to the sending end.
  • the touch operation includes at least one of: clicking, double clicking, long pressing, dragging, zooming, scrolling.
  • the touch event includes an abscissa, an ordinate, and an event type of the touch operation location.
  • the method further includes: when the touch operation is dragging, generating a first touch event, a second touch event, and at least one third touch event, where the first touch event includes an abscissa and an ordinate of a touch operation start position.
  • a first event type the second touch event includes an abscissa, an ordinate, and a second event type of the end position of the touch operation
  • the third touch event includes an abscissa and an ordinate of the touch position between the start position and the end position of the touch operation.
  • a third event type the first event type is a left button press, the third event type is a move, the second event type is a left button lift; the first touch event, the third touch event, and the second touch event are sequentially sent To the sender.
  • the step of generating a touch event according to the touch operation comprises: setting the event type of the generated touch event to zoom when the touch operation is zooming.
  • the step of generating a touch event according to the touch operation comprises: setting the event type of the generated touch event to scrolling when the touch operation is sliding for at least two fingers.
  • the touch event further includes a lateral offset value of the touch operation position, a longitudinal offset value, and a number of fingers.
  • the step of generating a touch event based on the touch operation includes adding a timestamp to the touch event.
  • unit or “module” in this specification refers to software and/or hardware that can be completed independently or in cooperation with other components to perform a specific function, such as an FPGA (Field-Programmable Gate Array). , IC (Integrated Circuit), etc.
  • FPGA Field-Programmable Gate Array
  • IC Integrated Circuit
  • the embodiment of the present application further provides a computer readable storage medium having stored thereon a computer program, the program being executed by the processor to implement the steps of any of the foregoing methods.
  • the computer readable storage medium may include, but is not limited to, any type of disk, including a floppy disk, an optical disk, a DVD, a CD-ROM, a micro drive, and a magneto-optical disk, a ROM, a RAM, an EPROM, an EEPROM, a DRAM, a VRAM, a flash memory device. , magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of medium or device suitable for storing instructions and/or data.
  • the embodiment of the present application further provides a computer device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the steps of any one of the foregoing methods when executing the program.
  • the processor is a control center of the computer system, and may be a processor of the physical machine or a processor of the virtual machine.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

A touch-back method and system for wireless screen mirroring. The touch-back system for wireless screen mirroring comprises a sending end and a receiving end, wherein the receiving end receives a touch operation (100); the receiving end creates a touch event on the basis of the touch operation and sends the touch event to the sending end (101); the sending end receives and analyzes the touch event to obtain the touch operation corresponding to the touch event (102); and the sending end performs the touch operation (103).

Description

无线传屏触摸回传方法及***Wireless screen touch return method and system
本申请要求在2018年4月4日提交中国专利局、申请号为201810298499.7的中国专利申请的优先权，该申请的全部内容通过引用结合在本申请中。The present application claims the priority of the Chinese Patent Application, filed on Apr. 4, s.
技术领域Technical field
本申请涉及交互智能平板领域，例如涉及一种无线传屏触摸回传方法及***。The present application relates to the field of interactive smart tablets, for example, to a wireless screen touch back method and system.
背景技术Background technique
无线传屏在会议、教育等场景下应用越来越广泛，无线传屏通常是指将发送端(例如Windows、Mac或Chrome笔记本)的屏幕通过无线的方式投屏至接收端(例如大尺寸的智能平板或交互平板)。在使用无线传屏的过程中，发明人发现现有技术中至少存在如下问题：现有的无线传屏方案要么不支持触摸回传，要么只支持单一的点击事件回传，而不支持更丰富的操作事件的触摸回传。Wireless screens are more and more widely used in conferences, education, etc. Wireless screens usually refer to the screen of the sender (such as Windows, Mac or Chrome notebook) being screened wirelessly to the receiving end (for example, large size). Smart tablet or interactive tablet). In the process of using wireless screen transmission, the inventor found that at least the following problems exist in the prior art: the existing wireless screen transmission scheme does not support touch back transmission, or only supports single click event back transmission, and does not support richer. The touchback of the action event.
发明内容Summary of the invention
为了解决目前无线传屏方案中不支持更丰富的操作事件触摸回传的问题，本申请实施例提供了一种无线传屏触摸回传方法及***，能够支持单击、双击、长按、拖动、缩放和滚动等更丰富的操作事件的触摸回传。In order to solve the problem that the current wireless transmission scheme does not support the richer operation event touchback, the embodiment of the present application provides a wireless screen touchback method and system, which can support click, double click, long press, and drag. Touchback of richer operational events such as motion, zoom, and scroll.
本申请实施例提供了一种无线传屏触摸回传***，包括发送端和接收端，所述接收端设置为接收触摸操作；所述接收端还设置为根据所述触摸 操作生成触摸事件，将所述触摸事件发送给所述发送端；所述发送端设置为接收并解析所述触摸事件，以获取所述触摸事件对应的所述触摸操作；所述发送端还设置为执行所述触摸操作。The embodiment of the present application provides a wireless screen touch back transmission system, including a transmitting end and a receiving end, the receiving end is configured to receive a touch operation, and the receiving end is further configured to generate a touch event according to the touch operation, and The sending event is sent to the sending end; the sending end is configured to receive and parse the touch event to obtain the touch operation corresponding to the touch event; the sending end is further configured to perform the touch operation .
其中，所述触摸操作包括以下至少之一：单击、双击、长按、拖动、缩放、滚动。The touch operation includes at least one of the following: clicking, double clicking, long pressing, dragging, zooming, scrolling.
其中，所述触摸事件包括触摸操作位置的横坐标、纵坐标及事件类型。The touch event includes an abscissa, an ordinate, and an event type of the touch operation position.
其中，所述接收端设置为：当所述触摸操作为拖动时，生成第一触摸事件、第二触摸事件和至少一个第三触摸事件，所述第一触摸事件包括所述触摸操作开始位置的横坐标、纵坐标及第一事件类型，所述第二触摸事件包括触摸操作结束位置的横坐标、纵坐标及第二事件类型，所述第三触摸事件包括所述触摸操作开始位置和结束位置之间的触摸位置的横坐标、纵坐标及第三事件类型，所述第一事件类型为左键按下，所述第三事件类型为移动，所述第二事件类型为左键抬起；所述接收端还设置为将所述第一触摸事件、第三触摸事件和第二触摸事件依次发送给所述发送端。The receiving end is configured to: when the touch operation is dragging, generate a first touch event, a second touch event, and at least one third touch event, where the first touch event includes the touch operation start position The abscissa, the ordinate, and the first event type, the second touch event includes an abscissa, an ordinate, and a second event type of the touch operation end position, the third touch event including the touch operation start position and end An abscissa, an ordinate, and a third event type of the touch position between the positions, the first event type is a left button press, the third event type is a move, and the second event type is a left button lift The receiving end is further configured to sequentially send the first touch event, the third touch event, and the second touch event to the sending end.
其中，所述发送端还设置为将所述左键按下解析为鼠标左键按下，将所述移动解析为鼠标移动，将所述左键抬起解析为鼠标左键抬起。The sending end is further configured to parse the left button into a left mouse button press, parse the movement into a mouse movement, and parse the left button into a left mouse button to raise.
其中，所述接收端还设置为：当所述触摸操作为缩放时，将生成的所述触摸事件的事件类型设为缩放。The receiving end is further configured to: when the touch operation is zooming, set the generated event type of the touch event to zoom.
其中，所述发送端设置为将所述缩放解析为鼠标滚轮缩放。The sending end is configured to parse the zoom into a mouse wheel zoom.
其中，所述接收端还设置为：当所述触摸操作为至少两个手指滑动时，将生成的所述触摸事件的事件类型设为滚动。The receiving end is further configured to: when the touch operation is at least two finger sliding, set the generated event type of the touch event as scrolling.
其中，所述发送端设置为将所述滚动解析为鼠标滚轮滚动。The sending end is configured to parse the scroll into mouse wheel scrolling.
其中，所述接收端生成的触摸事件还包括触摸操作位置的横向偏移值、纵向偏移值、所述手指的个数；所述发送端还设置为判断所述触摸事 件是否为滚动事件；所述发送端还设置为当所述触摸事件为滚动事件时，根据所述手指的个数确定滚动速率；根据所述横向偏移值、纵向偏移值及所述滚动速率执行滚动操作。The touch event generated by the receiving end further includes a lateral offset value of the touch operation position, a vertical offset value, and the number of the fingers; and the sending end is further configured to determine whether the touch event is a scroll event; The sending end is further configured to: when the touch event is a scrolling event, determine a scrolling rate according to the number of the fingers; perform a scrolling operation according to the horizontal offset value, the vertical offset value, and the scrolling rate.
其中，所述发送端还设置为：当所述手指的个数为两个时，将所述滚动速率确定为L；当所述手指的个数为三个时，将所述滚动速率确定为nL；当所述手指的个数为四个时，将所述滚动速率确定为kL，其中，k和n均为正数。The sending end is further configured to: when the number of the fingers is two, determine the scrolling rate as L; when the number of the fingers is three, determine the scrolling rate as nL; when the number of the fingers is four, the scroll rate is determined as kL, where k and n are both positive numbers.
其中，所述接收端还设置为向所述触摸事件中加入时间戳。The receiving end is further configured to add a timestamp to the touch event.
本申请实施例提供了一种无线传屏接收端，所述接收端设置为接收触摸操作；所述接收端还设置为根据所述触摸操作生成触摸事件，将所述触摸事件发送给发送端。The embodiment of the present application provides a wireless screen receiving end, the receiving end is configured to receive a touch operation, and the receiving end is further configured to generate a touch event according to the touch operation, and send the touch event to the sending end.
本申请实施例提供了一种无线传屏触摸回传方法，包括以下步骤：接收触摸操作；根据所述触摸操作生成触摸事件；将所述触摸事件发送给发送端。The embodiment of the present application provides a wireless screen touchback method, including the steps of: receiving a touch operation; generating a touch event according to the touch operation; and transmitting the touch event to the sending end.
其中，所述触摸操作包括以下至少之一：单击、双击、长按、拖动、缩放、滚动。The touch operation includes at least one of the following: clicking, double clicking, long pressing, dragging, zooming, scrolling.
其中，所述触摸事件包括触摸操作位置的横坐标、纵坐标及事件类型。The touch event includes an abscissa, an ordinate, and an event type of the touch operation position.
其中，还包括：当所述触摸操作为拖动时，生成第一触摸事件、第二触摸事件和至少一个第三触摸事件，所述第一触摸事件包括所述触摸操作开始位置的横坐标、纵坐标及第一事件类型，所述第二触摸事件包括触摸操作结束位置的横坐标、纵坐标及第二事件类型，所述第三触摸事件包括所述触摸操作开始位置和结束位置之间的触摸位置的横坐标、纵坐标及第三事件类型，所述第一事件类型为左键按下，所述第三事件类型为移动， 所述第二事件类型为左键抬起；将所述第一触摸事件、第三触摸事件和第二触摸事件依次发送给所述发送端。The method further includes: when the touch operation is dragging, generating a first touch event, a second touch event, and at least one third touch event, where the first touch event includes an abscissa of a start position of the touch operation, The ordinate and the first event type, the second touch event includes an abscissa, an ordinate, and a second event type of the end position of the touch operation, the third touch event including between the start position and the end position of the touch operation Touching the abscissa, the ordinate, and the third event type of the position, the first event type is a left button press, the third event type is a move, and the second event type is a left button lift; The first touch event, the third touch event, and the second touch event are sequentially sent to the transmitting end.
其中，所述步骤根据所述触摸操作生成触摸事件包括：当所述触摸操作为缩放时，将生成的所述触摸事件的事件类型设为缩放。The step of generating a touch event according to the touch operation includes: when the touch operation is zooming, setting the generated event type of the touch event to zoom.
其中，所述步骤根据所述触摸操作生成触摸事件包括：当所述触摸操作为至少两个手指滑动时，将生成的所述触摸事件的事件类型设为滚动。The step of generating a touch event according to the touch operation includes: when the touch operation is at least two finger slides, setting the generated event type of the touch event to scrolling.
其中，所述触摸事件还包括触摸操作位置的横向偏移值、纵向偏移值、所述手指的个数。The touch event further includes a lateral offset value of the touch operation position, a longitudinal offset value, and the number of the fingers.
其中，所述步骤根据所述触摸操作生成触摸事件包括向所述触摸事件中加入时间戳。The step of generating a touch event according to the touch operation includes adding a time stamp to the touch event.
本申请实施例提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述任一项所述方法的步骤。An embodiment of the present application provides a computer readable storage medium having stored thereon a computer program, the program being executed by a processor to implement the steps of any of the methods described above.
本申请实施例提供了一种计算机设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现上述任一项所述方法的步骤。An embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, where the processor executes the program to implement the method of any of the above step.
本申请实施例无线传屏触摸回传***具有如下有益效果：The wireless screen touch back transmission system of the embodiment of the present application has the following beneficial effects:
本申请实施例无线传屏触摸回传***中，接收端接收用户的触摸操作，该触摸操作例如为单击、双击、长按、拖动、缩放和滚动等，接收端根据用户的触摸操作生成触摸事件，将触摸事件发送给发送端，发送端对触摸事件进行解析以得到触摸操作，也就是说得到用户的操作是单击、双击、长按、拖动、缩放还是滚动等，确定用户的触摸操作后，发送端对该触摸操作进行响应，即执行该触摸操作，从而实现了单击、双击、长按、拖动、缩放和滚动等操作的触摸回传。本申请实施例无线传屏触摸回传***能够支持单击、双击、长按、拖动、缩放和滚动等更丰富的操作事件的 触摸回传，而且实现了用户多样性操作的触摸回传，用户使用更方便，体验更高。In the wireless screen touch back transmission system of the embodiment of the present application, the receiving end receives a touch operation of the user, such as a click, a double click, a long press, a drag, a zoom, a scroll, and the like, and the receiving end generates a touch operation according to the user's touch operation. Touching the event, sending the touch event to the sending end, and the sending end parsing the touch event to obtain a touch operation, that is, obtaining the user's operation by clicking, double-clicking, long-pressing, dragging, zooming, or scrolling, etc., determining the user's After the touch operation, the transmitting end responds to the touch operation, that is, performs the touch operation, thereby implementing touch returning of operations such as clicking, double-clicking, long-pressing, dragging, zooming, and scrolling. The wireless screen touch back transmission system of the embodiment of the present application can support touch return of richer operation events such as click, double click, long press, drag, zoom, and scroll, and realize touch return of the user's diverse operation. Users are more convenient to use and have a higher experience.
附图说明DRAWINGS
图1为本申请实施例一的无线传屏触摸回传***的结构示意图；1 is a schematic structural diagram of a wireless screen touch back transmission system according to Embodiment 1 of the present application;
图2为图1所示的无线传屏触摸回传***的工作流程图；2 is a flow chart of the operation of the wireless screen touch back transmission system shown in FIG. 1;
图3为本申请实施例二的无线传屏触摸回传***的结构示意图；3 is a schematic structural diagram of a wireless screen touch back transmission system according to Embodiment 2 of the present application;
图4为图3所示的无线传屏触摸回传***的工作流程图；4 is a working flow chart of the wireless screen touch back transmission system shown in FIG. 3;
图5为本申请实施例三的无线传屏触摸回传***的结构示意图；5 is a schematic structural diagram of a wireless screen touch back transmission system according to Embodiment 3 of the present application;
图6为图5所示的无线传屏触摸回传***的工作流程图。FIG. 6 is a flow chart showing the operation of the wireless screen touch back transmission system shown in FIG. 5.
具体实施方式detailed description
下面结合附图和实施例对本申请进行进一步的详细介绍。The present application will be further described in detail below with reference to the accompanying drawings and embodiments.
在下述介绍中，术语“第一”、“第二”仅为用于描述的目的，而不能理解为指示或暗示相对重要性，也不能理解为特指。下述介绍提供了本申请的多个实施例，不同实施例之间可以替换或者合并组合，因此本申请也可认为包含所记载的相同和/或不同实施例的所有可能组合。因而，如果一个实施例包含特征A、B、C，另一个实施例包含特征B、D，那么本申请也应视为包括含有A、B、C、D的一个或多个所有其他可能的组合的实施例，尽管该实施例可能并未在以下内容中有明确的文字记载。In the following description, the terms "first" and "second" are used for the purpose of description only, and are not to be construed as indicating or implying a relative importance or a specific meaning. The following description provides a plurality of embodiments of the present application, and various embodiments may be substituted or combined in combination, and thus the present application is also considered to include all possible combinations of the same and/or different embodiments described. Thus, if an embodiment includes features A, B, C and another embodiment includes features B, D, then the application should also be considered to include one or more of all other possible combinations containing A, B, C, D. The embodiment, although this embodiment may not be explicitly described in the following.
本申请实施例提供了一种无线传屏触摸回传***，包括发送端和接收端，发送端例如可以为手机、平板电脑、台式电脑、Windows、Mac或Chrome笔记本等设备，接收端例如可以为交互智能平板、交互平板、显示器或智能电视等设备。发送端与接收端连接，发送端与接收端例如通过套接字(Socket)、网线、蓝牙、Wi-Fi或紫峰协议(ZigBee)等方式连接。 发送端投屏至接收端，例如：发送端向接收端发送包含当前界面内容的数据，接收端接收该数据后进行展示，从而接收端显示的界面内容与发送端显示的当前界面内容相同。The embodiment of the present application provides a wireless screen touch back transmission system, including a transmitting end and a receiving end. The sending end may be, for example, a mobile phone, a tablet computer, a desktop computer, a Windows, a Mac, or a Chrome notebook. The receiving end may be, for example, Interactive smart tablets, interactive tablets, monitors, or smart TVs. The transmitting end is connected to the receiving end, and the transmitting end and the receiving end are connected by, for example, a socket (Socket), a network cable, a Bluetooth, a Wi-Fi, or a ZigBee protocol. The sending end screens to the receiving end. For example, the sending end sends data containing the content of the current interface to the receiving end, and the receiving end receives the data and displays it, so that the interface content displayed by the receiving end is the same as the current interface content displayed by the sending end.
本申请实施例的无线传屏触摸回传***包括发送端和接收端，接收端设置为接收触摸操作；接收端还设置为根据触摸操作生成触摸事件，将触摸事件发送给发送端；发送端设置为接收并解析触摸事件，以获取触摸事件对应的触摸操作；发送端还设置为执行触摸操作。The wireless screen touch back transmission system of the embodiment of the present application includes a transmitting end and a receiving end, and the receiving end is configured to receive a touch operation; the receiving end is further configured to generate a touch event according to the touch operation, and send the touch event to the sending end; the sending end sets To receive and parse the touch event, to obtain a touch operation corresponding to the touch event; the sending end is further configured to perform a touch operation.
本申请实施例无线传屏触摸回传***中，接收端接收用户的触摸操作，该触摸操作例如为单击、双击、长按、拖动、缩放和滚动等，接收端根据用户的触摸操作生成触摸事件，将触摸事件发送给发送端，发送端对触摸事件进行解析以得到触摸操作，也就是说得到用户的操作是单击、双击、长按、拖动、缩放还是滚动等，确定用户的触摸操作后，发送端对该触摸操作进行响应，即执行该触摸操作，从而实现了单击、双击、长按、拖动、缩放和滚动等操作的触摸回传。本申请实施例无线传屏触摸回传***能够支持单击、双击、长按、拖动、缩放和滚动等更丰富的操作事件的触摸回传，而且实现了用户多样性操作的触摸回传，用户使用更方便，体验更高。In the wireless screen touch back transmission system of the embodiment of the present application, the receiving end receives a touch operation of the user, such as a click, a double click, a long press, a drag, a zoom, a scroll, and the like, and the receiving end generates a touch operation according to the user's touch operation. Touching the event, sending the touch event to the sending end, and the sending end parsing the touch event to obtain a touch operation, that is, obtaining the user's operation by clicking, double-clicking, long-pressing, dragging, zooming, or scrolling, etc., determining the user's After the touch operation, the transmitting end responds to the touch operation, that is, performs the touch operation, thereby implementing touch returning of operations such as clicking, double-clicking, long-pressing, dragging, zooming, and scrolling. The wireless screen touch back transmission system of the embodiment of the present application can support touch return of richer operation events such as click, double click, long press, drag, zoom, and scroll, and realize touch return of the user's diverse operation. Users are more convenient to use and have a higher experience.
实施例一Embodiment 1
图1为本申请实施例一的无线传屏触摸回传***的结构示意图，如图1所示，本实施例的无线传屏触摸回传***包括发送端11和接收端10，接收端10例如可以为交互智能平板、交互平板、显示器或智能电视等设备。发送端20例如可以为手机、平板电脑、台式电脑、Windows、Mac或Chrome笔记本等设备，发送端11与接收端10例如通过套接字(Socket)、网线、蓝牙、Wi-Fi或紫峰协议(ZigBee)等方式连接。发送端11和接收端10已 组成无线传屏***，发送端11可以投屏至接收端10。在一个实施例中，发送端11为至少一个。1 is a schematic structural diagram of a wireless screen touch back transmission system according to Embodiment 1 of the present application. As shown in FIG. 1 , the wireless screen touch back transmission system of this embodiment includes a transmitting end 11 and a receiving end 10, for example, the receiving end 10 It can be an interactive smart tablet, interactive tablet, display or smart TV. The sending end 20 can be, for example, a mobile phone, a tablet computer, a desktop computer, a Windows, a Mac, or a Chrome notebook. The transmitting end 11 and the receiving end 10 are, for example, through a socket, a network cable, a Bluetooth, a Wi-Fi, or a Purple Peak protocol. ZigBee) and other ways to connect. The transmitting end 11 and the receiving end 10 have formed a wireless screen transmission system, and the transmitting end 11 can be projected to the receiving end 10. In one embodiment, the transmitting end 11 is at least one.
本实施例的接收端10设置为接收触摸操作；接收端10还设置为根据触摸操作生成触摸事件，将触摸事件发送给发送端11；发送端11设置为接收并解析触摸事件，以获取触摸事件对应的触摸操作；发送端11还设置为执行触摸操作。The receiving end 10 of the embodiment is configured to receive a touch operation; the receiving end 10 is further configured to generate a touch event according to the touch operation, and send the touch event to the sending end 11; the sending end 11 is configured to receive and parse the touch event to obtain the touch event Corresponding touch operation; the transmitting end 11 is also arranged to perform a touch operation.
图2为本实施例无线传屏触摸回传***的工作流程图，下面结合图2介绍本实施例无线传屏触摸回传***的工作流程。FIG. 2 is a flowchart of the operation of the wireless screen touch back transmission system according to the embodiment of the present invention. The working flow of the wireless screen touch back transmission system of this embodiment is described below with reference to FIG. 2 .
如图2所示，步骤100，接收端接收触摸操作。As shown in FIG. 2, in step 100, the receiving end receives a touch operation.
在一个实施例中，接收端10接收用户的触摸操作，用户的触摸操作可以是用户直接作用于接收端10显示界面(或屏幕)上的操作，也可以是用户使用控制器、鼠标和/或键盘对接收端10进行的操作，还可以是用户通过手势对接收端10进行的操作。在一个实施例中，用户的触摸操作例如包括以下至少之一：单击、双击、长按、拖动、缩放和滚动等。接收端10还能够识别用户的触摸操作，例如能够识别用户的触摸操作是单击、双击、长按、拖动、缩放还是滚动等操作。在一个实施例中，有一台或多台发送端11投屏至接收端10，接收端10能够以不同区域分别显示多台发送端11投屏的内容，用户的触摸操作是在某一个发送端11投屏的区域进行。In one embodiment, the receiving end 10 receives a touch operation of the user, and the touch operation of the user may be an operation of the user directly acting on the display interface (or screen) of the receiving end 10, or the user may use the controller, the mouse, and/or The operation performed by the keyboard on the receiving end 10 may also be an operation performed by the user on the receiving end 10 by gesture. In one embodiment, the user's touch operation includes, for example, at least one of: click, double click, long press, drag, zoom, scroll, and the like. The receiving end 10 is also capable of recognizing a user's touch operation, for example, an operation capable of recognizing whether the user's touch operation is a click, a double tap, a long press, a drag, a zoom, or a scroll. In one embodiment, one or more transmitting ends 11 are projected to the receiving end 10. The receiving end 10 can display the content of the plurality of transmitting ends 11 in different areas, and the user's touch operation is at a certain transmitting end. 11 screened areas are carried out.
步骤101，接收端根据触摸操作生成触摸事件，将触摸事件发送给发送端。Step 101: The receiving end generates a touch event according to the touch operation, and sends the touch event to the sending end.
在一个实施例中，接收端10根据用户的触摸操作生成至少一个触摸事件，将触摸事件依次发送给发送端11。触摸事件例如包括触摸操作位置的横坐标、纵坐标及事件类型。本步骤中接收端10将用户的触摸操作转换为触摸事件，通过触摸操作位置的横坐标、纵坐标及事件类型可以记录在接收端10屏幕的哪个位置执行了何种操作。In one embodiment, the receiving end 10 generates at least one touch event according to a touch operation of the user, and sequentially transmits the touch event to the transmitting end 11. Touch events include, for example, the abscissa, ordinate, and event type of the touch operation location. In this step, the receiving end 10 converts the user's touch operation into a touch event, and by the horizontal coordinate, the ordinate, and the event type of the touch operation position, it is possible to record at which position on the screen of the receiving end 10 the operation is performed.
在本申请的一个实施例中，当用户的触摸操作为单击时，接收端10生成第一触摸事件和第二触摸事件，第一触摸事件包括触摸操作位置即用户单击位置的横坐标、纵坐标及第一事件类型，第二触摸事件包括触摸操作位置即用户单击位置的横坐标、纵坐标及第二事件类型，其中，第一事件类型例如可以为左键按下，第二事件类型例如可以为左键抬起，也就是说，第一触摸事件和第二触摸事件按照顺序组合在一起就记录了用户的单击操作。例如当用户在坐标为(246,1346)的位置进行点击的触摸操作时，接收端10生成的第一触摸事件为(246,1346，左键按下)，生成的第二触摸事件为(246,1346，左键抬起)。然后接收端10将第一触摸事件和第二触摸事件依次发送给发送端11，以便发送端11能够正确响应触摸事件。In an embodiment of the present application, when the touch operation of the user is a click, the receiving end 10 generates a first touch event and a second touch event, where the first touch event includes a touch operation position, that is, an abscissa of the user click position, The ordinate and the first event type, the second touch event includes a touch operation position, that is, an abscissa, an ordinate, and a second event type of the user click position, wherein the first event type may be, for example, a left button press, and a second event The type can be, for example, a left button lift, that is, the first touch event and the second touch event are combined in order to record the user's click operation. For example, when the user performs a touch operation of clicking at a position of coordinates (246, 1346), the first touch event generated by the receiving end 10 is (246, 1346, left key pressed), and the generated second touch event is (246). , 1346, left button lifted). The receiving end 10 then sequentially transmits the first touch event and the second touch event to the transmitting end 11 so that the transmitting end 11 can correctly respond to the touch event.
在本申请的另一个实施例中，当用户的触摸操作为双击时，接收端10生成第一触摸事件、第二触摸事件、第三触摸事件和第四触摸事件，第一触摸事件、第二触摸事件、第三触摸事件和第四触摸事件均包括触摸操作位置即双击位置的横坐标、纵坐标，第一触摸事件还包括第一事件类型，第一事件类型例如可以为左键按下；第二触摸事件还包括第二事件类型，第二事件类型例如可以为左键抬起；第三触摸事件还包括第三事件类型，第三事件类型例如可以为左键按下；第四触摸事件还包括第***类型，第***类型例如可以为左键抬起，也就是说，第一触摸事件、第二触摸事件、第三触摸事件和第四触摸事件按照顺序组合在一起就记录了用户的双击操作。然后接收端10将第一触摸事件、第二触摸事件、第三触摸事件和第四触摸事件依次发送给发送端11，以便发送端11能够正确响应触摸事件。In another embodiment of the present application, when the touch operation of the user is a double tap, the receiving end 10 generates a first touch event, a second touch event, a third touch event, and a fourth touch event, the first touch event, the second The touch event, the third touch event, and the fourth touch event each include a touch operation position, that is, an abscissa and an ordinate of the double-click position, and the first touch event further includes a first event type, and the first event type may be, for example, a left button press; The second touch event further includes a second event type, the second event type may be, for example, a left button lift; the third touch event further includes a third event type, and the third event type may be, for example, a left button press; the fourth touch event A fourth event type is further included, and the fourth event type may be, for example, a left button lift, that is, the first touch event, the second touch event, the third touch event, and the fourth touch event are recorded in order. User's double click operation. The receiving end 10 then sequentially transmits the first touch event, the second touch event, the third touch event and the fourth touch event to the transmitting end 11 so that the transmitting end 11 can correctly respond to the touch event.
在本申请的另一个实施例中，当用户的触摸操作为长按时，接收端10生成触摸事件，该触摸事件包括用户长按位置的横坐标、纵坐标及事件类 型，其中，事件类型例如可以为长按。然后接收端10将触摸事件发送给发送端11。In another embodiment of the present application, when the touch operation of the user is a long press, the receiving end 10 generates a touch event, where the touch event includes an abscissa, an ordinate, and an event type of the user's long press position, wherein the event type may be, for example, For long press. The receiving end 10 then transmits a touch event to the transmitting end 11.
在本申请的另一个实施例中，当用户的触摸操作为拖动时，这里拖动例如可以理解为选中一个目标(例如文件夹)然后将该目标移动至目的位置，接收端10生成第一触摸事件、第二触摸事件和至少一个第三触摸事件。其中，第一触摸事件包括触摸操作开始位置即选中目标的位置的横坐标、纵坐标及第一事件类型，第二触摸事件包括触摸操作结束位置即目的位置的横坐标、纵坐标及第二事件类型，第三触摸事件包括触摸操作开始位置和结束位置之间的触摸位置即移动过程中的位置的横坐标、纵坐标及第三事件类型，第一事件类型例如可以为左键按下，第三事件类型例如可以为移动，第二事件类型例如可以为左键抬起。其中，第三触摸事件可以为一个或多个，也就是说，可以选取移动过程中的一个或多个位置以生成第三触摸事件。第一触摸事件、第三触摸事件和第二触摸事件按照顺序组合在一起就记录了用户的拖动操作。然后，接收端10将第一触摸事件、第三触摸事件和第二触摸事件依次发送给发送端11，以便发送端11能够正确响应触摸事件。以下以一个例子介绍接收端10生成的触摸事件，当用户的触摸操作为拖动时，接收端10生成的第一触摸事件为(246,1346，左键按下)，生成两个第三触摸事件，分别为(248,1349，移动)、(258,1496，移动)，生成的第二触摸事件为(260,1500，左键抬起)，其中，(246,1346)为拖动开始位置的坐标，(248,1349)和(258,1496)为拖动过程中两个位置的坐标，(260,1500)为拖动结束位置(即目的位置)的坐标。In another embodiment of the present application, when the user's touch operation is dragging, the drag here can be understood as, for example, selecting a target (eg, a folder) and then moving the target to the destination, and the receiving end 10 generates the first A touch event, a second touch event, and at least one third touch event. The first touch event includes an abscissa, an ordinate, and a first event type of a touch operation start position, that is, a position of the selected target, and the second touch event includes an end position of the touch operation, that is, an abscissa, an ordinate, and a second event of the target position. The third touch event includes a touch position between the touch operation start position and the end position, that is, an abscissa, an ordinate, and a third event type of the position during the movement, and the first event type may be, for example, a left button press, The three event types can be, for example, a move, and the second event type can be, for example, a left button lift. The third touch event may be one or more, that is, one or more locations in the moving process may be selected to generate a third touch event. The first touch event, the third touch event, and the second touch event are combined in order to record the user's drag operation. Then, the receiving end 10 sequentially transmits the first touch event, the third touch event, and the second touch event to the transmitting end 11 so that the transmitting end 11 can correctly respond to the touch event. The touch event generated by the receiving end 10 is introduced as an example. When the touch operation of the user is dragging, the first touch event generated by the receiving end 10 is (246, 1346, left key pressed), and two third touches are generated. The events are (248, 1349, move), (258, 1496, move), and the generated second touch event is (260, 1500, left button lift), where (246, 1346) is the drag start position. The coordinates, (248, 1349) and (258, 1496) are the coordinates of the two positions during the dragging process, and (260, 1500) are the coordinates of the drag end position (ie the destination position).
在本申请的另一个实施例中，当用户的触摸操作为缩放时，这里用户的触摸操作例如可以是两个手指向中间捏合或向外分离，接收端10生成多个触摸事件，触摸操作位置的横坐标、纵坐标例如可以为用户手指经过位 置的坐标，事件类型例如可以为缩放。然后，接收端10将该多个触摸事件依次发送给发送端11。In another embodiment of the present application, when the touch operation of the user is zooming, the touch operation of the user here may be, for example, two fingers being pinched or separated outward, and the receiving end 10 generates a plurality of touch events, and the touch operation position is The abscissa and the ordinate may be, for example, the coordinates of the position of the user's finger, and the event type may be, for example, a zoom. Then, the receiving end 10 sequentially transmits the plurality of touch events to the transmitting end 11.
在本申请的另一个实施例中，当用户的触摸操作为滑动时，这里用户的触摸操作例如可以是两个手指滑动、三个手指滑动、四个手指滑动或五个手指滑动等，接收端10生成多个触摸事件，触摸操作位置的横坐标、纵坐标例如可以为用户手指滑动经过位置的坐标，事件类型例如可以为滚动。然后接收端10将该多个触摸事件依次发送给发送端11。In another embodiment of the present application, when the touch operation of the user is sliding, the touch operation of the user here may be, for example, two finger sliding, three finger sliding, four finger sliding or five finger sliding, etc., receiving end 10 generates a plurality of touch events, and the abscissa and the ordinate of the touch operation position may be, for example, coordinates of the position where the user's finger slides, and the event type may be, for example, scrolling. The receiving end 10 then transmits the plurality of touch events to the transmitting end 11 in sequence.
步骤102，发送端接收并解析触摸事件，以获取触摸事件对应的触摸操作。Step 102: The sending end receives and parses the touch event to obtain a touch operation corresponding to the touch event.
在一个实施例中，发送端11接收并解析触摸事件，以获取触摸事件对应的触摸操作，通过对触摸事件的解析可以得到触摸操作的位置横坐标、纵坐标及事件类型，通过事件类型可以确定用户的触摸操作是单击、双击、长按、拖动、缩放还是滚动等操作。In one embodiment, the transmitting end 11 receives and parses the touch event to obtain a touch operation corresponding to the touch event, and the position of the touch operation can be obtained by analyzing the touch event, and the position, the ordinate, and the event type can be determined by the event type. The user's touch operation is a click, double click, long press, drag, zoom, or scroll.
在本申请的一个实施例中，发送端11将触摸事件的事件类型左键按下解析为鼠标左键按下，将事件类型左键抬起解析为鼠标左键抬起。In one embodiment of the present application, the transmitting end 11 parses the event type of the touch event into a left mouse button press, and raises the event type left button to the left mouse button.
在本申请的另一个实施例中，发送端11将事件类型长按解析为鼠标右键按下、鼠标右键抬起。In another embodiment of the present application, the transmitting end 11 parses the event type long press into a right mouse button press and a right mouse button lift.
在本申请的另一个实施例中，发送端11将事件类型移动解析为鼠标移动。In another embodiment of the present application, the sender 11 parses the event type movement into a mouse movement.
在本申请的另一个实施例中，发送端11将事件类型缩放解析为鼠标滚轮缩放，作为鼠标滚轮缩放的一个例子可以是用户在Windows笔记本上使用鼠标滚轮缩放一张照片。在本申请的另一个实施例中，发送端11将事件类型滚动解析为鼠标滚轮滚动，作为鼠标滚轮滚动的一个例子可以是用户在Windows笔记本上浏览网页，滚动鼠标滚轮以使网页滚动。In another embodiment of the present application, the sender 11 parses the event type scaling into mouse wheel zoom. As an example of mouse wheel zooming, the user may use the mouse wheel to zoom a photo on a Windows notebook. In another embodiment of the present application, the sender 11 parses the event type into mouse wheel scrolling. As an example of the mouse wheel scrolling, the user may browse the webpage on a Windows notebook and scroll the mouse wheel to scroll the webpage.
在本申请的另一个实施例中，发送端11和接收端10的屏幕尺寸可能不一致，因而发送端11和接收端10的坐标空间也可能不一致，例如发送端11的坐标空间可能为1366x768，而接收端10的坐标空间可能为1920x1080。为了屏蔽发送端11和接收端10之间的坐标空间的差异，本实施例发送端11和接收端10对收到的相对于自身屏幕坐标空间的坐标转换为相对于一个较大的坐标空间(例如65535x65535)的坐标，这样发送端11和接收端10就可以不用知道对方的屏幕尺寸大小。例如：当发送端11的分辨率为1366x768,接收端10的屏幕分辨率为1920x1080时，将接收端10的一个触摸位置坐标(100，200)转换成相对于65535x65535空间的坐标就是(100/1920*65535,200/1080*65535)＝(3414，12136)，发送端11收到(3414，12136)的坐标后再转换为自身坐标系的坐标为(3414*1366/65535，12136*768/65535)＝(71,142)，该坐标(71,142)即为发送端11自身坐标系中的坐标。In another embodiment of the present application, the screen sizes of the transmitting end 11 and the receiving end 10 may be inconsistent, and thus the coordinate spaces of the transmitting end 11 and the receiving end 10 may also be inconsistent. For example, the coordinate space of the transmitting end 11 may be 1366×768. The coordinate space of the receiving end 10 may be 1920x1080. In order to shield the difference in the coordinate space between the transmitting end 11 and the receiving end 10, the transmitting end 11 and the receiving end 10 of the present embodiment convert the received coordinates relative to the own screen coordinate space to a larger coordinate space ( For example, the coordinates of 65535x65535), so that the transmitting end 11 and the receiving end 10 do not need to know the screen size of the other party. For example, when the resolution of the transmitting end 11 is 1366×768 and the screen resolution of the receiving end 10 is 1920×1080, the coordinates of one touch position (100, 200) of the receiving end 10 are converted into coordinates relative to the space of 65535×65535 (100/1920). *65535,200/1080*65535)=(3414,12136), the coordinates of the (4314,12136) received by the transmitting end 11 and then converted to the coordinates of its own coordinate system are (3414*1366/65535, 12136*768/65535) ) = (71, 142), the coordinates (71, 142) are the coordinates in the coordinate system of the transmitting end 11 itself.
步骤103，发送端执行触摸操作。In step 103, the transmitting end performs a touch operation.
在一个实施例中，发送端11对触摸事件的解析结果进行响应，即执行触摸操作。In one embodiment, the transmitting end 11 responds to the parsing result of the touch event, ie, performs a touch operation.
在本申请的一个实施例中，如果解析结果为鼠标左键按下、鼠标左键抬起，则发送端11执行鼠标左键按下、鼠标左键抬起的操作，即执行单击的操作。In an embodiment of the present application, if the analysis result is that the left mouse button is pressed and the left mouse button is raised, the sending end 11 performs an operation of pressing the left mouse button and lifting the left mouse button, that is, performing a click operation. .
在本申请的另一个实施例中，如果解析结果为鼠标左键按下、鼠标左键抬起、鼠标左键按下和鼠标左键抬起，则发送端11执行鼠标左键按下、鼠标左键抬起、鼠标左键按下和鼠标左键抬起的操作，即执行双击的操作。In another embodiment of the present application, if the analysis result is that the left mouse button is pressed, the left mouse button is raised, the left mouse button is pressed, and the left mouse button is raised, the sending end 11 performs a left mouse button press, and the mouse The left button is raised, the left mouse button is pressed, and the left mouse button is raised, that is, the double click operation is performed.
在本申请的另一个实施例中，如果解析结果为鼠标右键按下、鼠标右键抬起，则发送端11执行鼠标右键按下、鼠标右键抬起的操作，即执行右击的操作。In another embodiment of the present application, if the parsing result is that the right mouse button is pressed and the right mouse button is raised, the sending end 11 performs an operation of right mouse button pressing and right mouse button lifting, that is, performing a right click operation.
在本申请的另一个实施例中，如果解析结果为鼠标左键按下、移动和鼠标左键抬起，则发送端11执行鼠标左键按下、移动和鼠标左键抬起的操作，即拖动的操作。In another embodiment of the present application, if the analysis result is that the left mouse button is pressed, moved, and the left mouse button is raised, the transmitting end 11 performs an operation of pressing the left mouse button, moving, and lifting the left mouse button, that is, Drag operation.
在本申请的另一个实施例中，如果解析结果为鼠标滚轮缩放，则发送端11执行鼠标滚轮缩放的操作。In another embodiment of the present application, if the parsing result is mouse wheel zoom, the transmitting end 11 performs an operation of zooming the mouse wheel.
在本申请的另一个实施例中，如果解析结果为鼠标滚轮滚动，则发送端11执行鼠标滚轮滚动的操作。In another embodiment of the present application, if the parsing result is a mouse wheel scrolling, the transmitting end 11 performs an operation of scrolling the mouse wheel.
本实施例无线传屏触摸回传***的接收端10接收用户的触摸操作，该触摸操作例如为单击、双击、长按、拖动、缩放和/或滚动等，然后根据用户的触摸操作生成至少一个触摸事件，也就是将触摸操作转换为触摸事件，再将触摸事件依次发送给发送端11，发送端11接收到触摸事件后，解析触摸事件并执行触摸操作，也就是执行单击、双击、长按、拖动、缩放、滚动等操作，从而实现了单击、双击、长按、拖动、缩放和滚动等操作的触摸回传。本实施例无线传屏触摸回传***能够支持更丰富的操作事件的触摸回传，用户使用更方便，体验更高。The receiving end 10 of the wireless screen touch back transmission system of the embodiment receives a touch operation of the user, such as a click, a double click, a long press, a drag, a zoom, and/or a scroll, etc., and then generates according to a user's touch operation. At least one touch event, that is, converting the touch operation into a touch event, and then transmitting the touch event to the transmitting end 11 in turn, after receiving the touch event, the transmitting end 11 parses the touch event and performs a touch operation, that is, performs a click and double click , long press, drag, zoom, scroll, etc., to achieve touch backhaul of click, double click, long press, drag, zoom and scroll. The wireless screen touch back transmission system of the embodiment can support the touch return of a richer operation event, and the user is more convenient to use and has a higher experience.
实施例二Embodiment 2
图3为本实施例无线传屏触摸回传***的结构示意图，如图3所示，本实施例无线传屏触摸回传***包括发送端21和接收端20，本实施例无线传屏触摸回传***与实施例一不同的是：接收端20生成的触摸事件还包括触摸操作位置的横向偏移值、纵向偏移值、手指的个数；发送端21还设置为判断触摸事件是否为滚动事件；发送端21还设置为当触摸事件为滚动事 件时，根据手指的个数确定滚动速率；根据横向偏移值、纵向偏移值及滚动速率执行滚动操作。在一实施例中，发送端21还设置为：当手指的个数为两个时，将滚动速率确定为L；当手指的个数为三个时，将滚动速率确定为nL；当手指的个数为四个时，将滚动速率确定为kL，其中，k和n均为正数。本实施例与实施例一的相关之处请参见实施例一的介绍。FIG. 3 is a schematic structural diagram of a wireless screen touch back transmission system according to an embodiment of the present invention. As shown in FIG. 3, the wireless screen touch back transmission system of the embodiment includes a transmitting end 21 and a receiving end 20, and the wireless screen touch back in this embodiment. The transmission system is different from the first embodiment in that the touch event generated by the receiving end 20 further includes a lateral offset value, a vertical offset value, and a number of fingers of the touch operation position; the transmitting end 21 is further configured to determine whether the touch event is scrolling. The event 21 is further configured to determine a scroll rate according to the number of fingers when the touch event is a scroll event; perform a scroll operation according to the horizontal offset value, the vertical offset value, and the scroll rate. In an embodiment, the transmitting end 21 is further configured to: when the number of the fingers is two, the scrolling rate is determined as L; when the number of the fingers is three, the scrolling rate is determined to be nL; When the number is four, the scroll rate is determined as kL, where k and n are both positive numbers. For the related parts of this embodiment and the first embodiment, refer to the introduction of the first embodiment.
图4为本实施例无线传屏触摸回传***的工作流程图，如图4所示，本实施例无线传屏触摸回传***的工作流程包括步骤200-205：4 is a working flow chart of the wireless screen touch back transmission system of the embodiment. As shown in FIG. 4, the workflow of the wireless screen touch back transmission system of this embodiment includes steps 200-205:
步骤200，接收端接收触摸操作，该步骤与实施例一步骤100基本相同，请参见实施例一的介绍。In step 200, the receiving end receives the touch operation, and the step is substantially the same as the step 100 in the first embodiment. Please refer to the introduction of the first embodiment.
步骤201，接收端20根据触摸操作生成触摸事件，将触摸事件发送给发送端21，本步骤与实施例一步骤101不同的是：接收端20生成的触摸事件还包括触摸操作位置的横向偏移值、纵向偏移值、手指的个数，这里手指的个数是指用户在接收端20执行滑动操作时所使用的手指个数，例如两个、三个或更多个。其中，横向偏移值例如可以为以像素为单位，手指在横向偏移的像素数量；纵向偏移值例如可以为以像素为单位，手指在纵向偏移的像素数量。本步骤与实施例一步骤101的相关之处请参见实施例一的介绍。Step 201: The receiving end 20 generates a touch event according to the touch operation, and sends the touch event to the sending end 21. This step is different from the step 101 of the first embodiment in that the touch event generated by the receiving end 20 further includes a lateral shift of the touch operation position. The value, the vertical offset value, and the number of fingers, where the number of fingers refers to the number of fingers used by the user at the receiving end 20 to perform a sliding operation, for example, two, three or more. The lateral offset value may be, for example, the number of pixels in which the finger is laterally offset in units of pixels; and the longitudinal offset value may be, for example, the number of pixels in which the finger is shifted in the longitudinal direction in units of pixels. Refer to the introduction of the first embodiment for the correlation between this step and the step 101 of the first embodiment.
步骤202与实施例一步骤102基本相同，请参见实施例一的介绍。The step 202 is basically the same as the step 102 of the first embodiment. Please refer to the introduction of the first embodiment.
步骤203A，判断触摸事件是否为滚动事件。In step 203A, it is determined whether the touch event is a scroll event.
本步骤中，发送端21判断触摸事件是否为滚动事件，在本申请的一个实施例中，发送端21可以通过触摸事件的事件类型判断是否为滚动事件。In this step, the sending end 21 determines whether the touch event is a scrolling event. In an embodiment of the present application, the sending end 21 can determine whether it is a rolling event by the event type of the touch event.
步骤203，如果触摸事件不是滚动事件，则发送端21对触摸事件的解析结果进行响应，本步骤与步骤103基本相同，请参见实施例一的介绍。In step 203, if the touch event is not a scrolling event, the sending end 21 responds to the parsing result of the touch event. This step is basically the same as step 103. Please refer to the introduction of the first embodiment.
步骤204，如果触摸事件为滚动事件，则确定滚动速率。Step 204: If the touch event is a scroll event, determine a scroll rate.
在一个实施例中，发送端21根据手指个数确定滚动速率，滚动速率例如可以理解为当用户使用手指滑动发送端21显示的页面时，手指每偏移一个像素，页面需要滚动的距离(即像素个数)。在本申请的一个实施例中，当手指的个数为两个时，发送端21将滚动速率确定为L；当手指的个数为三个时，发送端21将滚动速率确定为nL，例如2L；当手指的个数为四个时，发送端21将滚动速率确定为kL，例如3L，以此类推，其中，n和k均为正数。从而用户可以通过切换触摸手指的个数来控制滚动速率，即随意切换手指个数就能够控制滚动速率，用户使用更方便，体验更好。In one embodiment, the transmitting end 21 determines the scrolling rate according to the number of fingers. The scrolling rate can be understood, for example, as the distance that the page needs to be scrolled every time the finger is offset by one pixel when the user slides the page displayed by the transmitting end 21 with the finger (ie, The number of pixels). In an embodiment of the present application, when the number of the fingers is two, the transmitting end 21 determines the scrolling rate as L; when the number of the fingers is three, the transmitting end 21 determines the scrolling rate as nL, for example, 2L; when the number of fingers is four, the transmitting end 21 determines the scrolling rate as kL, for example, 3L, and so on, where n and k are both positive numbers. Therefore, the user can control the scrolling rate by switching the number of touched fingers, that is, the scrolling rate can be controlled by switching the number of fingers at will, and the user is more convenient to use and the experience is better.
步骤207，根据横向偏移值、纵向偏移值和滚动速率执行滚动操作。Step 207, performing a scrolling operation according to the lateral offset value, the vertical offset value, and the scroll rate.
在本步骤中，发送端21根据横向偏移值、纵向偏移值和滚动速率执行滚动操作。In this step, the transmitting end 21 performs a scrolling operation based on the lateral offset value, the vertical offset value, and the scroll rate.
本实施例无线传屏触摸回传***不仅具有实施例一的效果，而且接收端20生成的触摸事件包括触摸操作位置的横向偏移值、纵向偏移值、手指的个数，发送端21接收到触摸事件后判断触摸事件是否为滚动事件，如果是滚动事件，则发送端21根据用户触摸手指的个数确定滚动速率，再根据横向偏移值、纵向偏移值和滚动速率执行滚动操作，也就是说，本实施例中用户触摸手指个数改变后，滚动速率亦相应改变，从而可以动态控制滚动事件的滚动速率，即用户可以通过随意切换触摸手指的个数来控制滚动速率，使用更方便，体验更好。The wireless screen touchback system of the present embodiment not only has the effect of the first embodiment, but also the touch event generated by the receiving end 20 includes the lateral offset value, the vertical offset value, and the number of fingers of the touch operation position, and the transmitting end 21 receives After the touch event, it is determined whether the touch event is a scroll event. If it is a scroll event, the sending end 21 determines the scroll rate according to the number of fingers touched by the user, and then performs a scroll operation according to the horizontal offset value, the vertical offset value, and the scroll rate. That is to say, in the embodiment, after the number of touched by the user is changed, the scrolling rate is also changed accordingly, so that the scrolling rate of the scrolling event can be dynamically controlled, that is, the user can control the scrolling rate by randomly switching the number of touched fingers, and the use of the scrolling rate is controlled. Convenient and better.
实施例三Embodiment 3
图5为本实施例无线传屏触摸回传***的结构示意图，如图5所示，本实施例无线传屏触摸回传***包括发送端31和接收端30，与实施例一不同的是：接收端30还设置为向触摸事件中加入时间戳，以使触摸事件中具有时间戳。FIG. 5 is a schematic structural diagram of a wireless screen touch back transmission system according to the embodiment. As shown in FIG. 5, the wireless screen touch back transmission system of this embodiment includes a transmitting end 31 and a receiving end 30, which are different from the first embodiment: The receiving end 30 is also arranged to add a timestamp to the touch event to have a timestamp in the touch event.
图6为本实施例无线传屏触摸回传***的工作流程图，如图6所示，本实施例无线传屏触摸回传***的工作流程包括步骤300-303，其中步骤300、303与实施例一的步骤100、103基本相同，请参见实施例一的介绍。下面介绍步骤301和302，步骤301和302与实施例一步骤101和102相同的部分就不再重复介绍，下面重点介绍不同点。本实施例的步骤301与实施例一的步骤101不同的是：接收端30在生成触摸事件后向触摸事件中加入时间戳，这样触摸事件就包括了触摸操作的时间信息。本实施例的步骤302与步骤102不同的是：发送端20接收触摸事件后，当有多个触摸事件时，根据时间戳信息确定多个触摸事件的先后顺序，将该顺序与接收到触摸事件的顺序进行比较，如果发现两个顺序不一致，以根据时间戳信息确定的触摸事件顺序为准。因为在接收端30将触摸事件发送给发送端31的过程中，由于通信异常等原因多个触摸事件的顺序可能会发生混乱，导致发送端31接收触摸事件后执行错误的触摸操作，本实施例根据时间戳信息对多个触摸事件的顺序进行校正，避免了发送端31执行错误的触摸操作。FIG. 6 is a flowchart of the operation of the wireless screen touch back transmission system of the embodiment. As shown in FIG. 6 , the workflow of the wireless screen touch back transmission system of this embodiment includes steps 300-303, wherein steps 300 and 303 are implemented. The steps 100 and 103 of the first example are basically the same. Please refer to the introduction of the first embodiment. Steps 301 and 302 will be described below. Steps 301 and 302 will not be repeated in the same manner as steps 101 and 102 of the first embodiment. The differences will be mainly described below. The step 301 of the embodiment is different from the step 101 of the first embodiment in that the receiving end 30 adds a time stamp to the touch event after generating the touch event, so that the touch event includes the time information of the touch operation. The step 302 of the embodiment is different from the step 102. After receiving the touch event, when the sending end 20 has multiple touch events, the sequence of the plurality of touch events is determined according to the timestamp information, and the sequence is received and the touch event is received. The order is compared. If the two sequences are found to be inconsistent, the order of the touch events determined according to the timestamp information shall prevail. In the process of transmitting the touch event to the transmitting end 31 at the receiving end 30, the order of the multiple touch events may be confusing due to the abnormality of the communication, etc., causing the transmitting end 31 to perform an erroneous touch operation after receiving the touch event. Correcting the order of the plurality of touch events according to the time stamp information prevents the transmitting end 31 from performing an erroneous touch operation.
本实施例无线传屏触摸回传***不仅具有实施例一的效果，而且接收端30向触摸事件中加入时间戳，触摸事件就包括了触摸操作的时间信息，这样发送端31就能够根据时间戳信息对多个触摸事件的顺序进行校正，避免了发送端31执行错误的触摸操作，使用更便捷、高效。The wireless screen touch back transmission system of the embodiment not only has the effect of the first embodiment, but also the receiving end 30 adds a time stamp to the touch event, and the touch event includes time information of the touch operation, so that the transmitting end 31 can according to the time stamp. The information corrects the order of the plurality of touch events, and prevents the transmitting end 31 from performing an erroneous touch operation, which is more convenient and efficient to use.
本申请实施例还提供了一种无线传屏接收端，该接收端设置为接收触摸操作；接收端还设置为根据触摸操作生成触摸事件，将触摸事件发送给发送端。The embodiment of the present application further provides a wireless screen receiving end, the receiving end is configured to receive a touch operation, and the receiving end is further configured to generate a touch event according to the touch operation, and send the touch event to the sending end.
在一实施例中，触摸操作包括以下至少之一：单击、双击、长按、拖动、缩放、滚动。In an embodiment, the touch operation includes at least one of: clicking, double clicking, long pressing, dragging, zooming, scrolling.
在一实施例中，触摸事件包括触摸操作位置的横坐标、纵坐标及事件类型。In an embodiment, the touch event includes an abscissa, an ordinate, and an event type of the touch operation location.
在一实施例中，接收端设置为：当触摸操作为拖动时，生成第一触摸事件、第二触摸事件和至少一个第三触摸事件，第一触摸事件包括触摸操作开始位置的横坐标、纵坐标及第一事件类型，第二触摸事件包括触摸操作结束位置的横坐标、纵坐标及第二事件类型，第三触摸事件包括触摸操作开始位置和结束位置之间的触摸位置的横坐标、纵坐标及第三事件类型，第一事件类型为左键按下，第三事件类型为移动，第二事件类型为左键抬起；将第一触摸事件、第三触摸事件和第二触摸事件依次发送给发送端。In an embodiment, the receiving end is configured to: when the touch operation is dragging, generate a first touch event, a second touch event, and at least one third touch event, where the first touch event includes an abscissa of a touch operation start position, The ordinate and the first event type, the second touch event includes an abscissa, an ordinate, and a second event type of the end position of the touch operation, and the third touch event includes an abscissa of the touch position between the start position and the end position of the touch operation, The ordinate and the third event type, the first event type is a left button press, the third event type is a move, the second event type is a left button lift; the first touch event, the third touch event, and the second touch event Send to the sender in turn.
在一实施例中，接收端设置为：当触摸操作为缩放时，将生成的触摸事件的事件类型设为缩放。In an embodiment, the receiving end is configured to set the event type of the generated touch event to zoom when the touch operation is zooming.
在一实施例中，接收端设置为：当触摸操作为至少两个手指滑动时，将生成的触摸事件的事件类型设为滚动。In an embodiment, the receiving end is configured to set the event type of the generated touch event to scrolling when the touch operation is at least two finger sliding.
在一实施例中，触摸事件还包括触摸操作位置的横向偏移值、纵向偏移值、手指的个数。In an embodiment, the touch event further includes a lateral offset value of the touch operation position, a longitudinal offset value, and a number of fingers.
在一实施例中，接收端设置为：向触摸事件中加入时间戳。In an embodiment, the receiving end is configured to: add a timestamp to the touch event.
本说明书中，对于无线传屏接收端实施例而言，由于其主要内容已在无线传屏触摸回传***实施例中介绍过，所以相关之处请参见无线传屏触摸回传***实施例的介绍。In this specification, for the wireless screen receiving end embodiment, since the main content thereof has been introduced in the wireless screen touch back transmission system embodiment, please refer to the wireless screen touch back transmission system embodiment. Introduction.
本申请实施例还提供了一种无线传屏触摸回传方法，包括以下步骤：接收触摸操作；根据触摸操作生成触摸事件；将触摸事件发送给发送端。The embodiment of the present application further provides a wireless screen touchback method, including the steps of: receiving a touch operation; generating a touch event according to the touch operation; and transmitting the touch event to the sending end.
在一实施例中，触摸操作包括以下至少之一：单击、双击、长按、拖动、缩放、滚动。In an embodiment, the touch operation includes at least one of: clicking, double clicking, long pressing, dragging, zooming, scrolling.
在一实施例中，触摸事件包括触摸操作位置的横坐标、纵坐标及事件类型。In an embodiment, the touch event includes an abscissa, an ordinate, and an event type of the touch operation location.
在一实施例中，还包括：当触摸操作为拖动时，生成第一触摸事件、第二触摸事件和至少一个第三触摸事件，第一触摸事件包括触摸操作开始位置的横坐标、纵坐标及第一事件类型，第二触摸事件包括触摸操作结束位置的横坐标、纵坐标及第二事件类型，第三触摸事件包括触摸操作开始位置和结束位置之间的触摸位置的横坐标、纵坐标及第三事件类型，第一事件类型为左键按下，第三事件类型为移动，第二事件类型为左键抬起；将第一触摸事件、第三触摸事件和第二触摸事件依次发送给发送端。In an embodiment, the method further includes: when the touch operation is dragging, generating a first touch event, a second touch event, and at least one third touch event, where the first touch event includes an abscissa and an ordinate of a touch operation start position. And a first event type, the second touch event includes an abscissa, an ordinate, and a second event type of the end position of the touch operation, and the third touch event includes an abscissa and an ordinate of the touch position between the start position and the end position of the touch operation. And a third event type, the first event type is a left button press, the third event type is a move, the second event type is a left button lift; the first touch event, the third touch event, and the second touch event are sequentially sent To the sender.
在一实施例中，步骤根据触摸操作生成触摸事件包括：当触摸操作为缩放时，将生成的触摸事件的事件类型设为缩放。In an embodiment, the step of generating a touch event according to the touch operation comprises: setting the event type of the generated touch event to zoom when the touch operation is zooming.
在一实施例中，步骤根据触摸操作生成触摸事件包括：当触摸操作为至少两个手指滑动时，将生成的触摸事件的事件类型设为滚动。In an embodiment, the step of generating a touch event according to the touch operation comprises: setting the event type of the generated touch event to scrolling when the touch operation is sliding for at least two fingers.
在一实施例中，触摸事件还包括触摸操作位置的横向偏移值、纵向偏移值、手指的个数。In an embodiment, the touch event further includes a lateral offset value of the touch operation position, a longitudinal offset value, and a number of fingers.
在一实施例中，步骤根据触摸操作生成触摸事件包括向触摸事件中加入时间戳。In an embodiment, the step of generating a touch event based on the touch operation includes adding a timestamp to the touch event.
本说明书中，对于无线传屏触摸回传方法实施例而言，由于其主要内容已在无线传屏触摸回传***实施例中介绍过，所以相关之处请参见无线传屏触摸回传***实施例的介绍。In this specification, for the wireless screen touch back transmission method embodiment, since the main content thereof has been introduced in the wireless screen touch back transmission system embodiment, please refer to the wireless screen touch back transmission system implementation. An introduction to the example.
本领域的技术人员可以清楚地了解到本申请实施例的技术方案可借助软件和/或硬件来实现。本说明书中的“单元”或“模块”是指能够独立完成或与其他部件配合完成特定功能的软件和/或硬件，其中硬件例如可以是FPGA(Field－Programmable Gate Array，现场可编程门阵列)、IC(Integrated Circuit，集成电路)等。A person skilled in the art can clearly understand that the technical solutions of the embodiments of the present application can be implemented by using software and/or hardware. The term "unit" or "module" in this specification refers to software and/or hardware that can be completed independently or in cooperation with other components to perform a specific function, such as an FPGA (Field-Programmable Gate Array). , IC (Integrated Circuit), etc.
本申请实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述任一项方法的步骤。其中，计算机可读存储介质可以包括但不限于任何类型的盘，包括软盘、光盘、DVD、CD-ROM、微型驱动器以及磁光盘、ROM、RAM、EPROM、EEPROM、DRAM、VRAM、闪速存储器设备、磁卡或光卡、纳米***(包括分子存储器IC)，或适合于存储指令和/或数据的任何类型的媒介或设备。The embodiment of the present application further provides a computer readable storage medium having stored thereon a computer program, the program being executed by the processor to implement the steps of any of the foregoing methods. The computer readable storage medium may include, but is not limited to, any type of disk, including a floppy disk, an optical disk, a DVD, a CD-ROM, a micro drive, and a magneto-optical disk, a ROM, a RAM, an EPROM, an EEPROM, a DRAM, a VRAM, a flash memory device. , magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of medium or device suitable for storing instructions and/or data.
本申请实施例还提供了一种计算机设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，处理器执行程序时实现上述任一项方法的步骤。在本申请实施例中，处理器为计算机***的控制中心，可以是实体机的处理器，也可以是虚拟机的处理器。The embodiment of the present application further provides a computer device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the steps of any one of the foregoing methods when executing the program. In the embodiment of the present application, the processor is a control center of the computer system, and may be a processor of the physical machine or a processor of the virtual machine.

Claims (14)

  1. 一种无线传屏触摸回传***，包括发送端和接收端，A wireless screen touch back transmission system, comprising a transmitting end and a receiving end,
    所述接收端设置为接收触摸操作；The receiving end is configured to receive a touch operation;
    所述接收端还设置为根据所述触摸操作生成触摸事件，将所述触摸事件发送给所述发送端；The receiving end is further configured to generate a touch event according to the touch operation, and send the touch event to the sending end;
    所述发送端设置为接收并解析所述触摸事件，以获取所述触摸事件对应的所述触摸操作；The sending end is configured to receive and parse the touch event to obtain the touch operation corresponding to the touch event;
    所述发送端还设置为执行所述触摸操作。The transmitting end is further configured to perform the touch operation.
  2. 根据权利要求1所述的无线传屏触摸回传***，其中，所述触摸操作包括以下至少之一：单击、双击、长按、拖动、缩放、滚动。The wireless screen touch back transmission system according to claim 1, wherein the touch operation comprises at least one of: clicking, double clicking, long pressing, dragging, zooming, scrolling.
  3. 根据权利要求1或2所述的无线传屏触摸回传***，其中，所述接收端还设置为向所述触摸事件中加入时间戳。The wireless screen touch back transmission system according to claim 1 or 2, wherein the receiving end is further arranged to add a time stamp to the touch event.
  4. 一种无线传屏接收端，所述接收端设置为接收触摸操作；A wireless screen receiving end, the receiving end being configured to receive a touch operation;
    所述接收端还设置为根据所述触摸操作生成触摸事件，将所述触摸事件发送给发送端。The receiving end is further configured to generate a touch event according to the touch operation, and send the touch event to the sending end.
  5. 一种无线传屏触摸回传方法，包括以下步骤：A wireless screen touchback method includes the following steps:
    接收触摸操作；Receiving a touch operation;
    根据所述触摸操作生成触摸事件；Generating a touch event according to the touch operation;
    将所述触摸事件发送给发送端。Sending the touch event to the sender.
  6. 根据权利要求5所述的无线传屏触摸回传方法，其中，所述触摸操作包括以下至少之一：单击、双击、长按、拖动、缩放、滚动。The wireless screen touch back transmission method according to claim 5, wherein the touch operation comprises at least one of: clicking, double clicking, long pressing, dragging, zooming, scrolling.
  7. 根据权利要求5或6所述的无线传屏触摸回传方法，其中，所述触摸事件包括触摸操作位置的横坐标、纵坐标及事件类型。The wireless screen touch back transmission method according to claim 5 or 6, wherein the touch event comprises an abscissa, an ordinate, and an event type of the touch operation position.
  8. 根据权利要求7所述的无线传屏触摸回传方法，其中，还包括：当所述触摸操作为拖动时，生成第一触摸事件、第二触摸事件和至少一个第三触摸事件，所述第一触摸事件包括所述触摸操作开始位置的横坐标、纵坐标及第一事件类型，所述第二触摸事件包括触摸操作结束位置的横坐标、纵坐标及第二事件类型，所述第三触摸事件包括所述触摸操作开始位置和结束位置之间的触摸位置的横坐标、纵坐标及第三事件类型，所述第一事件类型为左键按下，所述第三事件类型为移动，所述第二事件类型为左键抬起；The wireless screen touch back method according to claim 7, further comprising: generating a first touch event, a second touch event, and at least one third touch event when the touch operation is dragging, The first touch event includes an abscissa, an ordinate, and a first event type of the touch operation start position, and the second touch event includes an abscissa, an ordinate, and a second event type of the touch operation end position, the third The touch event includes an abscissa, an ordinate, and a third event type of the touch position between the touch operation start position and the end position, the first event type is a left button press, and the third event type is a move, The second event type is a left button lift;
    将所述第一触摸事件、第三触摸事件和第二触摸事件依次发送给所述发送端。The first touch event, the third touch event, and the second touch event are sequentially sent to the sending end.
  9. 根据权利要求7所述的无线传屏触摸回传方法，其中，所述步骤根据所述触摸操作生成触摸事件包括：当所述触摸操作为缩放时，将生成的所述触摸事件的事件类型设为缩放。The wireless screen touchback method according to claim 7, wherein the step of generating a touch event according to the touch operation comprises: when the touch operation is zooming, setting an event type of the generated touch event For zooming.
  10. 根据权利要求7所述的无线传屏触摸回传方法，其中，所述步骤根据所述触摸操作生成触摸事件包括：当所述触摸操作为至少两个手指滑动时，将生成的所述触摸事件的事件类型设为滚动。The wireless screen touchback method according to claim 7, wherein the step of generating a touch event according to the touch operation comprises: the touch event to be generated when the touch operation is at least two finger slides The event type is set to scroll.
  11. 根据权利要求10所述的无线传屏触摸回传方法，其中，所述触摸事件还包括触摸操作位置的横向偏移值、纵向偏移值、所述手指的个数。The wireless screen touch back transmission method according to claim 10, wherein the touch event further comprises a lateral offset value of the touch operation position, a longitudinal offset value, and the number of the fingers.
  12. 根据权利要求5-6、8-11中任一项所述的无线传屏触摸回传方法，其中，所述步骤根据所述触摸操作生成触摸事件包括向所述触摸事件中加入时间戳。The wireless screen touch back method according to any one of claims 5-6, 8-11, wherein the step of generating a touch event according to the touch operation comprises adding a time stamp to the touch event.
  13. 一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现所述权利要求5-12中任一项所述方法的步骤。A computer readable storage medium having stored thereon a computer program, the program being executed by a processor to perform the steps of the method of any of claims 5-12.
  14. 一种计算机设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现所述权利要求5-12中任一项所述方法的步骤。A computer apparatus comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor executing the program to implement the method of any one of claims 5-12 A step of.
PCT/CN2018/117052 2018-04-04 2018-11-22 Touch-back method and system for wireless screen mirroring WO2019192190A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810298499.7A CN108563391A (en) 2018-04-04 2018-04-04 Wireless screen transmission touches retransmission method and system
CN201810298499.7 2018-04-04

Publications (1)

Publication Number Publication Date
WO2019192190A1 true WO2019192190A1 (en) 2019-10-10

Family

ID=63534071

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/117052 WO2019192190A1 (en) 2018-04-04 2018-11-22 Touch-back method and system for wireless screen mirroring

Country Status (2)

Country Link
CN (1) CN108563391A (en)
WO (1) WO2019192190A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108563391A (en) * 2018-04-04 2018-09-21 广州视源电子科技股份有限公司 Wireless screen transmission touches retransmission method and system
CN109960449A (en) * 2019-03-22 2019-07-02 深圳前海达闼云端智能科技有限公司 A kind of throwing screen display methods and relevant apparatus
CN112463086A (en) * 2019-09-06 2021-03-09 华为技术有限公司 Display control method and electronic equipment
CN111078117B (en) * 2020-03-24 2020-07-21 杭州赛鲁班网络科技有限公司 Courseware system based on multi-screen interaction
CN114691006B (en) * 2020-12-31 2024-01-23 博泰车联网科技(上海)股份有限公司 Information processing method and related device based on screen projection
CN117785085A (en) * 2022-09-21 2024-03-29 北京字跳网络技术有限公司 Information prompting method, device, equipment, medium and product of virtual terminal equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130113738A1 (en) * 2011-11-08 2013-05-09 Electronics And Telecommunications Research Institute Method and apparatus for controlling content on remote screen
CN105045548A (en) * 2015-06-16 2015-11-11 广州视睿电子科技有限公司 Wireless screen transmission method, extension device and wireless screen transmission system
CN105808147A (en) * 2016-05-10 2016-07-27 安徽大学 Wireless replication and expanded display interaction method and system
CN106992845A (en) * 2017-03-28 2017-07-28 广州视源电子科技股份有限公司 Data transmission method, system and device
CN108563391A (en) * 2018-04-04 2018-09-21 广州视源电子科技股份有限公司 Wireless screen transmission touches retransmission method and system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5533254B2 (en) * 2010-05-24 2014-06-25 アイシン・エィ・ダブリュ株式会社 Information display device, information display method, and program
CN105630452A (en) * 2013-02-21 2016-06-01 海信集团有限公司 Screen transmission method and electronic devices
CN104111069B (en) * 2013-04-17 2018-04-27 富泰华工业（深圳）有限公司 Automatic station-keeping system and method
CN104216625A (en) * 2013-05-31 2014-12-17 华为技术有限公司 Display object display position adjusting method and terminal equipment
CN105843547B (en) * 2016-05-24 2019-06-07 腾讯科技（深圳）有限公司 A kind of page sliding method and device
CN107168674B (en) * 2017-06-19 2020-08-11 浙江工商大学 Screen casting annotation method and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130113738A1 (en) * 2011-11-08 2013-05-09 Electronics And Telecommunications Research Institute Method and apparatus for controlling content on remote screen
CN105045548A (en) * 2015-06-16 2015-11-11 广州视睿电子科技有限公司 Wireless screen transmission method, extension device and wireless screen transmission system
CN105808147A (en) * 2016-05-10 2016-07-27 安徽大学 Wireless replication and expanded display interaction method and system
CN106992845A (en) * 2017-03-28 2017-07-28 广州视源电子科技股份有限公司 Data transmission method, system and device
CN108563391A (en) * 2018-04-04 2018-09-21 广州视源电子科技股份有限公司 Wireless screen transmission touches retransmission method and system

Also Published As

Publication number Publication date
CN108563391A (en) 2018-09-21

Similar Documents

Publication Publication Date Title
WO2019192190A1 (en) Touch-back method and system for wireless screen mirroring
WO2019120054A1 (en) Interactive control method and system, and terminal and storage medium
WO2017101440A1 (en) Remote annotation synchronization method and system
WO2017101441A1 (en) Method and system for remote synchronization of annotation moving and scaling
US20130014042A1 (en) Method and apparatus for adjusting size of a list item
EP2645223A2 (en) Touch-based method and apparatus for sending information
US10452777B2 (en) Display apparatus and character correcting method thereof
JP2010134897A (en) Drawing device, drawing method, program and recording medium
JP2009104268A (en) Coordinate detection device and operation method using touch panel
CN103092518B (en) A kind of mobile accurate touch control method of cloud desktop based on RDP agreement
US8633895B2 (en) Apparatus and method for improving character input function in mobile terminal
JP2014527673A (en) Widget processing method and apparatus, and mobile terminal
US20150301633A1 (en) Information processing device, display device with touch panel, information processing method, and program
US20150253943A1 (en) Method and Apparatus for Implementing Remote Browsing
US9830056B1 (en) Indicating relationships between windows on a computing device
CN106293563B (en) Control method and electronic equipment
JPWO2014098164A1 (en) Image display device, portable terminal device, information processing system, image display device control method, and program
JP2015148857A (en) Information browsing device, object selection control program, and object selection control method
JP2015018300A (en) Display unit, terminal apparatus, display system, and display method
US10645144B2 (en) Computer-implemented method for controlling a remote device with a local device
US20150062038A1 (en) Electronic device, control method, and computer program product
TWI547862B (en) Multi - point handwriting input control system and method
US10359931B2 (en) Remote operation apparatus, remote operation system, and non-transitory computer readable medium storing program
CN104572602A (en) Method and device for displaying message
CN104484117A (en) Method and device for man-machine interaction

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18913645

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18913645

Country of ref document: EP

Kind code of ref document: A1