WO2017088429A1 - Procédé et système de commande d'un programme d'application d'écran tactile dans un terminal à écran par un terminal mobile - Google Patents

Procédé et système de commande d'un programme d'application d'écran tactile dans un terminal à écran par un terminal mobile Download PDF

Info

Publication number
WO2017088429A1
WO2017088429A1 PCT/CN2016/084268 CN2016084268W WO2017088429A1 WO 2017088429 A1 WO2017088429 A1 WO 2017088429A1 CN 2016084268 W CN2016084268 W CN 2016084268W WO 2017088429 A1 WO2017088429 A1 WO 2017088429A1
Authority
WO
WIPO (PCT)
Prior art keywords
coordinate
mobile terminal
display terminal
button
click
Prior art date
Application number
PCT/CN2016/084268
Other languages
English (en)
Chinese (zh)
Inventor
周勇
Original Assignee
深圳Tcl数字技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl数字技术有限公司 filed Critical 深圳Tcl数字技术有限公司
Publication of WO2017088429A1 publication Critical patent/WO2017088429A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces

Definitions

  • the present invention relates to the field of intelligent control technologies, and in particular, to a method and system for a mobile terminal to control a touch screen application on a display terminal.
  • touch operation functions have become the basic functions of most mobile terminals, and more and more touch screen applications can be used by mobile terminals. Due to the versatility of the mobile terminal and the display terminal platform, many mobile terminal-based touch screen applications can be directly installed and run on the display terminal. However, the touch screen application is operated and controlled based on the touch screen, and The display terminal does not have a touch screen function or is inconvenient to touch the display terminal due to the distance being too far. The user is inconvenient to directly perform touch control on the display terminal when using the touch screen application on the display terminal. Since the mobile terminal can access and control the display terminal very conveniently through the home wireless local area network, there is an urgent need for a method for controlling the touch screen application running on the display terminal through the mobile terminal.
  • a main object of the present invention is to provide a method and system for controlling a touch screen application on a display terminal by a mobile terminal, and aims to control a touch screen application running on the display terminal through the mobile terminal.
  • the present invention provides a method for a mobile terminal to control a touch screen application on a display terminal, the method comprising the following steps:
  • the mobile terminal When the mobile terminal receives the calibration instruction of the preset universal button on the mobile terminal, the mobile terminal acquires a screenshot of the control button on the display terminal that includes the currently running touch screen application;
  • the mobile terminal displays the screenshot and acquires a coordinate point of the user performing a click operation on the area where the control button is located in the screenshot displayed by the mobile terminal;
  • the mobile terminal acquires a coordinate percentage of the coordinate point in the screenshot, and sets a correspondence between the coordinate percentage and the preset universal button;
  • the display terminal identifies a click instruction on the second coordinate position of the display terminal according to the coordinate information
  • the display terminal controls the currently running touch screen application according to the click instruction.
  • the step of acquiring the coordinate information corresponding to the preset universal button that the user clicks includes:
  • the preset coordinate information corresponding to the preset universal button is acquired.
  • the step of the display terminal identifying the click instruction on the second coordinate position of the display terminal according to the coordinate information comprises:
  • the display terminal acquires a second coordinate position on the display terminal according to the coordinate information, and identifies a click instruction on a control button on the display terminal, where the second coordinate position is within a range of the control button.
  • the step of the mobile terminal acquiring the coordinate percentage of the coordinate point in the screenshot, and setting the correspondence between the coordinate percentage and the preset universal button comprises:
  • the resolution of the mobile terminal is W1*H1
  • the resolution of the display terminal is W2*H2
  • the coordinate point is (X1, Y1)
  • the step of the display terminal identifying the click command on the second coordinate position of the display terminal according to the coordinate information further includes:
  • the display terminal calculates a second coordinate position on the display terminal according to the coordinate percentage P, and simulates a click action on the second coordinate position, injects into the system, and identifies the second coordinate position. Clicking on the instruction, wherein the coordinates of the second coordinate position are (X1) /W1*W2, Y1 /H1* H2).
  • the present invention also provides a method for a mobile terminal to control a touch screen application on a display terminal, the method comprising the following steps:
  • the mobile terminal When the mobile terminal detects the click operation of the preset universal button, the mobile terminal acquires coordinate information corresponding to the preset universal button that the user clicks, wherein the mobile terminal is pre-set with a mapping relationship between different common buttons and different coordinate information. ;
  • the display terminal identifies a click instruction on the second coordinate position of the display terminal according to the coordinate information
  • the display terminal controls the currently running touch screen application according to the click instruction.
  • the step of acquiring the coordinate information corresponding to the preset universal button that the user clicks includes:
  • the preset coordinate information corresponding to the preset universal button is acquired.
  • the step of the display terminal identifying the click instruction on the second coordinate position of the display terminal according to the coordinate information comprises:
  • the display terminal acquires a second coordinate position on the display terminal according to the coordinate information, and identifies a click instruction on a control button on the display terminal, where the second coordinate position is within a range of the control button.
  • the step of obtaining the coordinate information corresponding to the preset universal button clicked by the user when the mobile terminal detects the click operation of the preset universal button further includes:
  • the mobile terminal When the mobile terminal receives the calibration instruction of the preset universal button on the mobile terminal, the mobile terminal acquires a screenshot of the control button on the display terminal that includes the currently running touch screen application;
  • the mobile terminal displays the screenshot and acquires a coordinate point of the user performing a click operation on the area where the control button is located in the screenshot displayed by the mobile terminal;
  • the mobile terminal acquires a coordinate percentage of the coordinate point in the screenshot, and sets a correspondence between the coordinate percentage and the preset universal button.
  • the step of the mobile terminal acquiring the coordinate percentage of the coordinate point in the screenshot, and setting the correspondence between the coordinate percentage and the preset universal button comprises:
  • the resolution of the mobile terminal is W1*H1
  • the resolution of the display terminal is W2*H2
  • the coordinate point is (X1, Y1)
  • the step of the display terminal identifying the click command on the second coordinate position of the display terminal according to the coordinate information further includes:
  • the display terminal calculates a second coordinate position on the display terminal according to the coordinate percentage P, and simulates a click action on the second coordinate position, injects into the system, and identifies the second coordinate position. Clicking on the instruction, wherein the coordinates of the second coordinate position are (X1) /W1*W2, Y1 /H1* H2).
  • the present invention further provides a system for a mobile terminal to control a touch screen application on a display terminal, the system comprising: a mobile terminal and a display terminal, wherein
  • the mobile terminal When the mobile terminal detects a click operation of the preset universal button, the mobile terminal acquires coordinate information corresponding to the preset universal button that the user clicks, wherein the mobile terminal is pre-set with different common buttons and different coordinate information. Mapping relationship; sending the coordinate information to the display terminal;
  • the display terminal identifies a click instruction on the second coordinate position of the display terminal according to the coordinate information; and controls the currently running touch screen application according to the click instruction.
  • the mobile terminal is further configured to:
  • the coordinate information preset corresponding to the preset universal button is acquired.
  • the display terminal is further configured to:
  • the mobile terminal is further configured to:
  • Receiving, by the user, a calibration instruction of the preset universal button on the mobile terminal acquiring a screenshot of the control button on the display terminal that includes the currently running touch screen application; displaying the screenshot and acquiring the user's display on the mobile terminal The coordinate point of the click control operation in the area where the control button is located in the screenshot; the coordinate percentage of the coordinate point in the screenshot is obtained, and the correspondence between the coordinate percentage and the preset universal button is set.
  • the mobile terminal is further configured to:
  • the resolution of the mobile terminal is W1*H1
  • the resolution of the display terminal is W2*H2
  • the coordinate point is (X1, Y1)
  • the display terminal is further configured to:
  • the invention provides a method and a system for controlling a touch screen application program on a display terminal by using a mobile terminal, and using the mobile terminal to acquire a preset universal button clicked by the user on the mobile terminal, and setting coordinate information corresponding to the preset universal button Sending to the display terminal, the display terminal can acquire the second coordinate position on the display terminal according to the coordinate information, and identify a click instruction on the second coordinate position to touch the touch screen application currently running on the display terminal Take control.
  • the display terminal can convert and recognize the click instruction on the second coordinate position of the display terminal according to the coordinate information corresponding to the preset universal button, and therefore, the user A corresponding click command may be generated in the display terminal by performing a click operation on the mobile terminal, so that the display terminal controls the touch screen application according to the click instruction, thereby implementing the touch screen application running on the display terminal by the mobile terminal.
  • FIG. 1 is a schematic flowchart of a first embodiment of a method for a mobile terminal to control a touch screen application on a display terminal according to the present invention
  • FIG. 2 is a schematic flowchart of a second embodiment of a method for a mobile terminal to control a touch screen application on a display terminal according to the present invention
  • FIG. 3 is a schematic structural diagram of a system for controlling a touch screen application program on a display terminal of a mobile terminal according to the present invention.
  • the invention provides a method for a mobile terminal to control a touch screen application on a display terminal.
  • FIG. 1 is a schematic flowchart diagram of a first embodiment of a method for a mobile terminal to control a touch screen application on a display terminal according to the present invention.
  • the method for the mobile terminal to control the touch screen application on the display terminal includes:
  • step S10 when the mobile terminal detects the click operation of the preset universal button, the mobile terminal acquires coordinate information corresponding to the preset universal button that the user clicks, wherein the mobile terminal is pre-set with different common buttons and different coordinate information. Mapping relationship;
  • the mobile terminal is provided with a plurality of common buttons commonly used in virtual handles, such as above, lower, left, right, hit, jump, etc., to meet button support in the touch screen application running on the display terminal.
  • a plurality of common buttons commonly used in virtual handles such as above, lower, left, right, hit, jump, etc.
  • Real-time monitoring of the user's touch screen operation on the mobile terminal such as a click operation on the preset universal button, and when detecting the user's click operation on the preset universal button on the mobile terminal, acquiring the preset universal button corresponding to the user click Coordinate information.
  • the mapping relationship between different common buttons and different coordinate information is pre-set on the mobile terminal.
  • the coordinate information may be information such as a specific coordinate point position, a coordinate percentage, and the like, such as an abscissa of the coordinate point, a width of the ordinate relative to the width of the touch screen area, a percentage of the length, and the like.
  • the preset coordinate information corresponding to the universal button is only related to the position of the control button of the currently running touch screen application on the display terminal, and is independent of the position of the universal button on the mobile terminal. .
  • the coordinate information is taken as a coordinate point position.
  • the user needs to use the preset universal button B on the mobile terminal to control
  • the mapping relationship between the universal button B and the coordinate point position a may be preset on the mobile terminal. In this way, when the mobile terminal detects the click operation of the universal button B by the user, the coordinate information corresponding to the common button B clicked by the user, that is, the coordinate point position a can be acquired.
  • Step S20 the mobile terminal sends the coordinate information to the display terminal
  • the mobile terminal sends the coordinate information corresponding to the preset universal button obtained by the user when the user clicks the preset universal button operation to the display terminal by using the home wireless local area network, the UPnP protocol, or the like.
  • the coordinate point position a corresponding to the acquired universal button B clicked by the user can be sent to the display terminal.
  • Step S30 the display terminal identifies a click instruction on the second coordinate position of the display terminal according to the coordinate information
  • the second coordinate position on the display terminal may be calculated and obtained according to the coordinate information, such as the coordinate point position sent by the display terminal according to the mobile terminal.
  • the control target A in the touch screen application currently running in the display terminal corresponding to the coordinate point position a can be identified, the control target A is also the second coordinate position, and a mouse click is simulated according to the second coordinate position.
  • the action is input to the display terminal system as a touch screen event, and the display terminal can recognize the click command at the second coordinate position of the display terminal, that is, the control target A.
  • the display terminal is configured to recognize the second coordinate position on the display terminal according to the coordinate information corresponding to the preset universal button sent by the mobile terminal, so the user clicks on the mobile terminal It is assumed that the relative position of the universal button in the mobile terminal can be completely different from the second coordinate position. In this way, the user can perform a click operation on different common buttons on the mobile terminal according to the target point that needs to be controlled on the display terminal, so that the display terminal can obtain coordinate information corresponding to different common buttons of the click. To identify click commands for different control targets on the display terminal.
  • Step S40 The display terminal controls the currently running touch screen application according to the click instruction.
  • the display terminal may respond to the recognized click command, and directly respond to the click operation effect on the display terminal, thereby responding to the click command.
  • the display terminal may respond to the recognized click command, and directly respond to the click operation effect on the display terminal, thereby responding to the click command.
  • the mobile terminal is used to acquire a preset universal button that is clicked by the user on the mobile terminal, and the coordinate information corresponding to the preset universal button is sent to the display terminal, and the display terminal can acquire the display terminal according to the coordinate information. And a second coordinate position on the second coordinate position and identifying a click command at the second coordinate position to control a touch screen application currently running on the display terminal.
  • the display terminal can convert and recognize the click instruction on the second coordinate position of the display terminal according to the coordinate information corresponding to the preset universal button, and therefore, the user A corresponding click command may be generated in the display terminal by performing a click operation on the mobile terminal, so that the display terminal controls the touch screen application according to the click instruction, thereby implementing the touch screen application running on the display terminal by the mobile terminal.
  • step S10 may include:
  • the preset coordinate information corresponding to the preset universal button is acquired.
  • the display terminal may identify a click instruction at the second coordinate position of the display terminal according to the coordinate information, and control the currently running touch screen application.
  • the user only needs to click on any coordinate point within the range of the preset universal button on the mobile terminal to perform the same control on the touch screen application currently running on the display terminal, which is more convenient for the user to pass the mobile terminal. Controls the touch screen application running on the display terminal.
  • step S30 may include:
  • the display terminal acquires a second coordinate position on the display terminal according to the coordinate information, and identifies a click instruction on a control button on the display terminal, where the second coordinate position is within a range of the control button.
  • the display terminal acquires the second coordinate position on the display terminal according to the coordinate information
  • further, if the second coordinate position falls within the range of the control button on the display terminal it is recognized as a click command to the control button on the display terminal.
  • the click command of a target point in the touch screen application running on the display terminal through the mobile terminal, but also recognize the click command of a button in the touch screen application running on the display terminal, which is applicable. More broad and more flexible.
  • a second embodiment of the present invention provides a method for a mobile terminal to control a touch screen application on a display terminal.
  • the method further includes:
  • Step S50 When the mobile terminal receives the calibration instruction of the preset universal button on the mobile terminal, the mobile terminal acquires a screenshot of the control button on the display terminal that includes the currently running touch screen application.
  • Step S60 the mobile terminal displays the screenshot and acquires a coordinate point of the user performing a click operation on the area where the control button is located in the screenshot displayed by the mobile terminal;
  • Step S70 The mobile terminal acquires a coordinate percentage of the coordinate point in the screenshot, and sets a correspondence between the coordinate percentage and the preset universal button.
  • the embodiment further includes a calibration operation for presetting a universal button on the mobile terminal, and a virtual handle may be preset on the mobile terminal, where the virtual handle includes a plurality of common preset buttons, as above, below, and left. Right button, menu, selection and other function buttons, some common preset buttons in the virtual handle can meet the needs of buttons in most touch screen applications.
  • the preset universal button in the mobile terminal is first calibrated to be in the touch screen application in the display terminal. The corresponding control buttons are controlled accurately and efficiently.
  • the mobile terminal When receiving the calibration instruction of the preset universal button on the mobile terminal, the mobile terminal acquires a full-screen screenshot of the control button on the display terminal that includes the currently running touch screen application, and the screenshot includes the current running touch screen application. All the control buttons used.
  • the mobile terminal also displays the screenshot in full screen, and the user may perform a click operation on the control button in the screenshot according to the screenshot displayed on the mobile terminal, and acquire a control button in the screenshot displayed by the user on the mobile terminal. Performing a coordinate point of the click operation, acquiring a coordinate percentage of the coordinate point in the screenshot, and setting a correspondence relationship between the coordinate percentage and the preset universal button, and saving the coordinate percentage and the preset
  • the correspondence of the universal buttons can complete the calibration of the preset universal buttons on the mobile terminal.
  • the preset universal button After the preset universal button is calibrated on the mobile terminal, in the subsequent operation, if the mobile terminal detects that the first coordinate position clicked by the user falls within the range of the preset universal button, the preset may be acquired.
  • the universal button corresponds to the preset coordinate information, that is, the coordinate percentage, in the calibration operation, and the display terminal can obtain the control button that the user selects the click in the screenshot in the calibration operation according to the coordinate information, thereby realizing the user clicking on the mobile terminal.
  • the universal button is preset, a click command for the control button selected by the user in the screenshot is recognized on the display terminal, thereby controlling the current operation of the touch screen application on the display terminal according to the preset universal button on the mobile terminal The corresponding control button in .
  • the coordinate point of the click is converted into coordinate information such as a coordinate percentage, and the coordinate percentage is associated with the universal button on the virtual handle, and in subsequent operations, the user Click the preset universal button on the virtual handle to send the coordinate percentage corresponding to the preset universal button to the display terminal.
  • the display terminal restores the coordinate percentage to the coordinate point according to the resolution of the screen, and then according to the The coordinate point simulates the action of a mouse click and is injected into the system to recognize the click command for the coordinate point.
  • the resolution of the mobile terminal is assumed to be W1*H1
  • the display terminal resolution is W2*H2.
  • the universal button B on the mobile terminal When the universal button B on the mobile terminal is calibrated, if the user clicks on the screenshot on the mobile terminal, the coordinate point P1 obtained by the control button A is (X1, Y1), the calculated coordinate percentage is P (X1) /W1,Y1 /H1), and set the correspondence between the coordinate percentage P and the universal button B.
  • the preset coordinate percentage P corresponding to the universal button B can be acquired, and the coordinate percentage P is obtained.
  • the display terminal can obtain the second coordinate position on the display terminal, that is, the coordinate point P2 (X1) according to the coordinate percentage P.
  • the touch screen application is a game application that is operated by a touch button. Since the game application is mostly operated based on the touch screen button, since the display terminal generally has a larger screen, better stereo sound and the like than the mobile terminal, playing the game on the display terminal can bring the player with respect to the mobile terminal. For more sense of presence and realism, in this embodiment, the game application can be run on the display terminal and the buttons in the game application can be controlled and operated by the mobile terminal, which can bring better game effects to the user.
  • the present invention further provides a system in which a mobile terminal controls a touch screen application on a display terminal.
  • the mobile terminal may be a terminal having a touch function such as a mobile phone or a pad
  • the display terminal may be a television, a computer, or the like, which is not limited herein.
  • FIG. 3 is a schematic structural diagram of a system for controlling a touch screen application program on a display terminal of a mobile terminal according to the present invention.
  • system for controlling the touch screen application on the display terminal by the mobile terminal comprises:
  • the mobile terminal 1 When the mobile terminal 1 detects the click operation of the preset universal button, the mobile terminal 1 acquires coordinate information corresponding to the preset universal button that the user clicks, wherein the mobile terminal 1 is pre-set with a mapping relationship between different common buttons and different coordinate information. Sending the coordinate information to the display terminal 2;
  • the display terminal 2 identifies a click command at the second coordinate position of the display terminal 2 based on the coordinate information; and controls the currently running touch screen application according to the click command.
  • the mobile terminal 1 is provided with a plurality of common buttons commonly used in virtual handles, such as above, below, left, right, hit, jump, etc., to meet the touch screen application running on the display terminal 2.
  • Button support Real-time monitoring of the user's touch screen operation on the mobile terminal 1 such as a click operation on the preset universal button, and when detecting the user's click operation on the preset universal button on the mobile terminal 1, acquiring the preset universal clicked by the user The coordinate information corresponding to the button.
  • the mapping relationship between different common buttons and different coordinate information is preset on the mobile terminal 1.
  • the coordinate information may be information such as a specific coordinate point position, a coordinate percentage, and the like, such as an abscissa of the coordinate point, a width of the ordinate relative to the width of the touch screen area, a percentage of the length, and the like.
  • the preset coordinate information corresponding to the universal button is only related to the position of the control button of the touch screen application currently running on the display terminal 2, and the universal button is on the mobile terminal 1. Position is irrelevant. For example, the coordinate information is taken as a coordinate point position. If the coordinate point position of the control target A of the touch screen application currently running on the display terminal 2 is a, the user needs to use the preset universal button B on the mobile terminal 1.
  • the mapping relationship between the universal button B and the coordinate point position a can be preset on the mobile terminal 1. In this way, when the mobile terminal 1 detects the click operation of the universal button B by the user, the coordinate point position a corresponding to the common button B clicked by the user can be acquired.
  • the mobile terminal 1 transmits the coordinate information corresponding to the preset universal button acquired by the user when the user clicks the preset universal button operation to the display terminal 2 through the home wireless local area network, the UPnP protocol, or the like.
  • the coordinate point position a corresponding to the acquired universal button B clicked by the user can be sent to the display terminal 2.
  • the second coordinate position on the display terminal 2 can be calculated according to the coordinate information, and the display terminal 2 can recognize the coordinate position a according to the coordinate terminal sent by the mobile terminal 1.
  • the coordinate point position a corresponds to the control target A in the touch screen application currently running on the display terminal 2, the control target A is also the second coordinate position, and simulates a mouse click action according to the second coordinate position as a time
  • the touch screen event is input to the display terminal 2 system, and the display terminal 2 can recognize the click command at the second coordinate position of the display terminal 2, that is, the control target A.
  • the display terminal 2 calculates the second coordinate position recognized on the display terminal 2 according to the coordinate information corresponding to the preset universal button transmitted by the mobile terminal 1, the preset universal button clicked by the user on the mobile terminal 1 is The relative position in the mobile terminal 1 and the second coordinate position may be completely different. In this way, the user can click on the different common buttons on the mobile terminal 1 according to the target point that is controlled on the display terminal 2, so that the display terminal 2 can recognize the coordinate information corresponding to the different common buttons that are clicked. Click commands for different control targets on the display terminal 2.
  • the display terminal 2 After the display terminal 2 recognizes the click command on the second coordinate position of the display terminal 2, it can respond to the recognized click command, and directly responds to the click operation effect on the display terminal 2, thereby displaying the response in response to the click command.
  • the touch screen application currently running on terminal 2 is controlled.
  • the mobile terminal 1 is used to acquire a preset universal button that is clicked by the user on the mobile terminal 1, and the coordinate information corresponding to the preset universal button is sent to the display terminal 2.
  • the display terminal 2 can obtain the coordinate information according to the coordinate information.
  • a second coordinate position on the terminal 2 is displayed, and a click command at the second coordinate position is recognized to control the touch screen application currently running on the display terminal 2.
  • the display terminal 2 can convert and recognize the click command on the second coordinate position of the display terminal 2 according to the coordinate information corresponding to the preset universal button.
  • the user can generate a corresponding click instruction in the display terminal 2 by performing a click operation on the mobile terminal 1 for the display terminal 2 to control the touch screen application according to the click instruction, thereby implementing control of the display terminal 2 by the mobile terminal 1.
  • Touchscreen app is used to acquire a preset universal button that is clicked by the user on the mobile terminal 1, and the coordinate information corresponding to the preset universal button is sent to the display terminal 2.
  • the display terminal 2 can obtain the coordinate information according to
  • the mobile terminal 1 can be used to:
  • the coordinate information preset corresponding to the preset universal button is acquired.
  • the display terminal 2 can recognize the click command at the second coordinate position of the display terminal 2 based on the coordinate information, and control the currently operating touch screen application.
  • the user only needs to click on any coordinate point within the range of the preset universal button on the mobile terminal 1 to perform the same control on the touch screen application currently running on the display terminal 2, which is more convenient for the user to pass the mobile terminal. 1 controls the display of the touch screen application running on the terminal 2.
  • the display terminal 2 can be used to:
  • the display terminal 2 acquires the second coordinate position on the display terminal 2 according to the coordinate information, further, if the second coordinate position falls within the range of the control button on the display terminal 2, It is recognized as a click command to the control button on the display terminal 2.
  • the control button on the display terminal 2 not only the user can recognize the click command of a target point in the touch screen application running on the display terminal 2 through the mobile terminal 1, but also recognize the click of a button in the touch screen application running on the display terminal 2.
  • the instructions are more applicable and more flexible.
  • the mobile terminal 1 can also be used to:
  • Receiving a calibration instruction of the preset universal button on the mobile terminal 1 by the user acquiring a screenshot of the control button on the display terminal 2 including the currently running touch screen application; displaying the screenshot and acquiring the user's display to the mobile terminal 1 In the screenshot, the coordinate point of the area where the control button is located is clicked; the coordinate percentage of the coordinate point in the screenshot is obtained, and the correspondence between the coordinate percentage and the preset universal button is set.
  • the calibration operation of the preset universal button on the mobile terminal 1 is further included, and the virtual handle can be set in advance on the mobile terminal 1, and the virtual handle includes a plurality of common preset buttons, as above, below, left, and right. Direction buttons, menus, selections, and other function buttons. Several common preset buttons in the virtual handle can meet the needs of buttons in most touch screen applications.
  • the preset universal button in the mobile terminal 1 is first calibrated to touch the touch screen in the display terminal 2. The corresponding control buttons in the application are controlled accurately and efficiently.
  • the mobile terminal 1 When receiving the calibration instruction of the preset universal button on the mobile terminal 1 , the mobile terminal 1 acquires a full-screen screenshot of the control button on the display terminal 2 including the currently running touch screen application, and the screenshot includes the currently running touch screen application. All the control buttons you need.
  • the mobile terminal 1 also displays the screenshot in full screen, and the user can perform a click operation on the control button in the screenshot according to the screenshot displayed on the mobile terminal 1, and obtain a click operation on the control button in the screenshot displayed by the mobile terminal 1 by the user. And a coordinate percentage of the coordinate point in the screenshot, and setting a correspondence between the coordinate percentage and the preset universal button, and saving the coordinate percentage and the preset universal button Corresponding relationship, the calibration of the preset universal button on the mobile terminal 1 can be completed.
  • the preset universal button After the preset universal button is calibrated on the mobile terminal 1, in the subsequent operation, if the mobile terminal 1 detects that the first coordinate position clicked by the user falls within the range of the preset universal button, the preset may be acquired.
  • the universal button corresponds to the preset coordinate information, that is, the coordinate percentage, in the calibration operation, and the display terminal 2 can obtain the control button that the user selects the click in the screenshot in the calibration operation according to the coordinate information, thereby realizing the user in the mobile terminal 1
  • a click command for the control button selected by the user in the screenshot is recognized on the display terminal 2, thereby controlling the current operation on the display terminal 2 according to the preset universal button on the mobile terminal 1. Run the appropriate control button in the touchscreen application.
  • the coordinate points of the click are converted into coordinate information such as a coordinate percentage, and the coordinate percentage is associated with the universal button on the virtual handle, in subsequent operations.
  • the display terminal 2 restores the coordinate percentage to the coordinate point according to the resolution of the screen. Then, according to the coordinate point to simulate a mouse click action, injected into the system, the click command for the coordinate point can be recognized.
  • the display terminal 2 has a resolution of W2*H2.
  • the universal button B on the mobile terminal 1 is calibrated, if the user clicks on the screenshot on the mobile terminal 1 the coordinate point P1 obtained by the control button A is (X1, Y1), the calculated coordinate percentage is P (X1) /W1,Y1 /H1), and set the correspondence between the coordinate percentage P and the universal button B.
  • the preset coordinate percentage P corresponding to the common button B can be acquired, and the coordinates are obtained.
  • the percentage P is sent to the display terminal 2; after obtaining the coordinate percentage P, the display terminal 2 can obtain the second coordinate position on the display terminal 2, that is, the coordinate point P2 (X1) according to the coordinate percentage P. /W1*W2, Y1 /H1* H2), and a click command on the second coordinate position of the display terminal 2, that is, the coordinate point P2, that is, a click command for controlling the button A on the display terminal 2 is recognized, thereby controlling the currently operating touch screen application.
  • the touch screen application is a game application that is operated by a touch button. Since the game application is mostly operated based on the touch screen button, since the display terminal 2 generally has a larger screen, better stereo sound and the like than the mobile terminal 1, the game is played on the display terminal 2 with respect to the mobile terminal 1 The player can bring more sense of presence and realism to the player.
  • the game application can be run on the display terminal 2, and the button in the game application can be controlled and operated by the mobile terminal 1, which can bring the user Better game effects.
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk,
  • a storage medium such as ROM/RAM, disk,
  • the optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Position Input By Displaying (AREA)

Abstract

L'invention a trait à un procédé de commande d'un programme d'application d'écran tactile dans un terminal à écran par un terminal mobile. Selon ce procédé : lors de la détection d'une opération de clic d'un utilisateur sur un bouton universel prédéfini, le terminal mobile acquiert des informations de coordonnées correspondant au bouton universel prédéfini sur lequel l'utilisateur a cliqué, une relation de mise en correspondance entre différents boutons universels et différentes informations de coordonnées étant prédéfinie dans le terminal mobile (S10) ; le terminal mobile envoie les informations de coordonnées à un terminal à écran (S20) ; le terminal à écran identifie une instruction de clic sur une seconde position de coordonnées dudit terminal à écran selon les informations de coordonnées (S30) ; et le terminal à écran commande un programme d'application d'écran tactile s'exécutant actuellement en fonction de l'instruction de clic (S40). L'invention concerne également un système de commande d'un programme d'application d'écran tactile dans un terminal à écran par un terminal mobile. Un programme d'application d'écran tactile s'exécutant dans un terminal à écran est commandé au moyen d'un terminal mobile.
PCT/CN2016/084268 2015-11-23 2016-06-01 Procédé et système de commande d'un programme d'application d'écran tactile dans un terminal à écran par un terminal mobile WO2017088429A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510821593.2 2015-11-23
CN201510821593.2A CN105487856A (zh) 2015-11-23 2015-11-23 移动终端控制显示终端上触屏应用程序的方法及***

Publications (1)

Publication Number Publication Date
WO2017088429A1 true WO2017088429A1 (fr) 2017-06-01

Family

ID=55674856

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/084268 WO2017088429A1 (fr) 2015-11-23 2016-06-01 Procédé et système de commande d'un programme d'application d'écran tactile dans un terminal à écran par un terminal mobile

Country Status (2)

Country Link
CN (1) CN105487856A (fr)
WO (1) WO2017088429A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112445406A (zh) * 2019-08-29 2021-03-05 中兴通讯股份有限公司 终端屏幕操作方法及终端和存储介质

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105487856A (zh) * 2015-11-23 2016-04-13 深圳Tcl数字技术有限公司 移动终端控制显示终端上触屏应用程序的方法及***
CN106658106A (zh) * 2016-11-29 2017-05-10 深圳众思科技有限公司 信号控制方法、***、电子设备及待控制设备
CN108803669B (zh) * 2018-07-05 2021-08-24 北京淳中科技股份有限公司 云台转向控制方法、装置、电子设备及存储介质
CN113031843A (zh) * 2021-04-25 2021-06-25 歌尔股份有限公司 一种手表控制方法、显示终端及手表

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102404641A (zh) * 2011-12-06 2012-04-04 深圳Tcl新技术有限公司 使用智能手机遥控电视机的方法和***
CN102625010A (zh) * 2012-03-06 2012-08-01 清华大学 一种Eye-Free的触屏手机控制电视的方法
CN103000015A (zh) * 2012-12-13 2013-03-27 深圳Tcl新技术有限公司 基于无线传屏的显示设备精确遥控方法和装置
CN103024457A (zh) * 2012-12-20 2013-04-03 四川长虹电器股份有限公司 一种服务器端触屏控制方法及装置
CN103281575A (zh) * 2013-03-28 2013-09-04 四川长虹电器股份有限公司 一种智能电视新型控制方法
CN104185000A (zh) * 2014-08-11 2014-12-03 惠州华阳通用电子有限公司 一种跨屏互动的自动校准方法
CN104918073A (zh) * 2015-05-27 2015-09-16 深圳市金立通信设备有限公司 一种图像的显示方法及终端
CN105487856A (zh) * 2015-11-23 2016-04-13 深圳Tcl数字技术有限公司 移动终端控制显示终端上触屏应用程序的方法及***

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2596994C2 (ru) * 2010-11-09 2016-09-10 Конинклейке Филипс Электроникс Н.В. Пользовательский интерфейс с тактильной обратной связью
CN103067566B (zh) * 2012-04-24 2015-01-07 曾昭兴 鼠标输入方法以及触摸屏手机控制装置
CN103888801A (zh) * 2012-12-21 2014-06-25 鸿富锦精密工业（深圳）有限公司 电视机、遥控装置及菜单显示方法
US9740294B2 (en) * 2013-06-28 2017-08-22 Samsung Electronics Co., Ltd. Display apparatus and method for controlling display apparatus thereof
CN103530149A (zh) * 2013-09-27 2014-01-22 深圳市同洲电子股份有限公司 一种游戏手柄模拟配置文件的配置方法及终端

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102404641A (zh) * 2011-12-06 2012-04-04 深圳Tcl新技术有限公司 使用智能手机遥控电视机的方法和***
CN102625010A (zh) * 2012-03-06 2012-08-01 清华大学 一种Eye-Free的触屏手机控制电视的方法
CN103000015A (zh) * 2012-12-13 2013-03-27 深圳Tcl新技术有限公司 基于无线传屏的显示设备精确遥控方法和装置
CN103024457A (zh) * 2012-12-20 2013-04-03 四川长虹电器股份有限公司 一种服务器端触屏控制方法及装置
CN103281575A (zh) * 2013-03-28 2013-09-04 四川长虹电器股份有限公司 一种智能电视新型控制方法
CN104185000A (zh) * 2014-08-11 2014-12-03 惠州华阳通用电子有限公司 一种跨屏互动的自动校准方法
CN104918073A (zh) * 2015-05-27 2015-09-16 深圳市金立通信设备有限公司 一种图像的显示方法及终端
CN105487856A (zh) * 2015-11-23 2016-04-13 深圳Tcl数字技术有限公司 移动终端控制显示终端上触屏应用程序的方法及***

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112445406A (zh) * 2019-08-29 2021-03-05 中兴通讯股份有限公司 终端屏幕操作方法及终端和存储介质

Also Published As

Publication number Publication date
CN105487856A (zh) 2016-04-13

Similar Documents

Publication Publication Date Title
WO2017088429A1 (fr) Procédé et système de commande d'un programme d'application d'écran tactile dans un terminal à écran par un terminal mobile
WO2015109865A1 (fr) Système et procédé de commande personnalisée pour mode de fonctionnement de climatiseur
WO2016173192A1 (fr) Procédé et dispositif de test de stabilité de télévision
WO2018018681A1 (fr) Procédé et dispositif de prévisualisation de programme vidéo
WO2019051902A1 (fr) Procédé de commande de terminal, climatiseur et support d'informations lisible par un ordinateur
WO2017084305A1 (fr) Procédé et système de contrôle d'un terminal
WO2019051887A1 (fr) Procédé et dispositif permettant de commander un appareil ménager, et support d'informations lisible par ordinateur
WO2017041538A1 (fr) Procédé et dispositif d'affichage commandé par interface utilisateur de terminal
WO2017036203A1 (fr) Procédé de commande de lecture pour une application multimédia, dispositif de télécommande et système de télévision
WO2016058258A1 (fr) Procédé et système de commande à distance de terminal
WO2017036208A1 (fr) Procédé et système pour extraire des informations dans une interface d'affichage
WO2018113187A1 (fr) Procédé de commande d'affichage et dispositif d'affichage
WO2019051897A1 (fr) Procédé et dispositif de réglage de paramètre de fonctionnement de terminal, et support d'informations lisible par ordinateur
WO2017084303A1 (fr) Procédé de commutation pour lanceur et système de commande de commutation
WO2017071223A1 (fr) Procédé et dispositif de commande pour une application de télévision
WO2015144052A1 (fr) Méthode et appareil de collecte de statistiques sur des informations de réseau
WO2018126888A1 (fr) Procédé et appareil de configuration d'un raccourci pour une fonction de télévision
WO2018006581A1 (fr) Procédé et appareil de lecture de télévision intelligente
WO2019051901A1 (fr) Procédé et dispositif de commande de terminal, et support d'informations lisible par ordinateur
WO2017059686A1 (fr) Procédé et dispositif d'affichage de bureau
WO2017041546A1 (fr) Procédé et appareil de connexion bluetooth de télévision
WO2018082186A1 (fr) Procédé et dispositif de positionnement d'emi pour télévision
WO2019019249A1 (fr) Procédé, appareil et dispositif d'exécution de demande de réseau, et support de stockage lisible par ordinateur
WO2017177523A1 (fr) Téléviseur intelligent et procédé de commande par icônes pour celui-ci
WO2017161697A1 (fr) Procédé et appareil de prévisualisation synchrone de multiples programmes de terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16867657

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 07/09/2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16867657

Country of ref document: EP

Kind code of ref document: A1