CN113365125A - Terminal control method and device, terminal and storage medium - Google Patents

Terminal control method and device, terminal and storage medium Download PDF

Info

Publication number
CN113365125A
CN113365125A CN202110601625.3A CN202110601625A CN113365125A CN 113365125 A CN113365125 A CN 113365125A CN 202110601625 A CN202110601625 A CN 202110601625A CN 113365125 A CN113365125 A CN 113365125A
Authority
CN
China
Prior art keywords
touch
information
terminal
display device
target position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110601625.3A
Other languages
Chinese (zh)
Inventor
翟泽
杨司烨
魏新勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN202110601625.3A priority Critical patent/CN113365125A/en
Publication of CN113365125A publication Critical patent/CN113365125A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42224Touch pad or touch panel provided on the remote control
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C23/00Non-electrical signal transmission systems, e.g. optical systems
    • G08C23/04Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42221Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42222Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The disclosure provides a control method and device of a terminal, the terminal and a storage medium. The control method of the terminal provided by the embodiment of the disclosure comprises the following steps: the terminal is connected with display device communication, includes: responding to the first operation event, determining and sending sensor information of the terminal to the display equipment, so that the display equipment determines a target position of a display interface of the display equipment according to the sensor information; and responding to the first touch event, generating touch information based on the first touch event and sending the touch information to the display equipment so that the display equipment responds according to the target position and the touch information. The method in the embodiment of the disclosure can enable the display device to execute corresponding response according to the sensor information and the touch information, thereby solving the problem of difficulty in remote touch interaction.

Description

Terminal control method and device, terminal and storage medium
Technical Field
The present disclosure relates to the field of intelligent terminal technologies, and in particular, to a terminal control method, an apparatus, a terminal, and a storage medium.
Background
The television is usually controlled by a remote controller, along with the development of the technology, the intelligent remote controller is widely used, and the intelligent remote controller is in communication connection with the television in a wireless connection mode so as to control the application on the television.
Disclosure of Invention
The disclosure provides a control method and device of a terminal, the terminal and a storage medium.
The present disclosure adopts the following technical solutions.
In some embodiments, the present disclosure provides a method for controlling a terminal, the terminal being in communication with a display device, including:
responding to a first operation event, determining and sending sensor information of the terminal to the display equipment, so that the display equipment determines a target position of a display interface of the display equipment according to the sensor information;
responding to a first touch event, generating touch information based on the first touch event and sending the touch information to the display equipment so that the display equipment responds according to the target position and the touch information.
In some embodiments, the present disclosure provides a method for controlling a display device, the display device being in communication connection with a terminal, including:
receiving sensor information sent by the terminal, and determining a target position of a display interface according to the sensor information;
and receiving touch information sent by the terminal, and responding according to the target position and the touch information.
In some embodiments, the present disclosure provides a control apparatus of a terminal, the terminal being communicatively connected to a display device, including:
the first determining unit is used for responding to a first operation event, determining and sending sensor information of the terminal to the display equipment, so that the display equipment determines a target position of a display interface of the display equipment according to the sensor information;
and the second determining unit is used for responding to a first touch event, generating touch information based on the first touch event and sending the touch information to the display equipment so that the display equipment responds according to the target position and the touch information.
In some embodiments, the present disclosure provides a control apparatus for a display device, the display device being in communication connection with a terminal, including:
the receiving unit is used for receiving the sensor information sent by the terminal;
the control unit is used for determining the target position of the display interface according to the sensor information;
the receiving unit is also used for receiving touch information sent by the terminal;
the control unit is further used for responding according to the target position and the touch information.
In some embodiments, the present disclosure provides a terminal comprising: at least one memory and at least one processor;
the memory is used for storing program codes, and the processor is used for calling the program codes stored in the memory to execute the method.
In some embodiments, the present disclosure provides a storage medium for storing program code for performing the above-described method.
The control method of the terminal provided by the embodiment of the disclosure comprises the following steps: terminal and display device communication connection, its characterized in that includes: responding to the first operation event, determining and sending sensor information of the terminal to the display equipment, so that the display equipment determines a target position of a display interface of the display equipment according to the sensor information; and responding to the first touch event, generating touch information based on the first touch event and sending the touch information to the display equipment so that the display equipment responds according to the target position and the touch information. The method in the embodiment of the disclosure can enable the display device to execute corresponding response according to the sensor information and the touch information, so that the problem of difficulty in remote touch interaction can be solved.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.
Fig. 1 is a flowchart of a control method of a terminal according to an embodiment of the present disclosure.
Fig. 2 is a flowchart of a control method of a display apparatus according to an embodiment of the present disclosure.
Fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be understood that various steps recited in method embodiments of the present disclosure may be performed in parallel and/or in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a" or "an" in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that reference to "one or more" unless the context clearly dictates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
The embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.
With the development of the technology, the smart television is gradually familiar to users, the traditional remote controller controls the television through the direction key, and under the condition that the screen of the smart television is larger and larger, the remote controller adopting the direction key is not matched with the smart television and is not suitable for touch application, so that the problem of difficult operation occurs, and under the condition of remote interaction, the touch interaction is inconvenient.
Some embodiments of the present disclosure provide a control method for a terminal, where the terminal is in communication connection with a display device, the terminal in some embodiments of the present disclosure may be a remote controller, a mobile phone, a tablet, and the like, and the display device may be a television, a display, and the like, referring to fig. 1, the control method for the terminal includes:
s11: and responding to a first operation event, determining and sending sensor information of the terminal to the display equipment, so that the display equipment determines a target position of a display interface of the display equipment according to the sensor information.
In some embodiments, the first operation event may be, for example, a moving operation on the terminal, after the first operation event is detected, the terminal acquires sensor information of itself, such as position sensor information, motion sensor information, gyroscope information, and the like, and sends the sensor information to the display device, the display device generates a target position of a control identifier corresponding to the terminal according to the sensor information, and the target position is a position on a display interface of the display device, which may be a point, an area, or an application.
S12: responding to a first touch event, generating touch information based on the first touch event and sending the touch information to the display equipment so that the display equipment responds according to the target position and the touch information.
In some embodiments, the terminal has a touch area, a first touch event is performed in the touch area, for example, a click event, a slide event, and the like, the touch information is information associated with the first touch event, for example, information such as a touch type, a touch trajectory, a touch length, and the like of the first touch event, the terminal sends the touch information to the display device, and the display device responds according to the target position and the touch information. In some embodiments, the touch information may be responded to based on the target location.
In some embodiments, the display device (e.g. a television) supports a touch application, but a user can only approach the display device to perform a touch operation and cannot perform remote touch interaction during use, in some techniques, a terminal (e.g. a mobile phone) supports a function of an analog remote controller, but the analog remote controller with a key is not adapted to the touch application, in some embodiments of the disclosure, the display device determines a target position through sensor information of the terminal, so that when a remote position needs to be moved (e.g. a mouse needs to be moved remotely), the user does not need to repeatedly slide on a touch area of the terminal to perform remote position movement, and the user does not need to perform remote movement through a key control manner, thereby improving convenience of operation and responding to touch information, so as to support operation of the touch application on the display device, according to some embodiments of the present disclosure, remote movement is realized through sensor information of a terminal, touch operation on a display device is realized through touch information, and remote touch interaction with the display device is realized by combining the sensor information and the touch information.
To illustrate a specific embodiment, a plurality of touch applications are displayed on a display device, in order to facilitate the operation of the touch applications on the display device, a user performs a first operation on a terminal, the terminal acquires sensor information of the terminal and transmits the sensor information to the display device, so as to control a control mark (such as an air mouse) on the display device to move to a target position, the target position is determined by the display device according to the sensor information of the mobile terminal, for example, the user moves the terminal to the right to move the control mark displayed on a display interface of the display device to the right by moving the terminal to the right, then the user performs a first touch operation on the terminal, such as a touch gesture operation, a click operation, a sliding operation, etc., the terminal generates touch information according to the first touch operation, transmits the touch information to the display device, and the display device responds to the first touch operation according to the touch information, for example, the first touch information is responded to the target position, so that the problem of inconvenience in remote touch is solved.
In some embodiments of the present disclosure, in response to a first touch event, generating touch information based on the first touch event and sending the touch information to the display device, so that the display device simulates the first touch event according to the touch information and responds to the simulated first touch event.
In some embodiments, the terminal generates touch information after detecting the first touch event, the first touch information may include a touch type, a touch trajectory, and the like of the first touch event, the display device may simulate the first touch event according to the touch information, and the display device may display the touch trajectory of the first touch event on the display device by simulating the first touch event instead of directly responding to the touch information, for example, when a user draws on the display device, a sliding touch operation of drawing is performed on the terminal, if a drawn line corresponding to the sliding touch operation is displayed by directly responding to the touch information, the user experience may be poor and the drawn process may not be viewed, in some embodiments of the disclosure, because the first touch event is simulated according to the touch information, so that the simulated first touch event acts on the display device, therefore, the process of the first touch event is truly displayed, and the use experience of the user is better.
In some embodiments of the present disclosure, the sensor information comprises: and the displacement information and the orientation information of the terminal are used for enabling the display equipment to determine the target position of the orientation of the terminal according to the displacement information and the orientation information.
In some embodiments, the displacement information in the sensor information may be obtained by an acceleration sensor of the terminal, the acceleration information obtained by the acceleration sensor is integrated with time as a variable to obtain speed information, the speed information is integrated with time as a variable to obtain displacement information, the orientation information in the sensor information may be obtained by a gyroscope of the terminal, the displacement information of the terminal may represent a distance that the terminal moves in space, and the orientation information of the terminal represents a position at which the terminal is currently pointed, in some embodiments, a control identifier is displayed on the display device, the control identifier is controlled by the terminal, the control identifier may be moved by the displacement information, but if the control identifier is controlled only by the displacement information, the user needs to move the terminal by a longer distance when the user wants to move the control identifier remotely, this obviously is unfavorable for user's use experience, therefore, this disclosure combines the orientation information of terminal, and display device can move the control sign according to the displacement information to adjust the position of control sign according to the orientation information, for example, can be in the preset distance near the position that moves according to the displacement information, adjust the position of control sign according to the orientation information, compare with the position of control sign through displacement information adjustment, adjust the position through the mode of adjusting the orientation information and also be favorable to carrying out comparatively meticulous touch operation on display device.
In some embodiments of the present disclosure, the touch information includes a touch area corresponding to the first touch event, so that the display device executes a corresponding response according to a size relationship between the touch area and an area threshold. In some embodiments, the touch area refers to a size of an area on the touch area of the terminal where a first touch event is performed, for example, the first touch event is a touch click event, the user clicks the touch area of the terminal with a finger, and the touch area is an area where the finger of the user is in contact with the touch area, different response modes can be performed on the display device for the same touch operation under different touch areas, in some embodiments, the response modes for different touch areas are different under the same application of the display device, for example, under a drawing board application of the display device, when the touch area is smaller than an area threshold, a drawing identifier for drawing is displayed so as to draw a drawing, and when the touch area is not smaller than the area threshold, a control identifier is displayed, and the control identifier can be used for selecting a tool in the drawing board application, for example, therefore, the user can enable the display equipment to display different types of marks by changing the touch area of touch control without switching the marks, and the operation of the user is reduced. In some embodiments, when the first touch event is a touch click event, the touch area may be a contact area with the touch area at the time of touch click, when the first touch event is a touch slide event, the touch area may be an average area of a touch trajectory of a unit length of touch slide (e.g. 1cm or 5mm), for example, when the user slides 10 units of length on the touch area, then a total contact area with the touch area during the touch slide operation is calculated, and then the total area is divided by 10 to obtain an average area of the touch trajectory of the unit length of touch slide, it should be noted that, in the case that the type of the first touch event is different, the area threshold of the display device may be different, for example, when the first touch event is a touch click event, the area threshold compared with the touch area is a value of 1, and when the first touch event is a touch slide event, the area threshold value compared with the touch area is a value 2, and the value 1 is different from the value 2, because the algorithm for the touch area may be different under the condition that the type of the first touch event is different, and the setting of different area threshold values is more scientific.
In some embodiments, different applications of the display device respond to the same touch information in different ways, for example, in a drawing board application, the display device performs entry of a drawing track according to a touch track in the touch information. Under the desktop application, the display device executes sliding operation of the control identifier according to the touch track in the touch information, or moves the desktop icon based on the touch track if the desktop icon is positioned based on the first control operation. In some embodiments, the display device may analyze the touch trajectory in the touch information in two ways, one way is to perform a corresponding response way according to the absolute length of the touch trajectory on the terminal, that is, if the touch trajectory of the first touch event on the terminal is 5cm, the display device also responds to the touch trajectory of 5cm, for example, the display device may simulate the first touch event with a touch trajectory of 5cm according to the touch information, so as to respond. In other embodiments, the display device scales the length of the touch track in the touch information, for example, a scaling coefficient may be preset, the scaling coefficient may be calculated according to a ratio between the touch area of the terminal and the display area of the display device, for example, the scaling coefficient may further be an area ratio between the display area of the display device and the touch area of the terminal, the display device uses a product of the length of the touch track in the touch information and the scaling coefficient as the length of the touch track to be responded, and responds to the length of the touch track, for example, the area of the display device is 10 times the area of the touch area of the terminal, if the length of the touch track in the touch information of the first touch event is 5cm, the display device multiplies the length of the touch track by 10, that is, 50cm is regarded as the length of the touch track to be responded, of course, the calculation of the product of the length of the touch trajectory and the scaling factor may also be performed by the terminal, and the terminal sends the product of the length of the touch trajectory and the scaling factor to the display device. In some cases, the display device may determine whether to respond to the absolute length of the touch trajectory or to respond to the product of the length of the touch trajectory and the scaling factor according to the size of the touch area, for example, a touch trajectory in which a user performs sliding on the terminal, where the touch area may be a touch area of a unit length (e.g., 1cm or 5mm) of the touch trajectory, and if the touch area is smaller than an area threshold, the display device directly responds to the absolute length of the touch trajectory, and if the touch area is not smaller than the area threshold, the display device performs product calculation on the absolute length of the touch trajectory and the scaling factor, and responds to the calculated length. Therefore, by setting the relation between different touch areas and the area threshold value, the user does not need to switch, and only needs to change the contact area between the finger and the touch area of the terminal when the user carries out the first touch event, so that different response modes can be carried out on the display device, the operation modes of the user are enriched, the operation of switching by the user is reduced, and the experience is improved.
In other embodiments of the present disclosure, a control method of a display device is provided, where the display device is in communication connection with a terminal, the display device may be the display device in any embodiment of the present disclosure, and the terminal may be the terminal in any embodiment of the present disclosure. Referring to fig. 2, the method includes:
s21: and receiving sensor information sent by the terminal, and determining the target position of a display interface according to the sensor information.
In some embodiments, the terminal and the display device may be in communication connection through WIFI or infrared, the display device receives sensor information sent by the terminal, the sensor information may be information acquired by a sensor of the terminal itself, and may include, for example, information of a motion sensor and information of a gyroscope, the display device may determine a target position according to the sensor information sent by the terminal, and the target position may be a point position or an area, and may be an application or a position within an application, for example.
S22: and receiving touch information sent by the terminal, and responding according to the target position and the touch information.
In some embodiments, the touch information is generated by the terminal in response to the first touch operation, and the display device may respond to the touch information at the target position, or respond to the touch information by an application pointed at the target position.
In some embodiments of the present disclosure, the display device may be a display device having a touch display screen, and for a scenario of remote touch interaction, a user cannot directly perform touch operation on the display device, and the key remote controller is not suitable for touch interaction.
In some embodiments of the present disclosure, responding according to the target position and the touch information includes: and simulating a first touch event according to the touch information, and responding to the simulated first touch event. In some embodiments, after receiving the touch information, the display device simulates a first touch event according to the touch information, where the first touch event may be a touch event detected on the terminal, rather than directly responding to the touch information, and by simulating the first touch event, feedback of the user after touch on the terminal may be more realistic, and the user may clearly see a touch response process rather than directly giving a response result, so that user experience is better.
In some embodiments of the present disclosure, the sensor information includes displacement information and orientation information of the terminal, and the target position towards which the terminal is oriented is determined according to the displacement information and the orientation information. In some embodiments, the display device may move the control identifier on the display device by a larger distance according to the displacement information, and move the control identifier in a small range according to the orientation information, for example, the control identifier may move to the position 1 according to the displacement information, and then move to the target position within a preset distance range near the position 1 according to the orientation information, so that a user may conveniently perform control in a large distance by using a mobile terminal, and may conveniently perform fine movement by using a terminal orientation adjustment manner.
In some embodiments of the present disclosure, the touch information includes a touch area; responding according to the target position and the touch information, and the method comprises the following steps: and determining the size relation between the touch area and an area threshold, and executing corresponding response according to the size relation.
In some embodiments, the touch area may be calculated in a manner related to the type of the first touch event, and the touch areas of the single-point touch event and the sliding touch event may be calculated in different manners. The response mode executed when the touch area is smaller than the area threshold may be different from the response mode when the touch area is not smaller than the area threshold, and the corresponding response executed according to the magnitude relationship may be determined based on the currently opened current application, and the response modes in different applications are different. For example, the touch information is information of a first touch event, in the case that the first touch event is a single-point touch event, if the touch area is smaller than the area threshold, the display device may consider the first touch event to be used for selection, and if the touch area is not smaller than the area threshold, the display device may consider the first touch event to be used for invoking the option menu, which reduces the waiting time of the user compared to invoking the option menu by a long-press method.
In some embodiments of the present disclosure, the touch information corresponds to a single-point touch event; in a first application of the display device, if the touch area is smaller than the area threshold, a first identifier is displayed, and if the touch area is not smaller than the area threshold, a second identifier is displayed, wherein the first identifier and the second identifier have different purposes.
In some embodiments, taking the first application as a palette application, taking the first touch event as a single-point touch event as an example, responding to the single-point touch by the terminal, acquiring a touch area of the single-point touch and sending the touch area to the display device, receiving the touch area of the single-point touch by the display device, determining a response mode to touch information according to the current application, taking the current application as the palette application as an example, if the touch area is smaller than an area threshold, displaying a brush, executing an entry action of the brush, and if the touch area is not smaller than the area threshold, displaying a control identifier, such as a mouse, so as to execute operations such as selection. Therefore, different response modes are executed through different touch areas, the response modes can be associated with the current application, and users can directly enable the display equipment to execute different response modes through the same touch operation without performing related switching operation, so that the interaction diversity is improved.
In some embodiments of the present disclosure, responding according to the target position and the touch information includes: responding according to the target position and the touch information based on the current application of the display equipment. In some embodiments, the display device identifies a type of a current application interface, analyzes a control operation corresponding to the touch information based on the type, and starts to execute the control operation based on the target position.
In some embodiments, under different current applications of the display device, response modes to the same target position and touch information may be different, for example, under a drawing board application, inputting of a brush may be performed according to the target position and the touch information, and under a desktop application, a displayed application may be switched according to the target position and the touch information. For example, a plurality of windows are displayed on the desktop, applications are displayed in the windows, a target window is selected through a target position, and the applications displayed in the target window are switched through touch information.
In some embodiments of the present disclosure, the response mode to the same touch information is different in different applications of the display device. For example, in a desktop application, the touch information corresponding to the sliding touch may be responded to switch the application displayed on the desktop, and in a drawing board application, the touch information corresponding to the sliding touch may be responded to perform drawing.
In some embodiments, the display device responds differently to different touch information within the same application. For example, in a desktop application, the touch information corresponding to the click touch operation may respond to selecting and opening an application on the desktop, and the touch information corresponding to the slide touch operation may respond to switching of a display application of the desktop. For another example, in a drawing board application, the touch information of the single-point touch operation may be responded by executing a display brush, where the brush is used for drawing, and the touch information of the double-point touch operation may be responded by executing a display control flag, where the control flag may be used for performing a selection operation.
In some embodiments of the present disclosure, responding according to the target position and the touch information includes: determining a display window where the target position is located; determining a first touch event corresponding to the touch information; and switching a display page in the display window according to the first touch event.
In some embodiments, the display window is used for displaying an application, and the switching operation of the application in the display window can be realized through the sensor information and the touch information. For example, two windows are displayed on a desktop, one of the two windows is located through a target position, a running first application is displayed in the target window, touch information may be, for example, touch information corresponding to a sliding touch operation, a user generates the touch information by executing the sliding touch operation on a terminal, after receiving the touch information, the display device executes a response of the sliding touch according to the touch information, switches the application displayed in the target window to a second application, and the second application may run directly in the target window.
In other embodiments, the applications in the display device are displayed in a hierarchical manner, the display depth may be determined according to the target position, the application in the target hierarchy is selected by default, and the position of the target hierarchy is adjusted according to the touch information, for example, the target hierarchy is moved to an upper hierarchy or a lower hierarchy.
Some embodiments of the present disclosure further provide a control apparatus for a terminal, where the terminal is in communication connection with a display device, and the control apparatus includes:
the first determining unit is used for responding to a first operation event, determining and sending sensor information of the terminal to the display equipment, so that the display equipment determines a target position of a display interface of the display equipment according to the sensor information;
and the second determining unit is used for responding to a first touch event, generating touch information based on the first touch event and sending the touch information to the display equipment so that the display equipment responds according to the target position and the touch information.
In some embodiments, the second determining unit is configured to generate touch information based on a first touch event and send the touch information to the display device in response to the first touch event, so that the display device simulates the first touch event according to the touch information and responds to the simulated first touch event.
In some embodiments, the sensor information comprises: and the displacement information and the orientation information of the terminal are used for enabling the display equipment to determine the target position of the orientation of the terminal according to the displacement information and the orientation information.
In some embodiments, the touch information includes a touch area corresponding to the first touch event, so that the display device executes a corresponding response according to a size relationship between the touch area and an area threshold.
Some embodiments of the present disclosure further provide a control apparatus for a display device, where the display device is in communication connection with a terminal, and the control apparatus includes:
the receiving unit is used for receiving the sensor information sent by the terminal;
the control unit is used for determining the target position of the display interface according to the sensor information;
the receiving unit is also used for receiving touch information sent by the terminal;
the control unit is further used for responding according to the target position and the touch information.
In some embodiments, the responding, by the control unit, according to the target position and the touch information includes:
and simulating a first touch event according to the touch information, and responding to the simulated first touch event.
In some embodiments, the sensor information includes displacement information and orientation information of the terminal, and the control unit determines the target position towards which the terminal is oriented according to the displacement information and the orientation information.
In some embodiments, the touch information comprises a touch area; the control unit responds according to the target position and the touch information, and the method comprises the following steps: and determining the size relation between the touch area and an area threshold, and executing corresponding response according to the size relation.
In some embodiments, the touch information corresponds to a single-point touch event; the control unit is used for displaying a first identifier in a first application of the display device if the touch area is smaller than the area threshold, and displaying a second identifier if the touch area is not smaller than the area threshold, wherein the first identifier and the second identifier have different purposes.
In some embodiments, the responding, by the control unit, according to the target position and the touch information includes: responding according to the target position and the touch information based on the current application of the display equipment.
In some embodiments, in different applications of the display device, the control unit responds to the same touch information in different ways; and/or the response modes of the control unit to different touch information are different in the same application of the display equipment.
In some embodiments, controlling to respond according to the target position and the touch information includes: determining a display window where the target position is located; determining a first touch event corresponding to the touch information; and switching a display page in the display window according to the first touch event.
For the embodiments of the apparatus, since they correspond substantially to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described apparatus embodiments are merely illustrative, wherein the modules described as separate modules may or may not be separate. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
The method and apparatus of the present disclosure have been described above based on the embodiments and application examples. In addition, the present disclosure also provides a terminal and a storage medium, which are described below.
Referring now to fig. 3, a schematic diagram of an electronic device (e.g., a terminal device or server) 800 suitable for use in implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in the drawings is only an example and should not bring any limitation to the functions and use range of the embodiments of the present disclosure.
The electronic device 800 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 801 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)802 or a program loaded from a storage means 808 into a Random Access Memory (RAM) 803. In the RAM803, various programs and data necessary for the operation of the electronic apparatus 800 are also stored. The processing apparatus 801, the ROM 802, and the RAM803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.
Generally, the following devices may be connected to the I/O interface 805: input devices 806 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 807 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage 808 including, for example, magnetic tape, hard disk, etc.; and a communication device 809. The communication means 809 may allow the electronic device 800 to communicate wirelessly or by wire with other devices to exchange data. While the figure illustrates an electronic device 800 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication means 809, or installed from the storage means 808, or installed from the ROM 802. The computer program, when executed by the processing apparatus 801, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to perform the methods of the present disclosure as described above.
Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, there is provided a control method of a terminal, the terminal being in communication connection with a display device, including:
responding to a first operation event, determining and sending sensor information of the terminal to the display equipment, so that the display equipment determines a target position of a display interface of the display equipment according to the sensor information;
responding to a first touch event, generating touch information based on the first touch event and sending the touch information to the display equipment so that the display equipment responds according to the target position and the touch information.
According to one or more embodiments of the present disclosure, a control method of a terminal is provided, which, in response to a first touch event, generates touch information based on the first touch event and sends the touch information to a display device, so that the display device simulates the first touch event according to the touch information and responds to the simulated first touch event.
According to one or more embodiments of the present disclosure, there is provided a control method of a terminal, the sensor information including: and the displacement information and the orientation information of the terminal are used for enabling the display equipment to determine the target position of the orientation of the terminal according to the displacement information and the orientation information.
According to one or more embodiments of the present disclosure, a control method of a terminal is provided, where the touch information includes a touch area corresponding to the first touch event, so that the display device executes a corresponding response according to a size relationship between the touch area and an area threshold.
According to one or more embodiments of the present disclosure, there is provided a control method of a display device, the display device being in communication connection with a terminal, the method including:
receiving sensor information sent by the terminal, and determining a target position of a display interface according to the sensor information;
and receiving touch information sent by the terminal, and responding according to the target position and the touch information.
According to one or more embodiments of the present disclosure, there is provided a control method of a display device responding according to the target position and the touch information, including:
and simulating a first touch event according to the touch information, and responding to the simulated first touch event.
According to one or more embodiments of the present disclosure, there is provided a control method of a display device, the sensor information including displacement information and orientation information of the terminal, the target position toward which the terminal is oriented being determined according to the displacement information and the orientation information.
According to one or more embodiments of the present disclosure, there is provided a control method of a display device, the touch information including a touch area; responding according to the target position and the touch information, and the method comprises the following steps: and determining the size relation between the touch area and an area threshold, and executing corresponding response according to the size relation.
According to one or more embodiments of the present disclosure, there is provided a control method of a display device, the touch information corresponding to a single-point touch event; in a first application of the display device, if the touch area is smaller than the area threshold, a first identifier is displayed, and if the touch area is not smaller than the area threshold, a second identifier is displayed, wherein the first identifier and the second identifier have different purposes.
According to one or more embodiments of the present disclosure, there is provided a control method of a display device responding according to the target position and the touch information, including:
responding according to the target position and the touch information based on the current application of the display equipment.
According to one or more embodiments of the present disclosure, there is provided a control method of a display device, in which response modes to the same touch information are different in different applications of the display device; and/or different response modes to different touch information are different in the same application of the display device.
According to one or more embodiments of the present disclosure, there is provided a control method of a display device responding according to the target position and the touch information, including: determining a display window where the target position is located; determining a first touch event corresponding to the touch information; and switching a display page in the display window according to the first touch event.
According to one or more embodiments of the present disclosure, there is provided a control apparatus of a terminal, the terminal being communicatively connected to a display device, including:
the first determining unit is used for responding to a first operation event, determining and sending sensor information of the terminal to the display equipment, so that the display equipment determines a target position of a display interface of the display equipment according to the sensor information;
and the second determining unit is used for responding to a first touch event, generating touch information based on the first touch event and sending the touch information to the display equipment so that the display equipment responds according to the target position and the touch information.
According to one or more embodiments of the present disclosure, there is provided a control apparatus of a display device, the display device being in communication connection with a terminal, including: the receiving unit is used for receiving the sensor information sent by the terminal; the control unit is used for determining the target position of the display interface according to the sensor information; the receiving unit is also used for receiving touch information sent by the terminal; the control unit is further used for responding according to the target position and the touch information.
According to one or more embodiments of the present disclosure, there is provided a terminal including: at least one memory and at least one processor;
wherein the at least one memory is configured to store program code, and the at least one processor is configured to call the program code stored in the at least one memory to perform the method of any one of the above.
According to one or more embodiments of the present disclosure, there is provided a storage medium for storing program code for performing the above-described method.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims (15)

1. A control method of a terminal, wherein the terminal is in communication connection with a display device, the method comprises the following steps:
responding to a first operation event, determining and sending sensor information of the terminal to the display equipment, so that the display equipment determines a target position of a display interface of the display equipment according to the sensor information;
responding to a first touch event, generating touch information based on the first touch event and sending the touch information to the display equipment so that the display equipment responds according to the target position and the touch information.
2. The method of claim 1,
responding to a first touch event, generating touch information based on the first touch event and sending the touch information to the display device, so that the display device simulates the first touch event according to the touch information and responds to the simulated first touch event.
3. The method of claim 1, wherein the sensor information comprises: and the displacement information and the orientation information of the terminal are used for enabling the display equipment to determine the target position of the orientation of the terminal according to the displacement information and the orientation information.
4. The method of claim 1,
the touch information comprises a touch area corresponding to the first touch event, so that the display device executes a corresponding response according to the size relation between the touch area and an area threshold.
5. A control method of a display device, wherein the display device is in communication connection with a terminal, the method comprising:
receiving sensor information sent by the terminal, and determining a target position of a display interface according to the sensor information;
and receiving touch information sent by the terminal, and responding according to the target position and the touch information.
6. The method of claim 5, wherein responding according to the target location and the touch information comprises:
and simulating a first touch event according to the touch information, and responding to the simulated first touch event.
7. The method of claim 5, wherein the sensor information includes displacement information and orientation information of the terminal, and wherein the target position towards which the terminal is oriented is determined based on the displacement information and the orientation information.
8. The method of claim 5,
the touch information comprises a touch area;
responding according to the target position and the touch information, and the method comprises the following steps: and determining the size relation between the touch area and an area threshold, and executing corresponding response according to the size relation.
9. The method of claim 8,
the touch information corresponds to a single-point touch event;
in a first application of the display device, if the touch area is smaller than the area threshold, a first identifier is displayed, and if the touch area is not smaller than the area threshold, a second identifier is displayed, wherein the first identifier and the second identifier have different purposes.
10. The method of claim 5, wherein responding according to the target location and the touch information comprises:
responding according to the target position and the touch information based on the current application of the display equipment.
11. The method of claim 10,
in different applications of the display device, the response modes to the same touch information are different; and/or different response modes to different touch information are different in the same application of the display device.
12. The method of claim 5, wherein responding according to the target location and the touch information comprises:
determining a display window where the target position is located;
determining a first touch event corresponding to the touch information;
and switching a display page in the display window according to the first touch event.
13. A control device of a terminal, the terminal is connected with a display device in a communication way, and the control device is characterized by comprising:
the first determining unit is used for responding to a first operation event, determining and sending sensor information of the terminal to the display equipment, so that the display equipment determines a target position of a display interface of the display equipment according to the sensor information;
and the second determining unit is used for responding to a first touch event, generating touch information based on the first touch event and sending the touch information to the display equipment so that the display equipment responds according to the target position and the touch information.
14. A control device of a display device, the display device being in communication connection with a terminal, comprising:
the receiving unit is used for receiving the sensor information sent by the terminal;
the control unit is used for determining the target position of the display interface according to the sensor information;
the receiving unit is also used for receiving touch information sent by the terminal;
the control unit is further used for responding according to the target position and the touch information.
15. A terminal, comprising:
at least one memory and at least one processor;
wherein the at least one memory is configured to store program code and the at least one processor is configured to invoke the program code stored in the at least one memory to perform the method of any of claims 1 to 12.
CN202110601625.3A 2021-05-31 2021-05-31 Terminal control method and device, terminal and storage medium Pending CN113365125A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110601625.3A CN113365125A (en) 2021-05-31 2021-05-31 Terminal control method and device, terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110601625.3A CN113365125A (en) 2021-05-31 2021-05-31 Terminal control method and device, terminal and storage medium

Publications (1)

Publication Number Publication Date
CN113365125A true CN113365125A (en) 2021-09-07

Family

ID=77530442

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110601625.3A Pending CN113365125A (en) 2021-05-31 2021-05-31 Terminal control method and device, terminal and storage medium

Country Status (1)

Country Link
CN (1) CN113365125A (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110298700A1 (en) * 2010-06-04 2011-12-08 Sony Corporation Operation terminal, electronic unit, and electronic unit system
CN102830795A (en) * 2011-06-23 2012-12-19 艾利维公司 Remote control with motion sensitive device
US20130044051A1 (en) * 2011-08-19 2013-02-21 Youngho JEONG Image display device and method for operating the same
CN103019374A (en) * 2012-11-20 2013-04-03 四川虹微技术有限公司 Object tracking-based remote control system
US20130271404A1 (en) * 2012-04-12 2013-10-17 Lg Electronics Inc. Remote controller equipped with touch pad and method for controlling the same
US20140028921A1 (en) * 2012-07-25 2014-01-30 Samsung Electronics Co., Ltd. Method and mobile terminal for displaying information, method and display device for providing information, and method and mobile terminal for generating control signal
CN105282587A (en) * 2015-07-13 2016-01-27 深圳市美贝壳科技有限公司 Synchronous visualized intelligent television control method based on mobile phone
CN111641857A (en) * 2020-05-29 2020-09-08 北京字节跳动网络技术有限公司 Interaction method and device of controlled equipment, interaction method and device of main control equipment, terminal and storage medium
WO2020259542A1 (en) * 2019-06-26 2020-12-30 华为技术有限公司 Control method for display apparatus, and related device
CN112449227A (en) * 2020-10-26 2021-03-05 广州视源电子科技股份有限公司 Interaction method and device for touch screen application compatible with remote controller operation, smart television and storage medium

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110298700A1 (en) * 2010-06-04 2011-12-08 Sony Corporation Operation terminal, electronic unit, and electronic unit system
CN102830795A (en) * 2011-06-23 2012-12-19 艾利维公司 Remote control with motion sensitive device
US20130044051A1 (en) * 2011-08-19 2013-02-21 Youngho JEONG Image display device and method for operating the same
US20130271404A1 (en) * 2012-04-12 2013-10-17 Lg Electronics Inc. Remote controller equipped with touch pad and method for controlling the same
US20140028921A1 (en) * 2012-07-25 2014-01-30 Samsung Electronics Co., Ltd. Method and mobile terminal for displaying information, method and display device for providing information, and method and mobile terminal for generating control signal
CN103019374A (en) * 2012-11-20 2013-04-03 四川虹微技术有限公司 Object tracking-based remote control system
CN105282587A (en) * 2015-07-13 2016-01-27 深圳市美贝壳科技有限公司 Synchronous visualized intelligent television control method based on mobile phone
WO2020259542A1 (en) * 2019-06-26 2020-12-30 华为技术有限公司 Control method for display apparatus, and related device
CN111641857A (en) * 2020-05-29 2020-09-08 北京字节跳动网络技术有限公司 Interaction method and device of controlled equipment, interaction method and device of main control equipment, terminal and storage medium
CN112449227A (en) * 2020-10-26 2021-03-05 广州视源电子科技股份有限公司 Interaction method and device for touch screen application compatible with remote controller operation, smart television and storage medium

Similar Documents

Publication Publication Date Title
EP2564286B1 (en) Method and apparatus for providing interoperability between devices
CN108491149B (en) Split screen display method and terminal
CN111190520A (en) Menu item selection method and device, readable medium and electronic equipment
WO2019127439A1 (en) Calculator operation method and terminal
KR20150051292A (en) Method for sharing contents and electronic device thereof
CN110647286A (en) Screen element control method, device, equipment and storage medium
CN111902835A (en) Computationally efficient human-machine interface for Web browser tab user interface buttons
CN112181571A (en) Floating window display method, device, terminal and storage medium
US20230199262A1 (en) Information display method and device, and terminal and storage medium
CN114363686B (en) Method, device, equipment and medium for publishing multimedia content
US20240086053A1 (en) Display method and apparatus, electronic device, and storage medium
CN115576632A (en) Interaction method, interaction device, electronic equipment, storage medium and computer program product
CN110456957B (en) Display interaction method, device, equipment and storage medium
CN112306224A (en) Man-machine interaction method and device and electronic equipment
CN115576458A (en) Application window display method, device, equipment and medium
CN114489457B (en) Virtual object control method and device, readable medium and electronic equipment
CN113365125A (en) Terminal control method and device, terminal and storage medium
CN113076053A (en) Cursor remote control method and device, electronic equipment and storage medium
CN114397961A (en) Head-mounted display device control method, head-mounted display device assembly, and medium
CN114840117A (en) Element control method, device, equipment and medium of information input page
CN114661278A (en) Information display method and device, electronic equipment and storage medium
CN113504883A (en) Window control method and device, electronic equipment and storage medium
CN114997104A (en) Document display method and device, electronic equipment and storage medium
CN112083840A (en) Method, device, terminal and storage medium for controlling electronic equipment
CN112732214B (en) Control method, electronic device, and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination