CN114938468A

CN114938468A - Display device, screen control method, and storage medium

Info

Publication number: CN114938468A
Application number: CN202210430021.1A
Authority: CN
Inventors: 孟祥菲; 唐高明
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-04-22
Filing date: 2022-04-22
Publication date: 2022-08-23

Abstract

The disclosure relates to a display device, a screen control method and a storage medium, which are applied to the technical field of display and solve the problem that the screen control mode in the prior art is not convenient and flexible enough. The display device includes: a display screen; a controller configured to: responding to the movement operation of the control equipment, and determining a corresponding target position of the movement operation in the display screen according to position information which is sent by the control equipment and corresponds to the movement operation, wherein the control equipment comprises portable terminal equipment; and the receiving control equipment executes corresponding operation on the display content displayed at the target position according to the control instruction based on the control instruction sent by the corresponding target position in the display screen.

Description

Display device, screen control method, and storage medium

Technical Field

The present disclosure relates to the field of display technologies, and in particular, to a display device, a screen control method, and a storage medium.

Background

Along with the continuous development of science and technology, display device's function is more and more abundant, has brought very big facility for people's work and life. For example, in a meeting scenario, a user may play multimedia content through a display device, so that all participants watch the multimedia content through the display device. In the prior art, users usually pass through a remote control device paired with a display device, namely: the remote control pen controls the screen of the display device, and when the remote control pen is lost, breaks down or the electric quantity is too low, the user cannot control the screen of the display device, so that the screen control mode is not convenient and flexible.

Disclosure of Invention

In order to solve the technical problem or at least partially solve the technical problem, the present disclosure provides a display device, a screen control method, and a storage medium, which can control a screen of the display device through a control device when a remote control pen is lost, has a fault, or has an excessively low power through interaction between the control device and the display device, so that a screen control manner is more flexible.

In a first aspect, the present disclosure provides a display device comprising:

a display screen;

a controller configured to: responding to a moving operation of a control device, and determining a target position corresponding to the moving operation in the display screen according to position information corresponding to the moving operation, which is sent by the control device, wherein the control device comprises a portable terminal device;

and receiving a control instruction sent by the control equipment based on a corresponding target position in the display screen, and executing corresponding operation on the display content displayed at the target position according to the control instruction.

In some embodiments of the present disclosure, the controller is specifically configured to:

receiving position information corresponding to the mobile operation, which is sent by the control equipment, wherein the position information is a plurality of coordinate data collected by the control equipment;

converting the coordinate data based on the coordinate data and the resolution of the display device to obtain corresponding target coordinates;

and determining a corresponding target position of the moving operation in the display screen based on the target coordinates.

and receiving position information corresponding to the movement operation, which is sent by the control device, wherein the position information is determined based on the resolution of the display device.

In some embodiments of the present disclosure, the controller is further configured to:

and determining that the movement operation is a target movement operation before determining a corresponding target position of the movement operation in the display screen according to the position information corresponding to the movement operation, which is sent by the control equipment, in response to the movement operation of the control equipment.

receiving a target parameter change value corresponding to the moving operation and sent by the control equipment;

and if the target parameter change value exceeds the corresponding target parameter threshold value, determining that the moving operation is the target moving operation.

In some embodiments of the present disclosure, the display screen is further configured to:

after the controller receives a control instruction sent by the control equipment based on a corresponding target position in the display screen, displaying a corresponding target window;

the controller is specifically configured to: and displaying the target content after corresponding operation is performed on the display content displayed at the target position on the target window.

receiving an ending instruction sent by the control equipment;

and removing the target window and the target content according to the ending instruction.

In a second aspect, the present disclosure provides a screen control method, including:

responding to a moving operation of a control device, and determining a corresponding target position of the moving operation in a display screen of a display device according to position information which is sent by the control device and corresponds to the moving operation, wherein the control device comprises a portable terminal device;

In some embodiments of the present disclosure, the determining, in response to a moving operation of a control device, a target position corresponding to the moving operation in the display screen according to position information corresponding to the moving operation and sent by the control device includes:

responding to the movement operation of control equipment, and receiving position information which is sent by the control equipment and corresponds to the movement operation, wherein the position information is a plurality of coordinate data collected by the control equipment;

In some embodiments of the present disclosure, the method further comprises:

and determining that the movement operation is a target movement operation before determining a target position corresponding to the movement operation in the display screen according to the position information corresponding to the movement operation and sent by the control equipment in response to the movement operation of the control equipment.

In some embodiments of the present disclosure, the determining that the move operation is a target move operation includes:

In some embodiments of the present disclosure, the method further comprises:

and displaying the target content after corresponding operation is performed on the display content displayed at the target position on the target window.

In some embodiments of the present disclosure, the method further comprises:

receiving an ending instruction sent by the control equipment;

In a third aspect, the present disclosure provides a computer-readable storage medium comprising: the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements a screen control method as shown in the second aspect.

In a fourth aspect, the present disclosure provides a computer program product comprising: when the computer program product is run on a computer, the computer is caused to implement the screen control method as shown in the second aspect.

Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: the method comprises the steps of firstly responding to the moving operation of a control device, determining a corresponding target position of the moving operation in a display screen according to position information which is sent by the control device and corresponds to the moving operation, wherein the control device comprises a portable terminal device, then receiving a control instruction which is sent by the control device based on the corresponding target position in the display screen, and executing corresponding operation on display content displayed at the target position according to the control instruction.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.

FIG. 1A is a diagram illustrating an operation scenario between a display device and a remote control device according to the prior art;

FIG. 1B is a schematic diagram of an operational scenario between a display device and a control device according to one or more embodiments of the present disclosure;

fig. 2A is a block diagram of a hardware configuration of a display apparatus 200 according to one or more embodiments of the present disclosure;

fig. 2B is a schematic diagram of a software configuration in the display device 200 according to one or more embodiments of the present disclosure;

FIG. 3A is a system framework diagram for implementing a screen control method in accordance with one or more embodiments of the present disclosure;

FIG. 3B is an architecture diagram for implementing a screen control method in accordance with one or more embodiments of the present disclosure;

fig. 4A is a schematic flowchart of a screen control method according to an embodiment of the disclosure;

FIG. 4B is a schematic diagram illustrating a screen control method according to an embodiment of the disclosure;

fig. 4C is a schematic view of an interaction process between a control device and a display device in a screen control method according to an embodiment of the present disclosure;

fig. 4D is a schematic diagram of a first display interface of a display device according to an embodiment of the present disclosure;

fig. 4E is a schematic diagram of a second display interface after a display device performs a corresponding operation according to an embodiment of the present disclosure;

fig. 5A is a schematic flowchart of another screen control method provided in the embodiment of the present disclosure;

FIG. 5B is a schematic diagram of another screen control method provided by the embodiments of the present disclosure;

fig. 5C is a schematic diagram of a coordinate system of a plurality of coordinate data collected by a control device according to an embodiment of the present disclosure;

fig. 5D is a schematic diagram of an interaction process between a control device and a display device in another screen control method provided in the embodiment of the present disclosure;

fig. 6A is a schematic flowchart of another screen control method provided in the embodiment of the present disclosure;

FIG. 6B is a schematic diagram illustrating another screen control method according to an embodiment of the present disclosure;

fig. 6C is a schematic view illustrating an interaction process between a control device and a display device in another screen control method provided by the embodiment of the present disclosure;

fig. 6D is a schematic diagram of a third display interface when the display screen of the display device displays a target window according to the embodiment of the disclosure;

fig. 6E is a schematic diagram of a fourth display interface when the display of the display device displays the target content according to the embodiment of the disclosure.

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, aspects of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments and features in the embodiments of the present disclosure may be combined with each other.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced in other ways than those described herein; it is to be understood that the embodiments disclosed in the specification are only a few embodiments of the present disclosure, and not all embodiments.

At present, it is a common scenario in the display field to control a screen of a display device, for example, an education screen or a conference screen. Taking a conference screen as an example, the conference screen is a necessary electronic product for many companies, and compared with a traditional electronic device in a conference room, for example: computer, projecting apparatus, blackboard and stereo set etc. through meeting screen and whiteboard function, can write, mark and wipe etc. at will, and intelligent environmental protection has higher use value. In general, 3 to 20 people may participate in a small conference, and as many as 20 to 50 people may participate in a medium conference, how to achieve a better communication effect in the conference process becomes a problem of important consideration of the display screen.

The screen control mainly refers to editing and controlling multimedia files displayed in the display device, such as a presentation (PPT) or an Excel table. The screen control has specific application in many scenes, for example, in a conference scene, the core requirement of the screen control is to control the screen at any time and any place in the speech process, so that participants can better understand the viewpoint and the opinion of a conference interpreter, and a better communication effect is achieved.

It should be noted that: the display device in this embodiment may be understood as an electronic device having a display screen, for example, an education screen in an education scene, a conference screen in a conference scene, a multimedia device, and the like. The display screen may include: a capacitive screen, an electromagnetic screen, an infrared screen, etc., which is not limited in this embodiment.

Fig. 1A is a schematic diagram of an operation scenario between a display device and a remote control device in the prior art. In the prior art, when controlling a screen of a display device, a user needs to pair and connect a remote control pen 100 and the display device 200 first, and then the user controls the screen of the display device 200 by operating the remote control pen 100. However, when the remote control pen 100 is lost, malfunctions or the power is too low, the user cannot control the screen of the display device 200, which results in a inconvenient and flexible screen control method and a reduced user experience.

In some embodiments, the communication means of the stylus 100 and the display device 200 may include infrared protocol communication, bluetooth protocol communication, wireless or other wired means, etc., by any of which the display device 200 can be controlled. For example, the user may input a user instruction through keys on the remote control pen 100, voice input, control panel input, and the like to control the display apparatus 200.

In order to solve the above problems, in the present disclosure, a controller of a display device first responds to a movement operation of a control device, determines a target position corresponding to the movement operation in a display screen according to position information corresponding to the movement operation and sent by the control device, where the control device includes a portable terminal device, and then receives a control instruction sent by the control device based on the corresponding target position in the display screen, and executes a corresponding operation on display content displayed at the target position according to the control instruction.

Fig. 1B is a schematic diagram of an operation scenario between a display device and a control device according to one or more embodiments of the present disclosure. As shown in fig. 1B, a user may control the display device 200 through the control device 300, a PPT or Excel table or the like may be displayed on the display device 200, the user may move the control device 300, an angular velocity sensor in the control device 300 may acquire change data (i.e., position information) of the control device 300, such as coordinate information, an angle value, a velocity value, and the like, and transmit the change data to the display device 200, so that a subsequent movement operation of the display device 200 in response to the control device 300 determines a target position corresponding to the movement operation in the display screen according to the position information corresponding to the movement operation transmitted by the control device 300, and after receiving a control instruction transmitted by the control device 300 based on the corresponding target position in the display screen, the display device 200 performs a corresponding operation on display content displayed at the target position according to the control instruction.

The control device 300 may include a portable terminal device, and the portable terminal device may be understood as a device that is easily carried between usage places, and in general, the weight of the device is not more than 5kg without a handle, or not more than 23kg with a handle is a portable device.

In some embodiments, assuming a conference scene, the attendees can control their mobile phones through operations such as moving and rotating, and transmit the position information acquired by the mobile phones in the moving process to the display device, so that the screen of the display device can be controlled through the interaction between the mobile phones and the display device in the following process, the problem that the user cannot control the screen of the display device due to the loss of the remote control pen, failure or low electric quantity is avoided, and the user experience is improved.

In some embodiments, the display device 200 may receive the user's control through touch or gesture, etc., instead of receiving the instruction using the control device described above.

In some embodiments, the display device 200 may also be controlled by a manner other than the control device 300, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain the voice instruction, or may be received by a voice control device provided outside the display device 200.

In some embodiments, the control device 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control operation and data communication. The audio and video content displayed on the control device 300 can also be transmitted to the display device 200, so as to realize the synchronous display function. The display apparatus 200 may also perform data communication with a server through various communication means, and may allow the display apparatus 200 to perform communication connection through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server may be a cluster or a plurality of clusters, and may include one or more types of servers. The server may provide various contents and interactions to the display apparatus 200. The display device 200 may be a liquid crystal display, an OLED display, or a projection display device, etc.

Fig. 2A is a block diagram of a hardware configuration of a display apparatus 200 according to one or more embodiments of the present disclosure. As shown in fig. 2A, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface (i.e., a user input interface) 280. The controller 250 includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, first to nth interfaces for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner demodulator 210 receives a broadcast television signal through a wired or wireless reception manner, and demodulates an audio/video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals. The communicator 220 is a component for communicating with an external device or a server according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the server through the communicator 220. The detector 230 is used to collect signals of the external environment or interaction with the outside. The controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. User interface 280 may be used to receive control signals for stylus 100.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operation and displayed in a graphical manner. It may be an interface element such as an icon, a window, and a control displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, and other visual interface elements.

Fig. 2B is a schematic diagram of a software configuration in a display device 200 according to one or more embodiments of the present disclosure, and as shown in fig. 2B, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (referred to as an "Application layer"), an Application Framework (referred to as a "Framework layer"), an Android runtime (Android runtime) and system library layer (referred to as a "system runtime library layer"), and a kernel layer.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, applications in the application layer include, but are not limited to, the above examples.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software, including at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

In some embodiments, the display device is a device having a display function, such as a conference screen, an educational screen, or the like. In the display device:

an output interface (display 260, and/or audio output interface 270) configured to output user interaction information;

a communicator 220 for communicating with a server;

a controller 250 configured to: responding to a moving operation of a control device, and determining a target position corresponding to the moving operation in the display screen according to position information corresponding to the moving operation, which is sent by the control device, wherein the control device comprises a portable terminal device;

In some embodiments, the controller 250 is specifically configured to: receiving position information corresponding to the mobile operation, which is sent by the control equipment, wherein the position information is a plurality of coordinate data collected by the control equipment; converting the coordinate data to obtain a plurality of corresponding target coordinates based on the coordinate data and the resolution of the display equipment; and determining a corresponding target position of the moving operation in the display screen based on the target coordinates.

In some embodiments, the controller 250 is specifically configured to: and receiving position information corresponding to the movement operation, which is sent by the control equipment, wherein the position information is determined based on the resolution of the display equipment.

In some embodiments, the controller 250 is further configured to: and determining that the movement operation is a target movement operation before determining a corresponding target position of the movement operation in the display screen according to the position information corresponding to the movement operation, which is sent by the control equipment, in response to the movement operation of the control equipment.

In some embodiments, the controller 250 is specifically configured to: receiving a target parameter change value corresponding to the moving operation and sent by the control equipment; and if the target parameter change value exceeds the corresponding target parameter threshold value, determining that the moving operation is the target moving operation.

In some embodiments, the display screen 260 is further configured to: after the controller receives a control instruction sent by the control equipment based on a corresponding target position in the display screen, displaying a corresponding target window; the controller 250, in particular, is configured to: and displaying the target content after corresponding operation is performed on the display content displayed at the target position on the target window.

In some embodiments, the controller 250 is further configured to: receiving an ending instruction sent by the control equipment; and removing the target window and the target content according to the ending instruction.

In summary, according to the present disclosure, first, in response to a moving operation of a control device, a target position corresponding to the moving operation in a display screen is determined according to position information corresponding to the moving operation, which is sent by the control device, where the target position corresponds to the moving operation, and the control device includes a portable terminal device, and then receives a control instruction, which is sent by the control device based on the target position corresponding to the moving operation in the display screen, and executes a corresponding operation on display content displayed at the target position according to the control instruction.

Fig. 3A is a system framework diagram for implementing a screen control method according to one or more embodiments of the present disclosure, and as shown in fig. 3A, the system may include a target position determining module 301, a control instruction receiving module 302, and an operation executing module 303. After the system detects the moving operation of the control device, the moving operation is the operation triggered by a user to the control device, such as moving, rotating and the like, the target position determining module 301 responds to the moving operation of the control device, determines the target position corresponding to the moving operation in the display screen according to the position information corresponding to the moving operation sent by the control device, the control instruction receiving module 302 can receive the control instruction sent by the control device based on the corresponding target position in the display screen, and the operation executing module 303 executes the corresponding operation on the display content displayed at the target position according to the control instruction, so that the purpose that the user controls the display device through the control device is achieved, and the use experience of the user is improved.

Fig. 3B is an architecture diagram of a screen control method implemented according to one or more embodiments of the present disclosure, and based on the system framework, the implementation of the present disclosure in the android system is as shown in fig. 3B, where the android system mainly includes an application layer, a framework layer, a system runtime layer, and a kernel layer, and the implementation logic is mainly embodied in the application layer, and includes a target position determination module, a control instruction receiving module, and an operation execution module.

According to the screen control method provided by the embodiment of the disclosure, the corresponding target position of the mobile operation in the display screen is determined according to the position information which is sent by the control equipment and corresponds to the mobile operation, the control equipment comprises the portable terminal equipment, then the control instruction which is sent by the control equipment based on the corresponding target position in the display screen is received, the corresponding operation is executed on the display content displayed at the target position according to the control instruction, and through the interaction between the control equipment and the display equipment, when a remote control pen is lost, fails or the electric quantity is too low, the screen of the display equipment is controlled through the control equipment, so that the screen control mode is more flexible, the inconvenience in operation for a user can be avoided, and meanwhile, the use experience of the user can be improved. For more detailed description of the present solution, the following description is made with reference to fig. 4A by way of example, and it is understood that the steps involved in fig. 4A may include more steps or fewer steps in actual implementation, and the sequence between the steps may also be different, so as to enable the screen control method provided in the embodiment of the present disclosure to be implemented, and the embodiment of the present disclosure is not limited.

Fig. 4A is a schematic flowchart of a screen control method according to an embodiment of the disclosure; fig. 4B is a schematic diagram illustrating a screen control method according to an embodiment of the disclosure. The present embodiment is applicable to a case where the screen of the display device is controlled by the portable terminal device.

As shown in fig. 4A, the screen control method specifically includes the following steps:

and S410, responding to the moving operation of the control equipment, and determining a target position corresponding to the moving operation in the display screen according to the position information corresponding to the moving operation and sent by the control equipment.

Wherein the control device comprises a portable terminal device. A movement operation may be understood as an operation of the control device by the user, such as moving, rotating, etc. The position information may be a plurality of coordinate data collected by the control device, or data obtained by converting the collected coordinate data by the control device. The target position may be understood as a corresponding specific position in the display screen during the moving operation of the control device. An angular velocity sensor is a device for sensing and maintaining a direction, and a single-axis angular velocity sensor can only measure a change in a single direction, so that three single-axis angular velocity sensors are required to measure X, Y and a change in three directions of a Z-axis. At present, a universal three-axis angular velocity sensor can replace three single-axis angular velocity sensors, and has the advantages of small volume, light weight, simple structure, good reliability and the like. The angular velocity sensor in this embodiment may adopt a three-axis angular velocity sensor, and may also adopt other angular velocity sensors capable of measuring changes in three directions, which is not specifically limited in this embodiment.

The control equipment moves along with the control operation of a user, an angular velocity sensor in the control equipment can acquire corresponding position information according to the movement operation and simultaneously sends the acquired position information corresponding to the movement operation to the display equipment, or the control equipment sends the acquired position information corresponding to the movement operation to the display equipment when receiving a position information acquisition command sent by the display equipment. When the controller of the display device detects the position information sent by the control device, in response to the movement operation of the control device, according to the position information corresponding to the movement operation sent by the control device, the movement track generated by the movement operation of the control device can be converted into corresponding continuous coordinates in the display screen end of the display device, that is: and the controller determines a corresponding target position of the mobile operation in the display screen of the display equipment according to the position information.

And S420, receiving a control instruction sent by the control device based on the corresponding target position in the display screen, and executing corresponding operation on the display content displayed at the target position according to the control instruction.

Wherein, the control instruction may include: the instructions such as focus, zoom, mark, and comment, which are not limited in this embodiment.

After receiving a control instruction sent by the control device based on the corresponding target position in the display screen, the controller of the display device can directly execute corresponding operation on the display content displayed at the target position according to the control instruction.

In some embodiments, when the controller of the display device receives a focusing instruction sent by the control device based on the corresponding target position in the display screen, the focus of the display content displayed by the control target position is bright, and other parts are masked.

In some embodiments, when the controller of the display device receives a marking instruction sent by the control device based on the corresponding target position in the display screen, the display content displayed at the target position is controlled to be highlighted with an obvious color or line, and the specific color or line is determined according to the corresponding setting, which is not specifically limited in this embodiment.

In this embodiment, thereby realize the effect of remote control pen through controlgear and control the screen, because dispose angular velocity sensor (gyroscope) in the controlgear (for example cell-phone), angular velocity sensor can be fine to the removal actions such as rotation, deflection and measure to can the analysis judge user's actual action, satisfy display device's use scene, increase the product adaptation degree, improve user's use and experience.

Fig. 4C is a schematic view of an interaction process between a control device and a display device in a screen control method provided by the embodiment of the present disclosure, as shown in fig. 4C: the process of implementing the screen control method through the interaction between the control device and the display device has been described in detail in the foregoing embodiments, and is not repeated herein to avoid repetition.

Fig. 4D is a schematic diagram of a first display interface of a display device according to an embodiment of the disclosure, and as shown in fig. 4D, the first display interface displayed by the display device before responding to a movement operation of the control device is exemplarily shown.

Fig. 4E is a schematic diagram of a second display interface after a display device performs a corresponding operation according to an embodiment of the present disclosure, as shown in fig. 4E:

fig. 4E is a schematic diagram illustrating a second display interface after the display device obtained by the screen control method in the foregoing embodiment performs corresponding operations, assuming that the user performs control in response to the content displayed on the first display interface in fig. 4D. Fig. 4E shows a specific content 11, which corresponds to the specific content after the controller performs a corresponding operation on the display content displayed at the target position according to the control instruction.

In some embodiments, the screen control method may further specifically include: the method comprises the steps that a controller of the display device responds to multiple groups of moving operations of multiple control devices, and determines multiple target positions, corresponding to the multiple groups of moving operations in a display screen, according to the priority of each control device and position information, corresponding to the target group moving operations, sent by each control device, wherein the multiple control devices comprise at least two control devices, the multiple groups of moving operations correspond to the multiple control devices one by one, the multiple target positions correspond to the multiple groups of moving operations, and the target group moving operations are moving operations corresponding to the control devices; and receiving a control instruction sent by each control device based on the corresponding target position in the display screen, and executing corresponding operation on the corresponding display content in the display screen according to the control instruction.

The priority of each control device may be predetermined, or may be determined according to a specific situation, which is not specifically limited in this embodiment.

Specifically, the plurality of control devices may control the screen of the display device at the same time, and each control device receives a target group movement operation of a corresponding user, and collects corresponding position information based on the target group movement operation. And the control devices respectively send the collected position information corresponding to the target group movement operation to the display device, or the control devices send the collected position information corresponding to the target group movement operation to the display device when receiving a position information acquisition command sent by the display device. When the controller of the display device detects the position information sent by each control device, the controller responds to the multiple groups of movement operations of each control device, and when the controller simultaneously receives the position information corresponding to the multiple groups of movement operations, the controller sequentially determines multiple target positions corresponding to the multiple groups of movement operations respectively in the display screen according to the priority of each control device and the position information corresponding to the target group movement operations sent by each control device, namely: converting a moving track generated by the moving operation of the plurality of control devices into a corresponding continuous coordinate in a display screen end of the display device; when the position information corresponding to the multiple groups of moving operations received by the controller has a time sequence, sequentially determining multiple target positions corresponding to the multiple groups of moving operations in the display screen according to the time sequence. After the controller determines a plurality of target positions of the plurality of groups of movement operations respectively corresponding to the target positions in the display screen, after receiving control instructions sent by each control device based on the corresponding target positions in the display screen, the controller can respectively execute corresponding operations on corresponding display contents in the display screen according to the control instructions.

In the embodiment, the screen is controlled by the remote control pen through the control device, a plurality of users can control the screen of the display device at the same time, the use experience of the users is improved, and the use scene of the display device is met.

fig. 5B is a schematic diagram of another screen control method according to an embodiment of the disclosure. Optionally, this embodiment mainly further describes a process of determining a corresponding target position of the moving operation in the display screen.

As shown in fig. 5A, the screen control method specifically includes the following steps:

and S510, responding to the movement operation of the control equipment, and receiving position information which is sent by the control equipment and corresponds to the movement operation, wherein the position information is a plurality of coordinate data collected by the control equipment.

The position information is specifically a plurality of coordinate data acquired by an angular velocity sensor configured in the control device. The plurality of coordinate data are three-dimensional coordinate data.

Fig. 5C is a schematic diagram of a coordinate system of a plurality of coordinate data collected by a control device according to an embodiment of the present disclosure, as shown in fig. 5C: the control device is taken as a mobile phone for explanation, the origin of the coordinate system is the center point of the mobile phone screen, and a three-dimensional coordinate system is established by three directions (X, Y and Z) extending from the center point.

And S520, converting the coordinate data based on the coordinate data and the resolution of the display device to obtain corresponding target coordinates.

After receiving the plurality of coordinate data, converting the plurality of coordinate data through a corresponding coordinate conversion formula according to the plurality of coordinate data and the resolution of the display device, and converting the three-dimensional coordinate into the two-dimensional coordinate, thereby obtaining a plurality of corresponding target coordinates.

In some embodiments, the above method further comprises:

a controller of the display device performs a calibration operation on an angular velocity sensor of the control device, and determines an initial position of the control device based on the calibration operation.

Specifically, the calibration operation process is as follows: after the control equipment is directly opposite to the display equipment (the control equipment needs to be horizontally placed), three-dimensional coordinate data and gyro data (gyro data) corresponding to the current position of the control equipment are obtained, and the three-dimensional coordinate data is used as the initial position of the control equipment, so that the corresponding target position of the mobile operation in the display screen can be conveniently determined subsequently.

For example, taking fig. 5C as an example, the coordinate transformation formula is described, and the specific process is as follows:

the movement operation of the cellular phone in the XY direction in fig. 5C corresponds to the lateral movement in the display screen of the display device, and the movement operation of the cellular phone in the YZ direction corresponds to the longitudinal movement in the display screen of the display device. The target position corresponding to the mobile operation of the mobile phone end in the display screen of the display device can be defined according to the rotating angle and the moving distance of XYZ. Assuming that the resolution of the display screen is A × B and 2K, the XY axis 90 degrees corresponds to the pixel position of A/2, and the ZY axis 90 degrees corresponds to the pixel position of B/2.

Assuming that the initial position of the control device is (x0, y0, z0), the position data of the control device after the previous movement is (x1, y1, z1) and the position data of the control device after the current movement is (x2, y2, z2) in the position information corresponding to the movement operation, the process of converting the three-dimensional coordinates into the two-dimensional coordinates is as follows:

wherein cos α represents

And

cosine value of the included angle of (a); x represents the moving distance of the corresponding XY in the display screen; cos beta represents

And

cosine value of the included angle of (a); y represents the movement distance of the corresponding YZ in the display screen.

In this embodiment, the method can quickly convert the plurality of coordinate data collected by the control device to obtain the corresponding plurality of target coordinates.

In some embodiments, during the conversion of the plurality of coordinate data, the target coordinate cannot exceed the screen range of the display screen, and if the determined target coordinate exceeds the screen range of the display screen, the target coordinate is invalid data.

And S530, determining a corresponding target position of the moving operation in the display screen based on the plurality of target coordinates.

After the controller determines the plurality of target coordinates, because the target coordinates include the corresponding angle and the corresponding moving distance of the moving operation of the control device in the display screen of the display device, the controller can directly determine the corresponding target position of the moving operation in the display screen according to the plurality of target coordinates.

And S540, receiving a control instruction sent by the control equipment based on the corresponding target position in the display screen, and executing corresponding operation on the display content displayed at the target position according to the control instruction.

In this embodiment, position information corresponding to a mobile operation sent by a control device is received, the position information is a plurality of coordinate data acquired by the control device, the plurality of coordinate data are converted based on the plurality of coordinate data and the resolution of a display device to obtain a plurality of corresponding target coordinates, and a target position corresponding to the mobile operation in a display screen is determined based on the plurality of target coordinates, so that accuracy of the determined target position can be improved, smooth execution of subsequent steps is facilitated, and user experience is improved.

Fig. 5D is a schematic view of an interaction process between a control device and a display device in another screen control method provided by the embodiment of the present disclosure, as shown in fig. 5D: the process of implementing another screen control method provided by the embodiments of the present disclosure through interaction between the control device and the display device has been described in detail in the above embodiments, and is not repeated herein to avoid repetition.

In some embodiments of the present disclosure, the method further comprises:

Specifically, after the control device performs the moving operation, the angular velocity sensor configured in the control device can acquire a plurality of coordinate data, and after the plurality of coordinate data are obtained, the processor configured in the control device can directly perform coordinate conversion on the plurality of coordinate data according to the resolution of the display device, and send the converted data to the display device as the position information corresponding to the moving operation. Accordingly, the controller of the display apparatus can receive the position information. The process of coordinate transformation has already been described in the above embodiments, and is not described herein again to avoid repetition.

In this embodiment, the processing amount of the display device can be reduced by performing coordinate conversion at the control device side, the display device does not need to convert coordinate data again, and the target position corresponding to the mobile operation in the display screen can be directly determined based on the position information corresponding to the mobile operation sent by the control device, so that the efficiency is improved.

Fig. 6A is a schematic flowchart of another screen control method provided in the embodiment of the present disclosure; fig. 6B is a schematic diagram illustrating a principle of another screen control method according to an embodiment of the present disclosure. Optionally, this embodiment mainly describes a process before determining a target position corresponding to a moving operation in a display screen.

As shown in fig. 6A, the screen control method specifically includes the following steps:

and S610, determining that the moving operation is the target moving operation.

The target moving operation may be a preset moving operation, for example, a moving operation in which an acceleration change value of the control device exceeds a certain value, or other moving operations, or may be determined according to specific situations, which is not limited in this embodiment.

Specifically, since the control device is a device commonly used by a user, the control device may be triggered inadvertently to perform a movement operation, or the control device may slightly shake due to hand shake or the like, and in order to avoid this, the display device needs to determine that the movement operation is a target movement operation, so as to improve the accuracy of the screen control process.

S620, responding to the moving operation of the control equipment, and determining the target position corresponding to the moving operation in the display screen according to the position information corresponding to the moving operation and sent by the control equipment.

And S630, receiving a control instruction sent by the control equipment based on the corresponding target position in the display screen, and executing corresponding operation on the display content displayed at the target position according to the control instruction.

In this embodiment, before the display device responds to the movement operation of the control device and determines the target position corresponding to the movement operation in the display screen according to the position information corresponding to the movement operation sent by the control device, it is further determined that the movement operation is the target movement operation, which can ensure the smooth proceeding of the subsequent screen control process and avoid interference.

In some embodiments of the present disclosure, the determining that the moving operation is a target moving operation may specifically include:

The target parameter change value may be understood as a preset parameter change value, for example, an acceleration change value acquired by an angular velocity sensor, an X-axis displacement change value, a Y-axis displacement change value, a Z-axis displacement change value, and the like. The target parameter threshold may be a preset threshold corresponding to the target parameter variation value, or may be determined according to the specific situation, which is not specifically limited in this embodiment.

Specifically, after receiving a target parameter change value corresponding to the movement operation and sent by the control device, the controller of the display device compares the target parameter change value with a corresponding target parameter threshold value, and according to the size relationship between the target parameter change value and the corresponding target parameter threshold value, if the target parameter change value exceeds the corresponding target parameter threshold value, the movement operation is determined to be the target movement operation; in contrast, if the target parameter variation value does not exceed the corresponding target parameter threshold value, it is determined that the movement operation is not the target movement operation, and the movement operation at this time may be regarded as a malfunction.

In the embodiment, the method for determining the movement operation as the target movement operation is simple and quick, can save the working efficiency, and can avoid the interference of misoperation on the screen control process.

Fig. 6C is a schematic diagram of an interaction process between a control device and a display device in another screen control method provided by the embodiment of the present disclosure, as shown in fig. 6C: the process of implementing another screen control method provided by the embodiments of the present disclosure through interaction between the control device and the display device has been described in detail in the embodiments, and is not repeated here to avoid repetition.

In some embodiments of the present disclosure, the method may further specifically include:

Specifically, after a controller of the display device receives a control instruction sent by the control device based on a corresponding target position in the display screen, a corresponding target window is displayed, the position of the target window can be set by user, and meanwhile, a subsequent controller can display target content after corresponding operation is performed on display content displayed at the target position on the target window.

In the embodiment, the target window is displayed, so that a subsequent user can see the process after the specific control instruction is executed, and the error can be corrected in time when the error is found in the screen control process.

Fig. 6D is a schematic diagram of a third display interface when the display screen of the display device displays the target window according to the embodiment of the present disclosure, which exemplarily shows an implementation manner, and a dashed box indicated by 12 in fig. 6D is the target window.

Fig. 6E is a schematic diagram of a fourth display interface when the display of the display device displays the target content according to the embodiment of the present disclosure, and based on fig. 6D, the display device displays the target content corresponding to the execution of the control instruction on the target window 12 shown in fig. 6D, as shown in fig. 6E, the target content is 13.

In some embodiments of the present disclosure, the method may further specifically include: receiving an ending instruction sent by the control equipment; and removing the target window and the target content according to the ending instruction.

Specifically, the controller of the display device can also receive an end instruction sent by the control device, and remove the target window and the target content according to the end instruction.

In this embodiment, after the screen control process is finished, the display content of the display screen can be restored to the original content by the above method.

In some embodiments of the present disclosure, the method may further specifically include: and establishing communication connection between the control equipment and the display equipment, and establishing a data transmission channel.

The communication connection mode may be bluetooth connection or WIFI connection, and the present embodiment is not limited.

In this embodiment, through the data transmission channel, subsequent position information transmission and control instruction transmission can be facilitated.

In some embodiments of the present disclosure, it is assumed that the control device is a mobile phone, the display device is a conference screen, and the conference screen end creates an angular velocity sensor service, and through the conference screen bluetooth service, the data change of the angular velocity sensor of the mobile phone end is monitored in real time. The conference screen Bluetooth service is used for carrying out Bluetooth connection, data and control instruction transmission and the like with the mobile phone end, and the mobile phone end can directly utilize the existing Bluetooth service and sensor data. The screen control method may include the steps of:

1. establishing a Bluetooth connection between a conference screen and a mobile phone end, wherein the Bluetooth connection is a general Attribute protocol (GATT) connection, a GATT transaction is established on nested protocols (Profiles), Services (Services) and Characteristics (Characteristics), and data of three coordinate axes X/Y/Z acquired by an angular velocity sensor can be added in the Characteristics;

2. the method comprises the steps that a mobile phone end obtains coordinate data collected by an angular velocity sensor, specifically, the coordinate data can be obtained by a Bluetooth service through a sensor manager;

3. the conference screen carries out calibration operation of the angular velocity sensor at the mobile phone end, data obtained by the calibration operation are used as original data, and the original data are subtracted from the data obtained by the angular velocity sensor data detection service and used as new data;

4. the conference screen starts the data monitoring of the gyro angular velocity sensor: the conference screen Bluetooth service sends an instruction for acquiring data of the angular velocity sensor to the mobile phone end through the GATT, and after the mobile phone end receives the instruction, the coordinate data acquired by the angular velocity sensor is sent to the conference screen Bluetooth service through the mobile phone Bluetooth;

5. the control application of the mobile phone end sends a control instruction through mobile phone Bluetooth;

6. the conference screen Bluetooth instruction monitoring service is used for monitoring and forwarding the conference screen control instruction;

7. the conference screen application can interact with angular velocity sensor service and conference screen Bluetooth instruction monitoring service of a conference screen end.

To sum up, according to the screen control method executed on the display device, firstly, the control device responds to the movement operation of the control device, determines the corresponding target position of the movement operation in the display screen according to the position information which is sent by the control device and corresponds to the movement operation, the control device comprises the portable terminal device, then receives the control instruction which is sent by the control device based on the corresponding target position in the display screen, and executes corresponding operation on the display content displayed at the target position according to the control instruction, and through the interaction between the control device and the display device, when the remote control pen is lost, has a fault or has too low electric quantity, the screen of the display device is controlled through the control device, so that the screen control mode is more flexible, the inconvenience in operation for the user can be avoided, and meanwhile, the use experience of the user can be improved.

The disclosed embodiment provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the computer program implements each process executed by the screen control method, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here.

The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

The present disclosure provides a computer program product, comprising: when the computer program product runs on a computer, the computer is enabled to implement the screen control method described above.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the foregoing discussion in some embodiments is not intended to be exhaustive or to limit the implementations to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

a display screen;

2. The display device of claim 1, wherein the controller is specifically configured to:

3. The display device of claim 1, wherein the controller is specifically configured to:

4. The display device according to claim 1, wherein the controller is further configured to:

5. The display device of claim 4, wherein the controller is specifically configured to:

6. The display device of any one of claims 1-5, wherein the display screen is further configured to:

7. The display device of claim 6, wherein the controller is further configured to:

receiving an ending instruction sent by the control equipment;

8. A screen control method, comprising:

responding to a moving operation of a control device, and determining a target position corresponding to the moving operation in a display screen of a display device according to position information corresponding to the moving operation and sent by the control device, wherein the control device comprises a portable terminal device;

9. A computer-readable storage medium, comprising: the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements the screen control method of claim 8.

10. A computer program product, comprising: when the computer program product is run on a computer, causing the computer to implement the screen control method of claim 8.