CN114035759B - Screen control method, control terminal, screen and computer readable storage medium - Google Patents

Screen control method, control terminal, screen and computer readable storage medium Download PDF

Info

Publication number
CN114035759B
CN114035759B CN202110902778.1A CN202110902778A CN114035759B CN 114035759 B CN114035759 B CN 114035759B CN 202110902778 A CN202110902778 A CN 202110902778A CN 114035759 B CN114035759 B CN 114035759B
Authority
CN
China
Prior art keywords
screen
display instruction
user input
control terminal
input information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110902778.1A
Other languages
Chinese (zh)
Other versions
CN114035759A (en
Inventor
魏其源
梁晓琳
曹江
江永超
王英琪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Kangjia Optoelectronic Technology Co ltd
Original Assignee
Chongqing Kangjia Optoelectronic Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Kangjia Optoelectronic Technology Co ltd filed Critical Chongqing Kangjia Optoelectronic Technology Co ltd
Priority to CN202110902778.1A priority Critical patent/CN114035759B/en
Publication of CN114035759A publication Critical patent/CN114035759A/en
Priority to PCT/CN2022/110195 priority patent/WO2023011578A1/en
Application granted granted Critical
Publication of CN114035759B publication Critical patent/CN114035759B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1446Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention relates to a screen control method, a control terminal, a screen and a computer readable storage medium. The control terminal has a control relation with at least two screens, and the screen control method applied to the control terminal comprises the steps of acquiring user input information sent by at least one screen in the controlled screens; determining at least one display instruction according to the user input information, wherein each display instruction corresponds to at least one screen in the screens with control relation of the control terminal; and sending a display instruction to the target screen so that the target screen performs display control according to the display instruction. By the screen control method, in some implementation processes, a user can conveniently control a multi-screen system such as a spliced large screen or a distributed screen without going to a control terminal.

Description

Screen control method, control terminal, screen and computer readable storage medium
Technical Field
The present invention relates to the field of display control, and more particularly, to a screen control method, a control terminal, a screen, and a computer-readable storage medium.
Background
With the rapid development of display technology, the display screen is not only required to be applied to small-sized devices such as terminals and tablets, but also generates application demands in larger scenes. Because of the high cost of manufacturing and maintaining a single large screen, and the difficulty of the process, spliced or distributed isoperimetric large screen or multi-screen system implementations are becoming the mainstream.
However, for a large spliced screen or a distributed screen, a user cannot conveniently control the screen in the whole system in a mode of screen touch, gesture and the like.
Therefore, how to realize convenient control for multi-screen systems such as a spliced large screen or a distributed screen is a problem to be solved
Disclosure of Invention
In view of the above-mentioned shortcomings of the related art, an object of the present application is to provide a screen control method, a control terminal, a screen, and a computer-readable storage medium, which aim to solve the problem that it is difficult to achieve convenient control for a multi-screen system such as a tiled large screen or a distributed screen in the related art.
A screen control method applied to a control terminal, the control terminal having a control relationship with at least two screens, the screen control method comprising:
acquiring user input information sent by at least one screen in the controlled screens;
determining at least one display instruction according to the user input information, wherein each display instruction corresponds to at least one screen in the screens with control relation of the control terminal;
and sending the display instruction to a target screen so that the target screen performs display control according to the display instruction.
According to the screen control method, the control terminal obtains the user input information sent by at least one screen, the control terminal determines the display instruction of the screen according to the user input information, and sends the display instruction to the corresponding screen, so that unified and convenient control over the spliced large screen or the distributed screen is realized.
Optionally, the determining at least one display instruction according to the user input information includes:
identifying the user input information to obtain an identification result;
and generating at least one display instruction according to the identification result and the working relation between the at least two screens.
It can be understood that the control terminal determines the display instruction according to the actual working condition of the screen, and can adapt to screen control under various working conditions.
Optionally, the user input information includes a gesture image, and identifying the user input information to obtain an identification result includes:
and recognizing the gesture image to obtain a gesture motion track of the user, wherein the gesture motion track is used as a recognition result.
It can be understood that the control mode of the failed user gesture image is applied to the control of the multi-screen, so that the screen control of the multi-screen control system is facilitated, and the user experience is good.
Optionally, the control terminal and the screen controlled by the control terminal transmit information through wireless radio frequency;
the acquiring the user input information sent by at least one screen of the controlled screens comprises:
acquiring user input information sent by at least one screen in the controlled screens through wireless radio frequency;
the sending the display instruction to the target screen includes:
and sending the display instruction to the target screen through wireless radio frequency.
It can be understood that the screen is controlled in a wireless radio frequency mode, so that the limitation of the setting position and wiring condition of each screen in practical application is avoided, and the method is applicable to screen control in more and larger scenes.
Optionally, the acquiring the user input information sent by at least one screen of the controlled screens includes:
acquiring user input information respectively sent by at least two screens in the controlled screens, and determining target user input information according to the at least two user input information;
the determining at least one display instruction according to the user input information comprises the following steps:
and determining at least one display instruction according to the determined target user input information.
It will be appreciated that when more than one user input is received, the final target user input is determined by integrating the user inputs, and in some implementations, the accuracy of the determination of the user's inputs can be improved.
Based on the same inventive concept, the present application also provides a screen control method, applied to a screen, including:
establishing communication with a control terminal;
receiving a display instruction sent by the control terminal, wherein the display instruction is a display instruction corresponding to the screen, which is determined by the control terminal according to the acquired user input information, and the user input information comprises user input information sent to the control terminal by at least one screen in the screens controlled by the control terminal;
and performing display control according to the display instruction.
The screen control method applied to the screen enables the screen to receive the display instruction corresponding to the operation of the user on the screen and/or other screens controlled by the control terminal, wherein the display instruction is sent by the control terminal, and the screen can be systematically controlled. In some implementations, the problem that a multi-screen system such as a spliced screen and a distributed screen is difficult to control uniformly is solved.
Optionally, before receiving the display instruction sent by the control terminal, the method further includes:
acquiring infrared reflection information through an infrared receiving and transmitting module and acquiring color information through a color sensing module;
and determining the user input information according to the infrared reflection information and the color information, and sending the user input information to the control terminal so that the control terminal can determine the display instruction.
It can be understood that the infrared transceiver module and the color sensing module acquire user input information, so that a user can control the screen in a gesture, a somatosensory mode and the like. And the infrared reflection information and the color information are considered when the user input information is judged, and the accuracy of operation identification of the user is ensured in some implementation processes.
Based on the same inventive concept, the application also provides a control terminal, which comprises a processor, a memory and a communication bus;
the communication bus is used for realizing connection communication between the processor and the memory;
the processor is configured to execute one or more computer programs stored in the memory to implement the steps of the screen control method applied to the control terminal as described above.
The control terminal can determine the display instruction of the screen according to the actual working condition of the screen, and send the display instruction to the corresponding screen, so that independent work of each screen can be realized, and cooperative work of the whole display system can be completed, and unified and convenient control of a spliced large screen or a distributed screen is realized.
Based on the same inventive concept, the application also provides a screen, comprising a processor, a memory and a communication bus;
the communication bus is used for realizing connection communication between the processor and the memory;
the processor is configured to execute one or more computer programs stored in the memory to implement the steps of the screen control method applied to a screen as described above.
The screen can receive display instructions corresponding to the operation of a user on the screen and/or other screens controlled by the control terminal, and the screen can be controlled systematically. In some implementations, the problem that a multi-screen system such as a spliced screen and a distributed screen is difficult to control uniformly is solved.
Based on the same inventive concept, the present application also provides a computer-readable storage medium storing one or more computer programs executable by one or more processors to implement at least one of the following steps of:
The screen control method applied to the control terminal as described above;
the screen control method applied to the screen as described above.
When the computer program stored in the computer readable storage medium is executed by the processor, unified and convenient control over the spliced large screen or the distributed screen can be realized in some processes.
Drawings
Fig. 1 is a schematic flow chart of a screen control method applied to a control terminal according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of determining at least one display instruction according to user input information according to an embodiment of the present invention;
fig. 3 is a flowchart of a screen control method applied to a screen according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a control terminal according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a screen according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a flow chart for controlling an independently operated screen a controlled by a control terminal according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a flow chart II for controlling an independently operating screen A controlled by a control terminal according to an embodiment of the present invention;
fig. 8 is a schematic flow chart of controlling a plurality of synchronous screens controlled by a control terminal according to an embodiment of the present invention;
Fig. 9 is a schematic flow chart of controlling a screen of collaborative work controlled by a control terminal according to an embodiment of the present invention;
fig. 10 is a schematic diagram of a tiled display system according to an embodiment of the present invention;
FIG. 11 is a schematic diagram of a tiled display system for detecting user gestures according to an embodiment of the present invention;
FIG. 12 is a schematic flow chart of the embodiment of the present invention when a plurality of screens acquire gesture motion trajectories of the hands of a user;
fig. 13 is a schematic structural diagram of a control terminal according to another alternative embodiment of the present invention;
FIG. 14 is a schematic view of a screen according to another alternative embodiment of the present invention;
reference numerals illustrate:
a hand-10; a control terminal-100; a main control module-101; a first radio frequency module-102; screen-200; a light emitting chipset-201; an infrared emitter-202; an infrared receiver-203; color sensor-204; a processing module-205; a second radio frequency module-206; a display driving unit-207; a first processor-301; a first memory-302; a first communication bus-303; a second processor-401; a second memory-402; a second communication bus-403.
Detailed Description
In order to facilitate an understanding of the present application, a more complete description of the present application will now be provided with reference to the relevant figures. Preferred embodiments of the present application are shown in the accompanying drawings. This application may, however, be embodied in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.
In the related art, a user cannot conveniently control a spliced large screen or a distributed screen in a mode of screen touch, gesture and the like.
Based on this, the present application intends to provide a solution to the above technical problem, the details of which will be explained in the following embodiments.
Examples:
the present embodiment provides a screen control method, which is applied to a control terminal, where the control terminal has a control relationship with at least two screens, and referring to fig. 1, the screen control method of the present embodiment includes:
s101, acquiring user input information sent by at least one screen in the controlled screens;
s102, determining at least one display instruction according to user input information;
each display instruction corresponds to at least one screen in the screens with control relation of the control terminal;
s103, sending a display instruction to a target screen so that the target screen performs display control according to the display instruction.
The control terminal and the screen have a control relationship, namely the control terminal can send a display instruction to the screen, so that the screen can perform display control according to the display instruction. In this embodiment, the control terminal may have a control relationship with any number of screens, but each screen may be independent, or may be a relationship of cooperative work, or may be a relationship of synchronous work. It can be understood that independent screens can respectively display the content which is not related to each other, and the displayed content is not influenced by other screens; the screens of the collaborative work jointly display related content, such as a large screen formed by splicing a plurality of screens, and each screen on the large screen respectively displays a part of the complete content, so that the large screen can completely display the content to be displayed; the synchronously operated screens simultaneously display the same content. In some examples, the screens controlled by the control terminals may be partially independent, one part is in a cooperative working relationship, and the other part may work synchronously, that is, the embodiment does not limit that only one working relationship exists between the screens controlled by the control terminals, and under the condition that the processing capability of the control terminals is enough, various working relationships may coexist.
The control terminal can be used as a single device and arranged outside each screen, for example, in a distributed screen, the control terminal can be arranged at a relatively central position of each screen; or as a sub-device, to a certain screen or a certain part of a screen, for example, in a spliced screen, the control terminal can be set to a certain main control screen.
According to the screen control method, the control terminal determines the display instruction according to the user input information sent by the screen controlled by the control terminal, and sends the display instruction to the corresponding screen to realize display control, so that the user can effectively control the multi-screen display scene such as the spliced large-scale screen or the distributed screen without inputting to the control terminal.
In some embodiments, as shown in fig. 2, determining at least one display instruction according to the user input information includes:
s1021, identifying user input information to obtain an identification result;
s1022, generating at least one display instruction according to the identification result and the working relation between at least two screens;
illustratively, the working relationship between the screens includes collaborative work, and generating at least one display instruction according to the recognition result and the working relationship between at least two screens includes:
According to the user input information, determining a target screen and a display instruction corresponding to each target screen from the screens of which the work relation is collaborative work, wherein the target screen in the embodiment comprises a screen which needs to be controlled in order to execute a display operation corresponding to the user input information, and each display instruction can instruct the corresponding target screen to perform display control so that each target screen can jointly complete the display operation.
It will be appreciated that in screen control, not all screens may be involved in each control. For example, the user may need to turn off or on only a part of the plurality of screens or change the display contents of a part of the screens, and thus, before controlling the screens, determine the target screen to be controlled. When it is determined that the display operation corresponding to the user input information is to close the screen, a display instruction for closing the screen is generated, each screen to be closed is determined, and the control terminal sends the display instruction for closing the screen to each screen to be closed.
In other examples, the operational relationship includes a synchronous operation, and determining at least one display instruction according to the user input information and the operational relationship between the respective screens includes:
And determining that the target screens comprise screens with synchronous working relation and determining a display instruction corresponding to each target screen according to the user input information, wherein the display instruction can instruct the corresponding target screen to perform display control so that each target screen respectively completes display operation corresponding to the user input information.
That is, the display instructions determined by the control terminal for the respective screens whose operation relationship is synchronous operation are identical, and the respective screens can perform the same display control.
In an example, before determining at least one display instruction, determining whether a screen to be controlled by a user is a screen with a working relationship of collaborative work or a screen with a synchronous work according to user input information, if the screen to be controlled by the user is the screen with the collaborative work, determining a target screen from the screens with the working relationship of collaborative work according to the user input information, and if the screen to be controlled by the user is the screen with the synchronous work, taking all the screens with the working relationship of synchronous work as the target screen. In another example, if the control terminal is only provided with one working relationship, the target screen can be directly determined without judging the working relationship of the screen to be controlled by the user, that is, the target screen is directly determined from the screen with the working relationship of the collaborative work when the control terminal only controls the screen with the collaborative work, or all the screens with the synchronous work are directly used as the target screen when the control terminal only controls the screen with the synchronous work.
In some embodiments, the working relationship between the screens may be set, where the setting manner includes, but is not limited to, directly inputting an instruction into the control terminal, or adopting the screen control method of this embodiment, inputting corresponding user input information on at least one screen, so that the control terminal performs setting according to the user input information acquired from the screen side.
In some practical applications, the working relationship between the screens may include, in addition to the above-mentioned working modes (including but not limited to independent working, cooperative working, and synchronous working), a positional relationship (including but not limited to a relative and absolute position) when each screen works, and in some implementations, according to the positions of the screens, it is determined which screens are controlled to determine the corresponding display instruction.
In some embodiments, each display instruction is sent to all the screens controlled by the control terminal, when the screen receives the corresponding display instruction, the display instruction is executed, if the display instruction received by the screen is not corresponding to the display instruction, the display instruction is not executed, and the control mode is also suitable for broadcast type message interaction, the control terminal broadcasts the display instruction to all the screens, and each screen executes the corresponding display instruction or does not execute the display instruction. Or the display instruction can be selected to be transmitted to the screen corresponding to the display instruction, for example, the determined display instruction corresponds to one screen only, and then the display instruction is transmitted to the corresponding screen only, so that transmission resources are saved through more accurate information interaction.
The user input information of the present embodiment includes, but is not limited to, gesture images, touch controls, voices, and the like of the user. Taking a gesture image with user input information as a user as an example, identifying the user input information, and obtaining an identification result comprises: and recognizing the gesture image to obtain a gesture motion track of the user, wherein the gesture motion track is used as a recognition result, and generating a display according to the gesture motion track. Similarly, when the user input information includes touch, the type of touch (including but not limited to sliding and clicking) and/or the position information of touch (including but not limited to sliding track and clicking position) are identified, and when the user input information includes voice, the voice is identified to obtain text or other voice information that the user wants to input.
In some embodiments, the control terminal and the screen controlled by the control terminal transmit information through wireless radio frequency, and correspondingly, obtain user input information sent by at least one screen in the controlled screen, including:
acquiring user input information sent by at least one screen in the controlled screens through wireless radio frequency;
sending a display instruction to a target screen, comprising:
and sending the display instruction to the target screen through the wireless radio frequency.
The wireless radio frequency includes, but is not limited to, wifi, bluetooth or other wireless radio frequency communication modes.
In some embodiments, obtaining user input information sent by at least one of the controlled screens includes:
acquiring user input information respectively sent by at least two screens in the controlled screens, and determining target user input information according to the at least two user input information;
determining at least one display instruction according to the user input information, including:
and determining at least one display instruction according to the determined target user input information.
For example, when a user touches or gestures on a large spliced screen, a touch track of the user may span multiple screens, or multiple screens near a hand of the user may sense gestures of the user, so that more than one screen acquires user input information, and the screens respectively send the acquired user input information to the control terminal, the situation that the control terminal receives the user input information sent by at least two screens in the controlled screens may occur. Of course, in other situations, such as multiple users operating multiple screens at the same time, it is also possible for the control terminal to receive more than one user input information.
And determining target user input information according to the user input information when the user input information sent by at least two screens is received. The target user input information may be one of the plurality of user input information with highest accuracy, or may be the target user input information which is obtained by integrating the plurality of user input information and re-calculating, or may be the target user input information which is determined by other modes and is finally used for determining the display instruction. In some implementations, the accuracy of the determination of the user's input can be improved by determining the target user input information from the user input information sent by at least two screens.
It should be understood that, in this embodiment, the screen for sending the user input information to the control terminal may be any screen controlled by the control terminal, where the screen may be a screen corresponding to the display instruction determined later (i.e., a screen controlled according to the user input information at this time), or may be a screen that does not receive the display instruction determined by the user input information (i.e., does not control the screen at this time). That is, by implementing the screen control method by the control terminal, the user can control not only the screen on which the user input information is acquired, but also other screens that are difficult for the user to reach through the screen.
According to the screen control method, the control terminal obtains user input information sent by at least one screen, the control terminal determines a display instruction of the screen according to the actual working condition of the screen, and the display instruction is sent to the corresponding screen, so that unified and convenient control over a spliced large screen or a distributed screen is realized. It can be appreciated that in practical application, the screen control method of the embodiment can not only realize the independent work of each screen, but also complete the cooperative work of the whole display system.
The present embodiment also provides a screen control method, which is applied to a screen, referring to fig. 3, and includes:
s201, establishing communication with a control terminal;
the communication connection includes wired or wireless communication, and exemplary wireless communication includes, but is not limited to, wireless radio frequency communication connections, such as wifi, bluetooth, or other wireless radio frequency communication means, and in some examples wireless broadcast or other communication means that do not require connection establishment may be used. For wired communications, the process of establishing communications includes, but is not limited to, connecting a communications cable, or accessing a communications port; for wireless communications that require connection establishment, the process of establishing a communication connection includes, but is not limited to, a pairing connection that performs wireless communications.
S202, receiving a display instruction sent by a control terminal;
the display instruction comprises a display instruction corresponding to a screen, wherein the display instruction is determined by the control terminal according to acquired user input information, and the user input information comprises user input information sent to the control terminal by at least one screen in the screens controlled by the control terminal.
S203, performing display control according to the display instruction;
by the screen control method applied to the screen, the screen can be displayed and controlled according to the user input information acquired by the screen controlled by the control terminal, and a user does not need to operate on the control terminal or the controlled screen, so that in some implementation processes, the screen can be effectively controlled in a multi-screen display scene such as a spliced large-scale screen or a distributed screen.
It will be appreciated that in some embodiments, the screen implementing the screen control method may also obtain user input information, where the user input information may be used to control other screens in the control terminal, and may also be used to control the screen from which the user input information is obtained.
The screen may obtain the user input information in any manner, for example, in some embodiments, before receiving the display instruction sent by the control terminal, the screen further includes: acquiring infrared reflection information through an infrared receiving and transmitting module and acquiring color information through a color sensing module;
And determining user input information according to the infrared reflection information and the color information, and sending the user input information to the control terminal so that the control terminal can determine a display instruction.
In some examples, the infrared reflection information and the color information can be directly used as user input information and sent to the control terminal, and in such examples, the control terminal can process the information to obtain corresponding data (including but not limited to obtaining data such as gesture motion tracks of a user after processing); in some examples, the infrared reflection information and the color information may be processed by a screen, and the processed data may be transmitted to the control terminal as user input information.
In an example, the infrared transceiver module may specifically include an infrared emitter and an infrared sensor, where the infrared emitter is configured to emit infrared rays outwards, the infrared sensor may receive infrared rays reflected by the outside, and the infrared reflection information obtained by the infrared transceiver module may determine whether an object exists in front of the screen, and may be used to detect gesture operations of a user, to obtain a gesture image of the user. The color information acquired by the color sensing module can be combined with the infrared reflection information to be analyzed and processed, so that a more accurate gesture image of the user is obtained, and the gesture operation performed by the user is judged by identifying gesture motion track and other data. Of course, in some examples, user input information such as gesture images can also be determined by the infrared transceiver module alone.
By the screen control method applied to the screen, the screen can receive the display instruction corresponding to the operation of the user on the screen and/or other screens controlled by the control terminal, which is sent by the control terminal, so that the screen can be systematically controlled. In some implementation processes, the problem that a spliced screen, a distributed screen and other multi-screen systems are difficult to control uniformly is solved, and a user can conveniently and rapidly perform touch, gesture, sound control and other operations on the screens in the multi-screen systems.
In order to better understand the screen control method provided by the present invention, a screen control method will be described below with reference to specific examples.
Referring to fig. 4, an example of a structure of a control terminal is shown, where the control terminal 100 includes a main control module 101 and a first radio frequency module 102, and the first radio frequency module 102 can implement data interaction with at least two screens.
Referring to fig. 5, a structure of a screen is illustrated, and the screen 200 includes a display panel including a plurality of light emitting chip sets 201, each light emitting chip set 201 including three light emitting chips of different colors, which may be, but not limited to, mini LED (sub millimeter light emitting diode) chips, micro LED chips (Micro light emitting diode) and the like. The screen 200 further includes a display driving unit 207 for providing data to the display panel according to the required control and display contents, and the display panel drives each light emitting chip set 201 to perform a specific display action according to the data provided by the display driving unit 207.
Taking Micro LED chips as an example, most of the display panel based on the Micro LED chip product is transparent, and the Micro LED chips are small in size, so that the transparent range of the display panel based on the Micro LED chip product is extremely high, in such an embodiment, the infrared emitter 202, the infrared receiver 203, and the color sensor 204 may be disposed below the display panel (on the side far away from the user when the user views the screen below the display panel referred to in this embodiment). In practical application, the information of the part blocked by the object such as the Micro LED chip can be supplemented by an algorithm or other part of the data of the reflected light.
A processing module 205 and a second rf module 206 are further disposed below the display panel, and the processing module 205 and the second rf module 206 may be disposed on a circuit board (not shown in the figure) below the display panel. In operation, the infrared emitter 202 continuously emits infrared rays to the upper side of the display panel (the upper side of the display panel in this embodiment is the side close to the user when the user views the screen), the infrared rays encounter objects such as the palm of the user and then are reflected to the infrared receiver 203, the infrared receiver 203 acquires infrared reflection information, and the color sensor 204 acquires color information of natural light. After receiving the data (including but not limited to the infrared reflection information and the color information) transmitted by the infrared receiver 203 and the color sensor 204, the processing module 205 analyzes and processes the received data to obtain a continuous motion track of the palm, i.e. identifies and obtains a gesture motion track of the user. For example, the gesture motion trajectory may be compared to a database, gesture meanings analyzed, and user input information (i.e., data representing the gesture meanings in this example) transmitted to the second rf module 206. The second rf module 206 may transmit user input information to the control terminal.
In an example, the control terminal may perform the screen control method applied to the control terminal provided in the above embodiment, and the screen may perform the screen control method applied to the screen provided in the above embodiment. An exemplary process of specifically controlling the screen by the user through gestures will be described below on the basis of the above screen and control terminal.
Example one: an independently operated screen a controlled by the control terminal is controlled by the screen control method of the above embodiment, see fig. 6.
S301, acquiring a gesture image input by a user on a screen A;
the user makes a gesture before the screen A, the screen A acquires a gesture image through an infrared transmitter, an infrared receiver and a color sensor, identifies and obtains a motion track of the user hand, and determines the gesture motion track input by the user.
S302, a screen A sends gesture motion tracks to a control terminal;
specifically, the gesture motion track is sent through the second radio frequency module.
S303, the control terminal acquires a gesture motion track sent by a screen A;
specifically, the gesture motion track sent by the screen A is received by the first radio frequency module of the control terminal;
S304, the control terminal determines a display instruction according to the gesture motion track and the working relation among the screens;
in this example, the control terminal has a control relationship with a plurality of screens including the screen a, but the screen a is independent from other screens. The first radio frequency module of the control terminal sends the acquired gesture motion trail to the main control module, and the main control module determines a display instruction A only corresponding to the screen A according to the gesture motion trail. Referring to fig. 7, after determining the display instruction, the control terminal proceeds to S405.
S405, the control terminal sends a display instruction A to a screen A;
the main control module of the control terminal sends the display instruction A to the first radio frequency module, and the first radio frequency module sends the display instruction to the second radio frequency module of the screen A.
S406, performing display control on the screen A according to the display instruction A;
after receiving the display instruction A, the second radio frequency module of the screen A sends the display instruction A to the display driving unit, and the display driving unit provides data for the display panel of the screen A according to the display instruction A and the required control and display content, so that the display panel acts.
Example two: the screen control method of the above embodiment controls a plurality of synchronously operated screens controlled by the control terminal.
In this example, the step of determining the display instruction by the control terminal is basically consistent with S101-S104, and will not be described herein. Referring to fig. 8, after determining the display instruction, the control terminal advances to S505.
S505, the control terminal sends a display instruction B to all synchronously working screens;
the main control module of the control terminal sends the display instruction B to the first radio frequency module, and the first radio frequency module sends the display instruction B to the second radio frequency module of each screen in a synchronous working state.
S506, the screen performs display control according to the display instruction B;
after receiving the display instruction B, the second radio frequency modules of the screens in the synchronous working state send the display instruction B to the display driving unit, and the display driving unit provides data for the display panel of the screen B according to the display instruction B and the control and display content according to the requirement, so that the display panel acts. In this example, the display instructions received by all the screens in the synchronous working state are consistent, and all the screens in the synchronous working state perform the same display control according to the display instructions, for example, play the same video.
In some practical application scenes, a plurality of screens working synchronously are distributed and arranged in different places, and when a user needs to control the screens, the user can uniformly control all the screens only by making corresponding control means such as gestures on any screen.
Example three: the screen control method of the above embodiment controls the screen of the cooperative work controlled by the control terminal.
In this example, the step of determining the display instruction by the control terminal is basically consistent with S101-S104, and will not be described herein. Referring to fig. 9, after determining the display instruction, the control terminal proceeds to S605.
In this example, the control terminal determines the display instruction C and the display instruction D. The display instruction C is a display instruction corresponding to the screen C, and the display instruction D is a display instruction corresponding to the screen D. In practical applications, the screen of the collaborative work may further include other screens than the screen C and the screen D, but only the content displayed on the screen C and the screen D may need to be controlled according to the control required to be implemented by the user, so the finally determined display instruction includes the display instruction C and the display instruction D.
S605, the control terminal sends a display instruction C to a screen C, and a display instruction D to a screen D;
the main control module of the control terminal sends the display instruction C and the display instruction D to the first radio frequency module, the first radio frequency module sends the display instruction C to the second radio frequency module of the screen C, and the display instruction D is sent to the screen D.
S606, performing display control on the screen C and the screen D according to the display instruction C or the display instruction D respectively;
after receiving the display instruction C, the second radio frequency module of the screen C in the cooperative working state sends the display instruction C to the display driving unit, and the display driving unit provides data for the display panel of the screen C according to the display instruction C and the control and display content according to the requirement, so that the display panel acts. Similarly, after receiving the display instruction D, the display driving unit of the screen D controls the display panel of the screen D according to the display instruction D.
Example four: the spliced screen is controlled by the screen control method of the embodiment.
It should be understood that, in the above examples, the arrangement manner of each screen is not limited, and may be distributed arrangement, or may be a spliced screen. To better explain the screen control method, the present example also describes a control procedure of the tiled screen.
Referring to fig. 10 and 11, schematic diagrams of a tiled display system provided in this example are shown;
the display device comprises a spliced screen, wherein the spliced screen is formed by combining a plurality of collaborative screens 200, the collaborative screens 200 are arranged in an array mode, a part of display content is displayed respectively, and the content displayed by all the screens 200 on the spliced screen is combined to form complete display content.
When the control is performed on the mosaic screen, the user may make a gesture in front of any screen 200, as shown in fig. 11, when the user makes a gesture, there may be a plurality of screens 200 that all acquire gesture images generated by the user's hand 10 and can recognize gesture motion trajectories input by the user. In one example, referring to fig. 12, when a plurality of screens 200 all acquire a user gesture image, a process of controlling the screens may include:
s701, acquiring gesture images by a plurality of screens;
s702, a screen for acquiring the gesture image sends the determined gesture motion trail to a control terminal through a second radio frequency module, and a first radio frequency module of the control terminal receives the gesture motion trail;
s703, the control terminal acquires gesture motion tracks sent by a plurality of screens;
the acquired gesture motion trajectories are also practically different due to the different positions of the individual screens 200 that make up the tiled screen.
S704, the control terminal determines a target gesture motion track according to gesture motion tracks sent by a plurality of screens;
as mentioned in the foregoing embodiment, the gesture motion trajectory transmitted from the plurality of screens may be selected as the most accurate target gesture motion trajectory, or may be calculated by combining the gesture motion trajectories to obtain a target gesture motion trajectory. The determined gesture motion trajectory of the object is used to determine a display instruction.
S705, the control terminal determines a display instruction according to the target gesture motion track and the working relation among the screens;
after determining the display instruction, the first rf module 102 of the control terminal 100 sends each display instruction to the second rf module 206 of the corresponding screen 200. In the above example, the screen 200 recognizes the gesture motion trajectory and transmits the gesture motion trajectory to the control terminal 100. In another example, the screen 200 may transmit a gesture image to the control terminal 100, and gesture motion trajectory recognition is performed by the control terminal 100.
Another alternative embodiment of the invention:
the present embodiment also provides a control terminal, which includes, but is not limited to, various devices or modules capable of implementing control, such as a controller of a host computer, as shown in fig. 13, where the control terminal includes a first processor 301, a first memory 302, and a first communication bus 303, and the control terminal includes:
the first communication bus 303 is used to enable connection communication between the first processor 301 and the first memory 302;
the first processor 301 is configured to execute one or more computer programs stored in the first memory 302 to implement at least one of the following steps:
Acquiring user input information sent by at least one screen in the controlled screens;
determining at least one display instruction according to the user input information, wherein each display instruction corresponds to at least one screen in the screens with control relation of the control terminal;
and sending a display instruction to the target screen so that the target screen performs display control according to the display instruction.
In this embodiment, the step of determining at least one display instruction by the first processor 301 according to the user input information includes:
identifying user input information to obtain an identification result;
and generating at least one display instruction according to the identification result and the working relation between at least two screens.
In this embodiment, the user input information includes a gesture image, and identifying the user input information to obtain an identification result includes:
and recognizing the gesture image to obtain a gesture motion track of the user, wherein the gesture motion track is used as a recognition result.
In this embodiment, the control terminal transmits information with the screen controlled by the control terminal through wireless radio frequency, and the first processor 301 performs a step of acquiring user input information sent by at least one of the controlled screens, including:
Acquiring user input information sent by at least one screen in the controlled screens through wireless radio frequency;
a step of transmitting a display instruction to a screen corresponding to the display instruction, comprising:
and sending a display instruction to a target screen through wireless radio frequency.
In this embodiment, the control terminal obtains user input information sent by the controlled screen, including: acquiring user input information respectively sent by at least two screens in the controlled screens, and determining target user input information according to the at least two user input information;
determining at least one display instruction according to the user input information, including:
and determining at least one display instruction according to the determined target user input information and the working relation among the screens.
The present embodiment also provides a screen, as shown in fig. 14, which includes a second processor 401, a second memory 402, and a second communication bus 403, wherein:
a second communication bus 403 is used to enable connection communication between the second processor 401 and the second memory 402;
the second processor 401 is used to execute one or more computer programs stored in the second memory 402 to implement at least one of the following steps:
Establishing communication with a control terminal;
receiving a display instruction sent by a control terminal, wherein the display instruction is a display instruction corresponding to a screen determined by the control terminal according to acquired user input information, and the user input information comprises user input information sent to the control terminal by at least one screen in the screens controlled by the control terminal;
and performing display control according to the display instruction.
In this embodiment, before receiving the display instruction sent by the control terminal, at least one of the following steps is further implemented:
acquiring infrared reflection information through an infrared receiving and transmitting module and acquiring color information through a color sensing module;
and determining the user input information according to the infrared reflection information and the color information, and sending the user input information to the control terminal so that the control terminal can determine the display instruction.
The present embodiments also provide a computer-readable storage medium including volatile or nonvolatile, removable or non-removable media implemented in any method or technology for storage of information, such as computer-readable instructions, data structures, computer program modules or other data. Computer-readable storage media includes, but is not limited to, RAM (Random Access Memory ), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory, charged erasable programmable Read-Only Memory), flash Memory or other Memory technology, CD-ROM (Compact Disc Read-Only Memory), digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer.
The computer readable storage medium in this embodiment may be used to store one or more computer programs, where the stored one or more computer programs may be executed by a processor to implement at least one step performed by the control terminal and/or the screen.
It will be apparent to one skilled in the art that all or some of the steps of the methods, systems, functional modules/units in the apparatus disclosed above may be implemented as software (which may be implemented in computer program code executable by a computing apparatus), firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between the functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed cooperatively by several physical components. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit.
Furthermore, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, computer program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and may include any information delivery media. Therefore, the present invention is not limited to any specific combination of hardware and software.
It is to be understood that the invention is not limited in its application to the examples described above, but is capable of modification and variation in light of the above teachings by those skilled in the art, and that all such modifications and variations are intended to be included within the scope of the appended claims.

Claims (10)

1. A screen control method applied to a control terminal, the control terminal being a separate device disposed outside a screen or disposed on a controlled part of the screen, characterized in that the control terminal has a control relationship with at least two screens, the screen control method comprising:
acquiring user input information sent by any at least one screen in the controlled screens;
determining at least one display instruction and a target screen which is required to be controlled by the display instruction according to the user input information, wherein each display instruction corresponds to at least one screen in the screens with control relation of the control terminal;
and sending the display instruction to the corresponding target screen so that the target screen performs display control according to the display instruction.
2. The screen control method of claim 1, wherein the determining at least one display instruction according to the user input information comprises:
Identifying the user input information to obtain an identification result;
and generating at least one display instruction according to the identification result and the working relation between the at least two screens.
3. The screen control method of claim 2, wherein the user input information includes a gesture image, and recognizing the user input information to obtain a recognition result includes:
and recognizing the gesture image to obtain a gesture motion track of the user, wherein the gesture motion track is used as a recognition result.
4. A screen control method according to any one of claims 1 to 3, wherein the control terminal transmits information between the screen controlled thereby and the screen via radio frequency;
the acquiring the user input information sent by at least one screen of the controlled screens comprises:
acquiring user input information sent by at least one screen in the controlled screens through wireless radio frequency;
the sending the display instruction to the target screen includes:
and sending the display instruction to the target screen through wireless radio frequency.
5. A screen control method according to any one of claims 1 to 3, wherein the acquiring the user input information transmitted by at least one of the controlled screens includes:
Acquiring user input information respectively sent by at least two screens in the controlled screens, and determining target user input information according to the at least two user input information;
the determining at least one display instruction according to the user input information comprises the following steps:
and determining at least one display instruction according to the determined target user input information.
6. A screen control method applied to a screen, comprising:
establishing communication with a control terminal, wherein the control terminal is a single device arranged outside a screen or is arranged on a controlled part of the screen;
receiving a display instruction sent by the control terminal, wherein the display instruction is a display instruction corresponding to the screen, which is determined by the control terminal according to the acquired user input information, the control terminal also determines a target screen to be controlled by the display instruction, and the user input information comprises user input information sent to the control terminal by any at least one screen in the screens controlled by the control terminal;
and performing display control according to the display instruction.
7. The screen control method of claim 6, further comprising, before receiving a display instruction transmitted from the control terminal:
Acquiring infrared reflection information through an infrared receiving and transmitting module and acquiring color information through a color sensing module;
and determining the user input information according to the infrared reflection information and the color information, and sending the user input information to the control terminal so that the control terminal can determine the display instruction.
8. The control terminal is characterized by comprising a processor, a memory and a communication bus;
the communication bus is used for realizing connection communication between the processor and the memory;
the processor is configured to execute one or more computer programs stored in the memory to implement the steps of the screen control method of any one of claims 1 to 5.
9. A screen, comprising a processor, a memory and a communication bus;
the communication bus is used for realizing connection communication between the processor and the memory;
the processor is configured to execute one or more computer programs stored in the memory to implement the steps of the screen control method of claim 6 or 7.
10. A computer-readable storage medium storing one or more computer programs executable by one or more processors to perform the steps of at least one of the following methods:
The screen control method according to any one of claims 1 to 5;
the screen control method according to claim 6 or 7.
CN202110902778.1A 2021-08-06 2021-08-06 Screen control method, control terminal, screen and computer readable storage medium Active CN114035759B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110902778.1A CN114035759B (en) 2021-08-06 2021-08-06 Screen control method, control terminal, screen and computer readable storage medium
PCT/CN2022/110195 WO2023011578A1 (en) 2021-08-06 2022-08-04 Screen control method, control terminal, screen, and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110902778.1A CN114035759B (en) 2021-08-06 2021-08-06 Screen control method, control terminal, screen and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN114035759A CN114035759A (en) 2022-02-11
CN114035759B true CN114035759B (en) 2023-12-22

Family

ID=80139820

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110902778.1A Active CN114035759B (en) 2021-08-06 2021-08-06 Screen control method, control terminal, screen and computer readable storage medium

Country Status (2)

Country Link
CN (1) CN114035759B (en)
WO (1) WO2023011578A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114035759B (en) * 2021-08-06 2023-12-22 重庆康佳光电科技有限公司 Screen control method, control terminal, screen and computer readable storage medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103052928A (en) * 2010-08-04 2013-04-17 惠普发展公司,有限责任合伙企业 System and method for enabling multi-display input
CN103109257A (en) * 2010-06-25 2013-05-15 诺基亚公司 Apparatus and method for transferring information items between communications devices
CN103729054A (en) * 2012-10-10 2014-04-16 三星电子株式会社 Multi display device and control method thereof
CN105324736A (en) * 2013-07-23 2016-02-10 英特尔公司 Techniques for touch and non-touch user interaction input
CN107291221A (en) * 2017-05-04 2017-10-24 浙江大学 Across screen self-adaption accuracy method of adjustment and device based on natural gesture
CN107479815A (en) * 2017-06-29 2017-12-15 努比亚技术有限公司 Realize the method, terminal and computer-readable recording medium of split screen screen control
CN108182028A (en) * 2017-12-27 2018-06-19 努比亚技术有限公司 A kind of control method, terminal and computer readable storage medium
CN109085990A (en) * 2018-07-25 2018-12-25 努比亚技术有限公司 A kind of gestural control method, mobile terminal and computer readable storage medium
JP6471261B1 (en) * 2018-10-04 2019-02-13 京セラ株式会社 Electronic device, control method and program
CN110633043A (en) * 2019-08-26 2019-12-31 华为技术有限公司 Split screen processing method and terminal equipment
CN111046447A (en) * 2018-11-23 2020-04-21 北京仁光科技有限公司 Authority control method and authority control system
CN112306439A (en) * 2020-10-29 2021-02-02 中国第一汽车股份有限公司 One-machine multi-screen interaction system and management method thereof, electronic equipment and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6844865B2 (en) * 1999-08-09 2005-01-18 Michael Stasko Multiple screen computer monitor
CN101661383B (en) * 2008-08-29 2012-06-06 联想(北京)有限公司 Electronic equipment and display control method thereof
CN109426408A (en) * 2017-09-01 2019-03-05 中兴通讯股份有限公司 A kind of multi-screen terminal and its apply display control method, device
CN114035759B (en) * 2021-08-06 2023-12-22 重庆康佳光电科技有限公司 Screen control method, control terminal, screen and computer readable storage medium

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103109257A (en) * 2010-06-25 2013-05-15 诺基亚公司 Apparatus and method for transferring information items between communications devices
CN103052928A (en) * 2010-08-04 2013-04-17 惠普发展公司,有限责任合伙企业 System and method for enabling multi-display input
CN103729054A (en) * 2012-10-10 2014-04-16 三星电子株式会社 Multi display device and control method thereof
CN105324736A (en) * 2013-07-23 2016-02-10 英特尔公司 Techniques for touch and non-touch user interaction input
CN107291221A (en) * 2017-05-04 2017-10-24 浙江大学 Across screen self-adaption accuracy method of adjustment and device based on natural gesture
CN107479815A (en) * 2017-06-29 2017-12-15 努比亚技术有限公司 Realize the method, terminal and computer-readable recording medium of split screen screen control
CN108182028A (en) * 2017-12-27 2018-06-19 努比亚技术有限公司 A kind of control method, terminal and computer readable storage medium
CN109085990A (en) * 2018-07-25 2018-12-25 努比亚技术有限公司 A kind of gestural control method, mobile terminal and computer readable storage medium
JP6471261B1 (en) * 2018-10-04 2019-02-13 京セラ株式会社 Electronic device, control method and program
CN111046447A (en) * 2018-11-23 2020-04-21 北京仁光科技有限公司 Authority control method and authority control system
CN110633043A (en) * 2019-08-26 2019-12-31 华为技术有限公司 Split screen processing method and terminal equipment
CN112306439A (en) * 2020-10-29 2021-02-02 中国第一汽车股份有限公司 One-machine multi-screen interaction system and management method thereof, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN114035759A (en) 2022-02-11
WO2023011578A1 (en) 2023-02-09

Similar Documents

Publication Publication Date Title
EP3617869B1 (en) Display method and apparatus
US8656067B2 (en) Peripheral device identification for pairing
US11609541B2 (en) System and method of IOT device control using augmented reality
US20140340344A1 (en) Display processor and display processing method
KR20160058580A (en) Electronic device for identifying peripheral apparatus and method thereof
CN104618793A (en) Information processing method and electronic equipment
US20120146884A1 (en) Control transfer apparatus, control transfer system and method thereof
US20150026229A1 (en) Method in an electronic device for controlling functions in another electronic device and electronic device thereof
US20240085913A1 (en) Robot autonomous operation method, robot, and computer-readable storage medium
US11991767B2 (en) Bluetooth communication system and related computer program product capable of reducing complexity of pairing bluetooth host device with bluetooth device set for user
KR20160147555A (en) Mobile terminal and method for controlling the same
CN114035759B (en) Screen control method, control terminal, screen and computer readable storage medium
EP3145160B1 (en) Apparatus and method for transmitting image files.
US20170134685A1 (en) Electronic apparatus, remote control apparatus, control method thereof, and electronic system
US8704698B2 (en) Universal remote control apparatus, system for controlling universal remote control, and method for the same based on batch instruction
CN105278662A (en) Interactive control method and apparatus for electronic whiteboard system and system
US11169626B2 (en) Transmitter, touch sensitive processing apparatus and processing method thereof and electronic system
CN109542250B (en) Inter-server switching control method, KVM video processor and spliced wall system
KR101640710B1 (en) Proximity detection of candidate companion display device in same room as primary display using camera
CN102890606A (en) Information processing device, information processing method, and program
KR20140047815A (en) System and method for controlling remote of plural device
WO2023142623A1 (en) Laser processing method and apparatus, and storage medium, display device and laser device
US20110125927A1 (en) Personal computer system and operation method thereof for multiple outputs
CN114915511B (en) Control method and device of split equipment
TWI621950B (en) Electronic device connecting system and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 402760 No.69, Wushan Road, Biquan street, Bishan District, Chongqing

Applicant after: Chongqing Kangjia Optoelectronic Technology Co.,Ltd.

Address before: 402760 No.69, Wushan Road, Biquan street, Bishan District, Chongqing

Applicant before: Chongqing Kangjia Photoelectric Technology Research Institute Co.,Ltd.

GR01 Patent grant
GR01 Patent grant