CN117406896A - Method and system for controlling one or more signal sources via An Zhuoduan - Google Patents
Method and system for controlling one or more signal sources via An Zhuoduan Download PDFInfo
- Publication number
- CN117406896A CN117406896A CN202311188886.2A CN202311188886A CN117406896A CN 117406896 A CN117406896 A CN 117406896A CN 202311188886 A CN202311188886 A CN 202311188886A CN 117406896 A CN117406896 A CN 117406896A
- Authority
- CN
- China
- Prior art keywords
- zhuoduan
- event
- interface
- signal sources
- current display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000012545 processing Methods 0.000 claims abstract description 84
- 230000003993 interaction Effects 0.000 claims description 59
- 239000003607 modifier Substances 0.000 claims description 24
- 230000008569 process Effects 0.000 claims description 13
- 230000004044 response Effects 0.000 claims description 12
- 230000008859 change Effects 0.000 claims description 11
- 238000012544 monitoring process Methods 0.000 claims description 11
- 230000006870 function Effects 0.000 claims description 10
- 238000009825 accumulation Methods 0.000 claims description 8
- 230000002452 interceptive effect Effects 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 5
- 230000007547 defect Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- IRLPACMLTUPBCL-KQYNXXCUSA-N 5'-adenylyl sulfate Chemical compound C1=NC=2C(N)=NC=NC=2N1[C@@H]1O[C@H](COP(O)(=O)OS(O)(=O)=O)[C@@H](O)[C@H]1O IRLPACMLTUPBCL-KQYNXXCUSA-N 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/08—Protocols specially adapted for terminal emulation, e.g. Telnet
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention relates to the technical field of image processing, and provides a method and a system for controlling one or more signal sources through An Zhuoduan, wherein the method is applied to a system for controlling one or more signal sources through An Zhuoduan, and the method comprises the following steps: acquiring a current display interface of one or more signal sources; acquiring interface processing instructions of the input equipment based on the interface of An Zhuoduan; and responding to the interface processing instruction, and processing the current display interface of the one or more signal sources. According to the method, one or more signal sources are controlled through the mobile device with the android system, so that the control of one or more signal sources through the mobile device is possible, the control of other one or more signal sources by a user is more convenient and quick, and the experience of low use cost of the user is improved.
Description
Technical Field
The present invention relates to the field of image processing technology, and in particular, to a method and system for controlling one or more signal sources through An Zhuoduan.
Background
In the prior art, at least one signal source image connected to a computer can be controlled by operating a mouse or touch on the computer under a common windows operating system, but there is no technology for controlling a signal source through an android system.
Taking the operation of a mouse on a computer as an example, the mouse is used as an external input device of the computer and can be connected to the computer through a USB port or Bluetooth. The computer can monitor and acquire signals on each external input device through the bottom layer protocol in the computer and distinguish input signals of a mouse, a keyboard or touch control signals. If the protocol is separated from the bottom layer, the input signals of a mouse, a keyboard or touch control cannot be analyzed. In the android system, when the external device is used to control An Zhuoduan, the signal source cannot be controlled according to the instruction of the external device.
Therefore, the method and the device solve the problem that the prior art cannot control the signal source through the mobile device with the android system and process the image of the signal source, and are very necessary.
Disclosure of Invention
The invention provides a method and a system for controlling one or more signal sources through An Zhuoduan, which are used for overcoming the defect that the prior art cannot control the signal sources through mobile equipment with an android system and process images of the signal sources, so that the mobile equipment can control one or more signal sources, and a user can control other one or more signal sources more conveniently and quickly by using an android mobile terminal.
In one aspect, the present invention provides a method for controlling one or more signal sources via An Zhuoduan, applied to a system for controlling one or more signal sources via An Zhuoduan, the system comprising An Zhuoduan, a signal interaction terminal, an input device, and at least one signal source, the input device, an Zhuoduan, and the signal interaction terminal being connected in sequence, the signal source being connected to the signal interaction terminal; the method comprises the following steps: acquiring current display interfaces of one or more signal sources on the signal interaction end, and displaying the current display interfaces of the one or more signal sources on the interface of An Zhuoduan; acquiring interface processing instructions input by the input equipment to one or more signal sources based on the interface of An Zhuoduan; and responding to the interface processing instruction, and processing the current display interface of one or more signal sources.
Further, the interface processing instruction input by the input device to one or more signal sources based on the interface of An Zhuoduan is obtained, including: uniformly monitoring touch events and mouse events, wherein the touch events comprise single-point touch events and multi-point touch events, and the mouse events comprise mouse pressing events, mouse moving events and mouse lifting events; acquiring the interface processing instruction according to the monitored touch event or the monitored mouse event; the interface processing instruction comprises zooming out, zooming in, stretching and moving the current display interface.
Further, the obtaining the interface processing instruction according to the monitored touch event or the monitored mouse event includes: determining an event intention according to the touch event or the mouse event, wherein the event intention comprises image movement, image scaling and image stretching; calculating a movement offset and a scaling value according to the event intention; generating the interface processing instruction according to the calculated movement offset and the scaling value; accordingly, the responding to the interface processing instruction processes the current display interface of one or more signal sources, including: moving the current display interface according to the movement offset; reducing or enlarging the current display interface according to the scaling value; and performing boundary limitation in the process of moving, shrinking or enlarging the current display interface.
Further, the calculating a movement offset and a scaling value according to the event intention includes: determining that the event is intended for image scaling, calculating a first average distance between the current contact and a first contact center point, and calculating a second average distance between the initial contact and a second contact center point; obtaining the scaling value by obtaining a quotient of the first average distance and the second average distance; the coordinates of the first contact center point are obtained by dividing the current contact point number by the coordinate accumulation sum of the current contact point, and the coordinates of the second contact center point are obtained by dividing the initial contact point number by the coordinate accumulation sum of the initial contact point.
Further, the calculating a movement offset and a scaling value according to the event intention includes: determining that the scaling value is 1 or that the event is intended to be an image movement or an image stretching; and calculating the distance between the first contact center point and the second contact center point, wherein the distance is the movement offset.
Further, the limiting the boundary in the process of moving, shrinking or enlarging the current display interface includes: determining that the first vertex ordinate of the current display interface is smaller than the first vertex ordinate of the parent component, and the first vertex abscissa of the current display interface is larger than the first vertex abscissa of the parent component; and determining that the second vertex ordinate of the current display interface is greater than the second vertex ordinate of the parent component, and the second vertex abscissa of the current display interface is less than the second vertex abscissa of the parent component.
Further, the unified monitoring touch event and mouse event includes: adding a modifier.pointerinput modifier to a window component to which the current display interface belongs, starting a Kotlin cooperative distance in the modifier, and monitoring a touch event and a mouse event in a spin polling mode; determining that the monitored event has a pressure value signal, wherein the monitored event is the touch event; and determining that the monitored event does not have a pressure value signal, and determining that the monitored event is the mouse event.
Further, the processing the current display interface of one or more signal sources in response to the interface processing instruction includes: determining a window component combination modifier and a modifier size modifier corresponding to the current display interface so that a window component can respond to the change of the position and the size of the current display interface; recording the change of the value by using a remamber recording function, responding the value to an interface through a mutableStateOf state function, and displaying the value; wherein the value includes vertex coordinates of the current display interface, and a size of the current display interface.
Further, the signal source is a camera, and is used for transmitting an image or video shot by the camera to the An Zhuoduan.
Further, the An Zhuoduan device includes a mobile device, and the input device includes a mouse connected to the An Zhuoduan via a bluetooth or USB cable.
Further, the An Zhuoduan signal interaction end and the signal interaction end both comprise interaction interface elements, wherein the interaction interface elements are in a display state when touch or mouse click is received, and are in a hidden state when touch or mouse click is not received.
In a second aspect, the present invention also provides a system for controlling one or more signal sources via An Zhuoduan, which in operation performs any of the methods of controlling one or more signal sources via An Zhuoduan described above.
According to the method for controlling one or more signal sources through An Zhuoduan, the current display interface of one or more signal sources is obtained, the interface processing instruction of the input device is obtained based on the interface of An Zhuoduan, and then the current display interface of one or more signal sources is processed in response to the interface processing instruction. According to the method, one or more signal sources are controlled through the mobile device with the android system, the defect that the one or more signal sources cannot be controlled through the mobile device with the android system in the prior art and images of the signal sources are processed is overcome, so that the control of a computer through the mobile device is possible, and the mobile device is carried by a user basically all the time, so that the control of other one or more signal sources by the user is more convenient and quick, and the user's experience of using cheapness is improved.
Drawings
In order to more clearly illustrate the invention or the technical solutions of the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a system schematic diagram of a system for controlling one or more signal sources via An Zhuoduan in accordance with the present invention;
FIG. 2 is an interface schematic diagram of An Zhuoduan of the method of controlling one or more signal sources by An Zhuoduan provided by the present invention;
FIG. 3 is a flow chart of a method of controlling one or more signal sources by An Zhuoduan according to the present invention;
FIG. 4 is a partial flow diagram of a method of controlling one or more signal sources via An Zhuoduan in accordance with the present invention;
FIG. 5 is a schematic overall framework of the method of controlling one or more signal sources by An Zhuoduan provided by the present invention;
fig. 6 is a schematic structural diagram of an electronic device provided by the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the present invention, the network is used to implement, and the essence is to cover the wired or wireless network connection implemented by the necessary firmware or software of the switch, router, etc., and also cover the wired or wireless network connection implemented by some service end or other computer as medium. In the present invention, the networks involved may include Wi-fi networks, bluetooth networks, private Area Networks (PANs), local Area Networks (LANs), wide Area Networks (WANs), IEEE 802.1x, intranets, the internet, extranets, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile communications (GSM), general Packet Radio Service (GPRS), cdmaOne, CDMA2000, evolution-data optimized (EV-DO), enhanced data rates for GSM evolution (EDGE), universal Mobile Telecommunications System (UMTS), digital Enhanced Cordless Telecommunications (DECT), digital AMPS (IS-136/TDMA), integrated Digital Enhanced Network (iDEN), wiMAX, LTE advanced, mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be public access, private, virtual private, e.g., VPN.
The present invention will be described by way of example with reference to the accompanying drawings in conjunction with the embodiments, and it should be noted that the embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
Fig. 1 shows a system schematic of a system for controlling one or more signal sources via An Zhuoduan provided by the present invention.
As shown in fig. 1, the system includes:
an Zhuoduan 110, a signal interaction terminal 120, an input device 130 (the input device in fig. 1 is a mouse), and at least one signal source (fig. 1 shows the case of two signal sources, including a signal source 141 and a signal source 142);
an Zhuoduan 110 comprises a mobile device with an android system;
the signal interaction end 120 is connected with one or more signal sources to obtain the current display interface from the signal sources and display the current display interface on the signal interaction end 120;
the signal interaction end 120 is in communication connection with the signal interaction end An Zhuoduan 110, and An Zhuoduan 110 obtains the current display interface of the signal interaction end 120 from the signal interaction end through the communication connection and displays the current display interface on the interface of An Zhuoduan 110;
an Zhuoduan 110 is further configured to forward the interface processing instructions to the signal interaction end 120 in response to the interface processing instructions entered by the user via the input device 130 to the one or more signal sources at the interface of An Zhuoduan;
The signal interaction end 120 is further configured to convert the control command from the An Zhuoduan 110 into a local control command through screen coordinate conversion, so as to control each signal source respectively.
The signal interaction terminal 120 refers to a personal computer, a laptop computer, and other computer devices equipped with windows system, linux system, etc.
An Zhuoduan 110 the input device may comprise a keyboard, mouse or touch screen display, as may be the case with mobile devices that include an android system. In a specific embodiment, an Zhuoduan 110 is an in-vehicle device with an android system.
In another embodiment, an Zhuoduan is a mobile phone with an android system, where the input device may include a keyboard, a mouse, or a touch screen on the mobile phone.
The signal source may be a camera, and is configured to transmit an image or video captured by the camera to the signal interaction end 120, and further to the An Zhuoduan 110.
Taking the example of controlling two signal sources through An Zhuoduan, the signal interaction end 120 is connected with the two signal sources 141 and 142, and the current display interface of the signal interaction end 120 can be obtained from the signal source 141 and the signal source 142 and displayed on the signal interaction end 120.
Specifically, fig. 2 shows an interface schematic of An Zhuoduan of the method of controlling one or more signal sources by An Zhuoduan provided by the present invention. Specifically, as shown in fig. 2, it shows the current display interfaces a and B of the signal source 141 and the signal source 142 displayed on the interface (screen) of An Zhuoduan 110.
The signal interaction end 120 and the signal interaction end An Zhuoduan 110 are communicatively connected, and An Zhuoduan 110 can obtain the current display interface thereof from the signal interaction end 120 through the communication connection and display the current display interface on the interface (i.e. screen) of the signal interaction end An Zhuoduan 110. Therefore, in the case that the signal interaction terminal 120 can display the current display interfaces of the signal source 141 and the signal source 142, the current display interface shown in fig. 2 may also be displayed on the An Zhuoduan. According to other embodiments of the present invention, an Zhuoduan 110 may also obtain its current display interface directly from signal source 141 and signal source 142 through the network according to the instruction of signal interaction terminal 120.
According to some embodiments of the present invention, the signal interaction terminals 120 and An Zhuoduan may further add UI interaction interface elements, which may be displayed by touch or mouse click when needed, and may not be in a hidden state when needed.
An Zhuoduan 110 are operative to forward interface processing instructions to signal interaction end 120 further in response to interface processing instructions entered by a user via input device 130 to one or more signal sources at An Zhuoduan interface.
When the mouse 130 is connected to the An Zhuoduan, the user can input interface processing instructions by referring to the current display interface of the An Zhuoduan, performing a mouse click or the like, and the interface processing instructions include a first interface processing instruction for processing the current display interface of the signal source 141 and a second interface processing instruction for processing the current display interface of the signal source 142.
For example, a user may operate signal source 141 at signal source 141 location on the An Zhuoduan interface and operate signal source 142 at signal source 142 location on the An Zhuoduan interface. The mouse 130 may be connected to An Zhuoduan 110 via a bluetooth or USB cable. The input of the input device may also include a touch input.
As a system developed for mobile devices, the android system is commonly used as a mobile terminal for mobile use or portable use in the prior art, and a mouse is not conceivable to be connected to the android system, so that the android system can be used as a control device.
An Zhuoduan 110 the interface processing instructions may be further forwarded to the signal interaction end 120, where the signal interaction end 120 converts the interface processing instructions from An Zhuoduan 110 into local control instructions through screen coordinate conversion, to control the signal source 141 and the signal source 142, respectively.
For example, a certain proportional relationship exists between the screen on the An Zhuoduan and the screen on the signal interaction end 120, the signal interaction end 120 can coordinate-transform the interface processing instruction on a certain position coordinate on the An Zhuoduan, convert the interface processing instruction into an interface processing instruction on a corresponding position on the signal interaction end 120, and the signal interaction end 120 controls one or more signal sources, where the scheme also covers a situation that the signal interaction end 120 directly forwards the interface processing instruction to one or more signal sources and responds by one or more signal sources.
According to some embodiments of the present invention, the signal interaction terminal 120 may obtain its current display interface from the signal source 141 and the signal source 142 through a video line or a network, and send interface processing instructions to the signal source 141 and the signal source 142 through a USB line or a network or forward the interface processing instructions from An Zhuoduan 110. The signal interaction end 120 may be provided with an input device and a display device, or may be provided with a touch screen display, through which user touches and output interfaces may be received.
In one embodiment, the source is a camera, and the images captured by the camera are sent to An Zhuoduan 110, where the transmitted images are cropped a second time at An Zhuoduan.
In another embodiment, annotating, or plotting, etc., the image of the signal source displayed in An Zhuoduan 110 sends the new image with the added annotation, plotting content to the other terminal.
In yet another embodiment, the video of the signal source is displayed at An Zhuoduan, the correspondence between each frame in the video and the time of the frame is acquired, and when the user clicks at An Zhuoduan to acquire a frame, the frame image is retrieved from the video.
According to the embodiment of the invention, the control of other one or more signal sources and the processing of corresponding images can be realized through the android system, and the android system can be carried on the mobile device, so that the control of the computer through the mobile device is possible, and the control and the image processing of the other one or more signal sources by the user are more convenient and faster because the mobile device is carried by the user basically all the time.
In addition, in the prior art, taking a mouse operation on a computer as an example, the mouse 130 is used as an external input device of the computer, and may be connected to the computer through a USB port or bluetooth. The computer can monitor and acquire signals on each external input device through the bottom layer protocol in the computer and distinguish input signals of a mouse, a keyboard or touch control signals. If the underlying protocol is disengaged, the input cannot be resolved, either by the mouse 130, keyboard or touch signal. Also, as an external developer of the application layer of the android system, since various protocol codes of the android bottom layer cannot be acquired, when the external developer of the application layer is ready to connect an external device on An Zhuoduan, for example, connect a mouse 130 through USB (or connect a mouse 130 through a bluetooth adapter), the developer can only acquire an event feedback from the android system at most, but cannot learn whether the event is a mouse event or a touch event.
Therefore, the present invention further proposes how to enable An Zhuoduan to respond normally to control commands entered by a user on the interface at An Zhuoduan to one or more signal sources, particularly via a mouse and touch, without enabling the android underlying protocol.
According to some embodiments of the present invention, when the touch and mouse-down events are monitored and collected, the analysis includes analyzing a voltage signal at the time, where the voltage signal is a value generated when a finger presses on the touch screen, if the voltage signal is not present, the pre-determined input event is a mouse event, and if the voltage signal is present, the pre-determined input event is a touch event. After determining the touch event, further distinguishing a single-point touch (single-finger touch) event from a multi-point touch (multi-finger touch) event by analyzing the number of contacts in the touch event.
Based on the above system for controlling one or more signal sources through An Zhuoduan, the present invention also proposes a method for controlling one or more signal sources through An Zhuoduan, and in particular, fig. 3 shows a schematic flow chart of a method for controlling one or more signal sources through An Zhuoduan provided by the present invention. As shown in fig. 3, the method includes:
s310, acquiring a current display interface of one or more signal sources;
s320, acquiring an interface processing instruction of the input equipment based on the current display interface;
s330, responding to the interface processing instruction, and processing the current display interface of one or more signal sources.
In step S310, a communication connection exists between the signal interaction end and at least one signal source, so the signal interaction end may obtain a corresponding current display interface from at least one signal source, and then forward the current display interface of the signal source obtained by the signal interaction end to An Zhuoduan based on the communication connection between the signal interaction end and An Zhuoduan.
The communication connection may be a video line connection or a network connection, which is not particularly limited herein.
In step S320, an Zhuoduan, after receiving the current display interface of the signal source, displays it, visually interacts with the user, and based on the current display interface, the user determines interface processing instructions including at least one or more of zooming out, zooming in, stretching, moving, cropping, annotating, plotting the current display interface.
After the user determines the interface processing instructions, the interface processing instructions are communicated An Zhuoduan via an input device connected to An Zhuoduan. The connection between the input device and An Zhuoduan may be a bluetooth connection or a USB connection, which is not limited herein.
The interface processing instruction is transmitted to An Zhuoduan through the input device, specifically, the interface processing instruction can be realized by the input device for touch control, mouse or keyboard input, and An Zhuoduan can uniformly monitor and collect touch control events, mouse events or keyboard events input by the input device.
An Zhuoduan the corresponding interface processing instruction can be obtained by analyzing the monitored and collected touch events, mouse events or keyboard events.
In step S330, the current display interface of the one or more signal sources is further processed in response to the interface processing instruction, where the processing includes, but is not limited to, scaling, zooming, stretching, moving, cropping, annotating, and plotting the current display interface, based on the interface processing instruction acquired by the input device in step S320.
It is easy to understand that An Zhuoduan will forward the interface processing instruction to the signal interaction end, where a certain proportional relationship exists between the screen on An Zhuoduan and the screen on the signal interaction end, where the signal interaction end can coordinate-transform the interface processing instruction on a position coordinate on An Zhuoduan, and convert the interface processing instruction into an interface processing instruction on a corresponding position on the signal interaction end, where the signal interaction end controls one or more signal sources and processes the current display interface, and the scheme also covers a case where the signal interaction end forwards the interface processing instruction to one or more signal sources, and the one or more signal sources respond by themselves.
In this embodiment, the current display interfaces of the one or more signal sources are processed by acquiring the current display interfaces of the one or more signal sources, acquiring an interface processing instruction of the input device based on the current display interfaces, and further responding to the interface processing instruction. According to the method, one or more signal sources are controlled through the mobile device with the android system, the defect that the one or more signal sources cannot be controlled through the mobile device with the android system and images of the signal sources are processed in the prior art is overcome, the one or more signal sources can be controlled through the mobile device, the control of other one or more signal sources by a user is more convenient and rapid, and the user's experience of using cheaply is improved.
According to the embodiment of the invention, the control of other one or more signal sources can be realized through the android system, and the android system can be carried on the mobile device, so that the control of the computer through the mobile device is possible, and the mobile device is carried by the user basically all the time, so that the control of the other one or more signal sources by the user is more convenient and faster.
Further, when the current display interface of the signal source is being played on the signal interaction end, and the current display interface of the same or the same signal sources is played on An Zhuoduan, the interface processing instruction input by the user on the An Zhuoduan interface for one or more signal sources may also include an interface processing instruction for adjusting a window (a streaming media playing window) of the playing signal source on An Zhuoduan, which further describes how to bypass the android system bottom layer to implement a response method for the interface processing instruction input by the mouse and the touch.
It can be understood that, firstly, based on the current display interface, the interface processing instruction of the input device is obtained, specifically, the touch event and the mouse event are monitored uniformly, the touch event comprises a single-point touch event and a multi-point touch event, and the mouse event comprises a mouse pressing event, a mouse moving event and a mouse lifting event; and acquiring an interface processing instruction according to the monitored touch event or mouse event.
Specifically, fig. 4 shows a partial flow diagram of a method for controlling one or more signal sources via An Zhuoduan provided by the present invention. As shown in fig. 4, fig. 4 further defines a step of acquiring an interface processing instruction according to the monitored touch event or mouse event, and specifically includes the following steps:
S410, determining event intents according to touch events or mouse events, wherein the event intents comprise image movement, image scaling and image stretching.
In the step, the pressing, moving and lifting events of the touch control and the mouse are monitored uniformly, the input events are collected in groups, and the intention of the events is prejudged.
In the event acquisition stage, unified monitoring of touch events and mouse events, namely unified monitoring of pressing, moving and lifting events of the touch and mouse, can comprise the steps of adding a modifier to a window component to which a current display interface belongs, starting a Kotlen cooperative distance in the modifier, and monitoring the touch events and the mouse events in a spin polling mode. When a user's pressing event (including one or more touch events or mouse events) is monitored, the collection work is started by the event group of the present round.
One event group starts with the pressing of the event PointEventType. Press and ends with the lifting of the event PointEventType. Release, where there may be zero to multiple movement events PointEventType. Move), e.g., a mouse moving from one location to another location or to another.
When monitoring and collecting touch (pressing) and mouse pressing events, analyzing the touch (pressing) and mouse pressing events, including analyzing a pressing value signal at the moment, wherein the pressing value is a value generated when a finger presses a touch screen, if the pressing value signal is not available, the pre-judging input event is a mouse event, and if the pressing value signal is available, the pre-judging input event is a touch event. After the touch event is determined, the single-point touch event and the multi-point touch event are further distinguished by analyzing the number of contacts in the touch event.
When the input event is a single-point touch event or a mouse event, the position relation between the coordinates of the single-point touch event or the mouse event and the window component is further analyzed, so that whether the event is intended to be a moving window or a stretching window (the stretching window comprises a large window or a small window, and the window is the current display interface) can be predicted.
According to some embodiments of the present invention, when the coordinates of the press event are not at the window edge, it is considered a moving window intent, and vice versa, such as when the coordinates of the press event are more than a threshold pixel (e.g., 40 pixels) from the window edge, it is considered a moving window intent, and vice versa, the particular threshold is configurable. When the intention of the user is to stretch the window intention, the stretching direction and the stretching size are further predicted.
According to some embodiments of the present invention, eight possible directions of left, upper right, lower left are determined according to the relative relationship between the coordinates of the input event and the edge position.
When the input event is a multi-touch event, the operation may be predicted to be a moving window or a scaling window (moving or scaling the current display interface).
Through the pre-judging operation in the earlier stage, the mouse or touch control instruction does not need to be repeatedly judged and analyzed in each subsequent monitoring and responding process, and only the moving coordinates of the mouse or touch control instruction need to be obtained, so that the calculating process is simplified and the responding speed is improved.
S420, calculating a movement offset and a scaling value according to the event intention.
And then continuing to monitor the subsequent input event, and starting to enter a calculation stage by combining the prejudged event intention, wherein the calculation comprises calculation of the movement offset and the scaling value of the contact. In the present invention, for simplicity and clarity in description, when calculating a mouse movement and a touch movement, both a mouse movement point and a touch movement point are referred to as a contact point, and thus, calculating a mouse movement distance is also referred to as calculating a contact point movement distance. When referring to a touch event, it still refers to a single touch event or a multi-touch event, rather than a mouse click event.
When the input event is predicted to be a multi-touch event, a scaling value (Scale) is calculated, including first calculating a first average distance between the current contact and a first contact center point. The coordinate sum of the current contact point is divided by the current contact point number to obtain the coordinate of the central point of the first contact point, and the distance sum of the coordinate of the current contact point and the coordinate of the central point of the first contact point is divided by the current contact point number to obtain the first average distance between the current contact point and the central point of the first contact point. And then the same steps are used for calculating a second average distance between the initial contact and the center point of the second contact. And (3) quotient the first average distance and the second average distance to obtain a scaling value of the window. The ratio is smaller than 1, and the ratio is smaller, and the ratio is larger. When the ratio is 1, there is no zoom out, which may correspond to two or more fingers maintaining a fixed relative distance over the moving window, at which point the movement Offset (Offset) of the contact point may be calculated still further.
And calculating the moving Offset of the contact, specifically, obtaining a first contact center point by dividing the current contact number by the coordinate accumulation sum of the current contact, obtaining a second contact center point by dividing the initial contact number by the coordinate accumulation sum of the initial contact, and calculating the distance between the first contact center point and the second contact center point, wherein the distance is the moving Offset (x, y) (Offset) of the contact. The value of x of the shift offset is positive, indicating a shift to the right and vice versa. The y value of the shift offset is positive, indicating a downward shift, and vice versa.
When the prejudging event is intended to be the movement of a mouse or the stretching of a window under single-point touch (single-finger movement) or the movement of the window, selecting to further calculate the movement offset of the contact, specifically, obtaining a first contact center point by dividing the coordinate accumulation sum of the current contact by the current contact number, obtaining a second contact center point by dividing the coordinate accumulation sum of the initial contact by the initial contact number, and calculating the distance between the first contact center point and the second contact center point, wherein the distance is the movement offset (x, y) of the contact. The value of x of the shift offset is positive, indicating a shift to the right and vice versa. The y value of the shift offset is positive, indicating a downward shift, and vice versa.
S430, generating the interface processing instruction according to the calculated movement offset and the scaling value;
s440, responding to the interface processing instruction, and processing the current display interface of one or more signal sources.
The window is made responsive to the movement offset and the scaling value to effect a window size change and a position change.
In the invention, the window exists as a component, and the width and the height of the window component can be respectively adjusted when the scaling value is responded to the window component, and the window component is used for displaying the current display interface of the signal source. Using 16:9, and calculating to obtain a change factor of width and height (e.g. the factor formula of width is f (n) =16×scale). When Scale is greater than 1, the width and height of the window assembly are adjusted (added with factors), namely amplified; when Scale is less than 1, the window assembly width and height are inversely adjusted (subtracted from the factor), i.e., scaled down.
According to some embodiments of the present invention, when responding to the movement offset to the window assembly, the vertex (upper left and/or lower right diagonal) of the window assembly needs to be adjusted respectively, according to some embodiments of the present invention, the adjustment is differentiated according to the pre-determined event intention, and when the pre-determined is the movement window intention (i.e. moving instead of zooming in or out the window, the movement may include a single-point touch movement and a mouse movement), only the position of the upper left vertex of the window assembly is adjusted; when the window is predicted to be stretched, the size of the window component changes along with the moving offset, and the starting point of the window component needs to be distinguished again for processing: the starting point moves leftwards and upwards when the pre-judging direction is left, upper left and upper; the starting points are kept unchanged when the right, the lower right and the lower right are used; the starting point Y moves upwards in the right upper direction; the starting point X moves axially to the left at the lower left.
S450, limiting the boundary in the process of moving, shrinking or enlarging the current display interface.
Specifically, in one embodiment, the boundary limiting specifically includes: determining that the first vertex ordinate of the current display interface is smaller than the first vertex ordinate of the parent component, and the first vertex abscissa of the current display interface is larger than the first vertex abscissa of the parent component; and determining that the second vertex ordinate of the current display interface is greater than the second vertex ordinate of the parent component, and the second vertex abscissa of the current display interface is less than the second vertex abscissa of the parent component.
In this embodiment, the first quadrant of the coordinate system established by using the bottom left corner of An Zhuoduan as the origin is the screen area, and the first vertex (upper left corner) abscissa, the first vertex ordinate, the second vertex (lower right corner) abscissa, and the second vertex ordinate are all positive.
The determination of the first vertex and the second vertex has a close relationship with the construction of the coordinate system, and may be adjusted according to the constructed coordinate system, which is not particularly limited herein.
For example, in another embodiment, the window assembly adjustment is further bounded while responding to the contact changes, including: the window top left vertex (topLeft) is limited to be not larger than the top left vertex of the parent level, and the bottom right (bottom right) vertex is limited to be smaller than the bottom right vertex of the parent level by comparing the window vertices (the first vertex and the second vertex of the current display interface) with the vertices of the parent level assembly (the grid area divided for each signal source in the An Zhuoduan screen), so that the window assembly is limited in the parent level assembly, the problem that the window assembly overflows or is cut off by the parent level assembly when the position and the size of the window assembly change is avoided, and the interface friendliness and interaction efficiency are reduced is solved, and meanwhile, the friend degree and further interaction efficiency of the interface are guaranteed.
In this embodiment, the upper left-most corner of An Zhuoduan is taken as the origin, and the fourth quadrant of the coordinate system thus established is the screen area, where the first vertex ordinate abscissa and the second vertex abscissa are positive, and the first vertex ordinate and the second vertex ordinate are negative.
According to some embodiments of the present invention, in order to enable a window component under an android end to respond to a change in position and size, a modifier and a modifier. In addition, a remmber record function is reused in the window component to record changes in the value, including the vertex coordinates of the currently displayed interface, and the window size of the currently displayed interface, and a value is responded to the interface (An Zhuoduan interface) by a mutatestateof state function. When the interface is redrawn, the previously stored values, such as the vertex coordinates of the current display interface and the size of the current display interface, are read, and the subsequent changes can be used as the reference starting point value according to the value just stored before instead of the initial initialization value, so that the calculation efficiency, the response speed and the correct response mode are ensured.
When multiple (source) windows are displayed on An Zhuoduan, the modifier and modifier may be combined for the window components corresponding to each window, according to some embodiments of the invention. And re-using a remmber record function in each window component to record changes in the values, including the vertex coordinates of the currently displayed interface, and the size of the currently displayed interface, and responding to the values to the interfaces (An Zhuoduan to the small grid areas/interfaces divided for the respective signal sources) by a mutatestateof status function. Through the offset position Modifier of the Modifier and the size Modifier of the Modifier, and by matching with a remmber record function and a mutatetateof state function, the method responds to input events (a mouse, gestures and the like) of a user and calculates corresponding results, can solve the problems of overlapping windows, undersize windows and covering windows, can avoid the problem of low visibility of contents, can adapt to the requirement of any layout of the windows, can achieve an accurate adjustment effect, has high sensitivity in event response (for example, the windows can realize the same-frame oblique dragging movement without completing the movement of two frames after transverse and longitudinal movement), and has smooth and non-sticky pictures, and can be moved by dragging, namely, can be seen.
Fig. 5 shows a general frame schematic of a method of controlling one or more signal sources by An Zhuoduan provided by the present invention. As shown in fig. 5, the method specifically includes:
event acquisition, including implementing modifier listening, continues listening for modifiers in a coroutine polling manner. In the monitoring process, a pressing event may occur, after the pressing event occurs, on one hand, the number (single point or multiple points) and the type (mouse, single point touch or multiple points touch) of the pressing event are analyzed to prejudge the event intention, on the other hand, the moving event is continuously monitored, after the moving event is monitored, the moving event is analyzed and calculated by referring to the prejudge event intention, then, according to the analysis and calculation result, response change is implemented, and in the changing process, anti-overflow limitation (namely boundary limitation) is carried out on the response change. When a lift event occurs, the event collection ends. For details of some steps in the above process, reference is made to the description about fig. 4, which is not repeated here.
By means of the above-described embodiments of the invention, it is possible to achieve a control of the mouse over An Zhuoduan and thus the individual signal sources by An Zhuoduan. The introduction of the mouse also enables An Zhuoduan to be more compatible with the daily interactive habits of the general users, so that the interactive efficiency of An Zhuoduan on the signal source is further improved.
The above description of the input device being a mouse also applies to the case when the input device is a keyboard, where two keyboard symbols on the mouse may be corresponding to left and right keys of the mouse, which is not repeated herein for simplicity.
The present invention also provides a system for controlling one or more signal sources via An Zhuoduan, which in operation performs the steps of the method for controlling one or more signal sources via An Zhuoduan described above.
Fig. 6 illustrates a physical schematic diagram of an electronic device, as shown in fig. 6, which may include: processor 610, communication interface (communications Interface) 620, memory 630, and communication bus 640, wherein processor 610, communication interface 620, and memory 630 communicate with each other via communication bus 640. The processor 610 may invoke logic instructions in the memory 630 to perform a mouse control method comprising: acquiring current display interfaces of one or more signal sources on the signal interaction end, and displaying the current display interfaces of the one or more signal sources on the interface of An Zhuoduan; acquiring interface processing instructions input by the input equipment to one or more signal sources based on the interface of An Zhuoduan; and responding to the interface processing instruction, and processing the current display interface of one or more signal sources.
Further, the logic instructions in the memory 630 may be implemented in the form of software functional units and stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In another aspect, the present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, is implemented to perform the mouse control method provided by the above methods, the method comprising: acquiring current display interfaces of one or more signal sources on the signal interaction end, and displaying the current display interfaces of the one or more signal sources on the interface of An Zhuoduan; acquiring interface processing instructions input by the input equipment to one or more signal sources based on the interface of An Zhuoduan; and responding to the interface processing instruction, and processing the current display interface of one or more signal sources.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (12)
1. A method of controlling one or more signal sources via An Zhuoduan, applied to a system for controlling one or more signal sources via An Zhuoduan, the system comprising An Zhuoduan, a signal interaction terminal, an input device, and at least one signal source, the input device, an Zhuoduan, and the signal interaction terminal being connected in sequence, the signal source being connected to the signal interaction terminal;
the method comprises the following steps:
acquiring current display interfaces of one or more signal sources on the signal interaction end, and displaying the current display interfaces of the one or more signal sources on the interface of An Zhuoduan;
Acquiring interface processing instructions input by the input equipment to one or more signal sources based on the interface of An Zhuoduan;
and responding to the interface processing instruction, and processing the current display interface of one or more signal sources.
2. The method of claim 1, wherein the obtaining interface processing instructions input by the input device to the one or more signal sources based on the An Zhuoduan interface comprises:
uniformly monitoring touch events and mouse events, wherein the touch events comprise single-point touch events and multi-point touch events, and the mouse events comprise mouse pressing events, mouse moving events and mouse lifting events;
acquiring the interface processing instruction according to the monitored touch event or the monitored mouse event;
the interface processing instruction comprises zooming out, zooming in, stretching and moving the current display interface.
3. The method of claim 2, wherein the obtaining the interface processing instruction according to the monitored touch event or the mouse event comprises:
Determining an event intention according to the touch event or the mouse event, wherein the event intention comprises image movement, image scaling and image stretching;
calculating a movement offset and a scaling value according to the event intention;
generating the interface processing instruction according to the calculated movement offset and the scaling value;
accordingly, the responding to the interface processing instruction processes the current display interface of one or more signal sources, including:
moving the current display interface according to the movement offset;
reducing or enlarging the current display interface according to the scaling value;
and performing boundary limitation in the process of moving, shrinking or enlarging the current display interface.
4. A method of controlling one or more signal sources via An Zhuoduan as claimed in claim 3, wherein said calculating a movement offset and a scaling value based on said event intent comprises:
determining that the event is intended for image scaling, calculating a first average distance between the current contact and a first contact center point, and calculating a second average distance between the initial contact and a second contact center point;
Obtaining the scaling value by obtaining a quotient of the first average distance and the second average distance;
the coordinates of the first contact center point are obtained by dividing the current contact point number by the coordinate accumulation sum of the current contact point, and the coordinates of the second contact center point are obtained by dividing the initial contact point number by the coordinate accumulation sum of the initial contact point.
5. The method of controlling one or more signal sources via An Zhuoduan of claim 4, wherein said calculating a movement offset and a scaling value based on said event intent comprises:
determining that the scaling value is 1 or that the event is intended to be an image movement or an image stretching;
and calculating the distance between the first contact center point and the second contact center point, wherein the distance is the movement offset.
6. A method of controlling one or more signal sources via An Zhuoduan as claimed in claim 3, wherein said limiting boundaries during moving, zooming out or zooming in of said current display interface comprises:
determining that the first vertex ordinate of the current display interface is smaller than the first vertex ordinate of the parent component, and the first vertex abscissa of the current display interface is larger than the first vertex abscissa of the parent component;
And determining that the second vertex ordinate of the current display interface is greater than the second vertex ordinate of the parent component, and the second vertex abscissa of the current display interface is less than the second vertex abscissa of the parent component.
7. The method of controlling one or more signal sources through An Zhuoduan of claim 2, wherein the unified listening for touch events and mouse events comprises:
adding a modifier.pointerinput modifier to a window component to which the current display interface belongs, starting a Kotlin cooperative distance in the modifier, and monitoring a touch event and a mouse event in a spin polling mode;
determining that the monitored event has a pressure value signal, wherein the monitored event is the touch event;
and determining that the monitored event does not have a pressure value signal, and determining that the monitored event is the mouse event.
8. A method of controlling one or more signal sources via An Zhuoduan as recited in claim 3 wherein said processing said currently displayed interface of one or more signal sources in response to said interface processing instructions comprises:
determining a window component combination modifier and a modifier size modifier corresponding to the current display interface so that a window component can respond to the change of the position and the size of the current display interface;
Recording the change of the value by using a remamber recording function, responding the value to an interface through a mutableStateOf state function, and displaying the value;
wherein the value includes vertex coordinates of the current display interface, and a size of the current display interface.
9. A method of controlling one or more signal sources by An Zhuoduan according to any one of claims 1 to 8, wherein said signal source is a camera for transmitting images or videos taken by said camera to said An Zhuoduan.
10. The method of controlling one or more signal sources through An Zhuoduan according to any one of claims 1-8, wherein said An Zhuoduan comprises a mobile device and said input device comprises a mouse connected to said An Zhuoduan by bluetooth or USB wires.
11. The method of any one of claims 1-8, wherein the An Zhuoduan and the signal-interactive side each comprise an interactive interface element that is displayed when a touch or mouse click is received and hidden when no touch or mouse click is received.
12. A system for controlling one or more signal sources via An Zhuoduan, wherein the system, when in operation, performs the method of controlling one or more signal sources via An Zhuoduan as claimed in any one of claims 1 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311188886.2A CN117406896A (en) | 2023-09-14 | 2023-09-14 | Method and system for controlling one or more signal sources via An Zhuoduan |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311188886.2A CN117406896A (en) | 2023-09-14 | 2023-09-14 | Method and system for controlling one or more signal sources via An Zhuoduan |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117406896A true CN117406896A (en) | 2024-01-16 |
Family
ID=89496955
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311188886.2A Pending CN117406896A (en) | 2023-09-14 | 2023-09-14 | Method and system for controlling one or more signal sources via An Zhuoduan |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117406896A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204557397U (en) * | 2015-02-03 | 2015-08-12 | 王海峰 | The wire mouse of a kind of smart mobile phone or panel computer |
| CN110049365A (en) * | 2019-03-18 | 2019-07-23 | 深圳康佳电子科技有限公司 | Visual information source switching handling method, display terminal, television set and storage medium |
| CN110851011A (en) * | 2019-09-17 | 2020-02-28 | 丁建华 | System and method for interacting large-screen multi-signal-source complex display contents |
| CN111049868A (en) * | 2018-10-15 | 2020-04-21 | 北京仁光科技有限公司 | Data interaction system and data interaction method |
| CN111309199A (en) * | 2019-02-28 | 2020-06-19 | 深圳市鸿合创新信息技术有限责任公司 | Display control method of touch display device and touch display device |
| CN113010075A (en) * | 2021-04-27 | 2021-06-22 | 北京仁光科技有限公司 | Multi-signal source window interaction method and system, readable storage medium and electronic device |
| CN216700149U (en) * | 2021-12-21 | 2022-06-07 | 苏州侎特自然健康科技有限公司 | Image output control system based on android system |
-
2023
- 2023-09-14 CN CN202311188886.2A patent/CN117406896A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204557397U (en) * | 2015-02-03 | 2015-08-12 | 王海峰 | The wire mouse of a kind of smart mobile phone or panel computer |
| CN111049868A (en) * | 2018-10-15 | 2020-04-21 | 北京仁光科技有限公司 | Data interaction system and data interaction method |
| CN111309199A (en) * | 2019-02-28 | 2020-06-19 | 深圳市鸿合创新信息技术有限责任公司 | Display control method of touch display device and touch display device |
| CN110049365A (en) * | 2019-03-18 | 2019-07-23 | 深圳康佳电子科技有限公司 | Visual information source switching handling method, display terminal, television set and storage medium |
| CN110851011A (en) * | 2019-09-17 | 2020-02-28 | 丁建华 | System and method for interacting large-screen multi-signal-source complex display contents |
| CN113010075A (en) * | 2021-04-27 | 2021-06-22 | 北京仁光科技有限公司 | Multi-signal source window interaction method and system, readable storage medium and electronic device |
| CN216700149U (en) * | 2021-12-21 | 2022-06-07 | 苏州侎特自然健康科技有限公司 | Image output control system based on android system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220043569A1 (en) | Display device, display controlling method, and computer program | |
| US20180232135A1 (en) | Method for window displaying on a mobile terminal and mobile terminal | |
| CN105426080B (en) | A kind of picture switching method and terminal | |
| JP4102827B2 (en) | Method and apparatus for searching menu on display unit of electronic device | |
| EP3002664B1 (en) | Text processing method and touchscreen device | |
| US9703392B2 (en) | Methods and apparatus for receiving, converting into text, and verifying user gesture input from an information input device | |
| US8542199B2 (en) | Image processing apparatus, image processing method, and program | |
| JP6478654B2 (en) | Imaging apparatus and control method thereof | |
| JP5910345B2 (en) | Character input program, information processing apparatus, and character input method | |
| WO2017084470A1 (en) | Mobile terminal, input processing method and user equipment, and computer storage medium | |
| JPWO2019203351A1 (en) | Image display device and image display method | |
| WO2011116705A1 (en) | Method and device for key-press judgement based on touch screen | |
| CN109194866B (en) | Image acquisition method, device, system, terminal equipment and storage medium | |
| WO2012176315A1 (en) | Information processing device, input control method, and input control program | |
| CN103685930A (en) | Display control apparatus, and method for controlling the same | |
| CN105940672B (en) | Detect the pattern described on the screen of user equipment | |
| EP3454202B1 (en) | Frame drop processing method and system for played ppt | |
| WO2015085874A1 (en) | Method and device for identifying gesture | |
| CN106896995B (en) | Wallpaper configuration method and device for mobile terminal | |
| CN111399721B (en) | Method and device for triggering search by display interface, storage medium and terminal | |
| CN117406896A (en) | Method and system for controlling one or more signal sources via An Zhuoduan | |
| WO2015127731A1 (en) | Soft keyboard layout adjustment method and apparatus | |
| JP6161244B2 (en) | Portable terminal device, program, and input method | |
| JP6183940B2 (en) | Information processing apparatus and input support method | |
| CN112286430B (en) | Image processing method, apparatus, device and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |