CN111641857A - Interaction method and device of controlled equipment, interaction method and device of main control equipment, terminal and storage medium - Google Patents
Interaction method and device of controlled equipment, interaction method and device of main control equipment, terminal and storage medium Download PDFInfo
- Publication number
- CN111641857A CN111641857A CN202010474793.6A CN202010474793A CN111641857A CN 111641857 A CN111641857 A CN 111641857A CN 202010474793 A CN202010474793 A CN 202010474793A CN 111641857 A CN111641857 A CN 111641857A
- Authority
- CN
- China
- Prior art keywords
- connection
- data information
- equipment
- operation event
- controlled
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03547—Touch pads, in which fingers can move on a surface
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42221—Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C2201/00—Transmission systems of control signals via wireless link
- G08C2201/30—User interface
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C2201/00—Transmission systems of control signals via wireless link
- G08C2201/40—Remote control systems using repeaters, converters, gateways
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C2201/00—Transmission systems of control signals via wireless link
- G08C2201/50—Receiving or transmitting feedback, e.g. replies, status updates, acknowledgements, from the controlled devices
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Telephonic Communication Services (AREA)
Abstract
The disclosure provides an interaction method and device of controlled equipment, an interaction method and device of main control equipment, a terminal and a storage medium. The interaction method of the controlled equipment comprises the following steps: establishing connection with controlled equipment; acquiring an operation event of the mobile terminal, and identifying the operation event as data information; and transmitting the data information to the controlled equipment through connection, so that the controlled equipment executes the operation event according to the data information. The interaction method of the main control equipment comprises the following steps: establishing connection with the master control equipment; receiving data information sent from the master control equipment through connection; analyzing the data information to obtain an operation event recorded by the data information; and executing the operation event at the computer terminal. The interaction method can enable the intelligent equipment to realize the function of the remote controller.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to an interaction method and apparatus for a controlled device, an interaction method and apparatus for a main control device, a terminal, and a storage medium.
Background
The diversified development of the electronic equipment greatly facilitates the work and life of people. However, different devices often have different remote controls, which also can be inconvenient.
Disclosure of Invention
In order to solve the existing problems, the present disclosure provides an interaction method and apparatus for a controlled device, an interaction method and apparatus for a main control device, a terminal, and a storage medium.
The present disclosure adopts the following technical solutions.
In some embodiments, the present disclosure provides an interaction method of a controlled device, executed in a mobile terminal, including:
establishing connection with the controlled equipment;
acquiring an operation event of the mobile terminal, and identifying the operation event as data information; and
transmitting the data information to the controlled equipment through the connection, so that the controlled equipment executes the operation event according to the data information;
wherein the operation event comprises a gesture operation event and/or a motion event; the mode of the operational event includes a touchpad mode or a vole mode.
In some embodiments, the present disclosure provides an interaction method of a master control device, executed in a computer terminal, including:
establishing connection with the master control equipment;
receiving data information sent from the master control device through the connection;
analyzing the data information to obtain an operation event recorded by the data information; and
and executing the operation event at the computer terminal.
In some embodiments, the present disclosure provides an interaction apparatus of a controlled device, including:
the connection module is used for establishing connection with the controlled equipment;
the acquisition module is used for acquiring operation events;
the identification module is used for identifying the operation event as data information; and
the transmission module is used for transmitting the data information to the controlled equipment through the connection so that the controlled equipment executes the operation event according to the data information;
wherein the operation event comprises a gesture operation event and/or a motion event; the mode of the operational event includes a touchpad mode or a vole mode.
In some embodiments, the present disclosure provides an interaction apparatus of a master device, including:
the connection module is used for establishing connection with the main control equipment;
the receiving module is used for receiving the data information sent from the main control equipment through the connection;
the analysis module is used for analyzing the data information to obtain the operation event recorded by the data information; and
and the execution module is used for executing the operation event.
In some embodiments, the present disclosure provides a terminal comprising: at least one memory and at least one processor;
the memory is used for storing program codes, and the processor is used for calling the program codes stored in the memory to execute the method.
In some embodiments, the present disclosure provides a storage medium for storing program code for performing the above-described method.
The interaction method provided by the disclosure can enable the intelligent device to realize the function of the remote controller, thereby avoiding the inconvenience that different remote controllers need to correspond to different devices.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.
Fig. 1 is a flowchart of an interaction method of a controlled device according to an embodiment of the present disclosure.
Fig. 2 is a schematic diagram of a mobile terminal application home interface according to an embodiment of the disclosure.
Fig. 3 is a flowchart of an interaction method of a master device according to an embodiment of the present disclosure.
Fig. 4 is a schematic structural diagram of an interaction device of a controlled device according to an embodiment of the present disclosure.
Fig. 5 is a schematic structural diagram of an interaction apparatus of a master control device according to an embodiment of the present disclosure.
Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be understood that various steps recited in method embodiments of the present disclosure may be performed in parallel and/or in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a" or "an" in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that reference to "one or more" unless the context clearly dictates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
The function of the virtual remote controller may be implemented in two parts, one part may be an application installed on a main control device such as a mobile terminal, for example, a client (client) application, and the other part may be an application installed on a controlled device such as a computer terminal of a smart television or a large-screen computer, for example, a server (server) application.
The following detailed description will be made on the scheme provided by the embodiments of the present application, respectively, with reference to the accompanying drawings.
As shown in fig. 1, fig. 1 is a flowchart of an interaction method of a controlled device according to an embodiment of the present disclosure, which may be executed in a mobile terminal, for example, and may include the following steps.
And S100, establishing connection with the controlled equipment.
Specifically, the embodiment of the present disclosure may monitor and determine the controlled device by the identifier; sending a connection request to the controlled equipment by establishing a webpage socket protocol data transmission channel so as to establish connection with the controlled equipment after the controlled equipment passes the connection request; or scanning the identifier of the controlled device to identify the controlled device and establish connection with the controlled device; wherein, the identification comprises a device name, a physical address, a network interconnection protocol number and a port. More specifically, listening and determining a controlled device by identification includes: registering a network service discovery protocol; initializing sensors for listening, such as discovery listeners; and according to the network service discovery protocol, the network interconnection protocol number, the port, the physical address and the equipment name of the controlled equipment are obtained through monitoring by the sensor so as to determine the controlled equipment. The method for sending a connection request to the controlled equipment by establishing a webpage socket protocol data transmission channel so as to establish connection with the controlled end after the controlled equipment passes the connection request comprises the following steps: establishing a network socket client object according to the internet interconnection protocol number and the port of the controlled equipment; the network socket client object sends a connection request to the controlled equipment; and receiving a connection response returned by the controlled equipment to complete the establishment of the connection. The embodiment of the disclosure includes two connection ways, for example, the master device and the controlled device are connected to the same wireless network, and at this time, the connection between the master device and the controlled device can be established. As shown in fig. 2, fig. 2 is a schematic diagram of a master device, for example, a mobile terminal application master interface according to an embodiment of the present disclosure. In fig. 2, when entering the main interface of the client application, the user can click the control 1 in the upper left corner, i.e., can search for nearby devices, and display the devices in a popup window in the form of a list, and the user can click the searched devices to connect. Or entering a main interface of the client application, clicking the control 2 at the upper right corner, and connecting with the equipment through a mark displayed on the scanning equipment, such as a two-dimensional code. It is to be understood that the information of the positions and shapes of the control 1 and the control 2 in fig. 2 is not limited to the information shown in the figure, and the specific style shown in the figure is only for exemplary purposes. The first approach may include two steps of searching for a device and establishing a connection. For example, the master device registers Network Service Discovery (NSD) snooping and initializes a Discovery listener to discover the controlled device through the same protocol number, port, and device name. Through the Websocket technology, a network socket client (WebSocketclient) object is newly built by the client according to the IP and the port of the server, and is connected with a network socket server (WebSocketServer) object of the server. However, in some scenarios, the server may not be searched for by the NSD service, in which case the client may identify the server and establish a connection by means of identification, such as two-dimensional code scanning.
S200, acquiring an operation event of the mobile terminal, and identifying the operation event as data information.
Wherein the operation event comprises a gesture operation event and/or a motion event; the mode of the operation event comprises a touch pad mode or a mouse flying mode; the data information includes instruction information and motion information. Specifically, when the mode is the touchpad mode, the embodiment of the present disclosure may acquire the recognized gesture operation event including the number of the at least one touch point, the initial position, the motion trajectory, and the termination position of each of the at least one touch point, and encapsulate the gesture operation event into data information. When the mode is the voly mode, the embodiment of the disclosure can acquire the identified motion event including the number of the at least one identification point, the initial position, the motion track and the ending position of each identification point, and encapsulate the motion event into data information. In an embodiment of the present disclosure, a gyro sensor may be registered to monitor a movement route to obtain movement information and encapsulate the movement information. Wherein, the motion route can also comprise a motion amplitude and a motion track; encapsulating the motion information may in turn include an adaptation process: such as obtaining the display size of the controlled device; and obtaining the movement distance of unit movement amplitude on the controlled equipment according to the display size and the movement amplitude, and packaging the movement distance and the movement track.
More specifically, after the client establishes a connection with the server, the remote control function may be activated. At this time, the interface can be displayed in two modes: a touchpad mode or a mouse-over mode; the two modes can be switched by, for example, a mode switching button. For example, in a touch pad mode, the embodiment of the present disclosure may recognize the gesture operation of the user by setting ontouchListener on the remote control interface, encapsulate different gestures into corresponding instructions, for example, may splice into a character string in a Json form, and send the character string to the server through WebSocketClient. For another example, in the mouse-over mode, the client may listen for motion changes of the device by registering a gyro sensor (gyroscopic sensor) through sensor technology. Then according to the display size of the controlled equipment and the integral amplitude of the rotation of the equipment, the proper steps are adjustedLength; wherein, the step size can refer to the movement distance of the unit movement amplitude of the master control device reflected on the controlled device. And then the motion route is sent to the server side according to the motion track and by combining with proper step length. The motion information may, for example, establish virtual coordinates, which may include position change information of the device and corresponding movement distance, and may specifically include an X where the initial position is located at the virtual coordinates1Coordinate, Y1Coordinate sum Z1Coordinates, X of virtual coordinates traversed by the equipment during its movement2Coordinate, Y2Coordinate sum Z2Coordinate … … until the device reaches an end position at X of the virtual coordinatenCoordinate, YnCoordinate sum ZnAnd (4) coordinates.
And S300, transmitting the data information to the controlled equipment through connection, so that the controlled equipment executes the operation event according to the data information.
Specifically, the embodiment of the present disclosure may transmit the encapsulated data information to the controlled device through the websocket protocol data transmission channel.
As shown in fig. 3, fig. 3 is a flowchart of an interaction method of a master control device according to an embodiment of the present disclosure, which may be executed in a computer terminal, for example, and may include the following steps.
And S500, establishing connection with the main control equipment.
Specifically, embodiments of the present disclosure may include: establishing a web socket protocol data transmission channel, registering a network service discovery protocol, setting a protocol number, a port and an equipment name of a computer terminal according to the network service discovery protocol, sending the protocol number, the port and the equipment name to a main control device through the web socket protocol data transmission channel, receiving a connection request sent from the main control device, and sending a connection response to the main control device to complete connection; or displaying the identifier, and receiving and passing the connection request sent by the slave main control equipment; wherein the identification comprises a device name, a physical address, a network interconnection protocol and a port of the computer terminal. In addition, the embodiments of the present disclosure may further include: establishing a network socket server object; receiving a connection request sent by the master control equipment to a network socket server object; and returning a connection response to the master control device. On one hand, the server side can register NSD service and set protocol number, port and equipment name; the server can transmit information about the local computer, such as device name, IP and port, to the client, and the client can read out the relevant information and display the information in the device list. On the other hand, in the code scanning identification embodiment, a two-dimensional code containing controlled equipment information such as an equipment name, a physical address, an IP and a port can be displayed on the server interface, and the two-dimensional code can be dynamically changed along with the change of the equipment information so as to ensure the timeliness of the information. The client obtains real-time information of the server by scanning the two-dimensional code, and can directly establish connection with the server through WebSocket under the condition that conditions such as a network and the like are met.
And S600, receiving the data information sent from the main control equipment through connection.
As mentioned above, the controlled device can receive the encapsulated data information through the established data transmission channel of the websocket protocol.
And S700, analyzing the data information to obtain the operation event recorded by the data information.
Specifically, the embodiment of the present disclosure may analyze the data information to obtain the number of at least one touch point or identification point, a first initial position, a first motion trajectory, and a first end position of each at least one touch point or identification point; and adapting the first initial position, the first motion track and the first termination position according to the display proportion of the computer terminal to obtain a second initial position, a second motion track and a second termination position which are adapted to the display of the computer terminal. In the embodiment of the present disclosure, after the data information is disassembled, the disassembled data information may be translated into a gesture operation event, or a movement distance and a movement track. More specifically, the server may disassemble the information after receiving the information, translate the information into corresponding gesture events, and then send the gesture events to, for example, an InputManager for processing. Or the server side moves the mouse arrow according to the received motion track, and the effect of the mouse can be achieved. If the data information is not subjected to the adaptation operation at the transmitting end, adaptation may be performed in this step, so as to convert the first information (the first initial position, the first motion trajectory, the first end position, and the like) into the second information (the second initial position, the second motion trajectory, the second end position, and the like).
And S800, executing the operation event at the computer terminal.
Through the operation, the operation of the user on the client can be embodied on the server so as to obtain the effect of the remote controller.
According to the scheme, the intelligent equipment can be virtualized to be the remote controller, different remote control devices do not need to be configured for different equipment, and convenience can be brought to users.
As shown in fig. 4, an interaction apparatus 10 of a controlled device, which may be a master device, for example, is further provided in the embodiment of the present disclosure, and includes a connection module 13, an acquisition module 15, an identification module 17, and a transmission module 19. Wherein the connection module 13 can be used to establish a connection with the controlled device. The acquisition module 15 may be used to acquire operational events. The identification module 17 may be used to identify the operational event as data information. The transmission module 19 is configured to transmit the data information to the controlled device through the connection, so that the controlled device executes the operation event according to the data information.
As shown in fig. 5, fig. 5 illustrates an interaction apparatus 30 of a master device provided in the embodiment of the present disclosure, which may be a controlled device, and may include a connection module 33, a receiving module 35, a parsing module 37, and an execution module 39. The connection module 33 may be configured to establish a connection with a master device. The receiving module 35 may be configured to receive data information sent from the master device through the connection. The parsing module 37 may be configured to parse the data information to obtain an operation event recorded by the data information. The execution module 39 may be used to execute the operational events.
For the embodiments of the apparatus, since they correspond substantially to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described apparatus embodiments are merely illustrative, wherein the modules described as separate modules may or may not be separate. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
In the above, the interaction method and apparatus for the controlled device and the interaction method and apparatus for the main control device of the present disclosure are described based on the embodiments and application cases. In addition, the present disclosure also provides a terminal and a storage medium, which are described below.
Referring now to fig. 6, a schematic diagram of an electronic device (e.g., a terminal device or server) 800 suitable for use in implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 6, the electronic device 800 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 801 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)802 or a program loaded from a storage means 808 into a Random Access Memory (RAM) 803. In the RAM803, various programs and data necessary for the operation of the electronic apparatus 800 are also stored. The processing apparatus 801, the ROM 802, and the RAM803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.
Generally, the following devices may be connected to the I/O interface 805: input devices 806 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 807 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage 808 including, for example, magnetic tape, hard disk, etc.; and a communication device 809. The communication means 809 may allow the electronic device 800 to communicate wirelessly or by wire with other devices to exchange data. While fig. 6 illustrates an electronic device 800 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication means 809, or installed from the storage means 808, or installed from the ROM 802. The computer program, when executed by the processing apparatus 801, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText transfer protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to perform the methods of the present disclosure as described above.
Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, there is provided an interaction method of a controlled device, performed in a mobile terminal, including:
establishing connection with the controlled equipment;
acquiring an operation event of the mobile terminal, and identifying the operation event as data information; and
transmitting the data information to the controlled equipment through the connection, so that the controlled equipment executes the operation event according to the data information;
wherein the operation event comprises a gesture operation event and/or a motion event; the mode of the operational event includes a touchpad mode or a vole mode.
According to one or more embodiments of the present disclosure, there is provided an interactive method, wherein the establishing a connection with the controlled device includes:
monitoring and determining the controlled equipment through identification; sending a connection request to the controlled equipment by establishing a webpage socket protocol data transmission channel so as to establish connection with the controlled equipment after the controlled equipment passes the connection request; or
Scanning the identity of the controlled device to identify the controlled device and establish a connection with the controlled device; wherein the identification comprises a device name, a physical address, a network interconnection protocol number and a port.
According to one or more embodiments of the present disclosure, there is provided an interaction method, wherein the listening and determining the controlled device by identification includes:
registering a network service discovery protocol;
initializing a sensor for monitoring; and
and according to the network service discovery protocol, the network interconnection protocol number, the port, the physical address and the equipment name of the controlled equipment are obtained through monitoring by the sensor so as to determine the controlled equipment.
According to one or more embodiments of the present disclosure, there is provided an interaction method, where the sending a connection request to the controlled device by establishing a websocket protocol data transmission channel to establish a connection with the controlled device after the controlled device passes the connection request includes:
establishing a network socket client object according to the network interconnection protocol number and the port of the controlled equipment;
sending the connection request to the controlled device through the network socket client object; and
and receiving a connection response returned from the controlled equipment to complete connection establishment.
According to one or more embodiments of the present disclosure, there is provided an interaction method, in which the obtaining an operation event for the mobile terminal, and the identifying the operation event as data information includes:
when the mode is the touchpad mode, acquiring the recognized gesture operation event comprising the number of at least one touch point, the initial position, the motion track and the termination position of each touch point, and packaging the gesture operation event into the data information;
when the mode is the flying mouse mode, acquiring the identified motion event comprising the number of at least one identification point, the initial position, the motion track and the termination position of each identification point, and encapsulating the motion event into the data information.
According to one or more embodiments of the present disclosure, an interaction method of a master control device is provided, which is executed at a computer terminal, and includes:
establishing connection with the master control equipment;
receiving data information sent from the master control device through the connection;
analyzing the data information to obtain an operation event recorded by the data information; and
and executing the operation event at the computer terminal.
According to one or more embodiments of the present disclosure, an interaction method is provided, where establishing a connection with the master device includes:
establishing a web socket protocol data transmission channel, registering a web service discovery protocol, setting a protocol number, a port and an equipment name of the computer terminal according to the web service discovery protocol, sending the protocol number, the port and the equipment name to the main control equipment through the web socket protocol data transmission channel, receiving a connection request sent from the main control equipment, and sending a connection response to the main control equipment to complete connection; or
Displaying an identifier, and receiving and passing a connection request sent from the master control equipment; wherein the identification comprises a device name, a physical address, a network interconnection protocol and a port of the computer terminal.
According to one or more embodiments of the present disclosure, an interaction method is provided, where the establishing a connection with the master device further includes:
establishing a network socket server object;
receiving the connection request sent from the master device to the web socket server object; and
and returning the connection response to the main control equipment.
According to one or more embodiments of the present disclosure, there is provided an interactive method, where the analyzing the data information and obtaining the operation event recorded by the data information includes:
analyzing the data information to obtain the number of at least one touch point or identification point, a first initial position, a first motion track and a first termination position of each touch point or identification point; and
and according to the display scale of the computer terminal, adapting the first initial position, the first motion track and the first termination position to obtain a second initial position, a second motion track and a second termination position which are adapted to the display of the computer terminal.
According to one or more embodiments of the present disclosure, there is provided an interaction apparatus of a controlled device, including:
the connection module is used for establishing connection with the controlled equipment;
the acquisition module is used for acquiring operation events;
the identification module is used for identifying the operation event as data information; and
the transmission module is used for transmitting the data information to the controlled equipment through the connection so that the controlled equipment executes the operation event according to the data information;
wherein the operation event comprises a gesture operation event and/or a motion event; the mode of the operational event includes a touchpad mode or a vole mode.
According to one or more embodiments of the present disclosure, there is provided an interaction apparatus of a master device, including:
the connection module is used for establishing connection with the main control equipment;
the receiving module is used for receiving the data information sent from the main control equipment through the connection;
the analysis module is used for analyzing the data information to obtain the operation event recorded by the data information; and
and the execution module is used for executing the operation event.
According to one or more embodiments of the present disclosure, there is provided a terminal including: at least one memory and at least one processor;
wherein the at least one memory is configured to store program code, and the at least one processor is configured to call the program code stored in the at least one memory to perform the method of any one of the above.
According to one or more embodiments of the present disclosure, there is provided a storage medium for storing program code for performing the above-described method.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (13)
1. An interaction method of a controlled device, which is executed in a mobile terminal, comprises the following steps:
establishing connection with the controlled equipment;
acquiring an operation event of the mobile terminal, and identifying the operation event as data information; and
transmitting the data information to the controlled equipment through the connection, so that the controlled equipment executes the operation event according to the data information;
wherein the operation event comprises a gesture operation event and/or a motion event; the mode of the operational event includes a touchpad mode or a vole mode.
2. The interaction method of claim 1, wherein said establishing a connection with the controlled device comprises:
monitoring and determining the controlled equipment through identification; sending a connection request to the controlled equipment by establishing a webpage socket protocol data transmission channel so as to establish connection with the controlled equipment after the controlled equipment passes the connection request; or
Scanning the identity of the controlled device to identify the controlled device and establish a connection with the controlled device; wherein the identification comprises a device name, a physical address, a network interconnection protocol number and a port.
3. The interaction method of claim 2, wherein the listening and determining the controlled device by identification comprises:
registering a network service discovery protocol;
initializing a sensor for monitoring; and
and according to the network service discovery protocol, the network interconnection protocol number, the port, the physical address and the equipment name of the controlled equipment are obtained through monitoring by the sensor so as to determine the controlled equipment.
4. The interaction method according to claim 2, wherein the sending a connection request to the controlled device by establishing a web socket protocol data transmission channel to establish a connection with the controlled device after the controlled device passes the connection request comprises:
establishing a network socket client object according to the network interconnection protocol number and the port of the controlled equipment;
sending the connection request to the controlled device through the network socket client object; and
and receiving a connection response returned from the controlled equipment to complete connection establishment.
5. The interaction method according to claim 1, wherein the obtaining of the operation event of the mobile terminal and the identifying of the operation event as data information comprises:
when the mode is the touchpad mode, acquiring the recognized gesture operation event comprising the number of at least one touch point, the initial position, the motion track and the termination position of each touch point, and packaging the gesture operation event into the data information;
when the mode is the flying mouse mode, acquiring the identified motion event comprising the number of at least one identification point, the initial position, the motion track and the termination position of each identification point, and encapsulating the motion event into the data information.
6. An interaction method of a main control device is executed in a computer terminal and comprises the following steps:
establishing connection with the master control equipment;
receiving data information sent from the master control device through the connection;
analyzing the data information to obtain an operation event recorded by the data information; and
and executing the operation event at the computer terminal.
7. The interaction method according to claim 6, wherein the establishing the connection with the master device comprises:
establishing a web socket protocol data transmission channel, registering a web service discovery protocol, setting a protocol number, a port and an equipment name of the computer terminal according to the web service discovery protocol, sending the protocol number, the port and the equipment name to the main control equipment through the web socket protocol data transmission channel, receiving a connection request sent from the main control equipment, and sending a connection response to the main control equipment to complete connection; or
Displaying an identifier, and receiving and passing a connection request sent from the master control equipment; wherein the identification comprises a device name, a physical address, a network interconnection protocol and a port of the computer terminal.
8. The interaction method of claim 7, wherein the establishing the connection with the master device further comprises:
establishing a network socket server object;
receiving the connection request sent from the master device to the web socket server object; and
and returning the connection response to the main control equipment.
9. The interaction method according to claim 6, wherein the parsing the data information to obtain the operation event recorded by the data information comprises:
analyzing the data information to obtain the number of at least one touch point or identification point, a first initial position, a first motion track and a first termination position of each touch point or identification point; and
and according to the display scale of the computer terminal, adapting the first initial position, the first motion track and the first termination position to obtain a second initial position, a second motion track and a second termination position which are adapted to the display of the computer terminal.
10. An interaction apparatus of a controlled device, comprising:
the connection module is used for establishing connection with the controlled equipment;
the acquisition module is used for acquiring operation events;
the identification module is used for identifying the operation event as data information; and
the transmission module is used for transmitting the data information to the controlled equipment through the connection so that the controlled equipment executes the operation event according to the data information;
wherein the operation event comprises a gesture operation event and/or a motion event; the mode of the operational event includes a touchpad mode or a vole mode.
11. An interaction apparatus of a master device, comprising:
the connection module is used for establishing connection with the main control equipment;
the receiving module is used for receiving the data information sent from the main control equipment through the connection;
the analysis module is used for analyzing the data information to obtain the operation event recorded by the data information; and
and the execution module is used for executing the operation event.
12. A terminal, comprising:
at least one memory and at least one processor;
wherein the at least one memory is configured to store program code and the at least one processor is configured to invoke the program code stored in the at least one memory to perform the interaction method of any of claims 1 to 9.
13. A storage medium for storing program code for performing the interaction method of any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010474793.6A CN111641857A (en) | 2020-05-29 | 2020-05-29 | Interaction method and device of controlled equipment, interaction method and device of main control equipment, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010474793.6A CN111641857A (en) | 2020-05-29 | 2020-05-29 | Interaction method and device of controlled equipment, interaction method and device of main control equipment, terminal and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111641857A true CN111641857A (en) | 2020-09-08 |
Family
ID=72333015
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010474793.6A Pending CN111641857A (en) | 2020-05-29 | 2020-05-29 | Interaction method and device of controlled equipment, interaction method and device of main control equipment, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111641857A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112306610A (en) * | 2020-11-02 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Terminal control method and device and electronic equipment |
| CN112738162A (en) * | 2020-12-11 | 2021-04-30 | 深圳市越疆科技有限公司 | Terminal-device communication method, terminal, electronic device, and storage medium |
| CN113365125A (en) * | 2021-05-31 | 2021-09-07 | 北京字节跳动网络技术有限公司 | Terminal control method and device, terminal and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012175606A (en) * | 2011-02-24 | 2012-09-10 | Sumitomo Electric Ind Ltd | Program, mobile terminal, image reception apparatus, image reception system, mobile terminal control method, and image reception apparatus control method |
| CN103677320A (en) * | 2012-08-30 | 2014-03-26 | 索尼公司 | Remote control, remote device, multimedia system and control method |
-
2020
- 2020-05-29 CN CN202010474793.6A patent/CN111641857A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012175606A (en) * | 2011-02-24 | 2012-09-10 | Sumitomo Electric Ind Ltd | Program, mobile terminal, image reception apparatus, image reception system, mobile terminal control method, and image reception apparatus control method |
| CN103677320A (en) * | 2012-08-30 | 2014-03-26 | 索尼公司 | Remote control, remote device, multimedia system and control method |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112306610A (en) * | 2020-11-02 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Terminal control method and device and electronic equipment |
| CN112738162A (en) * | 2020-12-11 | 2021-04-30 | 深圳市越疆科技有限公司 | Terminal-device communication method, terminal, electronic device, and storage medium |
| CN112738162B (en) * | 2020-12-11 | 2023-01-10 | 深圳市越疆科技有限公司 | Terminal-device communication method, terminal, electronic device, and storage medium |
| CN113365125A (en) * | 2021-05-31 | 2021-09-07 | 北京字节跳动网络技术有限公司 | Terminal control method and device, terminal and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111641857A (en) | Interaction method and device of controlled equipment, interaction method and device of main control equipment, terminal and storage medium | |
| WO2023279891A1 (en) | Screen mirroring device discovery method and apparatus, electronic device, and storage medium | |
| CN109059955B (en) | Method and device for drawing indication mark in electronic map navigation | |
| US11711441B2 (en) | Method and apparatus for publishing video synchronously, electronic device, and readable storage medium | |
| CN109408481B (en) | Log collection rule updating method and device, electronic equipment and readable medium | |
| US20230199873A1 (en) | Information interaction method and apparatus, and electronic device | |
| US20230140045A1 (en) | Information processing method and apparatus, device and storage medium | |
| CN111596991A (en) | Interactive operation execution method and device and electronic equipment | |
| US20220408143A1 (en) | Control setting method and apparatus, electronic device and interaction system | |
| WO2020221160A1 (en) | Method and device for presenting background | |
| CN116668402A (en) | Intelligent cloud box access method, device, equipment and storage medium | |
| CN110674481B (en) | Account registration method, device, equipment and storage medium of application program | |
| CN110618768B (en) | Information presentation method and device | |
| CN111614759A (en) | Resource sharing method and device, electronic equipment and computer readable medium | |
| CN112464039B (en) | Tree-structured data display method and device, electronic equipment and medium | |
| US20220215482A1 (en) | User information processing method, apparatus, electronic device, and computer storage medium | |
| CN113766293B (en) | Information display method, device, terminal and storage medium | |
| CN110069186B (en) | Method and equipment for displaying operation interface of application | |
| CN115808929B (en) | Vehicle simulation obstacle avoidance method and device, electronic equipment and computer readable medium | |
| CN111382039A (en) | Method, device, electronic equipment and storage medium for reporting user behavior event | |
| CN111460334B (en) | Information display method and device and electronic equipment | |
| CN111382038B (en) | Method, device, electronic equipment and storage medium for reporting service data | |
| CN113504883A (en) | Window control method and device, electronic equipment and storage medium | |
| CN113342440A (en) | Screen splicing method and device, electronic equipment and storage medium | |
| CN112153091B (en) | Method and device for determining relevance of equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200908 |