CN113141517B - First terminal, second terminal, remote operation control method, and readable storage medium - Google Patents

First terminal, second terminal, remote operation control method, and readable storage medium Download PDF

Info

Publication number
CN113141517B
CN113141517B CN202110380786.4A CN202110380786A CN113141517B CN 113141517 B CN113141517 B CN 113141517B CN 202110380786 A CN202110380786 A CN 202110380786A CN 113141517 B CN113141517 B CN 113141517B
Authority
CN
China
Prior art keywords
terminal
user
image
control signal
image acquisition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110380786.4A
Other languages
Chinese (zh)
Other versions
CN113141517A (en
Inventor
蔡苗
宋蕾
杨道国
梁永湖
张华林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guilin Xuyan Electromechanical Technology Co ltd
Guilin University of Electronic Technology
Original Assignee
Guilin Xuyan Electromechanical Technology Co ltd
Guilin University of Electronic Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guilin Xuyan Electromechanical Technology Co ltd, Guilin University of Electronic Technology filed Critical Guilin Xuyan Electromechanical Technology Co ltd
Priority to CN202110380786.4A priority Critical patent/CN113141517B/en
Publication of CN113141517A publication Critical patent/CN113141517A/en
Application granted granted Critical
Publication of CN113141517B publication Critical patent/CN113141517B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637Control signals issued by the client directed to the server or network components
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A40/00Adaptation technologies in agriculture, forestry, livestock or agroalimentary production
    • Y02A40/80Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in fisheries management

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Telephonic Communication Services (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The invention provides a first terminal, a second terminal, a remote operation control method and a readable storage medium. Wherein, the first terminal includes: the first communication device is in communication connection with the second terminal and is used for sending a control signal to the second terminal so as to enable the execution device of the second terminal to execute an operation function, the image acquisition device of the second terminal to acquire an image of the execution device executing the operation function, and information of the image sent by the second terminal is received; and the display device is connected with the first communication device and is used for displaying images. According to the technical scheme, through the communication connection between the first terminal and the second terminal, the real-time information interaction between the first terminal and the second terminal is realized, the immersive interaction experience is provided for the user, the user can feel the participation fun physically, and the participation feeling of the user is improved.

Description

First terminal, second terminal, remote operation control method, and readable storage medium
Technical Field
The present invention relates to the technical field of remote control, and in particular, to a first terminal, a second terminal, a remote operation control method, and a readable storage medium.
Background
The network live broadcast mode in the current market is a unidirectional audio and video live broadcast mode, namely, a server transmits direct broadcast audio and video information to a client, a user can only conduct online communication in a text mode, a live broadcast interaction mode is single, the possibility that the user can interact and the enjoyment participation sense cannot be met, the experience sense of the user is poor, and the user viscosity is reduced.
Disclosure of Invention
The present invention aims to solve at least one of the technical problems existing in the prior art or related art.
To this end, a first aspect of the invention provides a first terminal.
The second aspect of the present invention also provides a second terminal.
The third aspect of the present invention also provides a remote operation control method, which is applicable to the first terminal.
The fourth aspect of the present invention also provides a remote operation control method, which is applicable to the second terminal.
The fifth aspect of the present invention also provides a readable storage medium.
In view of this, a first aspect of the present invention proposes a first terminal comprising: the first communication device is in communication connection with the second terminal and is used for sending a control signal to the second terminal so as to enable the execution device of the second terminal to execute an operation function, the image acquisition device of the second terminal to acquire an image of the execution device executing the operation function, and information of the image sent by the second terminal is received; and the display device is connected with the first communication device and is used for displaying images.
The first terminal provided by the invention comprises a first communication device and a display device, wherein the first communication device is in communication connection with the second terminal, and the display device is connected with the first communication device. And the first communication device sends a control signal to the second terminal, so that the execution device of the second terminal executes corresponding operation according to the control signal and simultaneously, the image acquisition device of the second terminal acquires images of the operation functions executed by the execution device. Further, the first communication device receives the image information sent by the second terminal, and then displays the image through the display device. Through the communication connection of the first terminal and the second terminal, the real-time information interaction between the first terminal and the second terminal is realized, so that the user can watch the real-time picture of the second terminal from the first terminal and control the second terminal to execute the operation function, thereby providing the user with the immersive interaction experience, enabling the user to personally experience the participation fun, and improving the participation feeling of the user.
The first terminal provided by the invention can also have the following additional technical characteristics:
in the above technical solution, further, the first terminal further includes: an operation device for receiving an operation input for controlling the second terminal to execute an operation function; and the first control device is respectively connected with the operation device and the first communication device and is used for responding to the operation input to generate a control signal.
In the technical scheme, the first terminal comprises the operating device and the first control device, wherein the operating device is used for receiving and controlling the operation input of the second terminal, the user remotely performs the operation input through the operating device, and then the first communication device sends a control signal to the second terminal, so that the remote interaction with the second terminal is realized, for example, the user finishes the interactive operation on the second terminal by using touch gestures such as touch clicking and touch dragging, the user can conveniently and flexibly perform remote interaction with the second terminal, the operating device receives and controls the operation input of the second terminal, the user can be provided with an immersive operation experience, the operation habit of the user on the terminal equipment is consistent, and the use experience of the user is improved. Further, two ends of the first control device are respectively connected with the operation device and the first communication device, after the operation device receives operation input of a user, the first control device responds to the operation input to generate a control signal, the first communication device sends the control signal to the second terminal to execute corresponding operation functions, and the first control device is connected with the operation device and the first communication device, so that the user can watch a real-time picture of the operation executed by the second terminal and send the control signal to the second terminal, and interaction efficiency of the first terminal and the second terminal is improved.
In any of the above embodiments, further, the operation input is input by a user according to an image.
In the technical scheme, after the user views the image operated by the second terminal through the display device, the next operation of the second terminal is input according to the real-time image, so that the interaction between the operation and the image is completed, the interactive connection between the remote user and the second terminal is realized, and the participation of the user is improved.
Further, when the user views the real-time picture of the second terminal through the display device, if the user wants to switch the angle of the second terminal for image acquisition, the user can input and control the rotation of the image acquisition device through the operation device, so as to further switch the angle of the second terminal for operating the on-site image acquisition, and the user can also set the operation executed by the second terminal execution device to always follow the image acquisition device, track each key detail of the second terminal, and improve the viewing experience of the user.
According to a second aspect of the present invention, there is also provided a second terminal comprising: the second communication device is in communication connection with the first terminal and is used for receiving the control signal sent by the first terminal; the execution device is connected with the second communication device and is used for executing an operation function corresponding to the control signal; the image acquisition device is connected with the second communication device and is used for acquiring images of the operation functions executed by the execution device; the second communication device is also used for sending the information of the image to the first terminal.
In the technical scheme, the second terminal comprises a second communication device, an execution device and an image acquisition device, specifically, the second communication device is in communication connection with the first terminal, the execution device and the image acquisition device are respectively connected with the second communication device, the control signal sent by the first terminal is received through the second communication device, the execution device can execute the operation corresponding to the control signal, the image acquisition device acquires the image of the execution device executing the operation, and the acquired image information is sent to the first terminal through the second communication device, so that a user can watch a real-time picture of the operation of the second terminal. Through the real-time information interaction between the second terminal and the first terminal, the interaction between the operation and the image is realized, so that the user can control the operation of the second terminal while watching the real-time picture of the second terminal, and the participation of the user is enhanced.
Further, the image acquisition device can record the content of the operation process of the second terminal, and the second communication device is used for transmitting the record to the first terminal, so that the user can watch and store the record conveniently, and the practicability of the second terminal is improved.
The second terminal provided by the invention can also have the following additional technical characteristics:
In any of the foregoing solutions, further, the second terminal further includes: and the second control device is respectively connected with the execution device and the second communication device and is used for acquiring user information and verifying the authority of the operation function according to the user information.
In the technical scheme, two ends of the second control are respectively connected with the execution device and the second communication device, after the second communication device receives the control signal sent by the first terminal, the second control device judges whether the user has authority to control the operation of the second terminal according to the identity information of the user, and can effectively control interaction, so that the interaction between the first terminal and the second terminal is more orderly and standard.
According to a third aspect of the present invention, there is also provided a remote operation control method, adapted to a first terminal, the first terminal being communicatively connected to a second terminal, the control method comprising: transmitting a first control signal to the second terminal so as to enable an execution device of the second terminal to execute a first operation function and enable an image acquisition device of the second terminal to acquire an image of the execution device executing the first operation function; receiving information of an image sent by a second terminal; and displaying the image.
In the technical scheme, the first terminal receives operation input of a user, and sends a control signal to the second terminal, so that the execution device of the second terminal executes corresponding operation according to the control signal, and the image acquisition device of the second terminal acquires images of operation functions executed by the execution device. Further, after receiving the image information sent by the second terminal, the first terminal displays the image through the display device. Through first terminal and second terminal communication connection, realized the real-time information interaction of first terminal and second terminal for when the user can watch the real-time picture of second terminal from first terminal, control the second terminal and carry out the operational function, provide the interactive experience of being in person for the user, make the user can experience the enjoyment of participation physically, improved user's use experience.
According to the remote operation control method provided by the invention, the following additional technical characteristics can be provided:
in any of the above embodiments, further, after displaying the image, the method further includes: receiving an input for controlling the second terminal to execute a second operation function according to the image; in response to the input, a second control signal is sent to the second terminal.
In the technical scheme, after a user views a first operation of the second terminal according to the display image, the first terminal receives an input which is sent by the user according to the image content and controls the second terminal to execute a second operation function, and a second control signal is sent to the second terminal in response to the operation input, so that the second terminal can further operate according to the second control signal. The operation of the second terminal is further controlled through the display image, interaction between the image and the operation is achieved, interaction between the first terminal and the second terminal is enabled to be more accordant with the current situation, and interaction effect is improved.
In any of the foregoing solutions, before sending the first control signal to the second terminal, the method further includes: acquiring user information; and carrying out authority verification according to the user information.
In the technical scheme, before a first terminal sends a first control signal to a second terminal, identity information of a user is obtained, and authority verification is performed according to the user identity information. The interaction is effectively controlled, so that the interaction between the first terminal and the second terminal is more orderly and standard.
According to a fourth aspect of the present invention, there is also provided a remote operation control method adapted to a second terminal, the second terminal being in communication connection with a first terminal, the control method comprising: receiving a first control signal sent by a first terminal, executing a first operation function according to the first control signal, and acquiring an image for executing the first operation function; and sending the information of the image to the first terminal.
In the technical scheme, the second terminal receives the first control signal sent by the first terminal, the execution device executes corresponding first operation according to the first control signal, the image acquisition device acquires the image of the first operation executed by the execution device, and the second terminal sends the image information to the first terminal, so that a user can know the real-time condition of the second terminal, further, the user can conveniently participate in the field activity related to the second terminal remotely, the direct interaction between the user and the second terminal is realized, and the participation of the user is improved.
According to the remote operation control method provided by the invention, the following additional technical characteristics can be provided:
in any of the foregoing solutions, further, after sending the information of the image to the first terminal, the method further includes: receiving a second control signal sent by the first terminal according to the image of the operation function; and executing a second operation function according to the second control signal.
In the technical scheme, after the second terminal sends the information of the image to the first terminal, the user inputs a second operation of the second terminal according to the observed image of the first operation of the second terminal, the second terminal receives the first terminal and sends a second control signal according to the operation input, and then the second operation is executed according to the second control signal. The interaction between the operation and the image is realized, so that the interaction between the first terminal and the second terminal accords with the current situation, the interaction effect is improved, and the experience of the user is further improved.
In any of the foregoing solutions, before executing the first operation function according to the first control signal, the method further includes: acquiring user information; and verifying the authority of the first operation function according to the user information.
In the technical scheme, before the second terminal executes the first operation function according to the first control signal, the identity information of the user is acquired, and whether the user has operation authority to control the second terminal to execute the first operation function is judged. The interaction between the first terminal and the second terminal is effectively controlled, so that the interaction between the first terminal and the second terminal is more orderly and standard.
According to a fifth aspect of the present invention, there is provided a readable storage medium having stored thereon a program or instructions which, when executed by a processor, perform the steps of the remote operation control method set forth in the third aspect, or the steps of the remote operation control method set forth in the fourth aspect. Therefore, the computer readable storage medium has all the advantages of the remote operation control method according to the third aspect and the remote operation control method according to the fourth aspect, and will not be repeated.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the invention will become apparent and may be better understood from the following description of embodiments taken in conjunction with the accompanying drawings in which:
FIG. 1 shows a schematic block diagram of a first terminal and a second terminal of one embodiment of the invention;
FIG. 2 is a schematic flow chart of a remote operation control method according to an embodiment of a third aspect of the present invention;
FIG. 3 is a schematic flow chart of a remote operation control method according to still another embodiment of the third aspect of the present invention;
FIG. 4 is a schematic flow chart of a remote operation control method according to still another embodiment of the third aspect of the present invention;
FIG. 5 is a schematic flow chart of a remote operation control method according to an embodiment of the fourth aspect of the present invention;
FIG. 6 is a schematic flow chart of a remote operation control method according to a further embodiment of the fourth aspect of the present invention;
FIG. 7 is a schematic flow chart of a remote operation control method according to a further embodiment of the fourth aspect of the present invention;
fig. 8 shows a schematic block diagram of a remote operation control system according to an embodiment of the present invention.
The correspondence between the reference numerals and the component names in fig. 1 to 8 is:
100 first terminals, 102 first communication devices, 104 display devices, 106 operation devices, 108 first control devices, 110 second terminals, 112 second communication devices, 114 image acquisition devices, 116 execution devices, 118 second control devices, 120 remote control devices, 122 communication units, 124 control units, 130 information processing devices.
Detailed Description
In order that the above-recited objects, features and advantages of the present application will be more clearly understood, a more particular description of the application will be rendered by reference to the appended drawings and appended detailed description. It should be noted that, without conflict, the embodiments of the present application and features in the embodiments may be combined with each other.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application, however, the present application may be practiced in other ways than those described herein, and therefore the scope of the present application is not limited to the specific embodiments disclosed below.
The first terminal 100, the second terminal 110, the remote operation control method, and the readable storage medium according to some embodiments of the present application are described below with reference to fig. 1 to 8.
Example 1:
as shown in fig. 1, according to an embodiment of the present application, there is provided a first terminal 100 including: a first communication device 102 and a display device 104.
In detail, the first communication device 102 is communicatively connected to the second terminal 110, and is configured to send a control signal to the second terminal 110, so that the execution device 116 of the second terminal 110 performs an operation function, and the image acquisition device 114 of the second terminal 110 acquires an image of the execution device 116 performing the operation function, and receives information of the image sent by the second terminal 110; the display device 104 is connected to the first communication device 102 and is used for displaying images.
In this embodiment, the first terminal 100 comprises a first communication device 102 and a display device 104, wherein the first communication device 102 is communicatively connected to the second terminal 110 and the display device 104 is connected to the first communication device 102. The control signal is sent to the second terminal 110 through the first communication device 102, so that the execution device 116 of the second terminal 110 executes the corresponding operation according to the control signal, and at the same time, the image acquisition device 114 of the second terminal 110 acquires the image of the operation function executed by the execution device 116. Further, the first communication device 102 receives the image information sent by the second terminal 110, and then displays the image on the display device 104. Through the communication connection between the first terminal 100 and the second terminal 110, the real-time information interaction between the first terminal 100 and the second terminal 110 is realized, so that the user can control the second terminal 110 to execute the operation function while watching the real-time picture of the second terminal 110 from the first terminal 100, thereby providing the user with the immersive interaction experience, enabling the user to experience the participation fun physically, and improving the participation feeling of the user.
In a specific embodiment, the interaction scenario of the second terminal 110 may be a scenario for executing a live event or entertaining, for example, the interaction scenario of the second terminal 110 may be fishing, and the execution means 116 includes a fishing rod. The user views the real-time fishing picture in the second terminal 110 through the display device 104 of the first terminal 100, and then sends a control signal for retracting the fishing rod to the second terminal 110 through the first communication device 102 according to the viewed real-time fishing picture, so that the execution device 116 of the second terminal 110 performs the action of retracting the fishing rod according to the control signal. Through the communication connection between the first terminal 100 and the second terminal 110, interaction between operation and image is realized, so that the user can participate in entertainment instead of watching the entertainment singly, and the richness and the interestingness of interaction are improved.
Example 2:
as shown in fig. 1, according to an embodiment of the present invention, based on the above embodiment, further: the first terminal 100 further includes: an operation device 106 for receiving an operation input for controlling the second terminal 110 to perform an operation function; the first control device 108 is connected to the operation device 106 and the first communication device 102, respectively, for generating control signals in response to the operation input.
In this embodiment, the first terminal 100 includes an operation device 106 and a first control device 108, where the operation device 106 is configured to receive an operation input for controlling the second terminal 110, and a user performs the operation input remotely through the operation device 106, and further sends a control signal to the second terminal 110 through the first communication device 102, so as to implement remote interaction with the second terminal 110, for example, the user performs an interactive operation on the second terminal 110 by using touch gestures such as touch clicking and touch dragging, so that the user can conveniently and flexibly perform remote interaction with the second terminal 110, and receives the operation input for controlling the second terminal 110 through the operation device 106, thereby bringing an immersive operation experience for the user, and being consistent with an operation habit of the user on a terminal device, and improving a use experience of the user. Further, the two ends of the first control device 108 are respectively connected to the operation device 106 and the first communication device 102, after the operation device 106 receives an operation input from a user, the first control device 108 responds to the operation input to generate a control signal, the first communication device 102 sends the control signal to the second terminal 110 to execute a corresponding operation function, and the first control device 108 is connected to the operation device 106 and the first communication device 102, so that the user can watch a real-time image of the operation executed by the second terminal 110 and send the control signal to the second terminal 110, and the interaction efficiency of the first terminal 100 and the second terminal 110 is improved.
The user may directly touch the execution device 116 of the second terminal 110 in the real-time image in the display device 104 to implement operation input to the execution device 116 of the second terminal 110, thereby providing an immersive operation experience for the user and improving efficiency of interactive operation of the second terminal 110.
Further, the first control device 108 can process the image information sent by the second terminal 110, so that the real-time image displayed by the display device 104 is clearer, and the viewing experience of the user is improved.
Further, the first control device 108 is capable of performing authority verification on the identity of the user. For example, when the second terminal 110 performs live broadcast, the first control device 108 acquires user identity information, and determines whether the user has permission to enter the live broadcast room for viewing. In addition, the live broadcast rooms that the user can watch can be displayed on the display device 104 for the user to select according to the user identity information, and the user can select the live broadcast rooms that the user is interested in to enter for watching. For example, the live broadcasting room opened to the common user is a fixed live broadcasting room, the member user clicks the interested live broadcasting room to watch through the operation device 106 according to the member grade, and the user establishes interactive connection with the activity scene of the second terminal 110.
Example 3:
according to an embodiment of the present invention, on the basis of the above embodiment, further: the operation input is input by the user according to the image.
In this embodiment, after the user views the image operated by the second terminal 110 through the display device 104, the next operation of the second terminal 110 is input according to the real-time image, so as to complete interaction between the operation and the image, realize interactive connection between the remote user and the second terminal 110, and promote the participation of the user.
Further, when the user views the real-time image of the second terminal 110 through the display device 104, if the user wants to switch the angle of image acquisition of the second terminal 110, the user can input and control the rotation of the image acquisition device 114 through the operation device 106, so as to further switch the angle of image acquisition of the second terminal 110 on the scene, and can set the image acquisition device 114 to always follow the operation performed by the second terminal 110 execution device 116, track each key detail of the second terminal 110 on the scene, and improve the viewing experience of the user.
In a specific embodiment, if the second terminal 110 performs a fishing activity, the user views a live real-time picture of the second terminal 110 through the display device 104, and if the user observes that the fishing rod is rocked, the user considers that the fishing rod is hooked, and the operation input of the rod retracting action can be performed on the operation device 106, the first control device 108 converts the operation input of the rod retracting action into a control signal and transmits the control signal to the second terminal 110 through the first communication device 102, so that the execution device 116 on the second terminal 110 performs the rod retracting operation, and the user can remotely participate in the live activity of the second terminal 110, thereby improving the interaction effect and further improving the viscosity of the user.
Example 4:
as shown in fig. 1, according to a second aspect of the present invention, there is provided a second terminal 110, including: a second communication device 112, communicatively connected to the first terminal 100, for receiving the control signal sent by the first terminal 100; an executing device 116 connected to the second communication device 112 for executing an operation function corresponding to the control signal; an image acquisition device 114, connected to the second communication device 112, for acquiring an image of the operation function performed by the execution device 116; the second communication device 112 is further configured to send information of the image to the first terminal 100.
In this embodiment, the second terminal 110 includes a second communication device 112, an execution device 116, and an image acquisition device 114, specifically, the second communication device 112 is in communication connection with the first terminal 100, the execution device 116 and the image acquisition device 114 are respectively connected with the second communication device 112, a control signal sent by the first terminal 100 is received through the second communication device 112, so that the execution device 116 can execute an operation corresponding to the control signal, and the image acquisition device 114 acquires an image of the operation performed by the execution device 116, and sends the acquired image information to the first terminal 100 through the second communication device 112, so that a user can view a real-time screen of the operation of the second terminal 110. Through the real-time information interaction between the second terminal 110 and the first terminal 100, the interaction between the operation and the image is realized, so that the user can control the operation of the second terminal 110 while watching the real-time picture of the second terminal 110, and the participation of the user is enhanced.
Further, the image capturing device 114 can record the content of the operation process of the second terminal 110, and send the record to the first terminal 100 through the second communication device 112, so as to facilitate the user to watch and store, thereby improving the practicability of the second terminal 110.
Example 5:
as shown in fig. 1, according to an embodiment of the present invention, based on the above embodiment, further: the second terminal 110 further includes: and a second control device 118, which is connected to the execution device 116 and the second communication device 112, respectively, and is used for acquiring user information and performing authority verification on the operation function according to the user information.
In this embodiment, two ends of the second control are respectively connected to the execution device 116 and the second communication device 112, and after the second communication device 112 receives the control signal sent by the first terminal 100, the second control device 118 determines whether the user has permission to control the operation of the second terminal 110 according to the identity information of the user, so that effective control over interaction can be achieved, and the interaction between the first terminal 100 and the second terminal 110 is more orderly and standard.
In a specific embodiment, user information is obtained, and different interactive connection modes are established for the general user and the member user, for example, the first terminal 100 of the member user may be connected to the image capturing device 114 and the executing device 116 of the second terminal 110 at the same time, whereas the first terminal 100 of the general user may only be connected to the image capturing device 114 of the second terminal 110, or the first terminal 100 may be allowed to be connected to the image capturing device 114 and the executing device 116 at the same time, but only a part of the operations performed by the user on the executing device 116 may be allowed.
Example 6:
as shown in fig. 2, according to a third aspect of the present invention, there is provided a remote operation control method applicable to a first terminal, the first terminal being communicatively connected to a second terminal, the method comprising:
step 202, a first control signal is sent to a second terminal, so that an execution device of the second terminal executes a first operation function, and an image acquisition device of the second terminal acquires an image of the execution device executing the first operation function;
step 204, receiving information of an image sent by a second terminal;
step 206, displaying the image.
In this embodiment, the first terminal receives an operation input of a user, and sends a control signal to the second terminal, so that the execution device of the second terminal executes a corresponding operation according to the control signal, and at the same time, the image acquisition device of the second terminal acquires an image of an operation function executed by the execution device. Further, after receiving the image information sent by the second terminal, the first terminal displays the image through the display device. Through first terminal and second terminal communication connection, realized the real-time information interaction of first terminal and second terminal for when the user can watch the real-time picture of second terminal from first terminal, control the second terminal and carry out the operational function, provide the interactive experience of being in person for the user, make the user can experience the enjoyment of participation physically, improved user's use experience.
Example 7:
as shown in fig. 3, according to an embodiment of the present invention, there is provided a remote operation control method including:
step 302, a first control signal is sent to a second terminal, so that an execution device of the second terminal executes a first operation function, and an image acquisition device of the second terminal acquires an image of the execution device executing the first operation function;
step 304, receiving information of an image sent by a second terminal;
step 306, displaying an image;
step 308, receiving an input for controlling the second terminal to execute a second operation function according to the image;
in response to the input, a second control signal is sent to the second terminal, step 310.
In this embodiment, after the user views the first operation of the second terminal according to the display image, the first terminal receives an input from the user that controls the second terminal to perform the second operation function according to the image content, and in response to the operation input, transmits a second control signal to the second terminal so that the second terminal can perform further operations according to the second control signal. The operation of the second terminal is further controlled through the display image, interaction between the image and the operation is achieved, interaction between the first terminal and the second terminal is enabled to be more accordant with the current situation, and interaction effect is improved.
In a specific embodiment, if the active scene of the second terminal is fishing, the executing device of the second terminal includes a fishing rod, after the user sends an operation input of throwing out the fishing rod, the second terminal controls the fishing rod to complete throwing out according to a control signal of throwing out the fishing rod, the user views a real-time picture through the display device, and if the fishing rod is observed to have a sign of hooking the fish, the executing device can send an operation input of retracting the fishing rod, so that the fishing rod of the second terminal executes retracting action according to the control signal. Further, the user can also send an operation input for switching the image acquisition device of the second terminal to acquire panoramic images or special images such as water surfaces according to the display images, so that the image acquisition device of the second terminal switches the acquisition pictures according to the control signals, the user can observe the water surface fluctuation condition in a short distance, and the use experience of the user is improved.
Example 8:
as shown in fig. 4, according to an embodiment of the present invention, there is provided a remote operation control method including:
step 402, obtaining user information;
step 404, performing authority verification according to the user information;
step 406, sending a first control signal to the second terminal, so that the execution device of the second terminal executes the first operation function, and the image acquisition device of the second terminal acquires the image of the execution device executing the first operation function;
Step 408, receiving information of an image sent by the second terminal;
step 410, an image is displayed.
In this embodiment, before the first terminal sends the first control signal to the second terminal, the identity information of the user is obtained, and authority verification is performed according to the user identity information. The interaction is effectively controlled, so that the interaction between the first terminal and the second terminal is more orderly and standard.
In a specific embodiment, when the second terminal performs live broadcast, user identity information is obtained, and authority authentication is performed on the user. For example, only viewing is allowed. In addition, according to the identity information of the user, the live broadcasting room which can be watched by the user is displayed on the display device for the user to select, and the user can select the live broadcasting room which is interested in the user to enter for watching. For example, an active live broadcast room opened for a common user is a fixed live broadcast room, and member users click the interested live broadcast room to enter and watch through an operation device according to the member grades in more open live broadcast rooms, so that interactive connection with a second terminal active scene is established.
Example 9:
as shown in fig. 5, according to a fourth aspect of the present invention, there is provided a remote operation control method applied to a second terminal, the second terminal being communicatively connected to a first terminal, the method comprising:
Step 502, receiving a first control signal sent by a first terminal, executing a first operation function according to the first control signal, and collecting an image for executing the first operation function;
and step 504, sending information of the image to the first terminal.
In this embodiment, the second terminal receives the first control signal sent by the first terminal, the execution device executes a corresponding first operation according to the first control signal, the image acquisition device acquires the image of the first operation executed by the execution device, and the second terminal sends the image information to the first terminal, so that the user can know the real-time condition of the second terminal, further, the user can conveniently participate in the field activity related to the second terminal remotely, the direct interaction between the user and the second terminal is realized, and the participation of the user is improved.
Further, after the second terminal receives the first control signal sent by the first terminal, the second control device obtains user information and authenticates whether the user has operation authority, if so, the control executing device executes corresponding first operation according to the first control signal, and if not, the first control signal is refused.
In a specific embodiment, when the active scene of the second terminal is fishing, the executing device comprises a fishing rod, the second terminal receives a throwing-out fishing rod signal sent by the first terminal, if the user has operation authority, the fishing rod executes corresponding throwing-out action according to the first control signal, the image collecting device collects real-time pictures in the active scene and sends information of the images to the first terminal, and the user can observe specific conditions in the active scene in real time.
Example 10:
as shown in fig. 6, according to an embodiment of the present invention, there is provided a remote operation control method including:
step 602, receiving a first control signal sent by a first terminal, executing a first operation function according to the first control signal, and collecting an image for executing the first operation function;
step 604, sending information of an image to a first terminal;
step 606, receiving a second control signal sent by the first terminal according to the image of the operation function;
step 608, executing a second operation function according to the second control signal.
In this embodiment, after the second terminal transmits the information of the image to the first terminal, the user inputs a second operation of the second terminal according to the observed image of the first operation performed by the second terminal, and the second terminal receives the first terminal and transmits a second control signal according to the operation input, and further performs the second operation according to the second control signal. The interaction between the operation and the image is realized, so that the interaction between the first terminal and the second terminal accords with the current situation, the interaction effect is improved, and the experience of the user is further improved.
Example 11:
as shown in fig. 7, according to an embodiment of the present invention, there is provided a remote operation control method including:
Step 702, obtaining user information;
step 704, performing authority verification on the first operation function according to the user information;
step 706, receiving a first control signal sent by a first terminal, executing a first operation function according to the first control signal, and collecting an image for executing the first operation function;
step 708, information of the image is sent to the first terminal.
In this embodiment, after the second terminal transmits the information of the image to the first terminal, the user inputs a second operation of the second terminal according to the observed image of the first operation performed by the second terminal, and the second terminal receives the first terminal and transmits a second control signal according to the operation input, and further performs the second operation according to the second control signal. The interaction between the operation and the image is realized, so that the interaction between the first terminal and the second terminal accords with the current situation, the interaction effect is improved, and the experience of the user is further improved.
Example 12:
as shown in fig. 8, according to an embodiment of the present invention, a remote operation control system is proposed.
In this embodiment, the present invention proposes a remote operation control system including: a first terminal 100, a remote control device 120, an information processing device 130, and a second terminal 110. Wherein the first terminal 100 comprises a display device and an operating device, the remote control device 120 comprises a communication unit 122 and a control unit 124, and the second terminal 110 comprises an image acquisition device and an execution device.
Specifically, the remote operation control system realizes real-time information interaction between the first terminal 100 and the second terminal 110 through the remote control device 120 and the information processing device 130, so that a user can observe a real-time picture of the second terminal 110 from the first terminal 100, and control one or more execution devices in the second terminal 110 to move in real time through the operation device, thereby improving user experience.
Example 13:
according to a specific embodiment of the present invention, a remote operation control method is provided.
In this embodiment, the image capturing device of the second terminal obtains a real-time image, and the image information is transmitted to the information processing device for processing, and then transmitted to the remote control device, and then transmitted to the display device of the first terminal. The user receives the image information through the display device, operates the operation device according to the image information, performs real-time information interaction through the communication unit and the control unit of the remote control device through the operation input, processes the information through the information processing device, and transmits the processed information to the second terminal to control the image acquisition device and the execution device to move.
Example 14:
according to a fifth aspect of the present invention, there is provided a readable storage medium having stored thereon a program or instructions which, when executed by a processor, perform the steps of the remote operation control method set forth in the third aspect, or the steps of the remote operation control method set forth in the fourth aspect. Therefore, the computer readable storage medium has all the advantages of the remote operation control method according to the third aspect and the remote operation control method according to the fourth aspect, and will not be repeated.
In the present invention, the term "plurality" means two or more, unless explicitly defined otherwise. The terms "mounted," "connected," "secured," and the like are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; "coupled" may be directly coupled or indirectly coupled through intermediaries. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art according to the specific circumstances.
In the description of the present specification, the terms "one embodiment," "some embodiments," "particular embodiments," and the like, mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (8)

1. A first terminal, comprising:
the first communication device is in communication connection with the second terminal and is used for sending a control signal to the second terminal so as to enable the execution device of the second terminal to execute an operation function, the image acquisition device of the second terminal acquires an image of the execution device executing the operation function, and information of the image sent by the second terminal is received;
a display device connected to the first communication device for displaying the image;
an operation device for receiving an operation input for controlling the second terminal to execute the operation function;
first control means, connected to said operating means and said first communication means, respectively, for generating said control signal in response to said operation input;
the first control device can conduct authority verification on the identity of the user; different interactive connection modes are established for common users and member users; specifically, the first terminal of the member user is connected with the image acquisition device and the execution device of the second terminal at the same time, while the first terminal of the common user can only establish connection with the image acquisition device of the second terminal or allow the first terminal to establish connection with the image acquisition device and the execution device at the same time, but only allow the user to perform partial operation on the execution device;
A user can realize operation input of the execution device of the second terminal by directly touching the execution device of the second terminal in the real-time image in the display device;
the interactive scene of the second terminal is fishing, and the executing device comprises a fishing rod;
and the user sends a control signal for retracting the fishing rod to the second terminal through the first communication device, so that the executing device of the second terminal performs the action of retracting the fishing rod according to the control signal.
2. The first terminal of claim 1, wherein the first terminal,
the operation input is input by a user according to the image.
3. A second terminal, comprising:
the second communication device is in communication connection with the first terminal and is used for receiving the control signal sent by the first terminal;
an execution device connected with the second communication device and used for executing an operation function corresponding to the control signal;
the image acquisition device is connected with the second communication device and is used for acquiring images of the operation function executed by the execution device;
the second communication device is further configured to send information of the image to the first terminal;
The second control device is respectively connected with the execution device and the second communication device and is used for acquiring user information and carrying out authority verification on the operation function according to the user information;
different interactive connection modes are established for common users and member users; specifically, the first terminal of the member user is connected with the image acquisition device and the execution device of the second terminal at the same time, while the first terminal of the common user can only establish connection with the image acquisition device of the second terminal or allow the first terminal to establish connection with the image acquisition device and the execution device at the same time, but only allow the user to perform partial operation on the execution device;
the image acquisition device can record the content of the operation process of the second terminal, and sends the record to the first terminal through the second communication device, so that the user can watch and store the record conveniently;
the second terminal receives the throwing-out fishing rod signal sent by the first terminal, the fishing rod executes corresponding throwing-out action according to the control signal, and the image acquisition device acquires real-time pictures in the active scene and sends the information of the images to the first terminal.
4. A remote operation control method, which is suitable for a first terminal, the first terminal being communicatively connected to a second terminal, the control method comprising:
transmitting a first control signal to the second terminal so as to enable an execution device of the second terminal to execute a first operation function and enable an image acquisition device of the second terminal to acquire an image of the execution device executing the first operation function;
receiving information of the image sent by the second terminal;
displaying the image;
before the first control signal is sent to the second terminal, the method further comprises:
acquiring user information;
performing authority verification according to the user information;
different interactive connection modes are established for common users and member users; specifically, the first terminal of the member user is connected with the image acquisition device and the execution device of the second terminal at the same time, while the first terminal of the common user can only establish connection with the image acquisition device of the second terminal or allow the first terminal to establish connection with the image acquisition device and the execution device at the same time, but only allow the user to perform partial operation on the execution device;
A user can realize operation input of the execution device of the second terminal by directly touching the execution device of the second terminal in the real-time image in the display device;
the interactive scene of the second terminal is fishing, and the executing device comprises a fishing rod;
and the user sends a control signal for retracting the fishing rod to the second terminal through the first communication device, so that the executing device of the second terminal performs the action of retracting the fishing rod according to the control signal.
5. The remote operation control method according to claim 4, characterized by further comprising, after the displaying of the image:
receiving an input controlling the second terminal to execute a second operation function according to the image;
and transmitting a second control signal to the second terminal in response to the input.
6. A remote operation control method, characterized by being applied to a second terminal, the second terminal being communicatively connected to a first terminal, the control method comprising:
receiving a first control signal sent by the first terminal, executing a first operation function according to the first control signal, and acquiring an image for executing the first operation function;
Transmitting information of the image to the first terminal;
before the first operation function is executed according to the first control signal, the method further comprises:
acquiring user information;
performing authority verification on the first operation function according to the user information;
different interactive connection modes are established for common users and member users; specifically, the first terminal of the member user is connected with the image acquisition device and the execution device of the second terminal at the same time, while the first terminal of the common user can only establish connection with the image acquisition device of the second terminal or allow the first terminal to establish connection with the image acquisition device and the execution device at the same time, but only allow the user to perform partial operation on the execution device;
the image acquisition device can record the content of the operation process of the second terminal, and sends the record to the first terminal through the second communication device, so that the user can watch and store the record conveniently;
the second terminal receives the throwing-out fishing rod signal sent by the first terminal, the fishing rod executes corresponding throwing-out action according to the control signal, and the image acquisition device acquires real-time pictures in the active scene and sends the information of the images to the first terminal.
7. The remote operation control method according to claim 6, characterized by further comprising, after the transmitting of the information of the image to the first terminal:
receiving a second control signal sent by the first terminal according to the image of the operation function;
and executing a second operation function according to the second control signal.
8. A readable storage medium having stored thereon a program or instructions, which when executed by a processor, implements the remote operation control method according to claim 4 or 5, or the remote operation control method according to claim 6 or 7.
CN202110380786.4A 2021-04-09 2021-04-09 First terminal, second terminal, remote operation control method, and readable storage medium Active CN113141517B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110380786.4A CN113141517B (en) 2021-04-09 2021-04-09 First terminal, second terminal, remote operation control method, and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110380786.4A CN113141517B (en) 2021-04-09 2021-04-09 First terminal, second terminal, remote operation control method, and readable storage medium

Publications (2)

Publication Number Publication Date
CN113141517A CN113141517A (en) 2021-07-20
CN113141517B true CN113141517B (en) 2023-08-11

Family

ID=76810746

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110380786.4A Active CN113141517B (en) 2021-04-09 2021-04-09 First terminal, second terminal, remote operation control method, and readable storage medium

Country Status (1)

Country Link
CN (1) CN113141517B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113791692A (en) * 2021-09-28 2021-12-14 歌尔光学科技有限公司 Interaction method, terminal device and readable storage medium

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070033511A (en) * 2005-09-21 2007-03-27 에스케이 텔레콤주식회사 Remote fishing system and method using a mobile communication terminal
KR20080035788A (en) * 2006-10-20 2008-04-24 엘지전자 주식회사 Method of video telephony in mobile terminal
CN102419583A (en) * 2011-11-17 2012-04-18 西北农林科技大学 System for acquiring crop digital image remotely in real time
KR20120081698A (en) * 2011-01-12 2012-07-20 (주)살구넷 Remote fishing system
CN202720496U (en) * 2012-05-23 2013-02-06 陈光红 Remote control system of online fishing
CN103444670A (en) * 2013-08-26 2013-12-18 杨文宇 Fishing system assembly and method based on network video remote control
CN103858837A (en) * 2014-03-13 2014-06-18 重庆远钓科技有限公司 Unattended fishing system and method
CN105357262A (en) * 2015-09-29 2016-02-24 小米科技有限责任公司 Device control method and device control apparatus
CN106488334A (en) * 2015-09-01 2017-03-08 天脉聚源(北京)科技有限公司 A kind of net cast interactive approach and system
CN206313870U (en) * 2016-11-02 2017-07-07 徐文波 Live terminal servicing unit, control device and remote living broadcast control system
CN206413622U (en) * 2016-10-14 2017-08-18 谭军 A kind of automatic hooking fish equipment that can be controlled based on internet
CN207117819U (en) * 2017-05-18 2018-03-16 吴彦桥 A kind of long-range view equipment
CN108935365A (en) * 2018-06-25 2018-12-07 王斌 A kind of long-range fishing control system
CN109889855A (en) * 2019-01-31 2019-06-14 南京理工大学 Intelligent panoramic net cast networked shopping system and method based on mobile APP
CN209995176U (en) * 2019-04-14 2020-01-31 黄海锋 multifunctional fishing lamp support
CN112106007A (en) * 2019-08-29 2020-12-18 深圳市大疆创新科技有限公司 Unmanned aerial vehicle management method, equipment, unmanned aerial vehicle, system and storage medium

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070033511A (en) * 2005-09-21 2007-03-27 에스케이 텔레콤주식회사 Remote fishing system and method using a mobile communication terminal
KR20080035788A (en) * 2006-10-20 2008-04-24 엘지전자 주식회사 Method of video telephony in mobile terminal
KR20120081698A (en) * 2011-01-12 2012-07-20 (주)살구넷 Remote fishing system
CN102419583A (en) * 2011-11-17 2012-04-18 西北农林科技大学 System for acquiring crop digital image remotely in real time
CN202720496U (en) * 2012-05-23 2013-02-06 陈光红 Remote control system of online fishing
CN103444670A (en) * 2013-08-26 2013-12-18 杨文宇 Fishing system assembly and method based on network video remote control
CN103858837A (en) * 2014-03-13 2014-06-18 重庆远钓科技有限公司 Unattended fishing system and method
CN106488334A (en) * 2015-09-01 2017-03-08 天脉聚源(北京)科技有限公司 A kind of net cast interactive approach and system
CN105357262A (en) * 2015-09-29 2016-02-24 小米科技有限责任公司 Device control method and device control apparatus
CN206413622U (en) * 2016-10-14 2017-08-18 谭军 A kind of automatic hooking fish equipment that can be controlled based on internet
CN206313870U (en) * 2016-11-02 2017-07-07 徐文波 Live terminal servicing unit, control device and remote living broadcast control system
CN207117819U (en) * 2017-05-18 2018-03-16 吴彦桥 A kind of long-range view equipment
CN108935365A (en) * 2018-06-25 2018-12-07 王斌 A kind of long-range fishing control system
CN109889855A (en) * 2019-01-31 2019-06-14 南京理工大学 Intelligent panoramic net cast networked shopping system and method based on mobile APP
CN209995176U (en) * 2019-04-14 2020-01-31 黄海锋 multifunctional fishing lamp support
CN112106007A (en) * 2019-08-29 2020-12-18 深圳市大疆创新科技有限公司 Unmanned aerial vehicle management method, equipment, unmanned aerial vehicle, system and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
移动视频监控技术现状与架构;向稳新;;中国公共安全(综合版)(第09期);全文 *

Also Published As

Publication number Publication date
CN113141517A (en) 2021-07-20

Similar Documents

Publication Publication Date Title
CN108632633B (en) Live webcast data processing method and device
CN108574879B (en) Combined live broadcast method and device and electronic equipment
CN108632632B (en) Live webcast data processing method and device
CN110881144B (en) Data processing method based on live broadcast platform and related equipment
CN106254311B (en) Live broadcast method and device and live broadcast data stream display method and device
US9049341B2 (en) Method and apparatus for video resource management in video conference
CN109107167B (en) Interactive control method in game, electronic device and storage medium
CN108635863B (en) Live webcast data processing method and device
CN111773667A (en) Live game interaction method and device, computer readable medium and electronic equipment
CN106161219A (en) Message treatment method and device
KR20040102145A (en) Chat for television network
SG193150A1 (en) Method and system to process video effects
CN102571979A (en) Multi-screen interactive equipment and binding method thereof
US20170171509A1 (en) Method and electronic apparatus for realizing two-person simultaneous live video
CN109195003B (en) Interaction method, system, terminal and device for playing game based on live broadcast
CN106791975A (en) A kind of method of net cast, terminal device and video living transmission system
CN113141517B (en) First terminal, second terminal, remote operation control method, and readable storage medium
CN106412617B (en) Remote debugging control method and device
KR102243835B1 (en) Method and Apparatus for Providing Viewer-Participational Cloud Game Broadcasting Service
CN112789864A (en) Live broadcast method, device, equipment and computer readable storage medium
CN116980706A (en) Video playing method and device, storage medium and electronic equipment
CN111010333A (en) Instant communication device and method with touch control element
KR101915065B1 (en) Live streaming system for virtual reality contents and operating method thereof
CN103533443A (en) Method for online live telecast of surveillance videos
CN107835446B (en) Media state presentation and control method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant