CN115052106B - Remote control method, equipment and medium of intelligent terminal - Google Patents
Remote control method, equipment and medium of intelligent terminal Download PDFInfo
- Publication number
- CN115052106B CN115052106B CN202210582985.8A CN202210582985A CN115052106B CN 115052106 B CN115052106 B CN 115052106B CN 202210582985 A CN202210582985 A CN 202210582985A CN 115052106 B CN115052106 B CN 115052106B
- Authority
- CN
- China
- Prior art keywords
- intelligent terminal
- remote
- instruction
- movement
- fecc
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 86
- 230000033001 locomotion Effects 0.000 claims abstract description 167
- 238000013507 mapping Methods 0.000 claims abstract description 53
- 238000004891 communication Methods 0.000 claims abstract description 51
- 230000008569 process Effects 0.000 claims abstract description 31
- 238000004590 computer program Methods 0.000 claims description 19
- 238000013519 translation Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
- H04W88/02—Terminal devices
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
- Studio Devices (AREA)
- Selective Calling Equipment (AREA)
Abstract
The invention discloses a remote control method, equipment and medium of an intelligent terminal, wherein the intelligent terminal comprises a camera, a remote communication module and a motion module, and the method comprises the following steps: in the manual remote control moving process of the remote intelligent terminal, the local intelligent terminal obtains a FECC instruction for controlling a second camera of the remote intelligent terminal, and the FECC instruction is sent to the remote intelligent terminal through the first remote communication module; the remote intelligent terminal receives the FECC instruction through the second remote communication module, maps the FECC instruction into a movement instruction for controlling the second movement module, and enables the second movement module to move according to the movement instruction and simultaneously drives the remote intelligent terminal to move. The camera is conveniently and rapidly changed in position by mapping the movement control of the camera to the movement control of the movement module.
Description
Technical Field
The present invention relates to the field of robot control technologies, and in particular, to a remote control method, device, and medium for an intelligent terminal.
Background
At present, the local camera can be directly controlled by sending an instruction, and the remote camera is controlled to perform three-axis rotation with unchanged position through a FECC (FAR END CAMERA Control, remote camera Control) protocol. However, when the camera position needs to be moved and pictures of different positions are acquired, such as in a scene of regional patrol and interactive video conference, the mode of holding the mobile camera is very inconvenient. Therefore, how to conveniently and rapidly expand the region for image acquisition becomes a problem to be solved.
Disclosure of Invention
The invention mainly aims to provide a remote control method of an intelligent terminal, which aims to solve the technical problem of how to conveniently and rapidly expand the region for picture acquisition in the prior art.
In order to achieve the above object, the present invention provides a remote control method of an intelligent terminal, where the intelligent terminal includes a camera, a remote communication module and a motion module, and the remote control method of the intelligent terminal includes:
In the manual remote control moving process of the remote intelligent terminal, the local intelligent terminal acquires a FECC instruction for controlling a second camera of the remote intelligent terminal, and the FECC instruction is sent to the remote intelligent terminal through a first remote communication module;
The remote intelligent terminal receives the FECC instruction through the second remote communication module, maps the FECC instruction into a movement instruction for controlling the second movement module, and enables the second movement module to move according to the movement instruction and drive the remote intelligent terminal to move.
Optionally, the smart terminal further includes a display, and before the step of the local smart terminal obtaining the FECC instruction for controlling the second camera of the remote smart terminal, the method further includes:
the remote intelligent terminal sends the real-time picture acquired by the second camera to the local intelligent terminal through the second remote communication module;
the local intelligent terminal receives the real-time picture through the first remote communication module and displays the real-time picture through the display.
Optionally, before the step of mapping the FECC instruction to a movement instruction for controlling the second motion module, the method further comprises:
the remote intelligent terminal establishes a mapping rule for mapping the FECC instruction into the mobile instruction;
The step of mapping the FECC instruction into a movement instruction for controlling the second motion module includes:
and calling the mapping rule to map the FECC instruction into the moving instruction.
Optionally, the step of the remote intelligent terminal establishing a mapping rule for mapping the FECC instruction to the mobile instruction includes:
the remote intelligent terminal acquires a first movement direction set of the second camera and a second movement direction set of the second movement module, and establishes the mapping rule according to the same matching item of the first movement direction set and the second movement direction set.
Optionally, the step of establishing the mapping rule according to the same matching item of the first moving direction set and the second moving direction set includes:
and if the same matching item is moved left and right and moved back and forth, the left and right translation field in the motion request parameter of the FECC instruction corresponds to the left and right movement field of the second motion module, and the zoom-in and zoom-out picture field corresponds to the forward and backward field of the second motion module.
Optionally, the remote control method of the intelligent terminal further includes:
In a semi-automatic moving process of a remote intelligent terminal, a local intelligent terminal selects a target place in a real-time picture of the remote intelligent terminal, and the target place is sent to the remote intelligent terminal through a first remote communication module;
The remote intelligent terminal receives the target place through the second remote communication module, performs path planning according to the current position of the remote intelligent terminal and the target place to obtain a partial optimal path, and controls the second movement module to automatically travel to the target place according to the partial optimal path.
Optionally, the remote control method of the intelligent terminal further includes:
and scanning a moving area of the remote intelligent terminal through the second camera to generate a whole-course map in the manual remote control moving process of the remote intelligent terminal and in the semi-automatic moving process of the remote intelligent terminal.
Optionally, after the step of generating the global map, the method further includes:
transmitting the whole map to the local intelligent terminal through the second remote communication module;
and in the full-automatic moving process of the remote intelligent terminal, receiving a starting point and an ending point which are set on the whole-course map by the local intelligent terminal through a second remote communication module, obtaining a whole-course optimal path after finishing path planning according to the starting point and the ending point, and controlling a second movement module to automatically move to the ending point according to the whole-course optimal path.
In addition, to achieve the above object, the present invention also provides a remote control device for an intelligent terminal, the device including: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the method for remote control of a smart terminal as described above.
In addition, to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the remote control method of an intelligent terminal as described above.
The embodiment of the invention provides a remote control method, equipment and medium of an intelligent terminal, wherein the intelligent terminal comprises a camera, a remote communication module and a motion module, and the remote control method of the intelligent terminal comprises the following steps: in the manual remote control moving process of the remote intelligent terminal, the local intelligent terminal acquires a FECC instruction for controlling a second camera of the remote intelligent terminal, and the FECC instruction is sent to the remote intelligent terminal through a first remote communication module; the remote intelligent terminal receives the FECC instruction through the second remote communication module, maps the FECC instruction into a movement instruction for controlling the second movement module, and enables the second movement module to move according to the movement instruction and drive the remote intelligent terminal to move.
The camera FECC protocol is combined with the bottom control protocol of the motion module, and the movement control of the camera is mapped onto the movement control of the motion module according to the rotation of the control camera and the movement direction of the motion module, so that the position of the camera can be conveniently and rapidly changed without complex control logic and time sequence relation.
Drawings
FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart of an embodiment of a remote control method of an intelligent terminal according to the present invention;
fig. 3 is a schematic structural diagram of an embodiment of a remote control method of an intelligent terminal according to the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic diagram of a terminal structure of a hardware operating environment according to an embodiment of the present invention.
As shown in fig. 1, the terminal device may include: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., a wireless FIdelity (WI-FI) interface). The Memory 1005 may be a high-speed random access Memory (Random Access Memory, RAM) Memory or a stable Non-Volatile Memory (NVM), such as a disk Memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the structure shown in fig. 1 does not constitute a limitation of the terminal device, and may include more or less components than illustrated, or may combine certain components, or may be arranged in different components.
As shown in fig. 1, an operating system, a data storage module, a network telecommunication module, a user interface module, and a computer program may be included in the memory 1005 as one type of storage medium.
In the terminal device shown in fig. 1, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with a user; the processor 1001, the memory 1005 in the terminal device of the present invention may be provided in the terminal device, which invokes the computer program stored in the memory 1005 through the processor 1001, and performs the following operations:
In the manual remote control moving process of the remote intelligent terminal, the local intelligent terminal acquires a FECC instruction for controlling a second camera of the remote intelligent terminal, and the FECC instruction is sent to the remote intelligent terminal through a first remote communication module;
The remote intelligent terminal receives the FECC instruction through the second remote communication module, maps the FECC instruction into a movement instruction for controlling the second movement module, and enables the second movement module to move according to the movement instruction and drive the remote intelligent terminal to move.
Further, the processor 1001 may call a computer program stored in the memory 1005, and further perform the following operations:
The intelligent terminal further comprises a display, and before the step of the local intelligent terminal obtaining the FECC instruction for controlling the second camera of the remote intelligent terminal, the intelligent terminal further comprises:
the remote intelligent terminal sends the real-time picture acquired by the second camera to the local intelligent terminal through the second remote communication module;
the local intelligent terminal receives the real-time picture through the first remote communication module and displays the real-time picture through the display.
Further, the processor 1001 may call a computer program stored in the memory 1005, and further perform the following operations:
before the step of mapping the FECC instruction into a movement instruction for controlling the second motion module, the method further comprises:
the remote intelligent terminal establishes a mapping rule for mapping the FECC instruction into the mobile instruction;
The step of mapping the FECC instruction into a movement instruction for controlling the second motion module includes:
and calling the mapping rule to map the FECC instruction into the moving instruction.
Further, the processor 1001 may call a computer program stored in the memory 1005, and further perform the following operations:
the step of the remote intelligent terminal establishing a mapping rule for mapping the FECC instruction into the mobile instruction comprises the following steps:
the remote intelligent terminal acquires a first movement direction set of the second camera and a second movement direction set of the second movement module, and establishes the mapping rule according to the same matching item of the first movement direction set and the second movement direction set.
Further, the processor 1001 may call a computer program stored in the memory 1005, and further perform the following operations:
the step of establishing the mapping rule according to the same matching item of the first moving direction set and the second moving direction set comprises the following steps:
and if the same matching item is moved left and right and moved back and forth, the left and right translation field in the motion request parameter of the FECC instruction corresponds to the left and right movement field of the second motion module, and the zoom-in and zoom-out picture field corresponds to the forward and backward field of the second motion module.
Further, the processor 1001 may call a computer program stored in the memory 1005, and further perform the following operations:
The remote control method of the intelligent terminal further comprises the following steps:
In a semi-automatic moving process of a remote intelligent terminal, a local intelligent terminal selects a target place in a real-time picture of the remote intelligent terminal, and the target place is sent to the remote intelligent terminal through a first remote communication module;
The remote intelligent terminal receives the target place through the second remote communication module, performs path planning according to the current position of the remote intelligent terminal and the target place to obtain a partial optimal path, and controls the second movement module to automatically travel to the target place according to the partial optimal path.
Further, the processor 1001 may call a computer program stored in the memory 1005, and further perform the following operations:
The remote control method of the intelligent terminal further comprises the following steps:
and scanning a moving area of the remote intelligent terminal through the second camera to generate a whole-course map in the manual remote control moving process of the remote intelligent terminal and in the semi-automatic moving process of the remote intelligent terminal.
Further, the processor 1001 may call a computer program stored in the memory 1005, and further perform the following operations:
After the step of generating the global map, further comprising:
transmitting the whole map to the local intelligent terminal through the second remote communication module;
and in the full-automatic moving process of the remote intelligent terminal, receiving a starting point and an ending point which are set on the whole-course map by the local intelligent terminal through a second remote communication module, obtaining a whole-course optimal path after finishing path planning according to the starting point and the ending point, and controlling a second movement module to automatically move to the ending point according to the whole-course optimal path.
An embodiment of the present invention provides an intelligent terminal, referring to fig. 3, fig. 3 is a schematic structural diagram of an embodiment of an intelligent terminal of the present invention, where the intelligent terminal includes:
The device comprises a camera, a remote communication module and a motion module.
In video conferences, most of control technologies for a motion module carrying a camera are based on Bluetooth, infrared or wireless local area network and the like, and control instructions are directly sent to the motion module so as to control the motion of the motion module. However, when the front image of the motion module needs to be viewed in Real time through the camera and the motion module needs to be controlled to execute the corresponding motion action, if an RTP (Real-time Transport Protocol, real-time transmission protocol) channel which is often used when the FECC instruction is transmitted is adopted to transmit the motion module control instruction, for example, the RTP channel is used to directly transmit the control instruction corresponding to the bottom layer control protocol of the motion module, the intelligent terminal at this time does not need an instruction mapping unit, but not only needs to increase the data volume transmitted by the channel, but also needs to synchronize the camera and the instruction clock of the motion module, which is troublesome to realize and has low efficiency, so that in general, the motion control of the camera based on the motion module needs to be performed within a certain network range or within an infrared inductable range.
However, in reality, if only a small area is patrolled, a meeting is started in a designated conference room or a fixed scene is performed or video is performed in a video conference, for example, the intelligent terminal is fixed at a fixed position and cannot move, which results in that when an open video interaction is required, for example, when some guided scenes, patrolling scenes, live introduction scenes or video interaction conferences are required to be opened, this requirement cannot be met. At this time, a movable intelligent terminal is needed, and the movement module can be remotely controlled to move in the unmanned value conservation under the patrol scene.
In this embodiment, the intelligent terminal includes a remote communication module having a data receiving unit, a data sending unit and an instruction mapping unit, a motion module not shown in fig. 3, and a camera and a display disposed on the motion module, where the display has a touch function, and the integrated touch function is used to more conveniently obtain a control instruction for controlling the remote intelligent terminal, or may be other accessed peripheral devices, and in this embodiment, a mode and hardware for obtaining the control instruction are not limited. In this embodiment, the hardware configuration of the intelligent terminals is the same, and the remote real-time image and the key or touch area for controlling the remote movement are divided on the display. In the following, the local intelligent terminal is taken as an instruction sender and a controller, the first is taken as a prefix to refer to each component part, the remote intelligent terminal is taken as an instruction receiver, and the controlled party takes the second as a prefix to refer to each component part for explanation, but in other embodiments, the remote intelligent terminal can also reversely control the local intelligent terminal, the local intelligent terminal and the remote intelligent terminal mutually control, and the control method and logic thereof are the same as those of the embodiment and are not repeated herein.
Based on the intelligent terminal described above, the embodiment of the invention provides a remote control method for an intelligent terminal, and referring to fig. 2, fig. 2 is a schematic flow chart of an embodiment of a remote control method for an intelligent terminal according to the invention. In this embodiment, the remote control method of the intelligent terminal includes:
Step S30: in the manual remote control moving process of the remote intelligent terminal, the local intelligent terminal acquires a FECC instruction for controlling a second camera of the remote intelligent terminal, and the FECC instruction is sent to the remote intelligent terminal through a first remote communication module;
Step S40: the remote intelligent terminal receives the FECC instruction through the second remote communication module, maps the FECC instruction into a movement instruction for controlling the second movement module, and enables the second movement module to move according to the movement instruction and drive the remote intelligent terminal to move.
In this embodiment, after a remote real-time picture is displayed on a display of a local intelligent terminal, touch operation may be performed in a control area of the display, a data sending unit sends a FECC instruction corresponding to the touch operation to the remote intelligent terminal through an RTP channel, a data receiving unit of the remote intelligent terminal receives the FECC instruction and inputs the FECC instruction to an instruction mapping unit, and the instruction mapping unit maps the input FECC instruction to a movement module movement instruction corresponding to a bottom control protocol of a movement module according to a preset mapping rule, so as to control movement of the movement module, thereby driving the camera to move together. The FECC instruction corresponding to the touch operation of the receiving display may be a FECC instruction triggered by a virtual remote control keyboard or a peripheral keyboard, and in this embodiment, the hardware and method for triggering the FECC instruction are not limited.
In this embodiment, the intelligent terminal includes a camera, a remote communication module and a motion module, and the remote control method of the intelligent terminal includes: in the manual remote control moving process of the remote intelligent terminal, the local intelligent terminal acquires a FECC instruction for controlling a second camera of the remote intelligent terminal, and the FECC instruction is sent to the remote intelligent terminal through a first remote communication module; the remote intelligent terminal receives the FECC instruction through the second remote communication module, maps the FECC instruction into a movement instruction for controlling the second movement module, and enables the second movement module to move according to the movement instruction and drive the remote intelligent terminal to move.
The camera FECC protocol is combined with the bottom control protocol of the motion module, and the movement control of the camera is mapped onto the movement control of the motion module according to the rotation of the control camera and the movement direction of the motion module, so that the position of the camera can be conveniently and rapidly changed without complex control logic and time sequence relation.
Optionally, the smart terminal further includes a display, and before the step of the local smart terminal obtaining the FECC instruction for controlling the second camera of the remote smart terminal, the method further includes:
step S10: the remote intelligent terminal sends the real-time picture acquired by the second camera to the local intelligent terminal through the second remote communication module;
Step S20: the local intelligent terminal receives the real-time picture through the first remote communication module and displays the real-time picture through the display.
In this embodiment, after the handshake connection is established between the local and the remote end, the local receives the real-time image acquired by the remote camera. The camera of the remote intelligent terminal collects real-time pictures and sends the real-time pictures to the data receiving unit in the remote communication module of the local intelligent terminal through the data sending unit in the remote communication module, and then the local intelligent terminal displays the received real-time pictures in a 'real-time picture' area of the display, so that a local user can control the movement of the remote intelligent terminal based on the remote real-time pictures, and although the picture delay exists, the delay is still within an acceptable range in patrol or video conference. In this embodiment, the data transmission protocol or method of the real-time frame is not limited, and may be the RTP channel that is often used when transmitting the FECC instruction.
Optionally, before the step of mapping the FECC instruction to a movement instruction for controlling the second motion module, the method further comprises:
the remote intelligent terminal establishes a mapping rule for mapping the FECC instruction into the mobile instruction;
The step of mapping the FECC instruction into a movement instruction for controlling the second motion module includes:
and calling the mapping rule to map the FECC instruction into the moving instruction.
Before the FECC instruction is mapped into a motion module movement instruction for controlling the motion module by the instruction mapping unit, a mapping rule needs to be established and stored.
The remote intelligent terminal establishes a mapping rule for mapping the FECC instruction into a motion module moving instruction for controlling the motion module, and maps the FECC instruction into the motion module moving instruction for controlling the motion module by calling the mapping rule through the instruction mapping unit.
Optionally, the step of the remote intelligent terminal establishing a mapping rule for mapping the FECC instruction to the mobile instruction includes:
the remote intelligent terminal acquires a first movement direction set of the second camera and a second movement direction set of the second movement module, and establishes the mapping rule according to the same matching item of the first movement direction set and the second movement direction set.
For the FECC protocol, the request will not have a corresponding reply. Because the visual feedback of the camera can replace the actual response process, the FECC protocol needs to be able to quickly and accurately transmit control information. Specifically, when the mapping rule is established, a first movement direction set of the camera, such as three-axis rotation of up, down, front, back, left and right, and a second movement direction set of the movement module, such as plane movement of front, back, left and right, are obtained first, and the movement module generally does not move up and down. The FECC instruction for rotating the camera up and down can be directly mapped into a movement module movement instruction for moving the movement module back and forth without expansion or reduction; directly mapping FECC instructions for rotating the left and right shafts of the camera into movement instructions of the movement module for moving the movement module left and right; and setting the FECC instruction for rotating the left and right axes of the camera to be in an idle state.
Optionally, the step of establishing the mapping rule according to the same matching item of the first moving direction set and the second moving direction set includes:
and if the same matching item is moved left and right and moved back and forth, the left and right translation field in the motion request parameter of the FECC instruction corresponds to the left and right movement field of the second motion module, and the zoom-in and zoom-out picture field corresponds to the forward and backward field of the second motion module.
Under actual camera mounting position or installation demand, the triaxial rotation of camera often can not satisfy simultaneously. In this embodiment, the camera is a fixed focus lens, there is no driving device that rotates back and forth and left and right, only a driving device that rotates up and down, and the front and back shafts and left and right shafts of the physical layer cannot rotate, but only the up and down shafts rotate, but the remote intelligent terminal can still receive the FECC instruction of triaxial rotation. At this time, the picture instruction for enlarging and reducing the camera corresponds to the forward and backward instruction in the bottom control protocol of the motion module, and the FECC instruction for rotating the camera up and down is mapped to the left and right motion instruction of the motion module. In this embodiment, the mapping rule is not limited, the mapping rule is only needed to be corresponding to the actual installation and movement requirement of the camera, and the number of the mapping and sending instructions and the instructions are not limited.
Optionally, the remote control method of the intelligent terminal further includes:
In a semi-automatic moving process of a remote intelligent terminal, a local intelligent terminal selects a target place in a real-time picture of the remote intelligent terminal, and the target place is sent to the remote intelligent terminal through a first remote communication module;
The remote intelligent terminal receives the target place through the second remote communication module, performs path planning according to the current position of the remote intelligent terminal and the target place to obtain a partial optimal path, and controls the second movement module to automatically travel to the target place according to the partial optimal path.
When controlling the movement of the movement module of the remote intelligent terminal, the target location can be marked on the local display in a frame selection mode, for example, so that the target location in the remote real-time picture can be selected. In the present embodiment, the manner of displaying the labeling target point and selecting the target point is not limited. And the remote intelligent terminal receives the target place through the data receiving unit, performs path planning according to the current position of the motion module and the target place to obtain a partial optimal path, and controls the motion module to travel to the target place according to the partial optimal path. Also, in the present embodiment, the way of route planning according to the current position and the target location is not limited.
Optionally, the remote control method of the intelligent terminal further includes:
and scanning a moving area of the remote intelligent terminal through the second camera to generate a whole-course map in the manual remote control moving process of the remote intelligent terminal and in the semi-automatic moving process of the remote intelligent terminal.
In the process of remotely controlling the movement of the intelligent terminal, the remote intelligent terminal generates an area map within the movement range of the intelligent terminal according to the real-time picture acquired by the camera, namely, the movement area of the scanning intelligent terminal, and in the embodiment, the mode of generating the area map is not limited, and the area map can be generated according to the real-time picture acquired by the camera and of the movement area of the intelligent terminal. And then the whole map of the mobile area of the remote intelligent terminal is obtained through splicing or fusing the area maps.
Optionally, after the step of generating the global map, the method further includes:
transmitting the whole map to the local intelligent terminal through the second remote communication module;
and in the full-automatic moving process of the remote intelligent terminal, receiving a starting point and an ending point which are set on the whole-course map by the local intelligent terminal through a second remote communication module, obtaining a whole-course optimal path after finishing path planning according to the starting point and the ending point, and controlling a second movement module to automatically move to the ending point according to the whole-course optimal path.
In a patrol scene, when no person is on duty, the embodiment can also remotely control the intelligent terminal to carry out autonomous movement patrol. In this embodiment, after the movable global map of the remote intelligent terminal is generated, the start point and the end point set on the regional map are received through the data receiving unit, where the start point and the end point may be set by a background server or may be set by a local intelligent terminal, and in this embodiment, the device and the source for setting the start point and the end point are not limited, so that the data receiving unit may receive the data. After obtaining the starting point and the ending point, for example, after obtaining the starting point and the ending point in an automatic patrol scene, the remote intelligent terminal performs path planning according to the starting point and the ending point so as to obtain a whole-course optimal path between the starting point and the ending point, and then controls the movement module to move according to the whole-course optimal path. In this embodiment, the method of path planning is not limited, and the manner of controlling the motion module to travel in the optimal path is not limited.
Optionally, the intelligent terminal further comprises a radar,
The remote control method of the intelligent terminal further comprises the following steps:
and in the moving process according to the intelligent terminal, the remote intelligent terminal avoids the faults in moving or advancing according to the reflection signals of the radar.
Considering the safety of the intelligent terminal and the surrounding environment in the movement process of the intelligent terminal, when the intelligent terminal is remotely controlled to move according to the movement instruction of the intelligent terminal or the intelligent terminal automatically moves along an optimal path, the remote intelligent terminal avoids the faults in moving or moving according to the reflection signals of the radar of the remote intelligent terminal. In the present embodiment, the manner of fault avoidance is not limited.
In addition, the embodiment of the invention also provides remote control equipment of the intelligent terminal, which comprises: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the method for remote control of a smart terminal as described above.
In addition, the embodiment of the invention further provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program realizes the steps of the remote control method of the intelligent terminal when being executed by a processor.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (9)
1. The remote control method of the intelligent terminal is characterized in that the intelligent terminal comprises a camera, a remote communication module and a motion module, and comprises the following steps of:
In the manual remote control moving process of the remote intelligent terminal, the local intelligent terminal acquires a FECC instruction for controlling a second camera of the remote intelligent terminal, and the FECC instruction is sent to the remote intelligent terminal through a first remote communication module;
The remote intelligent terminal receives the FECC instruction through the second remote communication module, maps the FECC instruction into a movement instruction for controlling the second movement module, and enables the second movement module to move according to the movement instruction and simultaneously drives the remote intelligent terminal to move;
before the step of mapping the FECC instruction into a movement instruction for controlling the second motion module, the method further comprises:
the remote intelligent terminal establishes a mapping rule for mapping the FECC instruction into the mobile instruction;
The step of mapping the FECC instruction into a movement instruction for controlling the second motion module includes:
and calling the mapping rule to map the FECC instruction into the moving instruction.
2. The remote control method of a smart terminal according to claim 1, wherein the smart terminal further comprises a display, and before the step of the local smart terminal acquiring the FECC instruction for controlling the second camera of the remote smart terminal, further comprising:
the remote intelligent terminal sends the real-time picture acquired by the second camera to the local intelligent terminal through the second remote communication module;
the local intelligent terminal receives the real-time picture through the first remote communication module and displays the real-time picture through the display.
3. The remote control method of an intelligent terminal according to claim 1, wherein the step of the remote intelligent terminal establishing a mapping rule for mapping the FECC instruction to the movement instruction comprises:
the remote intelligent terminal acquires a first movement direction set of the second camera and a second movement direction set of the second movement module, and establishes the mapping rule according to the same matching item of the first movement direction set and the second movement direction set.
4. The remote control method of an intelligent terminal according to claim 3, wherein the step of establishing the mapping rule according to the same matching item of the first moving direction set and the second moving direction set comprises:
and if the same matching item is moved left and right and moved back and forth, the left and right translation field in the motion request parameter of the FECC instruction corresponds to the left and right movement field of the second motion module, and the zoom-in and zoom-out picture field corresponds to the forward and backward field of the second motion module.
5. The remote control method of an intelligent terminal according to claim 1, wherein the remote control method of an intelligent terminal further comprises:
In a semi-automatic moving process of a remote intelligent terminal, a local intelligent terminal selects a target place in a real-time picture of the remote intelligent terminal, and the target place is sent to the remote intelligent terminal through a first remote communication module;
The remote intelligent terminal receives the target place through the second remote communication module, performs path planning according to the current position of the remote intelligent terminal and the target place to obtain a partial optimal path, and controls the second movement module to automatically travel to the target place according to the partial optimal path.
6. The remote control method of an intelligent terminal according to claim 5, wherein the remote control method of an intelligent terminal further comprises:
and scanning a moving area of the remote intelligent terminal through the second camera to generate a whole-course map in the manual remote control moving process of the remote intelligent terminal and in the semi-automatic moving process of the remote intelligent terminal.
7. The remote control method of an intelligent terminal according to claim 6, further comprising, after the step of generating the global map:
transmitting the whole map to the local intelligent terminal through the second remote communication module;
and in the full-automatic moving process of the remote intelligent terminal, receiving a starting point and an ending point which are set on the whole-course map by the local intelligent terminal through a second remote communication module, obtaining a whole-course optimal path after finishing path planning according to the starting point and the ending point, and controlling a second movement module to automatically move to the ending point according to the whole-course optimal path.
8. A remote control device for an intelligent terminal, the device comprising: memory, a processor and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the method for remote control of a smart terminal according to any one of claims 1 to 7.
9. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the remote control method of a smart terminal according to any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210582985.8A CN115052106B (en) | 2022-05-26 | 2022-05-26 | Remote control method, equipment and medium of intelligent terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210582985.8A CN115052106B (en) | 2022-05-26 | 2022-05-26 | Remote control method, equipment and medium of intelligent terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115052106A CN115052106A (en) | 2022-09-13 |
| CN115052106B true CN115052106B (en) | 2024-04-23 |
Family
ID=83158934
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210582985.8A Active CN115052106B (en) | 2022-05-26 | 2022-05-26 | Remote control method, equipment and medium of intelligent terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115052106B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101087398A (en) * | 2006-06-08 | 2007-12-12 | 中兴通讯股份有限公司 | A method and device for realizing remote monitoring in conference TV system |
| CN102377979A (en) * | 2010-08-11 | 2012-03-14 | 杭州华三通信技术有限公司 | Camera control system and cameral control method |
| CN102572373A (en) * | 2011-12-30 | 2012-07-11 | 南京超然科技有限公司 | Image acquisition automatic control system and method for video conference |
| WO2018001052A1 (en) * | 2016-06-27 | 2018-01-04 | 中兴通讯股份有限公司 | Method, device and system for processing image acquisition |
| CN112346459A (en) * | 2020-11-04 | 2021-02-09 | 深圳优地科技有限公司 | Robot operation method and device, robot and storage medium |
-
2022
- 2022-05-26 CN CN202210582985.8A patent/CN115052106B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101087398A (en) * | 2006-06-08 | 2007-12-12 | 中兴通讯股份有限公司 | A method and device for realizing remote monitoring in conference TV system |
| CN102377979A (en) * | 2010-08-11 | 2012-03-14 | 杭州华三通信技术有限公司 | Camera control system and cameral control method |
| CN102572373A (en) * | 2011-12-30 | 2012-07-11 | 南京超然科技有限公司 | Image acquisition automatic control system and method for video conference |
| WO2018001052A1 (en) * | 2016-06-27 | 2018-01-04 | 中兴通讯股份有限公司 | Method, device and system for processing image acquisition |
| CN112346459A (en) * | 2020-11-04 | 2021-02-09 | 深圳优地科技有限公司 | Robot operation method and device, robot and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115052106A (en) | 2022-09-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9413941B2 (en) | Methods and apparatus to compensate for overshoot of a desired field of vision by a remotely-controlled image capture device | |
| US11240403B2 (en) | Compensation for delay in PTZ camera system | |
| CN110022431B (en) | Image pickup apparatus, image pickup method, display apparatus, and display method | |
| US11375162B2 (en) | Remote terminal and method for displaying image of designated area received from mobile robot | |
| WO2011126511A4 (en) | Establishing a video conference during a phone call | |
| CN109983763A (en) | Show equipment and its control method | |
| CN106791483B (en) | Image transmission method and device and electronic equipment | |
| US20220150598A1 (en) | Method for message interaction, and electronic device | |
| CN105657257A (en) | Method, device and system for taking panoramic photo, mobile terminal and selfie stick | |
| CN111966314A (en) | Image projection method, image projection device, mobile terminal and projection equipment | |
| CN110928509B (en) | Display control method, display control device, storage medium, and communication terminal | |
| US20160353096A1 (en) | Display device and image quality setting method | |
| JP2020022152A (en) | Communication terminal, program, display method and recording medium | |
| CN113411621A (en) | Audio data processing method and device, storage medium and electronic equipment | |
| CN105225265A (en) | 3-D view automatic synthesis method and device | |
| CN115052106B (en) | Remote control method, equipment and medium of intelligent terminal | |
| US10820036B1 (en) | System and method for establishing and controlling a direct video output feed from a selected remote device | |
| KR100736898B1 (en) | Video Transmission Mobile Communication System For Remote Control Camera Service And Video Transmission Service Providing Method Using The Same | |
| EP2942945B1 (en) | System and method of precision remote ptz control of ip cameras | |
| US10257467B2 (en) | Client device for displaying images of a controllable camera, method, computer program and monitoring system comprising said client device | |
| CN111654521A (en) | Remote vehicle moving method, device and system | |
| CN106817431B (en) | Internet of things video remote control method and system | |
| EP3848894B1 (en) | Method and device for segmenting image, and storage medium | |
| CN114745505A (en) | Shooting method, shooting device, electronic equipment and readable storage medium | |
| CN111629148A (en) | Method for controlling photographing, intelligent device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |