CN117897946A - Control method, device, image transmission equipment and system - Google Patents

Abstract

Control method and device for terminal equipment, coding and decoding method, image transmission equipment and image transmission system. The method comprises the following steps: acquiring a control signal generated when a user triggers a first control component on control equipment, wherein the control equipment is used for controlling the terminal equipment; and sending the control signal to the control function of the terminal equipment so as to enable the terminal equipment to execute the control function indicated by the control signal, wherein the terminal equipment comprises a second control component corresponding to the first control component, and the control function indicated by the control signal is consistent with the control function corresponding to the second control component. In this way, the function of the control means on the control device can be made more flexible and versatile.

Description

Control method, device, image transmission equipment and system Technical Field

The embodiment of the application relates to the technical field of image transmission, in particular to a control method and device of terminal equipment, image transmission equipment and an image transmission system.

Background

The wireless image transmission technology is widely applied to the fields of video shooting, film shooting and the like. Generally, a wireless image transmission system comprises an image transmission device and an image transmission receiving device, wherein the image transmission device can acquire images or videos acquired by an image acquisition device and send the images or videos to the image transmission receiving device, and the image transmission receiving device can display the received images or videos or send the received images or videos to other devices to be displayed by the other devices, so that a user can remotely see images. With the increasing demand of users, users are not only satisfied with implementing remote view functions by using wireless image transmission technology, but also hope to remotely perform some operations on the image acquisition device based on the received image or video, such as focusing, adjusting focal length, changing lens orientation, or adjusting some shooting parameters, etc., so that the wireless image transmission technology can be further explored to implement more functions by using the wireless image transmission technology.

Disclosure of Invention

In view of this, the present application provides a control method, apparatus, encoding and decoding method, image transmission device, and image transmission system for a terminal device.

According to a first aspect of the present application, there is provided a control method of a terminal device, the method comprising:

acquiring a control signal generated when a user triggers a first control component on control equipment, wherein the control equipment is used for being in communication connection with the terminal equipment so as to control the terminal equipment;

and sending the control signal to the terminal equipment so that the terminal equipment executes the control function indicated by the control signal, wherein a second control part is arranged on the terminal equipment and used for acquiring the operation of a user to control the terminal equipment, the first control part and the second control part can control various functions of the terminal equipment, and if the control function of one of the first control part and the second control part is changed, the control function of the other one of the first control part and the second control part is correspondingly changed.

According to a second aspect of the present application, there is provided a control device for a terminal apparatus, the control device comprising a processor, a memory, a computer program stored in the memory for execution by the processor, the computer program when executed by the processor implementing the steps of:

Acquiring a control signal generated when a user triggers a first control component on control equipment, wherein the control equipment is used for being in communication connection with the terminal equipment so as to control the terminal equipment;

and sending the control signal to the terminal equipment so that the terminal equipment executes the control function indicated by the control signal, wherein a second control part is arranged on the terminal equipment and used for acquiring the operation of a user to control the terminal equipment, the first control part and the second control part can control various functions of the terminal equipment, and if the control function of one of the first control part and the second control part is changed, the control function of the other one of the first control part and the second control part is correspondingly changed.

According to a third aspect of the present application, there is provided an image transmission system, the image transmission system including an image transmission device for communication connection with a terminal device, and an image reception device for communication connection with a control device of the terminal device, any one of the image transmission device and the image reception device being configured to execute the control method of the first aspect and the control method of the first aspect.

According to a fourth aspect of the present application, there is provided an image transmission device, the image transmission device including a hardware interface, the image transmission device being connected to a terminal device through the hardware interface, the image transmission device being configured to acquire image data from the terminal device through the hardware interface and send the image data to a control device of the terminal device, and receive a control instruction sent by the control device and output the control instruction to the terminal device through the hardware interface.

According to a fifth aspect of the present application, there is provided a graphic transmission device configured to be in communication connection with a terminal device, and to perform encoding processing on source video data input by the terminal device and send the encoded source video data to a display device of the terminal device, so that target video data obtained after decoding processing is displayed on a screen of the display device, and if a video parameter of the source video data changes, the target video parameter changes accordingly.

According to a sixth aspect of the present application, there is provided a picture transmission and reception device configured to be communicatively connected to a picture transmission and reception device, where the picture transmission and reception device is configured to receive a code stream of source video data from the picture transmission and reception device, and perform decoding processing to obtain target video data, so as to display the target video data on a display screen, where video parameters of the target video data change with changes in video parameters of the source video data.

According to a seventh aspect of the present application, there is provided an image transmission system comprising an image transmission device for communication connection with a terminal device and an image reception device for communication connection with a display device of the terminal device,

the image transmission equipment is used for encoding the source video data input by the terminal equipment and then transmitting the encoded source video data to the image transmission receiving equipment;

the image transmission and reception device is used for receiving the code stream of the source video data from the image transmission and reception device, and performing decoding processing to obtain target video data so as to display the target video data in a display screen, wherein the video parameters of the target video data change along with the change of the video parameters of the source video data.

According to an eighth aspect of the present application, there is provided a computer readable storage medium having stored thereon a computer program which when executed implements the method mentioned in the first aspect.

By applying the scheme provided by the application, the embodiment of the application provides a method for controlling terminal equipment, which can establish a mapping relation between a control component on the control equipment and the control component on the terminal equipment, namely, map the function of the control component on the control equipment to the function of the control component on the terminal equipment, and when a control signal triggered by the control component on the control equipment is transmitted through a graph transmission system, convert the protocol of the control signal through the graph transmission system, translate the control function corresponding to the control signal into the control function of the corresponding control component on the terminal equipment, and then execute the control function by the terminal equipment. Since the functions of the control components on most terminal devices can be set by the user at present, the functions of the control components on the control devices are not fixed any more and can be flexibly changed.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort to a person skilled in the art.

FIGS. 1 (a) -1 (d) are schematic diagrams of various image transmission systems according to embodiments of the present application.

Fig. 2 is a flowchart of a control method of a terminal device according to an embodiment of the present application.

Fig. 3 is a schematic diagram of establishing a mapping relationship between a control unit of a terminal device and a control unit of a control device according to an embodiment of the present application.

Fig. 4 is a schematic diagram of the logic structure of the control device according to one embodiment of the present application.

Fig. 5 is a schematic illustration of a graphics delivery system in accordance with one embodiment of the present application.

Fig. 6 is a schematic diagram of a prior art connection of a picture transmission device and a terminal device.

Fig. 7 is a schematic diagram of a graphical transmission device of an embodiment of the present application.

FIG. 8 is a schematic diagram of an embodiment of the present application in which the graph transmission device implements "one-shot-multiple-shot".

FIG. 9 is a schematic diagram of an exemplary implementation of a "multiple-input-multiple-output" device.

FIG. 10 is a schematic diagram of a graphical transmission device of one embodiment of the present application.

FIG. 11 is a schematic diagram of the structure of a graphical transmission device of one embodiment of the present application.

FIG. 12 is a schematic diagram of the structure of a graphical transmission device of one embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.

The wireless image transmission technology is widely applied to the fields of video shooting, film shooting and the like. Generally, a wireless mapping system includes a mapping transmitting device and a mapping receiving device. Fig. 1 (a) -1 (d) show schematic diagrams of four image transmission systems. In some scenarios, the image transmission device may be a device that has an image capturing function, and then transmits the captured image or video to the image transmission receiving device, for example, the image transmission device may be a device integrated with a camera. In some scenes, the image transmission device may be an independent device with a data transmission function, and the image transmission device may be connected to the image acquisition device through a wired or wireless connection, and then an image or video acquired by the image acquisition device may be acquired and sent to the image transmission receiving device. For example, the image transmission device may be connected to the camera or the pan-tilt camera through a data line, and then acquire an image or video acquired by the camera or the pan-tilt camera, and send the image or video to the image transmission device.

In some scenarios, the image receiving device may be a device that has a display screen, and after receiving the image or video sent by the image transmitting device, the image receiving device may display the image or video through the display screen, for example, the image receiving device may be an image screen. In some scenarios, the image transmission and receiving device may also be an independent device with a data transmission function, and the image transmission and receiving device may be connected to various other devices in a wired or wireless manner, and then the image transmission and receiving device sends the received image or video to the other devices, and displays the image or video through the other devices.

With the increasing demand of users, users are not only satisfied with implementing a remote view function by using a wireless image transmission technology, but also hope to remotely perform some operations on an image capturing device and/or a movable platform on which the image capturing device is mounted based on a received image or video, such as focusing, adjusting a focal length, changing a lens orientation, or adjusting various shooting parameters of the image capturing device, and so on, and control the movement of the movable platform, adjust a gesture, and so on. Thus, wireless mapping techniques may be further explored to enable more functionality with wireless mapping techniques.

For example, in some scenarios, the image capturing device or a device communicatively connected to the image capturing device may have a control function for the image capturing device in addition to the function of displaying images or videos. For example, control components such as a handle, a rocker, a key and the like can be further arranged in the image transmission and reception device or the device connected with the image transmission and reception device, and the image acquisition device can be controlled through the control components, for example, focal length adjustment, focusing adjustment, shooting parameter adjustment and the like, or if the image acquisition device is arranged on the cradle head, the cradle head rotation and the like can be controlled through the control components.

For convenience of description, the apparatus for capturing an image or video will be hereinafter referred to as a terminal apparatus, wherein the terminal apparatus may be an apparatus having only an image or video capturing function without a picture transmission function, or may be an apparatus having both an image or video capturing function and a picture transmission function. The device for controlling the terminal device is hereinafter referred to as a control device, and the control device may be a device having only a video display function and a function of controlling the terminal device, but not having a picture transfer function, or may be a device having both a video display function and a function of controlling the terminal device and a picture transfer function.

At present, for a scenario in which a control part of a control device can be used to control a terminal device, there are the following problems: one is that the control program of the control unit on the control device is written in advance, and the control function that the control unit corresponds to is mostly fixed, for example, a certain handle is used for adjusting the rotation of the cradle head, or a certain impeller is used for focusing, and its control function can not be flexibly changed. The other is that the general terminal equipment and the control equipment are matched, namely, only a certain control equipment matched with the terminal equipment can control the terminal equipment, and the control equipment is limited and not flexible.

Based on this, the embodiment of the application provides a method for controlling a terminal device, which can establish a mapping relationship between a control component on the control device and a control component on the terminal device, that is, map a function of the control component on the control device to a function of the control component on the terminal device, and when a control signal triggered by the control component on the control device is transmitted through a mapping system, convert a protocol of the control signal through the mapping system, translate a control function corresponding to the control signal into a control function of a corresponding control component of the control component on the terminal device, and then be executed by the terminal device. The mirror image relationship between the control part on the control device and the control part on the terminal device is established, and the functions of the control part on the control device are not fixed any more and can be flexibly changed because the functions of the control part on most of the terminal devices can be set by users at present.

The control method provided by the embodiment of the application can be executed by a transmitting end or a receiving end in the image transmission system, and the transmitting end can be an independent image transmission device or integrated on a terminal device. The receiving end can be a separate image transmission receiving device or can be integrated on the control device.

The terminal equipment in the embodiment of the application can be various equipment such as a cradle head, a camera and an unmanned aerial vehicle which can collect images or videos. The control device in the embodiment of the application may be various control devices with a display function and provided with one or more control components, for example, the control device may be a remote controller, a picture transmission screen with a control function, a motion sensing controller, and the like, and the control components may be a handle, a pulsator, a key, a rocker, and the like.

Specifically, as shown in fig. 2, the control method of the embodiment of the present application may include the following steps:

s202, acquiring a control signal generated when a user triggers a first control component on control equipment, wherein the control equipment is used for being in communication connection with the terminal equipment so as to control the terminal equipment;

in general, some control components may be disposed on the terminal device, for controlling functions of the terminal device, for example, a cradle head with a camera is taken as the terminal device, and a cradle head may be provided with a pulsator, a key, a rocker, etc., where these control components may control the cradle head to perform some control functions, for example, adjust rotation of the cradle head, or focus and focus the camera. The control device of the terminal device can be used for conveniently controlling the terminal device by a user remotely. The mapping relation between the control component on the control device and the control component on the terminal device can be established, when the user triggers the first control component on the control device, the mapping relation is equivalent to triggering the second control component corresponding to the first control component on the terminal device, so that the terminal device can be controlled to execute the control function corresponding to the second control component.

Therefore, in step S202, when the user needs to remotely control the terminal device, the user may trigger the first control unit on the control device of the terminal device, where the control device may generate a corresponding control signal, and different control units may correspond to different control signals, so as to determine which control unit is currently triggered by the user based on the control signal. The device performing the method may acquire the control signal.

S204, sending the control signal to the terminal equipment so that the terminal equipment executes the control function indicated by the control signal, wherein a second control part is arranged on the terminal equipment, the second control part is used for acquiring the operation of a user to control the terminal equipment, the first control part and the second control part can control various functions of the terminal equipment, and if the control function of one of the first control part and the second control part is changed, the control function of the other one of the first control part and the second control part is correspondingly changed.

In step S204, since the second control unit corresponding to the first control unit is included on the terminal device, after the control signal is acquired, a control function currently corresponding to the second control unit corresponding to the first control unit may be determined, and then the control function is taken as an operation corresponding to the control signal, so that the terminal device performs the control function.

For example, as shown in fig. 3, assuming that the terminal device is a cradle with a camera, the cradle includes a knob wheel 1 and a knob 2, the knob 1 is used for controlling the cradle to rotate, the knob 2 is used for controlling the camera to take a photograph, and the control device may be a remote controller, and the remote controller includes a rocker 1 and a rocker 2, so that a mapping relationship between control components of the two devices, namely, the knob 1-rocker 1 and the knob 2-rocker 2, may be established, when a user adjusts the knob 1 on the remote controller, the cradle may also be controlled to rotate, and when the user adjusts the knob 2 on the remote controller, the camera may also be controlled to take a photograph. Of course, when the mapping relationship is actually established, a more detailed mapping can be performed on the specific operation mode of the control component, for example, the knob 1 rotates anticlockwise-the rocker 1 rotates leftwards, the knob 1 rotates clockwise-the rocker 1 rotates rightwards, and the mapping relationship can be specifically set according to the characteristics of the control component and the actual requirement.

In some embodiments, the first control component or the second control component may be one or more of a pulsator, a handle, a rocker, a key, a knob, and the like.

In some embodiments, the control function corresponding to the second control unit on the terminal device may be set by the user himself, i.e. its control function may be variable instead of fixed. Since the control unit in the control device in the embodiment of the present application corresponds to the control unit of the terminal device, when the control function corresponding to the control unit of the terminal device changes, the control function corresponding to the control unit of the control device also changes accordingly. That is, the control function indicated by the control signal generated by triggering the first control component will change with the corresponding control function of the second control component. By establishing the mapping relation between the control part of the control device and the control part of the terminal device, the corresponding function of the control part on the control device can be changed along with the change of the function of the control part on the terminal device, the function is not fixed, and the configuration parameters of the control device are not required to be modified, so that the method is more flexible and convenient.

In some embodiments, the control function corresponding to the second control component may be set by the user through an interactive interface, for example, in some scenarios, the terminal device includes an interactive interface, and thus, the user may set the control function corresponding to the second control component through the interactive interface on the terminal device. Or the user can set the control function corresponding to the second control component through the interactive interface on the control device, and then the corresponding relation is sent to the terminal device. For example, each control component on the terminal device may be displayed on the interactive interface, after clicking each control component, the user may display a drop-down menu, where the drop-down menu corresponds to various control functions, and the user may select one of the control functions as the control function corresponding to the control component.

Because the control functions corresponding to the control components on the control equipment can be changed, the corresponding relations are relatively complex to memorize by the user, and the control equipment is inconvenient for the user to use. Therefore, in order to facilitate the user to quickly know the functions corresponding to the control components of each control device when the control components of the control device are used for controlling the terminal device, in some real-time cases, the control functions corresponding to the control components on the control device can be displayed through the interactive interface of the control device. For example, a function introduction page may be provided, on which functions corresponding to the respective control components may be displayed.

In some embodiments, in order to facilitate the user to memorize and understand the functions of the control components on the control device, and also to facilitate the control components on the two devices to establish a relatively accurate mapping relationship that conforms to the user's operating habits, the first control component and the second control component may be the same type of control component. For example, if the first control part is a pulsator, the second control part is also a pulsator, and if the first control part is a button, the second control part is also a button. Therefore, the user can conveniently and quickly associate the two in the using process. In addition, as the operation modes of different control components are different, the control components of the same type are associated, and the operation modes of the control components and the control components can be conveniently established into a mapping relation. For example, the pulsator comprises two operation modes of clockwise rotation and anticlockwise rotation, so that the pulsators on the two devices are associated, and a mapping relation between the two operation modes on the two pulsators is also convenient to establish, for example, the pulsator of the terminal device rotates clockwise and the pulsator on the control device rotates clockwise.

Of course, since both the control device and the control unit on the terminal device can control the terminal device, in order to avoid confusion of control instructions, for example, the user triggers the control unit on the control device and triggers the control unit on the terminal device at the same time, so that the terminal device receives multiple control instructions, and these instructions may still be contradictory. To avoid this, in some embodiments, the priority of the control signals sent on the two devices may be set, for example, typically, the user on the side of the terminal device is closer to the terminal device, and the decision made by the user is more accurate, so that the priority of the control signal generated by the control unit on the trigger terminal device may be set higher than the priority of the control signal generated by the control unit on the trigger control device, i.e. the terminal device may preferentially execute the control instruction generated by the control unit on the trigger terminal device.

Of course, the priority of the instruction sent by the control device side can be set higher, and the instruction can be flexibly set according to actual requirements.

In some scenes, in order to avoid disorder of control instructions, a function of disabling functions may be set on the control device or the terminal device, for example, a control of disabling functions may be set on an interactive interface of the control device or the terminal device, after a user triggers the control, a function of a control component on the terminal device may be disabled, or a function of a control component on the control device may be disabled, and only a function of a control component on one side device is reserved to avoid disorder of control instructions.

In some embodiments, a first mapping relationship between a control component on the control device and a control component on the terminal device may be stored in advance, for example, the first mapping relationship may be stored on a device where the transmitting end of the image transmission is located, or may also be stored on a device where the receiving end of the image transmission is located, when determining a control function indicated by a control signal, the second control component corresponding to the first control component may be determined based on the first mapping relationship, and then a control function corresponding to the second control component is used as a control function corresponding to the control signal.

At present, when the terminal equipment is remotely controlled, each terminal equipment can only be controlled by the matched control equipment, so that the control method is relatively limited and is relatively single. In order to enable the plurality of types of control devices to remotely control the terminal device, in some embodiments, the control device of each terminal device may include a plurality of types of devices, and the first mapping relationship may also include a group, where each group of first mapping relationships may be used to characterize a correspondence between a control component on the terminal device and a control component on one type of control device.

For example, assuming that the terminal device is a cradle head provided with a camera, the control device may be a remote controller, a picture transmission screen, a rocker, etc., so that three sets of first mapping relationships may be set and used to record a corresponding relationship between a control component on the cradle head and a control component on the remote controller, a corresponding relationship between a control component on the cradle head and a control component on the picture transmission screen, a corresponding relationship between a control component on the cradle head and a control component on the rocker, etc., respectively. When a control signal generated by a control component on the control equipment triggered by a user is acquired, which control equipment is currently used by the user and which control component on the control equipment can be determined based on the control signal, and then a corresponding first mapping relation is called to determine the control component corresponding to the first mapping relation on the terminal equipment.

In some embodiments, the first mapping relationship may be pre-cured on the product before the product leaves the factory, for example, the product research and development stage may preset the first mapping relationship, and store the first mapping relationship on the device where the image transmission end is located or the device where the image transmission receiving end is located. When the control device and the terminal device are in a state of upper frequency, namely when the control device and the terminal device are matched with a channel for transmitting data, the first mapping relation is automatically determined.

In some embodiments, in order to make the function corresponding to the control part of the control device more flexible, the first mapping relationship may also be set by the user. For example, a control for establishing a first mapping relationship may be set on an interactive interface of the control device, after the terminal device and the control device are connected, when a user clicks the control, a first identifier corresponding to a control component on the control device and a second identifier corresponding to the control component on the terminal device may be displayed on the interactive interface of the control device, and the first mapping relationship is determined based on the operation of the user on the first identifier and the second identifier.

For example, the names or icons of the control components on the control device and the names or icons of the control components on the terminal device may be displayed on the interactive interface, and the user may drag the first identifier or the second identifier, for example, the user drags a certain first identifier to a corresponding second identifier, that is, a mapping relationship between the two control components is established, or the user may scribe a line in the screen to connect the two control components, so as to establish a mapping relationship between the two control components. Or when the user clicks the first identifier, a drop-down menu can appear, a plurality of second identifiers are displayed, and then the user can select the second identifier in the drop-down menu to establish the mapping relation of the two control components.

Because the second mapping relation between each control component and the control function on the terminal device can be set by the user, for example, the user can set the second mapping relation through the terminal device or the interactive interface on the control device, the image transmission end or the image transmission receiving end can also acquire the second mapping relation between each control component and the control function on the terminal device, and determine the control function corresponding to the control component on the control device based on the first mapping relation and the second mapping relation, so as to display the corresponding relation between each control component and the control function on the control device on the interactive interface of the control device. For example, after the control function corresponding to each control component on the terminal device is set by the user through the interactive interface of the control device, that is, after the second mapping relation is determined, the second mapping relation can be obtained from the control device, and then the control function corresponding to each control component on the control device is determined based on the first mapping relation and the second mapping relation, so as to be displayed on the interactive interface of the control device, so that the user can control the terminal device through the corresponding relation between each control component and the control function on the control device displayed by the interactive interface.

In some embodiments, the method may be performed by any one of a picture transmitting device and a picture receiving device of a picture system, as shown in fig. 1 (d), the picture transmitting device being communicatively connected to the terminal device, and the picture receiving device being communicatively connected to the control device. For example, the image transmission device and the image reception device may be two independent devices, wherein the image transmission device may be connected to the terminal device by a wired or wireless manner, and the image reception device may be communicatively connected to the control device by a wired or wireless manner. After triggering a first control component on the control device, a user sends the generated signal to the image transmission receiving device, the image transmission receiving device can perform protocol conversion on the control signal based on a pre-stored first mapping relation, and after determining a control function corresponding to the control signal, the control signal is sent to the image transmission transmitting device so that the image transmission transmitting device sends the control signal to the terminal device to control the terminal device. Or the image transmission device sends the control signal to the image transmission receiving device, the image transmission receiving device carries out protocol conversion based on a pre-stored first mapping relation, and the control function corresponding to the control signal is determined and then sent to the terminal device. The control function corresponding to the control signal is determined by carrying out protocol conversion on the control signal in the image transmission system, so that the mapping between the control component on the terminal equipment and the control component on the control equipment is realized.

Accordingly, as shown in fig. 4, the control device of the terminal device according to the embodiment of the present application includes a processor 41, a memory 42, and a computer program stored in the memory 42 and executable by the processor 41, where the computer program when executed by the processor 41 implements the following steps:

acquiring a control signal generated when a user triggers a first control component on control equipment, wherein the control equipment is used for being in communication connection with the terminal equipment so as to control the terminal equipment;

and sending the control signal to the terminal equipment so that the terminal equipment executes the control function indicated by the control signal, wherein a second control part is arranged on the terminal equipment and used for acquiring the operation of a user to control the terminal equipment, the first control part and the second control part can control various functions of the terminal equipment, and if the control function of one of the first control part and the second control part is changed, the control function of the other one of the first control part and the second control part is correspondingly changed.

In some embodiments, the control function indicated by the control signal varies with a corresponding control function of the second control component.

In some embodiments, the control function corresponding to the second control component is set by the user through an interactive interface, where the interactive interface includes an interactive interface of the control device and/or an interactive interface of the terminal device.

In some embodiments, the interactive interface on the control device displays control functions corresponding to each control component of the control device.

In some embodiments, the first control component and the second control component are the same type of control component.

In some embodiments, the first control component or the second control component comprises one or more of: the device comprises a wave wheel, a handle, a rocker, a key and a knob.

In some embodiments, the control signals generated by the control means on the terminal device are triggered with a higher priority than the control signals generated by the control means on the control device.

In some embodiments, when the processor is configured to send the control signal to the terminal device, the processor is specifically configured to:

Determining the second control component corresponding to the first control component based on a first mapping relation between the control component on the control device and the control component on the terminal device;

and taking the control function corresponding to the second control part as the control function corresponding to the control signal.

In some embodiments, the control device includes multiple types of devices, and the first mapping relationship includes multiple groups, where each group of first mapping relationship is used to characterize a correspondence between a control component on the terminal device and a control component on one type of control device.

In some embodiments, the first mapping is determined based on:

displaying a first identifier corresponding to a control component on the control equipment and a second identifier corresponding to the control component on the terminal equipment on an interactive interface of the control equipment;

and determining the first mapping relation based on the operation of the user on the first identifier and the second identifier.

In some embodiments, the first mapping is determined based on:

and when the control equipment and the terminal equipment are in a state of up-conversion, automatically determining the first mapping relation.

In some embodiments, the processor is further configured to:

acquiring a second mapping relation between each control component on the terminal equipment and the control function;

and determining a control function corresponding to the control component on the control equipment based on the first mapping relation and the second mapping relation so as to display the corresponding relation between each control component on the control equipment and the control function on an interactive interface of the control equipment.

In some embodiments, the control device may be a mapping transmitting apparatus of a mapping system.

In some embodiments, the control device may be a graph transmission receiving apparatus of a graph transmission system.

Further, as shown in fig. 5, the embodiment of the present application provides an image transmission system 50, where the image transmission system 50 includes an image transmission device 51 and an image reception device 52, where the image transmission device 51 is used for communication connection with a terminal device 53, the image reception device 52 is used for communication connection with a control device 54 of the terminal device 53, and any one of the image transmission device 51 and the image reception device 52 is used for executing the control method described in any one of the foregoing embodiments.

The wireless image transmission technology is not only used for transmitting the image acquired by the terminal equipment to the control equipment of the terminal equipment so as to display the image by the control equipment, but also used for transmitting the control instruction transmitted by the user through the control equipment to the terminal equipment so as to control the terminal equipment remotely by the user. Currently, in some scenarios, the transmitting end of the image transmission system may be made into an independent image transmission device, and the image transmission device may be connected with the terminal device through a data line, so as to send an image collected by the terminal device to one end of the control device. The image transmission receiving end can also be made into an independent image transmission device which is in communication connection with the control device, or the image transmission receiving end can also be integrated on the control device.

Since the image transmission device connected to the terminal device needs to transmit both the image collected by the terminal device and the control command sent by the control device to the terminal device, as shown in fig. 6, 2 hardware communication interfaces are generally required to be disposed on the image transmission device, for example, an HDMI interface and a USB interface are generally disposed, where the HDMI interface is used for transmitting image data, and the USB interface is used for transmitting the control command. When the image acquired by the terminal equipment and the control instruction of the control equipment to the terminal equipment are transmitted by using the image transmission equipment, the image transmission equipment and the terminal equipment are connected by utilizing an HDMI data line and USB data at the same time, so that two functions of data transmission and control instruction transmission are realized. Obviously, this kind of mode needs to set up a plurality of hardware interfaces on the image transmission equipment, is unfavorable for miniaturization and the portability of image transmission equipment, and the user needs to connect many data lines when using image transmission equipment simultaneously, and the operation is more loaded down with trivial details, and it is inconvenient to use.

Based on this, an image capturing device is provided in the embodiments of the present application, as shown in fig. 7, which is a schematic diagram of an image capturing device in the embodiments of the present application (it should be noted that an appearance shape of the image capturing device provided in the embodiments of the present application is not limited to the image capturing device shown in the drawings), the image capturing device includes a hardware interface, and the image capturing device may be connected to a terminal device through the hardware interface, where the terminal device may be a device with an image capturing function, for example, may be a camera, an unmanned aerial vehicle, a cradle head provided with a camera, or the like. The image transmission device can acquire image data from the terminal device through the hardware interface and then send the image data to the control device of the terminal device so that a user can view the image through the display interface of the control device. The control device can be a remote controller, a picture screen, a somatosensory controller and the like. Meanwhile, the terminal equipment can also receive the control instruction sent by the control equipment and output the control instruction to the terminal equipment through the hardware interface so as to realize remote control of the terminal equipment. The control device may be provided with control components, such as a handle, a rocker, a button, a pulsator, a knob, etc., and the user may trigger the control components to send a control instruction, or the user may trigger a control on a display interface of the control device to send a control instruction. The control instruction may be various instructions for controlling the terminal device, for example, the terminal device may be a cradle head provided with a camera, and thus, the control instruction may be to control rotation of the cradle head, or to control focusing, photographing, etc. of the camera on the cradle head.

By integrating two functions of image data transmission and control instruction transmission on one hardware interface of the image transmission device, the two functions can be executed respectively without arranging two hardware interfaces on the image transmission device, the image transmission device can be simplified, and meanwhile, a user does not need to be connected with a plurality of data lines when using the image transmission device, so that the image transmission device is convenient for the user to use.

In some embodiments, to implement the same hardware interface to transmit both images and control commands, the hardware interface may be an HDMI interface and the control commands may be commands in HDMI CEC format. By combining the HDMI CEC technology and the wireless graphic transmission technology, the transmission of image data and the transmission of control instructions can be completed simultaneously through one HDMI interface. Of course, the hardware interface may be other types of interfaces, such as an SDI interface, a USB interface, etc., and the type of the control instruction may also be adjusted based on the type suitability of the hardware interface.

In some embodiments, the terminal device may be a camera, and the control instructions may be used to adjust a shooting parameter of the camera. For example, the control instruction may be used to adjust the position of the focus of the photographing device, the size of the focal length, the size of the aperture, and the like.

In some embodiments, as shown in fig. 8, the control device of the terminal device may be a plurality of devices, for example, a plurality of users need to view the images acquired by the terminal device at the same time, and thus, the image transmission device may include a plurality of transmission channels (such as transmission channels 1-3 in fig. 8), each of which may correspond to one control device (such as control devices 1-3 in fig. 8), and each of the transmission channels is configured to transmit the image data acquired from the terminal device to the corresponding control device, and to transmit the control instruction transmitted by the control device to the terminal device. That is, the image transmission device can realize a one-to-many function, and send image data collected by one terminal device to a plurality of control devices, and simultaneously send control instructions of the plurality of control devices to the terminal device. Of course, in a scenario that the plurality of control devices can control the terminal device, the priority of the control instruction sent by each control device can be set, so that the confusion of the control instruction is avoided.

In some embodiments, as shown in fig. 9, the image transmission device may include a plurality of the above-described hardware interfaces (e.g., the hardware interfaces 1-3 in fig. 9), each for connecting one of the terminal devices (e.g., the terminal devices 1-3 in fig. 9), for transmitting image data and control instructions of the connected terminal device through the hardware interface. The image transmission device may include a plurality of transmission channels (such as transmission channels 1-3 in fig. 9), each corresponding to one of the terminal devices, a control device for transmitting image data received from the terminal device to the terminal device, and a control instruction for transmitting the control device to the terminal device. The image transmission device can realize the function of 'many-to-one', and the image data collected by a plurality of terminal devices is sent to the same control device, so that a user can remotely view the images collected by the plurality of terminal devices at the same time. Meanwhile, the image transmission device can also respectively send the control instructions sent by the control device to each terminal device so as to realize the control of a plurality of terminal devices by using one control device. Wherein the user may select a terminal device to be controlled from a plurality of terminal devices before transmitting the control instruction through the control device, and then transmit the control instruction.

In some embodiments, in order to facilitate the user to view the images collected by the plurality of terminal devices on the control device, the image data received from each terminal device may be displayed on the interactive interface of the control device by means of split screen display.

Currently, when a wireless image transmission system is used to transmit image data acquired by a terminal device to a display device at a receiving end, coding units in image transmission devices generally all receive source video data from a video input interface according to a fixed video specification (such as a frame rate, a resolution and the like), and then encode the received source video data according to a fixed coding parameter (such as a code rate and a compression rate) and then transmit the encoded source video data to image transmission and reception devices. Similarly, the image transmission and reception device decodes the encoded source video data according to the fixed video specification to obtain a video image with a fixed frame rate and a fixed resolution for display. However, since the terminal device connected to the image transmission device may change, the video specification of the source video data collected by each terminal device may also change, for example, the frame rate or the resolution may be different, if the coding units in the image transmission device all receive the source video data from the video input interface according to the fixed video specification, and then the fixed coding parameters are adopted to code the received source video data, then the problem that the wireless bandwidth resource of the image transmission device cannot be fully and reasonably utilized may be caused, and the ideal display effect cannot be achieved at the display device end.

For example, assume that the coding units of the image transmission device all receive source video data from the video input interface according to a fixed video specification (e.g., frame rate: 60 frames/s, resolution: 10K), then encode the received source video data according to the same encoding parameters (e.g., same code rate and compression rate), and then transmit the encoded source video data to the image transmission device, and the image transmission device decodes the encoded source video data into a video image of the fixed specification (frame rate: 60 frames/s, resolution: 10K) and then displays the video image. Thus, if the frame rate of the source video data collected by the terminal device is 30 frames/s and the resolution is 20K, the coding unit of the image transmission device still follows the frame rate: 60 frames/s, resolution: 10K, receiving source video data from a video input interface, and re-encoding the source video data, where the frame rate of the source video data acquired by the terminal device every second is smaller than the frame rate encoded by the encoding unit every second, the encoding unit may repeatedly encode the same image frame, wasting bandwidth resources, and similarly, receiving and re-encoding an original high-resolution image according to a low-resolution image, which may also result in that the resolution of a video image decoded by the image transmission and reception device is lower than that of the source image, and the display effect of the image is not ideal. Similarly, if the frame rate of the source video data collected by the terminal device is 80 frames/s and the resolution is 5K, the coding unit of the image transmission device still follows the frame rate: 60 frames/s, resolution: the 10K receives source video data from the video input interface, and then the recoding processing is performed, so that the possible good current network resources can be generated, but the video data is not transmitted by using the video data to the maximum extent, and the frame rate of the video image obtained by decoding of the image transmission and reception device is lower than that of the source video data, so that the problem that the displayed video image is not smooth enough can occur.

Based on this, the embodiment of the application provides a graph transmission device, when the graph transmission device encodes source video data acquired from a terminal device, the graph transmission device does not encode the source video data according to a fixed encoding strategy, for example, does not receive the source video data from the terminal device according to video parameters such as a fixed frame rate, a fixed resolution and the like, does not encode the source video data according to encoding parameters such as a fixed code rate, a fixed compression rate and the like, but adjusts the encoding strategy adaptively based on the video parameters of the source video data, so that the frame rate, the resolution and the like of the video data displayed by a display device at a receiving end are not fixed any more, but can be changed along with the change of the video parameters of the source video data, thereby maximally utilizing the bandwidth resources of the graph transmission device, and simultaneously achieving a better display effect when the video image is displayed at the receiving end.

As shown in fig. 10, the image transmission device provided in the embodiment of the present application is configured to be in communication connection with a terminal device, for example, the image transmission device may include a hardware communication interface, which is connected to the terminal device by a wire, or may include a wireless transmission unit in the image transmission device, and is wirelessly connected to the terminal device by the wireless transmission unit. The terminal device may be a device with an image capturing function, for example, a camera, an unmanned aerial vehicle, a cradle head provided with a camera, and the like.

The image transmission device may acquire the source video data input by the terminal device, and may then detect a video parameter of the source video data currently input by the terminal device, for example, in some scenarios, the video parameter may be one or more of a frame rate, a resolution, and the like of the source video data. Then, the source video data may be encoded according to the video parameters of the source video data, for example, an encoding policy that matches the video parameters of the source video data may be determined, where the encoding policy is used to indicate the video parameters such as the frame rate, the resolution, and the like of the video image received by the encoding unit of the image transmission device, and the encoding parameters such as the code rate, the compression rate, and the like used when the encoding unit encodes the source video data, and then the source video data may be encoded based on the encoding policy, and the encoded source video data may be sent to the display device of the terminal device. The display device of the terminal device can be various electronic devices with display screens, and video images acquired by the terminal device are displayed to a user through the display screens of the display devices, so that the user can remotely see the images.

In some scenarios, the display device may integrate a device with a function of image transmission and reception, that is, the display device is also an image transmission and reception device, and after receiving source video data subjected to encoding processing, the display device may perform decoding processing to obtain target video data for display. In some scenarios, the display device may be a device having only a display function, and the display device may be in communication connection with the image transmission and reception device, where after receiving the source video data subjected to encoding processing, the image transmission and reception device may decode the source video data subjected to processing to obtain target video data, and then output the target video data to the display device for display by the display device.

When the image transmission device encodes the source video data, the image transmission device adaptively adjusts the encoding strategy based on the video parameters of the source video data, namely, the frame rate, the code rate, the resolution, the compression rate and the like are adaptively adjusted during encoding instead of being fixed, and the decoding end adaptively decodes according to the video parameters, so that the video parameters of the target video data displayed in the final display device also change along with the change of the video parameters of the source video data.

In some embodiments, the image transmission device includes a video input interface through which the image transmission device obtains source video data from the terminal device, wherein the video input interface may be an HDMI interface, an SDI interface, or the like.

In some embodiments, as shown in fig. 11, the image transmission apparatus may include a detection unit for detecting a video parameter of the source video data currently input by the terminal apparatus. The detection unit may be a hardware unit, for example, a chip dedicated to detecting the frame rate and resolution of the source video data. Of course, in some scenarios, the detection unit may also be a software unit, i.e. may be a program or a piece of code with video parameters for detecting the source video data.

In some embodiments, as shown in fig. 12, the image transmission device further includes a processing unit and an encoding unit, where the processing unit is configured to receive the currently detected video parameter from the detecting unit, and send the currently detected video parameter to the encoding unit if it is determined that the currently detected video parameter is inconsistent with the last detected historical video parameter. The processing unit may be a processor in the image transmission device, such as a CPU.

The coding unit is configured to receive the currently detected video parameter from the processing unit, determine a coding policy that matches the currently detected video parameter, and then code the source video data based on the coding policy, for example, the coding unit may adjust a frame rate, a resolution, and other video parameters of the video data received from the terminal device, and may adjust coding parameters such as a code rate used in a coding process and a compression rate of compressing the video data, so that the current coding policy may maximize utilization of bandwidth resources of the image transmission device. The encoding unit encodes the source video data to obtain a code stream of the source video data, and then the code stream of the source video data obtained by encoding can be sent to the display device through the wireless transmission unit. The coding unit may be a hardware unit with a coding function, for example, may be a chip specially used for coding, or in some cases, the CPU has a coding function, and the coding unit may also be a CPU. That is, the detecting unit, the processing unit and the encoding unit may be three independent chips or the same chip.

In order to realize that the receiving end cannot generate excessive delay, namely, after the terminal equipment performs video acquisition, the display equipment can quickly receive and display video images, and cannot generate a long-time black screen phenomenon, so that bad experience is brought to users. Therefore, after the image transmission device is powered on, the coding unit can acquire the source video data from the terminal device through the video input interface of the image transmission device, and then code the acquired source video data and send the source video data. The coding unit needs to initialize the video parameters of the received source video data according to a certain specification, and considering most cases, the video parameters of the current source video data and the video parameters of the last time are consistent (unless terminal devices with different video parameters are replaced), so that after the image transmission device is powered on each time, the video parameters of the source video data received by the image transmission device can be initialized to the video parameters of the last time, and the source video data can be quickly received and coded for transmission. Therefore, in some embodiments, the image transmission device may further include a storage unit, and after determining that the video parameter of the currently detected source video data and the last detected historical video parameter are inconsistent, the image transmission device is further configured to store the currently detected video parameter in the storage unit, so that the encoding unit may initialize the video parameter of the received source video data to the video parameter stored by the storage unit last time when the image transmission device is powered on.

In some embodiments, the code stream obtained by encoding the source video data includes information for indicating the video parameter, for example, the video parameter may be recorded in header information in a data packet of the code stream, so that after the decoding end obtains the code stream, the decoding end may obtain the video parameter from the code stream information, and then decode the code stream based on the video parameter to obtain the target video data, so that the video parameter of the target video data obtained by decoding at the decoding end also adaptively changes along with the change of the video parameter of the source video data, and a more ideal display effect is achieved.

Accordingly, the embodiments of the present disclosure further provide a picture transmission and reception device configured to be communicatively connected to a picture transmission and reception device, where the picture transmission and reception device is configured to receive a code stream of source video data from the picture transmission and reception device, and obtain a video parameter of the source video data from the code stream, for example, may obtain the video parameter from header information of the code stream. The code stream may then be decoded based on video parameters of the source video data to obtain target video data for display, wherein the video parameters of the target video data vary with the video parameters of the source video data.

Further, an embodiment of the present disclosure provides an image transmission system including an image transmission device for communication connection with a terminal device and an image reception device for communication connection with a display device of the terminal device,

the image transmission equipment is used for detecting video parameters of source video data input by the terminal equipment, carrying out coding processing on the source video data based on the video parameters of the source video data to obtain a code stream of the source video data, and sending the code stream to the image transmission and reception equipment;

the image transmission and reception device is used for acquiring video parameters of the source video data from the code stream, decoding the code stream based on the video parameters of the source video data to obtain target video data, and displaying the target video data in a display screen, wherein the video parameters of the target video data change along with the change of the video parameters of the source video data.

The specific details of the image transmission device and the image reception device in encoding and decoding the video data may refer to the descriptions in the foregoing embodiments, and are not repeated herein.

Further, an embodiment of the present application further provides an encoding method, where the method includes:

detecting video parameters of source video data input by terminal equipment;

and encoding the source video data based on the video parameters of the source video data to obtain a code stream of the source video data, and transmitting the code stream to display equipment of the terminal equipment so as to display target video data obtained after decoding the code stream on a screen of the display equipment, wherein the video parameters of the target video data change along with the change of the video parameters of the source video data.

In some cases, the encoding method may be performed by the image transmission device, and specific details of the image transmission device performing the encoding method may be referred to the description in the foregoing embodiments, which are not described herein.

Further, the embodiment of the application also provides a decoding method, which comprises the following steps:

receiving a code stream of source video data;

and acquiring video parameters of the source video data from the code stream, and decoding the code stream based on the video parameters of the source video data to obtain target video data so as to display the target video data in a display screen, wherein the video parameters of the target video data change along with the change of the video parameters of the source video data.

In some cases, the decoding method may be performed by the image transmission and reception apparatus, and the specific details of the image transmission and reception apparatus performing the decoding method may be referred to the description in the foregoing embodiments, which is not repeated herein.

It will be appreciated that the technical solutions described in the above embodiments may be combined without any conflict, and for reasons of space, the embodiments of the present application are not limited to the above embodiments.

Accordingly, the embodiments of the present application also provide a computer storage medium having a program stored therein, which when executed by a processor, implements the method in any of the embodiments described above.

Embodiments of the present application may take the form of a computer program product embodied on one or more storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having program code embodied therein. Computer-usable storage media include both permanent and non-permanent, removable and non-removable media, and information storage may be implemented by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to: phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, may be used to store information that may be accessed by the computing device.

For the device embodiments, reference is made to the description of the method embodiments for the relevant points, since they essentially correspond to the method embodiments. The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The foregoing has outlined rather broadly the methods and apparatus provided in embodiments of the present invention in order that the detailed description of the principles and embodiments of the present invention may be implemented in any way that is used to facilitate the understanding of the method and core concepts of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.

Claims (56)

1. A control method of a terminal device, the method comprising:

   acquiring a control signal generated when a user triggers a first control component on control equipment, wherein the control equipment is used for being in communication connection with the terminal equipment so as to control the terminal equipment;

   and sending the control signal to the terminal equipment so that the terminal equipment executes the control function indicated by the control signal, wherein a second control part is arranged on the terminal equipment and used for acquiring the operation of a user to control the terminal equipment, the first control part and the second control part can control various functions of the terminal equipment, and if the control function of one of the first control part and the second control part is changed, the control function of the other one of the first control part and the second control part is correspondingly changed.
2. The method of claim 1, wherein if a control function of one of the first control component and the second control component changes, a control function of the other of the first control component and the second control component changes accordingly, comprising:

   if the control function of one of the first control part and the second control part is changed, the control function of the other of the first control part and the second control part is changed in the same way.
3. Method according to claim 1 or 2, characterized in that the control function corresponding to the second control means is set by a user via an interactive interface comprising an interactive interface of the control device and/or an interactive interface of the terminal device.
4. A method according to any one of claims 1-3, characterized in that the interactive interface on the control device presents control functions corresponding to the individual control elements of the control device.
5. The method according to any one of claims 1-4, wherein the first control component and the second control component are of the same type of control component.
6. The method of any one of claims 1-5, wherein the first control component or the second control component comprises one or more of: the device comprises a wave wheel, a handle, a rocker, a key and a knob.
7. The method according to any of claims 1-6, characterized in that the priority of the control signals generated by the control means on the terminal device is higher than the priority of the control signals generated by the control means on the control device.
8. The method according to any of claims 1-7, wherein transmitting the control signal to the terminal device comprises:

   determining the second control component corresponding to the first control component based on a first mapping relation between the control component on the control device and the control component on the terminal device;

   and taking the control function corresponding to the second control part as the control function corresponding to the control signal.
9. The method of claim 8, wherein the control device comprises a plurality of types of devices, and wherein the first mapping relationships comprise a plurality of groups, each group of first mapping relationships being configured to characterize a correspondence of a control component on the terminal device to a control component on one type of control device.
10. The method according to claim 8 or 9, characterized in that the first mapping relation is determined based on:

    displaying a first identifier corresponding to a control component on the control equipment and a second identifier corresponding to the control component on the terminal equipment on an interactive interface of the control equipment;

    and determining the first mapping relation based on the operation of the user on the first identifier and the second identifier.
11. The method according to claim 8 or 9, wherein the first mapping relation is determined based on:

    and when the control equipment and the terminal equipment are in a state of up-conversion, automatically determining the first mapping relation.
12. The method according to any one of claims 1-11, further comprising:

    acquiring a second mapping relation between each control component on the terminal equipment and the control function;

    and determining a control function corresponding to the control component on the control equipment based on the first mapping relation and the second mapping relation so as to display the corresponding relation between each control component on the control equipment and the control function on an interactive interface of the control equipment.
13. The method according to any of claims 1-12, characterized in that the method is performed by any of a picture transmitting device of a picture transmitting system, which picture transmitting device is communicatively connected to the terminal device, and a picture receiving device of a picture transmitting system, which picture receiving device is communicatively connected to the control device.
14. A control device for a terminal device, wherein the control device comprises a processor, a memory, and a computer program stored in the memory for execution by the processor, the computer program implementing the following steps when executed by the processor:

    acquiring a control signal generated when a user triggers a first control component on control equipment, wherein the control equipment is used for being in communication connection with the terminal equipment so as to control the terminal equipment;

    and sending the control signal to the terminal equipment so that the terminal equipment executes the control function indicated by the control signal, wherein a second control part is arranged on the terminal equipment and used for acquiring the operation of a user to control the terminal equipment, the first control part and the second control part can control various functions of the terminal equipment, and if the control function of one of the first control part and the second control part is changed, the control function of the other one of the first control part and the second control part is correspondingly changed.
15. The apparatus of claim 14, wherein if a control function of one of the first control means and the second control means changes, a control function of the other of the first control means and the second control means changes accordingly, comprising:

    if the control function of one of the first control part and the second control part is changed, the control function of the other of the first control part and the second control part is changed in the same way.
16. The apparatus according to claim 14 or 15, wherein the control function corresponding to the second control means is set by a user via an interactive interface, the interactive interface comprising an interactive interface of the control device and/or an interactive interface of the terminal device.
17. The apparatus according to any one of claims 14-16, wherein the interactive interface on the control device exposes control functions corresponding to respective control components of the control device.
18. The device according to any one of claims 1-17, wherein the first control means and the second control means are of the same type of control means.
19. The apparatus of any one of claims 1-18, wherein the first control component or the second control component comprises one or more of: the device comprises a wave wheel, a handle, a rocker, a key and a knob.
20. The apparatus according to any of claims 1-19, wherein the priority of the control signals generated by the control means on the terminal device is higher than the priority of the control signals generated by the control means on the control device.
21. The apparatus according to any of claims 1-20, wherein the processor is configured, when configured to send the control signal to the terminal device, to:

    determining the second control component corresponding to the first control component based on a first mapping relation between the control component on the control device and the control component on the terminal device;

    and taking the control function corresponding to the second control part as the control function corresponding to the control signal.
22. The apparatus of claim 21, wherein the control device comprises a plurality of types of devices, and wherein the first mapping relationships comprise a plurality of groups, each group of first mapping relationships being configured to characterize a correspondence of a control component on the terminal device to a control component on one type of control device.
23. The apparatus according to claim 21 or 22, wherein the first mapping relationship is determined based on:

    displaying a first identifier corresponding to a control component on the control equipment and a second identifier corresponding to the control component on the terminal equipment on an interactive interface of the control equipment;

    and determining the first mapping relation based on the operation of the user on the first identifier and the second identifier.
24. The apparatus according to claim 21 or 22, wherein the first mapping relationship is determined based on:

    and when the control equipment and the terminal equipment are in a state of up-conversion, automatically determining the first mapping relation.
25. The apparatus of claim 1, wherein the processor is further configured to:

    acquiring a second mapping relation between each control component on the terminal equipment and the control function;

    and determining a control function corresponding to the control component on the control equipment based on the first mapping relation and the second mapping relation so as to display the corresponding relation between each control component on the control equipment and the control function on an interactive interface of the control equipment.
26. The apparatus of claim 14, wherein the apparatus is any one of a graph transmitting device or a graph receiving device of a graph system.
27. The apparatus of claim 14, wherein the apparatus is a transmission device of a transmission system, the transmission device includes a hardware interface, the transmission device is connected to a terminal device through the hardware interface, the transmission device is configured to obtain image data from the terminal device through the hardware interface and send the image data to a control device of the terminal device, and receive a control command sent by the control device and output the control command to the terminal device through the hardware interface.
28. The apparatus of claim 27, wherein the hardware interface is an HDM I interface and the control instruction is an HDMI CEC format instruction.
29. The apparatus according to claim 27 or 28, wherein the terminal device is a camera, and the control instruction is configured to adjust a shooting parameter of the camera.
30. The apparatus according to any one of claims 27-29, wherein the control device of the terminal device comprises a plurality of transmission channels, each transmission channel corresponding to a control device, for transmitting image data received from the terminal device to the control device, and for transmitting control instructions transmitted by the control device to the terminal device.
31. The apparatus according to any one of claims 27-29, wherein the hardware interfaces comprise a plurality of hardware interfaces, each for connecting to a terminal device, and the image transmission device comprises a plurality of transmission channels, each transmission channel corresponding to a terminal device, for transmitting the image data received from the terminal device to the control device of the terminal device, so as to display the image data received from the respective terminal devices on the interactive interface of the control device by means of split screen display; and the control instruction is used for sending the control instruction sent by the control equipment to the terminal equipment.
32. The apparatus according to claim 14, wherein the apparatus is a picture transmission device of a picture transmission system, the picture transmission device is configured to be in communication connection with a terminal device, the picture transmission device is configured to detect video parameters of source video data input by the terminal device, encode the source video data based on the video parameters of the source video data to obtain a code stream of the source video data, and send the code stream to a display device of the terminal device, so as to display target video data obtained by decoding the code stream on a screen of the display device, where the video parameters of the target video data change with a change of the video parameters of the source video data.
33. The apparatus of claim 32, wherein the image transmission device includes a detection unit, and wherein the detection unit is configured to detect a video parameter of source video data currently input by the terminal device.
34. The apparatus according to claim 33, wherein the image transmission device further comprises a processing unit and an encoding unit, the processing unit being configured to receive a currently detected video parameter from the detecting unit, and send the currently detected video parameter to the encoding unit if it is determined that the currently detected video parameter is inconsistent with a previously detected video parameter;

    the encoding unit is used for determining an encoding strategy matched with the currently detected video parameters, and encoding the source video data based on the encoding strategy to obtain a code stream of the source video data so as to send the code stream to the display equipment.
35. The apparatus of any of claims 32-34, wherein the image transmitting device comprises a video input interface through which the image transmitting device obtains source video data from the terminal device, the video input interface comprising one or more of: HDMI interface, SDI interface.
36. The apparatus of any of claims 32-35, wherein the image transmission device further comprises a storage unit, the image transmission device further configured to store the video parameters in the storage unit.
37. The apparatus according to any of claims 32-36, wherein the code stream includes information indicating the video parameter to enable a picture receiving device to decode based on the video parameter information.
38. The apparatus according to any of claims 32-37, wherein the code stream includes information indicating the video parameters.
39. The apparatus of any of claims 32-38, wherein the video parameters include one or more of: resolution of video image, frame rate of video image.
40. The apparatus of claim 14, wherein the apparatus is a picture-transmission receiving device of a picture-transmission system, the picture-transmission receiving device configured to be communicatively connected to a picture-transmission transmitting device, the picture-transmission receiving device configured to receive a code stream of source video data from the picture-transmission transmitting device, obtain video parameters of the source video data from the code stream, and decode the code stream based on the video parameters of the source video data to obtain target video data, so as to display the target video data on a display screen, wherein the video parameters of the target video data change with changes in the video parameters of the source video data.
41. A picture transmission system, characterized in that the picture transmission system comprises a picture transmission device for communication connection with a terminal device and a picture reception device for communication connection with a control device of the terminal device, any one of the picture transmission device and the picture reception device being adapted to perform the control method according to any one of claims 1-13.
42. The image transmission device is characterized by comprising a hardware interface, wherein the image transmission device is connected with a terminal device through the hardware interface, and is used for acquiring image data from the terminal device through the hardware interface and sending the image data to a control device of the terminal device, receiving a control command sent by the control device and outputting the control command to the terminal device through the hardware interface.
43. The graphic transmission device of claim 42, wherein the hardware interface is an HDMI interface and the control command is an HDMI CEC format command.
44. The image capturing device of claim 42 or 43, wherein the terminal device is a camera, and the control instructions are configured to adjust a capturing parameter of the camera.
45. The image transmission apparatus according to any one of claims 42 to 44, wherein the control apparatus of the terminal apparatus includes a plurality of transmission channels, each corresponding to one of the control apparatuses, for transmitting the image data received from the terminal apparatus to the control apparatus, and for transmitting the control instruction transmitted by the control apparatus to the terminal apparatus.
46. The image transmission apparatus according to any one of claims 42 to 44, wherein the hardware interfaces include a plurality of hardware interfaces, each for connecting to one terminal apparatus, the image transmission apparatus includes a plurality of transmission channels, each corresponding to one terminal apparatus, for transmitting image data received from the terminal apparatus to a control apparatus of the terminal apparatus, so as to display the image data received from the respective terminal apparatuses on an interactive interface of the control apparatus by means of split screen display; and the control instruction is used for sending the control instruction sent by the control equipment to the terminal equipment.
47. The image transmission device is characterized in that the image transmission device is configured to be in communication connection with a terminal device, and is used for encoding source video data input by the terminal device and then sending the source video data to a display device of the terminal device, so that target video data obtained after decoding processing is displayed on a screen of the display device, wherein if video parameters of the source video data change, the video parameters of the target video data correspondingly change.
48. The image transmission apparatus according to claim 47, wherein the image transmission apparatus includes a detection unit for detecting video parameters of source video data currently input by the terminal apparatus.
49. The image transmission apparatus according to claim 48, further comprising a processing unit and an encoding unit, wherein the processing unit is configured to receive a currently detected video parameter from the detecting unit, and send the currently detected video parameter to the encoding unit if it is determined that the currently detected video parameter is inconsistent with a previously detected video parameter;

    the encoding unit is used for determining an encoding strategy matched with the currently detected video parameters, and encoding the source video data based on the encoding strategy to obtain a code stream of the source video data so as to send the code stream to the display equipment.
50. The image transmitting device of any one of claims 48-49, wherein the image transmitting device includes a video input interface through which the image transmitting device obtains source video data from the terminal device, the video input interface including one or more of: HDMI interface, SDI interface.
51. The image transmission apparatus according to any one of claims 47 to 50, further comprising a storage unit, wherein the image transmission apparatus is further configured to store the video parameter in the storage unit.
52. The apparatus according to any one of claims 47-51, wherein the code stream includes information indicating the video parameter, so that the image receiving apparatus decodes the code stream based on the video parameter information.
53. The image transmitting device of any one of claims 47-52, wherein the video parameters include one or more of: resolution of video image, frame rate of video image.
54. A picture transmission and reception device, wherein the picture transmission and reception device is configured to be in communication connection with a picture transmission device, and the picture transmission and reception device is configured to receive a code stream of source video data from the picture transmission device, and perform decoding processing to obtain target video data, so as to display the target video data in a display screen, wherein video parameters of the target video data change along with changes of video parameters of the source video data.
55. A picture transmission system is characterized by comprising a picture transmission device and a picture reception device, wherein the picture transmission device is used for being in communication connection with a terminal device, the picture reception device is used for being in communication connection with a display device of the terminal device,

    the image transmission equipment is used for encoding the source video data input by the terminal equipment and then transmitting the encoded source video data to the image transmission receiving equipment;

    the image transmission and reception device is used for receiving the code stream of the source video data from the image transmission and reception device, and performing decoding processing to obtain target video data so as to display the target video data in a display screen, wherein the video parameters of the target video data change along with the change of the video parameters of the source video data.
56. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed, implements the method according to any of claims 1-13.