CN117640858A - Recording and playing picture synthesis method and device, electronic equipment and storage medium - Google Patents
Recording and playing picture synthesis method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN117640858A CN117640858A CN202310085855.8A CN202310085855A CN117640858A CN 117640858 A CN117640858 A CN 117640858A CN 202310085855 A CN202310085855 A CN 202310085855A CN 117640858 A CN117640858 A CN 117640858A
- Authority
- CN
- China
- Prior art keywords
- picture
- recording
- broadcasting
- sub
- video source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001308 synthesis method Methods 0.000 title description 2
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 86
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 85
- 238000000034 method Methods 0.000 claims abstract description 62
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 45
- 238000004590 computer program Methods 0.000 claims description 14
- 238000010586 diagram Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 11
- 230000006870 function Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Landscapes
- Television Signal Processing For Recording (AREA)
Abstract
The application relates to a method, a device, an electronic device and a storage medium for synthesizing recorded broadcast pictures, wherein the method comprises the following steps: the recording and broadcasting host acquires a recording and broadcasting picture synthesis instruction; the recording and broadcasting host determines a first video source device where the main picture is located according to the recording and broadcasting picture synthesis instruction, and sends the recording and broadcasting picture synthesis instruction to the first video source device; the first video source equipment determines a second video source equipment where each sub-picture is located according to a recording and broadcasting picture synthesis instruction, acquires the corresponding sub-picture from the second video source equipment, synthesizes the main picture with a plurality of sub-pictures to obtain a recording and broadcasting picture, and sends the recording and broadcasting picture to a recording and broadcasting host; the recording and broadcasting host receives the recording and broadcasting picture and displays the recording and broadcasting picture. According to the method and the device for synthesizing the video recording and playing picture, the main picture is directly obtained through the first video source equipment, picture synthesis is carried out on the main picture and each sub picture, picture quality of the main picture in the video recording and playing picture is improved, and time delay of synthesizing the video recording and playing picture is reduced.
Description
Technical Field
The present invention relates to the field of video recording and playing technologies, and in particular, to a method and apparatus for synthesizing a recording and playing picture, an electronic device, and a storage medium.
Background
In school education and teaching, classroom content is recorded and broadcast in a classroom sometimes so as to facilitate observers to learn about observation. In order to better present classroom content to viewers, it is generally necessary to perform synthesis of recorded broadcast pictures, for example, to perform picture synthesis of a teacher picture and a student picture, so as to obtain recorded broadcast pictures.
In the related art, when the recording and playing picture is synthesized by a plurality of pictures, because the human eyes usually pay attention to only one picture, the other pictures are more watched cooperatively, and when the recording and playing host synthesizes all the pictures, the recording and playing host does not have primary and secondary division, so that the picture quality which is concerned by the human eyes is low and the time delay is high.
Disclosure of Invention
Accordingly, an object of the present application is to provide a method, an apparatus, an electronic device, and a storage medium for synthesizing recorded broadcast pictures, which can improve the picture quality of interest to human eyes and reduce the delay.
According to a first aspect of embodiments of the present application, there is provided a method for synthesizing a recorded broadcast picture, the method including the steps of:
the recording and broadcasting host acquires a recording and broadcasting picture synthesis instruction; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub pictures, and the size of the main picture is larger than or equal to that of each sub picture;
the recording and broadcasting host determines a first video source device where the main picture is located according to the recording and broadcasting picture synthesis instruction, and sends the recording and broadcasting picture synthesis instruction to the first video source device;
the first video source equipment determines a second video source equipment where each sub-picture is located according to the recorded broadcast picture synthesis instruction, acquires the corresponding sub-picture from the second video source equipment, synthesizes the main picture with a plurality of sub-pictures to obtain a recorded broadcast picture, and sends the recorded broadcast picture to the recorded broadcast host;
and the recording and broadcasting host receives the recording and broadcasting picture and displays the recording and broadcasting picture.
According to a second aspect of embodiments of the present application, there is provided a method for synthesizing a recorded broadcast picture, the method including the steps of:
obtaining a recording and broadcasting picture synthesis instruction; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub pictures, and the size of the main picture is larger than or equal to that of each sub picture;
determining a first video source device where the main picture is located according to the recording and broadcasting picture synthesis instruction, sending the recording and broadcasting picture synthesis instruction to the first video source device, so that the first video source device determines a second video source device where each sub-picture is located according to the recording and broadcasting picture synthesis instruction, acquiring the corresponding sub-picture from the second video source device, and carrying out picture synthesis on the main picture and a plurality of sub-pictures to obtain a recording and broadcasting picture;
and receiving the recorded broadcast picture sent by the first video source equipment, and displaying the recorded broadcast picture.
According to a third aspect of embodiments of the present application, there is provided a synthesizing apparatus for a recorded broadcast picture, including:
the instruction acquisition module is used for acquiring a recording and broadcasting picture synthesis instruction by the recording and broadcasting host; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub pictures, and the size of the main picture is larger than or equal to that of each sub picture;
the command sending module is used for determining a first video source device where the main picture is located according to the recording and broadcasting picture synthesis command by the recording and broadcasting host, and sending the recording and broadcasting picture synthesis command to the first video source device;
the recording and broadcasting picture obtaining module is used for determining second video source equipment where each sub-picture is located according to the recording and broadcasting picture synthesizing instruction by the first video source equipment, obtaining the corresponding sub-picture from the second video source equipment, carrying out picture synthesis on the main picture and a plurality of sub-pictures to obtain a recording and broadcasting picture, and sending the recording and broadcasting picture to the recording and broadcasting host;
and the recording and broadcasting picture display module is used for receiving the recording and broadcasting picture by the recording and broadcasting host and displaying the recording and broadcasting picture.
According to a fourth aspect of embodiments of the present application, there is provided an electronic device, including: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method of composing a recorded broadcast picture as claimed in any one of the preceding claims.
According to a fifth aspect of embodiments of the present application, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method for synthesizing a recorded broadcast picture as described in any one of the above.
According to the embodiment of the application, the recording and broadcasting host acquires a recording and broadcasting picture synthesis instruction; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub pictures, and the size of the main picture is larger than or equal to that of each sub picture; the recording and broadcasting host determines a first video source device where the main picture is located according to the recording and broadcasting picture synthesis instruction, and sends the recording and broadcasting picture synthesis instruction to the first video source device; the first video source equipment determines a second video source equipment where each sub-picture is located according to the recorded broadcast picture synthesis instruction, acquires the corresponding sub-picture from the second video source equipment, synthesizes the main picture with a plurality of sub-pictures to obtain a recorded broadcast picture, and sends the recorded broadcast picture to the recorded broadcast host; and the recording and broadcasting host receives the recording and broadcasting picture and displays the recording and broadcasting picture. According to the method and the device for synthesizing the video recording and playing picture, the main picture is directly obtained through the first video source equipment, picture synthesis is carried out on the main picture and each sub picture, picture quality of the main picture in the video recording and playing picture is improved, and time delay of synthesizing the video recording and playing picture is reduced.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
For a better understanding and implementation, the present application is described in detail below with reference to the drawings.
Drawings
Fig. 1 is a flow chart of a method for synthesizing a recorded broadcast picture according to a first embodiment of the present application;
fig. 2 is a system structural block diagram corresponding to a method for synthesizing a recorded broadcast picture according to the first embodiment of the present application;
fig. 3 is a flow chart of a method for synthesizing a recorded broadcast picture according to a second embodiment of the present application;
fig. 4 is a block diagram of a synthesizing device of a recorded broadcast picture according to a third embodiment of the present application;
fig. 5 is a block diagram of an electronic device according to a fourth embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the following detailed description of the embodiments of the present application will be given with reference to the accompanying drawings.
It should be understood that the described embodiments are merely some, but not all, of the embodiments of the present application. All other embodiments, based on the embodiments herein, which would be apparent to one of ordinary skill in the art without making any inventive effort, are intended to be within the scope of the present application.
The terminology used in the embodiments of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the embodiments of the application. As used in this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any or all possible combinations of one or more of the associated listed items.
When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the accompanying claims. In the description of this application, it should be understood that the terms "first," "second," "third," and the like are used merely to distinguish between similar objects and are not necessarily used to describe a particular order or sequence, nor should they be construed to indicate or imply relative importance. The specific meaning of the terms in this application will be understood by those of ordinary skill in the art as the case may be.
Furthermore, in the description of the present application, unless otherwise indicated, "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.
The method for synthesizing the recorded broadcast pictures provided in the embodiments of the present application may be executed by a device for synthesizing recorded broadcast pictures, where the device for synthesizing recorded broadcast pictures may be implemented in a software and/or hardware manner, and the device for synthesizing recorded broadcast pictures may be configured by two or more physical entities or may be configured by one physical entity. The synthesis equipment of the recorded broadcast picture can be any electronic equipment provided with image synthesis software, and the electronic equipment can be intelligent equipment such as a computer, a mobile phone, a tablet or a video camera. The video source equipment is a teacher camera, a student camera, computer multimedia and the like in a classroom.
Example 1
Fig. 1 is a flow chart of a method for synthesizing a recorded broadcast picture according to a first embodiment of the present application. The method for synthesizing the recorded broadcast picture provided by the embodiment of the application comprises the following steps:
s10: the recording and broadcasting host acquires a recording and broadcasting picture synthesis instruction; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub-pictures, and the size of the main picture is larger than or equal to that of each sub-picture.
The video source equipment is video signal source equipment corresponding to the video picture, and the video source equipment is in communication connection with the recording and playing host, and can be connected through a local area network or an external network.
The video source device includes one or more of a teacher's video camera, a student's video camera, and a multimedia computer. The classroom camera can collect pictures of teachers, including panorama pictures of teachers and close-up pictures of classrooms. The student camera can collect pictures of students, including panoramic pictures of students and close-up pictures of students. The multimedia computer can provide a multimedia PPT picture.
The main picture is a picture focused by human eyes, and each sub picture is used for the cooperative viewing of the human eyes. In the recorded broadcast picture, the size of the main picture is larger than or equal to the size of each sub-picture. The video pictures of each video source device can form a picture list, and a user can select one picture from the picture list as a main picture and select another picture or several pictures as sub-pictures. For example, the main picture may be a student close-up picture, and the sub picture may be a student panorama picture and a teacher panorama picture.
In the embodiment of the application, the user can send the recording and broadcasting picture synthesis instruction to the recording and broadcasting host through the client or the webpage control platform, the client or the webpage control platform is in communication connection with the recording and broadcasting host, and the client can be a mobile phone, a tablet personal computer and an interactive tablet, and can also directly input the recording and broadcasting picture synthesis instruction on the recording and broadcasting host.
S20: and the recording and broadcasting host determines the first video source equipment where the main picture is located according to the recording and broadcasting picture synthesis instruction, and sends the recording and broadcasting picture synthesis instruction to the first video source equipment.
In the embodiment of the application, the recording and broadcasting host is connected with each video source device through a local area network or an external network, after a recording and broadcasting picture synthesis instruction is acquired, a UDP multicast message is sent to a router of the local area network or the external network, the router sends the UDP multicast message to each video source device, the UDP multicast message is used for inquiring which video source device video picture is a main picture, the video source device corresponding to the main picture returns a video source device identifier to the recording and broadcasting host, and accordingly the recording and broadcasting host determines a first video source device where the main picture is located according to the video source device identifier and sends the recording and broadcasting picture synthesis instruction to the first video source device. Wherein the video source device identification may be a device identification code.
S30: the first video source equipment determines a second video source equipment where each sub-picture is located according to the recorded broadcast picture synthesis instruction, acquires the corresponding sub-picture from the second video source equipment, synthesizes the main picture with a plurality of sub-pictures to obtain a recorded broadcast picture, and sends the recorded broadcast picture to a recorded broadcast host.
In the related art, a recording and broadcasting host needs to acquire a main picture from a first video source device and acquire a corresponding sub-picture from a second video source device, wherein the main picture and the sub-picture are coded, the recording and broadcasting host needs to decode the main picture and the sub-picture to obtain video image data, synthesize the video image data, and code the synthesized video image data to obtain the recording and broadcasting picture. In the whole process, the main picture is coded twice, the picture quality is reduced in each coding, and the processing time is required for coding and decoding, so that the delay of synthesizing the recorded broadcast picture is improved.
In the embodiment of the application, communication connection is established between the video source devices through a local area network or an external network. The first video source equipment can acquire corresponding sub-pictures from each second video source equipment, the first video source equipment can directly acquire the main picture acquired by the first video source equipment, the main picture and each sub-picture are subjected to picture synthesis to obtain a recorded broadcast picture, and the recorded broadcast picture is sent to a recorded broadcast host. Because the first video source equipment can directly acquire the main picture acquired by the first video source equipment, the main picture does not need to be encoded, and only needs to decode each sub-picture, and then the main picture and each decoded sub-picture are subjected to picture synthesis to obtain the recorded broadcast picture. Compared with the related art, the method reduces the primary encoding action of the main picture, thereby improving the picture quality of the main picture and simultaneously reducing the delay of the synthesized recorded broadcast picture.
S40: the recording and broadcasting host receives the recording and broadcasting picture and displays the recording and broadcasting picture.
In the embodiment of the application, the recording and broadcasting host is provided with the display screen, and the recording and broadcasting picture can be displayed through the display screen. Optionally, the recording and broadcasting host can record the recording and broadcasting picture into an optical disk for storage, and can also send the recording and broadcasting picture to the server so as to realize live broadcasting or on-demand broadcasting through the server.
By applying the embodiment of the application, the recording and broadcasting picture synthesis instruction is obtained through the recording and broadcasting host; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub pictures, and the size of the main picture is larger than or equal to that of each sub picture; the recording and broadcasting host determines a first video source device where the main picture is located according to the recording and broadcasting picture synthesis instruction, and sends the recording and broadcasting picture synthesis instruction to the first video source device; the first video source equipment determines a second video source equipment where each sub-picture is located according to a recording and broadcasting picture synthesis instruction, acquires the corresponding sub-picture from the second video source equipment, synthesizes the main picture with a plurality of sub-pictures to obtain a recording and broadcasting picture, and sends the recording and broadcasting picture to a recording and broadcasting host; the recording and broadcasting host receives the recording and broadcasting picture and displays the recording and broadcasting picture. According to the method and the device for synthesizing the video recording and playing picture, the main picture is directly obtained through the first video source equipment, picture synthesis is carried out on the main picture and each sub picture, picture quality of the main picture in the video recording and playing picture is improved, and time delay of synthesizing the video recording and playing picture is reduced.
Referring to fig. 2, fig. 2 is a system structural block diagram corresponding to a method for synthesizing a recorded broadcast picture according to a first embodiment of the present application. The system 1 corresponding to the method for synthesizing the recorded broadcast pictures comprises a client 10, a recorded broadcast host 11, a student camera 12, a teacher camera 13, a computer multimedia 14 and a router 15 of a local area network, wherein the specific process of synthesizing the recorded broadcast pictures is as follows: the user clicks the selected picture style on the client 10 to generate a recording and playing picture synthesis instruction. The picture style refers to the synthesized result of different pictures. For example, the user designates the main screen as a student close-up screen (SP screen) and the sub-screen as a student panoramic screen (SC screen) and a teacher panoramic screen (TC screen) on the client 10, and the client 10 generates a recording screen composition instruction and transmits the recording screen composition instruction to the recording host 11. The recording and broadcasting host 11 receives the recording and broadcasting picture synthesis instruction, sends a UDP multicast message to the router 15 of the local area network, and finds the video source equipment corresponding to the main picture, namely the student camera 12. The recording host 11 transmits a recording picture composition instruction to the student camera 12, the recording picture composition instruction including layout information of recording pictures, for example, the recording picture composition instruction may be "the student camera 12 pulls TC picture, SP picture, and SC picture, recording size information of TC picture, SP picture, and SC picture, and recording position information of XX". The student camera 12 receives the recording and broadcasting picture synthesizing instruction, collects the SP picture and the SC picture, pulls the TC picture from the teacher camera 13, synthesizes the SP picture, the SC picture, and the TC picture, obtains the recording and broadcasting picture, and the recording and broadcasting host 11 pulls the recording and broadcasting picture from the student camera 12 and displays the recording and broadcasting picture.
In an alternative embodiment, the step of acquiring the corresponding sub-frame from the second video source device in step S30 includes S31, which is specifically as follows:
s31: the first video source equipment pulls the corresponding sub-picture code stream from the second video source equipment, decodes the sub-picture code stream and obtains the corresponding sub-picture.
In the embodiment of the present application, after the second video source device collects its own video picture, the video picture needs to be encoded into a sub-picture code stream, so as to be sent to other video source devices. Therefore, the first video source device pulls the corresponding sub-picture code stream from the second video source device, and decodes the sub-picture code stream so as to facilitate the subsequent synthesis of the recorded broadcast picture.
In an alternative embodiment, the recording picture synthesizing instruction includes layout information of the recording picture; the layout information includes recording size information of each sub-picture, recording position information of each sub-picture, recording size information of a main picture and recording position information of the main picture, and the step S30 is to synthesize the main picture with a plurality of sub-pictures to obtain recording pictures, including the steps S32-S34, specifically as follows:
s32: the first video source equipment acquires a main picture according to the recorded broadcast size information of the main picture;
s33: the first video source equipment zooms each sub-picture according to the recorded and broadcast size information of each sub-picture to obtain a plurality of zoomed sub-pictures;
s34: and the first video source equipment synthesizes the scaled sub-pictures with the main picture according to the recording and playing position information of the main picture in the layout information and the position information of each sub-picture to obtain a recording and playing picture.
The layout information of the recorded broadcast picture is used for determining the positions of the main picture and each sub picture in the recorded broadcast picture. The recording size information of the main picture includes a width and a height of the main picture, the recording size information of the sub picture includes a width and a height of the sub picture, the recording position information of the main picture may refer to a position coordinate of an upper left corner of the main picture in the recording picture, and the recording position information of the sub picture may refer to a position coordinate of an upper left corner of the sub picture in the recording picture.
In the embodiment of the present application, before the recorded broadcast pictures are synthesized, a blank background picture may be generated according to layout information of the recorded broadcast pictures. The primary picture does not need decoding, is YUV image data, does not need scaling, and the first video source equipment can directly acquire YUV image data corresponding to recording and playing size information of the primary picture. The first video source device decodes each sub-picture into YUV image data, and since the sub-picture is from the second video source device, the size of the sub-picture may not be consistent with the recording size of the sub-picture, and thus the first video source device is required to perform a scaling operation on the size of the sub-picture so that the size of the sub-picture is consistent with the recording size of the sub-picture. For example, the size of the sub-picture is 720×480, and the recording size of the sub-picture is 400×300, and the first video source device needs to scale the size of the sub-picture from 720×480 to 400×300. Copying YUV image data of the main picture and the YUV image data of each scaled sub picture to corresponding positions of the blank background picture according to the recording and playing position information of the main picture and the recording and playing position information of the sub picture to obtain the recording and playing picture. By the mode, the recorded broadcast picture can be automatically and quickly obtained.
Example 2
Referring to fig. 3, fig. 3 is a flow chart of a method for synthesizing a recorded broadcast picture according to a second embodiment of the present application, the method includes the following steps:
s100: obtaining a recording and broadcasting picture synthesis instruction; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub pictures, and the size of the main picture is larger than or equal to that of each sub picture;
s200: determining a first video source device where a main picture is located according to a recorded broadcast picture synthesis instruction, sending the recorded broadcast picture synthesis instruction to the first video source device, so that the first video source device determines a second video source device where each sub-picture is located according to the recorded broadcast picture synthesis instruction, acquiring a corresponding sub-picture from the second video source device, and carrying out picture synthesis on the main picture and a plurality of sub-pictures to obtain a recorded broadcast picture;
s300: and receiving the recorded broadcast picture sent by the first video source equipment, and displaying the recorded broadcast picture.
In the embodiment of the present application, the method for synthesizing the recorded broadcast pictures is described from the execution body of the recorded broadcast host, and the specific implementation process is detailed in the first embodiment, which is not described herein again.
Example 3
The following are examples of apparatus that may be used to perform the method of example 1 of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method in embodiment 1 of the present application.
Fig. 4 is a schematic structural diagram of a device for synthesizing a recorded broadcast picture according to an embodiment of the present application. The classroom recorded broadcast device 5 provided in this embodiment of the present application includes:
the instruction obtaining module 51 is configured to obtain a recording and broadcasting picture synthesis instruction from a recording and broadcasting host; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub pictures, and the size of the main picture is larger than or equal to that of each sub picture;
the instruction sending module 52 is configured to determine, according to the recording and broadcasting picture synthesis instruction, a first video source device where the main picture is located, and send the recording and broadcasting picture synthesis instruction to the first video source device;
the recording and broadcasting picture obtaining module 53 is configured to determine a second video source device where each sub-picture is located according to a recording and broadcasting picture synthesis instruction by using the first video source device, obtain a corresponding sub-picture from the second video source device, perform picture synthesis on the main picture and a plurality of sub-pictures, obtain a recording and broadcasting picture, and send the recording and broadcasting picture to the recording and broadcasting host;
the recording and broadcasting picture display module 54 is used for receiving the recording and broadcasting picture by the recording and broadcasting host and displaying the recording and broadcasting picture.
By applying the embodiment of the application, the recording and broadcasting picture synthesis instruction is obtained through the recording and broadcasting host; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub pictures, and the size of the main picture is larger than or equal to that of each sub picture; the recording and broadcasting host determines a first video source device where the main picture is located according to the recording and broadcasting picture synthesis instruction, and sends the recording and broadcasting picture synthesis instruction to the first video source device; the first video source equipment determines a second video source equipment where each sub-picture is located according to a recording and broadcasting picture synthesis instruction, acquires the corresponding sub-picture from the second video source equipment, synthesizes the main picture with a plurality of sub-pictures to obtain a recording and broadcasting picture, and sends the recording and broadcasting picture to a recording and broadcasting host; the recording and broadcasting host receives the recording and broadcasting picture and displays the recording and broadcasting picture. According to the method and the device for synthesizing the video recording and playing picture, the main picture is directly obtained through the first video source equipment, picture synthesis is carried out on the main picture and each sub picture, picture quality of the main picture in the video recording and playing picture is improved, and time delay of synthesizing the video recording and playing picture is reduced.
In one embodiment of the present application, a recording and playing picture obtaining module includes:
and the code stream decoding unit is used for pulling the corresponding sub-picture code stream from the second video source device by the first video source device, and decoding the sub-picture code stream to obtain the corresponding sub-picture.
In one embodiment of the present application, a recording and playing picture obtaining module includes:
the main picture acquisition unit is used for acquiring the main picture according to the recorded broadcast size information of the main picture by the first video source equipment;
the sub-picture scaling unit is used for scaling each sub-picture according to the recorded and broadcast size information of each sub-picture by the first video source equipment to obtain a plurality of scaled sub-pictures;
and the recording and broadcasting picture obtaining unit is used for combining the scaled sub-pictures with the main picture according to the recording and broadcasting position information of the main picture in the layout information and the position information of each sub-picture by the first video source equipment to obtain the recording and broadcasting picture.
Example 4
The following are device embodiments of the present application that may be used to perform the method of embodiment 1 of the present application. For details not disclosed in the apparatus embodiments of the present application, please refer to the method in embodiment 1 of the present application.
Referring to fig. 5, the present application further provides an electronic device 300, which may be specifically a computer, a mobile phone, a tablet computer, a video source device, and the like, and in an exemplary embodiment of the present application, the electronic device 300 is a video source device, where the video source device may include: at least one processor 301, at least one memory 302, at least one display, at least one network interface 303, a user interface 304, and at least one communication bus 305.
The user interface 304 is mainly used for providing an input interface for a user, and acquiring data input by the user. Optionally, the user interface may also include a standard wired interface, a wireless interface.
The network interface 303 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), among others.
Wherein a communication bus 305 is used to enable connected communications between these components.
Wherein the processor 301 may include one or more processing cores. The processor uses various interfaces and lines to connect various portions of the overall electronic device, perform various functions of the electronic device, and process data by executing or executing instructions, programs, code sets, or instruction sets stored in memory, and invoking data stored in memory. Alternatively, the processor may be implemented in hardware in at least one of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable Logic Array, PLA). The processor may integrate one or a combination of several of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), and a modem etc. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display layer; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor and may be implemented by a single chip.
The Memory 302 may include a random access Memory (Random Access Memory, RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory includes a non-transitory computer readable medium (non-transitory computer-readable storage medium). The memory may be used to store instructions, programs, code sets, or instruction sets. The memory may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the above-described respective method embodiments, etc.; the storage data area may store data or the like referred to in the above respective method embodiments. The memory may optionally also be at least one storage device located remotely from the aforementioned processor. As shown in fig. 5, an operating system, a network communication module, a user interface module, and an operating application program may be included in a memory as one type of computer storage medium.
The processor may be used to call an application program of the composition method of the recorded broadcast picture stored in the memory, and specifically execute the method steps of the embodiment 1 shown above, and the specific execution process may refer to the specific description shown in embodiment 1, which is not repeated herein.
Example 5
The present application further provides a computer readable storage medium, on which a computer program is stored, where instructions are adapted to be loaded by a processor and execute the method steps of the above-described embodiment 1, and the specific execution process may refer to the specific description shown in the embodiment, which is not repeated herein. The storage medium can be an electronic device such as a personal computer, a notebook computer, a smart phone, a tablet computer and the like.
For the device embodiments, reference is made to the description of the method embodiments for the relevant points, since they essentially correspond to the method embodiments. The above-described apparatus embodiments are merely illustrative, in which components illustrated as separate components may or may not be physically separate, and components shown as units may or may not be physical units, may be located in one place, or may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purposes of the present application. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.
Claims (10)
1. The method for synthesizing the recorded broadcast picture is characterized by comprising the following steps:
the recording and broadcasting host acquires a recording and broadcasting picture synthesis instruction; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub pictures, and the size of the main picture is larger than or equal to that of each sub picture;
the recording and broadcasting host determines a first video source device where the main picture is located according to the recording and broadcasting picture synthesis instruction, and sends the recording and broadcasting picture synthesis instruction to the first video source device;
the first video source equipment determines a second video source equipment where each sub-picture is located according to the recorded broadcast picture synthesis instruction, acquires the corresponding sub-picture from the second video source equipment, synthesizes the main picture with a plurality of sub-pictures to obtain a recorded broadcast picture, and sends the recorded broadcast picture to the recorded broadcast host;
and the recording and broadcasting host receives the recording and broadcasting picture and displays the recording and broadcasting picture.
2. The method for synthesizing a recorded broadcast picture according to claim 1, wherein:
the recording and broadcasting picture synthesis instruction comprises layout information of recording and broadcasting pictures; the layout information comprises recording and broadcasting size information of each sub-picture, recording and broadcasting position information of each sub-picture, recording and broadcasting size information of the main picture and recording and broadcasting position information of the main picture;
the step of synthesizing the main picture and the sub pictures to obtain a recorded broadcast picture comprises the following steps:
the first video source equipment acquires a main picture according to the recorded broadcast size information of the main picture;
the first video source equipment zooms each sub-picture according to the recording and playing size information of each sub-picture to obtain a plurality of zoomed sub-pictures;
and the first video source equipment synthesizes the scaled sub-pictures with the main picture according to the recorded broadcast position information of the main picture and the position information of each sub-picture in the layout information to obtain a recorded broadcast picture.
3. The method for synthesizing a recorded broadcast picture according to claim 1 or 2, wherein:
the step of acquiring the corresponding sub-picture from the second video source device includes:
and the first video source equipment pulls the corresponding sub-picture code stream from the second video source equipment, decodes the sub-picture code stream and obtains the corresponding sub-picture.
4. The method for synthesizing a recorded broadcast picture according to claim 1 or 2, wherein:
the video source device comprises one or more of a teacher camera, a student camera and a multimedia computer.
5. The method for synthesizing the recorded broadcast picture is characterized by comprising the following steps:
obtaining a recording and broadcasting picture synthesis instruction; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub pictures, and the size of the main picture is larger than or equal to that of each sub picture;
determining a first video source device where the main picture is located according to the recording and broadcasting picture synthesis instruction, sending the recording and broadcasting picture synthesis instruction to the first video source device, so that the first video source device determines a second video source device where each sub-picture is located according to the recording and broadcasting picture synthesis instruction, acquiring the corresponding sub-picture from the second video source device, and carrying out picture synthesis on the main picture and a plurality of sub-pictures to obtain a recording and broadcasting picture;
and receiving the recorded broadcast picture sent by the first video source equipment, and displaying the recorded broadcast picture.
6. A recording and broadcasting picture synthesizing device, characterized by comprising:
the instruction acquisition module is used for acquiring a recording and broadcasting picture synthesis instruction by the recording and broadcasting host; the recorded broadcast picture synthesis instruction is used for indicating to synthesize video pictures of a plurality of video source devices; the video picture comprises a main picture and a plurality of sub pictures, and the size of the main picture is larger than or equal to that of each sub picture;
the command sending module is used for determining a first video source device where the main picture is located according to the recording and broadcasting picture synthesis command by the recording and broadcasting host, and sending the recording and broadcasting picture synthesis command to the first video source device;
the recording and broadcasting picture obtaining module is used for determining second video source equipment where each sub-picture is located according to the recording and broadcasting picture synthesizing instruction by the first video source equipment, obtaining the corresponding sub-picture from the second video source equipment, carrying out picture synthesis on the main picture and a plurality of sub-pictures to obtain a recording and broadcasting picture, and sending the recording and broadcasting picture to the recording and broadcasting host;
and the recording and broadcasting picture display module is used for receiving the recording and broadcasting picture by the recording and broadcasting host and displaying the recording and broadcasting picture.
7. The apparatus for synthesizing a recorded broadcast picture according to claim 6, wherein the recorded broadcast picture obtaining module comprises:
and the code stream decoding unit is used for pulling the corresponding sub-picture code stream from the second video source device by the first video source device, and decoding the sub-picture code stream to obtain the corresponding sub-picture.
8. The apparatus for synthesizing a recorded broadcast picture according to claim 6, wherein the recorded broadcast picture obtaining module comprises:
a main picture acquisition unit, configured to acquire a main picture according to recorded broadcast size information of the main picture by the first video source device;
the sub-picture scaling unit is used for scaling each sub-picture according to the recording and playing size information of each sub-picture by the first video source equipment to obtain a plurality of scaled sub-pictures;
and the recording and broadcasting picture obtaining unit is used for combining the scaled sub-pictures with the main picture according to the recording and broadcasting position information of the main picture in the layout information and the position information of each sub-picture by the first video source equipment to obtain a recording and broadcasting picture.
9. An electronic device, comprising: a processor, a memory and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any one of claims 1 to 5 when the computer program is executed.
10. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310085855.8A CN117640858A (en) | 2023-01-16 | 2023-01-16 | Recording and playing picture synthesis method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310085855.8A CN117640858A (en) | 2023-01-16 | 2023-01-16 | Recording and playing picture synthesis method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117640858A true CN117640858A (en) | 2024-03-01 |
Family
ID=90029266
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310085855.8A Pending CN117640858A (en) | 2023-01-16 | 2023-01-16 | Recording and playing picture synthesis method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117640858A (en) |
-
2023
- 2023-01-16 CN CN202310085855.8A patent/CN117640858A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180192063A1 (en) | Method and System for Virtual Reality (VR) Video Transcode By Extracting Residual From Different Resolutions | |
| CN108713322B (en) | Method and apparatus for preparing video content and playing back encoded content | |
| Reyna | The potential of 360-degree videos for teaching, learning and research | |
| CN108063976B (en) | Video processing method and device | |
| CN108965929B (en) | Video information presentation method, video information presentation client and video information presentation device | |
| CN110868625A (en) | Video playing method and device, electronic equipment and storage medium | |
| CN109168026A (en) | Instant video display methods, device, terminal device and storage medium | |
| US8504591B2 (en) | Data generating device and data generating method, and data processing device and data processing method | |
| EP3206408B1 (en) | Encoding device and method, playback device and method, and program | |
| KR20170132098A (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| CN108271044A (en) | A kind of processing method and processing device of information | |
| CN107333164B (en) | Image data processing method and device | |
| CN112399249A (en) | Multimedia file generation method and device, electronic equipment and storage medium | |
| JP2005051703A (en) | Live streaming broadcasting method, live streaming broadcasting apparatus, live streaming broadcasting system, program, recording medium, broadcasting method, and broadcasting apparatus | |
| CN109257587A (en) | A kind of method and device of encoding and decoding video data | |
| KR20160119218A (en) | Sound image playing method and device | |
| CN112367479B (en) | Panoramic video image display method and display equipment | |
| CN110856010A (en) | Video playing method and device, storage medium and electronic equipment | |
| KR100901111B1 (en) | Live-Image Providing System Using Contents of 3D Virtual Space | |
| WO2021241190A1 (en) | Media distribution device, media distribution method, and program | |
| KR101058274B1 (en) | Virtual Reality Image Management System and Method | |
| JP2019149785A (en) | Video conversion device and program | |
| CN113497963A (en) | Video processing method, device and equipment | |
| CN113554904B (en) | Intelligent processing method and system for multi-mode collaborative education | |
| CN107995538B (en) | Video annotation method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |