CN111757138A - Close-up display method and device based on single-shot live video - Google Patents
Close-up display method and device based on single-shot live video Download PDFInfo
- Publication number
- CN111757138A CN111757138A CN202010628774.4A CN202010628774A CN111757138A CN 111757138 A CN111757138 A CN 111757138A CN 202010628774 A CN202010628774 A CN 202010628774A CN 111757138 A CN111757138 A CN 111757138A
- Authority
- CN
- China
- Prior art keywords
- close
- video
- image data
- display
- video image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000015654 memory Effects 0.000 claims description 20
- 238000001514 detection method Methods 0.000 claims description 13
- 230000003044 adaptive effect Effects 0.000 claims description 5
- 230000004044 response Effects 0.000 claims description 5
- 238000009432 framing Methods 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 13
- 239000002609 medium Substances 0.000 description 10
- 230000006870 function Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000012544 monitoring process Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 239000012120 mounting media Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003238 somatosensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The embodiment of the application discloses a close-up display method and device based on a single-shot live video. According to the technical scheme provided by the embodiment of the application, the close-up area selected by the selection operation is determined by responding to the selection operation of the user on the video image data display picture played in real time, and the video image data received in real time is converted into the first close-up video image data based on the close-up area and is output to the video display terminal for displaying; or sending a video acquisition instruction corresponding to the close-up area to the front end, receiving second close-up video image data acquired by the single shot corresponding to the close-up area at the front end, and outputting the second close-up video image data to the video display end for displaying. By adopting the technical means, the corresponding area of the live broadcast picture can be displayed in close-up mode according to the selection of the user, and the playing effect of the live broadcast video is optimized. And the acquisition and playing cost of close-up display of the live video is simplified through close-up display of the single-shot live video.
Description
Technical Field
The embodiment of the application relates to the technical field of video playing, in particular to a close-up display method and device based on single-shot live video.
Background
The playing of the high definition video is generally performed by decoding through a video decoding module and then displaying in a display screen. With the improvement of hardware and software performances such as shooting equipment, encoding and decoding, data transmission and the like, the definition of the corresponding video is higher and higher, for example, high-definition videos with resolutions of 4K, 8K, 16K and above bring better experience for the display of video details. Especially in scenes such as live broadcast in goods, video conference, live broadcast in events, online lessons and the like, better watching experience can be provided through high-definition video acquisition and playing.
However, in the prior art, when playing a high-definition live video, a video of a corresponding scene is generally collected through a lens at a front end and transmitted to a video display end for playing. Because the video display end only displays the collected videos corresponding to the scenes, the video playing and displaying mode is single, the specific details in the videos cannot be displayed, and the ideal playing effect is difficult to achieve. The way of realizing the close-up display of the video playing pictures by additionally arranging the multiple paths of close-up shots increases the video acquisition and playing cost, and the operation of arranging and switching the multiple paths of shots is complicated.
Disclosure of Invention
The embodiment of the application provides a close-up display method and device based on single-shot live video, which can realize close-up display of the single-shot video, optimize video playing effect and save video acquisition and playing cost.
In a first aspect, an embodiment of the present application provides a close-up display method based on a single shot live video, including:
receiving video image data collected by a single lens at the front end, and outputting the video image data to a video display end for displaying;
in response to a user's selection operation of the video image data display screen played in real time, determining a close-up area selected by the selection operation, the close-up area being a partial image area of one frame of the video image data;
converting the video image data received in real time into first special-writing video image data based on the special-writing area and outputting the first special-writing video image data to a video display end for displaying; or sending a video acquisition instruction corresponding to the close-up area to the front end, receiving second close-up video image data acquired by the front end single shot corresponding to the close-up area, and outputting the second close-up video image data to the video display end for displaying.
Further, in response to a user's selection operation of the video image data display screen played in real time, determining a close-up area selected by the selection operation includes:
receiving a selection operation of a user on a display picture of the video image data, and determining a click position of the selection operation on the display picture of the video image data;
determining the close-up area selected by the selection operation according to the click position.
Further, determining the close-up area selected by the selection operation based on the click location comprises:
framing a close-up area on the video image data using a screen frame of a set size centered on the click position.
Further, determining the close-up area selected by the selection operation based on the click location comprises:
and detecting and identifying the image data within the set range of the click position based on a preset close-up target detection model, determining a corresponding close-up target, and selecting the image data of the corresponding close-up target as a close-up area by using a picture frame adaptive box.
Further, converting the video image data received in real time into first close-up video image data based on the close-up area and outputting the first close-up video image data to a video display terminal for displaying, including:
determining a close-up display of the video image data from the close-up region frame-by-frame;
intercepting the close-up display frame by frame to form the first close-up video image data;
and outputting the first close-up video image data to a video display end for displaying.
Further, determining a close-up display of the video image data from the close-up region frame by frame, comprising:
determining a close-up display picture of a position corresponding to the video image data frame by frame according to the position information of the close-up area; alternatively, a close-up display of the video image data is determined frame by frame from the close-up goal contained by the close-up area, the close-up display containing the corresponding close-up goal.
Further, sending video capture instructions corresponding to the close-up area to a front end, comprising:
and determining video acquisition parameters of a single lens at the front end based on the close-up area, and sending the video acquisition parameters and a video acquisition instruction to the front end, wherein the video acquisition parameters comprise lens focus and focal length adjustment parameters.
In a second aspect, an embodiment of the present application provides a close-up display apparatus based on a live single shot video, including:
the panoramic display module is used for receiving video image data collected by a front-end single lens and outputting the video image data to a video display end for display;
a selection module, which is used for responding to the selection operation of the user on the display screen of the video image data, and determining the close-up area selected by the selection operation, wherein the close-up area is a local image area of one frame of the video image data;
the close-up display module is used for converting the video image data received in real time into first close-up video image data based on the close-up area and outputting the first close-up video image data to a video display end for displaying; or sending a video acquisition instruction corresponding to the close-up area to the front end, receiving second close-up video image data acquired by the front end single shot corresponding to the close-up area, and outputting the second close-up video image data to the video display end for displaying.
In a third aspect, an embodiment of the present application provides an electronic device, including:
a memory and one or more processors;
the memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a close-up display method based on a live single shot video as described in the first aspect.
In a fourth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions for performing the close-up display method based on live single shot video as described in the first aspect when executed by a computer processor.
The method comprises the steps that a close-up area selected by selection operation is determined by responding to the selection operation of a user on a video image data display picture played in real time, and the video image data received in real time are converted into first close-up video image data based on the close-up area and output to a video display end for displaying; or sending a video acquisition instruction corresponding to the close-up area to the front end, receiving second close-up video image data acquired by the single shot corresponding to the close-up area at the front end, and outputting the second close-up video image data to the video display end for displaying. By adopting the technical means, the corresponding area of the live broadcast picture can be displayed in close-up mode according to the selection of the user, and the playing effect of the live broadcast video is optimized. And the acquisition and playing cost of close-up display of the live video is simplified through close-up display of the single-shot live video.
Drawings
Fig. 1 is a flowchart of a close-up display method based on a single shot live video according to an embodiment of the present application;
FIG. 2 is a close-up area selection flow chart in accordance with a first embodiment of the present application;
FIG. 3 is a close-up display flow diagram of the first embodiment of the present application;
fig. 4 is a schematic structural diagram of a close-up display device based on a single shot live video according to a second embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to a third embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, specific embodiments of the present application will be described in detail with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some but not all of the relevant portions of the present application are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
The close-up display method based on the single-shot live video aims to convert video image data received in real time into close-up video data through the close-up area selected by a user, or directly controls the front end single shot to acquire corresponding close-up video data according to the close-up area, so that close-up display of a live video display picture is achieved, and the live video playing effect is optimized. Compared with a traditional live video playing mode, the method generally collects corresponding panoramic video images through a single lens at the front end and transmits the panoramic video images to a video display end for displaying. If a part of the close-up pictures need to be displayed, multiple shots must be added for acquiring different close-up video data. Obviously, the way of collecting close-up video data by adopting multiple paths of shots undoubtedly increases the video live broadcast cost. Based on the above, the close-up display method based on the single shot live video is provided, so as to solve the technical problems of single live video mode and high live broadcast cost in the prior art.
The first embodiment is as follows:
fig. 1 is a flowchart of a close-up display method based on a single shot live video according to an embodiment of the present application, where the close-up display method based on a single shot live video provided in this embodiment may be executed by a close-up display device based on a single shot live video, the close-up display device based on a single shot live video may be implemented in a software and/or hardware manner, and the close-up display device based on a single shot live video may be formed by two or more physical entities or may be formed by one physical entity. Generally, the close-up display device based on the single shot live video can be a host server, a live video processing platform and the like.
The following description will be given taking the close-up display apparatus based on a single shot live video as an example of a main body that performs a close-up display method based on a single shot live video. Referring to fig. 1, the close-up display method based on the single shot live video specifically includes:
and S110, receiving video image data collected by a front-end single lens, and outputting the video image data to a video display end for displaying.
The close-up display method based on the single shot live video is mainly applied to live scenes, the live video is collected through a camera at the front end of the live video and is transmitted to the close-up display equipment based on the single shot live video for processing, and the processed video image data are output to a video display end for displaying.
Specifically, when live video acquisition and playing are carried out, live video image data are acquired by shooting in real time through a lens arranged at the front end of the live broadcast. The live video image data may be a video file or a high definition or ultra high definition video corresponding to streaming media (e.g., streaming media in the field of live application), such as high definition video of 4K, 8K, 16K, or more. It will be appreciated that the higher the definition of live video image data, the higher the definition of the subsequent converted close-up video data. Therefore, when the embodiment of the application performs multi-path close-up playing and displaying on the high-definition videos of 4K, 8K, 16K and above, the display effect is relatively good, and the situation that the display picture of the close-up video data is fuzzy and unclear can not be caused.
Further, live video image data acquired based on a single shot at the front end can return to the close-up display device based on the single-shot live video for processing in real time, and the live video image data is output to the video display end for display after being processed (such as video decoding and other operations). When a user needs to perform close-up display on a certain part of content, the user selects the content corresponding to the live video image data to perform close-up display by performing interactive operation with the close-up display equipment based on the single shot live video. The video image data can be live video image data generated in real time in live video scenes such as live delivery, video conference, live event and online lessons. Correspondingly, when close-up display is carried out on live video image data, different close-up display contents are determined according to different actual live video scenes. For example, for a live video scene with goods live broadcast, the contents displayed in close-up are generally required to be goods, so that the looks of the goods can be better known through the live broadcast picture according to the close-up video image data of the goods. For live events, the contents needing to be displayed in close-up mode are all players, some limbs of the players or related articles on the playing field, and the determined close-up video image data can provide better watching experience for users. For the video conference, if a plurality of conference persons are included in the conference, the contents which need to be displayed in close-up mode are all the conference persons, so that the close-up video image data corresponding to all the conference persons are determined, a user watching the video conference at a far end can conveniently select to watch the close-up video image data of the conference persons who are speaking, and the conference key points of the conference persons can be better understood.
In addition, the close-up display method based on the single-shot live video can be applied to the field of intelligent transportation, so that better monitoring and management of traffic vehicles can be realized. Live video image data acquired in real time through a front-end camera is used as monitoring video content, and the live video image data are output to a video display end to be displayed through the one-shot live video-based close-up display device, so that monitoring of traffic vehicles is achieved. Further, when a user needs to check specific details of a certain vehicle or people in the vehicle, the user interacts with the close-up display device based on the single shot live video to determine the content needing close-up display. Therefore, the close-up display equipment based on the single shot live video can output the corresponding close-up video image data to the video display end for display according to the selection of the user, and further achieves the better monitoring and management effect of intelligent traffic.
And S120, responding to the selection operation of the user on the video image data display picture played in real time, and determining the close-up area selected by the selection operation, wherein the close-up area is a local image area of one frame of the video image data.
Illustratively, when a user watches a display screen of live video image data through a video display end, a corresponding area on the display screen is selected through selection operation of the video display end to be displayed in a close-up manner, and the area is defined as a close-up area. The user can implement the selection operation in modes of screen clicking and dragging, direction key clicking, gesture sliding, coordinate input, somatosensory induction, voice instruction, image recognition instruction, mouse control (including a wired mouse, a wireless mouse and a gyroscope mouse), a remote controller, customized control equipment and the like. And uploading interactive information to the close-up display equipment based on the single shot live video based on the selection operation so as to realize the man-machine interaction between the user and the close-up display equipment based on the single shot live video.
It should be noted that, since the live video image data is transmitted to the back-end video display end in real time for display, after the close-up area is determined according to the selection operation of the user, the subsequent video display end further processes the video image data received in real time based on the close-up area to display the close-up area in a close-up manner. And only when the user carries out the man-machine interaction operation again, the video display end can change the close-up display state.
Referring to fig. 2, the selected flow of the close-up area includes:
s1201, receiving a selection operation of a user on a display picture of the video image data, and determining a click position of the selection operation on the display picture of the video image data;
s1202, determining the close-up area selected by the selection operation according to the click position.
Specifically, when the user selects the close-up area, a certain position of the display screen is clicked by a key input device such as a mouse, and the video display terminal determines the corresponding position of the selection operation on the screen, namely the click position of the video image data display screen, based on the selection operation of the user. Further, when determining a close-up area based on this click position, a close-up area is framed on the video image data using a screen frame of a set size centering on the click position. For example, in an intelligent traffic scene, when a user needs to display a monitoring screen displayed in a panoramic manner, the user clicks the position of a certain vehicle on the display screen. Based on the click position, the area of the whole vehicle on the display screen can be framed and selected through the screen frame, so that the close-up area is determined. It should be noted that, in the above embodiment, the close-up area is selected by using a fixed-size frame, so that the resolution of the frame-by-frame close-up video data displayed in the subsequent output is ensured to be the same, and the appearance is not affected. For the use scene with fixed live scenes, a better close-up display effect can be provided.
In one embodiment, when the close-up area is determined based on the click position, the image data within the set range of the click position can be detected and identified based on a preset close-up target detection model, a corresponding close-up target is determined, and the image data of the corresponding close-up target is selected as the close-up area by using the picture frame adaptive box. According to the embodiment of the application, a close-up target detection model is constructed in advance, and corresponding targets are identified according to different use scenes. Taking vehicle recognition as an example, when constructing a close-up target detection model, image data of a large number of close-up targets (namely vehicles) is collected as training samples, and the training samples are input into a target detection network for model training, so that the close-up target detection model is constructed. Thereby, the corresponding close-up target in the live video image data can be determined based on the close-up target detection model. The close-up object detection model may be an object detection model constructed using a network such as FasterR-CNN, YOLOv3, or the like. In the prior art, there are many specific implementation manners for target detection and identification, and the embodiments of the present application are not limited herein. Further, after the vehicle is detected based on the close-up target detection model, the image data corresponding to the close-up target can be selected as the close-up area by using the picture frame adaptive box. When the close-up area is selected using the frame adaptive frame, the size of the frame is adaptively adjusted according to the size of the close-up object on the display screen, so that the close-up object can be completely selected by the frame. And the completeness of the close-up target during close-up display can be guaranteed by adaptively adjusting the size of the picture frame. And a better close-up display effect can be provided for the condition that the live shot is not fixed.
S130, converting the video image data received in real time into first special writing video image data based on the special writing area and outputting the first special writing video image data to a video display end for displaying; or sending a video acquisition instruction corresponding to the close-up area to the front end, receiving second close-up video image data acquired by the front end single shot corresponding to the close-up area, and outputting the second close-up video image data to the video display end for displaying.
Further, based on the close-up area determined in step S120, a close-up display of the corresponding content can be performed according to the close-up area. When converting the video image data received in real time into the first close-up video image data based on the close-up area and outputting the first close-up video image data to the video display terminal for displaying, referring to fig. 3, the close-up display flow includes:
s1301, determining a close-up display picture of the video image data frame by frame according to the close-up area;
s1302, intercepting the close-up display frame by frame to form the first close-up video image data;
and S1303, outputting the first close-up video image data to a video display end for displaying.
Specifically, based on the determined close-up area, for the video image data which needs to be close-up displayed subsequently, close-up video image data is determined according to the close-up area. And taking the close-up area as an intercepting template to intercept a close-up display picture from the live video image data for each frame of live video image data received in real time in the live broadcasting process, and outputting the close-up display picture as close-up video data to a video display end for displaying.
Wherein the close-up display picture of the position corresponding to the video image data can be determined frame by frame according to the position information of the close-up area. It can be understood that, for a use scene with a fixed live view (such as live tape, live video conference), the position of each part of the content on the display screen is relatively fixed, so that the close-up display screen at the corresponding position can be directly determined frame by frame according to the position information of the close-up area.
In one embodiment, a close-up display of the video image data may also be determined from frame to frame as a function of the close-up goal encompassed by the close-up area, the close-up display encompassing a corresponding close-up goal. It will be appreciated that for use scenes where live footage is not fixed (e.g. live sporting events), the content corresponding to the close-up area may change in real time at the location of the live video image data due to the need to follow the associated object to move footage synchronously. Therefore, according to the embodiment of the application, the target close-up targets contained in the close-up area are identified, the video image data received in real time is further compared frame by frame based on the identified close-up targets, the partial area containing the close-up targets is selected as the close-up display picture, and the close-up display picture is output to the video display end as the close-up video data to be displayed. The close-up target recognition comparison may refer to the detection and recognition of the close-up target in step S120, which is not described herein again.
In one embodiment, the video acquisition instruction corresponding to the close-up area is sent to the front end, and the second close-up video image data acquired by the front end single shot corresponding to the close-up area is received and output to the video display end for display. Before that, video acquisition parameters of a front-end single shot are determined based on the close-up area, and the video acquisition parameters and video acquisition instructions are sent to the front end, wherein the video acquisition parameters comprise adjustment parameters of a shot focus and a focal length. And adjusting the focus and the focal length of the front single lens to enable the complete picture of the live video data acquired by the front single lens to correspond to the close-up area, and outputting and displaying the complete picture as close-up video image data. Different from the mode of directly capturing the close-up display picture from the original live-action video image data as the close-up video image data, the embodiment can ensure that the resolution of the subsequently output and displayed close-up video image data is relatively higher by changing the shot shooting parameters, and further optimize the close-up display effect.
For example, in a live broadcast scene, when a user watches live broadcast on a video display terminal, if specific details of a certain commodity on a live broadcast picture need to be checked, a certain commodity is selected through relevant click operation to be displayed in close-up. The close-up display device based on the single shot live video responds to the selection operation of a certain commodity by a user, and determines a close-up area corresponding to the commodity (namely, a close-up target). And further processing live video image data received in real time based on the close-up area, determining the close-up video image data, and further outputting the close-up video image data to a video display end for displaying, so that a user can conveniently check specific details of commodities, the commodity phase can be known through commodity close-up pictures, and the live effect of the commodities is optimized.
In one embodiment, the close-up display device of the single shot live video also determines the content needing close-up display again and switches the display picture of the video display end by receiving the switching instruction of the currently displayed close-up video image data. Illustratively, in a video conference scene, when a user watching a video conference at a far end wants to view close-up video image data of a conference person who is making a speech, the close-up video image data of the conference person is determined to be played and displayed through a relevant selection operation. When the conference speaker changes, in order to more clearly understand the conference content, the user can select the close-up display content again according to the live video image data, re-determine the close-up video image data, and perform close-up display on the conference person who is speaking.
In one embodiment, the user can also trigger a return instruction through interactive operation, and the close-up display device of the single shot live video responds to the return instruction to switch the live picture of the close-up video image data currently being displayed back to the live picture of the whole live video image data for display, so that the user can conveniently view the panoramic live picture.
In the above, by responding to the selection operation of the user on the display picture of the video image data played in real time, the close-up area selected by the selection operation is determined, and the video image data received in real time is converted into the first close-up video image data based on the close-up area and is output to the video display terminal for displaying; or sending a video acquisition instruction corresponding to the close-up area to the front end, receiving second close-up video image data acquired by the single shot corresponding to the close-up area at the front end, and outputting the second close-up video image data to the video display end for displaying. By adopting the technical means, the corresponding area of the live broadcast picture can be displayed in close-up mode according to the selection of the user, and the playing effect of the live broadcast video is optimized. And the acquisition and playing cost of close-up display of the live video is simplified through close-up display of the single-shot live video.
Example two:
on the basis of the foregoing embodiment, fig. 4 is a schematic structural diagram of a close-up display device based on a single-shot live video according to a second embodiment of the present application. Referring to fig. 4, the close-up display apparatus based on a single shot live video provided in this embodiment specifically includes: a panorama display module 21, a selection module 22 and a close-up display module 23.
The panoramic display module 21 is configured to receive video image data acquired by a front-end single lens, and output the video image data to a video display terminal for display;
the selection module 22 is used for responding to the selection operation of the user on the display screen of the video image data, and determining the close-up area selected by the selection operation, wherein the close-up area is a local image area of one frame of the video image data;
the close-up display module 23 is used for converting the video image data received in real time into first close-up video image data based on the close-up area and outputting the first close-up video image data to a video display end for displaying; or sending a video acquisition instruction corresponding to the close-up area to the front end, receiving second close-up video image data acquired by the front end single shot corresponding to the close-up area, and outputting the second close-up video image data to the video display end for displaying.
In the above, by responding to the selection operation of the user on the display picture of the video image data played in real time, the close-up area selected by the selection operation is determined, and the video image data received in real time is converted into the first close-up video image data based on the close-up area and is output to the video display terminal for displaying; or sending a video acquisition instruction corresponding to the close-up area to the front end, receiving second close-up video image data acquired by the single shot corresponding to the close-up area at the front end, and outputting the second close-up video image data to the video display end for displaying. By adopting the technical means, the corresponding area of the live broadcast picture can be displayed in close-up mode according to the selection of the user, and the playing effect of the live broadcast video is optimized. And the acquisition and playing cost of close-up display of the live video is simplified through close-up display of the single-shot live video.
The close-up display device based on the single shot live video provided by the second embodiment of the application can be used for executing the close-up display method based on the single shot live video provided by the first embodiment of the application, and has corresponding functions and beneficial effects.
Example three:
an embodiment of the present application provides an electronic device, and with reference to fig. 5, the electronic device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The number of processors in the electronic device may be one or more, and the number of memories in the electronic device may be one or more. The processor, memory, communication module, input device, and output device of the electronic device may be connected by a bus or other means.
The memory 32 is provided as a computer-readable storage medium for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the close-up display method based on single-shot live video according to any embodiment of the present application (for example, a panorama display module, a selection module, and a close-up display module in a close-up display device based on single-shot live video). The memory can mainly comprise a program storage area and a data storage area, wherein the program storage area can store an operating system and an application program required by at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory may further include memory located remotely from the processor, and these remote memories may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The communication module 33 is used for data transmission.
The processor 31 executes various functional applications and data processing of the device by executing software programs, instructions and modules stored in the memory, namely, the close-up display method based on the live single shot video.
The input device 34 may be used to receive entered numeric or character information and to generate key signal inputs relating to user settings and function controls of the apparatus. The output device 35 may include a display device such as a display screen.
The electronic equipment provided by the embodiment can be used for executing the close-up display method based on the single shot live video provided by the embodiment one, and has corresponding functions and beneficial effects.
Example four:
embodiments of the present application further provide a storage medium containing computer executable instructions, which when executed by a computer processor, perform a close-up display method based on a live single shot video, the close-up display method based on the live single shot video comprising: receiving video image data collected by a single lens at the front end, and outputting the video image data to a video display end for displaying; in response to a user's selection operation of the video image data display screen played in real time, determining a close-up area selected by the selection operation, the close-up area being a partial image area of one frame of the video image data; converting the video image data received in real time into first special-writing video image data based on the special-writing area and outputting the first special-writing video image data to a video display end for displaying; or sending a video acquisition instruction corresponding to the close-up area to the front end, receiving second close-up video image data acquired by the front end single shot corresponding to the close-up area, and outputting the second close-up video image data to the video display end for displaying.
Storage medium-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk, or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Lanbas (Rambus) RAM, etc.; non-volatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network (such as the internet). The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations, e.g., in different computer systems connected by a network. The storage medium may store program instructions (e.g., embodied as a computer program) that are executable by one or more processors.
Of course, the storage medium containing the computer-executable instructions provided in the embodiments of the present application is not limited to the above-mentioned close-up display method based on the single-shot live video, and may also perform related operations in the close-up display method based on the single-shot live video provided in any embodiment of the present application.
The close-up display device, the storage medium, and the electronic device based on the single shot live video provided in the foregoing embodiments may execute the close-up display method based on the single shot live video provided in any embodiment of the present application, and refer to the close-up display method based on the single shot live video provided in any embodiment of the present application without detailed technical details in the foregoing embodiments.
The foregoing is considered as illustrative of the preferred embodiments of the invention and the technical principles employed. The present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the claims.
Claims (10)
1. A close-up display method based on single-shot live video is characterized by comprising the following steps:
receiving video image data collected by a single lens at the front end, and outputting the video image data to a video display end for displaying;
in response to a user's selection operation of the video image data display screen played in real time, determining a close-up area selected by the selection operation, the close-up area being a partial image area of one frame of the video image data;
converting the video image data received in real time into first special-writing video image data based on the special-writing area and outputting the first special-writing video image data to a video display end for displaying; or sending a video acquisition instruction corresponding to the close-up area to the front end, receiving second close-up video image data acquired by the front end single shot corresponding to the close-up area, and outputting the second close-up video image data to the video display end for displaying.
2. The close-up display method based on the live video shot according to claim 1, wherein the determining, in response to a user selection operation on the video image data display screen played in real time, a close-up area selected by the selection operation comprises:
receiving a selection operation of a user on a display picture of the video image data, and determining a click position of the selection operation on the display picture of the video image data;
determining the close-up area selected by the selection operation according to the click position.
3. A close-up display method based on a live single shot video according to claim 2, wherein determining the close-up area selected by the selection operation according to the click position comprises:
framing a close-up area on the video image data using a screen frame of a set size centered on the click position.
4. A close-up display method based on a live single shot video according to claim 2, wherein determining the close-up area selected by the selection operation according to the click position comprises:
and detecting and identifying the image data within the set range of the click position based on a preset close-up target detection model, determining a corresponding close-up target, and selecting the image data of the corresponding close-up target as a close-up area by using a picture frame adaptive box.
5. The close-up display method based on the single-shot live video, according to claim 1, wherein the step of converting the video image data received in real time into first close-up video image data based on the close-up area and outputting the first close-up video image data to a video display terminal for displaying comprises the steps of:
determining a close-up display of the video image data from the close-up region frame-by-frame;
intercepting the close-up display frame by frame to form the first close-up video image data;
and outputting the first close-up video image data to a video display end for displaying.
6. The close-up display method based on the single-shot live video, as claimed in claim 5, wherein the determining the close-up display of the video image data frame by frame according to the close-up area comprises:
determining a close-up display picture of a position corresponding to the video image data frame by frame according to the position information of the close-up area; alternatively, a close-up display of the video image data is determined frame by frame from the close-up goal contained by the close-up area, the close-up display containing the corresponding close-up goal.
7. The close-up display method based on the single-shot live video, as claimed in claim 1, wherein sending the video capture instruction corresponding to the close-up area to the front end comprises:
and determining video acquisition parameters of a single lens at the front end based on the close-up area, and sending the video acquisition parameters and a video acquisition instruction to the front end, wherein the video acquisition parameters comprise lens focus and focal length adjustment parameters.
8. A close-up display device based on a single shot live video, comprising:
the panoramic display module is used for receiving video image data collected by a front-end single lens and outputting the video image data to a video display end for display;
a selection module, which is used for responding to the selection operation of the user on the display screen of the video image data, and determining the close-up area selected by the selection operation, wherein the close-up area is a local image area of one frame of the video image data;
the close-up display module is used for converting the video image data received in real time into first close-up video image data based on the close-up area and outputting the first close-up video image data to a video display end for displaying; or sending a video acquisition instruction corresponding to the close-up area to the front end, receiving second close-up video image data acquired by the front end single shot corresponding to the close-up area, and outputting the second close-up video image data to the video display end for displaying.
9. An electronic device, comprising:
a memory and one or more processors;
the memory for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement a close-up display method based on a live single shot video as recited in any one of claims 1-7.
10. A storage medium containing computer-executable instructions for performing the close-up display method based on live single shot video according to any one of claims 1 to 7 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010628774.4A CN111757138A (en) | 2020-07-02 | 2020-07-02 | Close-up display method and device based on single-shot live video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010628774.4A CN111757138A (en) | 2020-07-02 | 2020-07-02 | Close-up display method and device based on single-shot live video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111757138A true CN111757138A (en) | 2020-10-09 |
Family
ID=72678806
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010628774.4A Pending CN111757138A (en) | 2020-07-02 | 2020-07-02 | Close-up display method and device based on single-shot live video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111757138A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112261424A (en) * | 2020-10-19 | 2021-01-22 | 北京字节跳动网络技术有限公司 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
| CN112653900A (en) * | 2020-12-21 | 2021-04-13 | Oppo广东移动通信有限公司 | Target display method, device and equipment in video live broadcast |
| WO2023231622A1 (en) * | 2022-05-30 | 2023-12-07 | 荣耀终端有限公司 | Video editing method and electronic device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102591366A (en) * | 2012-02-17 | 2012-07-18 | 广州盈可视电子科技有限公司 | Method and device for controlling cloud deck |
| CN104933909A (en) * | 2015-07-03 | 2015-09-23 | 安徽状元郎电子科技有限公司 | A fully intelligent broadcasting instructing system |
| CN106210703A (en) * | 2016-09-08 | 2016-12-07 | 北京美吉克科技发展有限公司 | The utilization of VR environment bust shot camera lens and display packing and system |
| CN106792092A (en) * | 2016-12-19 | 2017-05-31 | 广州虎牙信息科技有限公司 | Live video flow point mirror display control method and its corresponding device |
| CN110234015A (en) * | 2019-05-15 | 2019-09-13 | 广州视源电子科技股份有限公司 | Live broadcast control method and device, storage medium and terminal |
-
2020
- 2020-07-02 CN CN202010628774.4A patent/CN111757138A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102591366A (en) * | 2012-02-17 | 2012-07-18 | 广州盈可视电子科技有限公司 | Method and device for controlling cloud deck |
| CN104933909A (en) * | 2015-07-03 | 2015-09-23 | 安徽状元郎电子科技有限公司 | A fully intelligent broadcasting instructing system |
| CN106210703A (en) * | 2016-09-08 | 2016-12-07 | 北京美吉克科技发展有限公司 | The utilization of VR environment bust shot camera lens and display packing and system |
| CN106792092A (en) * | 2016-12-19 | 2017-05-31 | 广州虎牙信息科技有限公司 | Live video flow point mirror display control method and its corresponding device |
| CN110234015A (en) * | 2019-05-15 | 2019-09-13 | 广州视源电子科技股份有限公司 | Live broadcast control method and device, storage medium and terminal |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112261424A (en) * | 2020-10-19 | 2021-01-22 | 北京字节跳动网络技术有限公司 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
| CN112653900A (en) * | 2020-12-21 | 2021-04-13 | Oppo广东移动通信有限公司 | Target display method, device and equipment in video live broadcast |
| WO2023231622A1 (en) * | 2022-05-30 | 2023-12-07 | 荣耀终端有限公司 | Video editing method and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111698390B (en) | Virtual camera control method and device, and virtual studio implementation method and system | |
| CN110636353B (en) | Display device | |
| CN111757137A (en) | Multi-channel close-up playing method and device based on single-shot live video | |
| CN111757138A (en) | Close-up display method and device based on single-shot live video | |
| US9460351B2 (en) | Image processing apparatus and method using smart glass | |
| CN111669508A (en) | Camera control method and display device | |
| TW201501510A (en) | Method and system for displaying multi-view images and non-transitory computer readable storage medium thereof | |
| CN105828206A (en) | Multi-video on-demand method and device | |
| CN105939497B (en) | Media streaming system and media streaming method | |
| CN114296949A (en) | Virtual reality equipment and high-definition screen capturing method | |
| CN111708383A (en) | Method for adjusting shooting angle of camera and display device | |
| CN112702617A (en) | Caching method and display method of live video page and related equipment | |
| CN109286760B (en) | Entertainment video production method and terminal thereof | |
| CN110933350A (en) | Electronic cloud mirror recording and broadcasting system, method and device | |
| CN112188221B (en) | Play control method, play control device, computer equipment and storage medium | |
| CN111277904B (en) | Video playing control method and device and computing equipment | |
| WO2023174009A1 (en) | Photographic processing method and apparatus based on virtual reality, and electronic device | |
| CN114615556B (en) | Virtual live broadcast enhanced interaction method and device, electronic equipment and storage medium | |
| CN108449362A (en) | Interactive system based on virtual reality imaging | |
| CN115278047A (en) | Shooting method, shooting device, electronic equipment and storage medium | |
| CN112929685A (en) | Interaction method and device for VR live broadcast room, electronic equipment and storage medium | |
| CN111367598B (en) | Method and device for processing action instruction, electronic equipment and computer readable storage medium | |
| CN112887620A (en) | Video shooting method and device and electronic equipment | |
| CN112312147A (en) | Live broadcast control method and device and storage medium | |
| CN112399235A (en) | Method for enhancing photographing effect of camera of smart television and display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201009 |