CN113794836B

CN113794836B - Bullet time video generation method, device, system, equipment and medium

Info

Publication number: CN113794836B
Application number: CN202111057559.4A
Authority: CN
Inventors: 金友芝
Original assignee: Beijing ByteDance Network Technology Co Ltd
Current assignee: Beijing ByteDance Network Technology Co Ltd
Priority date: 2021-09-09
Filing date: 2021-09-09
Publication date: 2023-10-13
Anticipated expiration: 2041-09-09
Also published as: CN113794836A

Abstract

The embodiment of the disclosure discloses a bullet time video generation method, device, system, equipment and medium, wherein the method is applied to a user side and comprises the following steps: if bullet time video generation operation triggered by a user aiming at a current video frame currently displayed in the free view video is detected, determining a bullet time video generation request according to current video frame identification information corresponding to the current video frame; the bullet time video generation request is sent to a media server, so that the media server determines target video frames corresponding to each bullet time point from video streams under each view angle according to the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to a user side; and playing bullet time videos formed by the received target video frames on a playing interface, so that multi-view video with bullet time effect can be automatically generated, a user does not need to manually switch view angles, and the user watching experience is improved.

Description

Bullet time video generation method, device, system, equipment and medium

Technical Field

The embodiment of the disclosure relates to the internet technology, in particular to a bullet time video generation method, device, system, equipment and medium.

Background

With the rapid development of internet technology and the increasing demand of users, a free view video has been developed so that users can watch videos from different views. However, in the process of watching the video at the free viewing angle, the user can only select to watch the video stream at one viewing angle, and if the user wants to watch the picture change condition at different viewing angles, the user needs to manually and frequently switch the viewing angles, so that the user viewing experience is greatly reduced.

Disclosure of Invention

The embodiment of the disclosure provides a bullet time video generation method, device, system, equipment and medium, so as to automatically generate multi-view video with bullet time effect, without manually switching view angles by a user, enrich video playing effect and promote user viewing experience.

In a first aspect, an embodiment of the present disclosure provides a bullet time video generating method, applied to a user terminal, including:

if bullet time video generation operation triggered by a user aiming at a current video frame currently displayed in the free view video is detected, determining a bullet time video generation request according to current video frame identification information corresponding to the current video frame;

The bullet time video generation request is sent to a media server, so that the media server determines a target video frame corresponding to each bullet time point from a video stream under each view angle according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user side;

and playing bullet time video consisting of each received target video frame on a playing interface.

In a second aspect, an embodiment of the present disclosure further provides a bullet time video generating method, applied to a media server, including:

receiving a bullet time video generation request sent by a user terminal, wherein the bullet time video generation request is determined according to current video frame identification information corresponding to a current video frame when the user terminal detects bullet time video generation operation triggered by a current video frame currently displayed in a free view video;

and determining a target video frame corresponding to each bullet time point from the video stream under each view angle according to the current video frame identification information in the bullet time video generation request, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays bullet time videos formed by the received target video frames on a playing interface.

In a third aspect, an embodiment of the present disclosure further provides a bullet time video generating device, integrated at a user terminal, including:

the bullet time video generation request determining module is used for determining a bullet time video generation request according to the current video frame identification information corresponding to the current video frame if bullet time video generation operation triggered by a user aiming at the current video frame currently displayed in the free view video is detected;

the bullet time video generation request sending module is used for sending the bullet time video generation request to a media server so that the media server can determine a target video frame corresponding to each bullet time point from a video stream under each view according to the current video frame identification information in the bullet time video generation request, and send each target video frame corresponding to each bullet time point to the user side;

and the bullet time video playing module is used for playing bullet time videos formed by the received target video frames on a playing interface.

In a fourth aspect, an embodiment of the present disclosure further provides a bullet time video generating apparatus, integrated in a media server, including:

The bullet time video generation request receiving module is used for receiving a bullet time video generation request sent by a user terminal, wherein the bullet time video generation request is determined according to the current video frame identification information corresponding to the current video frame when the user terminal detects bullet time video generation operation triggered by a current video frame currently displayed in the free view video;

the target video frame sending module is used for determining target video frames corresponding to each bullet time point from the video stream under each view according to the current video frame identification information in the bullet time video generation request, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays bullet time videos formed by the received target video frames on a playing interface.

In a fifth aspect, embodiments of the present disclosure further provide a bullet time video generation system, the system including: a user terminal and a media server;

the user side is used for realizing the bullet time video generation method provided by the first aspect of the disclosure;

the media server is configured to implement a bullet time video generation method as provided in the second aspect of the present disclosure.

In a sixth aspect, embodiments of the present disclosure further provide an electronic device, including:

one or more processors;

a memory for storing one or more programs;

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the bullet time video generation method as described in any of the embodiments of the present disclosure.

In a seventh aspect, the disclosed embodiments also provide a computer readable storage medium having stored thereon a computer program which when executed by a processor implements a bullet time video generation method according to any of the disclosed embodiments.

According to the technical scheme, when the user side detects bullet time video generation operation triggered by a user aiming at the current video frame currently displayed in the free view video, a bullet time video generation request is determined according to the current video frame identification information corresponding to the current video frame, and the bullet time video generation request is sent to the media server. And the media server determines a target video frame corresponding to each bullet time point from the video stream under each view angle according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user side. The user side plays bullet time videos formed by the received target video frames on the playing interface, so that automatic generation of bullet time videos is realized, a user can directly watch multi-view videos with bullet time effects, the user does not need to manually switch view angles, video playing effects are enriched, and user watching experience is improved.

Drawings

The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.

Fig. 1 is a flowchart of a bullet time video generation method according to an embodiment of the present disclosure;

fig. 2 is a flowchart of a bullet time video generating method according to a second embodiment of the present disclosure;

FIG. 3 is an example of a bullet time video generation process in accordance with a second embodiment of the present disclosure;

fig. 4 is a schematic structural diagram of a bullet time video generating apparatus according to a third embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of a bullet time video generating apparatus according to a fourth embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of a bullet time video generating system according to a fifth embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of an electronic device according to a sixth embodiment of the disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.

It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.

It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.

The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

Example 1

Fig. 1 is a flowchart of a bullet time video generation method according to an embodiment of the present disclosure, where the embodiment is applicable to a case of generating a multi-view video with bullet time effect for a free-view video, and particularly, may be used in an application scenario of generating a bullet time video in a live or on-demand free-view video. The method may be performed by a bullet time video generating device, which may be implemented in software and/or hardware, integrated in the user side. As shown in fig. 1, the method specifically includes the following steps:

s110, if bullet time video generation operation triggered by a user aiming at a current video frame currently displayed in the free view video is detected, determining a bullet time video generation request according to current video frame identification information corresponding to the current video frame.

The free view video may be a video shot in real time, i.e., a live video. For example, live video obtained by shooting the same object in real time by using cameras under different view angles. The freeview video may also be a video that has been captured, i.e., an on-demand video. For example, video-on-demand obtained after shooting the same object by using cameras under different view angles in advance is completed. The current video frame may refer to a video frame currently presented on the play interface when the user triggers the bullet time video generation operation. The current video frame may be used to characterize the start play time corresponding to the bullet time video that the user wants to watch. For example, the current playing time corresponding to the current video frame may be used as the first bullet time point of the bullet time video, and the next playing time of the current playing time corresponding to the current video frame may also be used as the first bullet time point of the bullet time video. Each video frame in the freeview video can be uniquely identified by using the identification information so as to distinguish the video frames at different playing moments. For example, the current video frame identification information may be, but is not limited to, a play time stamp or a frame number corresponding to the current video frame. The play time stamp may refer to a play time of the current video frame in the freeview video. The frame number may refer to a play position of the current video frame in the video stream at the current viewing angle.

Specifically, when the user views the video stream at a certain viewing angle on the playing interface of the user side, if the user wants to view the bullet time video corresponding to a certain video frame, the user can pause the video onto the video frame, for example, the user can pause the video to the starting playing time or the about-to-start playing time corresponding to the bullet time video to be generated by dragging the video playing progress or directly clicking the pause mode. The user can trigger bullet time video generation operation in a preset trigger mode on the basis of the current video frame displayed after the video is paused, for example, the user can trigger bullet time video generation operation in a mode of clicking a preset button, so that when the user side detects bullet time video generation operation triggered by the user, a bullet time video generation request is obtained based on the current video frame identification information corresponding to the current displayed current video frame. For example, the user side may generate a bullet time video generation request including a play timestamp corresponding to the current video frame, or generate a bullet time video generation request including a frame number corresponding to the current video frame.

S120, sending the bullet time video generation request to the media server, so that the media server determines a target video frame corresponding to each bullet time point from the video stream under each view angle according to the current video frame identification information in the bullet time video generation request, and sending each target video frame corresponding to each bullet time point to the user side.

Wherein the media server may refer to a background server for storing video streams at each view angle. The bullet time point may refer to the play time in the bullet time video. The number of bullet time points may be equal to the number of viewing angles supported by the freeview video. That is, bullet time points may be in one-to-one correspondence with viewing angles. The target video frame may refer to a video frame that is desired to be presented at a bullet time point. The viewing angles corresponding to the different bullet time points are different, so that the target video frames at the different viewing angles can be displayed at the different bullet time points.

Specifically, the user side sends a bullet time video generation request to the media server, after receiving the bullet time video generation request, the media server can determine, from the video stream corresponding to each view angle, a target video frame corresponding to each bullet time point in the rotation direction of the default view angle based on the current video frame identification information in the bullet time video generation request, and can send each target video frame with different view angles to the user side. For example, the media server may send all the target video frames to the client at one time, or may send each target video frame to the client one by one according to the default rotation direction of the viewing angle.

S130, playing bullet time videos composed of the received target video frames on a playing interface.

Specifically, after receiving all the target video frames issued by the media server at one time, the user side can display each target video frame corresponding to the default view angle rotation direction on the playing interface, namely, play bullet time video with view angle rotation effect; and after receiving one target video frame issued by the media server, displaying the target video frame received in real time on a playing interface, thereby reducing the time for a user to wait for playing bullet time video. The user side can play bullet time videos on the playing interface in a popup window mode, so that a user can directly watch multi-view videos with bullet time effects without manually switching view angles, video playing effects are enriched, automatic generation of bullet time videos is achieved, the user can trigger bullet time video generation operation aiming at video frames at any playing time, bullet time videos corresponding to any video frames can be dynamically generated and played, personalized requirements of the user are met, and viewing experience of the user is greatly improved.

Illustratively, S130 may include: acquiring a target playing speed selected by a user; and playing bullet time video consisting of the received target video frames on a playing interface according to the target playing speed.

The target playing speed may be a speed selected by a user for playing bullet time video. The target playing speed can be the original playing speed of the free view video; the speed of the bullet time video can be higher than the original playing speed so as to play the bullet time video faster and reduce the playing time; but also at a speed less than the original playing speed so as to play the bullet time video slower, so that the user can more clearly view each target video frame.

Specifically, the user may select a target playing speed to be played by clicking a preset button on the playing interface. The user side plays the bullet time video according to the target playing speed selected by the user, so that the personalized requirements of the user can be further met, and the watching experience of the user is further improved.

Based on the above technical solution, as an implementation manner of generating the bullet time video, S130 may include: receiving and caching each target video frame corresponding to the clockwise visual angle rotation direction and each target video frame corresponding to the anticlockwise visual angle rotation direction sent by the media server; if the clockwise watching operation triggered by the user is detected, playing a clockwise bullet time video consisting of target video frames corresponding to the clockwise visual angle rotating direction on a playing interface; and if the anticlockwise watching operation triggered by the user is detected, playing anticlockwise bullet time video consisting of target video frames corresponding to the anticlockwise viewing angle rotation direction on a playing interface.

The clockwise viewing angle rotation direction may mean that all viewing angles are changed in the clockwise direction when playing bullet time video. The counterclockwise viewing angle rotation direction may refer to all viewing angles being changed in a counterclockwise direction when playing bullet time video.

Specifically, after receiving the bullet time video generation request, the media server may determine, from the video stream corresponding to each view angle, a target video frame corresponding to each bullet time point corresponding to the clockwise view angle rotation direction, and determine, from the video stream corresponding to each view angle, a target video frame corresponding to each bullet time point corresponding to the counterclockwise view angle rotation direction, that is, determine two target video frames corresponding to each bullet time point, that is, a target video frame corresponding to the clockwise view angle rotation direction and a target video frame corresponding to the counterclockwise view angle rotation direction, based on the current video frame identification information in the bullet time video generation request. The media server may send each target video frame corresponding to the clockwise view rotation direction and each target video frame corresponding to the counterclockwise view rotation direction to the client. The user side caches each received target video frame corresponding to the rotation directions of the two viewing angles, and detects viewing operation triggered by the user in real time, for example, the user can trigger clockwise viewing operation by clicking a clockwise viewing button or trigger anticlockwise viewing operation by clicking an anticlockwise viewing button. When the clockwise watching operation triggered by the user is detected, each target video frame corresponding to the clockwise visual angle rotating direction, namely the clockwise bullet time video, can be played on the playing interface, so that the user can watch the bullet time video with the clockwise visual angle rotating effect quickly. When the anticlockwise watching operation triggered by the user is detected, each target video frame corresponding to the anticlockwise viewing angle rotating direction, namely anticlockwise bullet time video, can be played on the playing interface, so that the user can watch the bullet time video with the anticlockwise viewing angle rotating effect rapidly. According to the embodiment of the disclosure, the user can be supported to selectively watch bullet time videos in two directions, and the bullet time videos corresponding to the rotation directions of the two visual angles can be played more rapidly by caching the bullet time videos, so that the waiting time of the user is reduced, and the watching experience of the user is further improved.

On the basis of the above aspects, as another implementation manner of generating the bullet time video, the operations of steps S110 and S120 may include: acquiring a target visual angle rotation direction selected by a user, wherein the target visual angle rotation direction comprises a clockwise visual angle rotation direction or a counterclockwise visual angle rotation direction; determining a bullet time video generation request according to current video frame identification information corresponding to the current video frame and the target visual angle rotation direction; and sending the bullet time video generation request to a media server, so that the media server determines target video frames corresponding to each bullet time point from video streams under each view according to the current video frame identification information and the target view rotation direction in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to a user side.

Specifically, when the user triggers the bullet time video generation operation, the user may select a target viewing angle rotation direction that the user wants to watch, i.e., a clockwise viewing angle rotation direction or a counterclockwise viewing angle rotation direction, so that the user side may obtain the target viewing angle rotation direction selected by the user, and may generate a bullet time video generation request including the current video frame identification information and the target viewing angle rotation direction, and send the bullet time video generation request to the media server. Based on the current video frame identification information, the media server determines a target video frame corresponding to each bullet time point corresponding to the target view angle rotation direction from the video stream corresponding to each view angle, and sends each target video frame corresponding to the target view angle rotation direction to the user side. The user side can play each target video frame corresponding to the target visual angle rotation direction on the play interface, so that the user can directly watch bullet time video of the selected target visual angle rotation effect. The media server in the embodiment of the disclosure only needs to issue each target video frame corresponding to the target visual angle rotation direction selected by the user, so that dynamic downloading of bullet time video is realized on the basis of supporting the visual angle rotation direction selectable by the user, the cache space is saved, and the running performance is improved.

Example two

Fig. 2 is a flowchart of a bullet time video generation method according to a second embodiment of the present disclosure, where the present embodiment is applicable to a case of generating a multi-view video with bullet time effect for a free-view video, and particularly, may be used in an application scenario of generating a bullet time video in a live or on-demand free-view video. The method may be performed by a bullet time video generating apparatus, which may be implemented in software and/or hardware, integrated in a media server. As shown in fig. 2, the method specifically includes the following steps:

s210, receiving a bullet time video generation request sent by a user terminal, wherein the bullet time video generation request is determined according to current video frame identification information corresponding to a current video frame when the user terminal detects bullet time video generation operation triggered by a current video frame currently displayed in the free view video.

The media server may refer to a background server for storing video streams corresponding to each view angle.

Specifically, the specific determination process of the bullet time video generation request may be referred to the description related to the above embodiment, and will not be repeated here. The media server may receive a bullet time video generation request including the current video frame identification information sent by the client.

S220, determining target video frames corresponding to each bullet time point from the video stream under each view according to the current video frame identification information in the bullet time video generation request, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays bullet time videos composed of each received target video frame on a playing interface.

The bullet time point may refer to a playing time in the bullet time video. The number of bullet time points may be equal to the number of viewing angles supported by the freeview video. That is, bullet time points may be in one-to-one correspondence with viewing angles. The target video frame may refer to a video frame that is desired to be presented at a bullet time point. The viewing angles corresponding to the different bullet time points are different, so that the target video frames at the different viewing angles can be displayed at the different bullet time points.

Specifically, the media server may parse the bullet time video generation request to obtain current video frame identification information, determine, from the video stream corresponding to each view angle, a target video frame corresponding to each bullet time point in the rotation direction of the default view angle based on the current video frame identification information, and send each target video frame having different view angles to the client. The user side displays each target video frame corresponding to the default view angle rotation direction on the playing interface, namely plays the bullet time video with the view angle rotation effect, so that the user can directly watch the multi-view angle video with the bullet time effect without manually switching the view angle, the video playing effect is enriched, the automatic generation of the bullet time video is realized, the user can trigger bullet time video generation operation aiming at the video frame at any playing time, the bullet time video corresponding to any video frame can be dynamically generated and played, the personalized requirement of the user is met, and the watching experience of the user is greatly improved.

Based on the above technical solution, the determining, in S220, the target video frame corresponding to each bullet time point from the video stream under each view angle according to the current video frame identification information in the bullet time video generation request may include: and determining a viewing angle corresponding to each bullet time point, and determining a target video frame corresponding to the corresponding bullet time point from a video stream under the viewing angle according to the current video frame identification information in the bullet time video generation request.

Specifically, a viewing angle corresponding to each bullet time point may be determined based on the viewing angle rotation direction and all viewing angles supported for viewing. The number of bullet time points may be equal to the number of viewing angles. Different bullet time points correspond to different viewing angles. The viewing angle rotation direction may be a default viewing angle rotation direction set, or may be a target viewing angle rotation direction selected by the user. According to the current video frame identification information in the bullet time video generation request, a target video frame corresponding to a corresponding bullet time point can be determined from video streams under each viewing view angle in turn according to the rotation direction of the viewing angle.

Illustratively, the target video frame corresponding to the first bullet time point may be determined by the following step S210, and the target video frame corresponding to the second bullet time point and the subsequent bullet time points may be determined by the following step S220:

s210, determining a first viewing angle corresponding to the first bullet time point, and determining a first target video frame corresponding to the first bullet time point from a video stream under the first viewing angle according to the current video frame identification information in the bullet time video generation request.

The first bullet time point may refer to a playing start time in the bullet time video. The first viewing angle may refer to the first viewing angle viewed by the user in the bullet time video. The first target video frame may refer to a first target video frame in the bullet time video, i.e., a target video frame corresponding to the first viewing angle. For example, any one of all viewing angles may be taken as a first viewing angle corresponding to a first bullet time point, and a video frame having the same identification information as the current video frame may be determined as a first target video frame from a video stream corresponding to the first viewing angle, so that bullet time video is played from a current playing time corresponding to the current video frame.

Illustratively, determining a first viewing perspective corresponding to the first bullet time point may include: if the visual angle change range corresponding to the free visual angle video is 360 degrees, acquiring a user viewing visual angle when a user triggers bullet time video generation operation, and determining the user viewing visual angle as a first viewing visual angle corresponding to a first bullet time point; if the view angle variation range corresponding to the free view angle video is not 360 degrees, determining the left-most view angle or the right-most view angle as the first view angle corresponding to the first bullet time point.

Specifically, when the visual angle variation range is 360 degrees, the user side can acquire the user viewing visual angle during bullet time video generation operation, namely, the current viewing visual angle corresponding to the current video frame, and send the user viewing visual angle to the media server, so that the media server can acquire the user viewing visual angle, and take the user viewing visual angle as the first viewing visual angle, so that visual angle rotation can be performed from the user viewing visual angle, the corresponding bullet time video can be played, and the playing effect of the bullet time video can be further improved. When the viewing angle variation range is not 360 degrees, for example, the viewing angle variation range is 270 degrees, the media server may use the leftmost or rightmost viewing angle as the first viewing angle, so as to perform viewing angle rotation from the leftmost or rightmost viewing angle, and play the corresponding bullet time video. For example, fig. 3 gives an example of a bullet time video generation process. As shown in fig. 3, the media server stores N video streams corresponding to the aligned N views. When the video watched by the user in the user side is a video stream corresponding to the view angle 2 and the user triggers the bullet time video generating operation for the current video frame currently shown by the video stream (i.e. the user triggering time identified in fig. 3), the media server may determine whether to use the leftmost view angle as the first viewing view angle or the rightmost view angle as the first viewing view angle based on the view angle rotation direction. For example, when the viewing angle rotation direction is the clockwise rotation direction in fig. 3, the leftmost viewing angle (i.e., viewing angle 1) may be taken as the first viewing angle; when the rotation direction of the visual angle is the anticlockwise rotation direction, the rightmost visual angle (namely the visual angle N) can be used as the first viewing angle, so that the rotation effect of the visual angle can be displayed more coherently, and the playing effect of bullet time video is further improved.

Illustratively, determining a first target video frame corresponding to the first bullet time point from the video stream at the first viewing angle according to the current video frame identification information in the bullet time video generation request may include: determining a first video frame which is the same as the current video frame identification information from the video stream at the first viewing angle; and taking the next video frame of the first video frame in the video stream at the first viewing angle as a first target video frame corresponding to the first bullet time point.

Specifically, the media server determines the next video frame with the video frame identical to the current video frame identification information as the first target video frame from the video stream corresponding to the first viewing angle, so that the bullet time video can be played from the next playing time of the current playing time corresponding to the current video frame, and the diversity of bullet time video display can be further improved.

S220, determining a current viewing angle corresponding to the current bullet time point according to the viewing angle rotation direction and the last viewing angle corresponding to the last bullet time point, and determining a current target video frame corresponding to the current bullet time point from the video stream under the current viewing angle according to the identification information of the last target video frame corresponding to the last bullet time point.

Specifically, the viewing angle corresponding to each bullet time point after the first bullet time point may be determined based on the viewing angle corresponding to the last bullet time point according to the viewing angle rotation direction. For example, when the viewing angle rotation direction is the clockwise viewing angle rotation mode, the next viewing angle of the last viewing angle corresponding to the last bullet time point may be taken as the current viewing angle corresponding to the current bullet time point along the viewing angle rotation direction. For example, as shown in fig. 3, when the view angle rotation direction is the clockwise view angle rotation manner, the view angle 2 may be determined as the view angle corresponding to the second bullet time point, the view angle 3 may be determined as the view angle corresponding to the third bullet time point, and so on. When the view angle rotation direction is in a counterclockwise view angle rotation mode, the view angle N-1 can be determined as the view angle corresponding to the second bullet time point, the view angle N-2 can be determined as the view angle corresponding to the third bullet time point, and so on. The target video frame corresponding to each bullet time point after the first bullet time point may be determined based on the target video frame corresponding to the last bullet time point. For example, a next video frame of a video frame identical to the identification information of the previous target video frame may be taken as the current target video frame corresponding to the current bullet time point from the video stream at the current viewing angle corresponding to the current bullet time point. As shown in fig. 3, for the case that the view angle rotation direction is the clockwise view angle rotation direction, the view angle corresponding to the second bullet time point is view angle 2, at this time, from the video stream corresponding to view angle 2, the next video frame of the video frame identical to the identification information of view angle 1 may be taken as the target video frame corresponding to the second bullet time point, and so on, the target video frame corresponding to each bullet time point in the clockwise view angle rotation direction may be determined, so that the clockwise bullet time video from view angle 1 to view angle N may be played. Similarly, a target video frame corresponding to each bullet time point in the counterclockwise view angle rotation direction can be determined, so that a counterclockwise bullet time video from view angle N to view angle 1 can be played.

Based on the above technical solutions, as an implementation manner of generating the bullet time video, S220 may include: determining a target video frame corresponding to each bullet time point in the clockwise view angle rotation direction and a target video frame corresponding to each bullet time point in the anticlockwise view angle rotation direction according to the bullet time video generation request and the video stream under each view angle; and sending each target video frame corresponding to the clockwise visual angle rotation direction and each target video frame corresponding to the anticlockwise visual angle rotation direction to the user side, so that the user side plays the clockwise bullet time video consisting of each target video frame corresponding to the clockwise visual angle rotation direction or the anticlockwise bullet time video consisting of each target video frame corresponding to the anticlockwise visual angle rotation direction on the playing interface based on the watching operation triggered by the user.

Specifically, the determining process of the target video frame corresponding to each bullet time point in the clockwise view rotation direction and the determining process of the target video frame corresponding to each bullet time point in the counterclockwise view rotation direction may refer to the above related descriptions, which are not repeated herein. And the media server sends each target video frame corresponding to the clockwise visual angle rotation direction and each target video frame corresponding to the anticlockwise visual angle rotation direction to the user side. The user side caches each received target video frame corresponding to the two visual angle rotation directions, and detects the watching operation triggered by the user in real time. When the clockwise watching operation triggered by the user is detected, each target video frame corresponding to the clockwise visual angle rotating direction, namely the clockwise bullet time video, can be played on the playing interface, so that the user can watch the bullet time video with the clockwise visual angle rotating effect quickly. When the anticlockwise watching operation triggered by the user is detected, each target video frame corresponding to the anticlockwise viewing angle rotating direction, namely anticlockwise bullet time video, can be played on the playing interface, so that the user can watch the bullet time video with the anticlockwise viewing angle rotating effect rapidly. According to the bullet time video display method and device, the bullet time videos corresponding to the two visual angle rotation directions are sent to the user side, the user can be supported to selectively watch the bullet time videos in the two directions, the user side can play the bullet time videos more rapidly by caching the bullet time videos corresponding to the two visual angle rotation directions, waiting time of the user is reduced, and watching experience of the user is further improved.

On the basis of the above technical solutions, as another implementation manner of generating bullet time video, the bullet time video generation request is determined according to the current video frame identification information corresponding to the current video frame and the target viewing angle rotation direction selected by the user; accordingly, S220 may include: according to the bullet time video generation request and the video stream under each view angle, determining a target video frame corresponding to each bullet time point under the rotation direction of the target view angle, and sending each target video frame corresponding to each bullet time point to the user side, so that the user side plays bullet time videos composed of each received target video frame on a play interface.

Specifically, when the user triggers the bullet time video generation operation, the user may select a target viewing angle rotation direction that the user wants to watch, i.e., a clockwise viewing angle rotation direction or a counterclockwise viewing angle rotation direction, so that the user side may obtain the target viewing angle rotation direction selected by the user, and may generate a bullet time video generation request including the current video frame identification information and the target viewing angle rotation direction, and send the bullet time video generation request to the media server. The media server determines, based on the current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point corresponding to the target view angle rotation direction from the video stream corresponding to each view angle, and the specific determination process can refer to the related description content and is not repeated herein. And the media server sends each target video frame corresponding to the target visual angle rotation direction to the user side. The user side can play each target video frame corresponding to the target visual angle rotation direction on the play interface, so that the user can directly watch bullet time video of the selected target visual angle rotation effect. The media server in the embodiment of the disclosure only needs to issue each target video frame corresponding to the target visual angle rotation direction selected by the user, so that the user side can realize dynamic downloading of bullet time video on the basis of supporting the visual angle rotation direction selectable by the user, the cache space is saved, and the running performance is improved.

The following is an embodiment of a bullet time video generating apparatus provided by an embodiment of the present disclosure, which belongs to the same inventive concept as the bullet time video generating method of the first embodiment, and details which are not described in detail in the embodiment of the bullet time video generating apparatus may refer to the bullet time video generating method provided by the first embodiment.

Example III

Fig. 4 is a schematic structural diagram of a bullet time video generating apparatus according to a third embodiment of the present disclosure, where the present embodiment is applicable to a case of generating a multi-view video with bullet time effect for a free-view video, and particularly, may be used in an application scenario of generating bullet time video in a live or on-demand free-view video. The device is integrated at the user side. As shown in fig. 4, the apparatus specifically includes: a bullet time video generation request determination module 410, a bullet time video generation request transmission module 420, and a bullet time video play module 430.

The bullet time video generation request determining module 410 is configured to determine a bullet time video generation request according to current video frame identification information corresponding to a current video frame if a bullet time video generation operation triggered by a user for a current video frame currently displayed in the freeview video is detected; the bullet time video generation request sending module 420 is configured to send a bullet time video generation request to the media server, so that the media server determines, according to the current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point from the video stream under each view angle, and sends each target video frame corresponding to each bullet time point to the user side; the bullet time video playing module 430 is configured to play bullet time videos composed of the received target video frames on the playing interface.

On the basis of the technical scheme, the current video frame identification information is a playing time stamp or a frame number corresponding to the current video frame.

Based on the above technical solutions, the bullet time video playing module 430 is specifically configured to:

receiving and caching each target video frame corresponding to the clockwise visual angle rotation direction and each target video frame corresponding to the anticlockwise visual angle rotation direction sent by the media server; if the clockwise watching operation triggered by the user is detected, playing a clockwise bullet time video consisting of target video frames corresponding to the clockwise visual angle rotating direction on a playing interface; and if the anticlockwise watching operation triggered by the user is detected, playing anticlockwise bullet time video consisting of target video frames corresponding to the anticlockwise viewing angle rotation direction on a playing interface.

Based on the above technical solutions, the bullet time video generation request determining module 410 and the bullet time video generation request sending module 420 are specifically configured to:

acquiring a target visual angle rotation direction selected by a user, wherein the target visual angle rotation direction comprises a clockwise visual angle rotation direction or a counterclockwise visual angle rotation direction; determining a bullet time video generation request according to current video frame identification information corresponding to the current video frame and the target visual angle rotation direction; and sending the bullet time video generation request to a media server, so that the media server determines target video frames corresponding to each bullet time point from video streams under each view according to the current video frame identification information and the target view rotation direction in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to a user side.

acquiring a target playing speed selected by a user; and playing bullet time video consisting of the received target video frames on a playing interface according to the target playing speed.

The bullet time video generating device provided by the embodiment of the disclosure can execute the bullet time video generating method provided by the first embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of executing the bullet time video generating method.

It should be noted that each unit and module included in the above apparatus are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for convenience of distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

The following is an embodiment of a bullet time video generating apparatus provided by an embodiment of the present disclosure, which belongs to the same inventive concept as the bullet time video generating method of the second embodiment, and details which are not described in detail in the embodiment of the bullet time video generating apparatus may refer to the bullet time video generating method provided by the second embodiment.

Example IV

Fig. 5 is a schematic structural diagram of a bullet time video generating apparatus according to a fourth embodiment of the present disclosure, where the present embodiment is applicable to a case of generating a multi-view video with a bullet time effect for a free-view video, and particularly, may be used in an application scenario of generating a bullet time video in a live or on-demand free-view video. The apparatus is integrated with a media server. As shown in fig. 5, the apparatus specifically includes: a bullet time video generation request receiving module 510 and a target video frame transmitting module 520.

The bullet time video generation request receiving module 510 is configured to receive a bullet time video generation request sent by a user terminal, where the bullet time video generation request is determined according to current video frame identification information corresponding to a current video frame when the user terminal detects bullet time video generation operation triggered by a current video frame currently displayed in the free view video; the target video frame sending module 520 is configured to determine, according to the current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point from the video stream under each view, and send each target video frame corresponding to each bullet time point to the user side, so that the user side plays the bullet time video composed of each received target video frame on the playing interface.

Based on the above technical solution, the target video frame sending module 520 includes: the target video frame determining unit is specifically configured to: and determining a viewing angle corresponding to each bullet time point, and determining a target video frame corresponding to the corresponding bullet time point from a video stream under the viewing angle according to the current video frame identification information in the bullet time video generation request.

On the basis of the above technical solutions, the target video frame determining unit includes:

the first target video frame determining subunit is used for determining a first viewing angle corresponding to the first bullet time point, and determining a first target video frame corresponding to the first bullet time point from a video stream under the first viewing angle according to the current video frame identification information in the bullet time video generation request;

the current target video frame determining subunit is configured to determine a current viewing angle corresponding to a current bullet time point according to a viewing angle rotation direction and a last viewing angle corresponding to a last bullet time point, and determine a current target video frame corresponding to the current bullet time point from a video stream under the current viewing angle according to identification information of the last target video frame corresponding to the last bullet time point.

Based on the above technical solutions, the first target video frame determining subunit is further specifically configured to:

if the visual angle change range corresponding to the free visual angle video is 360 degrees, acquiring a user viewing visual angle when a user triggers bullet time video generation operation, and determining the user viewing visual angle as a first viewing visual angle corresponding to a first bullet time point;

If the view angle variation range corresponding to the free view angle video is not 360 degrees, determining the left-most view angle or the right-most view angle as the first view angle corresponding to the first bullet time point.

determining a first video frame which is the same as the current video frame identification information from the video stream at the first viewing angle; and taking the next video frame of the first video frame in the video stream at the first viewing angle as a first target video frame corresponding to the first bullet time point.

Based on the above technical solutions, the target video frame sending module 520 is specifically configured to:

determining a target video frame corresponding to each bullet time point in the clockwise view angle rotation direction and a target video frame corresponding to each bullet time point in the anticlockwise view angle rotation direction according to the bullet time video generation request and the video stream under each view angle; and sending each target video frame corresponding to the clockwise visual angle rotation direction and each target video frame corresponding to the anticlockwise visual angle rotation direction to the user side, so that the user side plays the clockwise bullet time video consisting of each target video frame corresponding to the clockwise visual angle rotation direction or the anticlockwise bullet time video consisting of each target video frame corresponding to the anticlockwise visual angle rotation direction on the playing interface based on the watching operation triggered by the user.

Based on the technical schemes, the bullet time video generation request is determined according to the current video frame identification information corresponding to the current video frame and the target visual angle rotation direction selected by the user;

accordingly, the target video frame sending module 520 is further specifically configured to:

according to the bullet time video generation request and the video stream under each view angle, determining a target video frame corresponding to each bullet time point under the rotation direction of the target view angle, and sending each target video frame corresponding to each bullet time point to the user side, so that the user side plays bullet time videos composed of each received target video frame on a play interface.

The bullet time video generating device provided by the embodiment of the disclosure can execute the bullet time video generating method provided by the second embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of executing the bullet time video generating method.

Example five

Fig. 6 is a schematic structural diagram of a bullet time video generating system according to a fifth embodiment of the present disclosure. The embodiment is applicable to the case of generating multi-view video with bullet time effect for free-view video, and particularly can be used for generating application scenes of bullet time video in live or on-demand free-view video. As shown in fig. 6, the system includes: a client 610 and a media server 620.

Wherein, the user side 610 may be configured to implement the bullet time video generation method according to the first embodiment of the present disclosure; the media server 620 may be used to implement the bullet time video generation method as provided by embodiment two of the present disclosure.

As an implementation, the working procedure of the bullet time video generating system in the embodiment of the disclosure may be: if the user side 610 detects a bullet time video generation operation triggered by the user for the current video frame currently displayed in the freeview video, the user side determines a bullet time video generation request according to the current video frame identification information corresponding to the current video frame, and sends the bullet time video generation request to the media server 620. The media server 620 determines, from the video stream at each view angle, a target video frame corresponding to each bullet time point in the default view angle rotation direction according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user side 610. The user side 610 plays bullet time videos composed of received target video frames on a playing interface, so that a user can directly watch multi-view videos with bullet time effects without manually switching view angles, video playing effects are enriched, automatic generation of bullet time videos is achieved, the user can trigger bullet time video generation operation aiming at video frames at any playing time, bullet time videos corresponding to any video frames can be dynamically generated and played, personalized requirements of the user are met, and viewing experience of the user is greatly improved.

As another implementation, the working process of the bullet time video generating system in the embodiment of the disclosure may further be: if the user side 610 detects a bullet time video generation operation triggered by the user for the current video frame currently displayed in the freeview video, the user side determines a bullet time video generation request according to the current video frame identification information corresponding to the current video frame, and sends the bullet time video generation request to the media server 620. The media server 620 determines, from the video stream under each view, a target video frame corresponding to each bullet time point in the clockwise view rotation direction and a target video frame corresponding to each bullet time point in the counterclockwise view rotation direction according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to the clockwise view rotation direction and each target video frame corresponding to the counterclockwise view rotation direction to the user side 610. The user side 610 caches each received target video frame corresponding to the two view angle rotation directions, and if a clockwise watching operation triggered by the user is detected, plays a clockwise bullet time video composed of each target video frame corresponding to the clockwise view angle rotation direction on the playing interface; and if the anticlockwise watching operation triggered by the user is detected, playing anticlockwise bullet time video consisting of target video frames corresponding to the anticlockwise viewing angle rotation direction on a playing interface. According to the embodiment of the disclosure, the user can be supported to selectively watch bullet time videos in two directions, and the bullet time videos corresponding to the rotation directions of the two visual angles can be played more rapidly by caching the bullet time videos, so that the waiting time of the user is reduced, and the watching experience of the user is further improved.

As another implementation, the working process of the bullet time video generating system in the embodiment of the disclosure may further be: if the user side 610 detects a bullet time video generation operation triggered by the user for the current video frame currently displayed in the freeview video, the user side obtains the target view rotation direction selected by the user, determines a bullet time video generation request according to the current video frame identification information corresponding to the current video frame and the target view rotation direction, and sends the bullet time video generation request to the media server 620. The media server 620 determines a target video frame corresponding to each bullet time point from the video stream under each view according to the current video frame identification information in the bullet time video generation request and the target view rotation direction, and sends each target video frame corresponding to each bullet time point to the user side 610. The user side 610 may play each target video frame corresponding to the target viewing angle rotation direction on the play interface, so that the user may directly watch the bullet time video of the selected target viewing angle rotation effect. The media server 620 in the embodiment of the present disclosure only needs to issue each target video frame corresponding to the target view angle rotation direction selected by the user, so that dynamic downloading of bullet time video is realized on the basis of supporting the user selectable view angle rotation direction, saving the buffer memory space, and improving the running performance.

In the bullet time video generation system provided in the embodiment of the present disclosure, when detecting a bullet time video generation operation triggered by a user for a current video frame currently displayed in a freeview video, the user side 610 determines a bullet time video generation request according to current video frame identification information corresponding to the current video frame, and sends the bullet time video generation request to the media server 620. The media server 620 determines, according to the current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point from the video stream under each view, and sends each target video frame corresponding to each bullet time point to the user side 610. The user side 610 plays bullet time videos composed of the received target video frames on the playing interface, so that automatic generation of bullet time videos is achieved, a user can directly watch multi-view videos with bullet time effects, the user does not need to manually switch view angles, video playing effects are enriched, and user watching experience is improved.

Example six

Referring now to fig. 7, a schematic diagram of an electronic device (e.g., a client or server in fig. 7) 900 suitable for use in implementing embodiments of the present disclosure is shown. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 7 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.

As shown in fig. 7, the electronic device 900 may include a processing means (e.g., a central processor, a graphics processor, etc.) 901, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 902 or a program loaded from a storage means 908 into a Random Access Memory (RAM) 903. In the RAM 903, various programs and data necessary for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. An input/output (I/O) interface 905 is also connected to the bus 904.

In general, the following devices may be connected to the I/O interface 905: input devices 906 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, and the like; an output device 907 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 908 including, for example, magnetic tape, hard disk, etc.; and a communication device 909. The communication means 909 may allow the electronic device 900 to communicate wirelessly or by wire with other devices to exchange data. While fig. 7 shows an electronic device 900 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.

In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a non-transitory computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 909, or installed from the storage device 908, or installed from the ROM 902. When executed by the processing device 901, performs the above-described functions defined in the methods of the embodiments of the present disclosure.

The electronic device provided by the embodiment of the present disclosure and the bullet time video generating method provided by the above embodiment belong to the same inventive concept, and technical details not described in detail in the embodiment of the present disclosure can be seen in the above embodiment, and the embodiment of the present disclosure has the same beneficial effects as the above embodiment.

Example seven

The presently disclosed embodiments provide a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the bullet time video generation method provided by any of the above embodiments.

It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to:

if bullet time video generation operation triggered by a user aiming at a current video frame currently displayed in the free view video is detected, determining a bullet time video generation request according to current video frame identification information corresponding to the current video frame; the bullet time video generation request is sent to a media server, so that the media server determines target video frames corresponding to each bullet time point from video streams under each view angle according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to a user side; and playing bullet time video consisting of the received target video frames on a playing interface.

Or alternatively, the process may be performed,

receiving a bullet time video generation request sent by a user side, wherein the bullet time video generation request is determined according to current video frame identification information corresponding to a current video frame when the user side detects bullet time video generation operation triggered by the current video frame currently displayed in the free view video; according to the current video frame identification information in the bullet time video generation request, determining target video frames corresponding to each bullet time point from the video stream under each view angle, and sending each target video frame corresponding to each bullet time point to the user side, so that the user side plays bullet time videos composed of each received target video frame on a playing interface.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. Wherein the name of the unit does not constitute a limitation of the unit itself in some cases, for example, the editable content display unit may also be described as an "editing unit".

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, there is provided a bullet time video generation method, applied to a user terminal, the method including:

According to one or more embodiments of the present disclosure, there is provided a bullet time video generating method, applied to a user terminal, the method further including:

optionally, the current video frame identification information is a play time stamp or a frame number corresponding to the current video frame.

optionally, playing the bullet time video composed of each received target video frame on the playing interface includes:

receiving and caching each target video frame corresponding to the clockwise visual angle rotation direction and each target video frame corresponding to the anticlockwise visual angle rotation direction sent by the media server;

if the clockwise watching operation triggered by the user is detected, playing a clockwise bullet time video consisting of all target video frames corresponding to the clockwise visual angle rotating direction on a playing interface;

and if the anticlockwise watching operation triggered by the user is detected, playing anticlockwise bullet time video consisting of target video frames corresponding to the anticlockwise viewing angle rotating direction on a playing interface.

optionally, the bullet time video generation request is determined according to the current video frame identification information corresponding to the current video frame; the bullet time video generation request is sent to a media server, so that the media server determines a target video frame corresponding to each bullet time point from a video stream under each view according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user side, and the method comprises the following steps:

Acquiring a target visual angle rotation direction selected by a user, wherein the target visual angle rotation direction comprises a clockwise visual angle rotation direction or a counterclockwise visual angle rotation direction;

determining a bullet time video generation request according to the current video frame identification information corresponding to the current video frame and the target visual angle rotation direction;

and sending the bullet time video generation request to a media server, so that the media server determines a target video frame corresponding to each bullet time point from a video stream under each view according to the current video frame identification information and the target view rotation direction in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user side.

acquiring a target playing speed selected by a user;

and playing bullet time videos formed by the received target video frames on a playing interface according to the target playing speed.

According to one or more embodiments of the present disclosure, there is provided a bullet time video generation method, applied to a media server, the method including:

According to one or more embodiments of the present disclosure, there is provided a bullet time video generation method, applied to a media server, the method further comprising:

optionally, the determining, according to the current video frame identification information in the bullet time video generation request, the target video frame corresponding to each bullet time point from the video stream under each view angle includes:

And determining a viewing angle corresponding to each bullet time point, and determining a target video frame corresponding to the corresponding bullet time point from a video stream under the viewing angle according to the current video frame identification information in the bullet time video generation request.

optionally, the determining a viewing angle corresponding to each bullet time point, and determining, according to the current video frame identification information in the bullet time video generation request, a target video frame corresponding to the corresponding bullet time point from a video stream under the viewing angle includes:

determining a first viewing angle corresponding to a first bullet time point, and determining a first target video frame corresponding to the first bullet time point from a video stream under the first viewing angle according to the current video frame identification information in the bullet time video generation request;

according to the rotation direction of the visual angle and the last visual angle corresponding to the last bullet time point, determining the current visual angle corresponding to the current bullet time point, and according to the identification information of the last target video frame corresponding to the last bullet time point, determining the current target video frame corresponding to the current bullet time point from the video stream under the current visual angle.

optionally, the determining the first viewing angle corresponding to the first bullet time point includes:

and if the visual angle change range corresponding to the free visual angle video is not 360 degrees, determining the leftmost or rightmost visual angle as a first visual angle corresponding to the first bullet time point.

optionally, the determining, according to the current video frame identification information in the bullet time video generation request, a first target video frame corresponding to a first bullet time point from the video stream under the first viewing angle includes:

Determining a first video frame which is identical to the current video frame identification information from the video stream at the first viewing angle;

and taking the next video frame of the first video frame in the video stream at the first viewing angle as a first target video frame corresponding to a first bullet time point.

optionally, the determining, according to the bullet time video generation request and the video stream under each view angle, a target video frame corresponding to each bullet time point, and sending each target video frame corresponding to each bullet time point to the user side, so that the user side plays the bullet time video composed of each received target video frame on a playing interface, where the method includes:

determining a target video frame corresponding to each bullet time point in the clockwise visual angle rotation direction and a target video frame corresponding to each bullet time point in the anticlockwise visual angle rotation direction according to the bullet time video generation request and the video stream under each visual angle;

And sending each target video frame corresponding to the clockwise visual angle rotation direction and each target video frame corresponding to the anticlockwise visual angle rotation direction to the user side, so that the user side plays a clockwise bullet time video consisting of each target video frame corresponding to the clockwise visual angle rotation direction or an anticlockwise bullet time video consisting of each target video frame corresponding to the anticlockwise visual angle rotation direction on a playing interface based on a watching operation triggered by a user.

optionally, the bullet time video generation request is determined according to the current video frame identification information corresponding to the current video frame and the target visual angle rotation direction selected by the user;

the method for determining the target video frame corresponding to each bullet time point according to the bullet time video generation request and the video stream under each view angle, and sending each target video frame corresponding to each bullet time point to the user side, so that the user side plays bullet time videos composed of each received target video frame on a playing interface, comprises the following steps:

And determining a target video frame corresponding to each bullet time point in the rotation direction of the target visual angle according to the bullet time video generation request and the video stream under each visual angle, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays bullet time videos formed by the received target video frames on a playing interface.

According to one or more embodiments of the present disclosure, there is provided a bullet time video generating apparatus, integrated at a user terminal, the apparatus including:

According to one or more embodiments of the present disclosure, there is provided a bullet time video generating apparatus integrated with a media server, the apparatus comprising:

The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).

Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims

1. The bullet time video generation method is characterized by being applied to a user side and comprising the following steps:

playing bullet time video composed of the received target video frames on a playing interface;

The media server determines a target video frame corresponding to each bullet time point from the video stream under each view according to the current video frame identification information in the bullet time video generation request, and the method comprises the following steps:

determining a first viewing angle corresponding to a first bullet time point, and determining a first video frame identical to the current video frame identification information from a video stream under the first viewing angle;

taking the next video frame of the first video frame in the video stream under the first viewing angle as a first target video frame corresponding to a first bullet time point;

determining a current viewing angle corresponding to a current bullet time point according to the viewing angle rotation direction and a last viewing angle corresponding to a last bullet time point, and determining a current target video frame corresponding to the current bullet time point from a video stream under the current viewing angle according to identification information of a last target video frame corresponding to the last bullet time point; and similarly, determining the target video frame corresponding to each bullet time point in the rotation direction of the visual angle.

2. The method of claim 1, wherein the current video frame identification information is a play time stamp or a frame number corresponding to the current video frame.

3. The method of claim 1, wherein playing the bullet time video comprised of each of the received target video frames on the play interface comprises:

4. The method of claim 1, wherein the determining a bullet time video generation request is based on current video frame identification information corresponding to the current video frame; the bullet time video generation request is sent to a media server, so that the media server determines a target video frame corresponding to each bullet time point from a video stream under each view according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user side, and the method comprises the following steps:

5. The method of claim 1, wherein playing the bullet time video comprised of each of the received target video frames on the play interface comprises:

acquiring a target playing speed selected by a user;

6. The bullet time video generation method is characterized by being applied to a media server and comprising the following steps of:

determining a target video frame corresponding to each bullet time point from a video stream under each view angle according to the current video frame identification information in the bullet time video generation request, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays bullet time videos formed by each received target video frame on a play interface;

the determining, according to the current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point from the video stream under each view angle includes:

7. The method of claim 6, wherein determining the first viewing perspective corresponding to the first bullet time point comprises:

8. The method of claim 6, wherein determining a target video frame corresponding to each bullet time point according to the bullet time video generation request and the video stream under each view, and transmitting each target video frame corresponding to each bullet time point to the user terminal, so that the user terminal plays the bullet time video composed of each received target video frame on a play interface, comprises:

9. The method of claim 6, wherein the bullet time video generation request is determined based on current video frame identification information corresponding to the current video frame and a user-selected target viewing angle rotation direction;

the method includes determining a target video frame corresponding to each bullet time point according to the bullet time video generation request and the video stream under each view angle, and sending each target video frame corresponding to each bullet time point to the user side, so that the user side plays bullet time videos composed of each received target video frame on a playing interface, and the method further includes:

10. The bullet time video generating device is characterized by being integrated at a user side and comprising:

the bullet time video playing module is used for playing bullet time videos formed by the received target video frames on a playing interface;

11. A bullet time video generating device integrated in a media server, comprising:

the target video frame sending module is used for determining target video frames corresponding to each bullet time point from the video stream under each view according to the current video frame identification information in the bullet time video generation request, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays bullet time videos formed by the received target video frames on a playing interface;

12. A bullet time video generation system, the system comprising: the system comprises a user terminal, a media server and a low-delay server;

Wherein, the user side is used for realizing the bullet time video generation method according to any one of claims 1-5;

the media server is adapted to implement the bullet time video generation method of any one of claims 6-9.

13. An electronic device, the electronic device comprising:

one or more processors;

a memory for storing one or more programs;

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the bullet time video generation method of any one of claims 1-9.

14. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when executed by a processor, implements the bullet time video generation method according to any one of claims 1-9.