CN116600070B - Holographic video storage method, device, equipment and storage medium - Google Patents

Holographic video storage method, device, equipment and storage medium Download PDF

Info

Publication number
CN116600070B
CN116600070B CN202310490717.8A CN202310490717A CN116600070B CN 116600070 B CN116600070 B CN 116600070B CN 202310490717 A CN202310490717 A CN 202310490717A CN 116600070 B CN116600070 B CN 116600070B
Authority
CN
China
Prior art keywords
frame
data
video
information
shot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310490717.8A
Other languages
Chinese (zh)
Other versions
CN116600070A (en
Inventor
刘世章
汪昭辰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Chenyuan Technology Information Co ltd
Original Assignee
Qingdao Chenyuan Technology Information Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Chenyuan Technology Information Co ltd filed Critical Qingdao Chenyuan Technology Information Co ltd
Priority to CN202310490717.8A priority Critical patent/CN116600070B/en
Publication of CN116600070A publication Critical patent/CN116600070A/en
Application granted granted Critical
Publication of CN116600070B publication Critical patent/CN116600070B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/172Caching, prefetching or hoarding of files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/1737Details of further file system functions for reducing power consumption or coping with limited storage space, e.g. in mobile devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00Image coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Holo Graphy (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

The application discloses a holographic video storage method, a device, equipment and a storage medium, wherein the method comprises the following steps: when a video storage instruction is received, acquiring data of a holographic video corresponding to an original video, wherein the data comprises summary information, image data, lens information and frame information of the holographic video; encoding the image data to obtain encoded data of the image; respectively converting the summary information, the coded data of the image, the shot information and the frame information of the holographic video into binary data; and constructing a storage file, and sequentially writing binary data of summary information, binary data of image data, binary data of lens information and binary data of frame information into the file to obtain the holographic video file. The application completely saves the lens information, frame information and other data of each frame image of the holographic video, so that each frame image of the holographic video can be positioned at the corresponding position of the original video, and the file only saves the holographic video content, thereby reducing the storage space.

Description

Holographic video storage method, device, equipment and storage medium
Technical Field
The present invention relates to the field of data storage technologies, and in particular, to a method, an apparatus, a device, and a storage medium for storing holographic video.
Background
In the video monitoring system, the monitoring camera and the monitoring network are important components, and along with the development and progress of technology, the imaging quality of the monitoring camera is improved, the performance of the monitoring network is enhanced, so that the video monitoring system is widely used, and an effective means is provided for the fields of traffic supervision, urban security, forest fire prevention, safety production and the like.
With the wide use of video monitoring systems, the number of generated monitoring videos also increases sharply, and in the prior art, all shot monitoring videos need to be stored in a storage system, so that a large amount of storage space is occupied, and the problem of insufficient storage space is easy to occur. If some key frames are extracted for storage, it is difficult to locate the corresponding video frames and shots in the original video according to the extracted key frames, and the problem that the content is lost easily and the video content cannot be stored comprehensively occurs.
Disclosure of Invention
The embodiment of the invention provides a holographic video storage method, device and equipment and a storage medium, which at least solve the technical problem of insufficient storage space caused by storing all original video data in the related technology.
According to an aspect of an embodiment of the present invention, there is provided a method for storing a holographic video, including: when a video storage instruction is received, acquiring data of a holographic video corresponding to an original video, wherein the holographic video is a video representing the original video content, and the data of the holographic video comprises summary information, image data, lens information and frame information of the holographic video; encoding the image data to obtain encoded data of the image; respectively converting the summary information, the coded data of the image, the shot information and the frame information of the holographic video into binary data; constructing a storage file, and sequentially writing binary data of summary information, binary data of image data, binary data of lens information and binary data of frame information into the file to obtain a holographic video file; the data block occupied by binary data of the summary information is used as a file header, the data block occupied by binary data of the image data is used as a frame data area, the data block occupied by binary data of the lens information is used as a lens information table, and the data block occupied by binary data of the frame information is used as a frame information table.
According to another aspect of the embodiment of the present invention, there is also provided a holographic video storage apparatus including: the acquisition module is used for acquiring data of a holographic video corresponding to an original video when receiving a video storage instruction, wherein the holographic video is a video representing the original video content, and the data of the holographic video comprises summary information, image data, lens information and frame information of the holographic video; the image coding module is used for coding the image data to obtain coded data of the image; the data serialization module is used for respectively converting the summary information, the coded data of the image, the lens information and the frame information of the holographic video into binary data; the data storage module is used for constructing a storage file, and sequentially writing binary data of summary information, binary data of image data, binary data of lens information and binary data of frame information into the file to obtain a holographic video file; the data block occupied by binary data of the summary information is called a file header, the data block occupied by binary data of the image data is called a frame data area, the data block occupied by binary data of the shot information is called a shot information table, and the data block occupied by binary data of the frame information is called a frame information table.
According to still another aspect of the embodiments of the present invention, there is also provided an electronic device including a memory in which a computer program is stored, and a processor configured to execute the above-described method of storing a holographic video by the above-described computer program.
According to a further aspect of embodiments of the present invention, there is also provided a computer-readable storage medium having a computer program stored therein, wherein the computer program is configured to perform the above-described holographic video storage method when run.
The technical scheme provided by the embodiment of the application can have the following beneficial effects:
According to the holographic video storage method, when the video storage instruction is received, the holographic video extracted from the original video is stored, the holographic video is concentrated, but the content of the original video can be completely represented, so that the holographic video storage method only stores the holographic video content, the storage space can be greatly reduced, and the problem of insufficient storage space caused by the storage of all frames of the video in the prior art is solved. The application also generates a holographic video format storage file, and the data structure of the storage file comprises a file header, a frame data area, a lens information table and a frame information table. Summary information, image data, shot information, and frame information of the holographic video may be recorded entirely such that each video frame/shot of the holographic video may be located to a corresponding video frame/shot in the original video.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:
FIG. 1 is a schematic illustration of an application environment of an alternative holographic video storage method according to an embodiment of the present invention;
FIG. 2 is a schematic illustration of an application environment of another alternative method of storing holographic video, in accordance with embodiments of the present invention;
FIG. 3 is a flow chart of an alternative method of storing holographic video in accordance with embodiments of the present invention;
FIG. 4 is a schematic diagram of an alternative sequence of content frames according to an embodiment of the invention;
FIG. 5 is a schematic diagram of content frame extraction according to an embodiment of the invention;
FIG. 6 is a schematic diagram of a data structure of a holographic video file according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of an alternative holographic video storage device according to an embodiment of the present invention;
Fig. 8 is a schematic structural view of an alternative electronic device according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
According to an aspect of the embodiment of the present invention, there is provided a method for storing a holographic video, which may be applied, but not limited to, in an application environment as shown in fig. 1, as an alternative implementation manner. The application environment comprises the following steps: a terminal device 102, a network 104 and a server 106 which interact with a user in a man-machine manner. Human-machine interaction can be performed between the user 108 and the terminal device 102, and a holographic video storage application program runs in the terminal device 102. The terminal device 102 includes a man-machine interaction screen 1022, a processor 1024 and a memory 1026. The man-machine interaction screen 1022 is used for displaying a sequence of video frames; the processor 1024 is used to obtain the original video to be processed. The memory 1026 is used for storing the original video to be processed as described above.
In addition, the server 106 includes a database 1062 and a processing engine 1064, where the database 1062 is used to store the video to be processed. The processing engine 1064 is configured to: when a video storage instruction is received, acquiring data of a holographic video corresponding to an original video, wherein the holographic video is video representing the content of the original video, and the data of the holographic video comprises summary information, image data, lens information and frame information of the holographic video; encoding the image data to obtain encoded data of the image; respectively converting the summary information, the coded data of the image, the shot information and the frame information of the holographic video into binary data; constructing a storage file, and sequentially writing binary data of summary information, binary data of image data, binary data of lens information and binary data of frame information into the file to obtain a holographic video file; wherein, the data block occupied by binary data of the summary information is taken as a file header, the data block occupied by binary data of the image data is taken as a frame data area, the data block occupied by binary data of the lens information is taken as a lens information table, and the data block occupied by binary data of the frame information is taken as a frame information table.
In one or more embodiments, the above-described method for storing holographic video according to the present application may be applied to the application environment shown in fig. 2. As shown in fig. 2, a human-machine interaction may be performed between a user 202 and a user device 204. The user device 204 includes a memory 206 and a processor 208. The user device 204 in this embodiment may store the holographic video, but is not limited to, with reference to performing the operations performed by the terminal device 102 described above.
Optionally, the terminal device 102 and the user device 204 include, but are not limited to, a mobile phone, a tablet computer, a notebook computer, a PC, a vehicle-mounted electronic device, a wearable device, and the like, and the network 104 may include, but is not limited to, a wireless network or a wired network. Wherein the wireless network comprises: WIFI and other networks that enable wireless communications. The wired network may include, but is not limited to: wide area network, metropolitan area network, local area network. The server 106 may include, but is not limited to, any hardware device that may perform calculations. The server may be a single server, a server cluster composed of a plurality of servers, or a cloud server. The above is merely an example, and is not limited in any way in the present embodiment.
In the embodiment of the application, the original video is composed of continuous pictures shot by a camera, a fixed time interval is reserved between the pictures during playing, usually 40 milliseconds, the display duration of each picture is also fixed, and the time variation is uniform. But the variation of the picture in the original video is not uniform. For example, a road takes 1 minute of monitoring video in the peak period and the early morning period respectively, and although the video duration is 1 minute, the video content change in the peak period is far greater than the video content change in the early morning period, and even the video in the early morning period may not change except the signal lamp.
Holographic video is a new video generated from changes in the original video content, the changes in the video frames are uniform, and the real temporal changes corresponding to the frames are non-uniform. For example, a road takes 1 minute of monitoring video in the peak period and the early morning period respectively, although the video duration is 1 minute, the video content in the peak period can generate 20-30 seconds of holographic video, and the monitoring video in the early morning period can only generate 1 second of holographic video.
Besides monitoring videos, videos such as movies, television shows and variety programs can also generate holographic videos, the holographic videos concentrate video contents, video shots and content frame information are recorded, and an effective means is provided for quickly browsing the contents of the videos. While each video frame/shot of the holographic video may be located to a corresponding video frame/shot in the original video. The content variation of the original video determines the duration and size of the holographic video, which may be a fraction, or even a few tenths, of the original video.
The following describes in detail a method for storing a holographic video according to an embodiment of the present application with reference to fig. 3, and as shown in fig. 3, the method mainly includes the following steps:
s301, when a video storage instruction is received, acquiring data of a holographic video corresponding to an original video, wherein the holographic video is video representing original video content, and the data of the holographic video comprises summary information, image data, lens information and frame information of the holographic video.
When a video storage instruction is received, a holographic video to be stored is first acquired. In an alternative embodiment, the method for acquiring the holographic video comprises the steps of firstly performing shot segmentation on the original video to obtain shot sequences and shot information. And extracting the content frames corresponding to the shots according to the shot sequences to obtain a content frame sequence.
Fig. 4 is a schematic diagram of an alternative sequence of content frames according to an embodiment of the invention. As shown in fig. 4, the video content is composed of a sequence of consecutive frames, and the sequence of consecutive frames can be divided into a plurality of groups according to the continuity of the video content, and each group of consecutive frame sequence is a shot.
Further, the content frames corresponding to each shot are extracted, and the embodiment of the application selects a small number of frames from the continuous frame sequence of each shot to represent the content of the shot by analyzing the difference of the content in the video shot, wherein the frames are the content frames. The content frames at least comprise the first and the last frames of the shots, and the first and the last frames are also called shot frames, so that the content frames of one shot are more than or equal to 2.
Fig. 5 is a schematic diagram of content frame extraction according to an embodiment of the present invention, as shown in fig. 5, the first frame is the first content frame, and then the 2 nd and 3 rd frames are calculated. And then calculating the difference rates of the 5 th, 6 th and 4 th frames until the difference rate is larger than a preset threshold, and if the difference rates of the 5 th, 6 th and 7 th frames and the first frame are smaller than the preset threshold and the 8 th frame is larger than the preset threshold, the 8 th frame is the third content frame. And by analogy, calculating the content frames in all subframes between all the first frames and all the tail frames. The end frame is selected directly as the last content frame without having to calculate the rate of difference with its previous content frame. The difference rate is the calculated difference rate between two frames of images.
For example, a surveillance video, with few people and few cars during the night, the video frame changes little, and the content frames will be few, for example, only a single number of content frames are extracted within 10 hours. The number of people and vehicles in the daytime is large, the change of people and objects in the video picture is frequent, and the content frames calculated according to the method are much more than those in the evening. Thus, the content frames are guaranteed not to lose all of the content information of the shot video relative to the key frames, as the key frames may lose part of the shot content. Compared with the scheme that each frame of the video is calculated and considered, the selection of the content frames only selects partial video image frames, so that the image calculation amount is greatly reduced on the premise of not losing the content.
Further, the content difference rate and the time difference value between all adjacent two content frames are calculated, interpolation frames and transition frames are generated between the adjacent two content frames according to the content difference rate and the time difference value between the adjacent two content frames, and a holographic frame sequence is formed according to the content frames, the interpolation frames and the transition frames.
All content frames of the video are important components of video holographic content, but holographic video generated by the content frames only has the advantages that the image is not coherent like a slide show, and important content frame pictures can be completely invisible. In order to display the images continuously, the content of the content frames can be seen clearly, interpolation frames and transition frames are generated among the content frames, and the holographic video composed of the content frames, the interpolation frames and the transition frames is obtained.
Specifically, an interpolation frame may be generated between two adjacent content frames where the difference rate between the two adjacent content frames is large and the time difference is short. For example, a nonlinear interpolation algorithm is employed to generate one or more interpolated frames between two adjacent content frames. The specific values of the specific first difference rate threshold and the specific first time period threshold are not particularly limited, and can be set according to actual conditions.
And generating a transition frame between two adjacent content frames when the difference rate between the two adjacent content frames is smaller than or equal to a preset second difference rate threshold value and the time difference value is larger than a preset second period threshold value. The specific transition frame generation method comprises the following steps: dividing two adjacent content frames with the difference rate smaller than or equal to a preset second difference rate threshold value and the time difference larger than the preset second period threshold value into a previous content frame and a next content frame according to time, respectively calculating the difference rates of all video frames in the time periods of the previous content frame and the next content frame and the previous content frame, sequencing all video frames in the time periods according to the sequence of the difference rates from large to small, and generating a transition frame sequence according to the preset number of video frames arranged in front.
According to the steps, the shot and the content frame of the video are obtained through granulating the video, interpolation frames and transition frames are calculated and generated among the content frames with larger content variation on the basis of the shot and the content frames, the holographic video with continuous image content is constructed by the content frames, the interpolation frames and the transition frames, the video content is concentrated, and the video content playing time is shortened without losing the content of the video. After the holographic video is generated, the method also comprises the step of acquiring data of the holographic video, including summary information, image data, lens information and frame information of the holographic video.
S302, encoding the image data to obtain encoded data of the image.
In one embodiment of the application, after the holographic video frame sequence is obtained, the image data needs to be encoded in order to reduce the storage space. Specifically, a video encoder is constructed, and a general video encoding method can be adopted, for example, an h264 encoder, an mpeg4 encoder and the like are used for encoding the image data sequence of the holographic frame, so as to obtain the encoded data of the image.
S303 converts the summary information of the holographic video, the encoded data of the image, the shot information, and the frame information into binary data, respectively.
In the embodiment of the application, the summary information of the holographic video comprises data such as file marks, file version numbers, original video IDs, image widths, image heights, frame image color space IDs, lens numbers, frame numbers, video duration, lens information table offsets, frame information table offsets, image coding IDs and the like of the holographic video.
In the embodiment of the application, the shot information of the holographic video comprises data such as an original shot ID, an original shot serial number, a shot start time, a shot end time, an original shot start time, an original shot end time, a frame number, a shot duration and the like.
In the embodiment of the application, the frame information of the holographic video comprises data such as an original frame ID, a frame serial number, an original lens ID, an original lens serial number, a frame time, an original frame time, a frame type, a frame display duration, a frame data offset, a frame data length and the like. The frame type includes any one of shot frames, content frames of non-shot frames, interpolation frames, and transition frames.
After obtaining the summary information, the coded data of the image, the shot information and the frame information of the holographic video, the summary information, the coded data of the image, the shot information and the frame information are converted into binary data through data serialization processing.
S304, constructing a storage file, and sequentially writing binary data of summary information, binary data of image data, binary data of lens information and binary data of frame information into the file to obtain a holographic video file; wherein, the data block occupied by binary data of the summary information is taken as a file header, the data block occupied by binary data of the image data is taken as a frame data area, the data block occupied by binary data of the lens information is taken as a lens information table, and the data block occupied by binary data of the frame information is taken as a frame information table.
First, a storage file is constructed, and an embodiment of the present application constructs an hcv (Holographic Video ) file from the holographic content of the video. The data structure of the holographic video file is shown in fig. 6, and comprises four parts of a file header, a frame data area, a lens information table and a frame information table.
After the file is defined, sequentially writing binary data of summary information, binary data of image data, binary data of lens information and binary data of frame information into the file to obtain the generated holographic video file. When binary data of summary information is written, the shot information table offset and the frame information table offset are unknown, and can be replaced by 0 first, and after the shot information and the frame information are written, the shot information table offset and the frame information table offset are updated.
Wherein, the data block occupied by binary data of the summary information is taken as a file header, the data block occupied by binary data of the image data is taken as a frame data area, the data block occupied by binary data of the lens information is taken as a lens information table, and the data block occupied by binary data of the frame information is taken as a frame information table.
The file header records the summary information of the holographic video, and the data structure HCVHEADER is shown in the following table:
Field name Type(s) Number of bytes Description of the invention
flag char 4 The hcv file is marked with the content of 'hcv'
version int 4 File version number
vid long 8 Original video ID
fwidth int 4 Image width
fheight int 4 Image height
colorid int 4 Frame image color space ID
scount int 4 Number of lenses
fcount int 4 Frame number
duration long 8 Video duration, microseconds
stpos long 8 Offset of lens information table
ftpos long 8 Frame information table offset
codeid int 4 Image coding ID
The frame data area stores the image data of all frames of the video in sequence, and the offset and the data length of each frame of the image data are recorded in the frame information table.
All the shot information of the video is sequentially stored in the shot information table, and the shot information HCVShot data structure is as follows:
Field name Type(s) Number of bytes Description of the invention
id long 8 Original lens ID
idx int 4 Original lens number
spts long 8 Lens start time, microseconds
epts long 8 Lens end time, microseconds
ospts long 8 Initial shot start time, microseconds
oepts long 8 Time of end of original shot, microseconds
fcount int 4 Frame number
duration long 8 Shot duration, microseconds
All frame information of the video is sequentially stored in the frame information table, and the data structure of the frame information HCVFrame is as follows:
According to this step, a stored holographic video file can be obtained. The embodiment of the application provides a holographic video storage method, which defines a storage file in a hcv format, wherein the data structure of the storage file comprises a file header, a frame data area, a lens information table and a frame information table. The method can completely record the data such as the original shot information, the original frame information, the start-stop time of the original shot and the like corresponding to each frame of the holographic video, so that each video frame/shot of the holographic video can be positioned to the corresponding video frame/shot in the original video. Even if the holographic video file is a condensed of the original video file, the video content is not lost, and the corresponding video frames/shots in the original video can be positioned according to each frame image of the current holographic video. And the application only stores the holographic video content, can greatly reduce the storage space, solve the problem of insufficient storage space caused by storing all frames of the video in the prior art.
According to another aspect of the embodiment of the present invention, there is also provided a holographic video storage apparatus for implementing the above holographic video storage method. As shown in fig. 7, the apparatus includes: an acquisition module 701, an image encoding module 702, a data serialization module 703, a data storage module 704.
The obtaining module 701 is configured to obtain, when receiving a video storage instruction, data of a holographic video corresponding to an original video, where the holographic video is a video representing content of the original video, and the data of the holographic video includes summary information, image data, shot information, and frame information of the holographic video;
an image encoding module 702, configured to encode image data to obtain encoded data of an image;
A data serialization module 703 for converting the summary information of the holographic video, the encoded data of the image, the shot information, and the frame information into binary data, respectively;
The data storage module 704 is configured to construct a storage file, and sequentially write binary data of summary information, binary data of image data, binary data of lens information, and binary data of frame information into the file to obtain a holographic video file; the data block occupied by binary data of the summary information is referred to as a file header, the data block occupied by binary data of the image data is referred to as a frame data area, the data block occupied by binary data of the shot information is referred to as a shot information table, and the data block occupied by binary data of the frame information is referred to as a frame information table.
It should be noted that, when the holographic video storage device provided in the foregoing embodiment performs the holographic video storage method, only the division of the foregoing functional modules is used as an example, in practical application, the foregoing functional allocation may be performed by different functional modules according to needs, that is, the internal structure of the apparatus is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the storage device of the holographic video provided in the above embodiment and the storage method embodiment of the holographic video belong to the same concept, which embody the detailed implementation process and are not described herein again.
According to still another aspect of the embodiment of the present invention, there is also provided an electronic device for implementing the above-mentioned holographic video storage method, which may be a terminal device or a server as shown in fig. 8. The present embodiment is described taking the electronic device as an example. As shown in fig. 8, the electronic device comprises a memory 805 and a processor 803, the memory 805 having stored therein a computer program, the processor 803 being arranged to perform the steps of any of the method embodiments described above by means of the computer program.
Alternatively, in this embodiment, the electronic device may be located in at least one network device of a plurality of network devices of the computer network.
Alternatively, in the present embodiment, the above-described processor may be configured to execute the following steps by a computer program: when a video storage instruction is received, acquiring data of a holographic video corresponding to an original video, wherein the holographic video is video representing the content of the original video, and the data of the holographic video comprises summary information, image data, lens information and frame information of the holographic video; encoding the image data to obtain encoded data of the image; respectively converting the summary information, the coded data of the image, the shot information and the frame information of the holographic video into binary data; constructing a storage file, and sequentially writing binary data of summary information, binary data of image data, binary data of lens information and binary data of frame information into the file to obtain a holographic video file; wherein, the data block occupied by binary data of the summary information is taken as a file header, the data block occupied by binary data of the image data is taken as a frame data area, the data block occupied by binary data of the lens information is taken as a lens information table, and the data block occupied by binary data of the frame information is taken as a frame information table.
Alternatively, it will be understood by those skilled in the art that the structure shown in fig. 8 is only schematic, and the electronic device may be a smart phone (such as an Android Mobile phone, an iOS Mobile phone, etc.), a tablet computer, a palm computer, a Mobile internet device (Mobile INTERNET DEVICES, MID), a PAD, etc. Fig. 8 is not limited to the structure of the electronic device and the electronic apparatus described above. For example, the electronics can also include more or fewer components (e.g., network interfaces, etc.) than shown in fig. 8, or have a different configuration than shown in fig. 8.
The memory 805 may be used to store software programs and modules, such as program instructions/modules corresponding to the method and apparatus for storing a holographic video in the embodiment of the present invention, and the processor 803 executes the software programs and modules stored in the memory 805, thereby performing various functional applications and data processing, that is, implementing the method for storing a holographic video described above. Memory 805 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 805 may further include memory remotely located relative to the processor 803, which may be connected to the terminal through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. The memory 805 may be used for storing information such as holographic video. As an example, as shown in fig. 8, the memory 805 may include, but is not limited to, a capturing module 701, an image encoding module 702, a data serializing module 703, and a data storing module 704 in a storage device including the holographic video. In addition, other module units in the holographic video storage device may be included, but are not limited to, and are not described in detail in this example.
Optionally, the transmission device 804 is configured to receive or transmit data via a network. Specific examples of the network described above may include wired networks and wireless networks. In one example, the transmission device 804 includes a network adapter (Network Interface Controller, NIC) that can connect to other network devices and routers via a network cable to communicate with the internet or a local area network. In one example, the transmission device 804 is a Radio Frequency (RF) module for communicating with the internet wirelessly.
In addition, the electronic device further includes: a display 801 for displaying the above-mentioned holographic video; and a connection bus 802 for connecting the respective module parts in the above-described electronic device.
According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. A processor of a computer device reads the computer instructions from a computer readable storage medium, the processor executing the computer instructions, causing the computer device to perform the above-mentioned method of storing video holograms, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.
Alternatively, in the present embodiment, the above-described computer-readable storage medium may be configured to store a computer program for executing the steps of: when a video storage instruction is received, acquiring data of a holographic video corresponding to an original video, wherein the holographic video is video representing the content of the original video, and the data of the holographic video comprises summary information, image data, lens information and frame information of the holographic video; encoding the image data to obtain encoded data of the image; respectively converting the summary information, the coded data of the image, the shot information and the frame information of the holographic video into binary data; constructing a storage file, and sequentially writing binary data of summary information, binary data of image data, binary data of lens information and binary data of frame information into the file to obtain a holographic video file; wherein, the data block occupied by binary data of the summary information is taken as a file header, the data block occupied by binary data of the image data is taken as a frame data area, the data block occupied by binary data of the lens information is taken as a lens information table, and the data block occupied by binary data of the frame information is taken as a frame information table.
Alternatively, in this embodiment, it will be understood by those skilled in the art that all or part of the steps in the methods of the above embodiments may be performed by a program for instructing a terminal device to execute the steps, where the program may be stored in a computer readable storage medium, and the storage medium may include: flash disk, read-Only Memory (ROM), random-access Memory (Random Access Memory, RAM), magnetic disk or optical disk, etc.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
The integrated units in the above embodiments may be stored in the above-described computer-readable storage medium if implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present invention may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, comprising several instructions for causing one or more computer devices (which may be personal computers, servers or network devices, etc.) to perform all or part of the steps of the method of the various embodiments of the present invention.
In the foregoing embodiments of the present invention, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In several embodiments provided by the present application, it should be understood that the disclosed client may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and are merely a logical functional division, and there may be other manners of dividing the apparatus in actual implementation, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.

Claims (9)

1. A method of storing holographic video, comprising:
When a video storage instruction is received, acquiring data of a holographic video corresponding to an original video, wherein the holographic video is a video representing the original video content, and the data of the holographic video comprises summary information, image data, lens information and frame information of the holographic video; wherein,
Acquiring data of holographic video corresponding to an original video, including:
Performing shot segmentation on the original video to obtain a shot sequence and shot information; extracting a content frame corresponding to the shot according to the shot sequence to obtain a content frame sequence; calculating content difference rates and time differences between all adjacent two content frames, and generating interpolation frames and transition frames between the adjacent two content frames according to the content difference rates and the time differences between the adjacent two content frames; forming a holographic frame sequence according to the content frame, the interpolation frame and the transition frame;
Obtaining the summary information, the image data, the shot information and the frame information according to the holographic frame sequence and the shot information;
the content frames refer to frames representing shot content, and comprise a first frame, a last frame and N intermediate frames, wherein N is a natural number, and the intermediate frames are obtained when the difference rate is larger than a preset threshold value through calculating the difference rate of all sub-frames of a shot except the first frame and the last frame and the previous content frame;
encoding the image data to obtain encoded data of the image;
Respectively converting the summary information, the coded data of the image, the shot information and the frame information of the holographic video into binary data;
Constructing a storage file, and sequentially writing binary data of summary information, binary data of coded data of images, binary data of lens information and binary data of frame information into the file to obtain a holographic video file; the data block occupied by binary data of the summary information is used as a file header, the data block occupied by binary data of the coded data of the image is used as a frame data area, the data block occupied by binary data of the lens information is used as a lens information table, and the data block occupied by binary data of the frame information is used as a frame information table.
2. The method of claim 1, wherein the summary information comprises:
File mark of holographic video, file version number, original video ID, image width, image height, frame image color space ID, number of shots, number of frames, video duration, shot information table offset, frame information table offset, and one or more summary information in image coding ID.
3. The method of claim 1, wherein the shot information comprises:
the shot information includes one or more of an original shot ID, an original shot sequence number, a shot start time, a shot end time, an original shot start time, an original shot end time, a frame number, and a shot duration.
4. The method of claim 1, wherein the frame information comprises:
One or more of an original frame ID, a frame sequence number, an original shot ID, an original shot sequence number, a frame time, an original frame time, a frame type, a frame display duration, a frame data offset, and a frame data length.
5. The method of claim 1, wherein encoding the image data to obtain encoded data for the image comprises:
And constructing a video encoder, and encoding the image data sequence of the holographic frame by using the video encoder to obtain encoded data of the image.
6. The method of claim 4, wherein the step of determining the position of the first electrode is performed,
The frame type includes any one of shot frames, content frames of non-shot frames, interpolation frames, and transition frames.
7. A holographic video storage device, comprising:
The acquisition module is used for acquiring data of a holographic video corresponding to an original video when receiving a video storage instruction, wherein the holographic video is a video representing the original video content, and the data of the holographic video comprises summary information, image data, lens information and frame information of the holographic video; wherein,
Acquiring data of holographic video corresponding to an original video, including:
Performing shot segmentation on the original video to obtain a shot sequence and shot information; extracting a content frame corresponding to the shot according to the shot sequence to obtain a content frame sequence; calculating content difference rates and time differences between all adjacent two content frames, and generating interpolation frames and transition frames between the adjacent two content frames according to the content difference rates and the time differences between the adjacent two content frames; forming a holographic frame sequence according to the content frame, the interpolation frame and the transition frame;
Obtaining the summary information, the image data, the shot information and the frame information according to the holographic frame sequence and the shot information;
the content frames refer to frames representing shot content, and comprise a first frame, a last frame and N intermediate frames, wherein N is a natural number, and the intermediate frames are obtained when the difference rate is larger than a preset threshold value through calculating the difference rate of all sub-frames of a shot except the first frame and the last frame and the previous content frame;
The image coding module is used for coding the image data to obtain coded data of the image;
The data serialization module is used for respectively converting the summary information, the coded data of the image, the lens information and the frame information of the holographic video into binary data;
The data storage module is used for constructing a storage file, and sequentially writing binary data of summary information, binary data of coded data of images, binary data of lens information and binary data of frame information into the file to obtain a holographic video file; the data block occupied by binary data of the summary information is used as a file header, the data block occupied by binary data of the coded data of the image is used as a frame data area, the data block occupied by binary data of the lens information is used as a lens information table, and the data block occupied by binary data of the frame information is used as a frame information table.
8. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method according to any of the claims 1 to 6 by means of the computer program.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored program, wherein the program, when run, performs the method of any one of claims 1 to 6.
CN202310490717.8A 2023-04-28 2023-04-28 Holographic video storage method, device, equipment and storage medium Active CN116600070B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310490717.8A CN116600070B (en) 2023-04-28 2023-04-28 Holographic video storage method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310490717.8A CN116600070B (en) 2023-04-28 2023-04-28 Holographic video storage method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN116600070A CN116600070A (en) 2023-08-15
CN116600070B true CN116600070B (en) 2024-07-02

Family

ID=87610820

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310490717.8A Active CN116600070B (en) 2023-04-28 2023-04-28 Holographic video storage method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116600070B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111193961A (en) * 2018-11-15 2020-05-22 索尼公司 Video editing apparatus and method
CN113938688A (en) * 2021-09-10 2022-01-14 视联动力信息技术股份有限公司 Video processing method and device, terminal equipment and storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101822443B1 (en) * 2016-09-19 2018-01-30 서강대학교산학협력단 Video Abstraction Method and Apparatus using Shot Boundary and caption
CN115022711B (en) * 2022-04-28 2024-05-31 之江实验室 System and method for ordering shot videos in movie scene
CN115022670B (en) * 2022-05-31 2023-09-05 咪咕文化科技有限公司 Video file storage method, video file restoration device, video file storage equipment and storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111193961A (en) * 2018-11-15 2020-05-22 索尼公司 Video editing apparatus and method
CN113938688A (en) * 2021-09-10 2022-01-14 视联动力信息技术股份有限公司 Video processing method and device, terminal equipment and storage medium

Also Published As

Publication number Publication date
CN116600070A (en) 2023-08-15

Similar Documents

Publication Publication Date Title
JP6283108B2 (en) Image processing method and apparatus
CN101273635A (en) Apparatus and method for encoding and decoding multi-view picture using camera parameter, and recording medium storing program for executing the method
CN110636294A (en) Video decoding method and device, and video encoding method and device
CN108063946B (en) Image encoding method and apparatus, storage medium, and electronic apparatus
CN107241585B (en) Video monitoring method and system
CN113596473A (en) Video compression method and device
CN106713940B (en) Video stream storage method, video stream reading method and video stream reading device
CN110650357A (en) Video decoding method and device
CN116600070B (en) Holographic video storage method, device, equipment and storage medium
CN117278776A (en) Multichannel video content real-time comparison method and device, equipment and storage medium
CN115243073B (en) Video processing method, device, equipment and storage medium
CN116489477B (en) Holographic video generation method, device, equipment and storage medium
CN114466202B (en) Mixed reality live broadcast method, apparatus, electronic device and readable storage medium
CN114466224A (en) Video data encoding and decoding method and device, storage medium and electronic equipment
CN112492333B (en) Image generation method and apparatus, cover replacement method, medium, and device
CN112866715B (en) Universal video compression coding system supporting man-machine hybrid intelligence
CN117176979B (en) Method, device, equipment and storage medium for extracting content frames of multi-source heterogeneous video
CN114501060A (en) Live broadcast background switching method and device, storage medium and electronic equipment
US20020051489A1 (en) Image matching method, and image processing apparatus and method using the same
CN109657098B (en) Video fingerprint extraction method and device
CN112333461A (en) Method and device for starting live video
CN113014905A (en) Image frame generation method and device, storage medium and electronic equipment
CN116668632A (en) Holographic video playing method, device, equipment and storage medium
CN110545431A (en) video decoding method and device and video encoding method and device
CN104702895A (en) Video image enhancing system applied to player

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant