CN113791735A

CN113791735A - Video data storage method and device, computer equipment and storage medium

Info

Publication number: CN113791735A
Application number: CN202111061100.1A
Authority: CN
Inventors: 夏春秋
Original assignee: Shenzhen Vision Technology Co Ltd
Current assignee: Shenzhen Vision Technology Co Ltd
Priority date: 2021-09-10
Filing date: 2021-09-10
Publication date: 2021-12-14

Abstract

The embodiment of the application belongs to the field of intelligent storage, and relates to a video data storage method, which comprises the following steps: acquiring a file to be uploaded; generating corresponding file data according to the file to be uploaded; judging whether the file to be uploaded is an appendable object or not according to the file data; if the file to be uploaded is judged to be the appendable object, acquiring a storage protocol of file data and an appending mode of the file to be uploaded; dividing a file to be uploaded according to a storage protocol of file data, and generating at least one data block with a storage space not exceeding a threshold value and a corresponding data block identifier; creating a file data storage pool and a data block storage pool; storing the file data into a file data storage pool through a Ceph distributed storage system; and allocating corresponding data block storage pools for data blocks with storage space not exceeding a threshold value according to the data identification. The application also provides a video data storage device, computer equipment and a storage medium. The resources occupied by video storage are reduced.

Description

Video data storage method and device, computer equipment and storage medium

Technical Field

The present application relates to the field of intelligent storage, and in particular, to a video data storage method and apparatus, a computer device, and a storage medium.

Background

With the increasing number of scenes of big data analysis, the requirement of using additional writing in object storage for the data of an archiving type is reflected, for example, the growing big data scenes of live broadcast industry, log analysis and the like realize that the data which needs to be continuously archived/analyzed is stored in a storage server. The standard simple storage service (S3) is stored in an overwriting manner, that is, when a user stores a file with the same name, the back-end storage system deletes the previous data, and then creates a new file again. According to the situation, a service end has to manage a large number of object lists, the situation that the file size is not uniform may occur due to the irregularity of the service, and an extreme situation may be that a massive small file list is maintained.

Disclosure of Invention

An embodiment of the application aims to provide a video data storage method, a video data storage device, a computer device and a storage medium, so that resources occupied by video storage are reduced.

In order to solve the foregoing technical problem, an embodiment of the present application provides a video data storage method, which adopts the following technical solutions:

acquiring a file to be uploaded;

generating corresponding file data according to the file to be uploaded;

judging whether the file to be uploaded is an appendable object or not according to the file data;

if the file to be uploaded is judged to be an appendable object, acquiring a storage protocol of the file data and an appending mode of the file to be uploaded;

dividing the file to be uploaded according to a storage protocol of file data, and generating at least one data block with a storage space not exceeding a threshold value and a corresponding data block identifier;

creating a file data storage pool and a data block storage pool;

storing the file data to the file data storage pool through a Ceph distributed storage system;

and distributing the corresponding data block storage pool for the data blocks of which the storage space does not exceed the threshold according to the data identification.

Further, the step of determining whether the file to be uploaded is an appendable object according to the file data specifically includes:

reading the file data;

matching a file identifier in the file data with a preset identifier, wherein the file identifier is used for indicating a file type, and the preset identifier comprises an appendable identifier and an appendable identifier;

when the file identification is matched with the preset appendable identification, determining that the file to be uploaded is an appendable object;

and when the file identifier is matched with the preset non-appendable identifier, determining that the file to be uploaded is a non-appendable object.

Further, the file data at least includes a file data identification number, and the step of dividing the file to be uploaded according to a storage protocol of the file data and generating at least one data block whose storage space does not exceed a threshold value and a corresponding data identification specifically includes:

if the storage protocol of the file data is a multi-copy protocol, segmenting the file to be uploaded to generate at least one data block with a storage space not exceeding a threshold value;

generating a data block identifier for each data block according to the file data identifier number and the fragment number corresponding to the data block;

or if the storage protocol of the file data is an Erasure Code (EC) protocol, the tail of the file to be uploaded is supplemented until EC is aligned, and a target file to be uploaded is obtained;

dividing the target file to be uploaded into at least one data block with a storage space not exceeding a threshold value;

and generating a data block identifier for each data block according to the file data identifier number and the fragment number corresponding to the data block.

Further, the step of allocating, according to the data identifier, the corresponding data block storage pool for the data block whose storage space does not exceed the threshold specifically includes:

acquiring an identification number of the data block storage pool;

performing hash operation and module taking on the data block identification number through a Ceph distributed storage system to obtain an object identification object _ ID;

performing Hash operation on the identification number of the data block storage Pool through a Ceph distributed storage system to obtain a storage Pool identification Pool _ ID;

merging the Pool _ ID and the object _ ID to obtain a PG _ ID;

and allocating a storage pool for each data block and file data not exceeding the threshold value through the PG _ ID.

Further, after the step of obtaining the file to be uploaded, the method further includes:

defining CGroup hierarchy rules in the storage pool;

judging whether the Ceph distributed storage system process is started or not, if so, loading the CGroup hierarchical rule, and starting the CGroup hierarchical rule of the Ceph distributed storage system process;

judging whether the Ceph distributed storage system process is closed or not, and if the Ceph distributed storage system process is closed, clearing the CGroup hierarchical rule;

and carrying out regulation and control on system resources through the CGroup by mounting a storage pool in the CGgroup so as to allocate resources to the Ceph distributed storage system.

Further, after the step of creating the file data storage pool and the data block storage pool, the method further includes:

when a restart instruction is received, stopping receiving the file to be uploaded through the restart instruction and generating unloading information;

unloading the radosgw mounting point of the Ceph split storage system through the unloading information;

when all the fuse mounting points are unloaded, stopping the file system service of the Ceph distributed storage system and generating redirection information;

redirecting the restart instruction to a restart service to restart the Ceph distributed storage system.

Further, before the step of obtaining the file to be uploaded, the method further includes:

acquiring default deployment parameters of a Ceph distributed storage system component, wherein the default parameters at least comprise an object storage gateway parameter, an interface class parameter, an authentication class parameter, a data segmentation parameter, an object storage unit parameter and a monitoring service parameter;

acquiring a deployment instruction of the Ceph distributed storage system;

acquiring the deployment instruction and the deployment parameter, and generating a corresponding scheduling instruction of the Ceph distributed storage system resource by combining the deployment instruction and the deployment parameter through a fixed format;

calling software package resources and function library resources of the Ceph distributed storage system through the scheduling instruction;

the binary mode of the Ceph distributed storage system is selected for transmission, and the Ceph distributed storage system calls software package resources and function library resources of the Ceph distributed storage system and transmits the software package resources and the function library resources to a target K-UX operating system;

setting environment configuration parameters of the Ceph distributed storage system, and reading the environment configuration parameters through the Ceph distributed storage system;

deploying the environment configuration parameters to the Ceph distributed storage system;

monitoring and judging whether the Ceph distributed storage system resources and the installation state of the Ceph distributed storage system resources are failed in real time;

if the Ceph distributed storage system resource or the Ceph distributed storage system resource fails, resetting installation of the Ceph distributed storage system resource to reinstall installation and deployment of the Ceph distributed storage system.

In order to solve the foregoing technical problem, an embodiment of the present application further provides a video data storage device, which adopts the following technical solutions:

the file acquisition module is used for acquiring a file to be uploaded;

the file data generation module is used for generating corresponding file data according to the file to be uploaded;

the adding judgment module is used for judging whether the file to be uploaded is an addable object or not according to the file data;

the protocol acquisition module is used for acquiring a storage protocol of the file data and an additional mode of the file to be uploaded if the file to be uploaded is judged to be an additional object;

the file segmentation module is used for segmenting the file to be uploaded according to a storage protocol of file data and generating at least one data block with a storage space not exceeding a threshold value and a corresponding data block identifier;

the storage pool creating module is used for creating a file data storage pool and a data block storage pool;

the file data storage module is used for storing the file data into the file data storage pool through a Ceph distributed storage system;

and the data block storage module is used for allocating the corresponding data block storage pool for the data blocks of which the storage space does not exceed the threshold value according to the data identification.

Further, the additional determining module is further configured to:

reading the file data;

Further, the file splitting module is further configured to:

Further, the data block storage module is further configured to:

acquiring an identification number of the data block storage pool;

merging the Pool _ ID and the object _ ID to obtain a PG _ ID;

Further, the video data storage device further includes a rule loading module, and the rule loading module is configured to:

defining CGroup hierarchy rules in the storage pool;

Further, the video data storage device further comprises a restart module, and the restart module is configured to:

Further, the video data storage apparatus further includes a deployment module, where the deployment module is configured to:

acquiring a deployment instruction of the Ceph distributed storage system;

In order to solve the above technical problem, an embodiment of the present application further provides a computer device, which adopts the following technical solutions:

a computer device comprising at least one connected processor, a memory, and an input/output unit, wherein the memory is used for storing computer readable instructions, and the processor is used for calling the computer readable instructions in the memory to execute the steps of the video data storage method.

In order to solve the above technical problem, an embodiment of the present application further provides a computer-readable storage medium, which adopts the following technical solutions:

a computer readable storage medium having computer readable instructions stored thereon, which when executed by a processor, implement the steps of the video data storage method described above.

Compared with the prior art, the embodiment of the application mainly has the following beneficial effects:

when a file is written, storing existing metadata information through a Ceph distributed storage system, quickly finding the position of the tail part of the data, filling the data to the current position, obtaining a storage pool storage protocol of the data block, cutting the remaining data into 1 or more data blocks according to the fragmentation rule according to the storage pool protocol, storing the data blocks at the rear end, and then storing the metadata of the position information of the written data to disperse the storage of the data, thereby improving the reading and writing efficiency of the data and increasing the reliability of the data. The standard object storage is that each uploading covers the last data, and the constraint that additional writing subverts the data is that the data can be spliced with the historical data by refilling and organizing the data in a mode of increasing operation types and additional positions and the like.

Drawings

In order to more clearly illustrate the solution of the present application, the drawings needed for describing the embodiments of the present application will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and that other drawings can be obtained by those skilled in the art without inventive effort.

FIG. 1 is an exemplary system architecture diagram in which the present application may be applied;

FIG. 2-1 is a flow diagram of one embodiment of a video data storage method according to the present application;

FIG. 2-2 is a flow chart of a multiple copy protocol of a video data storage method according to the present application;

FIGS. 2-3 are flow diagrams of erasure coding protocols for video data storage methods according to the present application;

FIG. 3 is a schematic block diagram of one embodiment of a video data storage device according to the present application;

FIG. 4 is a schematic block diagram of one embodiment of a computer device according to the present application.

Detailed Description

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs; the terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application; the terms "including" and "having," and any variations thereof, in the description and claims of this application and the description of the above figures are intended to cover non-exclusive inclusions. The terms "first," "second," and the like in the description and claims of this application or in the above-described drawings are used for distinguishing between different objects and not for describing a particular order.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

As shown in fig. 1, the system architecture 100 may include

terminal devices

101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the

terminal devices

101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The user may use the

terminal devices

101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. The

terminal devices

101, 102, 103 may have various communication client applications installed thereon, such as a web browser application, a shopping application, a search application, an instant messaging tool, a mailbox client, social platform software, and the like.

The

terminal devices

101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III, mpeg compression standard Audio Layer 3), MP4 players (Moving Picture Experts Group Audio Layer IV, mpeg compression standard Audio Layer 4), laptop portable computers, desktop computers, and the like.

The server 105 may be a server providing various services, such as a background server providing support for pages displayed on the

terminal devices

101, 102, 103.

It should be noted that the video data storage method provided by the embodiment of the present application is generally executed by a server/terminal device, and accordingly, the video data storage apparatus is generally disposed in the server/terminal device.

It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

With continuing reference to FIG. 2, a flow diagram of one embodiment of a method of video data storage is shown, in accordance with the present application. The video data storage method comprises the following steps:

step 201, obtaining a file to be uploaded.

In this embodiment, an upper threshold and a lower threshold are set, and if the accessed frequency of the file to be uploaded is higher than the upper threshold according to real-time statistics, the file to be uploaded is judged to be high-frequency data; if the accessed frequency of the file to be uploaded is lower than the lower limit data threshold value according to real-time statistics, the file to be uploaded is judged to be low-frequency data; and if the accessed frequency of the file to be uploaded is between the lower limit data threshold value and the upper limit threshold value according to real-time statistics, determining the file to be uploaded as intermediate frequency data.

Step 202, generating corresponding file data according to the file to be uploaded.

In this embodiment, the file data includes at least storage pool protocol, object identifier I D number, storage pool I D number, bucket name, file type of file to be uploaded, check code, and password.

Step 203, determining whether the file to be uploaded is an appendable object according to the file data.

In this embodiment, it is determined whether or not the write request and the addition method are to be added, and if the write request and the addition method are to be added, the normal upload mode is adopted for direct storage. If the flow is the additional writing flow, the meta information of the object with the additional writing existing at the storage back end is obtained, and the meta information contains the position of the current additional (namely the size of the current object, and the additional writing is uniformly required to be added from the tail part of the object) and the rule of the fragmentation of the object in the back-end storage.

Step 204, if it is determined that the file to be uploaded is an appendable object, acquiring a storage protocol of the file data and an appending mode of the file to be uploaded.

In this embodiment, the addition policy includes two modes, where two modes are added according to the specified position and the addition is performed without specifying the position, and if the mode is added according to the specified position, it is necessary to determine whether the added position is at the end of the file. And for a pattern whose position is not specified, the pattern may be added to the end.

Step 205, dividing the file to be uploaded according to a storage protocol of file data, and generating at least one data block with a storage space not exceeding a threshold value and a corresponding data block identifier.

In this embodiment, when a file to be uploaded is received, a storage pool storage protocol set for the bucket by the acquisition cluster is used. And if the file to be uploaded is judged to be an appendable object, the server acquires a storage pool storage protocol of the metadata and an appending mode of the file to be uploaded. The storage pool storage protocol comprises a multi-copy protocol and an erasure code protocol, and the appending mode comprises the appending of a specified position and the appending of a non-specified position.

At step 206, a file data storage pool and a data block storage pool are created.

In this embodiment, the server creates a file data storage pool and a data chunk storage pool. The file data storage pool is used to store metadata. The data block storage pool is used for storing data blocks.

And step 207, storing the file data into the file data storage pool through the Ceph distributed storage system.

In this embodiment, when the user invokes the metadata, the metadata is provided to the user by invoking the metadata found in the metadata storage pool, so that the metadata can be saved in the disk space.

And step 208, allocating corresponding data block storage pools for the data blocks of which the storage spaces do not exceed a threshold according to the data identification.

In this embodiment, for example, taking a live broadcast room in a live video scene as an example, when live broadcast data is to be sent to a user, data with a certain duration (taking 1 minute video data as an example) is put into an object storage. Under the scene of common object storage, each data uploading covers historical data, so that the live broadcast platform needs to perform listing and file management on a plurality of files in the live broadcast room to prevent the loss of the files. Assuming that the anchor broadcasts the live broadcast for 6 hours, in the conventional method, the number of times of uploading the file by the anchor reaches 6 × 60 to 360 times, that is, 360 files are generated by the secondary broadcast, and a large number of anchor broadcasts of a live broadcast platform are added for a long time, so that the files can be in the billions level. Through the implementation mode, continuous uploading of the same file name can be completed, namely, only one file is generated by one anchor in one live broadcast time, and the generated file is continuously added after the same file every time. After the live broadcast is finished, when a user needs to play a video at a certain specific time point, the video is converted into the position of the corresponding file through the progress bar, so that the user can quickly read the file.

In this embodiment, when a file is written, the existing metadata information is stored through the Ceph distributed storage system, the position of the tail of the data is quickly found, the data is filled to the current position, the storage pool storage protocol of the data block is obtained, the remaining data is cut into 1 or more data blocks according to the fragmentation rule according to the storage pool protocol and stored in the back end, and then the metadata of the position information of the written data is stored to disperse the storage of the data, improve the read-write efficiency of the data, and increase the reliability of the data. The standard object storage is that each uploading covers the last data, and the constraint that additional writing subverts the data is that the data can be spliced with the historical data by refilling and organizing the data in a mode of increasing operation types and additional positions and the like.

In some optional implementation manners, the step of determining whether the file to be uploaded is an appendable object according to the file data specifically includes:

reading the file data;

In the above embodiment, it is determined whether or not the write request and the addition method are to be added, and if the write request and the addition method are to be added, the normal upload mode is adopted for direct storage. If the flow is the additional writing flow, the meta information of the object with the additional writing existing at the storage back end is obtained, and the meta information contains the position of the current additional (namely the size of the current object, and the additional writing is uniformly required to be added from the tail part of the object) and the rule of the fragmentation of the object in the back-end storage.

In some optional implementation manners, the file data at least includes a file data identification number, and the step of segmenting the file to be uploaded according to a storage protocol of the file data and generating at least one data block whose storage space does not exceed a threshold and a corresponding data identification specifically includes:

In the above embodiment, the multiple copy modes are: when a file is written, the existing meta-information is stored, the strip at the tail part is found, the data is filled into the current strip, if the remaining data is cut into 1 or more strips according to the slicing rule of the strip, the strips are stored in the rear end, and then the meta-data of the position information of the written data is stored, so that the data can be read and added subsequently. As shown in fig. 2-2, for example: the data added and written three times into the My _ object.data are 4M, 12.2M and 7.8M respectively, and 5 strips will be stored at the back end. The erasure code pattern is: erasure code mode differentiation requires zero padding at the tail stripe of each IO as compared to multi-copy mode, since the EC protocol requires stripe alignment, otherwise data overwrite problems can occur. Therefore, the EC redundancy ratio in the storage pool is calculated to the number of bytes needing zero padding, and the tail zero padding is stored in the back-end storage. The principle of reading and writing data is consistent with multiple copies. As shown in fig. 2-3.

In some optional implementations, the allocating, according to the data identifier, the data block whose storage space does not exceed the threshold value to the corresponding data block storage pool specifically includes:

acquiring an identification number of the data block storage pool;

merging the Pool _ ID and the object _ ID to obtain a PG _ ID;

In the above embodiment, one storage pool is automatically generated, for example, by a command of ceph osd pool create ssd-pool 10241024.

The mathematical expression of PG _ ID is as follows:

store identification PG _ ID ═ hash (Pool _ ID) + hash (object _ ID number)% PG _ number

If a certain data block needs to be called, and the disk space of the storage pool where the data block needs to be called is to be found, finding the OSD is carried out through the following formula:

the disk space ID (OSD _ ID) is "reush" (PG _ ID, CLUSTER _ MAP, CURSH _ RULES).

In some optional implementation manners, after the step of obtaining the file to be uploaded, the method further includes:

defining CGroup hierarchy rules in the storage pool;

In the above embodiment, the CGroup refers to control groups, and the CGroup may configure the allocation of physical resources, such as CPU utilization, memory usage, and disk IO rate;

in some optional implementations, after the step of creating the file data storage pool and the data block storage pool, the method further includes:

In the above embodiment, when a problem is detected at the mounting point in Ceph, the activation is stopped, and the plurality of services of Ceph are terminated and the operation is shifted to the restart.

In some optional implementations, before the step of obtaining the file to be uploaded, the method further includes:

acquiring a deployment instruction of the Ceph distributed storage system;

In the above embodiment, the arrangement and deployment of the environmental parameters of the Ceph distribution system are completed in the above manner.

The block chain referred by the application is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware associated with computer readable instructions, which can be stored in a computer readable storage medium, and when executed, the processes of the embodiments of the methods described above can be included. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random Access Memory (RAM).

It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

With further reference to fig. 3, as an implementation of the method shown in fig. 2, the present application provides an embodiment of a video data storage apparatus, which corresponds to the embodiment of the method shown in fig. 2, and which is particularly applicable to various electronic devices.

As shown in fig. 3, the video data storage apparatus 300 according to the present embodiment includes: a file acquisition module 301, a file data generation module 302, an addition judgment module 303, a protocol acquisition module 304, a file division module 305, a storage pool creation module 306, a file data storage module 307, and a data block storage module 308. Wherein:

the file obtaining module 301 is configured to obtain a file to be uploaded;

the file data generating module 302 is configured to generate corresponding file data according to the file to be uploaded;

the addition judging module 303 is configured to judge whether the file to be uploaded is an object that can be added according to the file data;

the protocol obtaining module 304 is configured to obtain a storage protocol of the file data and an addition mode of the file to be uploaded if it is determined that the file to be uploaded is an appendable object;

the file segmentation module 305 is configured to segment the file to be uploaded according to a storage protocol of file data, and generate at least one data block whose storage space does not exceed a threshold and a corresponding data block identifier;

the storage pool creation module 306 is used to create a file data storage pool and a data block storage pool;

the file data storage module 307 is configured to store the file data in the file data storage pool through a Ceph distributed storage system;

the data block storage module 308 is configured to allocate a corresponding data block storage pool for data blocks whose storage space does not exceed a threshold according to the data identifier.

Further, the appending judgment module 303 is further configured to:

reading the file data;

Further, the file splitting module 305 is further configured to:

Further, the data block storage module 308 is further configured to:

acquiring an identification number of the data block storage pool;

merging the Pool _ ID and the object _ ID to obtain a PG _ ID;

defining CGroup hierarchy rules in the storage pool;

acquiring a deployment instruction of the Ceph distributed storage system;

In order to solve the technical problem, an embodiment of the present application further provides a computer device. Referring to fig. 4, fig. 4 is a block diagram of a basic structure of a computer device according to the present embodiment.

The computer device 4 comprises a memory 41, a processor 42, a network interface 43 communicatively connected to each other via a system bus. It is noted that only computer device 4 having components 41-43 is shown, but it is understood that not all of the shown components are required to be implemented, and that more or fewer components may be implemented instead. As will be understood by those skilled in the art, the computer device is a device capable of automatically performing numerical calculation and/or information processing according to a preset or stored instruction, and the hardware includes, but is not limited to, a microprocessor, an Application Specific Integrated Circuit (ASIC), a Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), an embedded device, and the like.

The computer device can be a desktop computer, a notebook, a palm computer, a cloud server and other computing devices. The computer equipment can carry out man-machine interaction with a user through a keyboard, a mouse, a remote controller, a touch panel or voice control equipment and the like.

The memory 41 includes at least one type of readable storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, an optical disk, etc. In some embodiments, the memory 41 may be an internal storage unit of the computer device 4, such as a hard disk or a memory of the computer device 4. In other embodiments, the memory 41 may also be an external storage device of the computer device 4, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, provided on the computer device 6. Of course, the memory 41 may also include both internal and external storage devices of the computer device 4. In this embodiment, the memory 41 is generally used for storing an operating system installed in the computer device 4 and various types of application software, such as computer readable instructions of a video data storage method. Further, the memory 41 may also be used to temporarily store various types of data that have been output or are to be output.

The processor 42 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data Processing chip in some embodiments. The processor 42 is typically used to control the overall operation of the computer device 4. In this embodiment, the processor 42 is configured to execute computer readable instructions stored in the memory 41 or process data, for example, execute computer readable instructions of the video data storage method.

The network interface 43 may comprise a wireless network interface or a wired network interface, and the network interface 43 is generally used for establishing communication connection between the computer device 4 and other electronic devices.

The present application further provides another embodiment, which is to provide a computer-readable storage medium storing computer-readable instructions executable by at least one processor to cause the at least one processor to perform the steps of the video data storage method as described above.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

It is to be understood that the above-described embodiments are merely illustrative of some, but not restrictive, of the broad invention, and that the appended drawings illustrate preferred embodiments of the invention and do not limit the scope of the invention. This application is capable of embodiments in many different forms and is provided for the purpose of enabling a thorough understanding of the disclosure of the application. Although the present application has been described in detail with reference to the foregoing embodiments, it will be apparent to one skilled in the art that the present application may be practiced without modification or with equivalents of some of the features described in the foregoing embodiments. All equivalent structures made by using the contents of the specification and the drawings of the present application are directly or indirectly applied to other related technical fields and are within the protection scope of the present application.

Claims

1. A video data storage method, comprising the steps of:

acquiring a file to be uploaded;

generating corresponding file data according to the file to be uploaded;

creating a file data storage pool and a data block storage pool;

2. The video data storage method according to claim 1, wherein the step of determining whether the file to be uploaded is an appendable object according to the file data specifically includes:

reading the file data;

3. The video data storage method according to claim 1, wherein the file data at least includes a file data identification number, and the step of dividing the file to be uploaded according to a storage protocol of the file data and generating at least one data block whose storage space does not exceed a threshold and a corresponding data identification specifically includes:

4. The method for storing video data according to claim 1, wherein said step of allocating the corresponding data block storage pool for the data blocks whose storage space does not exceed the threshold according to the data identifier specifically comprises:

acquiring an identification number of the data block storage pool;

merging the Pool _ ID and the object _ ID to obtain a PG _ ID;

5. The method for storing video data according to claim 1, wherein the step of obtaining the file to be uploaded is followed by the steps of:

defining CGroup hierarchy rules in the storage pool;

6. The video data storage method of claim 1, wherein said step of creating a file data storage pool and a data chunk storage pool is followed by the step of:

7. The video data storage method according to claim 1, wherein said step of obtaining the file to be uploaded is preceded by:

acquiring a deployment instruction of the Ceph distributed storage system;

8. A video data storage apparatus, comprising:

the file acquisition module is used for acquiring a file to be uploaded;

9. A computer device comprising a memory having computer readable instructions stored therein and a processor which when executed implements the steps of a video data storage method according to any one of claims 1 to 7.

10. A computer-readable storage medium having computer-readable instructions stored thereon which, when executed by a processor, implement the steps of the video data storage method according to any one of claims 1 to 7.