CN115277678B - File downloading method, device, computer equipment and storage medium - Google Patents

File downloading method, device, computer equipment and storage medium Download PDF

Info

Publication number
CN115277678B
CN115277678B CN202210910375.6A CN202210910375A CN115277678B CN 115277678 B CN115277678 B CN 115277678B CN 202210910375 A CN202210910375 A CN 202210910375A CN 115277678 B CN115277678 B CN 115277678B
Authority
CN
China
Prior art keywords
file
downloading
target
block
link
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210910375.6A
Other languages
Chinese (zh)
Other versions
CN115277678A (en
Inventor
曾如达
肖建锋
程希
林俊
陈晓明
温德森
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Merchants Finance Technology Co Ltd
Original Assignee
China Merchants Finance Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Merchants Finance Technology Co Ltd filed Critical China Merchants Finance Technology Co Ltd
Priority to CN202210910375.6A priority Critical patent/CN115277678B/en
Publication of CN115277678A publication Critical patent/CN115277678A/en
Application granted granted Critical
Publication of CN115277678B publication Critical patent/CN115277678B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/104Peer-to-peer [P2P] networks
    • H04L67/1074Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
    • H04L67/1078Resource delivery mechanisms
    • H04L67/108Resource delivery mechanisms characterised by resources being split in blocks or fragments

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a file downloading method which is characterized by comprising the following steps: acquiring a file downloading request; determining whether the file service has a file blocking function based on the file download link; if the file service has the file blocking function, judging whether the target file has the file blocking requirement or not based on the file downloading link; if the target file has the file blocking requirement, blocking the target file to obtain at least two blocked files and file serial numbers; based on the file serial numbers, sequentially downloading at least two block files to a local file system in blocks to obtain block metadata; and carrying out downloading state verification based on the block metadata, and if at least two block files are successfully verified, determining that the downloading of the target file is successful. According to the method, power failure or other abnormal conditions occur in the downloading process, only the fact that the block files are not successfully downloaded is needed to be determined, the part of the block files which are not successfully downloaded are repeatedly downloaded, and the downloading efficiency of the block files is improved.

Description

File downloading method, device, computer equipment and storage medium
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and apparatus for downloading a file, a computer device, and a storage medium.
Background
When a client downloads a file, the traditional downloading mode is single connection downloading, and because in some cases, the speed of single connection downloading is limited, in order to overcome the defects existing in single connection downloading, a file is generally downloaded in a block downloading mode, so that the speed limitation of the current network environment on single connection downloading is eliminated. When the file is downloaded in a block downloading mode, the file is downloaded repeatedly frequently or invalid files are downloaded due to power failure or other abnormal conditions in the downloading process, so that the efficiency and accuracy of file downloading are affected, and the downloading experience of a user is affected.
Disclosure of Invention
The embodiment of the invention provides a file downloading method, a file downloading device, computer equipment and a storage medium, which are used for solving the problem that repeated downloading or invalid file downloading is caused by power failure or abnormal conditions in the file downloading process.
A file downloading method, comprising:
acquiring a file downloading request, wherein the file downloading request comprises a file downloading link;
determining whether a file service corresponding to the file download link has a file blocking function or not based on the file download link;
if the file service corresponding to the file downloading link has a file blocking function, judging whether a target file corresponding to the file downloading link has a file blocking requirement or not based on the file downloading link;
If the target file corresponding to the file downloading link has the file blocking requirement, blocking the target file to obtain at least two blocked files and file serial numbers corresponding to each blocked file;
based on file serial numbers of at least two block files, sequentially downloading the at least two block files to a local file system in blocks, and obtaining block metadata corresponding to each block file;
and carrying out downloading state verification based on the block metadata corresponding to at least two block files, and if the at least two block files are successfully verified, determining that the target file is successfully downloaded.
A file downloading apparatus comprising:
the file downloading request acquisition module is used for acquiring a file downloading request, wherein the file downloading request comprises a file downloading link;
the file block function determining module is used for determining whether file service corresponding to the file download link has a file block function or not based on the file download link;
the file blocking requirement judging module is used for judging whether a target file corresponding to the file downloading link has a file blocking requirement or not based on the file downloading link if the file service corresponding to the file downloading link has a file blocking function;
The file sequence number acquisition module is used for partitioning the target file if the target file corresponding to the file downloading link has file partitioning requirements, and acquiring at least two partitioned files and file sequence numbers corresponding to each partitioned file;
the block metadata acquisition module is used for sequentially downloading at least two block files into a local file system in blocks based on file serial numbers of the at least two block files to acquire block metadata corresponding to each block file;
and the download state verification module is used for verifying the download state based on the block metadata corresponding to at least two block files, and if the at least two block files are successfully verified, the target file is confirmed to be successfully downloaded.
A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the above-described file downloading method when executing the computer program.
A computer readable storage medium storing a computer program which when executed by a processor implements the above-described file downloading method.
The file downloading method, the file downloading device, the computer equipment and the storage medium firstly acquire the file downloading request triggered by the user. Based on the file downloading link contained in the file downloading request, sending an access request to the file service corresponding to the file downloading link, determining whether the file service corresponding to the file downloading link has a file blocking function, and providing a basis for target file blocking downloading; and downloading the file, and judging whether the target file corresponding to the file downloading link has the file blocking requirement according to the file downloading link if the file service corresponding to the file downloading link has the file blocking function. When a target file corresponding to a file downloading link has a file blocking requirement, blocking the target file to obtain at least two blocked files and file serial numbers corresponding to the blocked files; the client terminal downloads the block files into the local file system in blocks based on file serial numbers of at least two block files, acquires block metadata corresponding to each block file, so as to perform downloading state verification based on the block metadata corresponding to at least two block files, determine whether the target file is successfully downloaded according to a verification result, determine whether the target file is successfully downloaded, and only need to determine which block files are not successfully downloaded in the downloading process, repeatedly download the part of unsuccessfully downloaded block files and improve the downloading efficiency.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments of the present invention will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic view of an application environment of a file downloading method according to an embodiment of the present invention;
FIG. 2 is a flow chart of a file downloading method according to an embodiment of the present invention;
FIG. 3 is another flow chart of a file downloading method according to an embodiment of the present invention;
FIG. 4 is another flow chart of a file downloading method according to an embodiment of the present invention;
FIG. 5 is another flow chart of a file downloading method according to an embodiment of the present invention;
FIG. 6 is another flow chart of a file downloading method according to an embodiment of the present invention;
FIG. 7 is another flow chart of a file downloading method according to an embodiment of the present invention;
FIG. 8 is another flow chart of a file downloading method according to an embodiment of the present invention;
FIG. 9 is a schematic diagram of a file downloading device according to an embodiment of the present invention;
FIG. 10 is a schematic diagram of a computer device in accordance with an embodiment of the invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The file downloading method provided by the embodiment of the invention can be applied to an application environment shown in figure 1. Specifically, the file downloading method is applied to a file downloading system, the file downloading system comprises a client and a server as shown in fig. 1, and the client and the server communicate through a network to realize the file downloading method. The client is also called a client, and refers to a program corresponding to the server for providing local service for the client. The client may be installed on, but is not limited to, various personal computers, notebook computers, smartphones, tablet computers, and portable wearable devices. The server may be implemented as a stand-alone server or as a server cluster composed of a plurality of servers.
In one embodiment, as shown in fig. 2, a file downloading method is provided, and the method is applied to the client in fig. 1 for illustration, and includes the following steps:
s201: acquiring a file downloading request, wherein the file downloading request comprises a file downloading link;
s202: determining whether a file service corresponding to the file download link has a file blocking function or not based on the file download link;
s203: if the file service corresponding to the file downloading link has the file blocking function, judging whether the target file corresponding to the file downloading link has the file blocking requirement or not based on the file downloading link;
s204: if the target file corresponding to the file downloading link has the file blocking requirement, blocking the target file to obtain at least two blocked files and the file serial numbers corresponding to each blocked file;
s205: based on file serial numbers of at least two block files, sequentially downloading the at least two block files to a local file system in blocks, and obtaining block metadata corresponding to each block file;
s206: and carrying out downloading state verification based on the block metadata corresponding to the at least two block files, and if the at least two block files are successfully verified, determining that the downloading of the target file is successful.
Wherein the file download request is a request for triggering downloading of a file.
As an example, in step S201, the client may obtain a file download request triggered by the user. The file downloading request comprises a file downloading link corresponding to the target file to be downloaded. In this example, after the client obtains the file downloading request, the client needs to send the file downloading request to the server corresponding to the file downloading link, so as to download the required target file from the server. The target file refers to a file to be downloaded corresponding to the file download link.
The file block function refers to a function of dividing an entire file into a plurality of file blocks.
As an example, in step S202, the client sends an access request to a file service corresponding to the file download link based on the file download link included in the file download request, and determines whether the file service corresponding to the file download link has a file blocking function, thereby providing a basis for target file blocking downloading. As an example, if the file service corresponding to the file download link has a file blocking function, the file download link may divide the target file into a plurality of blocked files with a fixed size or a size customized by the user, then download the plurality of blocked files, and in the process of downloading the plurality of blocked files, power failure or other abnormal conditions occur, only needs to determine which blocked files are not successfully downloaded, and repeatedly downloads the part of blocked files which are not successfully downloaded, thereby improving the downloading efficiency thereof.
As an example, in step S203, the client downloads the file, and if the file service corresponding to the file download link has the file blocking function, the server determines whether the target file corresponding to the file download link has the file blocking requirement according to the file download link. Specifically, the client side can compare the size of the target file corresponding to the target file with the preset blocking threshold size, and if the size of the target file is larger than the blocking threshold size, the target file corresponding to the file downloading link has file blocking requirements; otherwise, the target file does not have the file blocking requirement.
In a specific embodiment, step S203, that is, based on the file download link, determines whether the target file corresponding to the file download link has a file blocking requirement, includes:
s2031: and determining the size of the target file according to the length field value in the current response message, and comparing the size of the target file with the size of the blocking threshold.
S2032: if the size of the target file is smaller than the size of the blocking threshold, the target file corresponding to the file downloading link does not have the file blocking requirement.
S2033: if the size of the target file is larger than or equal to the size of the blocking threshold, the target file corresponding to the file downloading link has the file blocking requirement.
The size of the blocking threshold is preset and used for evaluating whether blocking is needed or not so as to determine whether the file blocking requirement exists or not.
As an example, in step S2031, the client parses the current response message, and determines, according to the length field value in the current response message, the size of the target file corresponding to the target file. The length field value may be a value corresponding to a content-length field in the current response message, which is an HTTP message length, and an octet value represented by a decimal number, which is a field commonly used in the response message, and is used to represent a size of a file. And then, the client compares the target file with the blocking threshold size to determine whether blocking requirements exist according to the comparison result.
As an example, in step 2032, when the target file size of the target file is smaller than the preset blocking threshold size, the client determines that the target file is smaller, and accordingly, the downloading efficiency is faster, and the target file can be quickly downloaded without performing the file blocking operation, so that the target file corresponding to the file downloading link can be determined not to have the file blocking requirement. Understandably, if the size of the target file is smaller and the file blocking requirement is not met, the target file can be directly downloaded without file blocking downloading and subsequent verification operations, so that the downloading efficiency of the target file is guaranteed.
As an example, in step S2033, when the target file size of the target file is greater than or equal to the preset blocking threshold size, the client determines that the target file is larger, and accordingly, the downloading efficiency is slower, and the file blocking operation is required to be performed so as to rapidly download the target file, so that it may be determined that the target file corresponding to the file downloading link has a file blocking requirement.
In this example, according to the length field value in the current response message, the size of the target file is determined, and whether the target file is segmented in the downloading process is determined by comparing the size of the target file with the size of the segmentation threshold value set in advance, so that the efficiency of downloading the file in segments is improved.
The file sequence number refers to the file sequence number corresponding to each of the block files obtained by dividing the target file into a plurality of block files.
As an example, in step S204, when the target file corresponding to the file download link has a file blocking requirement, the client needs to block the target file to obtain at least two blocked files and a file sequence number corresponding to each blocked file. Specifically, the client can determine the number of blocks according to the size of the target file and the size of the block threshold; and cutting the target file based on the number of the blocks to obtain at least two block files corresponding to the number of the blocks.
The block metadata refers to metadata corresponding to each block file, and the block metadata records attribute information of each block file.
As an example, in step S205, the client side downloads the block files into the local file system in blocks based on the file serial numbers of at least two block files, and obtains the block metadata corresponding to each block file, so as to perform the download status verification based on the block metadata corresponding to at least two block files, thereby determining whether the target file is downloaded successfully. In this example, the client stores the partition metadata corresponding to each partition file in a meta file, which is an auxiliary management resource file. In general, the block metadata of the block file records information such as a file download state corresponding to the file, a size of the block file, a storage position of the block file in the target file, a download time, a block hash value, and the like.
In a specific embodiment, in step 205, based on file sequence numbers of at least two block files, at least two block files are sequentially downloaded to a local file system in blocks, and block metadata corresponding to each block file is obtained, including:
S2051: based on file serial numbers of at least two block files, sequentially downloading the at least two block files to a local file system in blocks, and acquiring a file storage position of each block file in the local file system;
s2052: determining a block hash value of each block file according to the file storage position of each block file in a local file system;
s2053: and obtaining the block metadata corresponding to each block file according to the file downloading state of each block file, the size of the block file, the storage position of the block file in the target file, the downloading time and the block hash value.
The file storage position is the storage position of the block file in the local file system.
As an example, in step S2051, the client downloads at least two file blocks to the local file system based on the file sequence numbers of at least two block files, and obtains the file storage location of each block file in the local file system.
As an example, in step S2052, the client determines a block hash value of each block file according to a file storage location of each block file in the local file system. Specifically, after each block file is in a file storage position of the local file system, a block hash value corresponding to the block file is calculated according to the file storage position, so as to prepare for verifying the integrity of the target file.
The file downloading state is used for reflecting whether the file is successfully downloaded or not, and comprises a downloading success state and a downloading failure state. The file chunk size is the size of each chunk file.
As an example, in step S2053, the client writes the acquired file download status of each block file, the size of the block file, the start and stop positions of the block file, the download time and the block hash value into the meta file, and determines the metadata as the block metadata corresponding to each block file.
In the example, based on file sequence numbers of at least two block files, sequentially downloading the at least two block files to a local file system, and acquiring a file storage position of each block file in the local file system; and determining a file downloading state, the size of the blocked file, the start and stop positions of the blocked file, the downloading time, the blocked hash value and the like as blocked metadata through the blocked hash value corresponding to the file storage position, so that the integrity check can be performed based on the blocked metadata.
As an example, in step S206, after obtaining the block metadata corresponding to the at least two block files, the client may perform the download status check based on the block metadata corresponding to the at least two block files, so as to determine whether the target file is downloaded successfully according to the check result. In this example, the client detects whether at least two block files corresponding to the target file are downloaded successfully; if the downloading of at least two block files is successful, the successful downloading of the target file is determined, target metadata corresponding to the target file is generated, and the target metadata is stored in the meta file.
In a specific embodiment, after step S206, that is, after the objective file is determined to be downloaded successfully, the file downloading method further includes:
s2061: determining a target hash value corresponding to the target file according to the file storage positions of at least two block files in the local file system;
s2062: and acquiring target metadata corresponding to the target file based on the file downloading state, the target file size, the downloading time and the target hash value corresponding to the target file, and storing the target metadata in a local file system.
As an example, in step S2061, the client determines a file storage address corresponding to the target file according to the file storage locations of at least two block files in the local file system, and then determines a target hash value corresponding to the target file according to the file storage address corresponding to the target file.
As an example, in step S2062, the client determines the data such as the file download status, the size, the download time, and the target hash value of the target file as the target metadata corresponding to the target file, and writes the target metadata corresponding to the target file into the meta file.
In this example, according to the file storage positions of at least two block files in the local file system, the target hash value corresponding to the target file is determined, and then the file downloading state, the target file size, the downloading time and the target hash value corresponding to the target file are determined as the target metadata corresponding to the target file, so that whether the target file is stored in the local file system or not is evaluated based on the target metadata corresponding to the target file, and the purposes of preventing repeated downloading of the target file and improving the overall file downloading efficiency are achieved.
In the file downloading method provided by the embodiment, a file downloading request triggered by a user is acquired first. Based on the file downloading link contained in the file downloading request, sending an access request to the file service corresponding to the file downloading link, determining whether the file service corresponding to the file downloading link has a file blocking function, and providing a basis for target file blocking downloading; and downloading the file, and judging whether the target file corresponding to the file downloading link has the file blocking requirement according to the file downloading link if the file service corresponding to the file downloading link has the file blocking function. When a target file corresponding to a file downloading link has a file blocking requirement, blocking is carried out on the target file, and at least two blocked files and file serial numbers corresponding to each blocked file are obtained; the client terminal downloads the block files into the local file system in blocks based on file serial numbers of at least two block files, acquires block metadata corresponding to each block file, so as to perform downloading state verification based on the block metadata corresponding to at least two block files, and determine whether the target file is successfully downloaded according to a verification result, thereby determining whether the target file is successfully downloaded, and achieving the purposes of preventing repeated downloading of the target file and improving the overall file downloading efficiency.
In an embodiment, as shown in fig. 3, before determining, based on the file download link, whether the file service corresponding to the file download link has a file blocking function, the file downloading method further includes:
s301: generating an access request carrying a range request header, sending the access request to a file service corresponding to a file download link, and receiving a current response message returned by the file service corresponding to the file download link;
s302: judging whether a target file corresponding to the file downloading link is stored in the local file system according to the current response message;
s303: if the target file is not stored in the local file system, determining whether the file service corresponding to the file download link has a file blocking function or not based on the file download link.
In Range, a plurality of parts can be requested at a time, and the server returns the parts in the form of a multi-part file. The current response message refers to a response message returned at the current moment, wherein the response message is composed of a status line (protocol version, status code), a response header (server name, resource identifier and the like) and a content entity (resource information returned by a server side), and the response message is a result of processing an access request.
In step S301, the client generates an access request carrying a range request header, sends the access request to a file service corresponding to a file download link, and receives a current response message returned by the file service corresponding to the file download link, so as to determine whether the target file has a file blocking function according to the message content in the current response message.
In step S302, after receiving the current response message, the client parses the current response message, extracts key information related to the file identifier, processes the extracted key information to generate a file identifier corresponding to the target file, queries the local file system according to the file identifier to determine whether the target file corresponding to the file download link is stored in the local file system, and if the target file is stored in the local file system, does not need to repeatedly download the target file, thereby avoiding repeated downloading of the target file, saving system resources in the file downloading process, and avoiding heavy load of the server to affect the downloading efficiency of other files.
As an example, in step S303, when the client does not store the target file in the local file system, the client needs to download the target file from the server, so as to avoid subsequent repeated downloading caused by power failure or other abnormal reasons in the whole downloading process of the target file, the client may determine whether the file service corresponding to the file downloading link has a file blocking function based on the file downloading link first, so as to determine whether the target file can be downloaded in blocks.
In the file downloading method provided by the embodiment, based on the access request of the range request head, the current response message returned by the file service corresponding to the file downloading link is obtained, the current response message is analyzed to determine whether the local file system stores the corresponding target file, if the corresponding target file is stored, repeated downloading is not needed, system resources in the file downloading process are saved, and the problem that the downloading efficiency of other files is influenced due to heavy load of a server is avoided; if the corresponding target file is not stored, the target file needs to be downloaded from the server, and in order to avoid subsequent repeated downloading caused by power failure or other abnormal reasons in the whole downloading process of the target file, whether the file service corresponding to the file downloading link has a file blocking function or not can be determined based on the file downloading link first so as to determine whether the target file can be downloaded in blocks or not.
In one embodiment, as shown in fig. 4, step S302, that is, determining whether the target file corresponding to the file download link is stored in the local file system according to the current response message, includes:
s401: analyzing the current response message to obtain a length field value, and obtaining a file identifier according to the file downloading link and the length field value;
S402: inquiring a local file system based on the file identification, and judging whether target metadata corresponding to the file identification exists or not;
s403: if the target metadata corresponding to the file identification exists, determining that a target file corresponding to the file downloading link is stored in the local file system;
s404: and if the target metadata corresponding to the file identification does not exist, determining that the target file corresponding to the file downloading link is not stored in the local file system.
As an example, in step S401, the client parses a current response message after receiving the current response message, and obtains a length field value in the current response message; and obtaining the file identification according to the file download link and the length field value. In this example, the client may employ a pre-file-identifier generation algorithm to process two input parameters, namely, a file download link and a length field value, to generate a corresponding file identifier.
As an example, in step S402, the client may query the local file system based on the file identifier, and perform query matching on the local file system according to the file identifier to determine whether the local file system has the target metadata corresponding to the file identifier, which provides a basis for preventing file repeated downloading. In this example, there may be a hidden file in the local file system, where target metadata corresponding to different file identifiers is recorded in the hidden file.
As an example, in step S403, the client queries the local file system based on the file identifier, and if there is target metadata corresponding to the file identifier in the local file system, it is determined that the target file corresponding to the file download link is stored in the local file system, so that downloading is not required, and resource waste is reduced.
As an example, in step S403, the client queries the local file system based on the file identifier, and if there is no target metadata corresponding to the file identifier in the local file system, it is determined that the target file corresponding to the file download link is not stored in the local file system, and then the subsequent step S202 may be executed, that is, it is determined whether the file service corresponding to the file download link has the file blocking function based on the file download link.
In the file downloading method provided by the embodiment, the current response message is firstly analyzed to obtain the length field value in the current response message, and then the file identifier is obtained according to the file downloading link and the length field value, wherein the file identifier is an identifier which can uniquely identify a certain target file. And inquiring the local file system based on the file identification, and inquiring and matching the local file system according to the file identification to judge whether the local file system has target metadata corresponding to the file identification, so as to determine whether to continue downloading the target file according to a judging result, and provide a basis for preventing repeated downloading of the file, thereby achieving the aim of saving system resources.
In an embodiment, as shown in fig. 5, after step S302, that is, after determining whether the target file corresponding to the file download link is stored in the local file system according to the current response message, the file download method further includes:
s501: if the target file is stored in the local file system, judging whether the target file is a valid file or not;
s502: if the target file is an effective file, acquiring the target file from a local file system;
s503: if the target file is an invalid file, determining whether the file service corresponding to the file download link has a file blocking function or not based on the file download link.
As an example, in step S501, when the client stores the target file in the local file system, it may determine whether the target file is a valid file based on the file download status and the file integrity of the target file in the local file system, so as to determine whether the target file stored in the local file system is a required file. The file downloading state is a state for reflecting whether the file is successfully downloaded or not, and comprises a downloading success state and a downloading failure state. File integrity is information that reflects whether a file is complete.
In step S502, the client may directly obtain the target file from the local file system if the target file is an effective file, so that repeated downloading of the target file is not required, system resources in the file downloading process are saved, and the server is prevented from having a heavy load to affect the downloading efficiency of other files.
As an example, in step S503, when the target file is an invalid file, the client needs to download the target file from the server, and in order to avoid subsequent repeated downloading caused by power failure or other abnormal reasons in the whole downloading process of the target file, it may be determined whether the file service corresponding to the file downloading link has a file blocking function based on the file downloading link, so as to determine whether the target file can be blocked.
In the file downloading method provided by the embodiment, whether the target file is an effective file is judged first, if the target file is an effective file, repeated downloading is not needed, so that system resources in a file downloading process are saved, and the problem that the downloading efficiency of other files is influenced due to heavy load of a server is avoided; if the target file is an invalid file, the target file needs to be downloaded from the server, and in order to avoid subsequent repeated downloading caused by power failure or other abnormal reasons in the whole downloading process of the target file, whether the file service corresponding to the file downloading link has a file blocking function or not can be determined based on the file downloading link first so as to determine whether the target file can be downloaded in blocks or not.
In one embodiment, as shown in fig. 6, step S501, namely determining whether the target file is a valid file, includes:
s601: acquiring target metadata corresponding to a target file, wherein the target metadata comprises a file downloading state, a target file size and a target hash value;
s602: determining a current hash value corresponding to the target file according to a current storage address of the target file in a local file system, and acquiring an actual file size corresponding to the target file;
s603: if the file downloading state is a successful downloading state, the target hash value is consistent with the current hash value, and the size of the target file is consistent with the size of the actual file, determining that the target file is an effective file;
s604: and if the file downloading state is a downloading failure state, the target hash value is inconsistent with the current hash value, or the size of the target file is inconsistent with the size of the actual file, determining that the target file is an invalid file.
As an example, in step S601, the client obtains target metadata corresponding to the target file, and obtains a file download status of the target file, a target file size, and a target hash value, so as to perform subsequent validity check based on the target metadata. The file downloading state refers to a downloading state stored before the current time, and can be a successful downloading state or a failed downloading state. The target file size herein refers to the size of the target file stored in the target metadata before the current time. The target hash value here is a hash value recorded in the target metadata stored before the current time.
As an example, in step S602, the client performs a hash value calculation again according to the current storage location of the target file in the local file system, calculates a current hash value of the target file, and obtains an actual file size corresponding to the target file stored in the local file system at the current time, so as to perform validity check on the target file in combination with the target metadata based on the current hash value and the actual file size.
As an example, in step S603, when the file download status of the target metadata is a download success status, the target hash value is consistent with the current hash value, and the target file size is consistent with the actual file size, that is, when all three conditions are satisfied, the client determines that the validity standard is satisfied, and can determine that the target file is a valid file.
As an example, in step S604, when the file download status of the target metadata is a download failure status, the target hash value is inconsistent with the current hash value, and the target file size is inconsistent with the actual file size, that is, any one of the three conditions is not satisfied, the client determines that the validity standard is not satisfied, and determines that the target file is an invalid file.
In the file downloading method provided by the embodiment, whether the target file stored in the local file system is an effective file is evaluated according to the file downloading state in the target metadata, the comparison result of the target hash value and the current hash value and the comparison result of the target file size and the actual file size, so that the target file is prevented from being a local file which is failed to be downloaded or from being tampered by people after the successful downloading, and the effectiveness of the target file is ensured.
In one embodiment, as shown in fig. 7, based on the file download link, determining whether the file service corresponding to the file download link has a file blocking function includes:
s701: analyzing the current response message to obtain a length field value and a response state code;
s702: if the length field value is a valid field value and the response state code is a target state code, determining that the file service has a file blocking function;
s703: if the length field value is not the valid field value or the response status code is not the target status code, determining that the file service does not have the file blocking function.
The length field value is a field value recorded in the current response message and used for reflecting the length of the target file. The response status code is a status code recorded in the current response message and used for reflecting whether the block downloading function is supported.
As an example, in step S701, the client parses the obtained current response message, extracts a length field value and a response status code from the current response message, so as to evaluate whether the target file has a file blocking function based on the length field value and the response status code.
The valid field value is a preset field value with a file blocking function. The target state code is a preset state code with a file blocking function.
As an example, in step S702, if the length field value is a valid field value and the response status code is a target status code, it is determined that the file service has a file blocking function. For example, the client parses the current response message, and if the length field value corresponding to the content-range field in the current response message is a preset valid field value and the response status code is a preset target status code 206, determines that the file service has a file blocking function.
As an example, in step S703, the client determines that the file service does not have the file blocking function when the length field value is not a valid field value or the response status code is not a target status code. Specifically, the client parses the current response message, and if the length field value corresponding to the content-range field in the current response message is not a preset valid field value, or the response status code is a preset target status code 206, any one of the two items does not correspond to the corresponding one, it is determined that the file service does not have the file blocking function.
In the file downloading method provided by the embodiment, the current response message is parsed to obtain the length field value and the response status code, and whether the file service corresponding to the file downloading link has the file blocking function is judged through the length field value and the response status code, so that the feasibility of file blocking downloading is ensured.
In an embodiment, as shown in fig. 8, the download status verification based on the partition metadata corresponding to at least two partition files includes:
s801: inquiring a local file system according to file sequence numbers of at least two block files, and determining whether the at least two block files store block metadata or not;
s802: if the at least two block files are stored with the block metadata, judging whether the file downloading state in the at least two block metadata is a successful downloading state or not;
s803: if at least two block files are in a successful downloading state, calculating a local hash value corresponding to each block file according to a file storage position of each block file in a local file system, and judging whether the local hash value is consistent with a block hash value in block metadata;
s804: and if the local hash value and the partition hash value of at least two partition files are uniform, determining that the at least two partition files are successfully checked.
As an example, in step S801, all the blocked files downloaded by the client and the corresponding blocked metadata thereof are stored in the local file system, where the blocked metadata are hidden files, and when the client needs to verify the download status of the target file, the client may query the local file system based on the file sequence numbers corresponding to at least two blocked files, to determine whether each blocked file stores the blocked metadata.
As an example, in step S802, when determining that at least two partitioned files each store partitioned metadata, the client needs to determine whether the file download status in each partitioned metadata is a successful download status. For example, when the file download status of each block file is 1, it is determined as a download success status, and when the block download status of each block file is 0, it is determined as a download failure status, so as to determine whether the block file is a download success status according to the file download status in the block metadata.
As an example, in step S803, when at least two blocked files are in a successful download state, the client may calculate a local hash value according to a file storage location of the blocked file in the local file system, and determine whether the local hash value is consistent with the blocked hash value in the blocked metadata, so as to determine whether the blocked file is tampered after being downloaded to the local file system.
As an example, in step S804, when the local hash value and the partition hash value of at least two partition files of the client are equal, it may be determined that the at least two partition files are not tampered when being downloaded to the local file system, and at this moment, it may be determined that the at least two partition files are checked successfully, thereby determining that the target file is downloaded successfully.
In the file downloading method provided by the embodiment, whether each block file stores the block metadata or not is sequentially judged, whether the file downloading state in each block metadata is a downloading success state or not is judged, whether the local hash value calculated by each block file at the file storage position of the local file system is consistent with the block hash value or not is judged, so that whether the block file is successfully downloaded or not is determined, and therefore the aims of preventing file re-downloading caused by power failure in the downloading process or manual modification of a locally cached file are achieved, and the success rate of downloading the target file is improved.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic, and should not limit the implementation process of the embodiment of the present invention.
In one embodiment, a file downloading device is provided, where the file downloading device corresponds to the file downloading method in the above embodiment one by one. As shown in fig. 9, the file downloading device includes a file downloading request acquisition module 901, a file blocking function determination module 902, a file blocking requirement judgment module 903, a file sequence number acquisition module 904, a blocking metadata acquisition module 905, and a download status verification module 906. The functional modules are described in detail as follows:
A file download request acquiring module 901, configured to acquire a file download request, where the file download request includes a file download link;
a file block function determining module 902, configured to determine, based on the file download link, whether a file service corresponding to the file download link has a file block function;
the file blocking requirement judging module 903 is configured to judge whether a target file corresponding to the file download link has a file blocking requirement based on the file download link if the file service corresponding to the file download link has a file blocking function;
the file sequence number obtaining module 904 is configured to block the target file if the target file corresponding to the file download link has a file block requirement, and obtain at least two block files and a file sequence number corresponding to each block file;
the block metadata obtaining module 905 is configured to sequentially download at least two blocks of the block files to the local file system based on file sequence numbers of the at least two blocks of the file, and obtain block metadata corresponding to each block of the file;
and the download status checking module 906 is configured to perform download status checking based on the block metadata corresponding to the at least two block files, and determine that the target file is downloaded successfully if the at least two block files are checked successfully.
In an embodiment, the file downloading device further includes:
the current response message receiving module is used for generating an access request carrying a range request head, sending the access request to a file service corresponding to the file download link, and receiving a current response message returned by the file service corresponding to the file download link;
the target file judging module is used for judging whether a target file corresponding to the file downloading link is stored in the local file system according to the current response message;
the file blocking function determining module 902 is configured to determine, based on the file download link, whether a file service corresponding to the file download link has a file blocking function if the target file is not stored in the local file system.
In one embodiment, the object file determining module includes:
the file identification acquisition unit is used for analyzing the current response message, acquiring a length field value and acquiring a file identification according to the file downloading link and the length field value;
the target metadata query unit is used for querying a local file system based on the file identification and judging whether target metadata corresponding to the file identification exists or not;
the first storage result determining unit is used for determining that a target file corresponding to a file downloading link is stored in the local file system if target metadata corresponding to the file identification exists;
And the second storage result determining unit is used for determining that the target file corresponding to the file downloading link is not stored in the local file system if the target metadata corresponding to the file identification does not exist.
In an embodiment, the file downloading device further includes:
the effective file judging module is used for judging whether the target file is an effective file or not if the target file is stored in the local file system;
the target file acquisition module is used for acquiring the target file from the local file system if the target file is an effective file;
the file block function determining module 902 is configured to determine, based on the file download link, whether a file service corresponding to the file download link has a file block function if the target file is an invalid file.
In an embodiment, the valid file determining module further includes:
the target metadata acquisition unit is used for acquiring target metadata corresponding to a target file, wherein the target metadata comprises a file downloading state, a target file size and a target hash value;
the current information acquisition unit is used for determining a current hash value corresponding to the target file according to the current storage address of the target file in the local file system and acquiring the actual file size corresponding to the target file;
The effective file determining unit is used for determining that the target file is an effective file if the file downloading state is a successful downloading state, the target hash value is consistent with the current hash value, and the size of the target file is consistent with the size of the actual file;
and the invalid file determining unit is used for determining that the target file is an invalid file if the file downloading state is a downloading failure state, the target hash value is inconsistent with the current hash value, or the size of the target file is inconsistent with the actual file size.
In one embodiment, the file chunk function determination module 902 includes:
the current response message analyzing unit is used for analyzing the current response message and acquiring a length field value and a response state code;
the first block function determining unit is used for determining that the file service has a file block function if the length field value is a valid field value and the response state code is a target state code;
and the second block dividing function determining unit is used for determining that the file service does not have the file dividing function if the length field value is not a valid field value or the response state code is not a target state code.
In one embodiment, the download status verification module 906 includes:
the block metadata determining unit is used for querying a local file system according to file sequence numbers of at least two block files and determining whether the at least two block files store the block metadata or not;
The download success state judging unit is used for judging whether the file download state in the at least two block metadata is a download success state if the at least two block files are all stored with the block metadata;
the local hash value judging unit is used for calculating a local hash value corresponding to each block file according to the file storage position of each block file in the local file system if at least two block files are in a successful downloading state, and judging whether the local hash value is consistent with the block hash value in the block metadata;
and the verification success determining unit is used for determining that the verification of at least two partitioned files is successful if the local hash values of the at least two partitioned files are identical to the partitioned hash values.
For specific limitations on the file downloading device, reference may be made to the above limitation on the file downloading method, and no further description is given here. The respective modules in the above-described file downloading apparatus may be implemented in whole or in part by software, hardware, and a combination thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
In one embodiment, a computer device is provided, which may be a server, and the internal structure of which may be as shown in fig. 10. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer device is used for storing data adopted or generated in the process of downloading the execution file. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a file downloading method.
In an embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor executes the computer program to implement the method for downloading files in the foregoing embodiment, such as S201-S206 shown in fig. 2 or S201-S206 shown in fig. 3-8, and is not repeated here. Alternatively, the processor may implement the functions of each module/unit in this embodiment of the file downloading device when executing the computer program, for example, the functions of the file downloading request acquiring module 901, the file blocking function determining module 902, the file blocking requirement judging module 903, the file sequence number acquiring module 904, the blocking metadata acquiring module 905 and the download status checking module 906 shown in fig. 9, which are not described herein again for avoiding repetition.
In an embodiment, a computer readable storage medium is provided, and a computer program is stored on the computer readable storage medium, where the computer program when executed by a processor implements the method for downloading a file in the foregoing embodiment, for example, S201-S206 shown in fig. 2, or S201-S206 shown in fig. 3-8, and is not repeated herein. Alternatively, the functions of the modules/units in the above embodiment of the file downloading device are implemented when the computer program is executed by a processor, for example, the functions of the file downloading request acquiring module 901, the file blocking function determining module 902, the file blocking requirement judging module 903, the file sequence number acquiring module 904, the blocking metadata acquiring module 905 and the download status checking module 906 shown in fig. 9 are not repeated here. The computer readable storage medium may be nonvolatile or may be volatile.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions.
The above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention, and are intended to be included in the scope of the present invention.

Claims (8)

1. A method for downloading a file, comprising:
acquiring a file downloading request, wherein the file downloading request comprises a file downloading link;
generating an access request carrying a range request header, sending the access request to a file service corresponding to the file download link, and receiving a current response message returned by the file service corresponding to the file download link;
Judging whether a target file corresponding to the file downloading link is stored in a local file system according to the current response message;
if the target file is not stored in the local file system, analyzing the current response message to obtain a length field value and a response status code;
if the length field value is an effective field value and the response status code is a target status code, determining that the file service has a file blocking function;
if the length field value is not the valid field value or the response status code is not the target status code, determining that the file service does not have a file blocking function;
if the file service corresponding to the file downloading link has a file blocking function, judging whether a target file corresponding to the file downloading link has a file blocking requirement or not based on the file downloading link;
if the target file corresponding to the file downloading link has the file blocking requirement, blocking the target file to obtain at least two blocked files and file serial numbers corresponding to each blocked file;
based on file serial numbers of at least two block files, sequentially downloading the at least two block files to a local file system in blocks, and obtaining block metadata corresponding to each block file;
And carrying out downloading state verification based on the block metadata corresponding to at least two block files, and if the at least two block files are successfully verified, determining that the target file is successfully downloaded.
2. The method for downloading files according to claim 1, wherein said determining whether the target file corresponding to the file download link is stored in the local file system according to the current response message comprises:
analyzing the current response message to obtain a length field value, and obtaining a file identifier according to the file downloading link and the length field value;
inquiring a local file system based on the file identifier, and judging whether target metadata corresponding to the file identifier exists or not;
if the target metadata corresponding to the file identification exists, determining that a target file corresponding to the file downloading link is stored in a local file system;
and if the target metadata corresponding to the file identification does not exist, determining that the target file corresponding to the file downloading link is not stored in the local file system.
3. The method for downloading a file according to claim 1, wherein after determining whether the target file corresponding to the file download link is stored in the local file system according to the current response message, the method for downloading a file further comprises:
If the target file is stored in the local file system, judging whether the target file is a valid file or not;
if the target file is an effective file, acquiring the target file from the local file system;
and if the target file is an invalid file, determining whether a file service corresponding to the file download link has a file blocking function or not based on the file download link.
4. The file downloading method as claimed in claim 3, wherein said determining whether the target file is a valid file comprises:
acquiring target metadata corresponding to the target file, wherein the target metadata comprises a file downloading state, a target file size and a target hash value;
determining a current hash value corresponding to the target file according to a current storage address of the target file in a local file system, and acquiring an actual file size corresponding to the target file;
if the file downloading state is a successful downloading state, the target hash value is consistent with the current hash value, and the size of the target file is consistent with the size of the actual file, determining that the target file is an effective file;
And if the file downloading state is a downloading failure state, the target hash value is inconsistent with the current hash value, or the target file size is inconsistent with the actual file size, determining that the target file is an invalid file.
5. The file downloading method as claimed in claim 1, wherein the performing the download status check based on the block metadata corresponding to at least two of the block files includes:
inquiring a local file system according to file sequence numbers of at least two block files, and determining whether the at least two block files store block metadata or not;
if the at least two block files are stored with the block metadata, judging whether the file downloading state in the at least two block metadata is a successful downloading state or not;
if at least two block files are in a successful downloading state, calculating a local hash value corresponding to each block file according to a file storage position of each block file in a local file system, and judging whether the local hash value is consistent with a block hash value in the block metadata;
and if the local hash values of at least two partitioned files are identical to the partitioned hash values, determining that the at least two partitioned files are successfully checked.
6. A file downloading apparatus for implementing the file downloading method as claimed in any one of claims 1 to 5, the apparatus comprising:
the file downloading request acquisition module is used for acquiring a file downloading request, wherein the file downloading request comprises a file downloading link;
the file block function determining module is used for determining whether file service corresponding to the file download link has a file block function or not based on the file download link;
the file blocking requirement judging module is used for judging whether a target file corresponding to the file downloading link has a file blocking requirement or not based on the file downloading link if the file service corresponding to the file downloading link has a file blocking function;
the file sequence number acquisition module is used for partitioning the target file if the target file corresponding to the file downloading link has file partitioning requirements, and acquiring at least two partitioned files and file sequence numbers corresponding to each partitioned file;
the block metadata acquisition module is used for sequentially downloading at least two block files into a local file system in blocks based on file serial numbers of the at least two block files to acquire block metadata corresponding to each block file;
And the download state verification module is used for verifying the download state based on the block metadata corresponding to at least two block files, and if the at least two block files are successfully verified, the target file is confirmed to be successfully downloaded.
7. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the file downloading method according to any of claims 1 to 5 when executing the computer program.
8. A computer readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the file downloading method according to any one of claims 1 to 5.
CN202210910375.6A 2022-07-29 2022-07-29 File downloading method, device, computer equipment and storage medium Active CN115277678B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210910375.6A CN115277678B (en) 2022-07-29 2022-07-29 File downloading method, device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210910375.6A CN115277678B (en) 2022-07-29 2022-07-29 File downloading method, device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN115277678A CN115277678A (en) 2022-11-01
CN115277678B true CN115277678B (en) 2024-02-06

Family

ID=83746847

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210910375.6A Active CN115277678B (en) 2022-07-29 2022-07-29 File downloading method, device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115277678B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115834572B (en) * 2022-12-13 2024-03-26 广州文远知行科技有限公司 File downloading method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012173785A1 (en) * 2011-06-17 2012-12-20 Alibaba Group Holding Limited File processing method, system and server-clustered system for cloud storage
CN106657383A (en) * 2017-01-12 2017-05-10 腾讯科技(深圳)有限公司 Data downloading method and relevant equipment
CN108600312A (en) * 2018-03-21 2018-09-28 深圳市奥软网络科技有限公司 A kind of multi-threaded parallel method for down loading based on file block
CN110784520A (en) * 2019-09-30 2020-02-11 北京字节跳动网络技术有限公司 File downloading method and device and electronic equipment
CN113132489A (en) * 2021-04-22 2021-07-16 中国工商银行股份有限公司 Method, device, computing equipment and medium for downloading file

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012173785A1 (en) * 2011-06-17 2012-12-20 Alibaba Group Holding Limited File processing method, system and server-clustered system for cloud storage
CN106657383A (en) * 2017-01-12 2017-05-10 腾讯科技(深圳)有限公司 Data downloading method and relevant equipment
CN108600312A (en) * 2018-03-21 2018-09-28 深圳市奥软网络科技有限公司 A kind of multi-threaded parallel method for down loading based on file block
CN110784520A (en) * 2019-09-30 2020-02-11 北京字节跳动网络技术有限公司 File downloading method and device and electronic equipment
CN113132489A (en) * 2021-04-22 2021-07-16 中国工商银行股份有限公司 Method, device, computing equipment and medium for downloading file

Also Published As

Publication number Publication date
CN115277678A (en) 2022-11-01

Similar Documents

Publication Publication Date Title
CN110636130B (en) Delayed message processing method and device, computer equipment and storage medium
CN109831487B (en) Fragmented file verification method and terminal equipment
CN108319719B (en) Database data verification method and device, computer equipment and storage medium
CN112015674B (en) Multi-level-based cache resource access method and device and computer equipment
CN110377454B (en) Data verification method and device, computer equipment and storage medium
CN109040191B (en) File downloading method and device, computer equipment and storage medium
CN112632375B (en) Session information processing method, server and storage medium
CN110795171B (en) Service data processing method, device, computer equipment and storage medium
CN115277678B (en) File downloading method, device, computer equipment and storage medium
CN110908778A (en) Task deployment method, system and storage medium
CN111767297B (en) Big data processing method, device, equipment and medium
CN111274245B (en) Method and device for optimizing data storage
CN112506481A (en) Service data interaction method and device, computer equipment and storage medium
CN112199441B (en) Data synchronous processing method, device, equipment and medium based on big data platform
CN111652720B (en) Cloud evidence obtaining method and device, computer equipment and storage medium
CN110457614B (en) Data increment updating method and device for reducing data concurrency and computer equipment
CN116010926A (en) Login authentication method, login authentication device, computer equipment and storage medium
CN110569240A (en) Data storage method and device, computer equipment and storage medium
CN115357779A (en) Data processing method, device and system, electronic equipment and storage medium
CN111431888B (en) Method, device, equipment and storage medium for shielding key information
CN114218188A (en) Data migration method, device, equipment and storage medium
CN110851477B (en) Stream data processing method, stream data processing device, computer equipment and storage medium
CN112104569A (en) Message data processing method and device, computer equipment and storage medium
CN112783866A (en) Data reading method and device, computer equipment and storage medium
CN112836190A (en) Resource data authority control method and device and intelligent terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant