CN110365754A - A kind of distributed document transmission storage method, equipment and storage medium - Google Patents
A kind of distributed document transmission storage method, equipment and storage medium Download PDFInfo
- Publication number
- CN110365754A CN110365754A CN201910572447.9A CN201910572447A CN110365754A CN 110365754 A CN110365754 A CN 110365754A CN 201910572447 A CN201910572447 A CN 201910572447A CN 110365754 A CN110365754 A CN 110365754A
- Authority
- CN
- China
- Prior art keywords
- file
- transmitted
- connection pool
- value
- transmission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003860 storage Methods 0.000 title claims abstract description 51
- 230000005540 biological transmission Effects 0.000 title claims abstract description 48
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000000429 assembly Methods 0.000 claims abstract description 21
- 230000000712 assembly Effects 0.000 claims abstract description 21
- 230000009466 transformation Effects 0.000 claims abstract description 13
- 230000004044 response Effects 0.000 claims abstract description 4
- 238000004590 computer program Methods 0.000 claims description 15
- 238000012360 testing method Methods 0.000 claims description 8
- 241000508269 Psidium Species 0.000 claims description 4
- 238000012795 verification Methods 0.000 claims description 4
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000013461 design Methods 0.000 description 4
- 238000012546 transfer Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000006378 damage Effects 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000012856 packing Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of distributed documents to transmit storage method, comprising steps of obtaining file to be transmitted from the first distributed type assemblies；Connection pool is established according to configured transmission；Generate the MD5 value file of the file to be transmitted；File to be transmitted and the MD5 value file are transmitted to the second distributed type assemblies using the connection pool；Judge transformation task after the completion whether within a preset period of time without transformation task；In response to, without transformation task, destroying the connection pool in preset time period.The invention also discloses a kind of computer equipment and readable storage medium storing program for executing.Distributed document transmission storage method proposed by the present invention greatly improves the efficiency of transmission by the way that connection pool to be applied in the transmission of the file between distributed type assemblies.
Description
Technical field
The present invention relates to field of data transmission, and in particular to a kind of distributed document transmission storage method, equipment and deposits
Storage media.
Background technique
Currently, when carrying out the data transmission storage between distributed type assemblies, it, may since data volume to be transmitted is larger
It takes a long time, and in transmission process, safety not can guarantee yet.
Therefore, it is badly in need of the document data transfer that one kind is carried out safe and efficiently between distributed type assemblies to scan, transmit, deposit
The method of storage process.
Summary of the invention
In view of this, at least one aspect in order to overcome the above problem, the embodiment of the present invention propose a kind of distribution
File transmits storage method, comprising steps of
File to be transmitted is obtained from the first distributed type assemblies；
Connection pool is established according to configured transmission；
Generate the MD5 value file of the file to be transmitted；
File to be transmitted and the MD5 value file are transmitted to the second distributed type assemblies using the connection pool；
Judge transformation task after the completion whether within a preset period of time without transformation task；
In response to, without transformation task, destroying the connection pool in preset time period.
In some embodiments, connection pool is established according to configured transmission, further comprises:
According to required connection pool size, transport protocol and destination IP, the connection pool is set.
In some embodiments, further includes:
The thread of predetermined quantity is set.
In some embodiments, the MD5 value file for generating the file to be transmitted further comprises:
The MD5 value and test.txt file of file to be transmitted are generated using Google Guava；
The MD5 value is written to file test.txt.md5, to obtain the MD5 value file.
In some embodiments, file to be transmitted and the MD5 are transmitted to the second distributed type assemblies using the connection pool
It is worth file, further comprises:
Connecting object is obtained from the connection pool；
The file to be transmitted is transmitted by connecting object, and transmits the MD5 value file；
After being transmitted, the connecting object is returned into the connection pool.
In some embodiments, further comprise:
Utilize the MD5 value file verification transmission integrity.
In some embodiments, file to be transmitted is obtained from the first distributed type assemblies, further comprises:
Scan scheduled file in first distributed type assemblies；
The scheduled file is filtered to obtain the file to be transmitted；
The file to be transmitted is backed up.
In some embodiments, further includes:
New file to be transmitted is obtained, return step establishes connection pool according to configured transmission and repeats subsequent step.
Based on the same inventive concept, according to another aspect of the present invention, the embodiments of the present invention also provide at least one
A processor；And
Memory, the memory are stored with the computer program that can be run on the processor, which is characterized in that institute
State the step of executing any distributed document transmission storage method as described above when processor executes described program.
Based on the same inventive concept, according to another aspect of the present invention, the embodiments of the present invention also provide a kind of meters
Calculation machine readable storage medium storing program for executing, the computer-readable recording medium storage have computer program, and the computer program is processed
The step of any distributed document transmission storage method as described above is executed when device executes.
The present invention has following advantageous effects: the present invention passes through the text that is applied to connection pool between distributed type assemblies
In part transmission, the efficiency of transmission is greatly improved.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
Other embodiments are obtained according to these attached drawings.
Fig. 1 is the flow diagram that a kind of distributed document that the embodiment of the present invention provides transmits storage method；
Fig. 2 is the flow diagram that a kind of distributed document that the embodiment of the present invention provides transmits storage method；
Fig. 3 is the structural schematic diagram for the computer equipment that the embodiment of the present invention provides；
Fig. 4 is the structural schematic diagram for the computer readable storage medium that the embodiment of the present invention provides.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with specific embodiment, and reference
The embodiment of the present invention is further described in attached drawing.
It should be noted that all statements for using " first " and " second " are for differentiation two in the embodiment of the present invention
The non-equal entity of a same names or non-equal parameter, it is seen that " first " " second " only for the convenience of statement, does not answer
It is interpreted as the restriction to the embodiment of the present invention, subsequent embodiment no longer illustrates this one by one.
According to an aspect of the present invention, the embodiment of the present invention proposes a kind of alarm method based on management agreement, such as
May include step shown in Fig. 1: S1 obtains file to be transmitted from the first distributed type assemblies；S2 is built according to configured transmission
Vertical connection pool；S3 generates the MD5 value file of the file to be transmitted；S4 is passed using the connection pool to the second distributed type assemblies
Defeated file to be transmitted and the MD5 value file；S5 judges whether appoint within a preset period of time without transmission after the completion of transformation task
Business；S6, in response to, without transformation task, destroying the connection pool in preset time period.
In some embodiments, step S1 further comprises: scheduled file in scanning first distributed type assemblies；
The scheduled file is filtered to obtain the file to be transmitted；The file to be transmitted is backed up.
Specifically, first document scanner can be deployed in distributed type assemblies, monitoring scans preset file,
And file filter can be carried out according to the rule of setting, backup meets the file of the condition of scanning with to be transmitted.Deployment file scanner
And the file for needing to scan is monitored, and such as: it sets and needs the file scanned as "/data/sourcePath/ ", and be arranged and sweep
It is divided between retouching 30 seconds；File filter rule is set, such as: the file for meeting regular expressions [" .*tmp ", " .*git "] is filtered out,
Filter out the file less than 10k；The file for meeting file scan rule is backed up, such as: by file backup to file
With to be transmitted in "/data/sourcePath_tmp/ ".
In some embodiments, step S2 may further include:
According to required connection pool size, transport protocol and destination IP, the connection pool is set.
Specifically, transport protocol can be FTP, FTPS or SFTP, FTPS is that encryption, agreement are connected for ftp with SFTP
It is closely similar.FTPS is encrypted by ssl protocol, and SFTP is encrypted by SSH.SSL is for Encryption Designs such as http/smtp
, SSH is to encrypt for telnet/ftp etc., establish transmission channel and design.Popular says, SSH is just as pipe laying, and SSL is just
It is wrapped up in as being packaged, it is all the process of a production key that pipe laying is sub and packing is wrapped up in, which can all make data safety, and because SSH is one
Pipe is so it is well suited for the safe transmission of ftp.Secure File Transfer Protocol is an independent agreement in SSH, utilizes sftp server
Data can be transmitted.And FTPS is the meaning of ftp-over-ssl, i.e. ftp is not only used by ssl protocol encrypted transmission
Ftp server is also encrypted with ssl protocol.
Therefore, different agreements can be selected to establish connection pool according to actual needs, for example, in order to improve file transmission
Safety can choose FTPS or Secure File Transfer Protocol.Or it is selected according to the agreement that cluster is supported.
In some embodiments, Apache Common-pool2 can be used and establish connection pool, setting when establishing connection pool
Connection pool size, transport protocol, destination IP, user name, password and port, the object in connection pool is realized using JSch
SFTPClient。
In some embodiments, further includes: the thread of predetermined quantity is set.In this way, by the way that a certain number of threads are arranged,
For multi-thread transmission when can make transmission, per thread once transmits a file, while to can permit transmission identical for maximum
The file of Thread Count.
In some embodiments, step S3 further comprises: the MD5 value of file to be transmitted is generated using Google Guava
And test.txt file；The MD5 value is written to file test.txt.md5, to obtain the MD5 value file.
Specifically, the MD5 value that Google Guava generates test.txt file can be used, which is one 32
Character string, then this character string is written in file test.txt.md5 to (file designation rule is after old file name
Add " .md5 " suffix).
In some embodiments, step S4 may further include:
Connecting object is obtained from the connection pool；
The file to be transmitted is transmitted by connecting object, and transmits the MD5 value file；
After being transmitted, the connecting object is returned into the connection pool.
It is obtained from connection pool specifically, can use sftpClient=sftpClientPool.borrowObject ()
Connecting object is taken, transmits file first after obtaining connecting object, then transmits the MD5 file of this document, and in transmission process
Middle support breakpoint transmission function has retrying for certain data if accidental interruption situation occurs in transmission process for this document
Chance, the place that can then transmit before when transmitting again instantly continue to transmit；Finally it can use
FtpClientPool.returnObject (sftpClient) will be even after the MD5 value file of file and this document is transmitted
It connects object and returns to connection pool.
In some embodiments, after MD5 value file is transferred to destination, MD5 value verification can be carried out, please ensure to transmit
Integrality.
New file to be transmitted is obtained, return step establishes connection pool according to configured transmission and repeats subsequent step.
When certain time does not have transformation task, connection pool can empty destruction automatically, the weight when needing to transmit next time
Corresponding configured transmission is newly selected, for example, the Thread Count etc. for selecting corresponding agreement different with setting, then re-create connection
Pond.
Below with reference to Fig. 2 shows flow diagram a kind of present invention distributed document transmission storage method is described.
It is possible, firstly, to be swept according to preset scanning rule, filtering rule to corresponding document folder using document scanner
Filtering is retouched, to obtain file to be transmitted, and file to be transmitted is backed up.Then it can use file transmitter according to reality
Demand selects corresponding transport protocol, such as in order to ensure file transmission is safer, can choose Secure File Transfer Protocol.Then basis
The agreement and destination port of selection, Thread Count etc. establish connection pool.Then, the transmission for carrying out file to be transmitted is being transmitted
The MD5 value file that this document can first be generated before when being transmitted, first obtains connecting object, then successively from connection pool
The transmission of file and MD5 value file to be transmitted is carried out, and can be with multi-thread transmission difference file, and there is breakpoint transmission function
Can, after MD5 value file is transferred to destination, MD5 value verification can be carried out, please ensure transmission integrity；Final act storage
After device receives file input stream, switch to output stream, by file storage into the second distributed cluster system, such as file storage
Device receives file input stream and is written in memory as fileInputStream, then passes through output stream
Data in memory are written in the specified path of the second distributed type assemblies by fSDataOutputStream.Finally when a timing
Between when there is no transformation task, connection pool can empty destruction automatically.
By the present invention in that carrying out data transmission improving safety with selection different agreement, scanned by user-defined file
Rule improves flexibility, efficiency of transmission is improved by SFTP connection pool multi-thread transmission, by the way that file to be directly stored in
Automation is improved in HDFS, entire file scan, transmission, storing process have safe and efficient, automation effect.
Based on the same inventive concept, according to another aspect of the present invention, as shown in figure 3, the embodiment of the present invention also mentions
Supply a kind of computer equipment 501, comprising:
At least one processor 520；And
Memory 510, memory 510 are stored with the computer program 511 that can be run on a processor, and processor 520 is held
The step of any distributed document as above transmits storage method is executed when line program.
Based on the same inventive concept, according to another aspect of the present invention, as shown in figure 4, the embodiment of the present invention also mentions
A kind of computer readable storage medium 601 is supplied, computer readable storage medium 601 is stored with computer program instructions 610, meter
The step of any distributed document as above transmits storage method is executed when calculation machine program instruction 610 is executed by processor.
Finally, it should be noted that those of ordinary skill in the art will appreciate that realizing the whole in above-described embodiment method
Or part process, related hardware can be instructed to complete by computer program, program to can be stored in one computer-readable
It takes in storage medium, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, storage medium
It can be magnetic disk, CD, read-only memory (ROM) or random access memory (RAM) etc..The implementation of above-mentioned computer program
Example, can achieve the identical or similar effect of corresponding aforementioned any means embodiment.
In addition, typically, device disclosed by the embodiments of the present invention, equipment etc. can be various electric terminal equipments, such as hand
Machine, personal digital assistant (PDA), tablet computer (PAD), smart television etc., are also possible to large-scale terminal device, such as server
Deng, therefore protection scope disclosed by the embodiments of the present invention should not limit as certain certain types of device, equipment.The present invention is implemented
Client disclosed in example, which can be, is applied to any one of the above electricity with the combining form of electronic hardware, computer software or both
In sub- terminal device.
In addition, disclosed method is also implemented as the computer program executed by CPU according to embodiments of the present invention, it should
Computer program may be stored in a computer readable storage medium.When the computer program is executed by CPU, the present invention is executed
The above-mentioned function of being limited in method disclosed in embodiment.
In addition, above method step and system unit also can use controller and for storing so that controller is real
The computer readable storage medium of the computer program of existing above-mentioned steps or Elementary Function is realized.
In addition, it should be appreciated that the computer readable storage medium (for example, memory) of this paper can be volatibility and deposit
Reservoir or nonvolatile memory, or may include both volatile memory and nonvolatile memory.As an example and
Unrestricted, nonvolatile memory may include read-only memory (ROM), programming ROM (PROM), electrically programmable ROM
(EPROM), electrically erasable programmable ROM (EEPROM) or flash memory.Volatile memory may include that arbitrary access is deposited
Reservoir (RAM), the RAM can serve as external cache.As an example and not restrictive, RAM can be with a variety of
Form obtains, such as synchronous random access memory (DRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate SDRAM (DDR
SDRAM), enhance SDRAM (ESDRAM), synchronization link DRAM (SLDRAM) and directly Rambus RAM (DRRAM).Institute is public
The storage equipment for the aspect opened is intended to the memory of including but not limited to these and other suitable type.
Those skilled in the art will also understand is that, various illustrative logical blocks, mould in conjunction with described in disclosure herein
Block, circuit and algorithm steps may be implemented as the combination of electronic hardware, computer software or both.It is hard in order to clearly demonstrate
This interchangeability of part and software, with regard to various exemplary components, square, module, circuit and step function to its into
General description is gone.This function is implemented as software and is also implemented as hardware depending on concrete application and application
To the design constraint of whole system.The function that those skilled in the art can realize in various ways for every kind of concrete application
Can, but this realization decision should not be interpreted as causing a departure from range disclosed by the embodiments of the present invention.
Various illustrative logical blocks, module and circuit, which can use, in conjunction with described in disclosure herein is designed to
The following component of function here is executed to realize or execute: general processor, digital signal processor (DSP), dedicated integrated electricity
It is road (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete
Any combination of hardware component or these components.General processor can be microprocessor, but alternatively, processor can
To be any conventional processors, controller, microcontroller or state machine.Processor also may be implemented as calculating the group of equipment
Close, for example, the combination of DSP and microprocessor, multi-microprocessor, one or more microprocessors combination DSP and/or it is any its
Its this configuration.
The step of method in conjunction with described in disclosure herein or algorithm, can be directly contained in hardware, be held by processor
In capable software module or in combination of the two.Software module may reside within RAM memory, flash memory, ROM storage
Device, eprom memory, eeprom memory, register, hard disk, removable disk, CD-ROM or known in the art it is any its
In the storage medium of its form.Illustrative storage medium is coupled to processor, enables a processor to from the storage medium
Information is written to the storage medium in middle reading information.In an alternative, storage medium can be integral to the processor
Together.Pocessor and storage media may reside in ASIC.ASIC may reside in user terminal.In an alternative
In, it is resident in the user terminal that pocessor and storage media can be used as discrete assembly.
In one or more exemplary designs, function can be realized in hardware, software, firmware or any combination thereof.
If realized in software, can using function as one or more instruction or code may be stored on the computer-readable medium or
It is transmitted by computer-readable medium.Computer-readable medium includes computer storage media and communication media, which is situated between
Matter includes any medium for helping for computer program to be transmitted to another position from a position.Storage medium can be energy
Any usable medium being enough accessed by a general purpose or special purpose computer.As an example and not restrictive, the computer-readable medium
It may include that RAM, ROM, EEPROM, CD-ROM or other optical disc memory apparatus, disk storage equipment or other magnetic storages are set
It is standby, or can be used for carrying or storage form be instruct or the required program code of data structure and can by general or
Special purpose computer or any other medium of general or specialized processor access.In addition, any connection can suitably claim
For computer-readable medium.For example, if using coaxial cable, optical fiber cable, twisted pair, digital subscriber line (DSL) or all
It is if the wireless technology of infrared ray, radio and microwave to send software from website, server or other remote sources, then above-mentioned coaxial
Cable, fiber optic cable, twisted pair, DSL or such as wireless technology of infrared ray, radio and microwave are included in determining for medium
Justice.As used herein, disk and CD include compact disk (CD), it is laser disk, CD, digital versatile disc (DVD), soft
Disk, Blu-ray disc, wherein disk usually magnetically reproduce data, and CD using laser optics reproduce data.Above content
Combination should also be as being included in the range of computer-readable medium.
It is exemplary embodiment disclosed by the invention above, it should be noted that in the sheet limited without departing substantially from claim
Under the premise of inventive embodiments scope of disclosure, it may be many modifications and modify.According to open embodiment described herein
The function of claim to a method, step and/or movement be not required to the execution of any particular order.In addition, although the present invention is implemented
Element disclosed in example can be described or be required in the form of individual, but be unless explicitly limited odd number, it is understood that be multiple.
It should be understood that it is used in the present context, unless the context clearly supports exceptions, singular " one
It is a " it is intended to also include plural form.It is to be further understood that "and/or" used herein refers to including one or one
Any and all possible combinations of a above project listed in association.
It is for illustration only that the embodiments of the present invention disclose embodiment sequence number, does not represent the advantages or disadvantages of the embodiments.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware
Complete, relevant hardware can also be instructed to complete by program, program can store in a kind of computer-readable storage
In medium, storage medium mentioned above can be read-only memory, disk or CD etc..
It should be understood by those ordinary skilled in the art that: the discussion of any of the above embodiment is exemplary only, not
It is intended to imply that range disclosed by the embodiments of the present invention (including claim) is limited to these examples；In the think of of the embodiment of the present invention
Under road, it can also be combined between the technical characteristic in above embodiments or different embodiments, and there is this hair as above
Many other variations of the different aspect of bright embodiment, for simplicity, they are not provided in details.Therefore, all in the present invention
Within the spirit and principle of embodiment, any omission, modification, equivalent replacement, improvement for being made etc. be should be included in of the invention real
It applies within the protection scope of example.
Claims (10)
1. a kind of distributed document transmits storage method, comprising steps of
File to be transmitted is obtained from the first distributed type assemblies；
Connection pool is established according to configured transmission；
Generate the MD5 value file of the file to be transmitted；
File to be transmitted and the MD5 value file are transmitted to the second distributed type assemblies using the connection pool；
Judge transformation task after the completion whether within a preset period of time without transformation task；
In response to, without transformation task, destroying the connection pool in preset time period.
2. the method as described in claim 1, which is characterized in that establish connection pool according to configured transmission, further comprise:
According to required connection pool size, transport protocol and destination IP, the connection pool is set.
3. method according to claim 2, which is characterized in that further include:
The thread of predetermined quantity is set.
4. the method as described in claim 1, which is characterized in that generate the MD5 value file of the file to be transmitted, further wrap
It includes:
The MD5 value and test.txt file of the file to be transmitted are generated using Google Guava；
The MD5 value is written to file test.txt.md5, to obtain the MD5 value file.
5. the method as described in claim 1, which is characterized in that be passed to the transmission of the second distributed type assemblies using the connection pool
Defeated file and the MD5 value file further comprise:
Connecting object is obtained from the connection pool；
The file to be transmitted is transmitted by connecting object, and transmits the MD5 value file；
After being transmitted, the connecting object is returned into the connection pool.
6. method as claimed in claim 5, which is characterized in that further comprise:
Utilize the MD5 value file verification transmission integrity.
7. the method as described in claim 1, which is characterized in that file to be transmitted is obtained from the first distributed type assemblies, into one
Step includes:
Scan scheduled file in first distributed type assemblies；
The scheduled file is filtered to obtain the file to be transmitted；
The file to be transmitted is backed up.
8. the method as described in claim 1, which is characterized in that further include:
New file to be transmitted is obtained, return step establishes connection pool according to configured transmission and repeats subsequent step.
9. a kind of computer equipment, comprising:
At least one processor；And
Memory, the memory are stored with the computer program that can be run on the processor, which is characterized in that the place
It manages perform claim when device executes described program and requires method described in 1-8 any one.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists
In perform claim requires method described in 1-8 any one when the computer program is executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910572447.9A CN110365754A (en) | 2019-06-28 | 2019-06-28 | A kind of distributed document transmission storage method, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910572447.9A CN110365754A (en) | 2019-06-28 | 2019-06-28 | A kind of distributed document transmission storage method, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110365754A true CN110365754A (en) | 2019-10-22 |
Family
ID=68215806
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910572447.9A Pending CN110365754A (en) | 2019-06-28 | 2019-06-28 | A kind of distributed document transmission storage method, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110365754A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111858454A (en) * | 2020-06-29 | 2020-10-30 | 苏州浪潮智能科技有限公司 | GPU communication method, equipment and medium |
| CN112861188A (en) * | 2021-02-01 | 2021-05-28 | 青岛易来智能科技股份有限公司 | Data aggregation system and method for multiple clusters |
| CN117201479A (en) * | 2023-09-12 | 2023-12-08 | 北京大学 | Cross-cluster file transmission method, system and device |
| CN117201479B (en) * | 2023-09-12 | 2024-07-26 | 北京大学 | Cross-cluster file transmission method, system and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102111301A (en) * | 2011-03-28 | 2011-06-29 | 上海云高软件科技有限公司 | General file transmission system and implementation method thereof |
| CN103136335A (en) * | 2013-01-31 | 2013-06-05 | 北京千分点信息科技有限公司 | Data control method based on data platforms |
| CN104503989A (en) * | 2014-12-03 | 2015-04-08 | 中建材国际贸易有限公司 | Method for completing collection of isomerous database |
| US9098565B1 (en) * | 2009-10-08 | 2015-08-04 | Cellco Partnership | In-house elegant JDBC connection pooling solution for message broker |
| CN106506490A (en) * | 2016-11-03 | 2017-03-15 | 深圳智高点知识产权运营有限公司 | A kind of Distributed Calculation control method and distributed computing system |
| CN106959996A (en) * | 2017-01-20 | 2017-07-18 | 华数传媒网络有限公司 | A kind of back-end data synchronous method based on internet television |
| CN108052622A (en) * | 2017-12-15 | 2018-05-18 | 郑州云海信息技术有限公司 | A kind of storage method based on non-relational database, device and equipment |
-
2019
- 2019-06-28 CN CN201910572447.9A patent/CN110365754A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9098565B1 (en) * | 2009-10-08 | 2015-08-04 | Cellco Partnership | In-house elegant JDBC connection pooling solution for message broker |
| CN102111301A (en) * | 2011-03-28 | 2011-06-29 | 上海云高软件科技有限公司 | General file transmission system and implementation method thereof |
| CN103136335A (en) * | 2013-01-31 | 2013-06-05 | 北京千分点信息科技有限公司 | Data control method based on data platforms |
| CN104503989A (en) * | 2014-12-03 | 2015-04-08 | 中建材国际贸易有限公司 | Method for completing collection of isomerous database |
| CN106506490A (en) * | 2016-11-03 | 2017-03-15 | 深圳智高点知识产权运营有限公司 | A kind of Distributed Calculation control method and distributed computing system |
| CN106959996A (en) * | 2017-01-20 | 2017-07-18 | 华数传媒网络有限公司 | A kind of back-end data synchronous method based on internet television |
| CN108052622A (en) * | 2017-12-15 | 2018-05-18 | 郑州云海信息技术有限公司 | A kind of storage method based on non-relational database, device and equipment |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111858454A (en) * | 2020-06-29 | 2020-10-30 | 苏州浪潮智能科技有限公司 | GPU communication method, equipment and medium |
| CN111858454B (en) * | 2020-06-29 | 2022-11-22 | 苏州浪潮智能科技有限公司 | GPU communication method, equipment and medium |
| CN112861188A (en) * | 2021-02-01 | 2021-05-28 | 青岛易来智能科技股份有限公司 | Data aggregation system and method for multiple clusters |
| CN117201479A (en) * | 2023-09-12 | 2023-12-08 | 北京大学 | Cross-cluster file transmission method, system and device |
| CN117201479B (en) * | 2023-09-12 | 2024-07-26 | 北京大学 | Cross-cluster file transmission method, system and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11501533B2 (en) | Media authentication using distributed ledger | |
| CN102170440B (en) | Method suitable for safely migrating data between storage clouds | |
| CN111047324B (en) | Method and apparatus for updating a set of public keys at a blockchain node | |
| EP3673432B1 (en) | Implementing a blockchain-based workflow | |
| JP2020522149A (en) | Update of the WORLD STATE MARKLE PATRICIA TRIE subtree of the blockchain | |
| CN108377187A (en) | A kind of block chain private key application method and device based on biological characteristic | |
| CN108256354B (en) | Test data-based storage method and storage medium | |
| CN110365754A (en) | A kind of distributed document transmission storage method, equipment and storage medium | |
| CN108694331B (en) | Data storage method, device and system and computer readable storage medium | |
| CN109286677A (en) | A kind of method and device of the file transmission based on FTP | |
| CN104468640A (en) | Method and device for achieving sharing of cloud storage space | |
| CN104301652B (en) | Carry out the method and network hard disk video recorder of web camera access configuration | |
| CN103561033B (en) | User remotely accesses the device and method of HDFS cluster | |
| CN105141681B (en) | The synchronous method and device of RPKI files | |
| CN111931199A (en) | Health authentication method, equipment and medium based on block chain and dynamic code | |
| CN110413433A (en) | Restoration methods, equipment and storage medium after a kind of Maria DB clustering fault | |
| CN110445841A (en) | A kind of method, equipment and the storage medium of cloud physics machine carry cloud disk | |
| CN115514608A (en) | Block consensus method, device, equipment and storage medium | |
| CN110502215A (en) | A kind of construction method, equipment and the storage medium of micro services program | |
| CN109560895A (en) | Data transmission method and device | |
| CN103971059A (en) | Cookie local storage and usage method | |
| CN110442601A (en) | A kind of method and apparatus that Openstack mirror image data accelerates parallel | |
| CN110413354A (en) | It is a kind of to realize the method, equipment and storage medium interacted with third-party platform | |
| CN113449322A (en) | Data sharing method and device based on block chain, electronic equipment and readable medium | |
| Huang et al. | Mutual authentications to parties with QR-code applications in mobile systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191022 |