CN105824932A - Archive system for storing OSS based on Aliskiu object - Google Patents
Archive system for storing OSS based on Aliskiu object Download PDFInfo
- Publication number
- CN105824932A CN105824932A CN201610155390.9A CN201610155390A CN105824932A CN 105824932 A CN105824932 A CN 105824932A CN 201610155390 A CN201610155390 A CN 201610155390A CN 105824932 A CN105824932 A CN 105824932A
- Authority
- CN
- China
- Prior art keywords
- file
- archives economy
- service
- oss
- ali
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012217 deletion Methods 0.000 claims description 3
- 230000037430 deletion Effects 0.000 claims description 3
- 238000000034 method Methods 0.000 description 3
- 230000015556 catabolic process Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000009885 systemic effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses an archive system for storing OSS (open service system) based on an Aliskian object, which belongs to the technical field of cloud storage, and has the following business flows: 1) the application can request the pictures or files to be uploaded to a file server of the file system in a self-help mode. 2) After the uploading is successful, the application calls the service of the file system, the basic information of the file is provided for the service of the file system, and the file system stores the related information of the file into the database. 3) And after the basic information of the file is successfully stored, the file system uploads the file to the oss server. 4) The archive system provides the administrator with a management platform that can view the state of the current file, the logical name of the file stored in the oss, the physical name of the file, etc., and whether the deleted file is enabled. The archive system based on the Ali object storage is a massive, safe and highly reliable cloud storage service provided by the Ali cloud to the outside. Flexible expansion of capacity and processing power.
Description
Technical field
The present invention relates to cloud storage technical field, a kind of archives economy based on Ali's cloud object storage OSS.
Background technology
Archives economy, need to use files passe as in present each operation system, it is an indispensable center service, but the too many complexity existed due to the management of current file, picture etc., including big file transmission, Row control, dynamic capacity-expanding, platform dependency etc..
Our most archives economy at present; being all to be stored on file server by file, the problem existed is as follows: (1) autgmentability is poor, when the insufficient space of target file server; need expansion service device capacity; we need artificial purchase hardware, then join in server by hardware, the most for a user, need the service of shutting down; start shooting the most again service; i.e. have impact on the real-time of system, too increase cost, it is impossible to ensure elastic dilatation.(2) when large batch of user is at real-time reading and writing of files, substantial amounts of concurrency can be produced, it is easy to cause systemic breakdown.(3) stiff picture storage, it is impossible to support the image processing function such as breviary, cutting, watermark, compression and form conversion.
Summary of the invention
The technical assignment of the present invention is to provide a kind of archives economy based on Ali's cloud object storage OSS, settlement server autgmentability is poor, in high volume user's real-time reading and writing of files time be easily caused systemic breakdown problem, archives economy based on Ali's object storage (ObjectStorageService), be Ali's cloud externally provide magnanimity, safe and highly reliable cloud storage service, the resilient expansion of the platform-neutral of RESTFulAPI, capacity and disposal ability.
The technical solution adopted for the present invention to solve the technical problems is:
A kind of archives economy based on Ali's cloud object storage OSS, work flow is as follows:
1) application oneself mode of mistake can please need the picture uploaded or files passe to the file server of archives economy；
2) after uploading successfully, the service of application call archives economy, the essential information (including the description of System Number, business numbering, form number, file type, file extension, physical file title, logical file title, file, personal code work) of file is supplied to archives economy service, and the relevant information of file is saved in data base by archives economy；
3), after document base information preserves successfully, archives economy is by files passe to oss server.Return inquiry, deletion, download interface to corresponding user so that the storage size in the action uploaded, concrete files passe to oss and on oss, safety that user only focuses on all are managed by oss simultaneously；
4) archives economy is supplied to one management platform of manager, can check the state of current file, and file is stored in the physical name etc. of the logical name of oss, file, and whether enables deleted file;
Described archives economy provides three application interfaces, specifically comprises the following steps that
1) archives economy file newly-increased service CreateArchiveFile (Stringjsonstr);
2) archives economy file polling service QueryArchiveFile (Stringjsonstr);
3) service DeleteArchiveFile (Stringjsonstr) deleted by archives economy file.
Described archives economy file newly-increased service CreateArchiveFile, application oneself mode of mistake can please need the picture uploaded or files passe to the file server of archives economy, call CreateArchiveFile service, the json string of transmitting file in request, mainly includes that business datum content is: System Number, business numbering, form number, file type, file extension, physical file title, logical file title, file describe, personal code work.
Described archives economy file polling service QueryArchiveFile, the QueryArchiveFile service of application call archives economy, the json string of request, mainly includes System Number, business numbering, form number, personal code work, can return all listed files uploaded of active user.
Service DeleteArchiveFile deleted by described archives economy file, the QueryArchiveFile service of application call archives economy, and the json string of request specifically includes that physical file title.
A kind of based on Ali's cloud object storage OSS archives economy of the present invention compared with prior art, has the advantages that
Archives economy stores (ObjectStorageService) based on Ali's object, be Ali's cloud externally provide magnanimity, safe and highly reliable cloud storage service feature, carry out the Opening of service interface on its basis, provide the user service interface simple, efficient.For a user, they are that corresponding file uploaded by needs, and without going, concern memory space is enough.When high-volume user accesses archives economy, archives economy can transmit the request to oss server, oss the distributed request carrying out file processes, it is ensured that big and give user and access normally.Our service interface can preserve the relevant information of file simultaneously, for manager, and the correlation behavior checking file that can be real-time and do corresponding file process.
Accompanying drawing explanation
Fig. 1 is archives economy files passe schematic diagram of the present invention；
Fig. 2 archives economy of the present invention files passe implements block diagram.
Detailed description of the invention
The invention will be further described below in conjunction with the accompanying drawings.
The most sequentially, archives economy files passe divides the following steps:
(1) application oneself mode of mistake can please need the picture uploaded or files passe to the file server of archives economy.
(2) after uploading successfully, the service of application call archives economy, the essential information (including the description of System Number, business numbering, form number, file type, file extension, physical file title, logical file title, file, personal code work) of file is supplied to archives economy service, and the relevant information of file is saved in data base by archives economy.
(3), after document base information preserves successfully, archives economy is by files passe to oss server.Return inquiry, deletion, download interface to corresponding user so that the storage size in the action uploaded, concrete files passe to oss and on oss, safety that user only focuses on all are managed by oss simultaneously.
Fig. 2 is the step that implements of files passe:
(1) user is without safe ID and key, first to file.
(2) client object of transmitting file in establishment.
(3) whether inquiry has file storage object, if it does not exist, then create this object, arranges corresponding access limit simultaneously.
(4) concrete file is uploaded.
Archives economy provides three application interfaces at present, specifically comprises the following steps that
(1) archives economy file newly-increased service CreateArchiveFile (Stringjsonstr);
Application oneself mode of mistake can please need the picture uploaded or files passe to the file server of archives economy, call CreateArchiveFile service, the json string of transmitting file in request, mainly includes that business datum content is: System Number, business numbering, form number, file type, file extension, physical file title, logical file title, file describe, personal code work.
(2) archives economy file polling service QueryArchiveFile (Stringjsonstr);
The QueryArchiveFile service of application call archives economy, the json string of request, mainly include System Number, business numbering, form number, personal code work.The all listed files uploaded of active user can be returned.
(3) service DeleteArchiveFile (Stringjsonstr) deleted by archives economy file;
The QueryArchiveFile service of application call archives economy, the json string of request, specifically include that physical file title.
Files passe, it would be desirable to the path of definition files passe, the i.e. path of file server, then sets up the native object OSSClientclient=newOSSClient (ACCESS_ID, ACCESS_KEY) of oss files passe;Before uploading, we to see if there is the Bucket existed, if Bucket does not create, then creates new Bucket, client.createBucket (bucketName);Also needing to verify whether to have permission upload, arranging authority is client.setBucketAcl (bucketName, CannedAccessControlList.PublicRead);It is arranged to public access limit.Files passe mainly can be crossed and call client.putObject (bucketName, key, input, objectMeta);By files passe to oss server, the inside of files passe realizes seeing accompanying drawing 2.Concrete deployment is as follows:
1, firstly the need of the safe ID(AccessKeyID of the safe key created in the user of Ali's cloud for accessing OSS) and safe key (AccessKeySecret)；
2, the OSS server address using acquiescence creates OSSClient object, OSSClientclient=newOSSClient (ACCESS_ID, ACCESS_KEY)；
3, before uploading, we to see if there is the file storage object (Bucket) existed, and creation method is as follows:
privatestaticvoidCreateBucket(OSSClientclient,StringbucketName)
throwsOSSException,ClientException{
try{
// create bucket
client.createBucket(bucketName);
}catch(ServiceExceptione){
if(!OSSErrorCode.BUCKET_ALREADY_EXISTS.equals(e.getErrorCode())){
If // Bucket has existed, then ignore
throwe;
}
}
4, needing to arrange authority to upload, arranging authority is:
privatestaticvoidsetBucketPublicReadable(OSSClientclient,StringbucketName)
throwsOSSException,ClientException{
// access rights of bucket, public-read-write authority are set
client.setBucketAcl(bucketName,CannedAccessControlList.PublicReadWrite);
}
Authority has a three types: the public reading of CannedAccessControlList.Private private permission, CannedAccessControlList.PublicRead, the public read-write of CannedAccessControlList.PublicReadWrite
5, files passe:
privatestaticvoiduploadFile(OSSClientclient,StringbucketName,Stringkey,Stringfilename)
throwsOSSException,ClientException,FileNotFoundException{
Filefile=newFile(filename);
ObjectMetadataobjectMeta=newObjectMetadata();
objectMeta.setContentLength(file.length());
// can in metadata labelling file type
objectMeta.setContentType("image/jpeg");
InputStreaminput=newFileInputStream(file);
client.putObject(bucketName,key,input,objectMeta);
}
File download:
File download, when locally-downloaded, it would be desirable to provide store path, for the form of far call interface, owing to we are upper transmitting file when, according to the rule defined, can directly return the url of file, user can directly download according to this url, client downloads can call client.getObject (newGetObjectRequest (bucketName, key), newFile (filename)), partial code is as follows:
privatestaticvoiddownloadFile(OSSClientclient,StringbucketName,Stringkey,Stringfilename)
throwsOSSException,ClientException{
// generate the file monitored in bucket
ObjectListingObjectListing=client.listObjects(bucketName);
List<OSSObjectSummary>allfileList=ObjectListing
.getObjectSummaries();
StringobjName;
The file in container is read in // circulation
for(inti=0;i<allfileList.size();i++){
objName=allfileList.get(i).getKey();
client.getObject(newGetObjectRequest(bucketName,objName),
newFile(filename+objName));
}
}
File is deleted:
File is deleted, and deletes interface DeleteArchiveFile, and we can individually delete a file, it is also possible to batch deletes the All Files under a Bucket, and traversal file can use ObjectListing.getObjectSummaries ();Delete file and can use client.deleteObject (bucketName, objectName);It is as follows that part deletes code:
privatestaticvoiddeleteBucket(OSSClientclient,StringbucketName)
throwsOSSException,ClientException{
ObjectListingObjectListing=client.listObjects(bucketName);
List<OSSObjectSummary>deleteList=ObjectListing
.getObjectSummaries();
System.out.println(deleteList);
for(inti=0;i<deleteList.size();i++){
StringobjectName=deleteList.get(i).getKey();
If // it is not empty, first delete the file under bucket
client.deleteObject(bucketName,objectName);
}
}
Claims (4)
1. an archives economy based on Ali's cloud object storage OSS, it is characterised in that work flow is as follows:
1) application oneself mode of mistake can please need the picture uploaded or files passe to the file server of archives economy；
2) after uploading successfully, the service of application call archives economy, the essential information (including the description of System Number, business numbering, form number, file type, file extension, physical file title, logical file title, file, personal code work) of file is supplied to archives economy service, and the relevant information of file is saved in data base by archives economy；
3) after document base information preserves successfully, archives economy is by files passe to oss server, return inquiry, deletion, download interface to corresponding user simultaneously, the storage size in the action uploaded, concrete files passe to oss and on oss that user only focuses on, safety are all managed by oss；
4) archives economy is supplied to one management platform of manager, can check the state of current file, and file is stored in the physical name etc. of the logical name of oss, file, and whether enables deleted file;
Described archives economy provides three application interfaces, specifically comprises the following steps that
1) archives economy file newly-increased service CreateArchiveFile (Stringjsonstr);
2) archives economy file polling service QueryArchiveFile (Stringjsonstr);
3) service DeleteArchiveFile (Stringjsonstr) deleted by archives economy file.
A kind of archives economy based on Ali's cloud object storage OSS the most according to claim 1, it is characterized in that archives economy file newly-increased service CreateArchiveFile, application oneself mode of mistake can please need the picture uploaded or files passe to the file server of archives economy, call CreateArchiveFile service, the json string of transmitting file in request, mainly includes that business datum content is: System Number, business numbering, form number, file type, file extension, physical file title, logical file title, file describe, personal code work.
A kind of archives economy based on Ali's cloud object storage OSS the most according to claim 1, it is characterized in that archives economy file polling services QueryArchiveFile, the QueryArchiveFile service of application call archives economy, the json string of request, mainly include System Number, business numbering, form number, personal code work, all listed files uploaded of active user can be returned.
A kind of archives economy based on Ali's cloud object storage OSS the most according to claim 1, it is characterized in that service DeleteArchiveFile deleted by archives economy file, the QueryArchiveFile service of application call archives economy, the json string of request, specifically include that physical file title.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610155390.9A CN105824932A (en) | 2016-03-18 | 2016-03-18 | Archive system for storing OSS based on Aliskiu object |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610155390.9A CN105824932A (en) | 2016-03-18 | 2016-03-18 | Archive system for storing OSS based on Aliskiu object |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105824932A true CN105824932A (en) | 2016-08-03 |
Family
ID=56523905
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610155390.9A Pending CN105824932A (en) | 2016-03-18 | 2016-03-18 | Archive system for storing OSS based on Aliskiu object |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105824932A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107343050A (en) * | 2017-07-11 | 2017-11-10 | 山东浪潮通软信息科技有限公司 | It is a kind of that annex is sorted out to the method for dumping to electronic image system |
| CN107729504A (en) * | 2017-10-23 | 2018-02-23 | 武汉楚鼎信息技术有限公司 | A kind of method and system for handling large data objectses |
| CN109302499A (en) * | 2018-11-30 | 2019-02-01 | 成都华栖云科技有限公司 | A kind of storage gateway of compatible access nas storage and oss storage |
| CN109325158A (en) * | 2018-09-26 | 2019-02-12 | 厦门海迈科技股份有限公司 | A kind of electronic document automation archiving method and system |
| CN109831534A (en) * | 2019-03-19 | 2019-05-31 | 深圳市云语科技有限公司 | A kind of document transmission system based on the storage of Ali's cloud OSS object |
| CN110519400A (en) * | 2019-10-17 | 2019-11-29 | 南京甄视智能科技有限公司 | Equipment flow is carried out to the implementation method of the platform of internet of things of multiple entry separation |
| CN110851406A (en) * | 2019-11-19 | 2020-02-28 | 广东电网有限责任公司 | Power grid section storage method based on OSS distribution and back-end service platform |
| CN112445414A (en) * | 2019-08-30 | 2021-03-05 | 青岛海信移动通信技术股份有限公司 | Data processing method and device |
| CN113098941A (en) * | 2021-03-25 | 2021-07-09 | 浙江大学 | Virtual reality content distributed management method and system based on integral excitation |
| CN114710483A (en) * | 2022-06-08 | 2022-07-05 | 杭州比智科技有限公司 | Unified transmission method and system based on multi-cloud object storage |
| CN118042191A (en) * | 2024-04-10 | 2024-05-14 | 一网互通(北京)科技有限公司 | Method and device for improving success rate of sending video material by media platform |
| CN118042191B (en) * | 2024-04-10 | 2024-06-21 | 一网互通(北京)科技有限公司 | Method and device for improving success rate of sending video material by media platform |
-
2016
- 2016-03-18 CN CN201610155390.9A patent/CN105824932A/en active Pending
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107343050A (en) * | 2017-07-11 | 2017-11-10 | 山东浪潮通软信息科技有限公司 | It is a kind of that annex is sorted out to the method for dumping to electronic image system |
| CN107729504A (en) * | 2017-10-23 | 2018-02-23 | 武汉楚鼎信息技术有限公司 | A kind of method and system for handling large data objectses |
| CN109325158B (en) * | 2018-09-26 | 2021-01-05 | 厦门海迈科技股份有限公司 | Automatic electronic file filing method and system |
| CN109325158A (en) * | 2018-09-26 | 2019-02-12 | 厦门海迈科技股份有限公司 | A kind of electronic document automation archiving method and system |
| CN109302499A (en) * | 2018-11-30 | 2019-02-01 | 成都华栖云科技有限公司 | A kind of storage gateway of compatible access nas storage and oss storage |
| CN109831534A (en) * | 2019-03-19 | 2019-05-31 | 深圳市云语科技有限公司 | A kind of document transmission system based on the storage of Ali's cloud OSS object |
| CN112445414A (en) * | 2019-08-30 | 2021-03-05 | 青岛海信移动通信技术股份有限公司 | Data processing method and device |
| CN112445414B (en) * | 2019-08-30 | 2023-02-03 | 青岛海信移动通信技术股份有限公司 | Data processing method and device |
| CN110519400A (en) * | 2019-10-17 | 2019-11-29 | 南京甄视智能科技有限公司 | Equipment flow is carried out to the implementation method of the platform of internet of things of multiple entry separation |
| CN110519400B (en) * | 2019-10-17 | 2022-03-25 | 南京甄视智能科技有限公司 | Method for realizing Internet of things platform for carrying out multi-inlet separation on equipment flow |
| CN110851406A (en) * | 2019-11-19 | 2020-02-28 | 广东电网有限责任公司 | Power grid section storage method based on OSS distribution and back-end service platform |
| CN113098941A (en) * | 2021-03-25 | 2021-07-09 | 浙江大学 | Virtual reality content distributed management method and system based on integral excitation |
| CN114710483A (en) * | 2022-06-08 | 2022-07-05 | 杭州比智科技有限公司 | Unified transmission method and system based on multi-cloud object storage |
| CN114710483B (en) * | 2022-06-08 | 2022-09-09 | 杭州比智科技有限公司 | Unified transmission method and system based on multi-cloud object storage |
| CN118042191A (en) * | 2024-04-10 | 2024-05-14 | 一网互通(北京)科技有限公司 | Method and device for improving success rate of sending video material by media platform |
| CN118042191B (en) * | 2024-04-10 | 2024-06-21 | 一网互通(北京)科技有限公司 | Method and device for improving success rate of sending video material by media platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105824932A (en) | Archive system for storing OSS based on Aliskiu object | |
| US9864736B2 (en) | Information processing apparatus, control method, and recording medium | |
| CN103731483A (en) | Virtual file system based on cloud computing | |
| CN105474206A (en) | Virtual synchronization with on-demand data delivery | |
| CN102708152A (en) | Integrated management method for electronic evidence | |
| Tso et al. | iPhone social networking for evidence investigations using iTunes forensics | |
| CN103049491A (en) | Method and device for managing picture file | |
| WO2017174013A1 (en) | Data storage management method and apparatus, and data storage system | |
| CN103067479A (en) | Network disk synchronized method and system based on file coldness and hotness | |
| CN105554137A (en) | Backup system and method | |
| CN103019891A (en) | Method and system for restoring deleted file | |
| CN102523301A (en) | Method for caching data on client in cloud storage | |
| CN105978944A (en) | Object storage method and device | |
| KR101666064B1 (en) | Apparatus for managing data by using url information in a distributed file system and method thereof | |
| CN113448946B (en) | Data migration method and device and electronic equipment | |
| CN110865981A (en) | File access method for mobile terminal and mobile terminal thereof | |
| CN108243207A (en) | A kind of date storage method of network cloud disk | |
| CN1786951A (en) | Computer file system allowing ambiguous names | |
| CN1532714A (en) | Transmission control of image data in digital image system | |
| CN109558082B (en) | Distributed file system | |
| US8423585B2 (en) | Variants of files in a file system | |
| CN104281486B (en) | A kind of virtual machine treating method and apparatus | |
| CN106649528A (en) | Picture writing and reading methods and devices | |
| CN112347046B (en) | Method for acquiring creation time of file in distributed system | |
| JP5972455B2 (en) | How to delete information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160803 |