CN109446168B - Method for sharing configuration file based on InData-Kudu object storage - Google Patents
Method for sharing configuration file based on InData-Kudu object storage Download PDFInfo
- Publication number
- CN109446168B CN109446168B CN201811220363.0A CN201811220363A CN109446168B CN 109446168 B CN109446168 B CN 109446168B CN 201811220363 A CN201811220363 A CN 201811220363A CN 109446168 B CN109446168 B CN 109446168B
- Authority
- CN
- China
- Prior art keywords
- configuration file
- indata
- kudu
- application
- name
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 16
- 238000013500 data storage Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/65—Updates
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Storage Device Security (AREA)
Abstract
The invention provides a method for sharing a configuration file based on InData-Kudu object storage, which belongs to the technical field of object storage application. When accessing the configuration file, the IP address, port and object name (configuration file name), user name, password and the like of the InData-Kudu are input by using an API (application program interface) or Rest service provided by the InData-Kudu, and the configuration file can be accessed.
Description
Technical Field
The invention relates to an object storage application technology, in particular to a method for sharing configuration files based on InData-Kudu object storage.
Background
The existing enterprise or government IT often has a plurality of application programs which are distributed on different machines, and sometimes the configuration is mostly the same, such as database connection, but the database connection needs to be frequently modified for safety reasons, so that the configuration files of all servers need to be modified, the workload is very large, and the operation is troublesome and easy to make mistakes.
Some systems may be online frequently, and each packaging requires replacing the configuration files with those of the formal environment, which is very labor intensive and error prone due to the numerous and cluttered configuration files.
The container technology is popular at present, but the application configuration files deployed in the containers are not suitable to be changed, and the original configuration files of the new containers cannot be used once one container disappears and the new container is started. Therefore, it is desirable to isolate the configuration file from the system, such as sharing the configuration file to other places, so that only the code part needs to be updated when the program is updated, the configuration file is not managed, the configuration of the shared place is changed, and each server is not needed to change the configuration.
Some implement configuration file sharing based on zookeeper, which can be sufficient for KB level configuration files and a small number of configuration files, but cannot be done if the configuration files are large, such as a dictionary type configuration file of dozens of MB or even larger.
Some people put the shared configuration file on the NFS, but the NFS has a problem, and the NFS shared directory is easy to have a single point of failure or a network failure to cause application suspension, so that normal use of a plurality of applications is influenced, and the NFS is not suitable for a scenario of the configuration file on the internet.
The InData-Kudu is a distributed database management system, can store PB-level structured data and PB-EB-level unstructured data, and the InData-Kudu stores the unstructured data in an object storage mode.
One object of the InData-Kudu is as small as 1 byte and as large as TB level, the number of the objects supporting storage can be as large as billions, the InData-Kudu object can have multiple copies distributed on different nodes to support fault tolerance, and the InData-Kudu object storage has high availability, high performance and high concurrency support capability.
Disclosure of Invention
The invention provides a method for sharing configuration files based on InData-Kudu object storage, which can be used for sharing numerous configuration files with different sizes in the InData-Kudu object storage, can solve the problems of the scheme, and has better performance and wide application range.
The technical scheme of the invention is as follows:
a method for sharing configuration files based on InData-Kudu object storage,
the application and the configuration file are separated, and the configuration file used by the application is directly stored into the InData-Kudu object storage as an object for sharing.
Further, the configuration file name is used as an object name, the content of the configuration file is stored in the object, and the form of the object name is compatible with the path name of the configuration file.
Furthermore, when accessing the configuration file, the configuration file can be accessed by inputting the IP address, the port and the object name, the user name and the password of the InData-Kudu by using the API (application program interface) or the Rest service provided by the InData-Kudu, and the information of the configuration file is obtained by any computer connected with the network, thereby achieving the purpose of sharing the configuration file.
Further, the shared configuration file on the InData-Kudu object store is accessed over a connected network, i.e., an application, over a local area network, a wide area network, or the Internet.
Further, for the application that can be modified, the application accesses the configuration file on the InData-Kudu object storage through the Rest service or API provided by the InData-Kudu and through the local area network, the wide area network or the Internet.
Further, for an application which cannot be modified, an application starting script is added, the application starting script downloads the configuration file stored in the InData-Kudu to the local server through an InData-Kudu object storage client tool, and then the application can read the latest configuration file.
The invention has the advantages that
The invention provides a method for sharing configuration files based on InData-Kudu object storage, which can be used for sharing numerous configuration files with different sizes in the InData-Kudu object storage, can solve the problems in the background technology, and has better performance and wide application range.
Drawings
Fig. 1 is a schematic diagram of the operation of the present invention.
Detailed Description
The invention is explained in more detail below:
at present, the data in the field of big data has various sources, and includes both structured data similar to a relational model and unstructured data such as texts and pictures, and as a big data storage component, various challenges are faced, and the big data storage component can support efficient storage of both structured data and unstructured data, and can perform efficient analysis and low-delay random reading and writing in massive structuring and unstructured. As a big data storage component, high availability and security are also supported, providing scalability.
The InData-Kudu as a big data storage component can support the storage, analysis and random reading and writing of structured data efficiently, can support the efficient storage and reading of unstructured data, and provides high availability and expandability and a simple management platform.
The InData-Kudu logic is mainly divided into five modules of storage, SQL, development interface, tool and console.
The method takes the configuration file used by the application as an object to be directly stored in the InData-Kudu object storage.
The InData-Kudu is a distributed database management system issued by the wave tide, can store PB-level structured data and PB-EB-level unstructured data, and the InData-Kudu stores the unstructured data in an object storage form. One object of the InData-Kudu is as small as 1 byte and as large as TB level, the number of configuration files (objects) supporting storage can be as large as billions, and the InData-Kudu object can have multiple copies distributed on different nodes to support fault tolerance.
As shown in fig. 1, the configuration file used by the application is directly stored in the InData-Kudu object storage as one object, the name of the configuration file is used as the object name, the content of the configuration file is stored in the object, and the form of the object name is compatible with the path name of the configuration file. If the original configuration file name is/data/cfg/oracle.cfg, the object name is/data/cfg/oracle.cfg. When accessing the configuration file, the IP address, port and object name (configuration file name), user name, password and the like of the InData-Kudu are input by using an API (application program interface) or Rest service provided by the InData-Kudu, and the configuration file can be accessed.
For a modifiable application, the application may access the configuration file on the InData-Kudu object store through the Rest service or API interface provided by InData-Kudu, through a local area network, a wide area network, or the Internet.
For the application which cannot be modified, if the application can only access the configuration file on the local server without changing the source code, an application starting script can be added, the application starting script firstly downloads the shared configuration file stored in the InData-Kudu to the local server through the InData-Kudu object storage client tool, and then the application can read the latest configuration file.
Taking configuration file/data/cfg/oracle.cfg as an example, a specific method for obtaining the configuration file through the InData-Kudu object storage client tool is as follows: osget/data/cfg/oracle.
Taking a container application scenario as an example, all applications in a plurality of containers need to read a configuration file/data/cfg/oracle.cfg, but the content in the/data/cfg/oracle.cfg needs to be changed, on one hand, it is troublesome to change each container one by one, the workload is large, errors are easy to occur, and in addition, the container generally does not allow logging in a container operating system to change the configuration file, but the method only needs to update the content of a new configuration file into the InData-Kudu object storage, so that the latest configuration file content can be obtained when the applications in the containers are started, and an example of a command for updating the configuration file is osup/data/cfg/oracle.cfg.
Based on the scheme, the problem of sharing mass configuration files in mass application can be solved, and the system has high performance and high availability and is wide in application range.
Claims (6)
1. A method for sharing configuration files based on InData-Kudu object storage is characterized in that,
separating the application from the configuration file, and directly storing the configuration file used by the application as an object into an InData-Kudu object storage for sharing;
further comprising the steps of (a) further comprising,
the configuration file name is used as an object name, the content of the configuration file is stored in an object, and the form of the object name is compatible with the path name of the configuration file;
further comprising the steps of (a) further comprising,
when accessing the configuration file, the IP address, the port and the object name, the user name and the password of the InData-Kudu are input by utilizing an API (application program interface) or Rest service provided by the InData-Kudu, and the configuration file can be accessed, and the information of the configuration file is obtained through any computer connected with the network, so that the purpose of sharing the configuration file is achieved.
2. The method of claim 1,
further comprising the steps of (a) further comprising,
the shared configuration file on the InData-Kudu object store is accessed over a connected network, i.e., an application, over a local area network, a wide area network, or the Internet.
3. The method of claim 2,
further comprising the steps of (a) further comprising,
for the application that can be modified, the application accesses the configuration file on the InData-Kudu object storage through the local area network, the wide area network or the Internet through the Rest service or API interface provided by the InData-Kudu.
4. The method of claim 2,
further comprising the steps of (a) further comprising,
for the application which cannot be transformed, an application starting script is added, the application starting script downloads the configuration file stored in the InData-Kudu to the local server through an InData-Kudu object storage client tool, and then the application can read the latest configuration file.
5. The method of claim 1,
further comprising the steps of (a) further comprising,
the InData-Kudu can store PB level structured data and PB level unstructured data to EB level unstructured data, and the InData-Kudu stores the unstructured data in the form of object storage.
6. The method of claim 5,
further comprising the steps of (a) further comprising,
more than one copy of the InData-Kudu object is distributed across different nodes to support fault tolerance.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811220363.0A CN109446168B (en) | 2018-10-19 | 2018-10-19 | Method for sharing configuration file based on InData-Kudu object storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811220363.0A CN109446168B (en) | 2018-10-19 | 2018-10-19 | Method for sharing configuration file based on InData-Kudu object storage |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109446168A CN109446168A (en) | 2019-03-08 |
| CN109446168B true CN109446168B (en) | 2021-11-16 |
Family
ID=65546740
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811220363.0A Active CN109446168B (en) | 2018-10-19 | 2018-10-19 | Method for sharing configuration file based on InData-Kudu object storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109446168B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693235A (en) * | 2011-03-23 | 2012-09-26 | 鸿富锦精密工业（深圳）有限公司 | Information notification device and method of altered equipment configuration file |
| CN107463695A (en) * | 2017-08-14 | 2017-12-12 | 浪潮软件股份有限公司 | A kind of method and device of data storage |
| CN107784098A (en) * | 2017-10-24 | 2018-03-09 | 百味云科技股份有限公司 | Real-time data warehouse platform |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080154851A1 (en) * | 2006-12-21 | 2008-06-26 | Canon Kabushiki Kaisha | Method and apparatus for sharing files over a network |
-
2018
- 2018-10-19 CN CN201811220363.0A patent/CN109446168B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693235A (en) * | 2011-03-23 | 2012-09-26 | 鸿富锦精密工业（深圳）有限公司 | Information notification device and method of altered equipment configuration file |
| CN107463695A (en) * | 2017-08-14 | 2017-12-12 | 浪潮软件股份有限公司 | A kind of method and device of data storage |
| CN107784098A (en) * | 2017-10-24 | 2018-03-09 | 百味云科技股份有限公司 | Real-time data warehouse platform |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109446168A (en) | 2019-03-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11461270B2 (en) | Shard splitting | |
| US9172750B2 (en) | Cluster-node load balancing in a distributed database system | |
| US9778996B1 (en) | File system version set infrastructure | |
| US8214355B2 (en) | Small table: multitenancy for lots of small tables on a cloud database | |
| US11321291B2 (en) | Persistent version control for data transfer between heterogeneous data stores | |
| US20160259811A1 (en) | Method and system for metadata synchronization | |
| US8321487B1 (en) | Recovery of directory information | |
| US8874626B2 (en) | Tracking files and directories related to unsuccessful change operations | |
| US20100088271A1 (en) | Hsm two-way orphan reconciliation for extremely large file systems | |
| CN111290826A (en) | Distributed file system, computer system, and medium | |
| US20180260155A1 (en) | System and method for transporting a data container | |
| CN116848517A (en) | Cache indexing using data addresses based on data fingerprints | |
| US20170270149A1 (en) | Database systems with re-ordered replicas and methods of accessing and backing up databases | |
| Jiang et al. | A novel clustered MongoDB-based storage system for unstructured data with high availability | |
| CN109446168B (en) | Method for sharing configuration file based on InData-Kudu object storage | |
| US11962686B2 (en) | Encrypting intermediate data under group-level encryption | |
| US11683161B2 (en) | Managing encryption keys under group-level encryption | |
| US11907162B2 (en) | Minimizing data volume growth under encryption changes | |
| US8516023B1 (en) | Context based file system | |
| US11501014B2 (en) | Secure data replication in distributed data storage environments | |
| Wu et al. | Seven NoSQL Databases in a Week: Get up and running with the fundamentals and functionalities of seven of the most popular NoSQL databases | |
| US11657046B1 (en) | Performant dropping of snapshots by converter branch pruning | |
| US20230188324A1 (en) | Initialization vector handling under group-level encryption | |
| US11550760B1 (en) | Time-based partitioning to avoid in-place updates for data set copies | |
| US20230376451A1 (en) | Client support of multiple fingerprint formats for data file segments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211027 Address after: 271000 Langchao science and Technology Park, 527 Dongyue street, Tai'an City, Shandong Province Applicant after: INSPUR SOFTWARE Co.,Ltd. Address before: 250100 Ji'nan hi tech Zone No. 2877, Shandong Province Applicant before: INSPUR GROUP Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |