CN104731939A - Method for sharing data among tenants through data table - Google Patents
Method for sharing data among tenants through data table Download PDFInfo
- Publication number
- CN104731939A CN104731939A CN201510146460.XA CN201510146460A CN104731939A CN 104731939 A CN104731939 A CN 104731939A CN 201510146460 A CN201510146460 A CN 201510146460A CN 104731939 A CN104731939 A CN 104731939A
- Authority
- CN
- China
- Prior art keywords
- data
- tenant
- tables
- tenants
- shared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 238000013523 data management Methods 0.000 claims abstract description 13
- 238000007726 management method Methods 0.000 claims abstract description 13
- 230000001360 synchronised effect Effects 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 6
- 238000002955 isolation Methods 0.000 description 3
- 206010037660 Pyrexia Diseases 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Storage Device Security (AREA)
Abstract
The invention discloses a method for sharing data among tenants through a data table, which comprises the following concrete implementation processes: firstly, tenant data source management is carried out: in a cloud computing environment, a tenant inputs a data source through an online web page, applies for a new data management service, starts a timer after the input is finished, and updates data at regular time; and (3) carrying out data classification: combing and customizing the data directory and the grouping list information, and enabling a tenant to associate the created data table with the corresponding data directory, so that the data table can be conveniently retrieved and browsed; and finishing data sharing: the data tables of the tenants are shared in an open mode and are applied for use among the data tables. Compared with the prior art, the method for sharing data among tenants through the data table has the advantages that a resource management mode which is highly flexible and easy to use among tenants is achieved, high sharing of data resources among multiple tenants is achieved, the practicability is high, and the popularization is easy.
Description
Technical field
The present invention relates to large data technique field, specifically between a kind of practical, tenant, shared the method for data by tables of data.
Background technology
Many tenants technology (English: multi-tenancy technology) or claim multiple leasing techniques, it is a kind of software architecture technology, it is being inquired into and is realizing how under the environment of multi-user, sharing identical system or program assembly, and still can guarantee the isolation of data between each user.
Due to the fever of cloud computing subject under discussion, as how triangular web framework and service provide the service of the identical even customizable of most client in the data center shared, and still can ensure the data isolation of client, allow many tenants technology become aobvious under cloud computing technology.
In the epoch of cloud computing, large data, between tenant data management, to share and utilize be an important problem, how effectively the data resource of management and cloud computing determines the vitality of the upper layer application ecosystem, based on this, a kind of method being shared data between tenant by tables of data is now provided, the method is from the angle of data management, data sharing and data separate, and with a kind ofly gearing to actual circumstances, healthy and strong easy-to-use mode is the sharing and utilize the solution proposing a kind of practicality of large data under cloud computing environment.
Summary of the invention
Technical assignment of the present invention is for above weak point, provides a kind of method being shared data between practical, tenant by tables of data.
Shared a method for data between tenant by tables of data, its specific implementation process is:
First carry out tenant data source control: under cloud computing environment, tenant, by online web page logging data source, applies for new data management service, after typing, and opening timing device, timing more new data;
Carry out Data classification: combing customization data catalogue and group list information, the upper corresponding data directory of tables of data association that tenant will create, is convenient to the retrieval of tables of data and browses;
Complete data sharing: the tables of data opening and shares of tenant also uses carrying out application each other.
Described data source is relevant database or HBASE NoSQL database, comprises following information in this data source: IP, port, data source types, character set, description, field, table information.
The process of described timing more new data is: the database dynamically under pulling data source, table information and field information, and by these metadata automatic synchronizations to data management system, opening timing device, regularly according to the change tread more new metadata of real data table.
Between described tenant, each tenant of data source management uses a set of independently data management service, and the data between tenant are mutually isolated, are independent of each other.
Described Data classification is divided into vertical and horizontal two kinds: longitudinal classification is separate data dimension, and this data dimension comprises key element, department; Horizontal Data classification is the classification under same data dimension, comprises the personnel under same key element and article.
In described data sharing step, after cloud tenant selects the data that will open, tables of data is synchronized in Hive by ETL service by system automatically, and using Hive as data warehouse, carry out the management of data permission, the data of many tenants are unified in Hive and store; Open data can be applied for using by other tenants; Tenant carries out correlation inquiry and analysis in conjunction with the tables of data of application and the tables of data of self by SQL beyond the clouds, and the execution authority of SQL is controlled by software systems, carries out Logic judgment according to data application status.
Shared the method for data between a kind of tenant of the present invention by tables of data, have the following advantages:
To be shared the method for data between a kind of tenant that the present invention proposes by tables of data, solve multi-tenant data resource online management under cloud computing environment, data isolation between metadata management and tenant; Solve the sharing problem of large data between tenant, for high in the clouds data mining provides basis; Support data application between tenant, data examination & verification and license, allowing tenant based on the privately owned data resource of web page online management, data sharing can be carried out by data application; Share that data are unified after ETL data importing to be stored in Hive, using Hive as data warehouse, that is undertaken showing by data application between tenant shares; Practical, be easy to promote.
Embodiment
Below by specific embodiment, the invention will be further described.
The invention discloses a kind of method being shared data between tenant by tables of data, under privately owned cloud, the online data management of the multi-source data resources such as many tenants remote data source, RDS data source and the utilization of resources, carry out sharing of data between tenant in conjunction with Hive, Kettle and utilize, the data integration for organizing, under multidisciplinary and multiservice system and share a whole set of the solution proposed more.
Its specific implementation process comprises following three steps:
One, tenant data source control.
Under cloud computing environment, tenant applies for a new data management service, applies for by rear, by online web page logging data source.
Data source comprises the NoSQL database such as relevant database and HBASE of main flow, data source information comprises the information such as IP, port, data source types, character set, description, after typing, database under dynamic pulling data source, table information and field information, these metadata are synchronized automatically between data management system, opening timing device, timing is according to the change tread more new metadata of real data table.
Be different from general metadata management system, between tenant, data source management is based on cloud computing environment, and each tenant can apply for a set of independently data management service, and the data between tenant are mutually isolated, are independent of each other.
Two, Data classification.
According to industry characteristic combing and customized data directory and group list information, the data directory of the upper correspondence of tables of data association that tenant will create, is convenient to the retrieval of tables of data and browses.
Data classification is divided into vertical and horizontal two kinds of patterns, and longitudinal classification can be separate data dimension, such as key element, department etc., and horizontal Data classification is the classification under same data dimension, the personnel under such as same key element and article etc.
Three, data sharing.
The tables of data of tenant can opening and shares and can using carry out each other application.After cloud tenant selects the data that will open, tables of data is synchronized in Hive by ETL service by system automatically, and using Hive as data warehouse, carry out the management of data permission, the data of many tenants are unified in Hive and store.
Open data can be applied for using by other tenants.
Tenant carries out correlation inquiry and analysis in conjunction with the tables of data of application and the tables of data of self by SQL beyond the clouds, and the execution authority of SQL is controlled by software systems, carries out Logic judgment according to data application status.
Above-mentioned embodiment is only concrete case of the present invention; scope of patent protection of the present invention includes but not limited to above-mentioned embodiment; between any a kind of tenant according to the invention by tables of data share claims of the method for data and the those of ordinary skill of any described technical field to its suitable change done or replacement, all should fall into scope of patent protection of the present invention.
Claims (6)
1. shared a method for data between tenant by tables of data, it is characterized in that, its specific implementation process is:
First carry out tenant data source control: under cloud computing environment, tenant, by online web page logging data source, applies for new data management service, after typing, and opening timing device, timing more new data;
Carry out Data classification: combing customization data catalogue and group list information, the upper corresponding data directory of tables of data association that tenant will create, is convenient to the retrieval of tables of data and browses;
Complete data sharing: the tables of data opening and shares of tenant also uses carrying out application each other.
2. the method for data between a kind of tenant according to claim 1, is shared by tables of data, it is characterized in that, described data source is relevant database or HBASE NoSQL database, comprises following information in this data source: IP, port, data source types, character set, description, field, table information.
3. the method for data between a kind of tenant according to claim 2, is shared by tables of data, it is characterized in that, the process of described timing more new data is: the database dynamically under pulling data source, table information and field information, by these metadata automatic synchronizations to data management system, opening timing device, timing is according to the change tread more new metadata of real data table.
4. shared the method for data between a kind of tenant according to claim 2 by tables of data, it is characterized in that, between described tenant, each tenant of data source management uses a set of independently data management service, and the data between tenant are mutually isolated, are independent of each other.
5. shared the method for data between a kind of tenant according to claim 1 by tables of data, it is characterized in that, described Data classification is divided into vertical and horizontal two kinds: longitudinal classification is separate data dimension, and this data dimension comprises key element, department; Horizontal Data classification is the classification under same data dimension, comprises the personnel under same key element and article.
6. the method for data between a kind of tenant according to claim 1, is shared by tables of data, it is characterized in that, in described data sharing step, after cloud tenant selects the data that will open, tables of data is synchronized in Hive by ETL service by system automatically, using Hive as data warehouse, carry out the management of data permission, the data of many tenants are unified in Hive and store; Open data can be applied for using by other tenants; Tenant carries out correlation inquiry and analysis in conjunction with the tables of data of application and the tables of data of self by SQL beyond the clouds, and the execution authority of SQL is controlled by software systems, carries out Logic judgment according to data application status.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510146460.XA CN104731939B (en) | 2015-03-31 | 2015-03-31 | Method for sharing data among tenants through data table |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510146460.XA CN104731939B (en) | 2015-03-31 | 2015-03-31 | Method for sharing data among tenants through data table |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104731939A true CN104731939A (en) | 2015-06-24 |
| CN104731939B CN104731939B (en) | 2018-05-01 |
Family
ID=53455826
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510146460.XA Active CN104731939B (en) | 2015-03-31 | 2015-03-31 | Method for sharing data among tenants through data table |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104731939B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106203810A (en) * | 2016-07-01 | 2016-12-07 | 成都镜杰科技有限责任公司 | CRM data processing method based on cloud platform |
| CN106503085A (en) * | 2016-10-10 | 2017-03-15 | 北京世纪超星信息技术发展有限责任公司 | Based on the customizable search system in domain, method and technology |
| CN108038390A (en) * | 2017-12-09 | 2018-05-15 | 珠海横琴小可乐信息技术有限公司 | A kind of software, that is, service platform tenant data isolation and shared method and system |
| CN109756527A (en) * | 2017-11-01 | 2019-05-14 | 阿里巴巴集团控股有限公司 | Data sharing method, apparatus and system |
| CN110119422A (en) * | 2019-05-16 | 2019-08-13 | 武汉神算云信息科技有限责任公司 | Small wechat borrows tenant data depot data processing system and equipment |
| CN110414259A (en) * | 2018-04-28 | 2019-11-05 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus for constructing data element, realizing data sharing |
| CN111522869A (en) * | 2020-03-26 | 2020-08-11 | 中国南方电网有限责任公司 | Setting computing cloud data management method and setting computing system suitable for multiple tenants |
| CN112487378A (en) * | 2020-12-11 | 2021-03-12 | 宝付网络科技（上海）有限公司 | Tenant authority management system suitable for big data platform |
| CN116010431A (en) * | 2023-03-27 | 2023-04-25 | 北京有生博大软件股份有限公司 | Data element management method and management system based on multi-tenant mode |
| WO2023184908A1 (en) * | 2022-03-30 | 2023-10-05 | 北京柏睿数据技术股份有限公司 | Processing method and system for multi-tenant shared data |
| CN117076473A (en) * | 2023-10-11 | 2023-11-17 | 浪潮通用软件有限公司 | Metadata operation method, system, equipment and medium for SaaS multi-tenant |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080072309A1 (en) * | 2002-01-31 | 2008-03-20 | Brocade Communications Systems, Inc. | Network security and applications to the fabric environment |
| US7529728B2 (en) * | 2003-09-23 | 2009-05-05 | Salesforce.Com, Inc. | Query optimization in a multi-tenant database system |
| CN101777047A (en) * | 2009-01-08 | 2010-07-14 | 国际商业机器公司 | System, equipment and method for accessing database under multiple-tenant environment |
| US20110055151A1 (en) * | 2009-08-27 | 2011-03-03 | International Business Machines Corporation | Processing Database Operation Requests |
| US8200705B2 (en) * | 2008-07-30 | 2012-06-12 | International Business Machines Corporation | Method and apparatus for applying database partitioning in a multi-tenancy scenario |
| CN104216893A (en) * | 2013-05-31 | 2014-12-17 | 中国电信股份有限公司 | Partitioned management method for multi-tenant shared data table, server and system |
-
2015
- 2015-03-31 CN CN201510146460.XA patent/CN104731939B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080072309A1 (en) * | 2002-01-31 | 2008-03-20 | Brocade Communications Systems, Inc. | Network security and applications to the fabric environment |
| US7529728B2 (en) * | 2003-09-23 | 2009-05-05 | Salesforce.Com, Inc. | Query optimization in a multi-tenant database system |
| US8200705B2 (en) * | 2008-07-30 | 2012-06-12 | International Business Machines Corporation | Method and apparatus for applying database partitioning in a multi-tenancy scenario |
| CN101777047A (en) * | 2009-01-08 | 2010-07-14 | 国际商业机器公司 | System, equipment and method for accessing database under multiple-tenant environment |
| US20110055151A1 (en) * | 2009-08-27 | 2011-03-03 | International Business Machines Corporation | Processing Database Operation Requests |
| CN101996214A (en) * | 2009-08-27 | 2011-03-30 | 国际商业机器公司 | Method and device for processing database operation request |
| CN104216893A (en) * | 2013-05-31 | 2014-12-17 | 中国电信股份有限公司 | Partitioned management method for multi-tenant shared data table, server and system |
Non-Patent Citations (2)
| Title |
|---|
| 张绍谦 等: ""基于ECGP的企业数据集成研究"", 《华中科技大学学报(自然科学版)》 * |
| 魏华 等: "《数据库原理及应用 SQL Server 2008》", 31 March 2014, 西安交通大学出版社 * |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106203810A (en) * | 2016-07-01 | 2016-12-07 | 成都镜杰科技有限责任公司 | CRM data processing method based on cloud platform |
| CN106203810B (en) * | 2016-07-01 | 2020-05-19 | 上海中传网络技术股份有限公司 | CRM data processing method based on cloud platform |
| CN106503085A (en) * | 2016-10-10 | 2017-03-15 | 北京世纪超星信息技术发展有限责任公司 | Based on the customizable search system in domain, method and technology |
| CN106503085B (en) * | 2016-10-10 | 2020-04-28 | 北京世纪超星信息技术发展有限责任公司 | Domain-based customizable search systems, methods, and techniques |
| CN109756527B (en) * | 2017-11-01 | 2022-01-21 | 阿里巴巴集团控股有限公司 | Data sharing method, device and system |
| CN109756527A (en) * | 2017-11-01 | 2019-05-14 | 阿里巴巴集团控股有限公司 | Data sharing method, apparatus and system |
| CN108038390A (en) * | 2017-12-09 | 2018-05-15 | 珠海横琴小可乐信息技术有限公司 | A kind of software, that is, service platform tenant data isolation and shared method and system |
| CN110414259A (en) * | 2018-04-28 | 2019-11-05 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus for constructing data element, realizing data sharing |
| CN110414259B (en) * | 2018-04-28 | 2023-08-25 | 阿里巴巴集团控股有限公司 | Method and equipment for constructing data category and realizing data sharing |
| CN110119422A (en) * | 2019-05-16 | 2019-08-13 | 武汉神算云信息科技有限责任公司 | Small wechat borrows tenant data depot data processing system and equipment |
| CN111522869A (en) * | 2020-03-26 | 2020-08-11 | 中国南方电网有限责任公司 | Setting computing cloud data management method and setting computing system suitable for multiple tenants |
| CN112487378A (en) * | 2020-12-11 | 2021-03-12 | 宝付网络科技（上海）有限公司 | Tenant authority management system suitable for big data platform |
| WO2023184908A1 (en) * | 2022-03-30 | 2023-10-05 | 北京柏睿数据技术股份有限公司 | Processing method and system for multi-tenant shared data |
| CN116010431A (en) * | 2023-03-27 | 2023-04-25 | 北京有生博大软件股份有限公司 | Data element management method and management system based on multi-tenant mode |
| CN117076473A (en) * | 2023-10-11 | 2023-11-17 | 浪潮通用软件有限公司 | Metadata operation method, system, equipment and medium for SaaS multi-tenant |
| CN117076473B (en) * | 2023-10-11 | 2024-02-06 | 浪潮通用软件有限公司 | Metadata operation method, system, equipment and medium for SaaS multi-tenant |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104731939B (en) | 2018-05-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104731939A (en) | Method for sharing data among tenants through data table | |
| US8473515B2 (en) | Multi-tenancy in database namespace | |
| CN106649378B (en) | Data synchronization method and device | |
| US9465840B2 (en) | Dynamically indentifying and preventing skewed partitions in a shared-nothing database | |
| WO2013173111A3 (en) | Cloud-based data item sharing and collaboration among groups of users | |
| CN106528070B (en) | A kind of data table generating method and equipment | |
| CN104881466B (en) | The processing of data fragmentation and the delet method of garbage files and device | |
| CN103853970A (en) | Method for integrating operating authorities of multiple web application systems | |
| JP2017538194A5 (en) | ||
| MY178261A (en) | Method, system, and apparatus for exchanging data between client devices | |
| JP2017188137A5 (en) | ||
| CN104298761B (en) | The implementation method that master data is matched between a kind of heterogeneous software system | |
| CN104283959A (en) | Performance-grading-based storage mechanism suitable for cloud platform | |
| CN102917006A (en) | Method and device for achieving uniform control management of computing resource and object authority | |
| CN109684412A (en) | A kind of distributed data base system | |
| CN104216966A (en) | Method supporting index creation in various modes | |
| CN105573672B (en) | A kind of virtualization storage method and system based on NFS | |
| CN102999607A (en) | Data storage method, data access method and related devices | |
| CN109150964A (en) | A kind of transportable data managing method and services migrating method | |
| US10268551B1 (en) | Cloud service backup system | |
| CN109218350B (en) | Data information resource sharing system and method | |
| Pan et al. | An open sharing pattern design of massive power big data | |
| Cluci et al. | OpenStack in Higher Education and Academic Research: A Case Study on Benchmarking Big Data Processing Tools | |
| Acosta-Silva et al. | Exploitation of network-segregated CPU resources in CMS | |
| Kuhn et al. | Pluggable Databases |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180806 Address after: 250100 S06 tower, 1036, Chao Lu Road, hi tech Zone, Ji'nan, Shandong. Patentee after: Shandong wave cloud Mdt InfoTech Ltd Address before: No. 1036, Shandong high tech Zone wave road, Ji'nan, Shandong Patentee before: Inspur Group Co., Ltd. |
|
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: 250100 No. 1036 Tidal Road, Jinan High-tech Zone, Shandong Province, S01 Building, Tidal Science Park Patentee after: Inspur cloud Information Technology Co., Ltd Address before: 250100 Ji'nan science and technology zone, Shandong high tide Road, No. 1036 wave of science and Technology Park, building S06 Patentee before: SHANDONG LANGCHAO YUNTOU INFORMATION TECHNOLOGY Co.,Ltd. |