CN108959510A - 一种分布式数据库的分区级连接方法和装置 - Google Patents
一种分布式数据库的分区级连接方法和装置 Download PDFInfo
- Publication number
- CN108959510A CN108959510A CN201810682121.7A CN201810682121A CN108959510A CN 108959510 A CN108959510 A CN 108959510A CN 201810682121 A CN201810682121 A CN 201810682121A CN 108959510 A CN108959510 A CN 108959510A
- Authority
- CN
- China
- Prior art keywords
- data
- physical machine
- logical partition
- cost
- logical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000005192 partition Methods 0.000 title claims abstract description 160
- 238000000034 method Methods 0.000 title claims abstract description 59
- 230000005012 migration Effects 0.000 claims abstract description 53
- 238000013508 migration Methods 0.000 claims abstract description 53
- 238000011156 evaluation Methods 0.000 claims abstract description 10
- 238000004590 computer program Methods 0.000 claims description 15
- 238000003860 storage Methods 0.000 claims description 13
- 238000007689 inspection Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 19
- 238000012545 processing Methods 0.000 description 11
- 230000003068 static effect Effects 0.000 description 5
- 238000009826 distribution Methods 0.000 description 4
- 238000013210 evaluation model Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 238000000638 solvent extraction Methods 0.000 description 3
- 238000011022 operating instruction Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000006116 polymerization reaction Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000000994 depressogenic effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012854 evaluation process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/278—Data partitioning, e.g. horizontal or vertical partitioning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
- G06F16/24534—Query rewriting; Transformation
- G06F16/24549—Run-time optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24553—Query execution of query operations
- G06F16/24558—Binary matching operations
- G06F16/2456—Join operations
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (12)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810682121.7A CN108959510B (zh) | 2018-06-27 | 2018-06-27 | 一种分布式数据库的分区级连接方法和装置 |
CN202210635770.8A CN115129782A (zh) | 2018-06-27 | 2018-06-27 | 一种分布式数据库的分区级连接方法和装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810682121.7A CN108959510B (zh) | 2018-06-27 | 2018-06-27 | 一种分布式数据库的分区级连接方法和装置 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210635770.8A Division CN115129782A (zh) | 2018-06-27 | 2018-06-27 | 一种分布式数据库的分区级连接方法和装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108959510A true CN108959510A (zh) | 2018-12-07 |
CN108959510B CN108959510B (zh) | 2022-04-19 |
Family
ID=64487428
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210635770.8A Pending CN115129782A (zh) | 2018-06-27 | 2018-06-27 | 一种分布式数据库的分区级连接方法和装置 |
CN201810682121.7A Active CN108959510B (zh) | 2018-06-27 | 2018-06-27 | 一种分布式数据库的分区级连接方法和装置 |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210635770.8A Pending CN115129782A (zh) | 2018-06-27 | 2018-06-27 | 一种分布式数据库的分区级连接方法和装置 |
Country Status (1)
Country | Link |
---|---|
CN (2) | CN115129782A (zh) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020034818A1 (zh) * | 2018-08-14 | 2020-02-20 | 华为技术有限公司 | 分区合并方法和数据库服务器 |
CN111831425A (zh) * | 2019-04-18 | 2020-10-27 | 阿里巴巴集团控股有限公司 | 一种数据处理方法、装置及设备 |
CN112905591A (zh) * | 2021-02-04 | 2021-06-04 | 成都信息工程大学 | 一种基于机器学习的数据表连接顺序选择方法 |
CN112905596A (zh) * | 2021-03-05 | 2021-06-04 | 北京中经惠众科技有限公司 | 数据处理的方法、装置、计算机设备以及存储介质 |
CN114416884A (zh) * | 2022-03-28 | 2022-04-29 | 北京奥星贝斯科技有限公司 | 连接分区表的方法和装置 |
CN115114328A (zh) * | 2022-08-29 | 2022-09-27 | 北京奥星贝斯科技有限公司 | 针对分布式数据库生成查询计划的方法及装置 |
US11762881B2 (en) | 2018-08-14 | 2023-09-19 | Huawei Cloud Computing Technologies Co., Ltd. | Partition merging method and database server |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102831211A (zh) * | 2012-08-14 | 2012-12-19 | 中山大学 | 一种基于表关联分析的数据表迁移的方法 |
CN102968498A (zh) * | 2012-12-05 | 2013-03-13 | 华为技术有限公司 | 数据处理方法及装置 |
CN103440301A (zh) * | 2013-08-21 | 2013-12-11 | 曙光信息产业股份有限公司 | 一种数据多副本混合存储方法及*** |
CN104871153A (zh) * | 2012-10-29 | 2015-08-26 | 华为技术有限公司 | 用于灵活的分布式大规模并行处理(mpp)数据库的***和方法 |
CN105009110A (zh) * | 2012-11-30 | 2015-10-28 | 华为技术有限公司 | 大规模并行处理(mpp)数据库的自动伸缩方法 |
CN105512268A (zh) * | 2015-12-03 | 2016-04-20 | 曙光信息产业(北京)有限公司 | 一种数据查询方法及装置 |
CN106415534A (zh) * | 2015-05-31 | 2017-02-15 | 华为技术有限公司 | 一种分布式数据库中关联表分区的方法和设备 |
CN107784044A (zh) * | 2016-08-31 | 2018-03-09 | 华为技术有限公司 | 表数据查询方法及装置 |
CN107807938A (zh) * | 2016-09-09 | 2018-03-16 | 华为技术有限公司 | 一种数据表的处理方法及装置 |
-
2018
- 2018-06-27 CN CN202210635770.8A patent/CN115129782A/zh active Pending
- 2018-06-27 CN CN201810682121.7A patent/CN108959510B/zh active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102831211A (zh) * | 2012-08-14 | 2012-12-19 | 中山大学 | 一种基于表关联分析的数据表迁移的方法 |
CN104871153A (zh) * | 2012-10-29 | 2015-08-26 | 华为技术有限公司 | 用于灵活的分布式大规模并行处理(mpp)数据库的***和方法 |
CN105009110A (zh) * | 2012-11-30 | 2015-10-28 | 华为技术有限公司 | 大规模并行处理(mpp)数据库的自动伸缩方法 |
CN102968498A (zh) * | 2012-12-05 | 2013-03-13 | 华为技术有限公司 | 数据处理方法及装置 |
CN103440301A (zh) * | 2013-08-21 | 2013-12-11 | 曙光信息产业股份有限公司 | 一种数据多副本混合存储方法及*** |
CN106415534A (zh) * | 2015-05-31 | 2017-02-15 | 华为技术有限公司 | 一种分布式数据库中关联表分区的方法和设备 |
CN105512268A (zh) * | 2015-12-03 | 2016-04-20 | 曙光信息产业(北京)有限公司 | 一种数据查询方法及装置 |
CN107784044A (zh) * | 2016-08-31 | 2018-03-09 | 华为技术有限公司 | 表数据查询方法及装置 |
CN107807938A (zh) * | 2016-09-09 | 2018-03-16 | 华为技术有限公司 | 一种数据表的处理方法及装置 |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020034818A1 (zh) * | 2018-08-14 | 2020-02-20 | 华为技术有限公司 | 分区合并方法和数据库服务器 |
US11762881B2 (en) | 2018-08-14 | 2023-09-19 | Huawei Cloud Computing Technologies Co., Ltd. | Partition merging method and database server |
CN111831425A (zh) * | 2019-04-18 | 2020-10-27 | 阿里巴巴集团控股有限公司 | 一种数据处理方法、装置及设备 |
CN112905591A (zh) * | 2021-02-04 | 2021-06-04 | 成都信息工程大学 | 一种基于机器学习的数据表连接顺序选择方法 |
CN112905591B (zh) * | 2021-02-04 | 2022-08-26 | 成都信息工程大学 | 一种基于机器学习的数据表连接顺序选择方法 |
CN112905596A (zh) * | 2021-03-05 | 2021-06-04 | 北京中经惠众科技有限公司 | 数据处理的方法、装置、计算机设备以及存储介质 |
CN112905596B (zh) * | 2021-03-05 | 2024-02-02 | 北京中经惠众科技有限公司 | 数据处理的方法、装置、计算机设备以及存储介质 |
CN114416884A (zh) * | 2022-03-28 | 2022-04-29 | 北京奥星贝斯科技有限公司 | 连接分区表的方法和装置 |
CN114416884B (zh) * | 2022-03-28 | 2022-06-14 | 北京奥星贝斯科技有限公司 | 连接分区表的方法和装置 |
CN115114328A (zh) * | 2022-08-29 | 2022-09-27 | 北京奥星贝斯科技有限公司 | 针对分布式数据库生成查询计划的方法及装置 |
CN115114328B (zh) * | 2022-08-29 | 2022-10-28 | 北京奥星贝斯科技有限公司 | 针对分布式数据库生成查询计划的方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN108959510B (zh) | 2022-04-19 |
CN115129782A (zh) | 2022-09-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108959510A (zh) | 一种分布式数据库的分区级连接方法和装置 | |
US11797496B2 (en) | System and method for parallel support of multidimensional slices with a multidimensional database | |
US11144361B2 (en) | System and method for automatic dependency analysis for use with a multidimensional database | |
CN108280148A (zh) | 一种数据迁移方法和数据迁移服务器 | |
US20130151535A1 (en) | Distributed indexing of data | |
CN104615606B (zh) | 一种Hadoop分布式文件***及其管理方法 | |
US20100082599A1 (en) | Characterizing Queries To Predict Execution In A Database | |
CN106933534A (zh) | 一种数据同步方法和装置 | |
US9311380B2 (en) | Processing spatial joins using a mapreduce framework | |
US11068504B2 (en) | Relational database storage system and method for supporting fast query processing with low data redundancy, and method for query processing based on the relational database storage method | |
US9208273B1 (en) | Methods, systems, and articles of manufacture for implementing clone design components in an electronic design | |
Verma et al. | Big Data representation for grade analysis through Hadoop framework | |
US20200250192A1 (en) | Processing queries associated with multiple file formats based on identified partition and data container objects | |
TWI709049B (zh) | 隨機漫步、基於叢集的隨機漫步方法、裝置以及設備 | |
CN106202092A (zh) | 数据处理的方法及*** | |
CN108415912A (zh) | 基于MapReduce模型的数据处理方法和设备 | |
CN106547870A (zh) | 数据库的分表方法及装置 | |
CN110245978A (zh) | 策略组中的策略评估、策略选择方法及装置 | |
US8849795B2 (en) | Optimizing the execution of a query in a multi-database system | |
CN110020004A (zh) | 一种数据计算方法及引擎 | |
CN109656946A (zh) | 一种多表关联查询方法、装置及设备 | |
CN109376988A (zh) | 一种业务数据的处理方法和装置 | |
CN104239520A (zh) | 一种基于历史信息的hdfs数据块放置策略 | |
CN106570029A (zh) | 分布式关系型数据库的数据处理方法及*** | |
US11023493B2 (en) | Intelligently scheduling resynchronization jobs in a distributed object-based storage system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40001233 Country of ref document: HK |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20200922 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20200922 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20210207 Address after: 801-10, Section B, 8th floor, 556 Xixi Road, Xihu District, Hangzhou City, Zhejiang Province 310000 Applicant after: Ant financial (Hangzhou) Network Technology Co.,Ltd. Address before: Ky1-9008 Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands, ky1-9008 Applicant before: Innovative advanced technology Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20210910 Address after: 100020 unit 02, 901, floor 9, unit 1, building 1, No.1, East Third Ring Middle Road, Chaoyang District, Beijing Applicant after: Beijing Aoxing Beisi Technology Co.,Ltd. Address before: 801-10, Section B, 8th floor, 556 Xixi Road, Xihu District, Hangzhou City, Zhejiang Province 310000 Applicant before: Ant financial (Hangzhou) Network Technology Co.,Ltd. |
|
GR01 | Patent grant | ||
GR01 | Patent grant |