CN110543478A - 公共层宽表建设方法、装置及服务器 - Google Patents
公共层宽表建设方法、装置及服务器 Download PDFInfo
- Publication number
- CN110543478A CN110543478A CN201910647532.7A CN201910647532A CN110543478A CN 110543478 A CN110543478 A CN 110543478A CN 201910647532 A CN201910647532 A CN 201910647532A CN 110543478 A CN110543478 A CN 110543478A
- Authority
- CN
- China
- Prior art keywords
- data
- main
- incremental
- row
- service table
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000010276 construction Methods 0.000 title description 9
- 238000000034 method Methods 0.000 claims abstract description 55
- 238000012545 processing Methods 0.000 claims description 57
- 230000010076 replication Effects 0.000 claims description 34
- 238000012986 modification Methods 0.000 claims description 23
- 230000004048 modification Effects 0.000 claims description 23
- 238000007781 pre-processing Methods 0.000 claims description 17
- 230000008569 process Effects 0.000 claims description 17
- 230000008859 change Effects 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 12
- 230000003111 delayed effect Effects 0.000 claims description 12
- 238000012216 screening Methods 0.000 claims description 8
- 238000009938 salting Methods 0.000 claims description 6
- 230000004083 survival effect Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 7
- 238000007726 management method Methods 0.000 description 7
- 230000015556 catabolic process Effects 0.000 description 2
- 238000006731 degradation reaction Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013497 data interchange Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (22)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910647532.7A CN110543478B (zh) | 2019-07-17 | 2019-07-17 | 公共层宽表建设方法、装置及服务器 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910647532.7A CN110543478B (zh) | 2019-07-17 | 2019-07-17 | 公共层宽表建设方法、装置及服务器 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110543478A true CN110543478A (zh) | 2019-12-06 |
CN110543478B CN110543478B (zh) | 2023-02-03 |
Family
ID=68709937
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910647532.7A Active CN110543478B (zh) | 2019-07-17 | 2019-07-17 | 公共层宽表建设方法、装置及服务器 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110543478B (zh) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113220797A (zh) * | 2020-01-21 | 2021-08-06 | 浙江大搜车软件技术有限公司 | 信息配置的方法、设备、***、计算机设备和存储介质 |
CN113656370A (zh) * | 2021-08-16 | 2021-11-16 | 南方电网数字电网研究院有限公司 | 电力量测***数据处理方法、装置和计算机设备 |
CN114116842A (zh) * | 2021-11-25 | 2022-03-01 | 上海柯林布瑞信息技术有限公司 | 多维医疗数据实时获取方法、装置、电子设备及存储介质 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1494042A1 (fr) * | 2003-07-04 | 2005-01-05 | Alcatel | Serveur de données utilisé dans un système pour la fourniture de données d'augmentation pour les signaux de navigation par satellite |
US20130018849A1 (en) * | 2010-06-29 | 2013-01-17 | Asserted Versioning, Llc | Management of temporal data by means of a canonical schema |
US20130159248A1 (en) * | 2011-12-20 | 2013-06-20 | Klaus Otto Mueller | Merge monitor for table delta partitions |
CN103577474A (zh) * | 2012-08-03 | 2014-02-12 | 阿里巴巴集团控股有限公司 | 一种数据库的更新方法及*** |
CN108399256A (zh) * | 2018-03-06 | 2018-08-14 | 北京慧萌信安软件技术有限公司 | 异构数据库内容同步方法、装置及中间件 |
CN108681590A (zh) * | 2018-05-15 | 2018-10-19 | 普信恒业科技发展(北京)有限公司 | 增量数据处理方法及装置、计算机设备、计算机存储介质 |
CN109597846A (zh) * | 2018-10-22 | 2019-04-09 | 平安科技(深圳)有限公司 | 大数据平台数据仓库数据处理方法、装置和计算机设备 |
CN109614398A (zh) * | 2018-11-02 | 2019-04-12 | 阿里巴巴集团控股有限公司 | 数据库中表结构的变更方法及装置 |
CN109960629A (zh) * | 2019-03-14 | 2019-07-02 | 银清科技(北京)有限公司 | 对支付***业务量实时监控的方法和装置 |
-
2019
- 2019-07-17 CN CN201910647532.7A patent/CN110543478B/zh active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1494042A1 (fr) * | 2003-07-04 | 2005-01-05 | Alcatel | Serveur de données utilisé dans un système pour la fourniture de données d'augmentation pour les signaux de navigation par satellite |
US20130018849A1 (en) * | 2010-06-29 | 2013-01-17 | Asserted Versioning, Llc | Management of temporal data by means of a canonical schema |
US20130159248A1 (en) * | 2011-12-20 | 2013-06-20 | Klaus Otto Mueller | Merge monitor for table delta partitions |
CN103577474A (zh) * | 2012-08-03 | 2014-02-12 | 阿里巴巴集团控股有限公司 | 一种数据库的更新方法及*** |
CN108399256A (zh) * | 2018-03-06 | 2018-08-14 | 北京慧萌信安软件技术有限公司 | 异构数据库内容同步方法、装置及中间件 |
CN108681590A (zh) * | 2018-05-15 | 2018-10-19 | 普信恒业科技发展(北京)有限公司 | 增量数据处理方法及装置、计算机设备、计算机存储介质 |
CN109597846A (zh) * | 2018-10-22 | 2019-04-09 | 平安科技(深圳)有限公司 | 大数据平台数据仓库数据处理方法、装置和计算机设备 |
CN109614398A (zh) * | 2018-11-02 | 2019-04-12 | 阿里巴巴集团控股有限公司 | 数据库中表结构的变更方法及装置 |
CN109960629A (zh) * | 2019-03-14 | 2019-07-02 | 银清科技(北京)有限公司 | 对支付***业务量实时监控的方法和装置 |
Non-Patent Citations (1)
Title |
---|
周天绮等: "智慧社保大数据分析平台构建", 《计算机与现代化》 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113220797A (zh) * | 2020-01-21 | 2021-08-06 | 浙江大搜车软件技术有限公司 | 信息配置的方法、设备、***、计算机设备和存储介质 |
CN113656370A (zh) * | 2021-08-16 | 2021-11-16 | 南方电网数字电网研究院有限公司 | 电力量测***数据处理方法、装置和计算机设备 |
CN113656370B (zh) * | 2021-08-16 | 2024-04-30 | 南方电网数字电网集团有限公司 | 电力量测***数据处理方法、装置和计算机设备 |
CN114116842A (zh) * | 2021-11-25 | 2022-03-01 | 上海柯林布瑞信息技术有限公司 | 多维医疗数据实时获取方法、装置、电子设备及存储介质 |
CN114116842B (zh) * | 2021-11-25 | 2023-05-19 | 上海柯林布瑞信息技术有限公司 | 多维医疗数据实时获取方法、装置、电子设备及存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN110543478B (zh) | 2023-02-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110543478B (zh) | 公共层宽表建设方法、装置及服务器 | |
US20180137134A1 (en) | Data snapshot acquisition method and system | |
CN110674154B (zh) | 一种基于Spark的对Hive中数据进行***、更新和删除的方法 | |
CN111008521B (zh) | 生成宽表的方法、装置及计算机存储介质 | |
CN105989076A (zh) | 一种数据统计方法以及装置 | |
CN107679104B (zh) | 大表流式并行高速数据比对方法 | |
CN106055630A (zh) | 日志存储的方法及装置 | |
US11281698B2 (en) | Data configuration query method and device | |
CN109213758B (zh) | 数据存取方法、装置、设备及计算机可读存储介质 | |
CN105608126A (zh) | 一种建立海量数据库二级索引的方法和装置 | |
CN111258978A (zh) | 一种数据存储的方法 | |
CN105630934A (zh) | 一种数据统计方法及*** | |
CN104008199A (zh) | 一种数据查询方法 | |
CN114329096A (zh) | 一种原生图数据库处理方法及*** | |
CN103136244A (zh) | 基于云计算平台的并行数据挖掘方法及*** | |
CN115292414A (zh) | 一种业务数据同步到数仓的方法 | |
CN104408183A (zh) | 数据***的数据导入方法和装置 | |
US10135926B2 (en) | Shuffle embedded distributed storage system supporting virtual merge and method thereof | |
KR20180085633A (ko) | 질의 처리 장치 및 방법 | |
CN116186053A (zh) | 一种数据处理方法、装置及存储介质 | |
CN115658680A (zh) | 数据存储方法、数据查询方法和相关装置 | |
Wang et al. | [Retracted] Agricultural Productive Service System Based on the Block Chain and Edge Computing | |
CN116450637A (zh) | 一种数据管理方法、装置、电子设备以及存储介质 | |
CN114564501A (zh) | 一种数据库数据存储、查询方法、装置、设备及介质 | |
CN111159112B (zh) | 数据处理方法及*** |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20201012 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. Effective date of registration: 20201012 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant before: Advanced innovation technology Co.,Ltd. |
|
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20240219 Address after: Guohao Times City # 20-01, 128 Meizhi Road, Singapore Patentee after: Advanced Nova Technology (Singapore) Holdings Ltd. Country or region after: Singapore Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee before: Innovative advanced technology Co.,Ltd. Country or region before: United Kingdom |