CN112364047B - 基于Presto的动态数据处理方法及跨库查询方法 - Google Patents
基于Presto的动态数据处理方法及跨库查询方法 Download PDFInfo
- Publication number
- CN112364047B CN112364047B CN202011210164.9A CN202011210164A CN112364047B CN 112364047 B CN112364047 B CN 112364047B CN 202011210164 A CN202011210164 A CN 202011210164A CN 112364047 B CN112364047 B CN 112364047B
- Authority
- CN
- China
- Prior art keywords
- data source
- presto
- information
- data
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000003672 processing method Methods 0.000 title claims abstract description 12
- 238000012544 monitoring process Methods 0.000 claims abstract description 17
- 238000007792 addition Methods 0.000 claims abstract description 16
- 230000037430 deletion Effects 0.000 claims abstract description 16
- 238000012217 deletion Methods 0.000 claims abstract description 16
- 230000004048 modification Effects 0.000 claims abstract description 16
- 238000012986 modification Methods 0.000 claims abstract description 16
- 238000012545 processing Methods 0.000 claims abstract description 12
- 230000010354 integration Effects 0.000 claims description 15
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 238000007499 fusion processing Methods 0.000 abstract description 3
- 238000004590 computer program Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 230000009467 reduction Effects 0.000 description 4
- 238000007405 data analysis Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2433—Query languages
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
id | 表主键 |
info | 数据源信息 |
catalogName | 数据源名称 |
creator | 数据源创建者 |
connecterName | 数据源类型 |
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011210164.9A CN112364047B (zh) | 2020-11-03 | 2020-11-03 | 基于Presto的动态数据处理方法及跨库查询方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011210164.9A CN112364047B (zh) | 2020-11-03 | 2020-11-03 | 基于Presto的动态数据处理方法及跨库查询方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112364047A CN112364047A (zh) | 2021-02-12 |
CN112364047B true CN112364047B (zh) | 2024-04-09 |
Family
ID=74513640
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011210164.9A Active CN112364047B (zh) | 2020-11-03 | 2020-11-03 | 基于Presto的动态数据处理方法及跨库查询方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112364047B (zh) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108563509A (zh) * | 2018-04-28 | 2018-09-21 | 北京京东金融科技控股有限公司 | 数据查询实现方法、装置、介质及电子设备 |
CN109815283A (zh) * | 2018-12-18 | 2019-05-28 | 中科曙光南京研究院有限公司 | 一种异构数据源可视化查询方法 |
CN110555076A (zh) * | 2019-08-22 | 2019-12-10 | 上海数禾信息科技有限公司 | 数据打标方法、处理方法以及装置 |
CN111078728A (zh) * | 2019-12-19 | 2020-04-28 | 山大地纬软件股份有限公司 | 一种数据库归档模式下跨库查询方法和装置 |
CN111177173A (zh) * | 2020-01-02 | 2020-05-19 | 普元信息技术股份有限公司 | 大数据环境下实现数据同步优化处理的***及其方法 |
CN111259036A (zh) * | 2020-01-10 | 2020-06-09 | 苏州达家迎信息技术有限公司 | 一种跨库跨表查询方法、设备、服务器及存储介质 |
-
2020
- 2020-11-03 CN CN202011210164.9A patent/CN112364047B/zh active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108563509A (zh) * | 2018-04-28 | 2018-09-21 | 北京京东金融科技控股有限公司 | 数据查询实现方法、装置、介质及电子设备 |
CN109815283A (zh) * | 2018-12-18 | 2019-05-28 | 中科曙光南京研究院有限公司 | 一种异构数据源可视化查询方法 |
CN110555076A (zh) * | 2019-08-22 | 2019-12-10 | 上海数禾信息科技有限公司 | 数据打标方法、处理方法以及装置 |
CN111078728A (zh) * | 2019-12-19 | 2020-04-28 | 山大地纬软件股份有限公司 | 一种数据库归档模式下跨库查询方法和装置 |
CN111177173A (zh) * | 2020-01-02 | 2020-05-19 | 普元信息技术股份有限公司 | 大数据环境下实现数据同步优化处理的***及其方法 |
CN111259036A (zh) * | 2020-01-10 | 2020-06-09 | 苏州达家迎信息技术有限公司 | 一种跨库跨表查询方法、设备、服务器及存储介质 |
Non-Patent Citations (1)
Title |
---|
基于Presto海量日志分析***的设计;梁满;周传生;;黑龙江科技信息(第01期);全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN112364047A (zh) | 2021-02-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20200210423A1 (en) | Multi-party data joint query method, device, server and storage medium | |
JP5826831B2 (ja) | データマート自動化 | |
CN105354314B (zh) | 数据迁移方法及装置 | |
US20120303616A1 (en) | Data Perturbation and Anonymization Using One Way Hash | |
CN104361140B (zh) | 动态生成数据模型配置装置和方法 | |
CN110750650A (zh) | 企业知识图谱的构建方法及装置 | |
US8930303B2 (en) | Discovering pivot type relationships between database objects | |
CN102270225A (zh) | 数据变更日志监控方法和数据变更日志监控装置 | |
CN105955970A (zh) | 一种基于日志解析的数据库复制方法及装置 | |
EP2778953A1 (en) | Encoded-search database device, method for adding and deleting data for encoded search, and addition/deletion program | |
CN111177244A (zh) | 面向多个异构数据库的数据关联分析方法 | |
CN104537012B (zh) | 数据处理方法和装置 | |
WO2019079799A1 (en) | SYSTEM AND METHOD FOR DATA MANAGEMENT | |
CN113254470A (zh) | 一种数据更改方法、装置、计算机设备及存储介质 | |
CN109033157B (zh) | 一种基于自定义搜索条件树的复杂数据检索方法和*** | |
CN112364047B (zh) | 基于Presto的动态数据处理方法及跨库查询方法 | |
CN112634004A (zh) | 征信数据的血缘图谱分析方法与*** | |
CN111221967A (zh) | 一种基于区块链架构的语言数据分类存储*** | |
CN115455463A (zh) | 一种基于同态加密的隐匿sql查询方法 | |
CN115827780A (zh) | 一种基于隔离装置使用调度算法实现跨网区数据同步方法、***及存储介质 | |
CN113868253A (zh) | 一种数据关系捕获及大数据关系树构建方法 | |
US10664501B2 (en) | Deriving and interpreting users collective data asset use across analytic software systems | |
CN112749197B (zh) | 数据分片刷新方法、装置、设备及存储介质 | |
CN111143329B (zh) | 一种数据处理方法及装置 | |
CN103488693A (zh) | 数据处理装置和数据处理方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20220325 Address after: 250013 Shanke Zhongchuang space 203-g, No. 19 Keyuan Road, Lixia District, Jinan City, Shandong Province Applicant after: Shandong Shanke intellectual property operation center Co.,Ltd. Address before: 250014 3rd floor, block B, Yinhe building, 2008 Xinluo street, high tech Zone, Jinan City, Shandong Province Applicant before: SHANDONG ECLOUD INFORMATION TECHNOLOGY CO.,LTD. |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20220608 Address after: 250014 3rd floor, block B, Yinhe building, 2008 Xinluo street, high tech Zone, Jinan City, Shandong Province Applicant after: SHANDONG ECLOUD INFORMATION TECHNOLOGY CO.,LTD. Address before: 250013 Shanke Zhongchuang space 203-g, No. 19 Keyuan Road, Lixia District, Jinan City, Shandong Province Applicant before: Shandong Shanke intellectual property operation center Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20221228 Address after: Room 305, Block B, Yinhe Building, No. 2008, Xinluo Street, Jinan Area, China (Shandong) Pilot Free Trade Zone, Jinan, Shandong 250098 Applicant after: Shandong Huazhi Talent Technology Co.,Ltd. Address before: 250014 3rd floor, block B, Yinhe building, 2008 Xinluo street, high tech Zone, Jinan City, Shandong Province Applicant before: SHANDONG ECLOUD INFORMATION TECHNOLOGY CO.,LTD. |
|
TA01 | Transfer of patent application right | ||
GR01 | Patent grant | ||
GR01 | Patent grant |