CN113535422A - 一种面向工业大数据的数据清洗和事件处理的云平台*** - Google Patents
一种面向工业大数据的数据清洗和事件处理的云平台*** Download PDFInfo
- Publication number
- CN113535422A CN113535422A CN202010329550.3A CN202010329550A CN113535422A CN 113535422 A CN113535422 A CN 113535422A CN 202010329550 A CN202010329550 A CN 202010329550A CN 113535422 A CN113535422 A CN 113535422A
- Authority
- CN
- China
- Prior art keywords
- data
- event
- module
- attributes
- cleaning
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004140 cleaning Methods 0.000 title claims abstract description 20
- 238000012545 processing Methods 0.000 title claims abstract description 16
- 238000007781 pre-processing Methods 0.000 claims abstract description 15
- 238000001514 detection method Methods 0.000 claims abstract description 12
- 238000010606 normalization Methods 0.000 claims abstract description 4
- 238000000034 method Methods 0.000 claims description 21
- 238000004458 analytical method Methods 0.000 claims description 9
- 230000002159 abnormal effect Effects 0.000 claims description 7
- 239000011159 matrix material Substances 0.000 claims description 6
- 238000011084 recovery Methods 0.000 claims description 6
- 238000009776 industrial production Methods 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000005065 mining Methods 0.000 claims description 3
- 238000013450 outlier detection Methods 0.000 claims description 3
- 238000009826 distribution Methods 0.000 claims description 2
- 238000012423 maintenance Methods 0.000 claims description 2
- 238000004519 manufacturing process Methods 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 abstract description 6
- 230000002265 prevention Effects 0.000 abstract description 3
- 238000005457 optimization Methods 0.000 abstract description 2
- 238000007405 data analysis Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000010926 purge Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000004540 process dynamic Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2465—Query processing support for facilitating data mining operations in structured databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Quality & Reliability (AREA)
- Computational Linguistics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010329550.3A CN113535422A (zh) | 2020-04-20 | 2020-04-20 | 一种面向工业大数据的数据清洗和事件处理的云平台*** |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010329550.3A CN113535422A (zh) | 2020-04-20 | 2020-04-20 | 一种面向工业大数据的数据清洗和事件处理的云平台*** |
Publications (1)
Publication Number | Publication Date |
---|---|
CN113535422A true CN113535422A (zh) | 2021-10-22 |
Family
ID=78094171
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010329550.3A Pending CN113535422A (zh) | 2020-04-20 | 2020-04-20 | 一种面向工业大数据的数据清洗和事件处理的云平台*** |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113535422A (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114490616A (zh) * | 2022-02-10 | 2022-05-13 | 北京星汉博纳医药科技有限公司 | 数据清洗方法、装置、电子设备及存储介质 |
CN114722037A (zh) * | 2022-05-16 | 2022-07-08 | 中国信息通信研究院 | 工业互联网中间件数据处理方法、中间件和可读存储介质 |
-
2020
- 2020-04-20 CN CN202010329550.3A patent/CN113535422A/zh active Pending
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114490616A (zh) * | 2022-02-10 | 2022-05-13 | 北京星汉博纳医药科技有限公司 | 数据清洗方法、装置、电子设备及存储介质 |
CN114722037A (zh) * | 2022-05-16 | 2022-07-08 | 中国信息通信研究院 | 工业互联网中间件数据处理方法、中间件和可读存储介质 |
CN114722037B (zh) * | 2022-05-16 | 2022-08-26 | 中国信息通信研究院 | 工业互联网中间件数据处理方法、中间件和可读存储介质 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111475804B (zh) | 一种告警预测方法及*** | |
CN112256782B (zh) | 基于Hadoop的电力大数据处理*** | |
US11093519B2 (en) | Artificial intelligence (AI) based automatic data remediation | |
CN108038049B (zh) | 实时日志控制***及控制方法、云计算***及服务器 | |
WO2022083576A1 (zh) | 一种网络功能虚拟化设备运行数据的分析方法及装置 | |
CN105528280B (zh) | ***日志与健康监控关系决定日志告警等级的方法及*** | |
CN111259947A (zh) | 一种基于多模态学习的电力***故障预警方法和*** | |
CN111885040A (zh) | 分布式网络态势感知方法、***、服务器及节点设备 | |
Fu et al. | Digging deeper into cluster system logs for failure prediction and root cause diagnosis | |
CN111949480B (zh) | 一种基于组件感知的日志异常检测方法 | |
CN103678051B (zh) | 一种集群数据处理***中的在线故障容错方法 | |
CN113535422A (zh) | 一种面向工业大数据的数据清洗和事件处理的云平台*** | |
CN108280021A (zh) | 一种基于机器学习的日志等级分析方法 | |
CN114201374A (zh) | 基于混合机器学习的运维时序数据异常检测方法及*** | |
Shilpika et al. | MELA: A visual analytics tool for studying multifidelity hpc system logs | |
CN112559280A (zh) | 基于数据中台的数据全链路监控方法 | |
CN111581298B (zh) | 大数据仓库的异构数据整合***及方法 | |
Jia et al. | Robust and transferable log-based anomaly detection | |
CN117763015A (zh) | 一种结构化时序数据管理的方法及装置 | |
CN117333038A (zh) | 一种基于大数据的经济趋势分析*** | |
CN112151185A (zh) | 一种儿童呼吸疾病与环境数据关联分析方法及*** | |
CN112052284A (zh) | 一种大数据下的主数据管理方法及*** | |
CN111400122B (zh) | 一种硬盘健康度评估方法及装置 | |
CN116881376A (zh) | 一种企业数据资产的自动探索方法 | |
CN116629802A (zh) | 一种用于铁路港口站的大数据平台*** |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
CB02 | Change of applicant information | ||
CB02 | Change of applicant information |
Address after: 9 / F, building C9, No.19, Lane 299, Guanghua Road, high tech Zone, Ningbo City, Zhejiang Province Applicant after: Ningbo Zhongke Information Technology Application Research Institute (Ningbo Artificial Intelligence Industry Research Institute) Applicant after: Ningbo Zhongke Jidong Information Technology Co.,Ltd. Address before: 9 / F, building C9, No.19, Lane 299, Guanghua Road, high tech Zone, Ningbo City, Zhejiang Province Applicant before: Ningbo Institute of information technology application, Chinese Academy of Sciences (Ningbo Institute of artificial intelligence industry) Applicant before: Ningbo Zhongke Jidong Information Technology Co.,Ltd. |
|
WD01 | Invention patent application deemed withdrawn after publication | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20211022 |