CN106933863A - 数据清理方法及装置 - Google Patents
数据清理方法及装置 Download PDFInfo
- Publication number
- CN106933863A CN106933863A CN201511022880.3A CN201511022880A CN106933863A CN 106933863 A CN106933863 A CN 106933863A CN 201511022880 A CN201511022880 A CN 201511022880A CN 106933863 A CN106933863 A CN 106933863A
- Authority
- CN
- China
- Prior art keywords
- header field
- similarity
- sim
- field
- header
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Software Systems (AREA)
- Quality & Reliability (AREA)
Abstract
Description
Claims (15)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201511022880.3A CN106933863B (zh) | 2015-12-30 | 2015-12-30 | 数据清理方法及装置 |
PCT/CN2016/098771 WO2017113886A1 (zh) | 2015-12-30 | 2016-09-12 | 数据清理方法及装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201511022880.3A CN106933863B (zh) | 2015-12-30 | 2015-12-30 | 数据清理方法及装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106933863A true CN106933863A (zh) | 2017-07-07 |
CN106933863B CN106933863B (zh) | 2019-04-19 |
Family
ID=59224469
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201511022880.3A Active CN106933863B (zh) | 2015-12-30 | 2015-12-30 | 数据清理方法及装置 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN106933863B (zh) |
WO (1) | WO2017113886A1 (zh) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108984708A (zh) * | 2018-07-06 | 2018-12-11 | 蔚来汽车有限公司 | 脏数据识别方法及装置、数据清洗方法及装置、控制器 |
CN110399463A (zh) * | 2019-07-29 | 2019-11-01 | 国网河北省电力有限公司 | 工作票的相似度匹配方法及装置 |
CN111258968A (zh) * | 2019-12-30 | 2020-06-09 | 广州博士信息技术研究院有限公司 | 企业冗余数据清理方法、装置及大数据平台 |
CN111538464A (zh) * | 2020-05-10 | 2020-08-14 | 智博云信息科技(广州)有限公司 | 一种基于物联网平台的数据清理方法及装置 |
CN111639077A (zh) * | 2020-05-15 | 2020-09-08 | 杭州数梦工场科技有限公司 | 数据治理方法、装置、电子设备、存储介质 |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112036144B (zh) * | 2020-09-03 | 2024-04-02 | 广联达科技股份有限公司 | 数据解析方法、装置、计算机设备和可读存储介质 |
CN114462736A (zh) * | 2020-11-09 | 2022-05-10 | 中核核电运行管理有限公司 | 一种核电厂辐射工作许可证申请的经验反馈智能推荐方法 |
CN113010517B (zh) * | 2021-03-08 | 2024-02-09 | 中国工商银行股份有限公司 | 数据表管理方法及装置 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103324617A (zh) * | 2012-03-20 | 2013-09-25 | 腾讯科技(深圳)有限公司 | 一种历史垃圾消息的识别方法及*** |
CN103473373A (zh) * | 2013-09-29 | 2013-12-25 | 方正国际软件有限公司 | 基于阈值匹配模型的相似度分析***和方法 |
CN104021160A (zh) * | 2014-05-26 | 2014-09-03 | 北京金山安全软件有限公司 | 一种客户端数据清理方法和装置 |
CN104239304A (zh) * | 2013-06-07 | 2014-12-24 | 华为技术有限公司 | 一种数据处理的方法、装置以及设备 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU2007254820B2 (en) * | 2006-06-02 | 2012-04-05 | International Business Machines Corporation | Automatic weight generation for probabilistic matching |
CN101739414A (zh) * | 2008-11-25 | 2010-06-16 | 华中师范大学 | 一种本体概念映射方法 |
CN103257961B (zh) * | 2012-02-15 | 2016-08-10 | 北大方正集团有限公司 | 书目消重的方法、装置及*** |
-
2015
- 2015-12-30 CN CN201511022880.3A patent/CN106933863B/zh active Active
-
2016
- 2016-09-12 WO PCT/CN2016/098771 patent/WO2017113886A1/zh active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103324617A (zh) * | 2012-03-20 | 2013-09-25 | 腾讯科技(深圳)有限公司 | 一种历史垃圾消息的识别方法及*** |
CN104239304A (zh) * | 2013-06-07 | 2014-12-24 | 华为技术有限公司 | 一种数据处理的方法、装置以及设备 |
CN103473373A (zh) * | 2013-09-29 | 2013-12-25 | 方正国际软件有限公司 | 基于阈值匹配模型的相似度分析***和方法 |
CN104021160A (zh) * | 2014-05-26 | 2014-09-03 | 北京金山安全软件有限公司 | 一种客户端数据清理方法和装置 |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108984708A (zh) * | 2018-07-06 | 2018-12-11 | 蔚来汽车有限公司 | 脏数据识别方法及装置、数据清洗方法及装置、控制器 |
CN110399463A (zh) * | 2019-07-29 | 2019-11-01 | 国网河北省电力有限公司 | 工作票的相似度匹配方法及装置 |
CN111258968A (zh) * | 2019-12-30 | 2020-06-09 | 广州博士信息技术研究院有限公司 | 企业冗余数据清理方法、装置及大数据平台 |
CN111538464A (zh) * | 2020-05-10 | 2020-08-14 | 智博云信息科技(广州)有限公司 | 一种基于物联网平台的数据清理方法及装置 |
CN111639077A (zh) * | 2020-05-15 | 2020-09-08 | 杭州数梦工场科技有限公司 | 数据治理方法、装置、电子设备、存储介质 |
CN111639077B (zh) * | 2020-05-15 | 2024-03-22 | 杭州数梦工场科技有限公司 | 数据治理方法、装置、电子设备、存储介质 |
Also Published As
Publication number | Publication date |
---|---|
WO2017113886A1 (zh) | 2017-07-06 |
CN106933863B (zh) | 2019-04-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106933863A (zh) | 数据清理方法及装置 | |
CN104462059B (zh) | 商户地址信息识别方法和装置 | |
EP1739580B1 (en) | Categorization including dependencies between different category systems | |
Hussain et al. | Approximation of COSMIC functional size to support early effort estimation in Agile | |
Brechmann et al. | Truncation of vine copulas using fit indices | |
CN107480191A (zh) | 一种迭代的实体对齐模型 | |
CN111899090B (zh) | 企业关联风险预警方法及*** | |
CN106156145A (zh) | 一种地址数据的管理方法和装置 | |
CN110046262A (zh) | 一种基于法律专家知识库的上下文推理方法 | |
CN106557854A (zh) | 一种业务流程的展示方法和装置 | |
CN104484380A (zh) | 个性化搜索方法及装置 | |
CN107341194A (zh) | 一种企业重名人区分方法及装置 | |
CN108509484A (zh) | 分类器构建及智能问答方法、装置、终端及可读存储介质 | |
CN112991063B (zh) | 企业股权穿透方法 | |
CN110096652A (zh) | 舆情风向标指数计算方法及装置、可读存储介质 | |
CN109740160A (zh) | 一种基于人工智能语义分析的任务发布方法 | |
CN107491536A (zh) | 一种试题校验方法、试题校验装置及电子设备 | |
CN110222041A (zh) | 一种基于张量恢复的交通数据清洗方法 | |
Moshkovich et al. | Verbal decision analysis | |
DeCormier Plosky et al. | Developing the Global Health Cost Consortium unit cost study repository for HIV and TB: methodology and lessons learned | |
AU7323298A (en) | Method and apparatus for estimating the number of distinct values in a database | |
CN107977454A (zh) | 双语语料清洗的方法、装置及计算机可读存储介质 | |
CN106021311A (zh) | 网络社交活动推荐方法和装置 | |
CN107133218A (zh) | 商品名称智能匹配方法、***及计算机可读存储介质 | |
CN106933829A (zh) | 一种信息关联方法和设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20200804 Address after: Four, 646000 section, wine Valley Avenue, hi tech Development Zone, Sichuan, Luzhou Patentee after: GUOJIU BIG DATA Co.,Ltd. Address before: 625, room 269, Connaught platinum Plaza, No. 518101, Qianjin Road, Xin'an street, Shenzhen, Guangdong, Baoan District Patentee before: SHENZHEN SHANGGE INTELLECTUAL PROPERTY SERVICE Co.,Ltd. Effective date of registration: 20200804 Address after: 625, room 269, Connaught platinum Plaza, No. 518101, Qianjin Road, Xin'an street, Shenzhen, Guangdong, Baoan District Patentee after: SHENZHEN SHANGGE INTELLECTUAL PROPERTY SERVICE Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd. |
|
CP01 | Change in the name or title of a patent holder | ||
CP01 | Change in the name or title of a patent holder |
Address after: Four, 646000 section, wine Valley Avenue, hi tech Development Zone, Sichuan, Luzhou Patentee after: Guojiu big data Co.,Ltd. Address before: Four, 646000 section, wine Valley Avenue, hi tech Development Zone, Sichuan, Luzhou Patentee before: GUOJIU BIG DATA Co.,Ltd. |