CN104598565A - 一种基于随机梯度下降算法的k均值大规模数据聚类方法 - Google Patents
一种基于随机梯度下降算法的k均值大规模数据聚类方法 Download PDFInfo
- Publication number
- CN104598565A CN104598565A CN201510011974.4A CN201510011974A CN104598565A CN 104598565 A CN104598565 A CN 104598565A CN 201510011974 A CN201510011974 A CN 201510011974A CN 104598565 A CN104598565 A CN 104598565A
- Authority
- CN
- China
- Prior art keywords
- msub
- data
- msup
- steps
- clustering method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000005070 sampling Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 abstract description 6
- 230000000694 effects Effects 0.000 abstract description 5
- 238000003064 k means clustering Methods 0.000 description 9
- 238000004364 calculation method Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000007418 data mining Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000005065 mining Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- HHXYJYBYNZMZKX-UHFFFAOYSA-N 3,4:15,16-diepoxy-7-oxo-13(16),14-clerodadien-20,12-olide-(3alpha,4alpha)-form Natural products C12CCC3C4(C)CCCC(C)(C)C4CCC3(C)C1(C)CCC1C2(C)CCC1C(=C)C HHXYJYBYNZMZKX-UHFFFAOYSA-N 0.000 description 1
- PEDCQBHIVMGVHV-UHFFFAOYSA-N Glycerine Chemical compound OCC(O)CO PEDCQBHIVMGVHV-UHFFFAOYSA-N 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000000746 purification Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
- G06F18/232—Non-hierarchical techniques
- G06F18/2321—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
- G06F18/23211—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with adaptive number of clusters
Landscapes
- Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Probability & Statistics with Applications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Complex Calculations (AREA)
Abstract
Description
Claims (7)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510011974.4A CN104598565B (zh) | 2015-01-09 | 2015-01-09 | 一种基于随机梯度下降算法的k均值大规模数据聚类方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510011974.4A CN104598565B (zh) | 2015-01-09 | 2015-01-09 | 一种基于随机梯度下降算法的k均值大规模数据聚类方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104598565A true CN104598565A (zh) | 2015-05-06 |
CN104598565B CN104598565B (zh) | 2018-08-14 |
Family
ID=53124350
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510011974.4A Active CN104598565B (zh) | 2015-01-09 | 2015-01-09 | 一种基于随机梯度下降算法的k均值大规模数据聚类方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104598565B (zh) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105139277A (zh) * | 2015-08-18 | 2015-12-09 | 国家电网公司 | 一种电力配网信息聚类***及方法 |
CN105681089A (zh) * | 2016-01-26 | 2016-06-15 | 上海晶赞科技发展有限公司 | 网络用户行为聚类方法、装置及终端 |
CN108460499A (zh) * | 2018-04-02 | 2018-08-28 | 福州大学 | 一种融合用户时间信息的微博客用户影响力排名方法 |
CN108846532A (zh) * | 2018-03-21 | 2018-11-20 | 宁波工程学院 | 应用于物流供应链平台的企业风险评估方法及装置 |
CN110288004A (zh) * | 2019-05-30 | 2019-09-27 | 武汉大学 | 一种基于日志语义挖掘的***故障诊断方法及装置 |
US10503580B2 (en) | 2017-06-15 | 2019-12-10 | Microsoft Technology Licensing, Llc | Determining a likelihood of a resource experiencing a problem based on telemetry data |
CN111385243A (zh) * | 2018-12-27 | 2020-07-07 | ***通信集团山西有限公司 | 一种DDoS检测方法、装置及设备 |
US10805317B2 (en) | 2017-06-15 | 2020-10-13 | Microsoft Technology Licensing, Llc | Implementing network security measures in response to a detected cyber attack |
US10922627B2 (en) | 2017-06-15 | 2021-02-16 | Microsoft Technology Licensing, Llc | Determining a course of action based on aggregated data |
US11062226B2 (en) | 2017-06-15 | 2021-07-13 | Microsoft Technology Licensing, Llc | Determining a likelihood of a user interaction with a content element |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070118492A1 (en) * | 2005-11-18 | 2007-05-24 | Claus Bahlmann | Variational sparse kernel machines |
CN101488189A (zh) * | 2009-02-04 | 2009-07-22 | 天津大学 | 基于独立分量自动聚类处理的脑电信号处理方法 |
US20100095254A1 (en) * | 2005-08-12 | 2010-04-15 | Demaris David L | System and method for testing pattern sensitive algorithms for semiconductor design |
CN101872343A (zh) * | 2009-04-24 | 2010-10-27 | 罗彤 | 半监督式的海量数据层次分类方法 |
CN103810261A (zh) * | 2014-01-26 | 2014-05-21 | 西安理工大学 | 一种基于商空间理论的K-means聚类方法 |
-
2015
- 2015-01-09 CN CN201510011974.4A patent/CN104598565B/zh active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100095254A1 (en) * | 2005-08-12 | 2010-04-15 | Demaris David L | System and method for testing pattern sensitive algorithms for semiconductor design |
US20070118492A1 (en) * | 2005-11-18 | 2007-05-24 | Claus Bahlmann | Variational sparse kernel machines |
CN101488189A (zh) * | 2009-02-04 | 2009-07-22 | 天津大学 | 基于独立分量自动聚类处理的脑电信号处理方法 |
CN101872343A (zh) * | 2009-04-24 | 2010-10-27 | 罗彤 | 半监督式的海量数据层次分类方法 |
CN103810261A (zh) * | 2014-01-26 | 2014-05-21 | 西安理工大学 | 一种基于商空间理论的K-means聚类方法 |
Non-Patent Citations (2)
Title |
---|
吴小涛等: "基于遗传算法和梯度下降法的聚类新算法", 《计算技术与信息发展》 * |
汪宝彬等: "随机梯度下降法的一些性质", 《数学杂志》 * |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105139277B (zh) * | 2015-08-18 | 2018-09-11 | 国家电网公司 | 一种电力配网信息聚类***及方法 |
CN105139277A (zh) * | 2015-08-18 | 2015-12-09 | 国家电网公司 | 一种电力配网信息聚类***及方法 |
CN105681089B (zh) * | 2016-01-26 | 2019-10-18 | 上海晶赞科技发展有限公司 | 网络用户行为聚类方法、装置及终端 |
CN105681089A (zh) * | 2016-01-26 | 2016-06-15 | 上海晶赞科技发展有限公司 | 网络用户行为聚类方法、装置及终端 |
US10503580B2 (en) | 2017-06-15 | 2019-12-10 | Microsoft Technology Licensing, Llc | Determining a likelihood of a resource experiencing a problem based on telemetry data |
US10805317B2 (en) | 2017-06-15 | 2020-10-13 | Microsoft Technology Licensing, Llc | Implementing network security measures in response to a detected cyber attack |
US10922627B2 (en) | 2017-06-15 | 2021-02-16 | Microsoft Technology Licensing, Llc | Determining a course of action based on aggregated data |
US11062226B2 (en) | 2017-06-15 | 2021-07-13 | Microsoft Technology Licensing, Llc | Determining a likelihood of a user interaction with a content element |
CN108846532A (zh) * | 2018-03-21 | 2018-11-20 | 宁波工程学院 | 应用于物流供应链平台的企业风险评估方法及装置 |
CN108460499A (zh) * | 2018-04-02 | 2018-08-28 | 福州大学 | 一种融合用户时间信息的微博客用户影响力排名方法 |
CN108460499B (zh) * | 2018-04-02 | 2022-03-08 | 福州大学 | 一种融合用户时间信息的微博客用户影响力排名方法 |
CN111385243A (zh) * | 2018-12-27 | 2020-07-07 | ***通信集团山西有限公司 | 一种DDoS检测方法、装置及设备 |
CN110288004A (zh) * | 2019-05-30 | 2019-09-27 | 武汉大学 | 一种基于日志语义挖掘的***故障诊断方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN104598565B (zh) | 2018-08-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104598565B (zh) | 一种基于随机梯度下降算法的k均值大规模数据聚类方法 | |
Yang et al. | A scalable data chunk similarity based compression approach for efficient big sensing data processing on cloud | |
CN113705793B (zh) | 决策变量确定方法及装置、电子设备和介质 | |
CN102682089A (zh) | 一种利用鉴别随机邻域嵌入分析的数据降维方法 | |
CN106295690A (zh) | 基于非负矩阵分解的时间序列数据聚类方法及*** | |
CN103971136A (zh) | 一种面向大规模数据的并行结构化支持向量机分类方法 | |
Modarresi | Unsupervised feature extraction using singular value decomposition | |
Hu et al. | Parallel clustering of big data of spatio-temporal trajectory | |
CN111612319A (zh) | 基于一维卷积自编码器的负荷曲线深度嵌入聚类方法 | |
Wu et al. | AAE-SC: A scRNA-seq clustering framework based on adversarial autoencoder | |
CN114595635A (zh) | 火电机组主汽温度数据的特征选择方法、***及设备 | |
CN114090601A (zh) | 一种数据筛选方法、装置、设备以及存储介质 | |
CN111090679B (zh) | 基于时序影响和图嵌入的时序数据表示学习方法 | |
CN106021170A (zh) | 采用半监督低秩表示模型的图构建方法 | |
CN117060401A (zh) | 新能源功率预测方法、装置、设备和计算机可读存储介质 | |
CN114913921B (zh) | 一种标志基因识别的***和方法 | |
CN103778329B (zh) | 一种构造数据补足值的方法 | |
CN112000389B (zh) | 一种配置推荐方法、***、装置及计算机存储介质 | |
CN111402042B (zh) | 一种用于股市大盘形态分析的数据分析与显示方法 | |
CN102663141A (zh) | 一种基于多核并行的多路量化分级聚类方法 | |
Ramkumar et al. | An effective analysis of data clustering using distance-based K-means Algorithm | |
CN109447131B (zh) | 相似高维目标信息识别方法及*** | |
CN104794235B (zh) | 金融时间序列分段分布特征计算方法及*** | |
CN109189775B (zh) | 一种工业监控平台海量数据处理***及方法 | |
CN110210003A (zh) | 一种基于符号转移熵数据统计分析方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C41 | Transfer of patent application or patent right or utility model | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20160425 Address after: 100031 Xicheng District West Chang'an Avenue, No. 86, Beijing Applicant after: State Grid Corporation of China Applicant after: China Electric Power Research Institute Applicant after: State Grid Smart Grid Institute Address before: 100031 Xicheng District West Chang'an Avenue, No. 86, Beijing Applicant before: State Grid Corporation of China Applicant before: China Electric Power Research Institute |
|
CB02 | Change of applicant information |
Address after: 100031 Xicheng District West Chang'an Avenue, No. 86, Beijing Applicant after: State Grid Corporation of China Applicant after: China Electric Power Research Institute Applicant after: GLOBAL ENERGY INTERCONNECTION RESEARCH INSTITUTE Address before: 100031 Xicheng District West Chang'an Avenue, No. 86, Beijing Applicant before: State Grid Corporation of China Applicant before: China Electric Power Research Institute Applicant before: State Grid Smart Grid Institute |
|
COR | Change of bibliographic data | ||
GR01 | Patent grant | ||
GR01 | Patent grant |