CN109146057A - 一种基于查表计算的高精度的神经网络工程化方法 - Google Patents
一种基于查表计算的高精度的神经网络工程化方法 Download PDFInfo
- Publication number
- CN109146057A CN109146057A CN201810668569.3A CN201810668569A CN109146057A CN 109146057 A CN109146057 A CN 109146057A CN 201810668569 A CN201810668569 A CN 201810668569A CN 109146057 A CN109146057 A CN 109146057A
- Authority
- CN
- China
- Prior art keywords
- neural network
- precision
- layer
- quantization
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
- G06F18/232—Non-hierarchical techniques
- G06F18/2321—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
- G06F18/23213—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Molecular Biology (AREA)
- Computational Linguistics (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Mathematical Physics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Probability & Statistics with Applications (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Complex Calculations (AREA)
- Feedback Control In General (AREA)
Abstract
Description
Claims (5)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810668569.3A CN109146057B (zh) | 2018-06-26 | 2018-06-26 | 一种基于查表计算的高精度的神经网络工程化方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810668569.3A CN109146057B (zh) | 2018-06-26 | 2018-06-26 | 一种基于查表计算的高精度的神经网络工程化方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109146057A true CN109146057A (zh) | 2019-01-04 |
CN109146057B CN109146057B (zh) | 2020-12-08 |
Family
ID=64802178
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810668569.3A Active CN109146057B (zh) | 2018-06-26 | 2018-06-26 | 一种基于查表计算的高精度的神经网络工程化方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109146057B (zh) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111831354A (zh) * | 2020-07-09 | 2020-10-27 | 北京灵汐科技有限公司 | 数据精度配置方法、装置、芯片、芯片阵列、设备及介质 |
CN111860095A (zh) * | 2020-03-23 | 2020-10-30 | 北京嘀嘀无限科技发展有限公司 | 一种状态检测模型训练方法及装置、状态检测方法及装置 |
WO2020248423A1 (zh) * | 2019-06-12 | 2020-12-17 | 上海寒武纪信息科技有限公司 | 一种神经网络的量化参数确定方法及相关产品 |
US11397579B2 (en) | 2018-02-13 | 2022-07-26 | Shanghai Cambricon Information Technology Co., Ltd | Computing device and method |
US11437032B2 (en) | 2017-09-29 | 2022-09-06 | Shanghai Cambricon Information Technology Co., Ltd | Image processing apparatus and method |
US11513586B2 (en) | 2018-02-14 | 2022-11-29 | Shanghai Cambricon Information Technology Co., Ltd | Control device, method and equipment for processor |
WO2023004800A1 (zh) * | 2021-07-30 | 2023-02-02 | 华为技术有限公司 | 神经网络后处理方法、装置、芯片、电子设备及存储介质 |
US11676028B2 (en) | 2019-06-12 | 2023-06-13 | Shanghai Cambricon Information Technology Co., Ltd | Neural network quantization parameter determination method and related products |
US11789847B2 (en) | 2018-06-27 | 2023-10-17 | Shanghai Cambricon Information Technology Co., Ltd | On-chip code breakpoint debugging method, on-chip processor, and chip breakpoint debugging system |
US12001955B2 (en) | 2019-08-23 | 2024-06-04 | Anhui Cambricon Information Technology Co., Ltd. | Data processing method, device, computer equipment and storage medium |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101071412A (zh) * | 2006-05-10 | 2007-11-14 | 何千军 | 一种基于自定义模型的神经网络分析***及方法 |
CN106650922A (zh) * | 2016-09-29 | 2017-05-10 | 清华大学 | 硬件神经网络转换方法、计算装置、编译方法和神经网络软硬件协作*** |
CN107665364A (zh) * | 2016-07-28 | 2018-02-06 | 三星电子株式会社 | 神经网络方法和设备 |
CN107679618A (zh) * | 2017-07-28 | 2018-02-09 | 北京深鉴科技有限公司 | 一种静态策略定点化训练方法及装置 |
US20180046894A1 (en) * | 2016-08-12 | 2018-02-15 | DeePhi Technology Co., Ltd. | Method for optimizing an artificial neural network (ann) |
CN107832847A (zh) * | 2017-10-26 | 2018-03-23 | 北京大学 | 一种基于稀疏化后向传播训练的神经网络模型压缩方法 |
US20180107925A1 (en) * | 2016-10-19 | 2018-04-19 | Samsung Electronics Co., Ltd. | Method and apparatus for neural network quantization |
-
2018
- 2018-06-26 CN CN201810668569.3A patent/CN109146057B/zh active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101071412A (zh) * | 2006-05-10 | 2007-11-14 | 何千军 | 一种基于自定义模型的神经网络分析***及方法 |
CN107665364A (zh) * | 2016-07-28 | 2018-02-06 | 三星电子株式会社 | 神经网络方法和设备 |
US20180046894A1 (en) * | 2016-08-12 | 2018-02-15 | DeePhi Technology Co., Ltd. | Method for optimizing an artificial neural network (ann) |
CN106650922A (zh) * | 2016-09-29 | 2017-05-10 | 清华大学 | 硬件神经网络转换方法、计算装置、编译方法和神经网络软硬件协作*** |
US20180107925A1 (en) * | 2016-10-19 | 2018-04-19 | Samsung Electronics Co., Ltd. | Method and apparatus for neural network quantization |
CN107679618A (zh) * | 2017-07-28 | 2018-02-09 | 北京深鉴科技有限公司 | 一种静态策略定点化训练方法及装置 |
CN107832847A (zh) * | 2017-10-26 | 2018-03-23 | 北京大学 | 一种基于稀疏化后向传播训练的神经网络模型压缩方法 |
Non-Patent Citations (2)
Title |
---|
曹文龙 等: "神经网络模型压缩方法综述", 《计算机应用研究》 * |
牟帅: "基于位量化的深度神经网络加速与压缩研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11437032B2 (en) | 2017-09-29 | 2022-09-06 | Shanghai Cambricon Information Technology Co., Ltd | Image processing apparatus and method |
US11397579B2 (en) | 2018-02-13 | 2022-07-26 | Shanghai Cambricon Information Technology Co., Ltd | Computing device and method |
US11507370B2 (en) | 2018-02-13 | 2022-11-22 | Cambricon (Xi'an) Semiconductor Co., Ltd. | Method and device for dynamically adjusting decimal point positions in neural network computations |
US11513586B2 (en) | 2018-02-14 | 2022-11-29 | Shanghai Cambricon Information Technology Co., Ltd | Control device, method and equipment for processor |
US11789847B2 (en) | 2018-06-27 | 2023-10-17 | Shanghai Cambricon Information Technology Co., Ltd | On-chip code breakpoint debugging method, on-chip processor, and chip breakpoint debugging system |
JP7166704B2 (ja) | 2019-06-12 | 2022-11-08 | 寒武紀(西安)集成電路有限公司 | ニューラルネットワークにおける量子化パラメータの確定方法および関連製品 |
JP2021177369A (ja) * | 2019-06-12 | 2021-11-11 | シャンハイ カンブリコン インフォメーション テクノロジー カンパニー リミテッドShanghai Cambricon Information Technology Co., Ltd. | ニューラルネットワークにおける量子化パラメータの確定方法および関連製品 |
EP3772022A1 (en) * | 2019-06-12 | 2021-02-03 | Shanghai Cambricon Information Technology Co., Ltd | Method for determining quantization parameters in neural network and related products |
EP3772023A1 (en) * | 2019-06-12 | 2021-02-03 | Shanghai Cambricon Information Technology Co., Ltd | Method for determining quantization parameters in neural network and related products |
WO2020248423A1 (zh) * | 2019-06-12 | 2020-12-17 | 上海寒武纪信息科技有限公司 | 一种神经网络的量化参数确定方法及相关产品 |
US11676028B2 (en) | 2019-06-12 | 2023-06-13 | Shanghai Cambricon Information Technology Co., Ltd | Neural network quantization parameter determination method and related products |
US11676029B2 (en) | 2019-06-12 | 2023-06-13 | Shanghai Cambricon Information Technology Co., Ltd | Neural network quantization parameter determination method and related products |
US11675676B2 (en) | 2019-06-12 | 2023-06-13 | Shanghai Cambricon Information Technology Co., Ltd | Neural network quantization parameter determination method and related products |
US12001955B2 (en) | 2019-08-23 | 2024-06-04 | Anhui Cambricon Information Technology Co., Ltd. | Data processing method, device, computer equipment and storage medium |
CN111860095A (zh) * | 2020-03-23 | 2020-10-30 | 北京嘀嘀无限科技发展有限公司 | 一种状态检测模型训练方法及装置、状态检测方法及装置 |
CN111831354A (zh) * | 2020-07-09 | 2020-10-27 | 北京灵汐科技有限公司 | 数据精度配置方法、装置、芯片、芯片阵列、设备及介质 |
WO2023004800A1 (zh) * | 2021-07-30 | 2023-02-02 | 华为技术有限公司 | 神经网络后处理方法、装置、芯片、电子设备及存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN109146057B (zh) | 2020-12-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109146057A (zh) | 一种基于查表计算的高精度的神经网络工程化方法 | |
CN108304928A (zh) | 基于改进聚类的深度神经网络的压缩方法 | |
CN107480815A (zh) | 一种电力***台区负荷预测方法 | |
CN114609994B (zh) | 基于多粒度正则化重平衡增量学习的故障诊断方法及装置 | |
CN102054199A (zh) | 基于bp神经网络算法对涂层老化的分析方法 | |
CN111292124A (zh) | 一种基于优化组合神经网络的需水预测方法 | |
CN108985444A (zh) | 一种基于节点抑制的卷积神经网络剪枝方法 | |
CN113918882A (zh) | 可硬件实现的动态稀疏注意力机制的数据处理加速方法 | |
CN105024645A (zh) | 一种基于矩阵进化的光伏阵列故障定位方法 | |
CN108776589A (zh) | 雷达信号处理软件组件的部署方法 | |
Atsi et al. | A family of modified backward differentiation formula (BDF) type block methods for the solution of stiff ordinary differential equations | |
CN108763164B (zh) | 煤与瓦斯突出反演相似度的评价方法 | |
CN111090921A (zh) | 一种边坡锚固结构体系的安全性评价方法 | |
CN110263917A (zh) | 一种神经网络压缩方法及装置 | |
CN113312845A (zh) | 一种基于pso-svr的土石坝浸润线的测压管水位预测方法 | |
CN111622274A (zh) | 山区巨粒土高填方地基基础沉降预测方法及*** | |
CN111711530A (zh) | 基于社区拓扑结构信息的链接预测算法 | |
CN113449912B (zh) | 一种基于人工智能技术的空间负荷态势感知方法 | |
CN107809253A (zh) | 基于随机Kaczmarz迭代的压缩感知数据重构方法 | |
CN113722951B (zh) | 基于神经网络的散射体三维有限元网格优化方法 | |
CN116304587A (zh) | 一种基于cae和agru的滚动轴承退化趋势预测方法 | |
CN111221864B (zh) | 一种基于mysql慢查询日志词频分析的索引智能推荐方法 | |
CN108875961A (zh) | 一种基于预界机制的在线加权极限学习机方法 | |
CN110889204B (zh) | 一种神经网络模型参数压缩方法 | |
CN110991600B (zh) | 一种融合分布估计算法与极限学习机的干旱智慧预测方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information |
Address after: 311400 4th floor, building 9, Yinhu innovation center, No. 9, Fuxian Road, Yinhu street, Fuyang District, Hangzhou City, Zhejiang Province Applicant after: Hangzhou xiongmai integrated circuit technology Co.,Ltd. Address before: 311422 four floor, 9 floor, Silver Lake innovation centre, 9 Fu Fu Road, Fuyang Lake District, Hangzhou, Zhejiang. Applicant before: HANGZHOU XIONGMAI INTEGRATED CIRCUIT TECHNOLOGY Co.,Ltd. |
|
CB02 | Change of applicant information | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP03 | Change of name, title or address |
Address after: 311422 4th floor, building 9, Yinhu innovation center, 9 Fuxian Road, Yinhu street, Fuyang District, Hangzhou City, Zhejiang Province Patentee after: Zhejiang Xinmai Microelectronics Co.,Ltd. Address before: 311400 4th floor, building 9, Yinhu innovation center, No.9 Fuxian Road, Yinhu street, Fuyang District, Hangzhou City, Zhejiang Province Patentee before: Hangzhou xiongmai integrated circuit technology Co.,Ltd. |
|
CP03 | Change of name, title or address |