CN110337636A - 数据转换方法和装置 - Google Patents
数据转换方法和装置 Download PDFInfo
- Publication number
- CN110337636A CN110337636A CN201880011394.7A CN201880011394A CN110337636A CN 110337636 A CN110337636 A CN 110337636A CN 201880011394 A CN201880011394 A CN 201880011394A CN 110337636 A CN110337636 A CN 110337636A
- Authority
- CN
- China
- Prior art keywords
- domain
- value
- output value
- real number
- target layer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
- G06F7/38—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation
- G06F7/48—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
- G06F7/544—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices for evaluating functions by calculation
- G06F7/5443—Sum of products
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
- G06F7/38—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation
- G06F7/48—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
- G06F7/483—Computations with numbers represented by a non-linear combination of denominational numbers, e.g. rational numbers, logarithmic number system or floating-point numbers
- G06F7/485—Adding; Subtracting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
- G06F7/38—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation
- G06F7/48—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
- G06F7/483—Computations with numbers represented by a non-linear combination of denominational numbers, e.g. rational numbers, logarithmic number system or floating-point numbers
- G06F7/487—Multiplying; Dividing
- G06F7/4876—Multiplying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
- G06F7/38—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation
- G06F7/48—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
- G06F7/52—Multiplying; Dividing
- G06F7/523—Multiplying only
- G06F7/5235—Multiplying only using indirect methods, e.g. quarter square method, via logarithmic domain
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/30003—Arrangements for executing specific machine instructions
- G06F9/30007—Arrangements for executing specific machine instructions to perform operations on data operands
- G06F9/3001—Arithmetic instructions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/30003—Arrangements for executing specific machine instructions
- G06F9/30007—Arrangements for executing specific machine instructions to perform operations on data operands
- G06F9/30032—Movement instructions, e.g. MOVE, SHIFT, ROTATE, SHUFFLE
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2207/00—Indexing scheme relating to methods or arrangements for processing data by operating upon the order or content of the data handled
- G06F2207/38—Indexing scheme relating to groups G06F7/38 - G06F7/575
- G06F2207/48—Indexing scheme relating to groups G06F7/48 - G06F7/575
- G06F2207/4802—Special implementations
- G06F2207/4818—Threshold devices
- G06F2207/4824—Neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/048—Activation functions
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/14—Conversion to or from non-weighted codes
- H03M7/24—Conversion to or from floating-point codes
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Pure & Applied Mathematics (AREA)
- Mathematical Optimization (AREA)
- Mathematical Analysis (AREA)
- Computational Mathematics (AREA)
- Software Systems (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Nonlinear Science (AREA)
- Neurology (AREA)
- Image Analysis (AREA)
Abstract
一种数据转换方法和装置,该方法包括:根据神经网络的第一目标层的权重对数域位宽和最大权重系数的大小,确定权重基准值;根据该权重基准值和该权重对数域位宽,将该第一目标层中的权重系数转换到对数域。该方法中,权重系数在对数域的权重基准值不是经验值,而是根据权重对数域位宽和最大权重系数确定的,可以改善网络的表达能力,提高网络的准确率。
Description
PCT国内申请,说明书已公开。
Claims (88)
- PCT国内申请,权利要求书已公开。
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2018/077573 WO2019165602A1 (zh) | 2018-02-28 | 2018-02-28 | 数据转换方法和装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110337636A true CN110337636A (zh) | 2019-10-15 |
Family
ID=67804735
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201880011394.7A Pending CN110337636A (zh) | 2018-02-28 | 2018-02-28 | 数据转换方法和装置 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20200389182A1 (zh) |
CN (1) | CN110337636A (zh) |
WO (1) | WO2019165602A1 (zh) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3471271A1 (en) * | 2017-10-16 | 2019-04-17 | Acoustical Beauty | Improved convolutions of digital signals using a bit requirement optimization of a target digital signal |
US11037027B2 (en) * | 2018-10-25 | 2021-06-15 | Raytheon Company | Computer architecture for and-or neural networks |
US20220121909A1 (en) * | 2020-03-24 | 2022-04-21 | Lg Electronics Inc. | Training a neural network using stochastic whitening batch normalization |
CN111831356B (zh) * | 2020-07-09 | 2023-04-07 | 北京灵汐科技有限公司 | 权重精度配置方法、装置、设备及存储介质 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
PL2681710T3 (pl) * | 2011-03-02 | 2019-03-29 | Dolby Laboratories Licensing Corporation | Lokalny wieloskalowy operator mapowania tonowego |
CN103731159A (zh) * | 2014-01-09 | 2014-04-16 | 北京邮电大学 | 一种对先验信息迭代应用的混合域fft多进制和积译码算法 |
US20160026912A1 (en) * | 2014-07-22 | 2016-01-28 | Intel Corporation | Weight-shifting mechanism for convolutional neural networks |
CN107112005A (zh) * | 2015-04-17 | 2017-08-29 | 微软技术许可有限责任公司 | 深度神经支持向量机 |
CN107220025B (zh) * | 2017-04-24 | 2020-04-21 | 华为机器有限公司 | 处理乘加运算的装置和处理乘加运算的方法 |
-
2018
- 2018-02-28 WO PCT/CN2018/077573 patent/WO2019165602A1/zh active Application Filing
- 2018-02-28 CN CN201880011394.7A patent/CN110337636A/zh active Pending
-
2020
- 2020-08-24 US US17/000,915 patent/US20200389182A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
WO2019165602A1 (zh) | 2019-09-06 |
US20200389182A1 (en) | 2020-12-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108701250B (zh) | 数据定点化方法和装置 | |
EP3474194B1 (en) | Method and apparatus with neural network parameter quantization | |
US11023801B2 (en) | Data processing method and apparatus | |
US20190164043A1 (en) | Low-power hardware acceleration method and system for convolution neural network computation | |
CN110337636A (zh) | 数据转换方法和装置 | |
US20170061279A1 (en) | Updating an artificial neural network using flexible fixed point representation | |
US11574239B2 (en) | Outlier quantization for training and inference | |
KR102655950B1 (ko) | 뉴럴 네트워크의 고속 처리 방법 및 그 방법을 이용한 장치 | |
CN111026544A (zh) | 图网络模型的节点分类方法、装置及终端设备 | |
JP2022507704A (ja) | 適応量子化方法及び装置、デバイス、媒体 | |
EP4318313A1 (en) | Data processing method, training method for neural network model, and apparatus | |
CN110826706B (zh) | 用于神经网络的数据处理方法和装置 | |
CN113126953A (zh) | 针对浮点处理的方法和装置 | |
CN112085175B (zh) | 基于神经网络计算的数据处理方法和装置 | |
KR20210090249A (ko) | 이미지 처리 방법, 장치, 차량 탑재 연산 플랫폼, 전자 디바이스 및 시스템 | |
CN112561050B (zh) | 一种神经网络模型训练方法及装置 | |
CN111445016B (zh) | 加速非线性数学计算的***及方法 | |
US20230058500A1 (en) | Method and machine learning system to perform quantization of neural network | |
US20210232891A1 (en) | Neural network model compression with structured weight unification | |
KR20230076641A (ko) | 부동-소수점 연산을 위한 장치 및 방법 | |
Wu et al. | Accelerating deep convolutional neural network inference based on OpenCL | |
CN116384452B (zh) | 动态网络模型构建方法、装置、设备及存储介质 | |
US11916810B1 (en) | Resource management | |
CN114781496B (zh) | 一种寻优抽样方法、装置及电子设备 | |
WO2021036412A1 (zh) | 数据处理方法、装置、计算机设备和存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20191015 |