SG11202007532TA - Neural network accelerator - Google Patents
Neural network acceleratorInfo
- Publication number
- SG11202007532TA SG11202007532TA SG11202007532TA SG11202007532TA SG11202007532TA SG 11202007532T A SG11202007532T A SG 11202007532TA SG 11202007532T A SG11202007532T A SG 11202007532TA SG 11202007532T A SG11202007532T A SG 11202007532TA SG 11202007532T A SG11202007532T A SG 11202007532TA
- Authority
- SG
- Singapore
- Prior art keywords
- neural network
- network accelerator
- accelerator
- neural
- network
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
- G06F13/4282—Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/048—Activation functions
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Neurology (AREA)
- Complex Calculations (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201862710488P | 2018-02-16 | 2018-02-16 | |
| US201862664190P | 2018-04-29 | 2018-04-29 | |
| PCT/CA2019/050187 WO2019157599A1 (en) | 2018-02-16 | 2019-02-15 | Neural network accelerator |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| SG11202007532TA true SG11202007532TA (en) | 2020-09-29 |
Family
ID=67619691
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| SG11202007532TA SG11202007532TA (en) | 2018-02-16 | 2019-02-15 | Neural network accelerator |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US20210004668A1 (zh) |
| JP (1) | JP7349438B2 (zh) |
| KR (1) | KR20200118815A (zh) |
| CN (1) | CN111742331A (zh) |
| CA (1) | CA3090329C (zh) |
| SG (1) | SG11202007532TA (zh) |
| WO (1) | WO2019157599A1 (zh) |
Families Citing this family (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11966835B2 (en) * | 2018-06-05 | 2024-04-23 | Nvidia Corp. | Deep neural network accelerator with fine-grained parallelism discovery |
| US11769040B2 (en) | 2018-09-10 | 2023-09-26 | Nvidia Corp. | Scalable multi-die deep learning system |
| CN109543816B (zh) * | 2018-09-20 | 2022-12-06 | 中国科学院计算技术研究所 | 一种基于权重捏合的卷积神经网络计算方法和*** |
| US11747205B2 (en) * | 2019-02-27 | 2023-09-05 | Deep Smart Light Ltd. | Noninvasive, multispectral-fluorescence characterization of biological tissues with machine/deep learning |
| US11270197B2 (en) | 2019-03-12 | 2022-03-08 | Nvidia Corp. | Efficient neural network accelerator dataflows |
| US20210110243A1 (en) * | 2019-10-10 | 2021-04-15 | Hewlett Packard Enterprise Development Lp | Deep learning accelerator system interface |
| CN110991609B (zh) * | 2019-11-27 | 2023-12-26 | 天津大学 | 用于数据传输的行缓存器 |
| KR102410166B1 (ko) * | 2019-11-27 | 2022-06-20 | 고려대학교 산학협력단 | 이종 곱셈-누셈 유닛을 이용하는 심층 신경망의 가속기 |
| US11615256B1 (en) * | 2019-12-30 | 2023-03-28 | Ali Tasdighi Far | Hybrid accumulation method in multiply-accumulate for machine learning |
| US11610104B1 (en) * | 2019-12-30 | 2023-03-21 | Ali Tasdighi Far | Asynchronous analog accelerator for fully connected artificial neural networks |
| US20210303987A1 (en) * | 2020-03-26 | 2021-09-30 | Advanced Micro Devices, Inc. | Power reduction for machine learning accelerator background |
| US11175844B1 (en) * | 2020-05-13 | 2021-11-16 | International Business Machines Corporation | Optimal placement of data structures in a hybrid memory based inference computing platform |
| US20210357748A1 (en) * | 2020-05-14 | 2021-11-18 | Samsung Electronics Co., Ltd. | Hierarchical weight preprocessing for neural network accelerator |
| US11500811B2 (en) * | 2020-06-12 | 2022-11-15 | Alibaba Group Holding Limited | Apparatuses and methods for map reduce |
| JP2023534314A (ja) * | 2020-07-21 | 2023-08-08 | ザ ガバニング カウンシル オブ ザ ユニバーシティ オブ トロント | 深層学習ネットワークのトレーニングを加速させるためのシステム及び方法 |
| KR102464508B1 (ko) * | 2020-12-31 | 2022-11-09 | 주식회사 메이아이 | 인공 신경망 모델을 경량화하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능한 기록 매체 |
| CN113269316B (zh) * | 2021-03-26 | 2022-10-11 | 复旦大学 | 支持稀疏神经网络计算加速器的稀疏数据选择逻辑模块 |
| KR20220147398A (ko) * | 2021-04-27 | 2022-11-03 | 삼성전자주식회사 | 인공 지능 모델에 기반하여 데이터를 처리하는 전자 장치 및 그 동작 방법 |
| US11797270B2 (en) | 2021-06-17 | 2023-10-24 | International Business Machines Corporation | Single function to perform multiple operations with distinct operation parameter validation |
| US11675592B2 (en) | 2021-06-17 | 2023-06-13 | International Business Machines Corporation | Instruction to query for model-dependent information |
| US11693692B2 (en) | 2021-06-17 | 2023-07-04 | International Business Machines Corporation | Program event recording storage alteration processing for a neural network accelerator instruction |
| US11269632B1 (en) | 2021-06-17 | 2022-03-08 | International Business Machines Corporation | Data conversion to/from selected data type with implied rounding mode |
| US11669331B2 (en) | 2021-06-17 | 2023-06-06 | International Business Machines Corporation | Neural network processing assist instruction |
| US11734013B2 (en) | 2021-06-17 | 2023-08-22 | International Business Machines Corporation | Exception summary for invalid values detected during instruction execution |
| US20210319317A1 (en) * | 2021-06-24 | 2021-10-14 | Intel Corporation | Methods and apparatus to perform machine-learning model operations on sparse accelerators |
| CN113692592B (zh) * | 2021-07-08 | 2022-06-28 | 香港应用科技研究院有限公司 | 动态瓦片并行神经网络加速器 |
| CN113592066B (zh) * | 2021-07-08 | 2024-01-05 | 深圳市易成自动驾驶技术有限公司 | 硬件加速方法、装置、设备及存储介质 |
| EP4377841A1 (en) * | 2021-07-27 | 2024-06-05 | Qualcomm Incorporated | Activation buffer architecture for data-reuse in a neural network accelerator |
| KR20230133066A (ko) * | 2022-03-10 | 2023-09-19 | 리벨리온 주식회사 | 뉴럴 프로세싱 장치 |
Family Cites Families (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5751913A (en) * | 1996-07-29 | 1998-05-12 | Industrial Technology Research Institute | Reconfigurable neural network and difference-square neuron |
| US6199057B1 (en) * | 1996-10-23 | 2001-03-06 | California Institute Of Technology | Bit-serial neuroprocessor architecture |
| US9449257B2 (en) * | 2012-12-04 | 2016-09-20 | Institute Of Semiconductors, Chinese Academy Of Sciences | Dynamically reconstructable multistage parallel single instruction multiple data array processing system |
| US10192162B2 (en) * | 2015-05-21 | 2019-01-29 | Google Llc | Vector computation unit in a neural network processor |
| US10417555B2 (en) * | 2015-05-29 | 2019-09-17 | Samsung Electronics Co., Ltd. | Data-optimized neural network traversal |
| CA2990709C (en) | 2016-05-26 | 2018-09-04 | The Governing Council Of The University Of Toronto | Accelerator for deep neural networks |
| JP6898359B2 (ja) | 2016-06-14 | 2021-07-07 | タータン エーアイ リミテッド | ディープニューラルネットワーク用のアクセラレータ |
| US10891538B2 (en) | 2016-08-11 | 2021-01-12 | Nvidia Corporation | Sparse convolutional neural network accelerator |
| US20180046898A1 (en) | 2016-08-11 | 2018-02-15 | Vivante Corporation | Zero Coefficient Skipping Convolution Neural Network Engine |
| US10360163B2 (en) * | 2016-10-27 | 2019-07-23 | Google Llc | Exploiting input data sparsity in neural network compute units |
| US10175980B2 (en) * | 2016-10-27 | 2019-01-08 | Google Llc | Neural network compute tile |
| US11003985B2 (en) * | 2016-11-07 | 2021-05-11 | Electronics And Telecommunications Research Institute | Convolutional neural network system and operation method thereof |
| EP3552112A1 (en) * | 2016-12-09 | 2019-10-16 | Beijing Horizon Information Technology Co., Ltd. | Systems and methods for data management |
| US10521488B1 (en) * | 2016-12-30 | 2019-12-31 | X Development Llc | Dynamic partitioning |
| US10096134B2 (en) * | 2017-02-01 | 2018-10-09 | Nvidia Corporation | Data compaction and memory bandwidth reduction for sparse neural networks |
| US10467795B2 (en) * | 2017-04-08 | 2019-11-05 | Intel Corporation | Sub-graph in frequency domain and dynamic selection of convolution implementation on a GPU |
| CN107688850B (zh) * | 2017-08-08 | 2021-04-13 | 赛灵思公司 | 一种深度神经网络压缩方法 |
| EP3718023A1 (en) * | 2017-12-01 | 2020-10-07 | MemSQL Inc. | Accelerated filtering, grouping and aggregation in a database system |
-
2019
- 2019-02-15 CN CN201980014141.XA patent/CN111742331A/zh active Pending
- 2019-02-15 KR KR1020207023816A patent/KR20200118815A/ko not_active Application Discontinuation
- 2019-02-15 WO PCT/CA2019/050187 patent/WO2019157599A1/en active Application Filing
- 2019-02-15 CA CA3090329A patent/CA3090329C/en active Active
- 2019-02-15 US US16/968,678 patent/US20210004668A1/en active Pending
- 2019-02-15 JP JP2020543300A patent/JP7349438B2/ja active Active
- 2019-02-15 SG SG11202007532TA patent/SG11202007532TA/en unknown
Also Published As
| Publication number | Publication date |
|---|---|
| CA3090329A1 (en) | 2019-08-22 |
| CN111742331A (zh) | 2020-10-02 |
| JP2021515300A (ja) | 2021-06-17 |
| US20210004668A1 (en) | 2021-01-07 |
| CA3090329C (en) | 2021-07-27 |
| JP7349438B2 (ja) | 2023-09-22 |
| WO2019157599A1 (en) | 2019-08-22 |
| KR20200118815A (ko) | 2020-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| SG11202007532TA (en) | Neural network accelerator | |
| GB2568776B (en) | Neural network accelerator with parameters resident on chip | |
| EP3899811A4 (en) | NERVE NETWORK COMPRESSION | |
| GB201611857D0 (en) | An artificial neural network | |
| EP3777207A4 (en) | Content-specific neural network distribution | |
| GB2582519B (en) | Convolutional neural network hardware | |
| EP3874411A4 (en) | NEURAL NETWORK WITH IMPROVED SPIKING | |
| EP3465550A4 (en) | ACCELERATOR FOR DEEP NEURONAL NETWORKS | |
| GB201917993D0 (en) | Neural network classification | |
| GB2604298B (en) | Neural network processing | |
| EP3674984C0 (en) | SET OF NEURAL NETWORKS | |
| ZA201905869B (en) | Octree-based convolutional neural network | |
| IL273370A (en) | Photonic neural network system | |
| GB201810736D0 (en) | Neural trees | |
| GB201512278D0 (en) | Hybrid neural network | |
| EP3317224A4 (en) | NEUROMORPHIC NETWORK | |
| GB2596477B (en) | Hybrid neural network and autoencoder | |
| GB2579120B (en) | Inference system | |
| EP3497622A4 (en) | ARTIFICIAL NEURONAL NETWORK | |
| GB201804451D0 (en) | Artificial neural networks | |
| GB201803083D0 (en) | Artificial Neural Networks | |
| GB201813762D0 (en) | Neural interface | |
| GB201809704D0 (en) | Hardware accelerator | |
| EP3563305A4 (en) | ARTIFICIAL NEURAL NETWORK | |
| GB201805973D0 (en) | Neural network |