CN110333827B - 一种数据加载装置和数据加载方法 - Google Patents
一种数据加载装置和数据加载方法 Download PDFInfo
- Publication number
- CN110333827B CN110333827B CN201910624711.9A CN201910624711A CN110333827B CN 110333827 B CN110333827 B CN 110333827B CN 201910624711 A CN201910624711 A CN 201910624711A CN 110333827 B CN110333827 B CN 110333827B
- Authority
- CN
- China
- Prior art keywords
- data
- neural network
- module
- ping
- loading
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000011068 loading method Methods 0.000 title claims abstract description 175
- 238000013528 artificial neural network Methods 0.000 claims abstract description 199
- 238000007493 shaping process Methods 0.000 claims abstract description 86
- 238000004364 calculation method Methods 0.000 claims abstract description 32
- 238000004458 analytical method Methods 0.000 claims abstract description 14
- 230000015654 memory Effects 0.000 claims description 22
- 125000004122 cyclic group Chemical group 0.000 claims description 20
- 238000012545 processing Methods 0.000 claims description 15
- 238000012856 packing Methods 0.000 claims description 13
- 238000010586 diagram Methods 0.000 claims description 8
- 230000001502 supplementing effect Effects 0.000 claims description 6
- 238000013507 mapping Methods 0.000 claims description 3
- 239000013589 supplement Substances 0.000 claims description 3
- 238000000034 method Methods 0.000 abstract description 31
- 230000000875 corresponding effect Effects 0.000 description 52
- 230000008569 process Effects 0.000 description 15
- 230000005540 biological transmission Effects 0.000 description 6
- 230000009471 action Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 101100498818 Arabidopsis thaliana DDR4 gene Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0688—Non-volatile semiconductor memory arrays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Neurology (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
Description
Claims (2)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910624711.9A CN110333827B (zh) | 2019-07-11 | 2019-07-11 | 一种数据加载装置和数据加载方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910624711.9A CN110333827B (zh) | 2019-07-11 | 2019-07-11 | 一种数据加载装置和数据加载方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110333827A CN110333827A (zh) | 2019-10-15 |
CN110333827B true CN110333827B (zh) | 2023-08-08 |
Family
ID=68146303
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910624711.9A Active CN110333827B (zh) | 2019-07-11 | 2019-07-11 | 一种数据加载装置和数据加载方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110333827B (zh) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111358496A (zh) * | 2020-03-05 | 2020-07-03 | 成都翼诚电子有限公司 | 一种背膘自动测量大角度显像兽用b超机的测量方法 |
WO2022027172A1 (zh) * | 2020-08-03 | 2022-02-10 | 深圳市大疆创新科技有限公司 | 数据处理装置、方法和***以及神经网络加速器 |
CN112486901A (zh) * | 2020-11-30 | 2021-03-12 | 清华大学 | 基于乒乓缓冲的存内计算***及方法 |
CN117391149B (zh) * | 2023-11-30 | 2024-03-26 | 爱芯元智半导体(宁波)有限公司 | 神经网络输出数据的处理方法、装置及芯片 |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN100426681C (zh) * | 2005-05-10 | 2008-10-15 | 华为技术有限公司 | Turbo编码方法及编码装置 |
CN105260773B (zh) * | 2015-09-18 | 2018-01-12 | 华为技术有限公司 | 一种图像处理装置以及图像处理方法 |
CN107704922B (zh) * | 2017-04-19 | 2020-12-08 | 赛灵思公司 | 人工神经网络处理装置 |
CN107392309A (zh) * | 2017-09-11 | 2017-11-24 | 东南大学—无锡集成电路技术研究所 | 一种基于fpga的通用定点数神经网络卷积加速器硬件结构 |
CN109996023B (zh) * | 2017-12-29 | 2021-06-29 | 华为技术有限公司 | 图像处理方法和装置 |
CN109104197B (zh) * | 2018-11-12 | 2022-02-11 | 合肥工业大学 | 应用于卷积神经网络的非还原稀疏数据的编译码电路及其编译码方法 |
CN109550249B (zh) * | 2018-11-28 | 2022-04-29 | 腾讯科技(深圳)有限公司 | 一种目标对象的控制方法、装置及设备 |
CN109934339B (zh) * | 2019-03-06 | 2023-05-16 | 东南大学 | 一种基于一维脉动阵列的通用卷积神经网络加速器 |
CN109902821B (zh) * | 2019-03-06 | 2021-03-16 | 苏州浪潮智能科技有限公司 | 一种数据处理方法、装置及相关组件 |
-
2019
- 2019-07-11 CN CN201910624711.9A patent/CN110333827B/zh active Active
Also Published As
Publication number | Publication date |
---|---|
CN110333827A (zh) | 2019-10-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110333827B (zh) | 一种数据加载装置和数据加载方法 | |
US20210201124A1 (en) | Systems and methods for neural network convolutional layer matrix multiplication using cache memory | |
CN104077233B (zh) | 多通道卷积层处理方法和装置 | |
KR100862124B1 (ko) | 하위 포트 카운트 메모리를 이용하여 멀티포트 메모리를시뮬레이션하는 시스템 및 방법 | |
CN111240744B (zh) | 一种提高涉及稀疏矩阵并行计算效率的方法和*** | |
WO2021232769A1 (zh) | 一种存储数据的方法及数据处理装置 | |
CN113867644B (zh) | 磁盘阵列优化方法、装置、计算机设备及存储介质 | |
CN117349032B (zh) | 一种提高大语言模型吞吐量的方法及装置 | |
US9946461B2 (en) | In-flash immutable object processing | |
CN101504632A (zh) | 一种dma数据传输方法、***及一种dma控制器 | |
CN112988080B (zh) | 多数据页同时写入方法、3d闪存装置及计算机存储介质 | |
CN110515872B (zh) | 直接内存存取方法、装置、专用计算芯片及异构计算*** | |
CN110162483B (zh) | 静态内存碎片整理方法、装置、计算机设备及存储介质 | |
US20220188380A1 (en) | Data processing method and apparatus applied to graphics processing unit, and electronic device | |
CN112433847B (zh) | 一种OpenCL内核提交的方法及装置 | |
CN116048770A (zh) | 用于进程调度的方法和设备 | |
CN115775199A (zh) | 数据处理方法和装置、电子设备和计算机可读存储介质 | |
CN111078589B (zh) | 一种应用于深度学习计算的数据读取***、方法及芯片 | |
CN116048377A (zh) | 固态硬盘的数据处理方法及相关设备 | |
CN112036370A (zh) | 一种人脸特征比对方法、***、设备及计算机存储介质 | |
CN112991144B (zh) | 针对神经网络的图像数据进行分块的方法和*** | |
EP4150467B1 (en) | Two-way interleaving in a three-rank environment | |
CN104268101B (zh) | 一种存储空间分配方法及装置 | |
CN117311997B (zh) | 一种计算芯片的内存管理方法、装置及计算芯片 | |
CN111338974A (zh) | 用于矩阵数学指令集的图块化算法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20230711 Address after: Building S02, 1036 Gaoxin Langchao Road, Jinan, Shandong 250100 Applicant after: Shandong Inspur Scientific Research Institute Co.,Ltd. Address before: North 6th floor, S05 building, Langchao Science Park, 1036 Langchao Road, hi tech Zone, Jinan City, Shandong Province, 250100 Applicant before: SHANDONG INSPUR ARTIFICIAL INTELLIGENCE RESEARCH INSTITUTE Co.,Ltd. |
|
GR01 | Patent grant | ||
GR01 | Patent grant | ||
PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A data loading device and data loading method Granted publication date: 20230808 Pledgee: Qilu Bank Co.,Ltd. Jinan Science and Technology Innovation Financial Center Branch Pledgor: Shandong Inspur Scientific Research Institute Co.,Ltd. Registration number: Y2024980021353 |