CN107832017A - 一种提高地震数据存储io性能的方法及装置 - Google Patents
一种提高地震数据存储io性能的方法及装置 Download PDFInfo
- Publication number
- CN107832017A CN107832017A CN201711121585.2A CN201711121585A CN107832017A CN 107832017 A CN107832017 A CN 107832017A CN 201711121585 A CN201711121585 A CN 201711121585A CN 107832017 A CN107832017 A CN 107832017A
- Authority
- CN
- China
- Prior art keywords
- data
- virtual disk
- storage
- request
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000015654 memory Effects 0.000 claims abstract description 49
- 238000013507 mapping Methods 0.000 claims abstract description 24
- 238000013500 data storage Methods 0.000 claims abstract description 21
- 238000007726 management method Methods 0.000 claims abstract description 6
- 230000008569 process Effects 0.000 claims description 18
- 238000011084 recovery Methods 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 2
- 239000011800 void material Substances 0.000 claims 1
- 238000012545 processing Methods 0.000 abstract description 2
- 238000004891 communication Methods 0.000 description 7
- 230000007812 deficiency Effects 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 239000003209 petroleum derivative Substances 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
- G06F12/023—Free address space management
- G06F12/0253—Garbage collection, i.e. reclamation of unreferenced memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0664—Virtualisation aspects at device level, e.g. emulation of a storage device or system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
Description
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711121585.2A CN107832017B (zh) | 2017-11-14 | 2017-11-14 | 一种提高地震数据存储io性能的方法及装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711121585.2A CN107832017B (zh) | 2017-11-14 | 2017-11-14 | 一种提高地震数据存储io性能的方法及装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107832017A true CN107832017A (zh) | 2018-03-23 |
CN107832017B CN107832017B (zh) | 2021-02-12 |
Family
ID=61655433
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201711121585.2A Active CN107832017B (zh) | 2017-11-14 | 2017-11-14 | 一种提高地震数据存储io性能的方法及装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107832017B (zh) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111756828A (zh) * | 2020-06-19 | 2020-10-09 | 广东浪潮大数据研究有限公司 | 一种数据存储方法、装置及设备 |
CN112559816A (zh) * | 2019-09-26 | 2021-03-26 | 中国石油天然气集团有限公司 | 节点地震数据切分的性能优化方法及装置 |
CN112859166A (zh) * | 2019-11-27 | 2021-05-28 | 中国石油天然气集团有限公司 | 地震数据处理方法及装置 |
CN117149706A (zh) * | 2023-10-27 | 2023-12-01 | 山东大学 | 一种地震模拟数据的大规模并行优化方法及*** |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1945537A (zh) * | 2006-07-27 | 2007-04-11 | 清华大学 | 基于存储区域网络的高速固态存储设备的实现方法 |
CN102629941A (zh) * | 2012-03-20 | 2012-08-08 | 武汉邮电科学研究院 | 云计算***中虚拟机镜像缓存的方法 |
EP2350840B1 (en) * | 2008-10-20 | 2014-04-02 | Phan Tia Group Pte. LLC | Method for controlling performance aspects of a data storage and access routine |
CN104462225A (zh) * | 2014-11-12 | 2015-03-25 | 华为技术有限公司 | 一种数据读取的方法、装置及*** |
US9201494B1 (en) * | 2009-02-13 | 2015-12-01 | Unidesk Corporation | Multi-user managed desktop environment |
CN105867832A (zh) * | 2015-01-19 | 2016-08-17 | 张维加 | 一种面向用户与应用的计算机与智能设备加速方法和装置 |
CN106020718A (zh) * | 2016-05-09 | 2016-10-12 | 福建联迪商用设备有限公司 | 一种提高虚拟磁盘写入性能的方法及*** |
CN106547484A (zh) * | 2016-10-20 | 2017-03-29 | 华中科技大学 | 一种基于raid5的实现内存数据可靠性方法及*** |
CN106790422A (zh) * | 2016-12-02 | 2017-05-31 | 北京锐安科技有限公司 | 一种用于web应用的数据缓存集群和数据检索方法 |
CN106776798A (zh) * | 2016-11-23 | 2017-05-31 | 深圳市中博睿存科技有限公司 | 一种集群文件***基于客户端的可传播缓存方法 |
US9727273B1 (en) * | 2016-02-18 | 2017-08-08 | Veritas Technologies Llc | Scalable clusterwide de-duplication |
CN107168657A (zh) * | 2017-06-15 | 2017-09-15 | 深圳市云舒网络技术有限公司 | 一种基于分布式块存储的虚拟磁盘分层缓存设计方法 |
-
2017
- 2017-11-14 CN CN201711121585.2A patent/CN107832017B/zh active Active
Patent Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1945537A (zh) * | 2006-07-27 | 2007-04-11 | 清华大学 | 基于存储区域网络的高速固态存储设备的实现方法 |
EP2350840B1 (en) * | 2008-10-20 | 2014-04-02 | Phan Tia Group Pte. LLC | Method for controlling performance aspects of a data storage and access routine |
US9201494B1 (en) * | 2009-02-13 | 2015-12-01 | Unidesk Corporation | Multi-user managed desktop environment |
CN102629941A (zh) * | 2012-03-20 | 2012-08-08 | 武汉邮电科学研究院 | 云计算***中虚拟机镜像缓存的方法 |
CN104462225A (zh) * | 2014-11-12 | 2015-03-25 | 华为技术有限公司 | 一种数据读取的方法、装置及*** |
CN105867832A (zh) * | 2015-01-19 | 2016-08-17 | 张维加 | 一种面向用户与应用的计算机与智能设备加速方法和装置 |
US9727273B1 (en) * | 2016-02-18 | 2017-08-08 | Veritas Technologies Llc | Scalable clusterwide de-duplication |
CN106020718A (zh) * | 2016-05-09 | 2016-10-12 | 福建联迪商用设备有限公司 | 一种提高虚拟磁盘写入性能的方法及*** |
CN106547484A (zh) * | 2016-10-20 | 2017-03-29 | 华中科技大学 | 一种基于raid5的实现内存数据可靠性方法及*** |
CN106776798A (zh) * | 2016-11-23 | 2017-05-31 | 深圳市中博睿存科技有限公司 | 一种集群文件***基于客户端的可传播缓存方法 |
CN106790422A (zh) * | 2016-12-02 | 2017-05-31 | 北京锐安科技有限公司 | 一种用于web应用的数据缓存集群和数据检索方法 |
CN107168657A (zh) * | 2017-06-15 | 2017-09-15 | 深圳市云舒网络技术有限公司 | 一种基于分布式块存储的虚拟磁盘分层缓存设计方法 |
Non-Patent Citations (1)
Title |
---|
杨梦茹: "基于计算存储一体化策略的遥感数据高性能计算研究及应用", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112559816A (zh) * | 2019-09-26 | 2021-03-26 | 中国石油天然气集团有限公司 | 节点地震数据切分的性能优化方法及装置 |
CN112859166A (zh) * | 2019-11-27 | 2021-05-28 | 中国石油天然气集团有限公司 | 地震数据处理方法及装置 |
CN111756828A (zh) * | 2020-06-19 | 2020-10-09 | 广东浪潮大数据研究有限公司 | 一种数据存储方法、装置及设备 |
CN117149706A (zh) * | 2023-10-27 | 2023-12-01 | 山东大学 | 一种地震模拟数据的大规模并行优化方法及*** |
CN117149706B (zh) * | 2023-10-27 | 2024-03-19 | 山东大学 | 一种地震模拟数据的大规模并行优化方法及*** |
Also Published As
Publication number | Publication date |
---|---|
CN107832017B (zh) | 2021-02-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11349940B2 (en) | Server side data cache system | |
CN107832017A (zh) | 一种提高地震数据存储io性能的方法及装置 | |
CN109240946A (zh) | 数据的多级缓存方法及终端设备 | |
US9612758B1 (en) | Performing a pre-warm-up procedure via intelligently forecasting as to when a host computer will access certain host data | |
CN102164160B (zh) | 支持大并发量文件下载的方法、装置及*** | |
CN103544269B (zh) | 目录的存储方法、查询方法及节点控制器 | |
CN104850572A (zh) | HBase非主键索引构建与查询方法及其*** | |
CN109388590B (zh) | 提升多通道dma访问性能的动态缓存块管理方法和装置 | |
CN106066896A (zh) | 一种应用感知的大数据重复删除存储***及方法 | |
KR20120092930A (ko) | 맵 리듀스를 이용한 분산 메모리 클러스터 제어 장치 및 방법 | |
CN105117417A (zh) | 一种读优化的内存数据库Trie树索引方法 | |
CN103294702A (zh) | 一种数据处理方法、装置及*** | |
CN110321325A (zh) | 文件索引节点查找方法、终端、服务器、***及存储介质 | |
CN107688438A (zh) | 适用于大规模地震数据存储、快速定位的方法及装置 | |
CN107491487A (zh) | 一种全文数据库架构及位图索引创建、数据查询方法、服务器及介质 | |
CN102420814A (zh) | 一种数据访问方法、装置及服务器 | |
CN102694828A (zh) | 一种分布式缓存***数据存取的方法及装置 | |
CN106874459A (zh) | 流式数据存储方法及装置 | |
CN110413612A (zh) | 一种基于混合索引的混合内存性能优化方法及*** | |
CN107329910A (zh) | 一种基于localStorage的Web前端数据本地存储和访问方法 | |
CN102968456B (zh) | 一种栅格数据读取处理方法和装置 | |
CN110147345A (zh) | 一种基于rdma的键值存储***及其工作方法 | |
CN106649150A (zh) | 一种缓存管理方法及装置 | |
CN108140048A (zh) | 分层存储装置中的列式高速缓存 | |
CN106960011A (zh) | 分布式文件***元数据管理***及方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Applicant before: GEOPHYSICAL EXPLORATION COMPANY OF CNPC CHUANQING DRILLING ENGINEERING Co.,Ltd. Effective date of registration: 20201201 Address after: 100007 Beijing, Dongzhimen, North Street, No. 9, No. Applicant after: CHINA NATIONAL PETROLEUM Corp. Applicant after: BGP Inc., China National Petroleum Corp. Applicant after: CNPC Chuanqing Drilling Engineering Co.,Ltd. Address before: 610213, No. 1-4, Huayang Road, Huayang Town, Chengdu, Sichuan, Shuangliu County Applicant before: China National Petroleum Corp. Applicant before: CNPC Chuanqing Drilling Engineering Co.,Ltd. |
|
GR01 | Patent grant | ||
GR01 | Patent grant |