CN105487817B - A kind of customizable data storage method and system - Google Patents
A kind of customizable data storage method and system Download PDFInfo
- Publication number
- CN105487817B CN105487817B CN201510848227.6A CN201510848227A CN105487817B CN 105487817 B CN105487817 B CN 105487817B CN 201510848227 A CN201510848227 A CN 201510848227A CN 105487817 B CN105487817 B CN 105487817B
- Authority
- CN
- China
- Prior art keywords
- memory
- data
- user
- performance
- customizable
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000013500 data storage Methods 0.000 title claims abstract description 30
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000015654 memory Effects 0.000 claims abstract description 141
- 230000005540 biological transmission Effects 0.000 claims abstract description 8
- 238000012546 transfer Methods 0.000 claims description 11
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 239000007787 solid Substances 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013075 data extraction Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to memory area more particularly to a kind of customizable data storage method and system, it can be applied to the user data transmission between different performance memory, customize the user data to be transmitted；Customize the delivery time of the user data；By the user data to be transmitted according to the delivery time of customization, second memory is sent to from first memory；Wherein the storage performance of the second memory is higher than the first memory.
Description
Technical Field
The present invention relates to the field of memory, and in particular, to a customizable data storage method and system.
Background
However, as the technology generation of semiconductor technology is continuously advanced, NAND flash memory suffers from more and more bottleneck problems, such as the floating gate thickness cannot be infinitely thinned along with the reduction of the device size. In addition, other technical shortcomings of NAND flash memory limit its applications, such as high operating voltage, slow writing speed, etc.
Compared with a NAND flash memory, the 3D novel nonvolatile memory is a technology for changing a plane of a memory unit into a 3D vertical stacking, so that the integration level of chips is high, the memory density of each chip can be very high, and the capacity is large, for example, the 3D Xpoint phase change memory which is being developed by Intel, the memory capacity of each chip can reach 128Gb or 256Gb, and is even higher in the near future, for example, the Tb magnitude. The random read-write speed of the 3D nonvolatile memory is high, and the 3D nonvolatile memory can even be used as the last level off-chip cache of a processor.
Fig. 1 is a schematic structural diagram of a 3D nonvolatile memory in the prior art, and a 3D nonvolatile memory chip may be packaged in a package with at least a central processing unit or an off-chip last-level cache chip by a multi-chip package technology (MCP), as shown in fig. 1. The off-chip last level cache chip may be an embedded dynamic random access memory (eDRAM); the 3D nonvolatile memory is a 3D phase change memory (3D PCM) with gradually mature technology, and can also be other 3D nonvolatile memories. Because the 3D novel nonvolatile memory and the CPU are integrated in the same package, the access speed is very high, and the 3D novel nonvolatile memory can be used for replacing part or all of a system main memory and also can be used as a nonvolatile part of an off-chip last-level cache of the CPU. Because the 3D novel nonvolatile memory has very high access speed and high performance, the data frequently accessed by the CPU can be stored, and the data not frequently accessed by the system can be stored in a mass memory outside the system, so that the performance of the system is remarkably improved.
Fig. 2 is a schematic diagram of a storage data structure of a hybrid solid state disk, and the 3D novel nonvolatile memory can also be applied to a memory level, for example, the memory can be combined with a conventional NAND flash memory to form a hybrid solid state disk memory, as shown in fig. 2. Compared with a NAND flash memory, the 3D novel nonvolatile memory has the advantages of high reading speed and high performance, so that the data which are accessed by the system most frequently can be stored, and the data which are not accessed by the system frequently can be stored in the NAND flash memory, so that the performance of the whole hybrid solid state disk memory is greatly improved.
Neither the memory structure shown in fig. 1 nor fig. 2 can solve the following situation. Data which is not accessed frequently for a long time may be accessed frequently by a specific user in a certain time period, and the data is stored in a memory with lower performance, so the specific user cannot enjoy the high performance of the 3D novel nonvolatile memory in the certain time period, and the user experience is very poor. For example, the storage system of a company server is a hybrid memory composed of a 3D nonvolatile memory and an HDD memory. The server is frequently used by the design department, a large amount of data used by the design department is stored in a high-performance 3D novel nonvolatile memory, and the server is rarely used by the financial department in comparison, because the financial department makes financial data statistics on a certain day in a month or a week or a certain period of the day, so the data used by the financial department are not read frequently and are stored in the HDD memory. Then, when the financial staff needs to access the financial data each time, the financial staff needs to read the data from the HDD memory with low performance, and the financial staff feels that the data reading is very slow, and cannot enjoy the high performance of the 3D nonvolatile memory, which delays the progress of the work and reduces the work efficiency. This is a result that financial personnel do not want to see.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a customizable data storage method and a customizable data storage system, which can quickly and efficiently read data according to customization of a user.
The invention adopts the following technical scheme:
a customizable data storage method for user data transfer between different performance memories, the data storage method comprising:
customizing the user data to be transmitted;
customizing a transfer time of the user data;
transferring the user data to be transmitted from a first memory to a second memory at the customized transmission time;
wherein the second memory has a higher storage performance than the first memory.
Preferably, the data storage method further comprises:
customizing a return time of the user data; and after the user data is transferred to the second memory, the user data is transferred from the second memory to the first memory at the customized return time.
Preferably, the first memory is an HDD and/or a NAND flash memory.
Preferably, the second memory is a 3D nonvolatile memory.
Preferably, the first memory stores first data, and the second memory stores second data; and
the access frequency of the first data is less than the access frequency of the second data.
Preferably, the data storage method specifically includes:
and transferring the first data to be transmitted from the first memory to the second memory at the customized transmission time.
Preferably, the user data is accessed after being transferred from the first memory to the second memory.
A customizable data storage system, the data storage system comprising:
a first memory storing first user data;
a second memory connected to the first memory; second user data is stored;
a user customizing module respectively connected with the first memory and the second memory, customizing the user data to be transmitted in the first user data, customizing the transmission time of the user data to be transmitted, and
when the transfer time arrives, the customization module transfers the user data to be transferred from the first memory to the second memory; wherein,
the storage performance of the second memory is higher than that of the first memory, and the access frequency of the first data is less than that of the second data.
Preferably, the first memory is an HDD and/or a NAND flash memory.
Preferably, the second memory is a 3D nonvolatile memory.
The invention has the beneficial effects that:
the invention provides a user-customizable data storage method. For a mixed memory composed of a high-performance memory and a low-performance memory, a part of specified data which is stored in the low-performance memory and is used occasionally can be set to be stored in the high-performance memory before being used through a user customizable module, so that when a specific user uses the part of specified data, the data can be directly read from the high-performance memory quickly and efficiently, and the user experience is improved.
Drawings
FIG. 1 is a schematic diagram of a 3D novel non-volatile memory according to the prior art;
FIG. 2 is a schematic diagram of a storage data structure of a hybrid solid state disk;
FIG. 3 is a schematic structural diagram of a first embodiment of a customizable data storage system according to the present invention;
FIG. 4 is a diagram illustrating a second embodiment of a customizable data storage method according to the present invention;
fig. 5 is a schematic diagram illustrating user data transmission in a storage system according to a third embodiment of the present invention.
Detailed Description
In the following embodiments, the technical features may be combined with each other without conflict.
The following further describes embodiments of the present invention with reference to the drawings:
example one
As shown in fig. 3, a memory system in, for example, one computer architecture may be divided into a high performance memory (second memory) and a low performance memory (first memory). The high-performance memory has high access speed, high working performance and good user experience, and can be a 3D novel nonvolatile memory; the low performance memory, such as HDD, NAND flash memory, etc., has lower access speed, performance, and user experience than high performance memory. For a hybrid memory composed of a high-performance memory and a low-performance memory, a part of specified data (user data) which is stored in the low-performance memory and is used occasionally can be set to be stored in the high-performance memory before being used through a user customizable module, so that when the specified data is used by a specific user, the data can be directly and efficiently read from the high-performance memory, and the user experience is improved.
In this embodiment, the user-customizable data storage method is implemented by a user-customizable module, which can be set by a user and can migrate specific user data from a low-performance memory to a high-performance memory in a specified time period, so that the user can access the specific user data more quickly and efficiently during use, and the user experience is greatly improved. The specified time period may be a specific day of a month, or a certain time period within a certain day, etc.
Example two
The following will specifically describe the implementation process of the user-customizable data storage method of the present invention, as shown in fig. 4:
firstly, inputting a data extraction instruction:
step S1: those customized by a particular user require data to be migrated from low performance storage to high performance storage.
Step S2: the time period for migrating the data from the low-performance storage to the high-performance storage in step S1 is implemented, and the time period for migrating the data should be prior to the time period for using the data by the specific user, so that when the data is used by the specific user, the data has been migrated from the low-performance storage to the high-performance storage.
In a preferred embodiment of the present invention, the steps S1 and S2 can be combined to realize the migration of data of different users from the low performance memory to the high performance memory within a time period set by different users.
Followed by the output of a data fetch instruction:
the system may move the user-customized data from the low-performance memory to the high-performance memory within a specified time period based on the input.
EXAMPLE III
The following is a further description of an embodiment:
as shown in FIG. 5, the data (first data) of the finance department is not frequently accessed, so the system stores the data of the finance department in the HDD memory with low performance. When the financial staff visits the data of the financial department, the reading speed is slow, and the experience is poor. However, the user-customizable data storage method provided by the embodiment can be used for well avoiding the situation. As shown in FIG. 5, assume that the Ministry of finance staff needs to make financial data statistics at three to five pm on every thursday afternoon. The invention is applied to input to the user customizable module: (1) specifying data: financial department data; (2) the designated time is as follows: on thursday afternoon, 1 to 2 o 'clock, but of course any idle period before the financial staff accesses the financial department data at 3 o' clock on thursday afternoon. Therefore, the user customizable module can move the financial part data from the low-performance storage HDD to the high-performance 3D novel nonvolatile storage at 1-2 pm every thursday afternoon. Then at 3 pm on a thursday basis, the fiscal staff can access the fiscal department data directly from the high performance memory 3D new nonvolatile memory. Therefore, the speed of accessing financial data is increased, the working efficiency of workers is improved, and the experience of financial workers is improved. When the financial staff finishes processing the data of the financial department, the system can move the data of the part to the low-performance memory again to make room for storing the data (second data) which is frequently accessed by other departments.
In summary, the present invention provides a user-customizable data storage method. For a mixed memory composed of a high-performance memory and a low-performance memory, a part of specified data which is stored in the low-performance memory and is used occasionally can be set to be stored in the high-performance memory before being used through a user customizable module, so that when a specific user uses the part of specified data, the data can be directly read from the high-performance memory quickly and efficiently, and the user experience is improved.
While the specification concludes with claims defining exemplary embodiments of particular structures for practicing the invention, it is believed that other modifications will be made in the spirit of the invention. While the above invention sets forth presently preferred embodiments, these are not intended as limitations.
Various alterations and modifications will no doubt become apparent to those skilled in the art after having read the above description. Therefore, the appended claims should be construed to cover all such variations and modifications as fall within the true spirit and scope of the invention. Any and all equivalent ranges and contents within the scope of the claims should be considered to be within the intent and scope of the present invention.
Claims (7)
1. A customizable data storage method, applied to user data transfer between different performance stores, the data storage method comprising:
customizing the user data to be transmitted, wherein the user data is characterized in that the user data which needs to be migrated from the low-performance storage to the high-performance storage is customized by a specific user; the access frequency of the user data is low;
customizing a transfer time of the user data; the transfer time is characterized by a transfer time customized by a particular user, the transfer time should precede a period of time during which the particular user uses the data;
transferring the user data to be transmitted from a first memory to a second memory at the customized transmission time;
wherein the second memory has a higher storage performance than the first memory;
a customizable data storage system, the data storage system comprising:
a first memory storing first data;
a second memory connected to the first memory; second data is stored;
a user customizing module respectively connected with the first memory and the second memory, customizing the user data to be transmitted in the first data, customizing the transmission time of the user data to be transmitted, and
when the transfer time arrives, the customization module transfers the user data to be transferred from the first memory to the second memory; wherein,
the storage performance of the second memory is higher than that of the first memory, and the access frequency of the first data is less than that of the second data.
2. The customizable data storage method of claim 1, further comprising:
customizing a return time of the user data; and after the user data is transferred to the second memory, the user data is transferred from the second memory to the first memory at the customized return time.
3. The customizable data storage method of claim 1, wherein the first memory is an HDD and/or a NAND flash memory.
4. The customizable data storage method of claim 1, wherein the second memory is a 3D non-volatile memory.
5. The customizable data storage method according to claim 1, characterized in that the first memory stores first data and the second memory stores second data; and
the access frequency of the first data is less than the access frequency of the second data.
6. The customizable data storage method according to claim 5, characterized in that the data storage method specifically comprises:
and transferring the first data to be transmitted from the first memory to the second memory at the customized transmission time.
7. The customizable data storage method of claim 1, wherein the user data is accessed after the user data is transferred from the first memory to the second memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510848227.6A CN105487817B (en) | 2015-11-26 | 2015-11-26 | A kind of customizable data storage method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510848227.6A CN105487817B (en) | 2015-11-26 | 2015-11-26 | A kind of customizable data storage method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105487817A CN105487817A (en) | 2016-04-13 |
| CN105487817B true CN105487817B (en) | 2019-09-10 |
Family
ID=55674822
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510848227.6A Active CN105487817B (en) | 2015-11-26 | 2015-11-26 | A kind of customizable data storage method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105487817B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110659733A (en) * | 2019-09-20 | 2020-01-07 | 上海新储集成电路有限公司 | Processor system for accelerating prediction process of neural network model |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7877524B1 (en) * | 2007-11-23 | 2011-01-25 | Pmc-Sierra Us, Inc. | Logical address direct memory access with multiple concurrent physical ports and internal switching |
| CN103440208A (en) * | 2013-08-12 | 2013-12-11 | 华为技术有限公司 | Data storage method and device |
| CN104317731A (en) * | 2014-10-17 | 2015-01-28 | 杭州华为数字技术有限公司 | Hierarchical storage management method, device and storage system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101464338B1 (en) * | 2007-10-25 | 2014-11-25 | 삼성전자주식회사 | Data storage device, memory system, and computing system using nonvolatile memory device |
-
2015
- 2015-11-26 CN CN201510848227.6A patent/CN105487817B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7877524B1 (en) * | 2007-11-23 | 2011-01-25 | Pmc-Sierra Us, Inc. | Logical address direct memory access with multiple concurrent physical ports and internal switching |
| CN103440208A (en) * | 2013-08-12 | 2013-12-11 | 华为技术有限公司 | Data storage method and device |
| CN104317731A (en) * | 2014-10-17 | 2015-01-28 | 杭州华为数字技术有限公司 | Hierarchical storage management method, device and storage system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105487817A (en) | 2016-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11797433B2 (en) | Zoned namespace with zone grouping | |
| US11914531B2 (en) | Host controller interface using multiple circular queue, and operating method thereof | |
| KR101665611B1 (en) | Computer system and method of memory management | |
| US9342247B2 (en) | Leveraging a hybrid infrastructure for dynamic memory allocation and persistent file storage | |
| US10949120B2 (en) | Host defined bandwidth allocation for SSD tasks | |
| US9727267B1 (en) | Power management and monitoring for storage devices | |
| US10452269B2 (en) | Data storage devices having scale-out devices to map and control groups of non-volatile memory devices | |
| CN105518784A (en) | Data processor with memory controller for high reliability operation and method | |
| US20180115496A1 (en) | Mechanisms to improve data locality for distributed gpus | |
| US20150293845A1 (en) | Multi-level memory hierarchy | |
| US20140215177A1 (en) | Methods and Systems for Managing Heterogeneous Memories | |
| US9268681B2 (en) | Heterogeneous data paths for systems having tiered memories | |
| CN103218312A (en) | File access method and file access system | |
| US10095432B2 (en) | Power management and monitoring for storage devices | |
| CN103218305A (en) | Distribution method of memory space | |
| US20180004657A1 (en) | Data storage in a mobile device with embedded mass storage device | |
| US10838884B1 (en) | Memory access quality-of-service reallocation | |
| US10416886B2 (en) | Data storage device that reassigns commands assigned to scale-out storage devices and data processing system having the same | |
| CN105487817B (en) | A kind of customizable data storage method and system | |
| US11567862B2 (en) | Configurable NVM set to tradeoff between performance and user space | |
| US20200363997A1 (en) | Ssd managed host write atomicity with arbitrary transfer length | |
| US20130290605A1 (en) | Converged memory and storage system | |
| US11182329B2 (en) | Data processing system and operating method thereof | |
| CN110297784B (en) | Virtual weight memory system and data processing method | |
| US20170031633A1 (en) | Method of operating object-oriented data storage device and method of operating system including the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |