CN113900597A - Data storage method, system, equipment and storage medium - Google Patents
Data storage method, system, equipment and storage medium Download PDFInfo
- Publication number
- CN113900597A CN113900597A CN202111444161.6A CN202111444161A CN113900597A CN 113900597 A CN113900597 A CN 113900597A CN 202111444161 A CN202111444161 A CN 202111444161A CN 113900597 A CN113900597 A CN 113900597A
- Authority
- CN
- China
- Prior art keywords
- data
- stored
- data storage
- cold
- storage area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0616—Improving the reliability of storage systems in relation to life time, e.g. increasing Mean Time Between Failures [MTBF]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0676—Magnetic disk device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data storage method, a system, equipment and a storage medium, wherein the method comprises the following steps: receiving a data storage request, wherein the data storage request comprises data to be stored; determining the data type of the data to be stored according to a preset rule, wherein the data type comprises hot data and cold data; and placing the data to be stored in the corresponding data storage area according to the data type. The method classifies different data to be stored, stores different cold and hot data in different storage areas, reduces the frequency of reading the disk by the system, and further improves the stability of the system.
Description
Technical Field
The present invention relates to the field of data storage, and in particular, to a data storage method, system, device, and storage medium.
Background
With the popularization of cloud computing and the internet of things, the data volume is increasing at an unprecedented high speed, and more files or data are needed to be processed by enterprises, so that how to reasonably and efficiently manage the files is very important. Although the existing file system can meet the basic functions of uploading, downloading, inquiring and the like of files, the operations are basically centered on the files, and therefore, business personnel are inconvenient to efficiently manage data. Therefore, it is important to classify data properly, and some data used by the system in real time is called "hot data", some data which is not used too frequently but is called by the system frequently is called "warm data", and some data which is used rarely by the system is called "cold data" according to the difference of data. More and more enterprises need to backup data which is not used frequently and store the data in a low-energy-consumption and high-capacity mode, namely, cold data storage in reality. However, as a large amount of data needs to be stored and called to bring a large amount of operation load to the server, and different security protection policies are different according to the data, a data storage method is urgently needed to solve the problems in the prior art.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a data storage method, and aims to solve the technical problems of storage of a large amount of data and different security protection strategies of different data.
In order to achieve the above object, the present invention provides a data storage method, including:
receiving a data storage request, wherein the data storage request comprises data to be stored;
determining the data type of the data to be stored according to a preset rule, wherein the data type comprises hot data and cold data;
and placing the data to be stored in the corresponding data storage area according to the data type.
As an embodiment of the present invention, the step of determining the data type of the data to be stored according to a preset rule includes:
acquiring the format of the data to be stored;
and determining the data type of the data to be stored according to a preset data format storage rule.
As an embodiment of the present invention, the step of determining the data type of the data to be stored according to a preset rule includes:
acquiring the calling frequency of the data to be stored;
and determining the data type of the data to be stored according to the calling frequency storage rule.
As an embodiment of the present invention, the step of determining the data type of the data to be stored according to the call frequency storage rule further includes:
if the calling frequency of the data to be stored reaches a preset calling frequency, determining that the data to be stored is thermal data;
and if the calling frequency of the data to be stored does not reach the preset calling frequency, determining that the data to be stored is cold data.
As an embodiment of the present invention, the step of placing the data to be stored in the corresponding data storage area according to the data type includes:
if the data to be stored is thermal data, storing the data to be stored in a thermal data storage area, and generating corresponding coordinate data according to a storage position;
and if the data to be stored is cold data, storing the data to be stored in a cold data storage area.
As one embodiment of the present invention, detecting a data call frequency in the cold data storage area and the hot data storage area;
extracting cold data with the data calling frequency reaching a preset frequency in the cold data storage area, and storing the cold data into a hot data storage area;
and extracting the hot data with the data calling frequency lower than the preset frequency in the hot data storage area, and storing the hot data into a cold data storage area.
As an embodiment of the present invention, the step of placing the data to be stored in the corresponding data storage area according to the data type further includes:
determining the classification of the data to be stored according to the data attribute of the data to be stored;
and storing the data to be stored into a corresponding classification area in a corresponding data storage area according to the classification of the data to be stored.
Further, in order to achieve the above object, one embodiment of the present invention provides a data storage system, including: the device comprises a receiving module, a storage module and a processing module, wherein the receiving module is used for receiving a data storage request which comprises data to be stored;
the determining module is used for determining the data type of the data to be stored according to a preset rule;
and the storage module is used for placing the data to be stored in the corresponding data storage area according to the data type.
In addition, to achieve the above object, one embodiment of the present invention provides an electronic device,
comprising at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the memory has stored thereon instructions executable by at least one processor, the instructions being executable by the at least one processor to enable the at least one processor, when executed, to implement the steps of any of the above data storage.
Further, in order to achieve the above object, one embodiment of the present invention provides a storage medium having a data storage program stored thereon, wherein the data storage program, when executed by a processor, implements the steps of the data storage according to any one of the above items.
The data storage method and the data storage system provided by the invention have the following beneficial effects:
the invention provides a data storage method, which comprises the following steps: receiving a data storage request, wherein the data storage request comprises data to be stored; determining the data type of the data to be stored according to a preset rule, wherein the data type comprises hot data and cold data; and placing the data to be stored in the corresponding data storage area according to the data type. The method classifies different data to be stored, stores different cold and hot data in different storage areas, reduces the frequency of reading the disk by the system, and further improves the stability of the system.
Drawings
FIG. 1 is a schematic diagram of a terminal \ device structure of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a data storage method according to an embodiment of the present invention;
FIG. 3 is a detailed flowchart of the step of step S10 in FIG. 2;
FIG. 4 is a flowchart illustrating a detailed process of step S10 in one embodiment of the data storage method according to the present invention;
FIG. 5 is a detailed flowchart of step S102 in FIG. 4;
FIG. 6 is a detailed flowchart of step S30 in FIG. 1;
FIG. 7 is a flowchart illustrating steps of a data storage method according to an embodiment of the present invention;
FIG. 8 is a flowchart illustrating a detailed process of step S30 in one embodiment of a data storage method according to the present invention;
FIG. 9 is a schematic structural diagram of a data storage system according to an embodiment of the present invention;
FIG. 10 is a system diagram of a data storage system according to one embodiment of the invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: receiving a data storage request, wherein the data storage request comprises data to be stored; determining the data type of the data to be stored according to a preset rule, wherein the data type comprises hot data and cold data; and placing the data to be stored in the corresponding data storage area according to the data type.
The invention provides a solution for receiving a data storage request, wherein the data storage request comprises data to be stored; determining the data type of the data to be stored according to a preset rule, wherein the data type comprises hot data and cold data; and placing the data to be stored in the corresponding data storage area according to the data type.
As shown in fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention.
The terminal of the embodiment of the invention can be a PC, and can also be a mobile terminal device with a display function, such as a smart phone, a tablet computer, an electronic book reader, an MP3 (Moving Picture Experts Group Audio Layer III, motion video Experts Group Audio Layer 3) player, an MP4 (Moving Picture Experts Group 4) player, a portable computer, and the like.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Optionally, the terminal may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like. Such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display screen according to the brightness of ambient light, and a proximity sensor that may turn off the display screen and/or the backlight when the mobile terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when the mobile terminal is stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer and tapping) and the like for recognizing the attitude of the mobile terminal; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, the memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a data storage application program.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to invoke a data storage application stored in the memory 1005 and perform the following operations:
receiving a data storage request, wherein the data storage request comprises data to be stored;
determining the data type of the data to be stored according to a preset rule, wherein the data type comprises hot data and cold data;
and placing the data to be stored in the corresponding data storage area according to the data type.
Further, the processor 1001 may call a data storage application stored in the memory 1005, and also perform the following operations:
the step of determining the data type of the data to be stored according to a preset rule comprises the following steps:
acquiring the format of the data to be stored;
and determining the data type of the data to be stored according to a preset data format storage rule.
Further, the processor 1001 may call a data storage application stored in the memory 1005, and also perform the following operations:
the step of determining the data type of the data to be stored according to a preset rule comprises the following steps:
acquiring the calling frequency of the data to be stored;
and determining the data type of the data to be stored according to the calling frequency storage rule.
Further, the processor 1001 may call a data storage application stored in the memory 1005, and also perform the following operations:
the step of determining the data type of the data to be stored according to the calling frequency storage rule further comprises:
if the calling frequency of the data to be stored reaches a preset calling frequency, determining that the data to be stored is thermal data;
and if the calling frequency of the data to be stored does not reach the preset calling frequency, determining that the data to be stored is cold data.
Further, the processor 1001 may call a data storage application stored in the memory 1005, and also perform the following operations:
the step of placing the data to be stored in the corresponding data storage area according to the data type comprises the following steps:
if the data to be stored is thermal data, storing the data to be stored in a thermal data storage area, and generating corresponding coordinate data according to a storage position;
and if the data to be stored is cold data, storing the data to be stored in a cold data storage area.
Further, the processor 1001 may call a data storage application stored in the memory 1005, and also perform the following operations:
the method further comprises the following steps:
detecting data calling frequencies in the cold data storage area and the hot data storage area;
extracting cold data with the data calling frequency reaching a preset frequency in the cold data storage area, and storing the cold data into a hot data storage area;
and extracting the hot data with the data calling frequency lower than the preset frequency in the hot data storage area, and storing the hot data into a cold data storage area.
Further, the processor 1001 may call a data storage application stored in the memory 1005, and also perform the following operations:
the step of placing the data to be stored in the corresponding data storage area according to the data type further comprises:
determining the classification of the data to be stored according to the data attribute of the data to be stored;
and storing the data to be stored into a corresponding classification area in a corresponding data storage area according to the classification of the data to be stored.
Referring to fig. 2, a first embodiment of a data storage precaution of the present invention provides a data storage precaution method, including:
step S10, receiving a data storage request, wherein the data storage request comprises data to be stored;
step S20, determining the data type of the data to be stored according to a preset rule, wherein the data type comprises hot data and cold data;
and step S30, placing the data to be stored in the corresponding data storage area according to the data type.
Specifically, in this embodiment, with the high-speed development of the internet, the data volume increases explosively, the back-end storage of the service data is subject to higher adjustment, especially a cache system supporting high throughput service, and the memory is increased greatly in the context of mass data storage. In this embodiment, when a data storage request sent by a client to a server is received, and the data request includes data to be stored, the server determines a data type of the data to be stored according to a preset rule after finding corresponding data in the data request, where the data to be stored may be divided into: cold data and hot data. And correspondingly storing the classified data into corresponding storage areas.
In this embodiment, when a server receives a data storage request, the data storage request includes data to be stored; determining the data type of the data to be stored according to a preset rule, wherein the data type comprises hot data and cold data; and placing the data to be stored in the corresponding data storage area according to the data type. And reasonably distinguishing the data and storing the data in corresponding positions. The frequency of reading the magnetic disk can be reduced, and the stability of the system is improved.
Further, referring to fig. 3, in an embodiment of the data storage method according to the present invention, the step S20 further includes:
step S201', obtaining the format of the data to be stored;
step S202', the data type of the data to be stored is determined according to a preset data format storage rule.
Specifically, in this embodiment, data is classified according to the type of the data, and the data is stored in the corresponding storage area according to the corresponding data type, for example, in this embodiment, there are 5 types of common file types, which are specifically as follows: 1. a text file type. Text file type: including ASCII, MIME,. txt, etc. (1) The ASCII standard allows text files containing only ASCII characters to interact freely between Unix, Macintosh, Microsoft Windows, DOS, and other operating systems. (2) The type of text file in the MIME standard is "text/play", and in addition, it usually attaches encoded information. Before Mac OS X appeared, when Resource fork specified that a certain file was of type "TEXT", the Mac OS considered that this file was a TEXT file. (3) Txt is an extension of a text file that contains little formatting information. Txt format is not explicitly defined and generally refers to those formats that can be accepted by a system terminal or a simple text editor. 2. Video file format type. Video file formats have different classifications, such as: (1) microsoft video: wmv, asf, asx. (2) Real Player: rm, rmvb. (3) MPEG video: mp 4. (4) Mobile phone video: 3gp of a microorganism. (5) Apple video: mov, m4 v. (6) Other common videos: avi, dat, mkv, flv, vob, etc. 3. Audio file format type. Audio file format type: including Wave, AIFF, Audio, MPEG, RealAudio, MIDI, and other formats. (1) The Wave format is a sound File format developed by microsoft corporation, which conforms to the piff (resource exchange File format) File specification, is used for storing audio information resources of WINDOWS platform, and is supported by WINDOWS platform and application program thereof. (2) AIFF is an english abbreviation for audio exchange file format, an audio file format developed by apple computer corporation. (3) An Audio file is a compressed digital Audio format from Sun Microsystems, Inc., and is a commonly used Audio file format in the Internet. (4) MPEG (Moving Picture Experts Group) stands for a Moving Picture compression standard, and the audio file format herein refers to an audio part in the MPEG standard. (5) The RealAudio file is a new Streaming Audio file format developed by RealNetworks, which is included in the RealMedia standard of Audio and video compression established by RealNetworks, and is mainly used for transmitting Audio information in real time over a low-rate wide area network. (6) MIDI (Musical Instrument Digital Interface) is a unified international standard for Digital music/synthetic instruments that defines the manner in which computer music programs, synthesizers, and other electronic devices exchange music signals. 4. Picture file format type. The image formats, which are formats for storing image files, are usually JPEG, TIFF, RAW, BMP, GIF, PNG, and the like. Since the image file captured by the digital camera is large and has a limited storage capacity, the image is usually compressed and stored. 5. An executable file format type. An executable file refers to a file that can be loaded for execution by the operating system. In different operating system environments, executable programs are presented differently. Under the windows operating system, the executable program may be an exe file, sys file, com, etc. type file. And classifying the data to be stored according to different data types, and storing the data to different areas according to different classifications.
In the embodiment, according to the difference of the data types, the data are stored in different areas, so that the data can be called in time when being called next time, and the problems that the data volume is too much and the classification is unreasonable, and the consumption time is long and the server load is too high when the data are called next time are solved.
Further, referring to fig. 4, in an embodiment of the data storage method of the present invention, the step S20 further includes:
step S201, obtaining the calling frequency of the data to be stored;
step S202, determining the data type of the data to be stored according to the calling frequency storage rule.
Further, referring to fig. 5, the step S202 further includes:
step S2021, if the calling frequency of the data to be stored reaches a preset calling frequency, determining that the data to be stored is thermal data;
step S2022, if the calling frequency of the data to be stored does not reach the preset calling frequency, determining that the data to be stored is cold data.
Specifically, in the present embodiment, the data to be stored is automatically hierarchically processed. In the prior art, the data is layered and processed mostly by dividing the data into hot data, warm data and cold data according to the access frequency of the data. When the access frequency of the data is taken as a parameter, a time period is generally selected, the number of accesses to the data in the time period is counted, a threshold value is set, and the data is considered to be cold data when the number of accesses in the time period is lower than the threshold value. Here, the time period is an arbitrary time period, may be a long time period such as a month or a year, or may be a short time period such as a minute or an hour, and the number of accesses is an integer of 0 or more. For example, a year may be set as a time period, the number of accesses to data in the year is counted, and a threshold value is set as 20 times, and data with the number of accesses in the year lower than 20 times is classified as cold data. The time period may be set to one hour, the number of accesses to the data in one hour is counted, the threshold value is set to 100 times, and the data with the number of accesses in one hour lower than 100 times is classified as cold data. The access frequency and the threshold value are usually set according to the average access frequency of all data, and the values have practical significance relative to the average access frequency. The data layering is carried out according to the access frequency, and the method has the advantages of single standard, simplicity and easiness. But the disadvantage is also apparent that the standard is too simple to accommodate the needs of most data. For example, some data are accessed a high number of times in a short period of time but are not accessed for a long period of time other than the short period of time, and if the data are set as hot data only according to the access frequency, a large part of the storage space is occupied and the data are accessed for a long period of time, which results in waste of storage resources and poor storage performance. For another example, some data occupies a large capacity, the number of accesses is at a medium level, and is slightly higher than the threshold of the access frequency, and if the data is stored as hot data, a large amount of flash memory space is occupied, so that the overall storage speed is reduced, or the capacity of the flash memory has to be expanded. In this case, two factors, i.e., the access frequency and the size of the data file, need to be measured to reasonably layer the data. For another example, some data have high access frequency, but analysis shows that the access to the data is concentrated in a small part of the data, and if the part of the data is subdivided and the part with high access frequency is separated, the rest part can be stored as cold data, thereby realizing efficient utilization of storage space. If only a single criterion of access frequency is used, such information cannot be found, in which case a subdivision of the data according to its type is necessary. In practical application, the data structure is very complex, the access frequency cannot reflect the association and the difference between various data, most data cannot be effectively distinguished, and thus data storage management in the true sense cannot be achieved.
In the embodiment, data classification is performed according to the access frequency of the data to be stored, the data with high access frequency is divided into hot data and the data with low access frequency is cold data, so that balance between the storage space and the access speed is realized, and the server can store and read the cold data and the hot data when a large amount of data burst.
Further, referring to fig. 6, based on the above embodiment, in an embodiment of a data storage method according to the present invention, the step S30 further includes:
step S301, if the data to be stored is thermal data, storing the data to be stored in a thermal data storage area, and generating corresponding coordinate data according to a storage position;
step S302, if the data to be stored is cold data, storing the data to be stored in a cold data storage area.
Specifically, in this embodiment, when the generation storage data is hot data, it indicates that the data will be frequently read, modified, or referred to in an active state, and it is beneficial for the user to revisit the data in the near future. If the data to be stored is cold data, the data to be stored generally cannot be revisited by the user within a short time after the data is stored, and the data to be stored is in a static state after the data is stored, and does not change any more. Cold data can be directly stored in the cold data storage area.
In this embodiment, different storage modes are adopted according to different storage data, corresponding coordinate position information is generated after storage of frequently accessed hot data is completed, so that a user can conveniently access the hot data next time, and the data stored in the cold data storage area as cold data is directly stored in the cold data storage area as a static state.
Further, referring to fig. 7, based on the above embodiment, in an embodiment of a data storage method according to the present invention, the method further includes:
step S40, detecting the data calling frequency in the cold data storage area and the hot data storage area;
step S50, extracting cold data of which the data calling frequency reaches a preset frequency in the cold data storage area, and storing the cold data in the hot data storage area;
and step S60, extracting the hot data with the data calling frequency lower than the preset frequency in the hot data storage area, and storing the hot data in the cold data storage area.
Specifically, in the present embodiment, data access frequency detection is performed on already stored data, when the access frequency of cold data stored in a cold data storage region has reached the access frequency of hot data within a certain time range, the cold data is converted into a hot data storage region, and if the access frequency of data in a hot data storage region is lower than the access frequency of hot data, the corresponding hot data is converted into the cold data storage region and stored as cold data. For example, in an enterprise data management system, data such as company sales bulletins and logistics in a cold data area is exchanged from the cold data area to a hot data storage area at the end of the year and stored as hot data.
In the embodiment, for the stored data, according to the difference of the detected access frequency, when the cold data in the cold data storage region meets the storage condition of the hot data, the cold data meeting the condition is exchanged into the hot data storage region for storage, and the corresponding position coordinate information is generated, on the other hand, when the hot data in the hot data storage region does not meet the access frequency condition of the hot data, the hot data not meeting the condition is directly exchanged into the cold data storage region as the cold data for storage.
Further, referring to fig. 8, based on the foregoing embodiment, in an embodiment of the data storage method provided in the present invention, the step S30 further includes:
step S301', determining the classification of the data to be stored according to the data attribute of the data to be stored;
and step S302', storing the data to be stored into a corresponding classification area in a corresponding data storage area according to the classification of the data to be stored.
Specifically, in the present embodiment, the data may be classified according to the effect of the data on the user, and the data may be classified according to the usage habit of the user or the industry feature engaged in by the user. For example, production, logistics and sales are three different types of industries, each in a different phase, production in the initial phase, logistics and sales in the final phase after production, and completion of a transaction means the end of logistics and sales, i.e. logistics data and sales data are static after completion of a transaction and no longer change, and are generally not revisited by a user shortly after the user confirms completion of a transaction, but only when a company makes a quarterly or annual summary. Therefore, it is known from the characteristics of the type of industry to which the logistics data and sales data belong that the logistics data and sales data are rarely read and written, are in an infrequent state, and can be stored as cold data during the period from when the user confirms that the transaction is completed to when the transaction is summarized in a quarterly or annual manner.
In this embodiment, the data to be stored is classified and stored according to the use habits of the user or the industry attributes of the user, so as to be more suitable for the use habits and the industry characteristics of the user.
Referring to fig. 9, an embodiment of the present invention provides a data storage system 300, including:
a receiving module 310, configured to receive a data storage request, where the data storage request includes data to be stored;
a determining module 320, configured to determine a data type of the data to be stored according to a preset rule;
the storage module 330 is configured to place the data to be stored in a corresponding data storage area according to a data type.
Referring to FIG. 10, one embodiment of the present invention provides a data storage system 400. The vehicle unlocking system 400 includes:
a memory 420, a processor 410 and a computer program 440 stored on the memory 420 and executable on the processor 410, the computer program 440, when executed by the processor 410, implementing the steps of the vehicle unlocking method according to any of the above embodiments.
One embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the steps of the vehicle unlocking method according to any one of the above embodiments.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and all modifications and equivalents of the present invention, which are made by the contents of the present specification and the accompanying drawings, or directly/indirectly applied to other related technical fields, are included in the scope of the present invention.
Furthermore, an embodiment of the present invention further provides a computer-readable storage medium, where a data storage program is stored on the computer-readable storage medium, and when executed by a processor, the data storage program implements the following operations:
receiving a data storage request, wherein the data storage request comprises data to be stored;
determining the data type of the data to be stored according to a preset rule, wherein the data type comprises hot data and cold data;
and placing the data to be stored in the corresponding data storage area according to the data type.
Further, the data storage program when executed by the processor further performs the following:
the step of determining the data type of the data to be stored according to a preset rule comprises the following steps:
acquiring the format of the data to be stored;
and determining the data type of the data to be stored according to a preset data format storage rule.
Further, the data storage program when executed by the processor further performs the following:
the step of determining the data type of the data to be stored according to a preset rule comprises the following steps:
acquiring the calling frequency of the data to be stored;
and determining the data type of the data to be stored according to the calling frequency storage rule.
Further, the data storage program when executed by the processor further performs the following:
the step of determining the data type of the data to be stored according to the calling frequency storage rule further comprises:
if the calling frequency of the data to be stored reaches a preset calling frequency, determining that the data to be stored is thermal data;
and if the calling frequency of the data to be stored does not reach the preset calling frequency, determining that the data to be stored is cold data.
Further, the data storage program when executed by the processor further performs the following:
the step of placing the data to be stored in the corresponding data storage area according to the data type comprises the following steps:
if the data to be stored is thermal data, storing the data to be stored in a thermal data storage area, and generating corresponding coordinate data according to a storage position;
and if the data to be stored is cold data, storing the data to be stored in a cold data storage area.
Further, the data storage program when executed by the processor further performs the following:
the method further comprises the following steps:
detecting data calling frequencies in the cold data storage area and the hot data storage area;
extracting cold data with the data calling frequency reaching a preset frequency in the cold data storage area, and storing the cold data into a hot data storage area;
and extracting the hot data with the data calling frequency lower than the preset frequency in the hot data storage area, and storing the hot data into a cold data storage area.
Further, the data storage program when executed by the processor further performs the following:
the step of placing the data to be stored in the corresponding data storage area according to the data type further comprises:
determining the classification of the data to be stored according to the data attribute of the data to be stored;
and storing the data to be stored into a corresponding classification area in a corresponding data storage area according to the classification of the data to be stored.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A method of storing data, comprising:
receiving a data storage request, wherein the data storage request comprises data to be stored;
determining the data type of the data to be stored according to a preset rule, wherein the data type comprises hot data and cold data;
and placing the data to be stored in the corresponding data storage area according to the data type.
2. The data storage method according to claim 1, wherein the step of determining the data type of the data to be stored according to a preset rule comprises:
acquiring the format of the data to be stored;
and determining the data type of the data to be stored according to a preset data format storage rule.
3. The data storage method according to claim 1, wherein the step of determining the data type of the data to be stored according to a preset rule comprises:
acquiring the calling frequency of the data to be stored;
and determining the data type of the data to be stored according to the calling frequency storage rule.
4. The data storage method of claim 3, wherein the step of determining the data type of the data to be stored according to the call frequency storage rule further comprises:
if the calling frequency of the data to be stored reaches a preset calling frequency, determining that the data to be stored is thermal data;
and if the calling frequency of the data to be stored does not reach the preset calling frequency, determining that the data to be stored is cold data.
5. The data storage method of claim 1, wherein the step of placing the data to be stored in the corresponding data storage area according to the data type comprises:
if the data to be stored is thermal data, storing the data to be stored in a thermal data storage area, and generating corresponding coordinate data according to a storage position;
and if the data to be stored is cold data, storing the data to be stored in a cold data storage area.
6. The data storage method of claims 1-5, wherein the method further comprises:
detecting data calling frequencies in the cold data storage area and the hot data storage area;
extracting cold data with the data calling frequency reaching a preset frequency in the cold data storage area, and storing the cold data into a hot data storage area;
and extracting the hot data with the data calling frequency lower than the preset frequency in the hot data storage area, and storing the hot data into a cold data storage area.
7. The data storage method according to claim 1, wherein the step of placing the data to be stored in the corresponding data storage area according to the data type further comprises:
determining the classification of the data to be stored according to the data attribute of the data to be stored;
and storing the data to be stored into a corresponding classification area in a corresponding data storage area according to the classification of the data to be stored.
8. A data storage system, comprising:
the device comprises a receiving module, a storage module and a processing module, wherein the receiving module is used for receiving a data storage request which comprises data to be stored;
the determining module is used for determining the data type of the data to be stored according to a preset rule;
and the storage module is used for placing the data to be stored in the corresponding data storage area according to the data type.
9. An electronic device, comprising:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the memory has stored thereon instructions executable by at least one processor, the instructions being executable by the at least one processor to enable the at least one processor, when executing, to implement the steps of data storage according to claims 1-7.
10. A storage medium, characterized in that the computer readable storage medium has stored thereon a program of a data storage, which program, when executed by a processor, carries out the steps of the data storage according to claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111444161.6A CN113900597A (en) | 2021-11-30 | 2021-11-30 | Data storage method, system, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111444161.6A CN113900597A (en) | 2021-11-30 | 2021-11-30 | Data storage method, system, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113900597A true CN113900597A (en) | 2022-01-07 |
Family
ID=79195146
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111444161.6A Pending CN113900597A (en) | 2021-11-30 | 2021-11-30 | Data storage method, system, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113900597A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114924696A (en) * | 2022-07-18 | 2022-08-19 | 上海有孚数迅科技有限公司 | Method, apparatus, medium, and program product for storage management |
| CN115100757A (en) * | 2022-06-20 | 2022-09-23 | 重庆长安汽车股份有限公司 | Automobile data storage method and device, vehicle and storage medium |
| CN115186003A (en) * | 2022-09-14 | 2022-10-14 | 天云融创数据科技（北京）有限公司 | Data management method and system based on cloud computing |
| CN116361252A (en) * | 2023-03-09 | 2023-06-30 | 北京百度网讯科技有限公司 | Data storage and access method, device, equipment and medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108829341A (en) * | 2018-05-03 | 2018-11-16 | 上海科技大学 | A kind of data managing method based on mixing storage system |
| CN108829344A (en) * | 2018-05-24 | 2018-11-16 | 北京百度网讯科技有限公司 | Date storage method, device and storage medium |
| CN109491618A (en) * | 2018-11-20 | 2019-03-19 | 上海科技大学 | Data management system, method, terminal and medium based on mixing storage |
| CN109558075A (en) * | 2018-10-29 | 2019-04-02 | 珠海妙存科技有限公司 | A kind of method and device using the cold and hot attribute storing data of data |
| CN109857737A (en) * | 2019-01-03 | 2019-06-07 | 平安科技（深圳）有限公司 | A kind of cold and hot date storage method and device, electronic equipment |
| CN110727406A (en) * | 2019-10-10 | 2020-01-24 | 深圳力维智联技术有限公司 | Data storage scheduling method and device |
| CN111090392A (en) * | 2019-11-20 | 2020-05-01 | 深圳市得一微电子有限责任公司 | Cold and hot data separation method based on feature codes |
| CN111831222A (en) * | 2020-06-15 | 2020-10-27 | 新浪网技术(中国)有限公司 | Distributed object storage method and system |
| CN111858497A (en) * | 2020-07-31 | 2020-10-30 | 北京金山云网络技术有限公司 | Storage type conversion method, device and equipment |
| CN112463074A (en) * | 2020-12-14 | 2021-03-09 | 苏州浪潮智能科技有限公司 | Data classification storage method, system, terminal and storage medium |
-
2021
- 2021-11-30 CN CN202111444161.6A patent/CN113900597A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108829341A (en) * | 2018-05-03 | 2018-11-16 | 上海科技大学 | A kind of data managing method based on mixing storage system |
| CN108829344A (en) * | 2018-05-24 | 2018-11-16 | 北京百度网讯科技有限公司 | Date storage method, device and storage medium |
| CN109558075A (en) * | 2018-10-29 | 2019-04-02 | 珠海妙存科技有限公司 | A kind of method and device using the cold and hot attribute storing data of data |
| CN109491618A (en) * | 2018-11-20 | 2019-03-19 | 上海科技大学 | Data management system, method, terminal and medium based on mixing storage |
| CN109857737A (en) * | 2019-01-03 | 2019-06-07 | 平安科技（深圳）有限公司 | A kind of cold and hot date storage method and device, electronic equipment |
| CN110727406A (en) * | 2019-10-10 | 2020-01-24 | 深圳力维智联技术有限公司 | Data storage scheduling method and device |
| CN111090392A (en) * | 2019-11-20 | 2020-05-01 | 深圳市得一微电子有限责任公司 | Cold and hot data separation method based on feature codes |
| CN111831222A (en) * | 2020-06-15 | 2020-10-27 | 新浪网技术(中国)有限公司 | Distributed object storage method and system |
| CN111858497A (en) * | 2020-07-31 | 2020-10-30 | 北京金山云网络技术有限公司 | Storage type conversion method, device and equipment |
| CN112463074A (en) * | 2020-12-14 | 2021-03-09 | 苏州浪潮智能科技有限公司 | Data classification storage method, system, terminal and storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115100757A (en) * | 2022-06-20 | 2022-09-23 | 重庆长安汽车股份有限公司 | Automobile data storage method and device, vehicle and storage medium |
| CN114924696A (en) * | 2022-07-18 | 2022-08-19 | 上海有孚数迅科技有限公司 | Method, apparatus, medium, and program product for storage management |
| CN114924696B (en) * | 2022-07-18 | 2022-10-18 | 上海有孚数迅科技有限公司 | Method, apparatus, medium, and program product for storage management |
| CN115186003A (en) * | 2022-09-14 | 2022-10-14 | 天云融创数据科技（北京）有限公司 | Data management method and system based on cloud computing |
| CN116361252A (en) * | 2023-03-09 | 2023-06-30 | 北京百度网讯科技有限公司 | Data storage and access method, device, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113900597A (en) | Data storage method, system, equipment and storage medium | |
| CN107329985B (en) | Page collection method and device and mobile terminal | |
| CN107885741A (en) | Image cache management method and mobile terminal | |
| CN108401026B (en) | Block chain-based data storage method, system and computer-readable storage medium | |
| US11314814B2 (en) | Method for sharing content based on account group and electronic device for performing same | |
| CN109936504B (en) | Picture display method and device, server equipment and storage medium | |
| US20190107929A1 (en) | Method and device for loading content of page, and electronic device | |
| CN113472901A (en) | Load balancing method, device, equipment, storage medium and program product | |
| CN112183045A (en) | Online document processing method and device and electronic equipment | |
| CN109992719B (en) | Method and apparatus for determining push priority information | |
| CN105653674B (en) | File management method and system of intelligent terminal | |
| CN111309496A (en) | Method, system, device, equipment and storage medium for realizing delay task | |
| CN107707602B (en) | Data communication processing terminal, method and computer readable storage medium | |
| US20220382788A1 (en) | Electronic device and method for operating content using same | |
| US20210026807A1 (en) | Method for managing data associated with application and electronic device therefor | |
| CN105354506A (en) | File hiding method and apparatus | |
| KR101784057B1 (en) | Apparatus and method sharing customizable contents using user information of the mobile terminal | |
| CN111935353B (en) | Mobile terminal and short message display method thereof | |
| CN110390486B (en) | Book management method, apparatus and computer readable storage medium | |
| CN113507529A (en) | Method for realizing file downloading based on Web application | |
| CN111787043A (en) | Data request method and device | |
| CN110908958B (en) | File processing method, device, terminal and storage medium | |
| CN111125007B (en) | Application packaging method, device and readable storage medium | |
| CN117389690B (en) | Mirror image package construction method, device, equipment and storage medium | |
| CN116861455B (en) | Event data processing method, system, electronic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |