CN117171209A - Cache data cleaning method and device, storage medium and electronic equipment - Google Patents
Cache data cleaning method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN117171209A CN117171209A CN202210586563.8A CN202210586563A CN117171209A CN 117171209 A CN117171209 A CN 117171209A CN 202210586563 A CN202210586563 A CN 202210586563A CN 117171209 A CN117171209 A CN 117171209A
- Authority
- CN
- China
- Prior art keywords
- data
- cache
- database
- access
- cache database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004140 cleaning Methods 0.000 title claims abstract description 95
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000013075 data extraction Methods 0.000 claims description 29
- 230000002085 persistent effect Effects 0.000 claims description 26
- 238000005201 scrubbing Methods 0.000 claims description 4
- 230000015556 catabolic process Effects 0.000 abstract description 5
- 230000008569 process Effects 0.000 description 13
- 238000004590 computer program Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000010076 replication Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a cache data cleaning method, a device, a storage medium and electronic equipment, which can obtain a first access record for accessing data stored in each cache database. And then, based on the first access record, obtaining first access statistical data of first data stored in a first cache database, wherein the first cache database is one of the cache databases. And then comparing the first access statistical data with at least one cache cleaning condition, and determining the cache cleaning condition satisfied by the first access statistical data. And when the determined heat level corresponding to the cache cleaning condition is inconsistent with the heat level corresponding to the first cache database, transferring the first data to the cache database with the heat level corresponding to the determined cache cleaning condition. The cache data cleaning method can update and clean the hot spot data in each cache database according to different levels, improve the hit rate and avoid the breakdown of the server.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a method and apparatus for cleaning cache data, a storage medium, and an electronic device.
Background
With the advent of the big data age, network data has grown in bursts. In order to ensure efficient data query and update, hot spot data needs to be extracted from mass data to be cached at a memory level.
However, the current caching scheme causes a situation that a device providing a data service often crashes when the access amount is increased, for example, a server of social media often crashes when a hot spot is suddenly happened in daily life, so that the device cannot access. The inventors have found that a significant portion of the cause of the crash is: the expiration of the hot spot data cache causes that a large amount of data accessed by the client is missed in the memory, so that a large amount of data accessed by the client is extracted from the persistent layer database, and the persistent layer database cannot withstand the impact of large-flow data access.
Disclosure of Invention
In order to solve the problems of untimely cache cleaning, easy occurrence of collapse and the like in the prior art, the application provides a cache data cleaning method, a device, a storage medium and electronic equipment, which have the characteristics of timely cache cleaning, difficult occurrence of collapse and the like
According to the embodiment of the application, a method for cleaning cache data comprises the following steps:
obtaining a first access record for accessing data stored in each cache database, wherein different cache databases have different heat levels;
based on the first access record, obtaining first access statistical data of first data stored in a first cache database, wherein the first cache database is one of the cache databases;
comparing the first access statistical data with at least one cache cleaning condition, and determining the cache cleaning condition which is met by the first access statistical data, wherein each cache cleaning condition corresponds to different heat levels;
and if the determined heat level corresponding to the cache cleaning condition is inconsistent with the heat level corresponding to the first cache database, transferring the first data to the cache database with the determined heat level corresponding to the cache cleaning condition.
Further, the method for cleaning cache data further comprises the following steps:
obtaining a second access record for accessing the data stored in the persistent layer database;
obtaining second access statistics of second data stored in the persistent layer database based on the second access record;
comparing the second access statistical data with at least one data extraction condition, and determining the data extraction condition met by the second access statistical data, wherein each data extraction condition corresponds to a different heat level;
and storing the backup data of the second data into a cache database with the determined heat level corresponding to the data extraction condition.
Further, the method for cleaning cache data further comprises the following steps:
and if the determined heat level corresponding to the cache cleaning condition is null or the deleting level, deleting the first data from the first cache database.
Further, the first access statistics include: the data updating times and the data using times in the first cache database in a first preset time period, the cache cleaning condition includes a first data interval corresponding to the heat level, and if the determined heat level corresponding to the cache cleaning condition is inconsistent with the heat level corresponding to the first cache database, transferring the first data to the cache database with the determined heat level corresponding to the cache cleaning condition includes:
and if the heat level of the first data interval in which the data updating times or the data using times in the first cache database are located within the first preset time period is inconsistent with the heat level corresponding to the first cache database, transferring the first data to the cache database with the determined heat level corresponding to the data interval.
Further, the second access statistics include: the data updating times and the data using times in the persistent layer database in a second preset time period, the data extraction conditions include a second data interval corresponding to the heat level, and the storing the backup data of the second data into a cache database with the determined heat level corresponding to the data extraction conditions includes:
and if the data updating times or the data using times in the persistent layer database in the second preset time period are in the second data interval, storing the backup of the second data into a cache database with a level corresponding to the second data interval.
Further, after the first access record for accessing the data stored in each cache database is obtained, the method further includes:
acquiring the level identification of the data;
and storing the data into a cache database of the hotspot level corresponding to the level identification based on the level of the hotspot data characterized by the level identification.
Further, the cache database is constructed by non-relational database clusters, the cache database of each heat level is a non-relational database cluster, each cluster is composed of a preset number of servers, and the number of the servers is multiplied by the index of the preset number when the storage space is insufficient.
According to an embodiment of the present application, a cache data cleaning device includes:
the first recording module is used for obtaining a first access record for accessing the data stored in each cache database, wherein different cache databases have different heat levels;
the first statistics module is used for obtaining first access statistics data of first data stored in a first cache database based on the first access record, wherein the first cache database is one of the cache databases;
the cleaning module is used for comparing the first access statistical data with at least one cache cleaning condition and determining the cache cleaning condition which is met by the first access statistical data, wherein each cache cleaning condition corresponds to different heat levels; and
and the first storage module is used for transferring the first data to a cache database with the determined heat level corresponding to the cache cleaning condition when the determined heat level corresponding to the cache cleaning condition is inconsistent with the heat level corresponding to the first cache database.
According to an embodiment of the present application, there is provided a storage medium having a program stored therein, which when executed by a processor, implements the steps of the cache data cleaning method as described above.
An electronic device provided according to an embodiment of the present application includes at least one processor, and at least one memory and a bus connected to the processor; wherein the processor and the memory communicate with each other via a bus; the processor is configured to invoke program instructions in the memory to perform the steps of the cache data scrubbing method as described above.
The method for cleaning the cache data can obtain the first access records for accessing the data stored in each cache database, wherein different cache databases have different heat levels, and then obtain the first access statistical data of the first data stored in the first cache database based on the first access records, wherein the first cache database is one of the cache databases. And then comparing the first access statistical data with at least one cache cleaning condition, and determining the cache cleaning condition which is met by the first access statistical data, wherein each cache cleaning condition corresponds to different heat levels. And when the determined heat level corresponding to the cache cleaning condition is inconsistent with the heat level corresponding to the first cache database, transferring the first data to the cache database with the heat level corresponding to the determined cache cleaning condition. The cache data cleaning method can update and clean the hot spot data in each cache database according to different levels, effectively reduces the condition of cache expiration, improves the hit rate and avoids the breakdown of the server.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for cache data scrubbing provided in accordance with an exemplary embodiment;
FIG. 2 is a flow chart of data extraction provided in accordance with an exemplary embodiment;
FIG. 3 is another flow chart of data extraction provided in accordance with an exemplary embodiment;
FIG. 4 is a block diagram of a cache data cleaning apparatus provided in accordance with an exemplary embodiment;
fig. 5 is a block diagram of an electronic device provided in accordance with an exemplary embodiment.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Referring to fig. 1, an embodiment of the present application provides a method for cleaning cache data, which may include the following steps:
101. and obtaining a first access record for accessing the data stored in each cache database, wherein different cache databases have different heat levels.
The cache database is used as a slave node in a database master-slave replication architecture and is bound with the persistent layer database, and data in the persistent layer database is cached in a hierarchical mode by reading an operation log form in the persistent layer database. The data in the persistent layer database is read after a certain time interval, the data in the cache database is updated, when a user needs to inquire the data, the corresponding data is firstly inquired in the cache database, and when the corresponding data is not inquired, the data in the persistent layer database is inquired, so that most data can be obtained in the cache database, the access times to the persistent layer database are effectively reduced, and the occurrence of breakdown of a server is avoided. According to the hot spot degree of data access, different heat levels can be divided into a cache database, data with different heat levels are correspondingly cached, information such as the use times, ID, update times and the like of the data can be obtained from access records of the data, and according to statistical data of the information in interval time, the cache database with different heat levels is divided into new data, core data and hot spot data according to the low heat level, and the corresponding cache database can be the new cache database, the core cache database and the hot spot cache database.
102. Based on the first access record, first access statistical data of first data stored in a first cache database is obtained, wherein the first cache database is one of the cache databases.
As described above, statistics data such as the update times, the operation times and the like of the data can be obtained from the access records, and the heat level of the data can be obtained by sorting the statistics data according to the statistics data and the preset statistics rules, so that the corresponding cache database is determined.
103. And comparing the first access statistical data with at least one cache cleaning condition, and determining the cache cleaning condition which is met by the first access statistical data, wherein each cache cleaning condition corresponds to different heat levels.
When the heat level is confirmed, the heat level of the data can be further determined by comparing the access data with the cache cleaning condition, for example, for the use times of the data, the incoming new data level is greater than 10, the incoming core data level is greater than 20, the incoming hot spot data level is greater than 100 in the statistical time of 5 minutes interval.
104. And if the determined heat level corresponding to the cache cleaning condition is inconsistent with the heat level corresponding to the first cache database, transferring the first data to the cache database with the determined heat level corresponding to the cache cleaning condition.
After the statistical data of the data obtained from the cache database is compared with the data cleaning condition, and the re-determined heat level is different from the heat level of the cache database where the data is currently located, the data in the current cache database is stored into the cache database with the re-determined heat level. Therefore, the data in the cache database is dynamically updated at a hot level at regular time, the processing efficiency of the data in the cache database is improved, the condition that the cache is out of date is improved, the hit rate of hot spot data is improved, and the breakdown of a server is effectively avoided.
To further optimize the technical solution, some embodiments of the present application as shown in fig. 2 further propose a process for extracting data in a persistent layer database, where the data extraction process may include the following steps:
201. and obtaining a second access record for accessing the data stored in the persistent layer database.
Binding a slave node of a database master-slave replication architecture with a corresponding database master node of a service, and acquiring access records of data by reading a binlog log form of the database.
202. And obtaining second access statistical data of second data stored in the persistent layer database based on the second access record.
The statistics recorded in the access record may include statistics related to the number of data uses, the number of updates, the time of creation, etc.
203. And comparing the second access statistical data with at least one data extraction condition, and determining the data extraction condition met by the second access statistical data, wherein each data extraction condition corresponds to a different heat level.
And comparing the access data with preset data extraction conditions, further determining a heat level corresponding to the statistical data, and correspondingly determining a corresponding cache database after determining the heat level.
204. And storing the backup data of the second data into a cache database with the heat level corresponding to the determined data extraction condition.
After the corresponding cache database is determined, the data in the persistent layer database is backed up to the cache database with the corresponding heat level according to the principle of master-slave replication among the databases.
It will be appreciated that the above data cleaning and data extraction processes may be performed simultaneously on the cache database, or may be performed step by step, and those skilled in the art may select the process according to actual needs, which is not limited herein.
In another embodiment of the application. And if the determined heat level corresponding to the cache cleaning condition is null or the deleting level, deleting the first data from the first cache database.
Specifically, because the number of the cache databases is limited, and the heat level is also limited, for example, when the method is implemented, three heat level databases of new generation, core and hot spot are generally set, and corresponding data cleaning conditions are also three, then after comparison with each cache cleaning condition, the corresponding heat is not obtained, and then it can be determined that the heat data does not meet all the conditions for caching the hot spot data any more, and the hot spot data can be deleted directly, so that the data in the cache databases are cleaned timely, and the hit efficiency of the hot spot data is improved.
In the specific implementation process, the cache database is constructed by non-relational database clusters, the cache database of each heat level is a non-relational database cluster, each cluster is composed of a preset number of servers, and the number of the servers is multiplied by a preset number of indexes when the storage space is insufficient.
For example, a Redis non-relational database cluster can be adopted for each level of database, each heat level is a cluster, and the extracted hot spot data can also be directly stored in one Redis cluster under the condition that the data volume in the persistent layer database is not very large.
As a possible cleaning mode of the data cleaning process, the first access statistical data includes: the method comprises the steps that data updating times and data using times in a first cache database in a first preset time period are carried out, a cache cleaning condition comprises a first data interval corresponding to a heat level, if the determined heat level corresponding to the cache cleaning condition is inconsistent with the heat level corresponding to the first cache database, the first data is transferred to the cache database with the heat level corresponding to the determined cache cleaning condition, and the method comprises the steps of:
and if the heat level of the first data interval in which the data updating times or the data using times in the first cache database are positioned within the first preset time period is inconsistent with the heat level corresponding to the first cache database, transferring the first data to the cache database with the determined heat level corresponding to the data interval.
For example, the data interval may include three intervals of [10,20], [20,100], [100,1000], where the corresponding heat levels are respectively new generation, core and hot spot, and if the number of times of using the data in the new cache database is 30 in the statistical time of 5 minutes, the data is moved to the core cache database for storage. Otherwise, if the number of times of using the data in the hot spot cache database is 50 in the statistical time of 5 minutes, the data is moved to the core cache database for storage. And when the using times are less than 10, deleting the corresponding data in the newly-generated cache database directly.
As an implementation manner of the data extraction process, the second access statistical data includes: the data updating times and the data using times in the persistent layer database in the second preset time period, the data extraction conditions comprise a second data interval corresponding to the heat level, and the backup data of the second data are stored in the cache database with the heat level corresponding to the determined data extraction conditions, and the method comprises the following steps:
if the data updating times or the data using times in the persistent layer database in the second preset time period are in the second data interval, the backup of the second data is stored in the cache database with the level corresponding to the second data interval.
Based on the same design thought, the data extraction in the persistent layer database can also adopt the mode of judging among the same partitions in the data cleaning process to carry out hierarchical caching of the data, and the application is not described in detail herein.
Referring to fig. 3, in other embodiments of the present application, after obtaining a first access record for accessing data stored in each cache database, the method further includes:
301. and acquiring the level identification of the data.
302. And storing the data into a cache database of the hotspot level corresponding to the level identification based on the level of the hotspot data characterized by the level identification.
In a specific implementation process, a user can directly store the data into a corresponding cache database through the unique ID of the data, namely, the data can be formed into data with a corresponding heat level when being created for the first time. Thereby facilitating the flexible management of the data in the cache database by the user.
Based on the same design concept, referring to fig. 4, an embodiment of the present application further provides a device for cleaning cache data, where the device may be used to execute each step of the method for cleaning cache data described in the foregoing embodiment, and the device may include:
a first record module 401, configured to obtain a first access record for accessing data stored in each cache database, where different cache databases have different heat levels.
The first statistics module 402 is configured to obtain, based on the first access record, first access statistics of first data stored in a first cache database, where the first cache database is one of the cache databases.
The cleaning module 403 is configured to compare the first access statistic data with at least one cache cleaning condition, and determine cache cleaning conditions that the first access statistic data meets, where each cache cleaning condition corresponds to a different heat level.
And the first storage module 404 is configured to transfer the first data to a cache database having the determined heat level corresponding to the cache cleaning condition when the determined heat level corresponding to the cache cleaning condition is inconsistent with the heat level corresponding to the first cache database.
And a second record module 405, configured to obtain a second access record for accessing the data stored in the persistent layer database.
And a second statistics module 406, configured to obtain second access statistics of second data stored in the persistent layer database based on the second access record.
The extraction module 407 is configured to compare the second access statistic data with at least one data extraction condition, and determine data extraction conditions that the second access statistic data meets, where each data extraction condition corresponds to a different heat level. And
and a second storage module 408, configured to store the backup data of the second data into a cache database having a heat level corresponding to the determined data extraction condition.
The cache data cleaning device has the same beneficial effects as the cache data cleaning method, and the specific implementation manner of the cache data cleaning device can refer to the implementation process of the cache data cleaning method provided by the embodiment, and the application is not repeated herein.
The cache data cleaning device includes a processor and a memory, where the first recording module 401, the first statistics 402, the cleaning module 403, the first storage module 404, and the like are all stored as program units in the memory, and the processor executes the program units stored in the memory to implement corresponding functions.
The processor includes a kernel, and the kernel fetches the corresponding program unit from the memory. The kernel can be provided with one or more, and orderly management of the participating users is realized by adjusting kernel parameters.
The embodiment of the application provides a storage medium, on which a program is stored, which when executed by a processor, implements the cache data cleaning method described in the above embodiment.
The embodiment of the application provides a processor which is used for running a program, wherein the cache data cleaning method is executed when the program runs.
Referring to FIG. 5, an embodiment of the present application provides an electronic device comprising at least one processor 501, and at least one memory 502, bus 503 coupled to the processor 501; wherein, the processor 501 and the memory 502 complete the communication with each other through the bus 503; the processor 501 is configured to invoke the program instructions in the memory 502 to perform the cache data scrubbing method described above. The device herein may be a server, PC, PAD, cell phone, etc.
The application also provides a computer program product adapted to perform, when executed on a data processing apparatus, an initialisation procedure having the steps of the buffered data cleaning method described in the above embodiments.
According to the cache data cleaning method, the device, the storage medium and the electronic equipment provided by the embodiment of the application, the update cleaning of the cache data can be simultaneously carried out on the hot spot data in each cache database according to different levels, the condition of expiration of the cache is effectively reduced, and the hit rate is improved to avoid the breakdown of the server.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, the device includes one or more processors (CPUs), memory, and a bus. The device may also include input/output interfaces, network interfaces, and the like.
The memory may include volatile memory, random Access Memory (RAM), and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM), among other forms in computer readable media, the memory including at least one memory chip. Memory is an example of a computer-readable medium.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and variations of the present application will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. which come within the spirit and principles of the application are to be included in the scope of the claims of the present application.
Claims (10)
1. The cache data cleaning method is characterized by comprising the following steps:
obtaining a first access record for accessing data stored in each cache database, wherein different cache databases have different heat levels;
based on the first access record, obtaining first access statistical data of first data stored in a first cache database, wherein the first cache database is one of the cache databases;
comparing the first access statistical data with at least one cache cleaning condition, and determining the cache cleaning condition which is met by the first access statistical data, wherein each cache cleaning condition corresponds to different heat levels;
and if the determined heat level corresponding to the cache cleaning condition is inconsistent with the heat level corresponding to the first cache database, transferring the first data to the cache database with the determined heat level corresponding to the cache cleaning condition.
2. The method as recited in claim 1, further comprising:
obtaining a second access record for accessing the data stored in the persistent layer database;
obtaining second access statistics of second data stored in the persistent layer database based on the second access record;
comparing the second access statistical data with at least one data extraction condition, and determining the data extraction condition met by the second access statistical data, wherein each data extraction condition corresponds to a different heat level;
and storing the backup data of the second data into a cache database with the determined heat level corresponding to the data extraction condition.
3. The method as recited in claim 1, further comprising:
and if the determined heat level corresponding to the cache cleaning condition is null or the deleting level, deleting the first data from the first cache database.
4. The method of claim 1, wherein the first access statistics comprise: the data updating times and the data using times in the first cache database in a first preset time period, the cache cleaning condition includes a first data interval corresponding to the heat level, and if the determined heat level corresponding to the cache cleaning condition is inconsistent with the heat level corresponding to the first cache database, transferring the first data to the cache database with the determined heat level corresponding to the cache cleaning condition includes:
and if the heat level of the first data interval in which the data updating times or the data using times in the first cache database are located within the first preset time period is inconsistent with the heat level corresponding to the first cache database, transferring the first data to the cache database with the determined heat level corresponding to the data interval.
5. The method of claim 2, wherein the second access statistics comprise: the data updating times and the data using times in the persistent layer database in a second preset time period, the data extraction conditions include a second data interval corresponding to the heat level, and the storing the backup data of the second data into a cache database with the determined heat level corresponding to the data extraction conditions includes:
and if the data updating times or the data using times in the persistent layer database in the second preset time period are in the second data interval, storing the backup of the second data into a cache database with a level corresponding to the second data interval.
6. The method according to claim 1, wherein after obtaining the first access record for accessing the data stored in each cache database, further comprises:
acquiring the level identification of the data;
and storing the data into a cache database of the hotspot level corresponding to the level identification based on the level of the hotspot data characterized by the level identification.
7. The method according to any one of claims 1 to 6, wherein the cache database is constructed from clusters of non-relational databases, the cache database of each heat level being a cluster of non-relational databases, each cluster being constructed from a preset number of servers, the number of servers being multiplied by an index of the preset number when storage space is insufficient.
8. A cache data cleaning device, comprising:
the first recording module is used for obtaining a first access record for accessing the data stored in each cache database, wherein different cache databases have different heat levels;
the first statistics module is used for obtaining first access statistics data of first data stored in a first cache database based on the first access record, wherein the first cache database is one of the cache databases;
the cleaning module is used for comparing the first access statistical data with at least one cache cleaning condition and determining the cache cleaning condition which is met by the first access statistical data, wherein each cache cleaning condition corresponds to different heat levels; and
and the first storage module is used for transferring the first data to a cache database with the determined heat level corresponding to the cache cleaning condition when the determined heat level corresponding to the cache cleaning condition is inconsistent with the heat level corresponding to the first cache database.
9. A storage medium having stored therein a program which, when executed by a processor, implements the steps of the buffered data cleaning method of any of claims 1 to 7.
10. An electronic device comprising at least one processor, and at least one memory, bus coupled to the processor; wherein the processor and the memory communicate with each other via a bus; the processor is configured to invoke program instructions in the memory to perform the steps of the cache data scrubbing method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210586563.8A CN117171209A (en) | 2022-05-27 | 2022-05-27 | Cache data cleaning method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210586563.8A CN117171209A (en) | 2022-05-27 | 2022-05-27 | Cache data cleaning method and device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117171209A true CN117171209A (en) | 2023-12-05 |
Family
ID=88936297
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210586563.8A Pending CN117171209A (en) | 2022-05-27 | 2022-05-27 | Cache data cleaning method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117171209A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117931530A (en) * | 2024-03-22 | 2024-04-26 | 山东昌禹知商信息技术服务有限公司 | Database physical backup recovery processing method and system |
-
2022
- 2022-05-27 CN CN202210586563.8A patent/CN117171209A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117931530A (en) * | 2024-03-22 | 2024-04-26 | 山东昌禹知商信息技术服务有限公司 | Database physical backup recovery processing method and system |
| CN117931530B (en) * | 2024-03-22 | 2024-06-07 | 山东昌禹知商信息技术服务有限公司 | Database physical backup recovery processing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3944556B1 (en) | Block data storage method and apparatus, and block data access method and apparatus | |
| CN109165216A (en) | A kind of generation method and system, storage medium of Redis distributed data base major key id | |
| US20090089313A1 (en) | Decentralized record expiry | |
| CN107807932B (en) | Hierarchical data management method and system based on path enumeration | |
| CN108073349B (en) | Data transmission method and device | |
| US7895247B2 (en) | Tracking space usage in a database | |
| CN104657435A (en) | Storage management method for application data and network management system | |
| CN112328700A (en) | Distributed database | |
| CN117171209A (en) | Cache data cleaning method and device, storage medium and electronic equipment | |
| CN107092624B (en) | Data storage method, device and system | |
| CN118069712A (en) | Data life cycle management method and device, electronic equipment and storage medium | |
| CN109165207B (en) | Drinking water mass data storage management method and system based on Hadoop | |
| CN102724301B (en) | Cloud database system and method and equipment for reading and writing cloud data | |
| CN107547593A (en) | A kind of method, apparatus and distributed system for realizing that daily record is synchronous | |
| CN103236938A (en) | Method and system for user action collection based on cache memory and asynchronous processing technology | |
| CN102195936A (en) | Method and system for storing multimedia file and method and system for reading multimedia file | |
| CN109308310B (en) | Subsystem data interconnection processing method for asset management platform | |
| CN113297245A (en) | Method and device for acquiring execution information | |
| US20240103751A1 (en) | Garbage collection for object-based storage systems | |
| CN114297227B (en) | Time sequence database construction method, query method and time sequence database | |
| CN104661053A (en) | IPTV data processing method and system | |
| CN114238419B (en) | Data caching method and device based on multi-tenant SaaS application system | |
| CN114205368B (en) | Data storage system, control method, control device, electronic equipment and storage medium | |
| CN114281895A (en) | Multi-data center synchronization method supporting remote pulling | |
| CN106557469A (en) | The method and device of data in a kind of processing data warehouse |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |