CN111966719A - Method for refreshing local data cache of distributed consumer credit system in real time - Google Patents
Method for refreshing local data cache of distributed consumer credit system in real time Download PDFInfo
- Publication number
- CN111966719A CN111966719A CN202011127684.3A CN202011127684A CN111966719A CN 111966719 A CN111966719 A CN 111966719A CN 202011127684 A CN202011127684 A CN 202011127684A CN 111966719 A CN111966719 A CN 111966719A
- Authority
- CN
- China
- Prior art keywords
- cache
- redis
- data
- message
- topic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a method for refreshing local data cache of a distributed consumer credit system in real time, which comprises the following steps: step 1: a message sending tool for data updating is newly built, and a data updating message is asynchronously sent to Redis Topic; step 2: synchronously updating the data of the database; and step 3: registering a Redis Topic listener and monitoring a message of the Redis Topic; and 4, step 4: and calling a message refreshing interface to refresh the local data cache after the Redis Topic listener acquires the message. The invention can control the upper limit of the cache capacity under the condition of using the local cache or refresh the local cache in time when the data is updated, thereby eliminating the risk of memory overflow or data inconsistency; data updating and local cache refreshing are decoupled, and the influence of Redis abnormity on the main service is eliminated; based on a cache expiration policy and TTL, the probability of data inconsistency caused by temporary unavailability of Redis is reduced; the performance risk caused by the fact that a large number of queries directly penetrate the database to operate due to cache breakdown is reduced.
Description
Technical Field
The invention relates to the field of cache processing, in particular to a method for refreshing local data cache of a distributed consumer credit system in real time.
Background
TTL: is an abbreviation for Time To Live, which specifies the local data cache survival Time in nanoseconds.
Caffeine: the framework is a high-performance local cache framework based on Java 8, the framework is used for the reference of Google Guava and is partially improved, and meanwhile, the framework provides various cache expiration strategies and cache capacity upper limit configuration functions.
The upper limit of the buffer capacity: the method refers to how many pieces of data can be stored locally at most, and when the cache data reaches the upper limit of the cache capacity, the method can release the capacity by locally evicting the least recently used cache data and cache new data to the local.
Most of the current applications adopt a cache technology for performance, and by investigating various channels, the existing cache refreshing can be realized through the following three ways:
firstly, using hashmap to buffer controllable data volume to local.
And secondly, using Caffeine or similar java memory cache frames to specify the upper limit of the cache capacity and TTL, thereby achieving the purpose of caching static or hot data.
And thirdly, storing data by using a Redis distributed cache.
The first scheme and the second scheme are both limited by the fact that local data cache of the distributed application system cannot be refreshed timely under the condition that data are updated, and the risk that cache data are inconsistent with database data is easily caused, so that certain influence is caused on service development; in addition, under the condition that a large amount of cache data at the same time point is invalid, a large amount of queries directly penetrate through the database to perform data reading operation, and thus the performance problem of the database is caused.
The prior art has the problems that the upper limit of the cache capacity cannot be controlled when a local cache is used, or the local cache cannot be refreshed in time when data (such as mobile phone numbers) are updated, so that the risk of memory overflow or data inconsistency is caused, and the like.
Disclosure of Invention
The invention provides a method for refreshing local data cache of a distributed consumer credit system in real time, which can control the upper limit of cache capacity under the condition of using the local cache or refresh the local cache in time when data (such as mobile phone numbers) are updated, thereby eliminating the risk of memory overflow or data inconsistency.
The invention discloses a method for refreshing local data cache of a distributed consumer credit system in real time, which comprises the following steps:
A. when data is updated, the data updating message is asynchronously sent to Redis Topic;
B. synchronously updating the data of the database;
C. registering a Redis Topic listener and monitoring a message of the Redis Topic;
and after the Redis Topic listener acquires the message, calling a message refreshing interface to refresh the local data cache.
Redis Topic: the Redis client can subscribe to any number of Topic, and when a producer issues a message to Topic, a plurality of subscribers can receive the message at the same time.
Further, step a comprises:
A1. defining an update data model object, wherein the object is a field needing to be updated; defining a cache flush object, the object comprising: a cache key field, a cache type field and a cache refresh event field; defining a Redis Topic name, wherein the name type is a character string type; defining a Java thread pool, wherein the Java thread pool comprises the specified core thread number, the maximum thread number, the thread survival time, the queue size and the attribute of a thread pool rejection strategy;
A2. newly building the cache refreshing object defined in the step A1, and filling the cache refreshing object according to the updated data model object to obtain a cache refreshing message object;
A3. newly building a Java thread, and calling a conversion and transmission method of a Redis template tool, wherein a first parameter of the method is a Redis Topic name, and a second parameter is a cache refreshing message object to obtain a message transmission thread;
A4. and (4) taking the Redis Topic name in the step A1 and the cache refreshing message object in the step A2 as parameters, transmitting the parameters into a message sending thread, transmitting the message sending thread into the Java thread pool defined in the step A1, executing tasks, and asynchronously sending the data updating message to the Redis Topic.
The data model object is defined and updated by self-definition in the following steps, so that the consistency of data is ensured, the whole process is more reliable, and the risk problem caused by data inconsistency is reduced; and the upper limit of the cache capacity is controlled to realize the refreshing of the local cache in time.
Further, step B includes:
B1. automatically initializing a data source according to a Spring automatic assembly mechanism and database connection information appointed in a configuration file;
B2. taking the data source as a Spring JdbcTemplate object to obtain a database access tool;
B3. constructing an updated SQL statement according to the updated data model object defined in the step A1;
B4. and transmitting the updated SQL statements serving as parameters into a database access tool for task execution, and synchronously updating data to the database after the execution is finished.
The decoupling of data updating and local cache refreshing is realized, the influence of Redis abnormity on the main service is eliminated, namely when the Redis abnormity is realized, the data updating is not influenced, and the main service can continue to move to the next process.
Further, step C includes:
C1. defining a Redis message listener attribute object, wherein the object comprises a name field of a message listener and a message listener implementation class field; and defining an object of multiple Redis Topic listeners, wherein the object only has one TreeMap type field, a key in the TreeMap is a Redis Topic name, and a value in the TreeMap is a defined Redis message listener attribute object;
C2. newly adding Redis Topic listener configuration in a program starting file for setting object values of multiple defined Redis Topic listeners, and obtaining multiple Redis Topic listener objects based on a Spring automatic device mechanism and the multiple Redis Topic listener configuration;
C3. traversing TreeMap of the generated multiple Redis Topic listener objects, and reading Redis Topic names and Redis message listener attribute objects one by one; calling a Bean factory object obtained from a Spring context and inputting a Redis message listener attribute object to obtain a Redis message listener;
C4. and creating a Redis message listener container object according to the Bean factory object to register a Redis Topic listener, wherein the Redis Topic listener listens for the message of the Redis Topic according to the input Redis message listener and the Redis Topic name.
Further, step D includes:
D1. defining a cache refreshing implementation class and a cache refreshing abstract interface, defining an object of a hashmap type field in the cache refreshing abstract interface, wherein the key of the object is the cache type field of the cache refreshing object in the step A2, the value of the object is the cache refreshing implementation class, and a cache refreshing service registration method, a cache type abstract method and a cache refreshing abstract method are further defined in the cache refreshing abstract interface;
D2. defining two class object parameters, wherein the first parameter is a database access implementation class, and the second parameter is a Caffeine cache container;
D3. defining a class object construction method, wherein only one parameter of the method is a database access implementation class; assigning the obtained database access implementation class to the first class object parameter database access implementation class, calling a construction scheme of a Caffeine cache container, setting data cache capacity and cache survival time, and calling the database access implementation class to read data from a database and cache the data locally;
D4. implementing the cache type abstraction method of the cache refresh abstraction interface, and returning to the cache type field of the cache refresh message object defined in the step A1; a cache refresh abstract method for implementing a cache refresh abstract interface;
D5. defining a cache data reading method, and transmitting the cache key field of the cache refresh message object defined in the step A1 into the cache data reading method as a parameter;
D6. when the Redis Topic listener receives a data updating message, calling a cache refreshing method of a cache refreshing implementation class so as to transmit data to a Caffeine local cache;
D7. judging whether the cache is hit, if so, directly returning to the Caffeine local cache and calling a cache data reading method to read data, and if not, calling a query method of a database access tool to read data from the database and writing the data into the Caffeine local cache;
D8. when data read from a database is written into a Caffeine local cache, calling an overdue task scheduling method embedded in a Caffeine local cache frame, inputting a cache refreshing key and calling a cache invalidation method of a Caffeine cache container every specified TTL time, and removing overdue cache data from the Caffeine local cache at regular time;
based on the cache expiration policy and TTL, the probability of data inconsistency caused by temporary unavailability of Redis is reduced.
Local cache data is updated in near real time, and data consistency is guaranteed; under the condition of data updating or cache expiration, cache data is removed from the local area, and the performance risk caused by the fact that a large number of queries directly penetrate through the database to operate due to cache breakdown is reduced.
According to the method for refreshing the local data cache of the distributed consumer credit system in real time, the consistency of data is ensured by updating the data model object in a user-defined manner, so that the whole process is more reliable, and the risk problem caused by inconsistent data is reduced; the upper limit of the cache capacity is controlled to realize the refreshing of the local cache in time; the data updating and local cache refreshing decoupling is realized, and the influence of Redis abnormity on the main service is eliminated; based on a cache expiration policy and TTL, the probability of data inconsistency caused by temporary unavailability of Redis is reduced; under the condition of data updating or cache expiration, cache data is removed from the local area, and the performance risk caused by the fact that a large number of queries directly penetrate through the database to operate due to cache breakdown is reduced.
Drawings
FIG. 1 is a flow chart of a method of the present invention for real-time refreshing of a distributed consumer credit system local data cache.
FIG. 2 is a flow chart of refreshing a local cache according to the present invention.
FIG. 3 is a schematic diagram of a method for real-time refreshing of a local data cache of a distributed consumer credit system in accordance with the present invention.
Detailed Description
The present invention will be described in further detail with reference to the following examples. This should not be understood as limiting the scope of the above-described subject matter of the present invention to the following examples. Various substitutions and alterations according to the general knowledge and conventional practice in the art are intended to be included within the scope of the present invention without departing from the technical spirit of the present invention as described above.
The invention discloses a method for refreshing local data cache of a distributed consumer credit system in real time, which comprises the following steps:
A. when data is updated, the data updating message is asynchronously sent to Redis Topic;
A1. defining an update data model object, wherein the object is a field needing to be updated; defining a cache flush object, the object comprising: a cache key field, a cache type field and a cache refresh event field; defining a Redis Topic name, wherein the name type is a character string type; defining a Java thread pool, wherein the Java thread pool comprises the specified core thread number, the maximum thread number, the thread survival time, the queue size and the attribute of a thread pool rejection strategy;
A2. newly building the cache refreshing object defined in the step A1, and filling the cache refreshing object according to the updated data model object to obtain a cache refreshing message object;
A3. newly building a Java thread, and calling a conversion and transmission method of a Redis template tool, wherein a first parameter of the method is a Redis Topic name, and a second parameter is a cache refreshing message object to obtain a message transmission thread;
A4. and (4) taking the Redis Topic name in the step A1 and the cache refreshing message object in the step A2 as parameters, transmitting the parameters into a message sending thread, transmitting the message sending thread into the Java thread pool defined in the step A1, executing tasks, and asynchronously sending the data updating message to the Redis Topic.
B. Synchronously updating the data of the database;
B1. automatically initializing a data source according to a Spring automatic assembly mechanism and database connection information appointed in a configuration file;
B2. taking the data source as a Spring JdbcTemplate object to obtain a database access tool;
B3. constructing an updated SQL statement according to the updated data model object defined in the step A1;
B4. and transmitting the updated SQL statements serving as parameters into a database access tool for task execution, and synchronously updating data to the database after the execution is finished.
C. Registering a Redis Topic listener and monitoring a message of the Redis Topic;
C1. defining a Redis message listener attribute object, wherein the object comprises a name field of a message listener and a message listener implementation class field; and defining an object of multiple Redis Topic listeners, wherein the object only has one TreeMap type field, a key in the TreeMap is a Redis Topic name, and a value in the TreeMap is a defined Redis message listener attribute object;
C2. newly adding Redis Topic listener configuration in a program starting file for setting object values of multiple defined Redis Topic listeners, and obtaining multiple Redis Topic listener objects based on a Spring automatic device mechanism and the multiple Redis Topic listener configuration;
C3. traversing TreeMap of the generated multiple Redis Topic listener objects, and reading Redis Topic names and Redis message listener attribute objects one by one; calling a Bean factory object obtained from a Spring context and inputting a Redis message listener attribute object to obtain a Redis message listener;
C4. and creating a Redis message listener container object according to the Bean factory object to register a Redis Topic listener, wherein the Redis Topic listener listens for the message of the Redis Topic according to the input Redis message listener and the Redis Topic name.
And after the Redis Topic listener acquires the message, calling a message refreshing interface to refresh the local data cache.
D1. Defining a cache refreshing implementation class and a cache refreshing abstract interface, defining an object of a hashmap type field in the cache refreshing abstract interface, wherein the key of the object is the cache type field of the cache refreshing object in the step A2, the value of the object is the cache refreshing implementation class, and a cache refreshing service registration method, a cache type abstract method and a cache refreshing abstract method are further defined in the cache refreshing abstract interface;
D2. defining two class object parameters, wherein the first parameter is a database access implementation class, and the second parameter is a Caffeine cache container;
D3. defining a class object construction method, wherein only one parameter of the method is a database access implementation class; assigning the obtained database access implementation class to the first class object parameter database access implementation class, calling a construction scheme of a Caffeine cache container, setting data cache capacity and cache survival time, and calling the database access implementation class to read data from a database and cache the data locally;
D4. implementing the cache type abstraction method of the cache refresh abstraction interface, and returning to the cache type field of the cache refresh message object defined in the step A1; a cache refresh abstract method for implementing a cache refresh abstract interface;
D5. defining a cache data reading method, and transmitting the cache key field of the cache refresh message object defined in the step A1 into the cache data reading method as a parameter;
D6. when the Redis Topic listener receives a data updating message, calling a cache refreshing method of a cache refreshing implementation class so as to transmit data to a Caffeine local cache;
D7. judging whether the cache is hit, if so, directly returning to the Caffeine local cache and calling a cache data reading method to read data, and if not, calling a query method of a database access tool to read data from the database and writing the data into the Caffeine local cache;
D8. when data read from a database is written into a Caffeine local cache, calling an overdue task scheduling method embedded in a Caffeine local cache frame, inputting a cache refreshing key and calling a cache invalidation method of a Caffeine cache container every specified TTL time, and removing overdue cache data from the Caffeine local cache at regular time;
as shown in fig. 2, a flow chart of the present invention for refreshing local cache is that a Redis topoic listener receives a snoop message and sends the message to a Caffeine local cache, determines whether the cache is hit, returns Caffeine local cache read data if the cache is hit, and reads data from a database and writes the data into the local cache if the cache is not hit; when data is read from a database and written into the Caffeine local cache, an overdue task scheduling method embedded in a Caffeine local cache frame is called, and the overdue cache is automatically cleaned at intervals of TTL time.
As shown in fig. 3, a schematic diagram of a method for updating local data cache in real time in a distributed consumer credit system according to the present invention is shown, wherein when data is updated, a data update message is sent to a database to update the database and store persistent data in the database; when data is updated, asynchronously sending a data updating message to Redis Topic; the Redis Topic listener monitors the Redis Topic, receives a data updating message when monitoring the data updating message, and calls a local cache refreshing method to refresh the local cache.
Claims (5)
1. A method for real-time refreshing of a local data cache of a distributed consumer credit system, comprising:
A. when data is updated, the data updating message is asynchronously sent to Redis Topic;
B. synchronously updating the data of the database;
C. registering a Redis Topic listener and monitoring a message of the Redis Topic;
and after the Redis Topic listener acquires the message, calling a message refreshing interface to refresh the local data cache.
2. The method of distributed consumer credit system local data cache real-time refresh as claimed in claim 1, wherein: the step A comprises the following steps:
A1. defining an update data model object, wherein the object is a field needing to be updated; defining a cache flush object, the object comprising: a cache key field, a cache type field and a cache refresh event field; defining a Redis Topic name, wherein the name type is a character string type; defining a Java thread pool, wherein the Java thread pool comprises the specified core thread number, the maximum thread number, the thread survival time, the queue size and the attribute of a thread pool rejection strategy;
A2. newly building the cache refreshing object defined in the step A1, and filling the cache refreshing object according to the updated data model object to obtain a cache refreshing message object;
A3. newly building a Java thread, and calling a conversion and transmission method of a Redis template tool, wherein a first parameter of the method is a Redis Topic name, and a second parameter is a cache refreshing message object to obtain a message transmission thread;
A4. and (4) taking the Redis Topic name in the step A1 and the cache refreshing message object in the step A2 as parameters, transmitting the parameters into a message sending thread, transmitting the message sending thread into the Java thread pool defined in the step A1, executing tasks, and asynchronously sending the data updating message to the Redis Topic.
3. The method of distributed consumer credit system local data cache real-time refresh as claimed in claim 2, wherein: the step B comprises the following steps:
B1. automatically initializing a data source according to a Spring automatic assembly mechanism and database connection information appointed in a configuration file;
B2. taking the data source as a Spring JdbcTemplate object to obtain a database access tool;
B3. constructing an updated SQL statement according to the updated data model object defined in the step A1;
B4. and transmitting the updated SQL statements serving as parameters into a database access tool for task execution, and synchronously updating data to the database after the execution is finished.
4. The method of distributed consumer credit system local data cache real-time refresh as claimed in claim 1, wherein: the step C comprises the following steps:
C1. defining a Redis message listener attribute object, wherein the object comprises a name field of a message listener and a message listener implementation class field; and defining an object of multiple Redis Topic listeners, wherein the object only has one TreeMap type field, a key in the TreeMap is a Redis Topic name, and a value in the TreeMap is a defined Redis message listener attribute object;
C2. newly adding Redis Topic listener configuration in a program starting file for setting object values of multiple defined Redis Topic listeners, and obtaining multiple Redis Topic listener objects based on a Spring automatic device mechanism and the multiple Redis Topic listener configuration;
C3. traversing TreeMap of the generated multiple Redis Topic listener objects, and reading Redis Topic names and Redis message listener attribute objects one by one; calling a Bean factory object obtained from a Spring context and inputting a Redis message listener attribute object to obtain a Redis message listener;
C4. and creating a Redis message listener container object according to the Bean factory object to register a Redis Topic listener, wherein the Redis Topic listener listens for the message of the Redis Topic according to the input Redis message listener and the Redis Topic name.
5. The method of distributed consumer credit system local data cache real-time refresh as claimed in claim 2, wherein: the step D comprises the following steps:
D1. defining a cache refreshing implementation class and a cache refreshing abstract interface, defining an object of a hashmap type field in the cache refreshing abstract interface, wherein the key of the object is the cache type field of the cache refreshing object in the step A2, the value of the object is the cache refreshing implementation class, and a cache refreshing service registration method, a cache type abstract method and a cache refreshing abstract method are further defined in the cache refreshing abstract interface;
D2. defining two class object parameters, wherein the first parameter is a database access implementation class, and the second parameter is a Caffeine cache container;
D3. defining a class object construction method, wherein only one parameter of the method is a database access implementation class; assigning the obtained database access implementation class to the first class object parameter database access implementation class, calling a construction scheme of a Caffeine cache container, setting data cache capacity and cache survival time, and calling the database access implementation class to read data from a database and cache the data locally;
D4. implementing the cache type abstraction method of the cache refresh abstraction interface, and returning to the cache type field of the cache refresh message object defined in the step A1; a cache refresh abstract method for implementing a cache refresh abstract interface;
D5. defining a cache data reading method, and transmitting the cache key field of the cache refresh message object defined in the step A1 into the cache data reading method as a parameter;
D6. when the Redis Topic listener receives a data updating message, calling a cache refreshing method of a cache refreshing implementation class so as to transmit data to a Caffeine local cache;
D7. judging whether the cache is hit, if so, directly returning to the Caffeine local cache and calling a cache data reading method to read data, and if not, calling a query method of a database access tool to read data from the database and writing the data into the Caffeine local cache;
D8. when data read from a database is written into a Caffeine local cache, an overdue task scheduling method embedded in a Caffeine local cache frame is called, a cache refresh key is input and a cache invalidation method of a Caffeine cache container is called every other appointed TTL time, and overdue cache data are removed from the Caffeine local cache at regular time.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011127684.3A CN111966719B (en) | 2020-10-21 | 2020-10-21 | Method for refreshing local data cache of distributed consumer credit system in real time |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011127684.3A CN111966719B (en) | 2020-10-21 | 2020-10-21 | Method for refreshing local data cache of distributed consumer credit system in real time |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111966719A true CN111966719A (en) | 2020-11-20 |
CN111966719B CN111966719B (en) | 2021-07-13 |
Family
ID=73386959
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011127684.3A Active CN111966719B (en) | 2020-10-21 | 2020-10-21 | Method for refreshing local data cache of distributed consumer credit system in real time |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111966719B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112702264A (en) * | 2020-11-27 | 2021-04-23 | 四川新网银行股份有限公司 | Distributed network feature calculation method |
CN113392132A (en) * | 2021-05-07 | 2021-09-14 | 杭州数知梦科技有限公司 | Distributed caching method and system for IOT scene |
CN113486099A (en) * | 2021-06-23 | 2021-10-08 | 华泰证券股份有限公司 | Memory computing service framework and implementation system |
CN113742381A (en) * | 2021-08-30 | 2021-12-03 | 欧电云信息科技(江苏)有限公司 | Cache acquisition method, apparatus and computer readable medium |
CN114968405A (en) * | 2022-05-25 | 2022-08-30 | 山东国子软件股份有限公司 | User-defined workflow engine configuration system and method |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106027623A (en) * | 2016-03-14 | 2016-10-12 | 中国科学院计算技术研究所 | Distributed cluster state management method and system thereof |
CN106502589A (en) * | 2016-10-21 | 2017-03-15 | 普元信息技术股份有限公司 | The loading of caching or the system and method for persistence is realized based on cloud computing |
CN107438084A (en) * | 2016-05-25 | 2017-12-05 | 北京京东尚科信息技术有限公司 | Multi-client data synchronization method and apparatus |
CN108804237A (en) * | 2017-05-05 | 2018-11-13 | 北京京东尚科信息技术有限公司 | Data real-time statistical method, device, storage medium and electronic equipment |
CN109298957A (en) * | 2018-10-18 | 2019-02-01 | 大唐网络有限公司 | A kind of information management method with high reliability for supporting to regularly send |
CN109788027A (en) * | 2018-12-13 | 2019-05-21 | 平安科技(深圳)有限公司 | Method of data synchronization, device, server and computer storage medium |
CN110597910A (en) * | 2019-09-12 | 2019-12-20 | 聚好看科技股份有限公司 | Remote data synchronization method, device and system |
CN110928885A (en) * | 2018-09-04 | 2020-03-27 | 北京奇虎科技有限公司 | Method and device for updating data of Mysql database to Es database |
CN111563102A (en) * | 2020-04-10 | 2020-08-21 | 中国联合网络通信集团有限公司 | Cache updating method, server, system and storage medium |
-
2020
- 2020-10-21 CN CN202011127684.3A patent/CN111966719B/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106027623A (en) * | 2016-03-14 | 2016-10-12 | 中国科学院计算技术研究所 | Distributed cluster state management method and system thereof |
CN107438084A (en) * | 2016-05-25 | 2017-12-05 | 北京京东尚科信息技术有限公司 | Multi-client data synchronization method and apparatus |
CN106502589A (en) * | 2016-10-21 | 2017-03-15 | 普元信息技术股份有限公司 | The loading of caching or the system and method for persistence is realized based on cloud computing |
CN108804237A (en) * | 2017-05-05 | 2018-11-13 | 北京京东尚科信息技术有限公司 | Data real-time statistical method, device, storage medium and electronic equipment |
CN110928885A (en) * | 2018-09-04 | 2020-03-27 | 北京奇虎科技有限公司 | Method and device for updating data of Mysql database to Es database |
CN109298957A (en) * | 2018-10-18 | 2019-02-01 | 大唐网络有限公司 | A kind of information management method with high reliability for supporting to regularly send |
CN109788027A (en) * | 2018-12-13 | 2019-05-21 | 平安科技(深圳)有限公司 | Method of data synchronization, device, server and computer storage medium |
CN110597910A (en) * | 2019-09-12 | 2019-12-20 | 聚好看科技股份有限公司 | Remote data synchronization method, device and system |
CN111563102A (en) * | 2020-04-10 | 2020-08-21 | 中国联合网络通信集团有限公司 | Cache updating method, server, system and storage medium |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112702264A (en) * | 2020-11-27 | 2021-04-23 | 四川新网银行股份有限公司 | Distributed network feature calculation method |
CN113392132A (en) * | 2021-05-07 | 2021-09-14 | 杭州数知梦科技有限公司 | Distributed caching method and system for IOT scene |
CN113392132B (en) * | 2021-05-07 | 2023-04-11 | 杭州数知梦科技有限公司 | Distributed caching method and system for IOT scene |
CN113486099A (en) * | 2021-06-23 | 2021-10-08 | 华泰证券股份有限公司 | Memory computing service framework and implementation system |
CN113742381A (en) * | 2021-08-30 | 2021-12-03 | 欧电云信息科技(江苏)有限公司 | Cache acquisition method, apparatus and computer readable medium |
CN113742381B (en) * | 2021-08-30 | 2023-07-25 | 欧电云信息科技(江苏)有限公司 | Cache acquisition method, device and computer readable medium |
CN114968405A (en) * | 2022-05-25 | 2022-08-30 | 山东国子软件股份有限公司 | User-defined workflow engine configuration system and method |
CN114968405B (en) * | 2022-05-25 | 2024-06-04 | 山东国子软件股份有限公司 | Custom workflow engine configuration system and method |
Also Published As
Publication number | Publication date |
---|---|
CN111966719B (en) | 2021-07-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111966719B (en) | Method for refreshing local data cache of distributed consumer credit system in real time | |
CN109144994B (en) | Index updating method, system and related device | |
CN109271417B (en) | Database-based lightweight message queue implementation method and storage device | |
EP2738694A2 (en) | Compressed representation of a transaction token | |
CN110609865B (en) | Information synchronization method, device and system | |
CN101160797B (en) | Method for subscribing data dynamically | |
CN107786623B (en) | Message asynchronous processing method and device | |
WO2023231665A1 (en) | Distributed transaction processing method, system and device, and readable storage medium | |
CN107704573A (en) | A kind of intelligent buffer method coupled with business | |
CN105608126A (en) | Method and apparatus for establishing secondary indexes for massive databases | |
CN107329910A (en) | A kind of web front end data based on localStorage are locally stored and access method | |
US10620660B2 (en) | Efficient timestamp solution for analyzing concurrent software systems | |
CN111737254B (en) | Method and device for improving application cache utilization rate | |
CN117112618B (en) | EDA software data query method, electronic device and medium | |
CN106874465A (en) | Method for efficiently managing cache based on data version | |
CN111177254A (en) | Method and device for data synchronization between heterogeneous relational databases | |
CN115033646A (en) | Method for constructing real-time warehouse system based on Flink and Doris | |
CN107169047A (en) | A kind of method and device for realizing data buffer storage | |
DE202021102320U1 (en) | System for implementing sub-database replication | |
CN108416017B (en) | CDN cache clearing method and system | |
CN107590199B (en) | Memory-oriented multithreading database design method | |
CN113836212B (en) | Method for automatically generating Json data by database data, readable medium and electronic equipment | |
CN115695458A (en) | Data storage method of BS (base station) terminal under weak network environment | |
CN114238390A (en) | Data warehouse optimization method, device, equipment and storage medium | |
CN112269820A (en) | Method and platform for realizing data batch synchronization based on CMSP |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |