CN111966719A - Method for refreshing local data cache of distributed consumer credit system in real time - Google Patents

Method for refreshing local data cache of distributed consumer credit system in real time Download PDF

Info

Publication number
CN111966719A
CN111966719A CN202011127684.3A CN202011127684A CN111966719A CN 111966719 A CN111966719 A CN 111966719A CN 202011127684 A CN202011127684 A CN 202011127684A CN 111966719 A CN111966719 A CN 111966719A
Authority
CN
China
Prior art keywords
cache
redis
data
message
topic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011127684.3A
Other languages
Chinese (zh)
Other versions
CN111966719B (en
Inventor
李长彬
冯宇
蔡浩庭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan XW Bank Co Ltd
Original Assignee
Sichuan XW Bank Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan XW Bank Co Ltd filed Critical Sichuan XW Bank Co Ltd
Priority to CN202011127684.3A priority Critical patent/CN111966719B/en
Publication of CN111966719A publication Critical patent/CN111966719A/en
Application granted granted Critical
Publication of CN111966719B publication Critical patent/CN111966719B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • G06F16/24552Database cache management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/252Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to a method for refreshing local data cache of a distributed consumer credit system in real time, which comprises the following steps: step 1: a message sending tool for data updating is newly built, and a data updating message is asynchronously sent to Redis Topic; step 2: synchronously updating the data of the database; and step 3: registering a Redis Topic listener and monitoring a message of the Redis Topic; and 4, step 4: and calling a message refreshing interface to refresh the local data cache after the Redis Topic listener acquires the message. The invention can control the upper limit of the cache capacity under the condition of using the local cache or refresh the local cache in time when the data is updated, thereby eliminating the risk of memory overflow or data inconsistency; data updating and local cache refreshing are decoupled, and the influence of Redis abnormity on the main service is eliminated; based on a cache expiration policy and TTL, the probability of data inconsistency caused by temporary unavailability of Redis is reduced; the performance risk caused by the fact that a large number of queries directly penetrate the database to operate due to cache breakdown is reduced.

Description

Method for refreshing local data cache of distributed consumer credit system in real time
Technical Field
The invention relates to the field of cache processing, in particular to a method for refreshing local data cache of a distributed consumer credit system in real time.
Background
TTL: is an abbreviation for Time To Live, which specifies the local data cache survival Time in nanoseconds.
Caffeine: the framework is a high-performance local cache framework based on Java 8, the framework is used for the reference of Google Guava and is partially improved, and meanwhile, the framework provides various cache expiration strategies and cache capacity upper limit configuration functions.
The upper limit of the buffer capacity: the method refers to how many pieces of data can be stored locally at most, and when the cache data reaches the upper limit of the cache capacity, the method can release the capacity by locally evicting the least recently used cache data and cache new data to the local.
Most of the current applications adopt a cache technology for performance, and by investigating various channels, the existing cache refreshing can be realized through the following three ways:
firstly, using hashmap to buffer controllable data volume to local.
And secondly, using Caffeine or similar java memory cache frames to specify the upper limit of the cache capacity and TTL, thereby achieving the purpose of caching static or hot data.
And thirdly, storing data by using a Redis distributed cache.
The first scheme and the second scheme are both limited by the fact that local data cache of the distributed application system cannot be refreshed timely under the condition that data are updated, and the risk that cache data are inconsistent with database data is easily caused, so that certain influence is caused on service development; in addition, under the condition that a large amount of cache data at the same time point is invalid, a large amount of queries directly penetrate through the database to perform data reading operation, and thus the performance problem of the database is caused.
The prior art has the problems that the upper limit of the cache capacity cannot be controlled when a local cache is used, or the local cache cannot be refreshed in time when data (such as mobile phone numbers) are updated, so that the risk of memory overflow or data inconsistency is caused, and the like.
Disclosure of Invention
The invention provides a method for refreshing local data cache of a distributed consumer credit system in real time, which can control the upper limit of cache capacity under the condition of using the local cache or refresh the local cache in time when data (such as mobile phone numbers) are updated, thereby eliminating the risk of memory overflow or data inconsistency.
The invention discloses a method for refreshing local data cache of a distributed consumer credit system in real time, which comprises the following steps:
A. when data is updated, the data updating message is asynchronously sent to Redis Topic;
B. synchronously updating the data of the database;
C. registering a Redis Topic listener and monitoring a message of the Redis Topic;
and after the Redis Topic listener acquires the message, calling a message refreshing interface to refresh the local data cache.
Redis Topic: the Redis client can subscribe to any number of Topic, and when a producer issues a message to Topic, a plurality of subscribers can receive the message at the same time.
Further, step a comprises:
A1. defining an update data model object, wherein the object is a field needing to be updated; defining a cache flush object, the object comprising: a cache key field, a cache type field and a cache refresh event field; defining a Redis Topic name, wherein the name type is a character string type; defining a Java thread pool, wherein the Java thread pool comprises the specified core thread number, the maximum thread number, the thread survival time, the queue size and the attribute of a thread pool rejection strategy;
A2. newly building the cache refreshing object defined in the step A1, and filling the cache refreshing object according to the updated data model object to obtain a cache refreshing message object;
A3. newly building a Java thread, and calling a conversion and transmission method of a Redis template tool, wherein a first parameter of the method is a Redis Topic name, and a second parameter is a cache refreshing message object to obtain a message transmission thread;
A4. and (4) taking the Redis Topic name in the step A1 and the cache refreshing message object in the step A2 as parameters, transmitting the parameters into a message sending thread, transmitting the message sending thread into the Java thread pool defined in the step A1, executing tasks, and asynchronously sending the data updating message to the Redis Topic.
The data model object is defined and updated by self-definition in the following steps, so that the consistency of data is ensured, the whole process is more reliable, and the risk problem caused by data inconsistency is reduced; and the upper limit of the cache capacity is controlled to realize the refreshing of the local cache in time.
Further, step B includes:
B1. automatically initializing a data source according to a Spring automatic assembly mechanism and database connection information appointed in a configuration file;
B2. taking the data source as a Spring JdbcTemplate object to obtain a database access tool;
B3. constructing an updated SQL statement according to the updated data model object defined in the step A1;
B4. and transmitting the updated SQL statements serving as parameters into a database access tool for task execution, and synchronously updating data to the database after the execution is finished.
The decoupling of data updating and local cache refreshing is realized, the influence of Redis abnormity on the main service is eliminated, namely when the Redis abnormity is realized, the data updating is not influenced, and the main service can continue to move to the next process.
Further, step C includes:
C1. defining a Redis message listener attribute object, wherein the object comprises a name field of a message listener and a message listener implementation class field; and defining an object of multiple Redis Topic listeners, wherein the object only has one TreeMap type field, a key in the TreeMap is a Redis Topic name, and a value in the TreeMap is a defined Redis message listener attribute object;
C2. newly adding Redis Topic listener configuration in a program starting file for setting object values of multiple defined Redis Topic listeners, and obtaining multiple Redis Topic listener objects based on a Spring automatic device mechanism and the multiple Redis Topic listener configuration;
C3. traversing TreeMap of the generated multiple Redis Topic listener objects, and reading Redis Topic names and Redis message listener attribute objects one by one; calling a Bean factory object obtained from a Spring context and inputting a Redis message listener attribute object to obtain a Redis message listener;
C4. and creating a Redis message listener container object according to the Bean factory object to register a Redis Topic listener, wherein the Redis Topic listener listens for the message of the Redis Topic according to the input Redis message listener and the Redis Topic name.
Further, step D includes:
D1. defining a cache refreshing implementation class and a cache refreshing abstract interface, defining an object of a hashmap type field in the cache refreshing abstract interface, wherein the key of the object is the cache type field of the cache refreshing object in the step A2, the value of the object is the cache refreshing implementation class, and a cache refreshing service registration method, a cache type abstract method and a cache refreshing abstract method are further defined in the cache refreshing abstract interface;
D2. defining two class object parameters, wherein the first parameter is a database access implementation class, and the second parameter is a Caffeine cache container;
D3. defining a class object construction method, wherein only one parameter of the method is a database access implementation class; assigning the obtained database access implementation class to the first class object parameter database access implementation class, calling a construction scheme of a Caffeine cache container, setting data cache capacity and cache survival time, and calling the database access implementation class to read data from a database and cache the data locally;
D4. implementing the cache type abstraction method of the cache refresh abstraction interface, and returning to the cache type field of the cache refresh message object defined in the step A1; a cache refresh abstract method for implementing a cache refresh abstract interface;
D5. defining a cache data reading method, and transmitting the cache key field of the cache refresh message object defined in the step A1 into the cache data reading method as a parameter;
D6. when the Redis Topic listener receives a data updating message, calling a cache refreshing method of a cache refreshing implementation class so as to transmit data to a Caffeine local cache;
D7. judging whether the cache is hit, if so, directly returning to the Caffeine local cache and calling a cache data reading method to read data, and if not, calling a query method of a database access tool to read data from the database and writing the data into the Caffeine local cache;
D8. when data read from a database is written into a Caffeine local cache, calling an overdue task scheduling method embedded in a Caffeine local cache frame, inputting a cache refreshing key and calling a cache invalidation method of a Caffeine cache container every specified TTL time, and removing overdue cache data from the Caffeine local cache at regular time;
based on the cache expiration policy and TTL, the probability of data inconsistency caused by temporary unavailability of Redis is reduced.
Local cache data is updated in near real time, and data consistency is guaranteed; under the condition of data updating or cache expiration, cache data is removed from the local area, and the performance risk caused by the fact that a large number of queries directly penetrate through the database to operate due to cache breakdown is reduced.
According to the method for refreshing the local data cache of the distributed consumer credit system in real time, the consistency of data is ensured by updating the data model object in a user-defined manner, so that the whole process is more reliable, and the risk problem caused by inconsistent data is reduced; the upper limit of the cache capacity is controlled to realize the refreshing of the local cache in time; the data updating and local cache refreshing decoupling is realized, and the influence of Redis abnormity on the main service is eliminated; based on a cache expiration policy and TTL, the probability of data inconsistency caused by temporary unavailability of Redis is reduced; under the condition of data updating or cache expiration, cache data is removed from the local area, and the performance risk caused by the fact that a large number of queries directly penetrate through the database to operate due to cache breakdown is reduced.
Drawings
FIG. 1 is a flow chart of a method of the present invention for real-time refreshing of a distributed consumer credit system local data cache.
FIG. 2 is a flow chart of refreshing a local cache according to the present invention.
FIG. 3 is a schematic diagram of a method for real-time refreshing of a local data cache of a distributed consumer credit system in accordance with the present invention.
Detailed Description
The present invention will be described in further detail with reference to the following examples. This should not be understood as limiting the scope of the above-described subject matter of the present invention to the following examples. Various substitutions and alterations according to the general knowledge and conventional practice in the art are intended to be included within the scope of the present invention without departing from the technical spirit of the present invention as described above.
The invention discloses a method for refreshing local data cache of a distributed consumer credit system in real time, which comprises the following steps:
A. when data is updated, the data updating message is asynchronously sent to Redis Topic;
A1. defining an update data model object, wherein the object is a field needing to be updated; defining a cache flush object, the object comprising: a cache key field, a cache type field and a cache refresh event field; defining a Redis Topic name, wherein the name type is a character string type; defining a Java thread pool, wherein the Java thread pool comprises the specified core thread number, the maximum thread number, the thread survival time, the queue size and the attribute of a thread pool rejection strategy;
A2. newly building the cache refreshing object defined in the step A1, and filling the cache refreshing object according to the updated data model object to obtain a cache refreshing message object;
A3. newly building a Java thread, and calling a conversion and transmission method of a Redis template tool, wherein a first parameter of the method is a Redis Topic name, and a second parameter is a cache refreshing message object to obtain a message transmission thread;
A4. and (4) taking the Redis Topic name in the step A1 and the cache refreshing message object in the step A2 as parameters, transmitting the parameters into a message sending thread, transmitting the message sending thread into the Java thread pool defined in the step A1, executing tasks, and asynchronously sending the data updating message to the Redis Topic.
B. Synchronously updating the data of the database;
B1. automatically initializing a data source according to a Spring automatic assembly mechanism and database connection information appointed in a configuration file;
B2. taking the data source as a Spring JdbcTemplate object to obtain a database access tool;
B3. constructing an updated SQL statement according to the updated data model object defined in the step A1;
B4. and transmitting the updated SQL statements serving as parameters into a database access tool for task execution, and synchronously updating data to the database after the execution is finished.
C. Registering a Redis Topic listener and monitoring a message of the Redis Topic;
C1. defining a Redis message listener attribute object, wherein the object comprises a name field of a message listener and a message listener implementation class field; and defining an object of multiple Redis Topic listeners, wherein the object only has one TreeMap type field, a key in the TreeMap is a Redis Topic name, and a value in the TreeMap is a defined Redis message listener attribute object;
C2. newly adding Redis Topic listener configuration in a program starting file for setting object values of multiple defined Redis Topic listeners, and obtaining multiple Redis Topic listener objects based on a Spring automatic device mechanism and the multiple Redis Topic listener configuration;
C3. traversing TreeMap of the generated multiple Redis Topic listener objects, and reading Redis Topic names and Redis message listener attribute objects one by one; calling a Bean factory object obtained from a Spring context and inputting a Redis message listener attribute object to obtain a Redis message listener;
C4. and creating a Redis message listener container object according to the Bean factory object to register a Redis Topic listener, wherein the Redis Topic listener listens for the message of the Redis Topic according to the input Redis message listener and the Redis Topic name.
And after the Redis Topic listener acquires the message, calling a message refreshing interface to refresh the local data cache.
D1. Defining a cache refreshing implementation class and a cache refreshing abstract interface, defining an object of a hashmap type field in the cache refreshing abstract interface, wherein the key of the object is the cache type field of the cache refreshing object in the step A2, the value of the object is the cache refreshing implementation class, and a cache refreshing service registration method, a cache type abstract method and a cache refreshing abstract method are further defined in the cache refreshing abstract interface;
D2. defining two class object parameters, wherein the first parameter is a database access implementation class, and the second parameter is a Caffeine cache container;
D3. defining a class object construction method, wherein only one parameter of the method is a database access implementation class; assigning the obtained database access implementation class to the first class object parameter database access implementation class, calling a construction scheme of a Caffeine cache container, setting data cache capacity and cache survival time, and calling the database access implementation class to read data from a database and cache the data locally;
D4. implementing the cache type abstraction method of the cache refresh abstraction interface, and returning to the cache type field of the cache refresh message object defined in the step A1; a cache refresh abstract method for implementing a cache refresh abstract interface;
D5. defining a cache data reading method, and transmitting the cache key field of the cache refresh message object defined in the step A1 into the cache data reading method as a parameter;
D6. when the Redis Topic listener receives a data updating message, calling a cache refreshing method of a cache refreshing implementation class so as to transmit data to a Caffeine local cache;
D7. judging whether the cache is hit, if so, directly returning to the Caffeine local cache and calling a cache data reading method to read data, and if not, calling a query method of a database access tool to read data from the database and writing the data into the Caffeine local cache;
D8. when data read from a database is written into a Caffeine local cache, calling an overdue task scheduling method embedded in a Caffeine local cache frame, inputting a cache refreshing key and calling a cache invalidation method of a Caffeine cache container every specified TTL time, and removing overdue cache data from the Caffeine local cache at regular time;
as shown in fig. 2, a flow chart of the present invention for refreshing local cache is that a Redis topoic listener receives a snoop message and sends the message to a Caffeine local cache, determines whether the cache is hit, returns Caffeine local cache read data if the cache is hit, and reads data from a database and writes the data into the local cache if the cache is not hit; when data is read from a database and written into the Caffeine local cache, an overdue task scheduling method embedded in a Caffeine local cache frame is called, and the overdue cache is automatically cleaned at intervals of TTL time.
As shown in fig. 3, a schematic diagram of a method for updating local data cache in real time in a distributed consumer credit system according to the present invention is shown, wherein when data is updated, a data update message is sent to a database to update the database and store persistent data in the database; when data is updated, asynchronously sending a data updating message to Redis Topic; the Redis Topic listener monitors the Redis Topic, receives a data updating message when monitoring the data updating message, and calls a local cache refreshing method to refresh the local cache.

Claims (5)

1. A method for real-time refreshing of a local data cache of a distributed consumer credit system, comprising:
A. when data is updated, the data updating message is asynchronously sent to Redis Topic;
B. synchronously updating the data of the database;
C. registering a Redis Topic listener and monitoring a message of the Redis Topic;
and after the Redis Topic listener acquires the message, calling a message refreshing interface to refresh the local data cache.
2. The method of distributed consumer credit system local data cache real-time refresh as claimed in claim 1, wherein: the step A comprises the following steps:
A1. defining an update data model object, wherein the object is a field needing to be updated; defining a cache flush object, the object comprising: a cache key field, a cache type field and a cache refresh event field; defining a Redis Topic name, wherein the name type is a character string type; defining a Java thread pool, wherein the Java thread pool comprises the specified core thread number, the maximum thread number, the thread survival time, the queue size and the attribute of a thread pool rejection strategy;
A2. newly building the cache refreshing object defined in the step A1, and filling the cache refreshing object according to the updated data model object to obtain a cache refreshing message object;
A3. newly building a Java thread, and calling a conversion and transmission method of a Redis template tool, wherein a first parameter of the method is a Redis Topic name, and a second parameter is a cache refreshing message object to obtain a message transmission thread;
A4. and (4) taking the Redis Topic name in the step A1 and the cache refreshing message object in the step A2 as parameters, transmitting the parameters into a message sending thread, transmitting the message sending thread into the Java thread pool defined in the step A1, executing tasks, and asynchronously sending the data updating message to the Redis Topic.
3. The method of distributed consumer credit system local data cache real-time refresh as claimed in claim 2, wherein: the step B comprises the following steps:
B1. automatically initializing a data source according to a Spring automatic assembly mechanism and database connection information appointed in a configuration file;
B2. taking the data source as a Spring JdbcTemplate object to obtain a database access tool;
B3. constructing an updated SQL statement according to the updated data model object defined in the step A1;
B4. and transmitting the updated SQL statements serving as parameters into a database access tool for task execution, and synchronously updating data to the database after the execution is finished.
4. The method of distributed consumer credit system local data cache real-time refresh as claimed in claim 1, wherein: the step C comprises the following steps:
C1. defining a Redis message listener attribute object, wherein the object comprises a name field of a message listener and a message listener implementation class field; and defining an object of multiple Redis Topic listeners, wherein the object only has one TreeMap type field, a key in the TreeMap is a Redis Topic name, and a value in the TreeMap is a defined Redis message listener attribute object;
C2. newly adding Redis Topic listener configuration in a program starting file for setting object values of multiple defined Redis Topic listeners, and obtaining multiple Redis Topic listener objects based on a Spring automatic device mechanism and the multiple Redis Topic listener configuration;
C3. traversing TreeMap of the generated multiple Redis Topic listener objects, and reading Redis Topic names and Redis message listener attribute objects one by one; calling a Bean factory object obtained from a Spring context and inputting a Redis message listener attribute object to obtain a Redis message listener;
C4. and creating a Redis message listener container object according to the Bean factory object to register a Redis Topic listener, wherein the Redis Topic listener listens for the message of the Redis Topic according to the input Redis message listener and the Redis Topic name.
5. The method of distributed consumer credit system local data cache real-time refresh as claimed in claim 2, wherein: the step D comprises the following steps:
D1. defining a cache refreshing implementation class and a cache refreshing abstract interface, defining an object of a hashmap type field in the cache refreshing abstract interface, wherein the key of the object is the cache type field of the cache refreshing object in the step A2, the value of the object is the cache refreshing implementation class, and a cache refreshing service registration method, a cache type abstract method and a cache refreshing abstract method are further defined in the cache refreshing abstract interface;
D2. defining two class object parameters, wherein the first parameter is a database access implementation class, and the second parameter is a Caffeine cache container;
D3. defining a class object construction method, wherein only one parameter of the method is a database access implementation class; assigning the obtained database access implementation class to the first class object parameter database access implementation class, calling a construction scheme of a Caffeine cache container, setting data cache capacity and cache survival time, and calling the database access implementation class to read data from a database and cache the data locally;
D4. implementing the cache type abstraction method of the cache refresh abstraction interface, and returning to the cache type field of the cache refresh message object defined in the step A1; a cache refresh abstract method for implementing a cache refresh abstract interface;
D5. defining a cache data reading method, and transmitting the cache key field of the cache refresh message object defined in the step A1 into the cache data reading method as a parameter;
D6. when the Redis Topic listener receives a data updating message, calling a cache refreshing method of a cache refreshing implementation class so as to transmit data to a Caffeine local cache;
D7. judging whether the cache is hit, if so, directly returning to the Caffeine local cache and calling a cache data reading method to read data, and if not, calling a query method of a database access tool to read data from the database and writing the data into the Caffeine local cache;
D8. when data read from a database is written into a Caffeine local cache, an overdue task scheduling method embedded in a Caffeine local cache frame is called, a cache refresh key is input and a cache invalidation method of a Caffeine cache container is called every other appointed TTL time, and overdue cache data are removed from the Caffeine local cache at regular time.
CN202011127684.3A 2020-10-21 2020-10-21 Method for refreshing local data cache of distributed consumer credit system in real time Active CN111966719B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011127684.3A CN111966719B (en) 2020-10-21 2020-10-21 Method for refreshing local data cache of distributed consumer credit system in real time

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011127684.3A CN111966719B (en) 2020-10-21 2020-10-21 Method for refreshing local data cache of distributed consumer credit system in real time

Publications (2)

Publication Number Publication Date
CN111966719A true CN111966719A (en) 2020-11-20
CN111966719B CN111966719B (en) 2021-07-13

Family

ID=73386959

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011127684.3A Active CN111966719B (en) 2020-10-21 2020-10-21 Method for refreshing local data cache of distributed consumer credit system in real time

Country Status (1)

Country Link
CN (1) CN111966719B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112702264A (en) * 2020-11-27 2021-04-23 四川新网银行股份有限公司 Distributed network feature calculation method
CN113392132A (en) * 2021-05-07 2021-09-14 杭州数知梦科技有限公司 Distributed caching method and system for IOT scene
CN113486099A (en) * 2021-06-23 2021-10-08 华泰证券股份有限公司 Memory computing service framework and implementation system
CN113742381A (en) * 2021-08-30 2021-12-03 欧电云信息科技(江苏)有限公司 Cache acquisition method, apparatus and computer readable medium
CN114968405A (en) * 2022-05-25 2022-08-30 山东国子软件股份有限公司 User-defined workflow engine configuration system and method

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106027623A (en) * 2016-03-14 2016-10-12 中国科学院计算技术研究所 Distributed cluster state management method and system thereof
CN106502589A (en) * 2016-10-21 2017-03-15 普元信息技术股份有限公司 The loading of caching or the system and method for persistence is realized based on cloud computing
CN107438084A (en) * 2016-05-25 2017-12-05 北京京东尚科信息技术有限公司 Multi-client data synchronization method and apparatus
CN108804237A (en) * 2017-05-05 2018-11-13 北京京东尚科信息技术有限公司 Data real-time statistical method, device, storage medium and electronic equipment
CN109298957A (en) * 2018-10-18 2019-02-01 大唐网络有限公司 A kind of information management method with high reliability for supporting to regularly send
CN109788027A (en) * 2018-12-13 2019-05-21 平安科技(深圳)有限公司 Method of data synchronization, device, server and computer storage medium
CN110597910A (en) * 2019-09-12 2019-12-20 聚好看科技股份有限公司 Remote data synchronization method, device and system
CN110928885A (en) * 2018-09-04 2020-03-27 北京奇虎科技有限公司 Method and device for updating data of Mysql database to Es database
CN111563102A (en) * 2020-04-10 2020-08-21 中国联合网络通信集团有限公司 Cache updating method, server, system and storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106027623A (en) * 2016-03-14 2016-10-12 中国科学院计算技术研究所 Distributed cluster state management method and system thereof
CN107438084A (en) * 2016-05-25 2017-12-05 北京京东尚科信息技术有限公司 Multi-client data synchronization method and apparatus
CN106502589A (en) * 2016-10-21 2017-03-15 普元信息技术股份有限公司 The loading of caching or the system and method for persistence is realized based on cloud computing
CN108804237A (en) * 2017-05-05 2018-11-13 北京京东尚科信息技术有限公司 Data real-time statistical method, device, storage medium and electronic equipment
CN110928885A (en) * 2018-09-04 2020-03-27 北京奇虎科技有限公司 Method and device for updating data of Mysql database to Es database
CN109298957A (en) * 2018-10-18 2019-02-01 大唐网络有限公司 A kind of information management method with high reliability for supporting to regularly send
CN109788027A (en) * 2018-12-13 2019-05-21 平安科技(深圳)有限公司 Method of data synchronization, device, server and computer storage medium
CN110597910A (en) * 2019-09-12 2019-12-20 聚好看科技股份有限公司 Remote data synchronization method, device and system
CN111563102A (en) * 2020-04-10 2020-08-21 中国联合网络通信集团有限公司 Cache updating method, server, system and storage medium

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112702264A (en) * 2020-11-27 2021-04-23 四川新网银行股份有限公司 Distributed network feature calculation method
CN113392132A (en) * 2021-05-07 2021-09-14 杭州数知梦科技有限公司 Distributed caching method and system for IOT scene
CN113392132B (en) * 2021-05-07 2023-04-11 杭州数知梦科技有限公司 Distributed caching method and system for IOT scene
CN113486099A (en) * 2021-06-23 2021-10-08 华泰证券股份有限公司 Memory computing service framework and implementation system
CN113742381A (en) * 2021-08-30 2021-12-03 欧电云信息科技(江苏)有限公司 Cache acquisition method, apparatus and computer readable medium
CN113742381B (en) * 2021-08-30 2023-07-25 欧电云信息科技(江苏)有限公司 Cache acquisition method, device and computer readable medium
CN114968405A (en) * 2022-05-25 2022-08-30 山东国子软件股份有限公司 User-defined workflow engine configuration system and method
CN114968405B (en) * 2022-05-25 2024-06-04 山东国子软件股份有限公司 Custom workflow engine configuration system and method

Also Published As

Publication number Publication date
CN111966719B (en) 2021-07-13

Similar Documents

Publication Publication Date Title
CN111966719B (en) Method for refreshing local data cache of distributed consumer credit system in real time
CN109144994B (en) Index updating method, system and related device
CN109271417B (en) Database-based lightweight message queue implementation method and storage device
EP2738694A2 (en) Compressed representation of a transaction token
CN110609865B (en) Information synchronization method, device and system
CN101160797B (en) Method for subscribing data dynamically
CN107786623B (en) Message asynchronous processing method and device
WO2023231665A1 (en) Distributed transaction processing method, system and device, and readable storage medium
CN107704573A (en) A kind of intelligent buffer method coupled with business
CN105608126A (en) Method and apparatus for establishing secondary indexes for massive databases
CN107329910A (en) A kind of web front end data based on localStorage are locally stored and access method
US10620660B2 (en) Efficient timestamp solution for analyzing concurrent software systems
CN111737254B (en) Method and device for improving application cache utilization rate
CN117112618B (en) EDA software data query method, electronic device and medium
CN106874465A (en) Method for efficiently managing cache based on data version
CN111177254A (en) Method and device for data synchronization between heterogeneous relational databases
CN115033646A (en) Method for constructing real-time warehouse system based on Flink and Doris
CN107169047A (en) A kind of method and device for realizing data buffer storage
DE202021102320U1 (en) System for implementing sub-database replication
CN108416017B (en) CDN cache clearing method and system
CN107590199B (en) Memory-oriented multithreading database design method
CN113836212B (en) Method for automatically generating Json data by database data, readable medium and electronic equipment
CN115695458A (en) Data storage method of BS (base station) terminal under weak network environment
CN114238390A (en) Data warehouse optimization method, device, equipment and storage medium
CN112269820A (en) Method and platform for realizing data batch synchronization based on CMSP

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant