CN115934843A - Distributed data read-write processing method - Google Patents

Distributed data read-write processing method Download PDF

Info

Publication number
CN115934843A
CN115934843A CN202211694412.0A CN202211694412A CN115934843A CN 115934843 A CN115934843 A CN 115934843A CN 202211694412 A CN202211694412 A CN 202211694412A CN 115934843 A CN115934843 A CN 115934843A
Authority
CN
China
Prior art keywords
data
access
database
frequency
real
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202211694412.0A
Other languages
Chinese (zh)
Inventor
唐君伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Yiwei Software System Co ltd
Original Assignee
Shanghai Yiwei Software System Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Yiwei Software System Co ltd filed Critical Shanghai Yiwei Software System Co ltd
Priority to CN202211694412.0A priority Critical patent/CN115934843A/en
Publication of CN115934843A publication Critical patent/CN115934843A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a distributed data read-write processing method, relates to the technical field of data read-write processing, and solves the technical problem that master-slave delay detection cannot be carried out in the data read-write processing process in the prior art; according to the method, the access intensity of the current database is judged, so that data scheduling can be performed in time when the database is accessed, the deviation of database operation caused by the large access intensity is prevented, the working efficiency of the database is reduced, and meanwhile, the balance analysis is performed on the read-write task quantity in the access task after the intensity analysis is completed; and meanwhile, the master-slave control analysis is carried out on the corresponding database according to the existence of the delay, so that the master-slave execution is reasonably carried out, the data execution qualification of the database is ensured, and the data access execution risk of the database is reduced to the minimum.

Description

Distributed data read-write processing method
Technical Field
The invention relates to the technical field of data read-write processing, in particular to a distributed data read-write processing method.
Background
The database architecture is a write-once read-many architecture, a master library is also a write library, a slave library is also a read library, and the read-write separation means that all write operations move the master library and other slave libraries, and the read-write separation mainly aims to reduce the pressure of the master library so as to achieve the integral stability of the system;
however, in the prior art, master-slave delay causes inconsistency between data written into the master library and data read out from the slave library, master-slave delay detection cannot be performed in the data reading and writing process, and meanwhile, the database cannot be stored in a partitioned manner to partition the read-write data;
in view of the above technical drawbacks, a solution is proposed.
Disclosure of Invention
The invention aims to solve the problems, and provides a distributed data read-write processing method, which is used for carrying out data partition storage according to different types of read-write, is favorable for improving the efficiency of database data storage and the stability of database access, and prevents data access from deviating due to data access delay, so that the storage efficiency of the database is reduced; and after the real-time storage data in the database is stored in a partitioned manner, the relevance analysis is carried out on the data stored in the readable area and the writable area, so that the timeliness of the supply of the storage data can be ensured when the data stored in the readable area and the writable area need to be used simultaneously, and the problem that the data storage efficiency of the database is low and the data execution efficiency is influenced due to the fact that the data is not supplied timely in the reading and writing process is avoided.
The purpose of the invention can be realized by the following technical scheme:
a distributed data read-write processing method comprises the following steps:
analyzing stored data, namely analyzing real-time stored data in a database, performing type division on the real-time stored data, performing read-write type division according to the characteristics of the real-time stored data, and performing data partition storage according to different types of read-write;
step two, storage in a partitioning mode, namely after the real-time storage data in the database are stored in the partitioning mode, relevance analysis is carried out on the data stored in the readable area and the writable area;
analyzing the access intensity, namely analyzing and monitoring the current access intensity of the database, and simultaneously performing balance analysis on the read-write task quantity in the access task after the intensity analysis is finished;
and step four, master-slave control analysis, namely analyzing the data execution process during real-time access of the database, judging whether the data execution process has delay, and simultaneously carrying out master-slave control analysis on the corresponding database according to whether the delay exists.
As a preferred embodiment of the present invention, the specific process of analyzing the stored data in the first step is as follows:
setting a label i for real-time storage data in a database, wherein the label i is a natural number greater than 1, and acquiring the shortest update interval duration of the real-time storage data in the database and the data update frequency of the real-time storage data; collecting the data updating deviation probability of real-time storage data in a database; obtaining the type division coefficient of real-time storage data in a database through analysis;
comparing the type division coefficient of the real-time storage data in the database with a type division coefficient threshold value: if the type division coefficient of the real-time storage data in the database exceeds the type division coefficient threshold, judging that the change probability of the corresponding real-time storage data is large, and marking the corresponding real-time storage data as high-frequency writable data; and if the type division coefficient of the real-time storage data in the database does not exceed the type division coefficient threshold, judging that the change probability of the corresponding real-time storage data is small, and marking the corresponding real-time storage data as high-frequency readable data.
As a preferred embodiment of the present invention, the partition storage and storage process in step two is as follows:
correspondingly storing high-frequency writable data and high-frequency readable data in a database in a partitioning manner, dividing the database into a writable area and a readable area, correspondingly storing the high-frequency writable data and the high-frequency readable data to the writable area and the readable area respectively, and analyzing the data stored in the writable area and the readable area after the partitioned storage is finished;
uniformly marking the storage data in the writable area and the readable area as subarea storage data, acquiring the updating frequency of each subarea storage data at the same time and the shortest interval duration of adjacent updating of the subarea storage data, and comparing the updating frequency of each subarea storage data at the same time and the shortest interval duration of adjacent updating of the subarea storage data with an updating frequency threshold and a shortest interval duration threshold respectively:
if the updating frequency of the partition storage data at the same time exceeds the updating frequency threshold value, or the shortest interval duration of adjacent updating of the partition storage data does not exceed the shortest interval duration threshold value, judging that the corresponding partition storage data is high-relevance data; and if the updating frequency of the partition storage data at the same time does not exceed the updating frequency threshold value and the shortest interval duration of adjacent updating of the partition storage data exceeds the shortest interval duration threshold value, judging that the corresponding partition storage data is low-relevance data.
As a preferred embodiment of the present invention, the visit strength analysis process in step three is as follows:
analyzing the access strength of the database, acquiring the corresponding real-time access terminal quantity increasing speed of the database in the access time period and the quantity of access terminals required by the same storage data in the database at the same time, and comparing the quantity increasing speed with the quantity increasing speed threshold with the access terminal quantity threshold respectively:
if the number of the real-time access terminals corresponding to the database in the access time period exceeds the number increase speed threshold, or the number of the access terminals required by the same storage data in the database at the same moment exceeds the access terminal number threshold, judging that the real-time access strength of the database is high, and marking the current database access as high-strength execution; and if the number increase speed of the corresponding real-time access terminals of the database in the access time period does not exceed the number increase speed threshold value, and the number of the access terminals required by the same storage data in the database at the same moment does not exceed the access terminal number threshold value, judging that the real-time access strength of the database is low, and marking the current database access as low-strength execution.
As a preferred embodiment of the present invention, the high-intensity execution process is analyzed, the ratio of the data reading task amount to the data writing task amount and the ratio of the data reading task execution frequency to the data writing task execution frequency in the high-intensity execution process are collected, and the ratios are respectively compared with the task amount ratio threshold range and the execution frequency ratio threshold range:
if the ratio of the data reading task quantity to the data writing task quantity is in the task quantity ratio threshold range and the ratio of the data reading task execution frequency to the data writing task execution frequency is in the execution frequency ratio threshold range in the high-intensity execution process, judging that the balance of the current read-write access task quantity of the database is qualified, generating a balance access signal and sending the balance access signal to a mobile phone terminal of a manager;
if the ratio of the data reading task quantity to the data writing task quantity is not in the task quantity ratio threshold range or the ratio of the data reading task execution frequency to the data writing task execution frequency is not in the execution frequency ratio threshold range in the high-intensity execution process, judging that the balance of the current reading and writing access task quantity of the database is unqualified, generating an unbalanced access signal and sending the unbalanced access signal to a mobile phone terminal of a manager.
In a preferred embodiment of the present invention, the master-slave control analysis process in step four is as follows:
acquiring the frequency of data access delay and the average duration of the data access delay in the database access process, and comparing the frequency of the data access delay and the average duration of the data access delay in the database access process with a delay frequency threshold and an average duration threshold respectively:
if the frequency of data access delay exceeds a delay frequency threshold value or the average duration of the data access delay exceeds an average duration threshold value in the database access process, judging that the database access delay exists, generating an access delay signal and sending the access delay signal to a mobile phone terminal of a manager; and if the frequency of data access delay does not exceed the delay frequency threshold and the average duration of the data access delay does not exceed the average duration threshold in the database access process, judging that no delay exists in the database access, generating an access non-delay signal and sending the access non-delay signal to a mobile phone terminal of a manager.
Compared with the prior art, the invention has the beneficial effects that:
1. the real-time storage data are subjected to type division, read-write type division is carried out according to the characteristics of the real-time storage data, data are stored in a partitioned mode according to different types of read-write, the efficiency of database data storage is improved, the stability of database access is improved, and the problem that data access is deviated due to data access delay and the storage efficiency of a database is reduced is solved; after the real-time storage data in the database are stored in a partitioned manner, the relevance analysis is carried out on the data stored in the readable area and the writable area, so that the timeliness of the supply of the storage data can be ensured when the data stored in the readable area and the writable area need to be used simultaneously, and the problem that the data storage efficiency of the database is low and the data execution efficiency is influenced due to the fact that the data is not supplied timely in the reading and writing process is avoided;
2. in the invention, the current access strength of the database is analyzed and monitored, and the access strength of the current database is judged, so that data scheduling can be carried out in time when the database is accessed, the deviation of database operation caused by the large access strength is prevented, the working efficiency of the database is reduced, and meanwhile, after the strength analysis is finished, the read-write task quantity in the access task is subjected to balance analysis, so that a standard is provided for master-slave control, and unqualified storage resource matching caused in the read-write task quantity difference process is also prevented; the method comprises the steps of analyzing a data execution process during real-time access of a database, judging whether the data execution process has delay or not, accordingly ensuring reliability of data execution, preventing use quality of the database from being reduced, and simultaneously carrying out master-slave control analysis on a corresponding database according to whether the delay exists or not, carrying out master-slave execution reasonably, ensuring data execution qualification of the database, and reducing data access execution risk of the database to the minimum.
Drawings
In order to facilitate understanding for those skilled in the art, the present invention will be further described with reference to the accompanying drawings.
Fig. 1 is a flowchart of a distributed data read-write processing method according to the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Referring to fig. 1, a distributed data read-write processing method includes the following specific steps:
analyzing stored data, namely analyzing the real-time stored data in a database, performing type division on the real-time stored data, performing read-write type division according to the characteristics of the real-time stored data, and performing data partition storage according to different types of read-write, so that the efficiency of data storage of the database is improved, the stability of data access is improved, and the problem that the data access is deviated due to data access delay to reduce the storage efficiency of the database is solved;
step two, storage in a partition mode, namely after the real-time storage data in the database are stored in the partition mode, relevance analysis is carried out on the data stored in the readable area and the writable area, so that when the data stored in the readable area and the writable area need to be used simultaneously, timeliness of the stored data can be guaranteed, and the problem that the data storage efficiency of the database is low and the data execution efficiency is influenced due to untimely data supply in the reading and writing process is avoided;
analyzing and monitoring the current access strength of the database, and judging the access strength of the current database, so that data scheduling can be performed in time during database access, the deviation of database operation caused by the high access strength is prevented, the working efficiency of the database is reduced, and meanwhile, after the strength analysis is completed, the read-write task quantity in the access task is subjected to balance analysis, so that a standard is provided for master-slave control, and unqualified storage resource matching caused in the read-write task quantity difference process is also prevented;
step four, master-slave control analysis, namely analyzing the data execution process during real-time access of the database and judging whether the data execution process is delayed or not, so that the reliability of data execution is ensured, the use quality of the database is prevented from being reduced, meanwhile, master-slave control analysis is carried out on the corresponding database according to whether the delay exists or not, master-slave execution is reasonably carried out, the data execution qualification of the database is ensured, and the data access execution risk of the database is reduced to the minimum;
the specific process of analyzing the stored data in the first step is as follows:
setting a label i of real-time storage data in a database, wherein the label i is a natural number greater than 1, acquiring the shortest update interval duration of the real-time storage data in the database and the data update frequency of the real-time storage data, and respectively marking the shortest update interval duration of the real-time storage data in the database and the data update frequency of the real-time storage data as HGSi and GPLi; collecting the data updating deviation probability of the real-time storage data in the database, and marking the data updating deviation probability of the real-time storage data in the database as PGLi;
by the formula
Figure BDA0004022806680000071
Acquiring a type division coefficient Xi of real-time storage data in a database, wherein a1, a2 and a3 are preset proportionality coefficients, a1 is greater than a2 and greater than a3 and greater than 0, and beta is an error correction factor and takes the value of 0.9875;
comparing the type division coefficient Xi of the real-time storage data in the database with a type division coefficient threshold value:
if the type division coefficient Xi of the real-time storage data in the database exceeds the type division coefficient threshold, judging that the change probability of the corresponding real-time storage data is high, and marking the corresponding real-time storage data as high-frequency writable data; if the type division coefficient Xi of the real-time storage data in the database does not exceed the type division coefficient threshold, judging that the change probability of the corresponding real-time storage data is small, and marking the corresponding real-time storage data as high-frequency readable data;
the storage process of the partition in the second step is as follows:
correspondingly storing the high-frequency writable data and the high-frequency readable data in the database in a partitioned manner, dividing the database into a writable area and a readable area, correspondingly storing the high-frequency writable data and the high-frequency readable data in the writable area and the readable area respectively, and analyzing the data stored in the writable area and the readable area after the partitioned storage is finished;
uniformly marking the storage data in the writable area and the readable area as subarea storage data, acquiring the updating frequency of the subarea storage data at the same time and the shortest interval duration of the adjacent updating of the subarea storage data, and comparing the updating frequency of the subarea storage data at the same time and the shortest interval duration of the adjacent updating of the subarea storage data with an updating frequency threshold and a shortest interval duration threshold respectively: the updating shortest interval duration is obtained by averaging according to a plurality of updating interval durations;
if the updating frequency of the partition storage data at the same time exceeds the updating frequency threshold value, or the shortest interval duration of adjacent updating of the partition storage data does not exceed the shortest interval duration threshold value, judging that the corresponding partition storage data is high-relevance data; if the updating frequency of the partition storage data at the same time does not exceed the updating frequency threshold value and the shortest interval duration of adjacent updating of the partition storage data exceeds the shortest interval duration threshold value, judging that the corresponding partition storage data is low-relevance data;
when a database is accessed, if real-time access data needs to be read and written, data transmission channel occupation is carried out on partition storage data in different areas, namely after the current partition storage data is accessed, a real-time access terminal still needs to access associated data, the corresponding high-association data is transmitted to the real-time access terminal in real time, and the problem that network congestion is easily caused when the access intensity is high and the access quality is influenced because the associated data cannot be obtained in time during access is avoided;
the visit strength analysis process in step three is as follows:
analyzing the access strength of the database, acquiring the increase speed of the number of the real-time access terminals corresponding to the database in the access time period and the number of the access terminals required for the same storage data in the database at the same time, and comparing the increase speed of the number of the real-time access terminals corresponding to the database in the access time period and the number of the access terminals required for the same storage data in the database at the same time with a number increase speed threshold and an access terminal number threshold respectively:
if the number of the real-time access terminals corresponding to the database in the access time period exceeds the number increase speed threshold, or the number of the access terminals required by the same storage data in the database at the same moment exceeds the access terminal number threshold, judging that the real-time access strength of the database is high, and marking the current database access as high-strength execution; if the number increase speed of the corresponding real-time access terminals of the database in the access time period does not exceed the number increase speed threshold value, and the number of the access terminals required by the same storage data in the database at the same moment does not exceed the access terminal number threshold value, judging that the real-time access strength of the database is low, and marking the current database access as low-strength execution;
analyzing the high-intensity execution process, acquiring the ratio of the data reading task quantity to the data writing task quantity and the ratio of the data reading task execution frequency to the data writing task execution frequency in the high-intensity execution process, and comparing the ratio of the data reading task quantity to the data writing task quantity and the ratio of the data reading task execution frequency to the data writing task execution frequency in the high-intensity execution process with a task quantity ratio threshold range and an execution frequency ratio threshold range respectively:
if the ratio of the data reading task amount to the data writing task amount in the high-intensity execution process is within the task amount ratio threshold range, and the ratio of the data reading task execution frequency to the data writing task execution frequency is within the execution frequency ratio threshold range, judging that the current read-write access task amount balance of the database is qualified, generating a balance access signal and sending the balance access signal to a mobile phone terminal of a manager;
if the ratio of the data reading task quantity to the data writing task quantity is not in the task quantity ratio threshold range or the ratio of the data reading task execution frequency to the data writing task execution frequency is not in the execution frequency ratio threshold range in the high-intensity execution process, judging that the balance of the current read-write access task quantity of the database is unqualified, generating an unbalanced access signal and sending the unbalanced access signal to a mobile phone terminal of a manager; after receiving the unbalanced access signal, the manager performs master-slave control on the access area corresponding to the database;
the master-slave control analysis process in the fourth step is as follows:
acquiring the frequency of data access delay and the average duration of the data access delay in the database access process, and comparing the frequency of the data access delay and the average duration of the data access delay in the database access process with a delay frequency threshold and an average duration threshold respectively:
if the frequency of data access delay exceeds a delay frequency threshold value or the average duration of the data access delay exceeds an average duration threshold value in the database access process, judging that the database access delay exists, generating an access delay signal and sending the access delay signal to a mobile phone terminal of a manager;
if the frequency of data access delay in the database access process does not exceed the delay frequency threshold and the average duration of the data access delay does not exceed the average duration threshold, judging that no delay exists in the database access, generating an access non-delay signal and sending the access non-delay signal to a mobile phone terminal of a manager;
the manager receives the access delay signal and performs master-slave control on the corresponding access area; the access areas needing master-slave control are marked as control areas, and all access nodes in the control areas are subjected to decentralized processing, namely each access node can independently receive access requirements and automatically execute the access requirements after receiving the access requirements, so that the stable execution of the current access task is facilitated, and the reduction of the database operation efficiency caused by the task quantity intensity is prevented; if no delay exists in the control area or the task quantity balance is qualified, setting a main node for each access node in the control area, namely receiving the access requirement by the main node, sending the access requirement to other access nodes after judging that the access requirement can be executed, and sending execution feedback to the main node after the access nodes finish executing; the security of the database is ensured, and the traceability of data access is improved.
The formulas are obtained by acquiring a large amount of data and performing software simulation, and the coefficients in the formulas are set by the technicians in the field according to actual conditions;
when the data partitioning storage system is used, stored data are analyzed, real-time stored data in a database are analyzed, the real-time stored data are subjected to type division, read-write type division is carried out according to the characteristics of the real-time stored data, and data partitioning storage is carried out according to different types of read-write; the data storage method comprises the steps of partitioning storage, namely performing the partition storage on real-time storage data in a database, and performing relevance analysis on data stored in a readable area and a writable area; analyzing the access intensity, namely analyzing and monitoring the current access intensity of the database, and simultaneously performing balance analysis on the read-write task quantity in the access task after the intensity analysis is finished; and the master-slave control analysis is used for analyzing the data execution process during real-time access of the database, judging whether the data execution process has delay or not, and simultaneously carrying out master-slave control analysis on the corresponding database according to whether the delay exists or not.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best understand the invention for and utilize the invention. The invention is limited only by the claims and their full scope and equivalents.

Claims (6)

1. A distributed data read-write processing method is characterized by comprising the following steps:
analyzing the stored data, namely analyzing the real-time stored data in the database, performing type division on the real-time stored data, performing read-write type division according to the characteristics of the real-time stored data, and performing data partition storage according to different types of read-write;
step two, storage in a partitioning mode, namely after the real-time storage data in the database are stored in the partitioning mode, relevance analysis is carried out on the data stored in the readable area and the writable area;
analyzing the access intensity, namely analyzing and monitoring the current access intensity of the database, and simultaneously performing balance analysis on the read-write task quantity in the access task after the intensity analysis is finished;
and step four, master-slave control analysis, namely analyzing the data execution process during real-time access of the database, judging whether the data execution process has delay, and simultaneously carrying out master-slave control analysis on the corresponding database according to whether the delay exists.
2. The distributed data read-write processing method according to claim 1, wherein the specific process of the stored data analysis in the first step is as follows:
setting a label i for real-time storage data in a database, wherein the label i is a natural number greater than 1, and acquiring the shortest update interval duration of the real-time storage data in the database and the data update frequency of the real-time storage data; collecting the data updating deviation probability of real-time storage data in a database; obtaining the type division coefficient of real-time storage data in a database through analysis;
comparing the type division coefficient of the real-time storage data in the database with a type division coefficient threshold value: if the type division coefficient of the real-time storage data in the database exceeds the type division coefficient threshold, judging that the change probability of the corresponding real-time storage data is large, and marking the corresponding real-time storage data as high-frequency writable data; and if the type division coefficient of the real-time storage data in the database does not exceed the type division coefficient threshold, judging that the change probability of the corresponding real-time storage data is small, and marking the corresponding real-time storage data as high-frequency readable data.
3. The distributed data read-write processing method according to claim 1, wherein the storage process of the partition storage in the second step is as follows:
correspondingly storing high-frequency writable data and high-frequency readable data in a database in a partitioning manner, dividing the database into a writable area and a readable area, correspondingly storing the high-frequency writable data and the high-frequency readable data to the writable area and the readable area respectively, and analyzing the data stored in the writable area and the readable area after the partitioned storage is finished;
uniformly marking the storage data in the writable area and the readable area as subarea storage data, acquiring the updating frequency of the subarea storage data at the same time and the shortest interval duration of the adjacent updating of the subarea storage data, and comparing the updating frequency of the subarea storage data at the same time and the shortest interval duration of the adjacent updating of the subarea storage data with an updating frequency threshold and a shortest interval duration threshold respectively:
if the updating frequency of the partition storage data at the same time exceeds the updating frequency threshold value, or the shortest interval duration of adjacent updating of the partition storage data does not exceed the shortest interval duration threshold value, judging that the corresponding partition storage data is high-relevance data; and if the updating frequency of the partition storage data at the same time does not exceed the updating frequency threshold value and the shortest interval duration of adjacent updating of the partition storage data exceeds the shortest interval duration threshold value, judging that the corresponding partition storage data is low-relevance data.
4. The distributed data read-write processing method according to claim 1, wherein the access strength analysis process in step three is as follows:
analyzing the access strength of the database, acquiring the corresponding real-time access terminal quantity increasing speed of the database in the access time period and the quantity of access terminals required by the same storage data in the database at the same time, and comparing the quantity increasing speed with the quantity increasing speed threshold with the access terminal quantity threshold respectively:
if the number of the real-time access terminals corresponding to the database in the access time period exceeds the number increase speed threshold, or the number of the access terminals required by the same storage data in the database at the same moment exceeds the access terminal number threshold, judging that the real-time access strength of the database is high, and marking the current database access as high-strength execution; and if the number increase speed of the corresponding real-time access terminals of the database in the access time period does not exceed the number increase speed threshold value, and the number of the access terminals required by the same storage data in the database at the same moment does not exceed the access terminal number threshold value, judging that the real-time access strength of the database is low, and marking the current database access as low-strength execution.
5. The distributed data read-write processing method according to claim 4, wherein the high-intensity execution process is analyzed, a ratio of a data reading task amount to a data writing task amount and a ratio of a data reading task execution frequency to a data writing task execution frequency in the high-intensity execution process are collected, and the ratios are respectively compared with a task amount ratio threshold range and an execution frequency ratio threshold range:
if the ratio of the data reading task quantity to the data writing task quantity is in the task quantity ratio threshold range and the ratio of the data reading task execution frequency to the data writing task execution frequency is in the execution frequency ratio threshold range in the high-intensity execution process, judging that the balance of the current read-write access task quantity of the database is qualified, generating a balance access signal and sending the balance access signal to a mobile phone terminal of a manager;
if the ratio of the data reading task quantity to the data writing task quantity is not in the task quantity ratio threshold range or the ratio of the data reading task execution frequency to the data writing task execution frequency is not in the execution frequency ratio threshold range in the high-intensity execution process, judging that the balance of the current reading and writing access task quantity of the database is unqualified, generating an unbalanced access signal and sending the unbalanced access signal to a mobile phone terminal of a manager.
6. The distributed data read-write processing method according to claim 1, wherein the master-slave control analysis process in step four is as follows:
acquiring the frequency of data access delay and the average duration of the data access delay in the database access process, and comparing the frequency of the data access delay and the average duration of the data access delay in the database access process with a delay frequency threshold and an average duration threshold respectively:
if the frequency of data access delay exceeds a delay frequency threshold value or the average time length of the data access delay exceeds an average time length threshold value in the database access process, judging that the database access delay exists, generating an access delay signal and sending the access delay signal to a mobile phone terminal of a manager; if the frequency of data access delay does not exceed the delay frequency threshold value and the average time length of the data access delay does not exceed the average time length threshold value in the database access process, judging that no delay exists in the database access, generating an access non-delay signal and sending the access non-delay signal to a mobile phone terminal of a manager.
CN202211694412.0A 2022-12-28 2022-12-28 Distributed data read-write processing method Withdrawn CN115934843A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211694412.0A CN115934843A (en) 2022-12-28 2022-12-28 Distributed data read-write processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211694412.0A CN115934843A (en) 2022-12-28 2022-12-28 Distributed data read-write processing method

Publications (1)

Publication Number Publication Date
CN115934843A true CN115934843A (en) 2023-04-07

Family

ID=86650680

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211694412.0A Withdrawn CN115934843A (en) 2022-12-28 2022-12-28 Distributed data read-write processing method

Country Status (1)

Country Link
CN (1) CN115934843A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116489178A (en) * 2023-04-25 2023-07-25 安徽亚高科技有限公司 Method and device for distributed storage of communication information

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116489178A (en) * 2023-04-25 2023-07-25 安徽亚高科技有限公司 Method and device for distributed storage of communication information
CN116489178B (en) * 2023-04-25 2023-09-22 安徽亚高科技有限公司 Method and device for distributed storage of communication information

Similar Documents

Publication Publication Date Title
CN109460349B (en) Test case generation method and device based on log
CN115934843A (en) Distributed data read-write processing method
CN110175165A (en) Transaction account checking method, device, computer equipment and storage medium
CN113572780A (en) Equipment security policy configuration method
CN107870949A (en) Data analysis job dependence relation generation method and system
CN111399828A (en) Model-driven logic device modeling method and terminal
CN111654425B (en) Fault recording information acquisition method based on Modbus protocol and related equipment
CN109446762A (en) Cloud platform access method, device, computer equipment and storage medium
CN116489178B (en) Method and device for distributed storage of communication information
CN110399534B (en) Terminal performance report generation method, device, equipment and storage medium
CN110209534B (en) System and method for automatically backing up mysql database
CN111161064A (en) Processing method and device for blockchain transaction records
CN114884821B (en) Multi-strategy conflict avoiding method in self-intelligent network
CN114529405B (en) Information access management method and system based on intelligent transaction
CN113448747B (en) Data transmission method, device, computer equipment and storage medium
CN111885159B (en) Data acquisition method and device, electronic equipment and storage medium
CN102811154B (en) Resource acquisition method and network server system
CN114116774A (en) Log data query method and device
CN113793063A (en) Method and device for detecting conflict of power distribution network planning project schemes
CN110033189A (en) A kind of fibre core section automatic generation method, device and equipment
CN109067572A (en) Method, device and equipment based on order edlin SNMP configuration file
CN117311257B (en) PLC centralized control method and system applied to cell formation composition
CN115081233B (en) Flow simulation method and electronic equipment
CN115018398B (en) Animation project postponing prediction method, device and system
CN115391052B (en) Robot task processing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20230407

WW01 Invention patent application withdrawn after publication