CN109271453A - A kind of determination method and apparatus of database volume - Google Patents
A kind of determination method and apparatus of database volume Download PDFInfo
- Publication number
- CN109271453A CN109271453A CN201811228120.1A CN201811228120A CN109271453A CN 109271453 A CN109271453 A CN 109271453A CN 201811228120 A CN201811228120 A CN 201811228120A CN 109271453 A CN109271453 A CN 109271453A
- Authority
- CN
- China
- Prior art keywords
- database
- link
- link information
- capacity
- operation log
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3664—Environments for testing or debugging software
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Computer Hardware Design (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application discloses a kind of determination method and apparatus of database volume, this method comprises: the system of acquisition calls the link information of each system in link, the link information is for characterizing information relevant to system operatio；According to the link information of each system, determining has the first system of database manipulation；The first system is obtained to the operation log of database；According to the operation log, the capacity of the database is determined.
Description
Technical field
This application involves field of computer technology more particularly to a kind of determination method and apparatus of database volume.
Background technique
In internet, when providing service for different business, Distributed Services system can be used.Distributed Services
Multiple systems are generally comprised in system, when providing service for business, can call one or more of systems, are called
One or more systems different databases can be operated, and then realize the business.
The called sequencing of system can call link to indicate by system in Distributed Services system, in general, in order to
Service preferably is provided for business, link can be called to carry out pressure test system.Before carrying out pressure test, need really
Determine the capacity that system calls the database of system operatio in link, that is, determines each database that system calls link to be related to
Capacity, to determine the pressure test parameter for calling link to system according to the capacity of database.
However, when determining that system calls the capacity of each database for being related to of link using existing method, often
Wherein one or more databases can be omitted, lead to the capacity that cannot accurately obtain each database, and then can not be effectively
Link is called to carry out pressure test system.
Summary of the invention
The embodiment of the present application provides a kind of determination method and apparatus of database volume, is using existing side for solving
When method determines the capacity for the database that system calls link to be related to, since wherein one or more databases can be omitted, lead
The problem of cause cannot accurately obtain the capacity of each database.
In order to solve the above technical problems, the embodiment of the present application is achieved in that
In a first aspect, proposing a kind of determination method of database volume, comprising:
Acquisition system calls the link information of each system in link, and the link information is for characterizing and system operatio phase
The information of pass；
According to the link information of each system, determining has the first system of database manipulation；
The first system is obtained to the operation log of database；
According to the operation log, the capacity of the database is determined.
Second aspect proposes a kind of determining device of database volume, comprising:
First acquisition unit, obtains the link information that system calls each system in link, and the link information is used for table
Levy information relevant to system operatio；
First determination unit, according to the link information of each system, determining has the first system of database manipulation；
Second acquisition unit obtains the first system to the operation log of database；
Second determination unit determines the capacity of the database according to the operation log.
The third aspect, proposes a kind of electronic equipment, which includes:
Processor；And
It is arranged to the memory of storage computer executable instructions, which makes the processor when executed
Execute following operation:
Acquisition system calls the link information of each system in link, and the link information is for characterizing and system operatio phase
The information of pass；
According to the link information of each system, determining has the first system of database manipulation；
The first system is obtained to the operation log of database；
According to the operation log, the capacity of the database is determined.
Fourth aspect, proposes a kind of computer readable storage medium, the computer-readable recording medium storage one or
Multiple programs, one or more of programs are when the electronic equipment for being included multiple application programs executes, so that the electronics
Equipment executes following methods:
Acquisition system calls the link information of each system in link, and the link information is for characterizing and system operatio phase
The information of pass；
According to the link information of each system, determining has the first system of database manipulation；
The first system is obtained to the operation log of database；
According to the operation log, the capacity of the database is determined.
The embodiment of the present application use at least one above-mentioned technical solution can reach it is following the utility model has the advantages that
Technical solution provided by the embodiments of the present application, in the capacity for the database that the system that determines calls link to be related to,
Since available system calls the link information of each system in link, and determine that there is database manipulation according to link information
System, it can thus be avoided system omit the problem of；After determining the system with database manipulation, due to can basis
These systems determine the capacity of database to the operation log of database, therefore, the problem of can not only being omitted to avoid database,
The capacity for each database that system calls link to be related to can also accurately be obtained；Link is called to be related in the system that obtains
After the capacity of each database, the accurate pressure test parameter that link is called to system can be further obtained, in turn
Effectively link is called to carry out pressure test system.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The some embodiments recorded in application, for those of ordinary skill in the art, in the premise of not making the creative labor property
Under, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is the flow diagram of the determination method of one embodiment database volume of the application；
Fig. 2 is that one embodiment system of the application calls the schematic diagram of link；
Fig. 3 is that one embodiment system of the application calls the schematic diagram of link；
Fig. 4 is the schematic diagram of the system calling link after one embodiment of the application is cut；
Fig. 5 is the flow diagram of the determination method of one embodiment database volume of the application；
Fig. 6 is the structural schematic diagram of one embodiment electronic equipment of the application；
Fig. 7 is the structural schematic diagram of the determining device of one embodiment database volume of the application.
Specific embodiment
Distributed Services system can call internal multiple systems, called is multiple when providing service for business
System can be written and read database, to realize the business.By taking internet business as an example, provided for internet business
When service, the system for receiving transaction request, the system for storing user information, the branch for being paid can be called
System, the system for recording payment information, system for recording transaction journal number etc. are paid, when calling these systems, no
Same system can be written and read different databases, to complete internet business.
The called sequencing of system can call link to indicate by system in distribution service, in general, in order to
Service preferably is provided for business, link can be called to carry out pressure test system, especially before peak traffic arrival
Pressure test is carried out, in this way, can determine that system calls whether link can provide stable service for business.
Before carrying out pressure test, it is thus necessary to determine that system calls the capacity of each database of system operatio in link,
Determine the capacity for each database that system calls link to be related to.In the prior art, it is true to generally use artificial method
The capacity of fixed each database.Specifically, the system of calling service and the database of these system operatios can be artificially collected
Etc. information, the capacity of each database for calling link to be related to based on these information determining systems.
However, in practical applications, the one or more data for falling system operatio are often omitted using artificial method
Library leads to not the capacity of database being missed, and then effectively link can not be called to carry out pressure survey to system
Examination.Wherein, in terms of the omission problem of database is mainly reflected in following two:
First, it omits system and calls one or more systems with database manipulation in link, lead to missing data
Library.
For example, system, which is called, actually there are 3 systems in link, but wherein 2 systems are manually only collected into, omit 1
A system can omit one or more databases of the system operatio if the system being missed has database manipulation.
Second, some system in link is called for system, omits one or more databases of the system operatio.
For example, system has actually carried out read-write operation to 3 databases, but wherein 2 databases are only manually collected into,
Cause to omit 1 database.
In the case where omitting database, on the one hand, will be unable to the capacity of database being missed, another party
Face, if the capacity for the database being missed is lower, in the subsequent calling link progress pressure test to system, due to
Pressure test parameter is obtained based on the higher database determination of other capacity, therefore, for the database being missed,
The magnitude of pressure test parameter can be more than the maximum that database is able to bear, and cause database to collapse under pressure, when pressure test ring
When border is environment on line, the business of also resulting in goes wrong.
It can be seen that the method for existing determining database volume cannot accurately obtain system call link be related to it is every
The capacity of a database, to not can be effectively carried out subsequent pressure test.
In order to solve the above-mentioned technical problem, the embodiment of the present application provides a kind of determination method and apparatus of database volume,
This method comprises: the system of acquisition calls the link information of each system in link, the link information is grasped for characterizing with system
Make relevant information；According to the link information of each system, determining has the first system of database manipulation；Described in acquisition
Operation log of the first system to database；According to the operation log, the capacity of the database is determined.
Technical solution provided by the embodiments of the present application at least can achieve it is following the utility model has the advantages that
(1) when the capacity for the database for calling link to be related in the system that determines, since available system calls link
In each system link information, and according to link information determine have database manipulation system, it can thus be avoided system
The problem of omission；
(2) after determining the system with database manipulation, due to can be according to these systems to the operation day of database
Will determines the capacity of database, therefore, the problem of can not only omitting to avoid database, can also accurately obtain system call chain
The capacity for each database that road is related to；
(3) it after each database volume that the system that obtains calls link to be related to, can further obtain to system
The accurate pressure test parameter of link is called, and then effectively calls link to carry out pressure test system.
In order to make those skilled in the art better understand the technical solutions in the application, below in conjunction with the application reality
The attached drawing in example is applied, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described implementation
Example is merely a part but not all of the embodiments of the present application.Based on the embodiment in the application, this field is common
The application protection all should belong in technical staff's every other embodiment obtained without creative efforts
Range.
The Distributed Services system recorded in the embodiment of the present application may include multiple systems, and can be Internet service
Service is provided.Distributed Services system can call internal one or more systems, these are when providing service for business
The called sequencing of system can call link to indicate by system, wherein these systems can be to different numbers when called
It is written and read according to library, all databases of these system operatios can be considered as the data that the system calls link to be related to
Library.
The capacity of database may include following at least one: the maximum storage of database, database is in high concurrent field
The maximum number of connections that can be supported under scape, wherein the maximum number of connections can be understood as connecting with database simultaneously
The maximum quantity of system.
It should be understood that the capacity of database also may include other indexs of database, such as tps in other implementations
(transaction per second, the transactions of execution per second) peak value, tps mean value etc., no longer illustrates one by one here
It is bright.
The technical solution of the offer of the embodiment of the present application can be applied to the application of the Distributed Services system of above-mentioned record
In scene, and the capacity for each database that system calls link to be related in Distributed Services system is accurately obtained, in addition,
It can be applied to it needs to be determined that also no longer being illustrated one by one here in the other application scenarios of database volume.
Below in conjunction with attached drawing, the technical scheme provided by various embodiments of the present application will be described in detail.
Fig. 1 is the flow diagram of the determination method of one embodiment database volume of the application.The present embodiment is answered
It can be the Distributed Services system of above-mentioned record with scene, the method is as described below.
S102: the link information that system calls each system in link is obtained.
In S102, the capacity for each database that system calls link to be related in determining Distributed Services system
When, the available system calls the link information of each system in link.
The system calls link that can characterize in Distributed Services system, provides multiple systems of service for some business
Called sequencing, wherein when providing service for different business, different business can correspond to different system tune
With link, the embodiment of the present application is illustrated so that the corresponding system of a business calls link as an example.
In one implementation, the system calls the structure of link to can be chain structure.
By taking Fig. 2 as an example, in Fig. 2, it includes three nodes in link that system, which is called, and a node can represent a system,
Three nodes can represent tri- systems of A, B, C, and system calls the arrow in link that can characterize called successive suitable of system
Sequence.
In another implementation, the system calls the structure of link to can also be tree.
By taking Fig. 3 as an example.In Fig. 3, system calls link to may include eight nodes, and a node can represent one and be
System, eight nodes can represent eight systems of A, B, C, D, E, F, G, H, and system calls the arrow in link that can characterize system quilt
The sequencing of calling.
It should be understood that system calls the structure of link other than the chain structure of above-mentioned record and tree, can also be
Other structures no longer illustrate one by one here.In practical applications, system calls the structure of link typically more complicated, when
When system calls the structure of link to be chain structure and tree, it is also not necessarily limited to the shape that above-mentioned Fig. 2 or Fig. 3 is recorded.
When the link information can characterize system and be called and execute corresponding operating, information relevant to system operatio.
In the embodiment of the present application, for the system that system is called in link, the link information of the system can be with
Including at least one of system banner, the mark of the database of system operatio, the database manipulation message of system, wherein be
The database manipulation message of system can characterize concrete operations information when system operates database, such as in database
The read-write operation etc. that carries out of some tables of data.
It should be understood that the link information of system can also include other information relevant to system operatio, here no longer one by one
It illustrates.
The embodiment of the present application obtain system call link in each system link information when, may include:
Based on link information gathering system is called, the link information that the system calls each system in link is obtained.
It is described that link information gathering system is called to can be understood as a kind of bottom middleware system for servicing Governance Ability, energy
The operation information of all systems and each system that a collection business is once called enough is buried by log, and business is provided and is adjusted
It is (i.e. described which type of operation sequencing list (the i.e. described system calls link) and each system have been carried out
Link information).
In the embodiment of the present application, for a business, this can be collected based on the calling link information gathering system
The relevant log of business can determine that the corresponding system of system of calling service calls link based on these logs, be based on system
Link is called, it can be from the operation log for obtaining each system in system calling link in these logs, based on each system
Operation log can analyze to obtain the link information that system calls each system in link.
In one implementation, system calls the link information of each system in link can be as follows:
The systematic name of above-mentioned record can be understood as system banner, and data source can be understood as the mark of database, far
Journey recalls information etc. can be understood as information relevant to system operatio.
The method based on above-mentioned record get system call link in each system link information after, can execute
S104。
S104: according to the link information of each system, determining has the first system of database manipulation.
In S104, after the link information that the system that gets calls each system in link, each system can be based on
The link information of system determines one or more systems with database manipulation from multiple systems that system calls link.
In the embodiment of the present application, for the ease of difference, one or more systems with database manipulation can be known as
The first system, based on the link information of each system, determining has the first system of database manipulation, may include:
According to the link information of each system, at least one in link information including database manipulation message is determined
System；
At least one described system is determined as the first system.
Specifically, whether for each system, can analyze in the link information of the system includes database manipulation message,
If so, that is, the system is the system with database manipulation it can be said that the bright system operates database；If
No, it can be said that the bright system does not operate database, i.e., the system is the system without database manipulation.
It, can be using these systems as first system after obtaining that there are one or more systems of database manipulation
System.
It should be understood that can also determine first system with database manipulation by other methods in other implementations
System, for example, can will include at least one system of Database Identification in link information as the first system (chain of system
Include the mark of database in the information of road, may mean that the system has corresponding database manipulation), etc. not another here
One illustrates.
In the embodiment of the present application, since available system calls the link information of each system in link, and according to chain
Road information determine have database manipulation the first system, therefore, can accurately obtain system call link in which system into
Database manipulation is gone, to avoid the problem that system is omitted.
After determining the first system with database manipulation, S106 can be executed.
S106: the first system is obtained to the operation log of database.
In S106, after determining the first system with database manipulation, the first system logarithm can be further obtained
The operation log generated when being operated according to library.In this way, database can be determined in order to the subsequent operation log based on database
Capacity.
In the embodiment of the present application, the operation log of each database of available the first system operation, below with wherein
It is illustrated for one database.
In general, link full dose can be called to obtain based on system when obtaining operation log of the first system to database
Log relevant to system calling link, and the first system is obtained to the operation log of database from the log that full dose obtains.
However, it had both included usually the first system with database manipulation that system, which is called in link, it also include not having number
According to the other systems that library operates, due to not having the log of the system of database manipulation and the subsequent database manipulation day got
Will and determining database volume are unrelated, therefore, in one implementation, in order to simplify the step for obtaining database manipulation log
Suddenly, before obtaining the first system to the operation log of database, the method may include:
The other systems in link in addition to the first system are called to cut the system, after being cut
System calls link.
Other systems other than the first system can be understood as not having database manipulation in system calling link
System, the system due to not having database manipulation have no effect on subsequent step, system can be called in link and not had
There is the system of data manipulation to be cut.
By taking Fig. 4 as an example, in Fig. 4, it includes eight systems of A, B, C, D, E, F, G, H that system, which calls link, wherein system A, C,
D, G and H is the system with database manipulation, and system B, E and F are the system without database manipulation.
In Fig. 4, obtain system A, C, D, G and H respectively to the operation log of database before, can be by system call chain
System B, E and F in road are cropped, and the system after obtaining the only cutting comprising system A, C, D, G and H calls link.
The embodiment of the present application can be obtained and the system tune after cutting after the system after being cut calls link with full dose
With the relevant target journaling of link, since target journaling is log relevant to the first system, can be directly from target
The first system is obtained in log to the operation log of database, to simplify the step of obtaining database manipulation log.
It, can after the operation log that the method based on above-mentioned record gets each database that the first system operates it
To execute S108.
S108: according to the operation log, the capacity of the database is determined.
In S108, each database of the first system operation can be determined according to the operation log obtained in S106
Capacity, be illustrated by taking one of database as an example below.
The capacity of the database may include following at least one: the maximum storage of database, database it is high simultaneously
The maximum number of connections that can be supported under hair scene.Wherein, the maximum storage, which can be understood as database, can store most
Big data quantity, the maximum number of connections can be understood as the maximum quantity for the system that can be connect simultaneously with database.
May include: when determining the capacity of the database according to the operation log
According to the operation log, the access index of the database is determined, the access index includes the database
At least one of the system number of connection, the transactions tps peak value of execution per second and tps mean value；
According to the access index, the capacity of the database is determined.
Specifically, specific access of the system to database can be determined according to the first system to the operation log of database
Situation, and then determine the access index of the database, the access index can be the system number of database connection, database
Tps peak value and at least one of tps mean value, in addition, the access index can also be relevant to database access
Other indexs, for example, the query rate QPS etc. of database, no longer illustrates one by one here.
It should be noted that the access index of database can also be obtained from monitor supervision platform in other implementations
It arrives.Wherein, the monitor supervision platform can be used for being monitored database, when the first system executes database and operates, prison
Controlling platform can be based on the operation log of the first system, the access index analyzing and record the first system to database.In this way,
When determining the capacity of database, corresponding database access index can be obtained from monitor supervision platform.
After determining the access index of database, the capacity of database can be further determined that according to the access index.
In the embodiment of the present application, due to that can determine the capacity of database according to operation log of the system to database, because
On the other hand this can also accurately obtain system and link is called to be related to the problem of on the one hand can omitting to avoid database
The capacity of each database.
In one embodiment of the application, after the capacity for each database that the system that determines calls link to be related to,
It can be according to the capacity of database and the changing rule of business, capacity of the forecast database in future time.
For example, the tps peak value of database A is 200,000, business will increase within following certain time according to the ratio of 1:1.5
Long, it is possible to predict within this following time, it is 300,000 that the tps peak value of database A, which can achieve,.
In this way, can be provided accurately and effectively for assessment database by capacity of the forecast database in future time
Data, while the capacity planning for key index in database provides data supporting.
In another embodiment of the application, in the capacity for each database that the system that determines calls link to be related to
Afterwards, the pressure test conditions that link can also be called according to the capacity of database and to the system, determine to system call chain
The pressure test parameter on road, and call link to carry out pressure test system based on pressure test parameter.
In this way, due to system call each database in link capacity can method based on above-mentioned record it is accurate
It arrives, therefore, the pressure test parameter obtained based on database volume is also more accurate, to can be had based on pressure test parameter
Link is called to carry out pressure test system in effect ground.
Technical solution provided by the embodiments of the present application, in the capacity for the database that the system that determines calls link to be related to,
Since available system calls the link information of each system in link, and determine that there is database manipulation according to link information
System, it can thus be avoided system omit the problem of；After determining the system with database manipulation, due to can basis
These systems determine the capacity of database to the operation log of database, therefore, the problem of can not only being omitted to avoid database,
The capacity for each database that system calls link to be related to can also accurately be obtained；Link is called to be related in the system that obtains
After the capacity of each database, the accurate pressure test parameter that link is called to system can be further obtained, in turn
Effectively link is called to carry out pressure test system.
Entire technical solution in order to facilitate understanding, may refer to Fig. 5.Fig. 5 is one embodiment data storage capacity of the application
The flow diagram of method for determination of amount.The method is as described below.
S501: the link information that system calls each system in link is obtained.
In S510, the chain that system calls each system in link can be obtained based on link information gathering system is called
Road information, it is described to call the calling link information search system recorded in link information gathering system and above-mentioned embodiment illustrated in fig. 1
It unites identical, explanation is not repeated herein.
The link information recorded in the link information and embodiment illustrated in fig. 1 is identical, can characterize and system operatio phase
The information of pass, for a system, the link information of the system may include system banner, the mark of the database of system operatio
And at least one of database manipulation message of system.
Specifically, it can be called according to business, the system for obtaining the business based on the calling link information gathering system
Link, it is also possible to get the link information that system calls each system in link.Wherein, the system calls link
Structure can be chain structure, be also possible to tree, specifically may refer to Fig. 2 or Fig. 3, explanation is not repeated herein.
In the embodiment of the present application, for different business, arrive based on the calling link information gathering system is available
Different systems calls link and different link informations, is only illustrated by taking a business as an example here.
S502: according to the link information of each system, determining has the first system of database manipulation.
In S502, the link information of each system in link is called according to system, can there will be number in link information
According to one or more systems of library operation information as the first system with database manipulation.
In addition it is also possible to using one or more systems in link information with Database Identification as with database behaviour
The first system of work.
S503: it calls the other systems in link in addition to the first system to cut the system, is cut out
System after cutting calls link.
It usually may include the system with database manipulation that system, which is called in link, also may include not having database
The system of operation, due to do not have database manipulation system log and the subsequent database manipulation log got and really
It is unrelated to determine database volume, therefore, the system without database manipulation can be cropped, with the subsequent acquisition database behaviour of simplification
The step of making log.
S504: link is called based on the system after cutting, obtains the first system to the operation log of database.
In S504, operation log of the available the first system to each database.
By taking a database as an example, target day relevant to the system calling link after the cutting can be obtained first
Secondly will obtains the first system to the operation log of database from the target journaling.
S505: according to the operation log, the access index of the database is determined.
By taking a database as an example, the access index includes the system number of the database connection, execution per second
At least one of transactions tps peak value and tps mean value, the access index can be based on the operation logs of database point
Analysis obtains.
It should be noted that can also directly refer to from the access that monitor supervision platform obtains database in other implementations
Mark, wherein the monitor supervision platform can the operation log based on database the access situation of database is monitored, and be based on
The operation log analysis of database and the access index of database of record.
S506: according to the access index, the capacity of the database is determined.
It is illustrated for the capacity of the above-mentioned database for calling link to be related to by a determining system, in practical application
In, different business can correspond to different systems and call link, call link for each system, determining what it was related to
When the capacity of each database, it can be obtained by the determination of the method for above-mentioned record, explanation is not repeated herein.
After the capacity for each database that the system that determines calls link to be related to, in one implementation, Ke Yigen
According to the capacity of database and the changing rule of business, capacity of the forecast database in future time；In another realization side
In formula, the pressure test conditions of link can be called according to the capacity of data volume and to system, determine pressure test parameter, and
It calls link to carry out pressure test system based on pressure test parameter, specifically may refer to the interior of embodiment illustrated in fig. 1 record
Hold, is all not repeated to illustrate here.
Technical solution provided by the embodiments of the present application, in the capacity for the database that the system that determines calls link to be related to,
On the one hand the problem of omitting with database can be omitted to avoid system, on the other hand the evaluation measures of tool can also be provided,
Accurately obtain the capacity for each database that system calls link to be related to.In every number that the system that obtains calls link to be related to
After the capacity in library, the accurate pressure test parameter that link is called to system can be further obtained, and then effectively
Link is called to carry out pressure test system.
It is above-mentioned that the application specific embodiment is described.Other embodiments are within the scope of the appended claims.
In some cases, the movement recorded in detail in the claims or step can be executed according to the sequence being different from embodiment
And desired result still may be implemented.In addition, process depicted in the drawing not necessarily require the particular order shown or
Person's consecutive order is just able to achieve desired result.In some embodiments, multitasking and parallel processing are also possible
Or it may be advantageous.
Fig. 6 is the structural schematic diagram of one embodiment electronic equipment of the application.Referring to FIG. 6, in hardware view, the electricity
Sub- equipment includes processor, optionally further comprising internal bus, network interface, memory.Wherein, memory may be comprising interior
It deposits, such as high-speed random access memory (Random-Access Memory, RAM), it is also possible to further include non-volatile memories
Device (non-volatile memory), for example, at least 1 magnetic disk storage etc..Certainly, which is also possible that other
Hardware required for business.
Processor, network interface and memory can be connected with each other by internal bus, which can be ISA
(Industry Standard Architecture, industry standard architecture) bus, PCI (Peripheral
Component Interconnect, Peripheral Component Interconnect standard) bus or EISA (Extended Industry Standard
Architecture, expanding the industrial standard structure) bus etc..The bus can be divided into address bus, data/address bus, control always
Line etc..Only to be indicated with a four-headed arrow in Fig. 6, it is not intended that an only bus or a type of convenient for indicating
Bus.
Memory, for storing program.Specifically, program may include program code, and said program code includes calculating
Machine operational order.Memory may include memory and nonvolatile memory, and provide instruction and data to processor.
Processor is from the then operation into memory of corresponding computer program is read in nonvolatile memory, in logical layer
The determining device of database volume is formed on face.Processor executes the program that memory is stored, and is specifically used for executing following
Operation:
Acquisition system calls the link information of each system in link, and the link information is for characterizing and system operatio phase
The information of pass；
According to the link information of each system, determining has the first system of database manipulation；
The first system is obtained to the operation log of database；
According to the operation log, the capacity of the database is determined.
The method that the determining device of database volume disclosed in the above-mentioned embodiment illustrated in fig. 6 such as the application executes can be applied
It is realized in processor, or by processor.Processor may be a kind of IC chip, the processing capacity with signal.
During realization, each step of the above method can pass through the integrated logic circuit or software form of the hardware in processor
Instruction complete.Above-mentioned processor can be general processor, including central processing unit (Central Processing
Unit, CPU), network processing unit (Network Processor, NP) etc.；It can also be digital signal processor (Digital
Signal Processor, DSP), specific integrated circuit (Application Specific Integrated Circuit,
ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic
Device, discrete gate or transistor logic, discrete hardware components.It may be implemented or execute the public affairs in the embodiment of the present application
Each method, step and the logic diagram opened.General processor can be microprocessor or the processor be also possible to it is any often
The processor etc. of rule.The step of method in conjunction with disclosed in the embodiment of the present application, can be embodied directly in hardware decoding processor and hold
Row complete, or in decoding processor hardware and software module combine execute completion.Software module can be located at deposits at random
Reservoir, flash memory, read-only memory, this fields such as programmable read only memory or electrically erasable programmable memory, register
In mature storage medium.The storage medium is located at memory, and processor reads the information in memory, completes in conjunction with its hardware
The step of above method.
The method that the electronic equipment can also carry out Fig. 1 and Fig. 5, and realize the determining device of database volume in Fig. 1 and Fig. 5
Function in illustrated embodiment, details are not described herein for the embodiment of the present application.
Certainly, other than software realization mode, other implementations are not precluded in the electronic equipment of the application, for example patrol
Collect device or the mode of software and hardware combining etc., that is to say, that the executing subject of following process flow is not limited to each patrol
Unit is collected, hardware or logical device are also possible to.
The embodiment of the present application also proposed a kind of computer readable storage medium, the computer-readable recording medium storage one
A or multiple programs, the one or more program include instruction, and the instruction is when by the portable electronic including multiple application programs
When equipment executes, the method that the portable electronic device can be made to execute Fig. 1 and embodiment illustrated in fig. 5, and be specifically used for executing
It operates below:
Acquisition system calls the link information of each system in link, and the link information is for characterizing and system operatio phase
The information of pass；
According to the link information of each system, determining has the first system of database manipulation；
The first system is obtained to the operation log of database；
According to the operation log, the capacity of the database is determined.
Fig. 7 is the structural schematic diagram of the determining device 70 of one embodiment database volume of the application.Referring to FIG. 7,
In a kind of Software Implementation, the determining device 70 of the database volume can include: first acquisition unit 71, first determines
Unit 72, second acquisition unit 73 and the second determination unit 74, in which:
First acquisition unit 71, obtains the link information that system calls each system in link, and the link information is used for
Characterize information relevant to system operatio；
First determination unit 72, according to the link information of each system, determining has the first system of database manipulation
System；
Second acquisition unit 73 obtains the first system to the operation log of database；
Second determination unit 74 determines the capacity of the database according to the operation log.
Optionally, for the system call link in a system, the link information of the system include with down toward
Few one kind:
The system banner of the system；
The mark of the database of the system operatio；
The database manipulation message of the system, the database manipulation message is for characterizing the system to database
Concrete operations.
Optionally, first determination unit 72, according to the link information of each system, determining has database behaviour
The first system of work, comprising:
According to the link information of each system, at least one in link information including database manipulation message is determined
System；
At least one described system is determined as the first system.
Optionally, the determining device 70 of the database volume further include: cut unit 75, in which:
The cutting unit 75 obtains the first system to the operation log of database in the second acquisition unit 73
Before, the other systems in link in addition to the first system are called to cut the system, after being cut is
System calls link；
Wherein, the second acquisition unit 73 obtains the first system to the operation log of database, comprising:
Obtain target journaling relevant to the system calling link after the cutting；
The first system is obtained from the target journaling to the operation log of database.
Optionally, second determination unit 74 determines the capacity of the database according to the operation log, comprising:
According to the operation log, the access index of the database is determined, the access index includes the database
At least one of the system number of connection, the transactions tps peak value of execution per second and tps mean value；
According to the access index, the capacity of the database is determined.
Optionally, the first acquisition unit 71 obtains the link information that system calls each system in link, comprising:
Based on link information gathering system is called, the link information that the system calls each system in link is obtained.
Optionally, the determining device 70 of the database volume further include: predicting unit 76, in which:
The predicting unit 76 determines the database in second determination unit 74 according to the operation log
After capacity, according to the capacity of the database and the changing rule of the business, predict the database in future time
Capacity.
Optionally, the determining device 70 of the database volume further include: pressure test unit 77, in which:
The pressure test unit 77 determines the data in second determination unit 74 according to the operation log
After the capacity in library, the pressure test conditions of link are called according to the capacity of the data volume and to the system, determine pressure
Test parameter；
Based on the pressure test parameter, link is called to carry out pressure test the system.
The method that the determining device 70 of database volume provided by the embodiments of the present application can also carry out Fig. 1 and Fig. 5, and realize
The determining device of database volume is in the function of Fig. 1 and embodiment illustrated in fig. 5, and details are not described herein for the embodiment of the present application.
In short, being not intended to limit the protection scope of the application the foregoing is merely the preferred embodiment of the application.
Within the spirit and principles of this application, any modification, equivalent replacement, improvement and so on should be included in the application's
Within protection scope.
System, device, module or the unit that above-described embodiment illustrates can specifically realize by computer chip or entity,
Or it is realized by the product with certain function.It is a kind of typically to realize that equipment is computer.Specifically, computer for example may be used
Think personal computer, laptop computer, cellular phone, camera phone, smart phone, personal digital assistant, media play
It is any in device, navigation equipment, electronic mail equipment, game console, tablet computer, wearable device or these equipment
The combination of equipment.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM),
Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices
Or any other non-transmission medium, can be used for storage can be accessed by a computing device information.As defined in this article, it calculates
Machine readable medium does not include temporary computer readable media (transitory media), such as the data-signal and carrier wave of modulation.
It should also be noted that, the terms "include", "comprise" or its any other variant are intended to nonexcludability
It include so that the process, method, commodity or the equipment that include a series of elements not only include those elements, but also to wrap
Include other elements that are not explicitly listed, or further include for this process, method, commodity or equipment intrinsic want
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including described want
There is also other identical elements in the process, method of element, commodity or equipment.
Various embodiments are described in a progressive manner in the application, same and similar part between each embodiment
It may refer to each other, each embodiment focuses on the differences from other embodiments.Implement especially for system
For example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method
Part illustrates.
Claims (11)
1. a kind of determination method of database volume, comprising:
Acquisition system calls the link information of each system in link, and the link information is relevant to system operatio for characterizing
Information；
According to the link information of each system, determining has the first system of database manipulation；
The first system is obtained to the operation log of database；
According to the operation log, the capacity of the database is determined.
2. the method as described in claim 1 calls a system in link, the link letter of the system for the system
Breath comprises at least one of the following:
The system banner of the system；
The mark of the database of the system operatio；
The database manipulation message of the system, the database manipulation message is for characterizing the system to the specific of database
Operation.
3. method according to claim 2, according to the link information of each system, determining has the of database manipulation
One system, comprising:
According to the link information of each system, determines in link information and be including at least one of database manipulation message
System；
At least one described system is determined as the first system.
4. the method as described in claim 1, before obtaining the first system to the operation log of database, the method
Further include:
The other systems in link in addition to the first system are called to cut the system, the system after being cut
Call link；
Wherein, the first system is obtained to the operation log of database, comprising:
Obtain target journaling relevant to the system calling link after the cutting；
The first system is obtained from the target journaling to the operation log of database.
5. the method as described in claim 1 determines the capacity of the database according to the operation log, comprising:
According to the operation log, determine that the access index of the database, the access index include the database connection
System number, execution per second transactions tps peak value and at least one of tps mean value；
According to the access index, the capacity of the database is determined.
6. the method as described in claim 1 obtains the link information that system calls each system in link, comprising:
Based on link information gathering system is called, the link information that the system calls each system in link is obtained.
7. the method as described in claim 1, according to the operation log, after the capacity for determining the database, the side
Method further include:
According to the capacity of the database and the changing rule of the business, appearance of the database in future time is predicted
Amount.
8. the method as described in claim 1, according to the operation log, after the capacity for determining the database, the side
Method further include:
The pressure test conditions that link is called according to the capacity of the data volume and to the system determine that pressure test is joined
Number；
Based on the pressure test parameter, link is called to carry out pressure test the system.
9. a kind of determining device of database volume, comprising:
First acquisition unit, obtain system call link in each system link information, the link information for characterize with
The relevant information of system operatio；
First determination unit, according to the link information of each system, determining has the first system of database manipulation；
Second acquisition unit obtains the first system to the operation log of database；
Second determination unit determines the capacity of the database according to the operation log.
10. a kind of electronic equipment, comprising:
Processor；And
It is arranged to the memory of storage computer executable instructions, which when executed execute the processor
It operates below:
Acquisition system calls the link information of each system in link, and the link information is relevant to system operatio for characterizing
Information；
According to the link information of each system, determining has the first system of database manipulation；
The first system is obtained to the operation log of database；
According to the operation log, the capacity of the database is determined.
11. a kind of computer readable storage medium, the computer-readable recording medium storage one or more program, described one
A or multiple programs are when the electronic equipment for being included multiple application programs executes, so that the electronic equipment is executed with lower section
Method:
Acquisition system calls the link information of each system in link, and the link information is relevant to system operatio for characterizing
Information；
According to the link information of each system, determining has the first system of database manipulation；
The first system is obtained to the operation log of database；
According to the operation log, the capacity of the database is determined.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811228120.1A CN109271453B (en) | 2018-10-22 | 2018-10-22 | Method and device for determining database capacity |
| CN202111130963.XA CN113849372A (en) | 2018-10-22 | 2018-10-22 | Method and device for determining database capacity |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811228120.1A CN109271453B (en) | 2018-10-22 | 2018-10-22 | Method and device for determining database capacity |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111130963.XA Division CN113849372A (en) | 2018-10-22 | 2018-10-22 | Method and device for determining database capacity |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109271453A true CN109271453A (en) | 2019-01-25 |
| CN109271453B CN109271453B (en) | 2021-08-27 |
Family
ID=65194065
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111130963.XA Pending CN113849372A (en) | 2018-10-22 | 2018-10-22 | Method and device for determining database capacity |
| CN201811228120.1A Active CN109271453B (en) | 2018-10-22 | 2018-10-22 | Method and device for determining database capacity |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111130963.XA Pending CN113849372A (en) | 2018-10-22 | 2018-10-22 | Method and device for determining database capacity |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN113849372A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110351345A (en) * | 2019-06-25 | 2019-10-18 | 阿里巴巴集团控股有限公司 | Method and device for service request processing |
| CN111782386A (en) * | 2020-03-17 | 2020-10-16 | 新浪网技术(中国)有限公司 | Historical service flow-based database scheduling method and system |
| CN112486786A (en) * | 2020-11-12 | 2021-03-12 | 贝壳技术有限公司 | Calling link tracking method and device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070185913A1 (en) * | 2006-01-26 | 2007-08-09 | International Business Machines Corporation | Automatic Problem-Oriented Transformation of Database Performance Data |
| CN101196890A (en) * | 2006-12-08 | 2008-06-11 | 国际商业机器公司 | Method and device for analyzing information and application performance during polymerized data base operation |
| CN103425683A (en) * | 2012-05-18 | 2013-12-04 | 上海宝信软件股份有限公司 | Database performance test system |
| CN105302858A (en) * | 2015-09-18 | 2016-02-03 | 北京国电通网络技术有限公司 | Distributed database system node-spanning check optimization method and system |
| CN106549772A (en) * | 2015-09-16 | 2017-03-29 | 华为技术有限公司 | Resource prediction method, system and capacity management device |
| US20170270152A1 (en) * | 2013-03-15 | 2017-09-21 | Amazon Technologies, Inc. | System-wide checkpoint avoidance for distributed database systems |
| CN108009017A (en) * | 2016-11-01 | 2018-05-08 | 阿里巴巴集团控股有限公司 | A kind of expansion method of application link, device and system |
| CN108183927A (en) * | 2017-11-22 | 2018-06-19 | 链家网（北京）科技有限公司 | The monitoring method and system that a kind of distributed system link calls |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4756675B2 (en) * | 2004-07-08 | 2011-08-24 | インターナショナル・ビジネス・マシーンズ・コーポレーション | System, method and program for predicting computer resource capacity |
| CN106790718A (en) * | 2017-03-16 | 2017-05-31 | 北京搜狐新媒体信息技术有限公司 | Service call link analysis method and system |
| CN108599973B (en) * | 2018-01-05 | 2021-08-24 | 创新先进技术有限公司 | Log association method, device and equipment |
-
2018
- 2018-10-22 CN CN202111130963.XA patent/CN113849372A/en active Pending
- 2018-10-22 CN CN201811228120.1A patent/CN109271453B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070185913A1 (en) * | 2006-01-26 | 2007-08-09 | International Business Machines Corporation | Automatic Problem-Oriented Transformation of Database Performance Data |
| CN101196890A (en) * | 2006-12-08 | 2008-06-11 | 国际商业机器公司 | Method and device for analyzing information and application performance during polymerized data base operation |
| CN103425683A (en) * | 2012-05-18 | 2013-12-04 | 上海宝信软件股份有限公司 | Database performance test system |
| US20170270152A1 (en) * | 2013-03-15 | 2017-09-21 | Amazon Technologies, Inc. | System-wide checkpoint avoidance for distributed database systems |
| CN106549772A (en) * | 2015-09-16 | 2017-03-29 | 华为技术有限公司 | Resource prediction method, system and capacity management device |
| CN105302858A (en) * | 2015-09-18 | 2016-02-03 | 北京国电通网络技术有限公司 | Distributed database system node-spanning check optimization method and system |
| CN108009017A (en) * | 2016-11-01 | 2018-05-08 | 阿里巴巴集团控股有限公司 | A kind of expansion method of application link, device and system |
| CN108183927A (en) * | 2017-11-22 | 2018-06-19 | 链家网（北京）科技有限公司 | The monitoring method and system that a kind of distributed system link calls |
Non-Patent Citations (2)
| Title |
|---|
| MARTYN ELLISON 等: "Evaluating cloud database migration options using workload models", 《JOURNAL OF CLOUD COMPUTING VOLUME》 * |
| 张亚: "数据库***的性能测试探讨", 《计算机安全》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110351345A (en) * | 2019-06-25 | 2019-10-18 | 阿里巴巴集团控股有限公司 | Method and device for service request processing |
| CN110351345B (en) * | 2019-06-25 | 2021-10-12 | 创新先进技术有限公司 | Method and device for processing service request |
| CN111782386A (en) * | 2020-03-17 | 2020-10-16 | 新浪网技术(中国)有限公司 | Historical service flow-based database scheduling method and system |
| CN112486786A (en) * | 2020-11-12 | 2021-03-12 | 贝壳技术有限公司 | Calling link tracking method and device |
| CN112486786B (en) * | 2020-11-12 | 2022-08-09 | 贝壳技术有限公司 | Calling link tracking method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109271453B (en) | 2021-08-27 |
| CN113849372A (en) | 2021-12-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10281284B2 (en) | Hybrid road network and grid based spatial-temporal indexing under missing road links | |
| US11061984B2 (en) | Grid-based geofence data indexing | |
| CN108549569B (en) | Method and equipment for searching information in application program | |
| CN110032880A (en) | Record screen evidence collecting method, system and electronic equipment based on block chain | |
| CN107341220A (en) | A kind of multi-source data fusion method and device | |
| CN107463479A (en) | A kind of social data monitoring system | |
| CN109408522A (en) | A kind of update method and device of user characteristic data | |
| CN110503435A (en) | Transaction method for early warning, device and equipment based on block chain | |
| CN109934712A (en) | Account checking method, account checking apparatus and electronic equipment applied to distributed system | |
| CN109145625A (en) | Processing method, device and the block chain data-storage system of policy information | |
| CN103488525A (en) | Determination of user preference relevant to scene | |
| CN109271453A (en) | A kind of determination method and apparatus of database volume | |
| CN110516713A (en) | A kind of target group's recognition methods, device and equipment | |
| CN109901991A (en) | A kind of method, apparatus and electronic equipment for analyzing exception call | |
| CN109345081A (en) | A kind of collecting method, device and electronic equipment | |
| CN110020780A (en) | The method, apparatus and electronic equipment of information output | |
| CN111611337B (en) | Terminal data processing system | |
| WO2020233093A1 (en) | Association graph generation method and apparatus, computer device, and storage medium | |
| CN107766216A (en) | It is a kind of to be used to obtain the method and apparatus using execution information | |
| CN110245136A (en) | Data retrieval method and device, equipment and storage equipment | |
| CN113076451A (en) | Abnormal behavior recognition and risk model library establishing method and device and electronic equipment | |
| CN109614566A (en) | Traffic source analysis method, system and device | |
| CN117610505B (en) | Data processing method and device based on standard model | |
| CN107888696A (en) | One kind storage laboratory equipment information acquisition method, system and relevant apparatus | |
| CN111611336B (en) | Terminal data processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201012 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20201012 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |