CN109739742A - Business datum checking method, device and equipment - Google Patents
Business datum checking method, device and equipment Download PDFInfo
- Publication number
- CN109739742A CN109739742A CN201811427258.4A CN201811427258A CN109739742A CN 109739742 A CN109739742 A CN 109739742A CN 201811427258 A CN201811427258 A CN 201811427258A CN 109739742 A CN109739742 A CN 109739742A
- Authority
- CN
- China
- Prior art keywords
- data
- case
- information
- verification
- comparison
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Debugging And Monitoring (AREA)
Abstract
This application discloses a kind of business datum checking method, device and equipment, are related to technical field of data check, testing cost can be saved, it can be achieved that on line business datum real-time core pair.Wherein method includes: the corresponding newest inquiry log information of service data manipulating on real-time acquisition information trunk；According to default comparison rules, filtration treatment is associated to the newest inquiry log information and obtains query information；According to the query information and the default comparison rules, generates and compare recurrence use-case；The data query logic for comparing and returning in use-case is executed, and according to the corresponding comparison type of the default comparison rules, determines the verification of data result of business datum on the line.The application is checked suitable for business datum.
Description
Technical field
This application involves technical field of data check, particularly with regard to a kind of business datum checking method, device and set
It is standby.
Background technique
With the fast development of corporate business, data play an important role in driving inside and outside business, in face of continuing
The business model of upgrading and the business scenario of complexity, it includes: that people's effect relationship is more, analysis dimension is more, index that business datum, which faces,
Several features such as calculation of diameter is complicated and changeable, service export is more.In view of these situations, how in faster business datum iteration
With the guarantee corporate business quality of data under limited human resources, need to rely on efficient business datum verification mode and automation
Verification tool.
Currently, being directed to large-scale business datum verification mode in industry, the test verification scheme under line can be used.Under line
Environment is made number according to test case and is checked.However, the verification of data mode under this line, needs to rely on the complete of use-case by force
Property, and need to guarantee the quality of use-case, and then will cause use-case and make several higher costs, so that testing cost can be increased, in addition
Truthful data can not ensure test quality in the discrepant situation of environment under line on line.
Summary of the invention
In view of this, this application provides a kind of business datum checking method, device and equipment, main purpose is to solve
The verification of data mode under line will cause test case and make several higher costs at present, increase testing cost, and can not ensure survey
The problem of trying quality.
According to the one aspect of the application, a kind of business datum checking method is provided, this method comprises:
The corresponding newest inquiry log information of service data manipulating on information trunk is obtained in real time；
According to default comparison rules, filtration treatment is associated to the newest inquiry log information and obtains query information；
According to the query information and the default comparison rules, generates and compare recurrence use-case；
The data query logic for comparing and returning in use-case is executed, and according to the corresponding comparison of the default comparison rules
Type determines the verification of data result of business datum on the line.
Optionally, the basis presets comparison rules, is associated filtration treatment to the newest inquiry log information and obtains
To query information, specifically include:
It parses the newest inquiry log information and extracts report query relevant information；
From the report query relevant information of extraction obtain it is relevant to the default comparison rules content described in look into
Ask information；
Described according to the query information and the default comparison rules, generation, which compares, returns use-case, specifically includes:
It is obtained from the query information and the inquiry of the both data compared is needed to pass ginseng information；
Ginseng information is passed using the inquiry of the both data and the default comparison rules merge establishment, described in generation
It compares and returns use-case, and the both sides' relevant parameter returned in use-case that compares is consistent.
Optionally, the inquiry using the both data passes ginseng information and the default comparison rules merge group
It builds, generates the comparison and return use-case, and the both sides' relevant parameter returned in use-case that compares is consistent, it is specific to wrap
It includes:
Based on the both sides' relevant parameter consistency principle for comparing and returning in use-case, it is corresponding to parse default comparison rules
The verification of data function of the both data；
The inquiry of the both data is passed ginseng information to be respectively filled in corresponding verification of data function, with life
Use-case is returned at the comparison.
Optionally, described to execute the data query logic for comparing and returning in use-case, and advised according to the default comparison
Then corresponding comparison type determines the verification of data of business datum on the line as a result, specifically including:
The inquiry both data corresponding with inquiry biography ginseng information；
The inquiry in the verification of data function is passed into ginseng information and replaces with corresponding institute inquired
State both data；
The corresponding implementing result of verification of data function after obtaining both sides' replacement data；
The implementing result of both sides is compared, and is carried out according to the corresponding comparison type of the default comparison rules
Logic judgment or classification polymerization, obtain the verification of data result of business datum on the line.
Optionally, obtained from the query information described the inquiry of both data for needing to compare pass ginseng information it
Before, the method also includes:
Weight table standard is sentenced according to whether for same query information, and duplicate removal processing is carried out to the query information；
Described obtain from the query information needs the inquiry of the both data compared to pass ginseng information, specifically includes:
It is obtained from the query information after duplicate removal processing and the inquiry of the both data compared is needed to pass ginseng information.
Optionally, the data query logic for comparing and returning in use-case is executed described, and according to the default comparison
The corresponding comparison type of rule, after the verification of data result for determining business datum on the line, the method also includes:
Comparison recurrence use-case is stored in increment real-time regression use-case verification library；
Periodically or non-periodically the various time points saved in increment real-time regression use-case verification library are generated in real time
It compares and returns use-case progress duplicate removal processing；
Use-case, which is returned, using the comparison saved in the increment real-time regression use-case verification library after duplicate removal processing carries out line
Regression test under upper or line.
Optionally, the data query logic for comparing and returning in use-case is executed described, and according to the default comparison
The corresponding comparison type of rule, after the verification of data result for determining business datum on the line, the method also includes:
It counts the comparison generated within a preset period of time and returns use-case as history comparison recurrence use-case；
The history is compared recurrence use-case to be stored in full dose timing recurrence use-case verification library；
The history comparison that timing compares recurrence use-case preservation to the history returns use-case and carries out verification of data review, acquisition
The history of verification of data mistake, which compares, returns use-case；
Recurrence use-case is compared to the history of the verification of data mistake to analyze, and obtains verification error reason information.
According to the another aspect of the application, a kind of business datum checking device is provided, which includes:
Module is obtained, for obtaining the corresponding newest inquiry log information of service data manipulating on information trunk in real time；
Processing module is also used to be associated at filtering the newest inquiry log information according to comparison rules are preset
Reason obtains query information；
Generation module returns use-case for generating to compare according to the query information and the default comparison rules；
Determining module, for executing the data query logic compared in recurrence use-case, and according to the default comparison
The corresponding comparison type of rule, determines the verification of data result of business datum on the line.
Optionally, the processing module, specifically for parsing the newest inquiry log information and extracting report query phase
Close information；
From the report query relevant information of extraction obtain it is relevant to the default comparison rules content described in look into
Ask information；
The generation module needs the inquiry of the both data compared to pass ginseng specifically for obtaining from the query information
Information；
Ginseng information is passed using the inquiry of the both data and the default comparison rules merge establishment, described in generation
It compares and returns use-case, and the both sides' relevant parameter returned in use-case that compares is consistent.
Optionally, the generation module is specifically also used to based on the both sides' relevant parameter one for comparing and returning in use-case
Cause property principle parses the verification of data function of the default corresponding both data of comparison rules；
The inquiry of the both data is passed ginseng information to be respectively filled in corresponding verification of data function, with life
Use-case is returned at the comparison.
Optionally, the determining module is specifically used for the inquiry both data corresponding with inquiry biography ginseng information；
The inquiry in the verification of data function is passed into ginseng information and replaces with corresponding institute inquired
State both data；
The corresponding implementing result of verification of data function after obtaining both sides' replacement data；
The implementing result of both sides is compared, and is carried out according to the corresponding comparison type of the default comparison rules
Logic judgment or classification polymerization, obtain the verification of data result of business datum on the line.
Optionally, the determining module is specifically also used to obtain pair for needing to compare from the query information described
Before the inquiry of number formulary evidence passes ginseng information, weight table standard is sentenced according to whether for same query information, the query information is carried out
Duplicate removal processing；
The inquiry of the both data compared is needed to pass ginseng letter correspondingly, obtaining from the query information after duplicate removal processing
Breath.
Optionally, described device further include: preserving module and test module；
The preserving module, for comparison recurrence use-case to be stored in increment real-time regression use-case verification library；
The processing module is also used to periodically or non-periodically each to saving in increment real-time regression use-case verification library
The comparison that a time point generates in real time returns use-case and carries out duplicate removal processing；
The test module, for utilizing the ratio saved in the increment real-time regression use-case verification library after duplicate removal processing
Regression test to returning on use-case progress line or under line.
Optionally, described device further include:
Statistical module returns use-case as history comparison recurrence use for counting the comparison generated within a preset period of time
Example；
Preserving module is stored in full dose timing recurrence use-case verification library for the history to be compared recurrence use-case；
Review module compares the history comparison recurrence use-case that recurrence use-case saves to the history for timing and carries out data
Verification review, the history for obtaining verification of data mistake, which compares, returns use-case；
Analysis module compares recurrence use-case for the history to the verification of data mistake and analyzes, it is wrong to obtain verification
Accidentally cause information.
According to the application another aspect, a kind of storage medium is provided, computer program, described program are stored thereon with
Above-mentioned business datum checking method is realized when being executed by processor.
According to the application another aspect, a kind of entity device of business datum verification, including storage medium, place are provided
The computer program managing device and storage on a storage medium and can running on a processor, when the processor executes described program
Realize above-mentioned business datum checking method.
By above-mentioned technical proposal, a kind of business datum checking method, device and equipment provided by the present application, with current line
Under verification of data mode compare, the application can believe in business datum on user query line from corresponding newest inquiry log
Query information associated with default comparison rules content is obtained in breath, and is combined default comparison rules generation comparison to return and used
Example, and then compared by this and return use-case according to the corresponding verification of data result for comparing type and determining business datum on line.
To realize the real-time core pair that business datum on line can be realized whenever business datum on user query line, guarantee business on line
The Stability and veracity of data target.It no longer needs to test case and makes number, testing cost can be reduced, and what is utilized is true on line
Real data carries out verification of data, it is ensured that test quality.Business number in this general line based on data service of the application simultaneously
The scheme of automatic checking has the ability that index monitors in real time on line when factually.
Above description is only the general introduction of technical scheme, in order to better understand the technological means of the application,
And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects, features and advantages of the application can
It is clearer and more comprehensible, below the special specific embodiment for lifting the application.
Detailed description of the invention
The drawings described herein are used to provide a further understanding of the present application, constitutes part of this application, this Shen
Illustrative embodiments and their description please are not constituted an undue limitation on the present application for explaining the application.In the accompanying drawings:
Fig. 1 shows a kind of flow diagram of business datum checking method provided by the embodiments of the present application；
Fig. 2 shows the flow diagrams of another business datum checking method provided by the embodiments of the present application；
Fig. 3 shows a kind of example schematic of on-line checking log parsing provided by the embodiments of the present application；
Fig. 4 shows a kind of example signal of query information association comparison rules matching filtering provided by the embodiments of the present application
Figure；
Fig. 5 shows a kind of example schematic for comparing use-case and generating provided by the embodiments of the present application；
Fig. 6 shows the example schematic of business datum checking method general frame provided by the embodiments of the present application；
Fig. 7 shows a kind of structural schematic diagram of business datum checking device provided by the embodiments of the present application；
Fig. 8 shows the structural schematic diagram of another business datum checking device provided by the embodiments of the present application.
Specific embodiment
The application is described in detail below with reference to attached drawing and in conjunction with the embodiments.It should be noted that not conflicting
In the case of, the features in the embodiments and the embodiments of the present application can be combined with each other.
It will cause test case for the test verification scheme under existing line at present and make several higher costs, increase test
Cost, and can not ensure the problem of testing quality, in order to solve this problem, present embodiments provide a kind of business datum verification side
Method, as shown in Figure 1, this method comprises:
101, the corresponding newest inquiry log information of service data manipulating on information trunk is obtained in real time.
Wherein, it is had recorded in newest inquiry log information on user's real-time query line in the correlation log of service data manipulating
Which hold, as between business datum on user's current queries line and corresponding inquiry mode, query time point, the user network
Address agreement (Internet Protocol, IP) of interconnection etc..In the present embodiment whenever business datum on user query line
The corresponding newest inquiry log information of acquisition can be monitored in real time, to carry out the real time data verification of business datum on the line.
It can be the device or equipment that business datum is checked on line for the executing subject of the present embodiment, can configure
In client-side or server side, depending on actual demand.
102, according to comparison rules are preset, filtration treatment is associated to newest inquiry log information and obtains query information.
Wherein, default comparison rules can be set in advance by the comparison content of technical staff's verification of data according to actual needs
It is fixed, that is, which content of verification of data needed.It may include the inquiry biography of business datum on the line for need verification of data in query information
Join information, inquiry mode etc., to need industry on the line of verification of data from acquisition in corresponding database using the query information
Business data.
In the present embodiment, different default comparison rules can be pre-configured with, these are then preset into comparison rules and is saved
In comparison rules allocation list.It, will corresponding newest inquiry when needing that business datum is checked on the line to newest inquiry
Log information is matched with each default comparison rules in comparison rules allocation list, finds the default comparison rule of content matching
Then, query information associated with matched default comparison rules content is obtained and from the newest inquiry log information.
103, it according to the query information and default comparison rules got, generates and compares recurrence use-case.
Wherein, the verification of data task that use-case is used to execute business datum on the line of current queries that returns is compared.For this
Embodiment, these query informations that can be will acquire are stored in query information table, then the query information table and will compare rule
Then allocation list is merged into query information to be compared, and the comparativity in order to guarantee comparison rules, needs to configure in comparison rules
Configuration parameter incidence relation on the basis of table, so that the relevant relevant parameter of both sides' query information checked is needed to be consistent,
And then it ultimately generates comparison and returns use-case.
104, the data query logic for comparing and returning in use-case is executed, and according to the corresponding comparison class of default comparison rules
Type determines the verification of data result of business datum on line.
In the present embodiment, the both data needs for needing to check are inquired from corresponding database to be obtained, these
Data are likely to be at different data mart modeling links, therefore need to execute and compare the data query logic returned in use-case and then find
The both data for needing to compare, to realize that different data processing links compare the verifying of same bore/measurement.And
During specific verification is compared, needs to carry out logic judgment according to the corresponding comparison type of default comparison rules or classification is poly-
Close etc., finally provide specific comparison result.
For example, including the order price of commodity a, wherein the order price of commodity a in business datum on the line of user query
The price that actually should be equal to commodity a adds the service fee of commodity a, needs both sides carrying out data according to default comparison rules
Verification executes the comparison generated as procedure described above and returns use-case, judges whether the order price of commodity a is equal to the valence of commodity a
Lattice add the service fee of commodity a, and provide specific both sides' comparison result, and then can realize different indexs in this way
Between there are the verifying of logical relation comparisons.
By applying above-mentioned business datum checking method, compared with the verification of data mode under current line, the present embodiment base
In a kind of data service mode, it can be achieved that the reality of business datum on line can be realized when whenever business datum on user query line
When check, guarantee line on business datum index Stability and veracity.No longer need to test case and make number, can reduce test at
This, and using be on line truthful data carry out verification of data, it is ensured that test quality.The present embodiment is this based on number simultaneously
Has the ability that index monitors in real time on line according to the scheme of the real-time automatic checking of business datum in the general line of service.
Further, as the refinement and extension of above-described embodiment specific embodiment, in order to completely illustrate the present embodiment
Specific implementation process, present embodiments provide another business datum checking method, as shown in Fig. 2, this method comprises:
201, the corresponding newest inquiry log information of service data manipulating on information trunk is obtained in real time.
For example, if report configuration mode is based upon report tool Myreports largely to realize on line,
Business on duplication Myreports line can be monitored by the way that data duplication centre (Data Replication Center, DRC) is synchronous
Log (Log) table of data query changes, to obtain the corresponding newest inquiry log of service data manipulating on information trunk in real time
Information.
202, the newest inquiry log information that is analyzed and acquired by simultaneously extracts report query relevant information.
For example, newest inquiry log information extraction and report query relevant information are parsed, such as the unification of data query service
Resource identifier (Block URI), inquiry mode, inquiry pass the information such as ginseng, specific as shown in figure 3, inquiry log on listening-in line
Then DRC message parses and assembles to obtain report query relevant information, i.e. parsing assembling query information.
203, query information relevant to default comparison rules content is obtained from the report query relevant information of extraction.
Since the query information extracted in step 202 is full dose, data volume is larger, needs to compare with preconfigured
Each and default comparison rules in rule configuration list are associated filtering, find inquiry relevant to default comparison rules content
Information, and be stored in query information table.To reduce subsequent unnecessarily data query amount and verification of data amount, number can be accelerated
According to verification efficiency, accomplish quickly and accurately verification of data process.
204, it is obtained from query information and the inquiry of the both data compared is needed to pass ginseng information.
Wherein, inquiry passes in ginseng information and inquires the corresponding biography ginseng of data comprising both sides, can be from both sides respectively using biography ginseng
The data that both sides need to compare are obtained in corresponding database.
There can be content phase since step 203 is associated in the query information being obtained by filtration using comparison rules allocation list
Same same query information, when frequent refresh inquiry request or multiple users concentrate some in a short time such as same user
Between point inquire identical content etc..Therefore, in order to reduce the task amount of verification of data, accelerate the efficiency of verification of data, as one
Kind optional way may also include that before the step 204 and sentence weight table standard according to whether for same query information, filter to association
Query information that treated carries out duplicate removal processing, by identical query information duplicate removal and retains one of query information；Accordingly
Step 204 can include: obtain the inquiry of both data for needing to compare from the query information after duplicate removal processing and pass ginseng information.
It can guarantee in the short time by this optional way and verification of data only carried out to business datum on unduplicated line, avoid doing repetition
Verification of data test, can be improved the efficiency of verification of data, also mitigates the certain load pressure of system.
For example, being associated with as shown in figure 4, parsing assembling query information is carried out query information by comparison rules allocation list
Filter and duplicate removal ultimately produce query information table retain comprising association filtering and the query information after duplicate removal.
205, ginseng information is passed using the inquiry of both data and default comparison rules merge establishment, generate and compare recurrence
Use-case, and the both sides' relevant parameter compared in recurrence use-case is consistent.
For the present embodiment, in order to guarantee the comparativity of comparison rules, need to match on the basis of comparison rules allocation list
Parameter association relationship (corresponding table can be pre-configured with) is set, so that the relevant relevant parameter of the both sides' query information for needing to check is protected
It holds consistent.For example, query information to be compared is generated as shown in figure 5, comparison rules allocation list and query information table are merged,
Then parameter association relation table is utilized, so that needing the relevant relevant parameter of both sides' query information checked to be consistent, in turn
It ultimately generates comparison and returns use-case.
In order to illustrate the specific implementation process of step 205, alternatively, step 205 is specific can include: is based on
The both sides' relevant parameter consistency principle returned in use-case is compared, the data core of the default corresponding both data of comparison rules is parsed
To function；Then the inquiry of both data is passed ginseng information to be respectively filled in corresponding verification of data function, to generate ratio
To recurrence use-case.Generating obtained comparison recurrence use-case in this way accurately can be used to execute business on the line of current queries
The verification of data task of data.
For example, it is desired to which there are 4 item datas for the side A, and the side B only exists 3 item datas, in this condition in the both sides A and B of verification
Under, in order to enable both data audit process is comparable, using on the basis of comparison rules allocation list configuration parameter close
Connection relationship, so that obtaining the corresponding data of 3 item datas with the side B from 4 item datas of the side A, and 3 item datas with the side B
It is compared, and then realizes that A and B both data audit process is comparable.
206, the data query logic for comparing and returning in use-case is executed, and according to the corresponding comparison class of default comparison rules
Type determines the verification of data result of business datum on line.
Wherein, presetting the corresponding comparison type of comparison rules may include the types such as logic judgment, classification polymerization.
Based on the optional way in step 205, step 206 is specific can include: ginseng information is passed using the inquiry of both data,
Inquiry both data corresponding with inquiry biography ginseng information；The inquiry in verification of data function ginseng information is passed again to replace with respectively
The corresponding both data inquired；Then the verification of data function after obtaining both sides' replacement data corresponding executes knot
Fruit；Finally the implementing result of both sides is compared, and carries out logic judgment according to the corresponding comparison type of default comparison rules
Or classification polymerization, obtain the verification of data result of business datum on line.
For example, previously according to the corresponding verification of data function of calculation formula editor both sides of verification of data, then band
After entering specific both data and executing the verification of data function, differentiate whether is value that both sides are calculated according to the calculation formula
It is identical, if it is different, differentiating whether the difference between the two values is less than preconfigured certain threshold value again, if it is less than this
Threshold value, it is determined that both data compares unanimously, if it is greater than this threshold value, then the both data that can determine that needs are checked is different
Cause, this differentiation process can counterlogic judgement comparison type, and then can realize deposited between different indexs in this way
It is compared in the verifying of logical relation.
For another example business datum is the national total sales volume of commodity b on the line of user query, wherein the whole nation of commodity b is sold
The summation for selling the practical sales volume in all parts of the country that should be equal to commodity b of total amount, according to the data core of default comparison rules editor both sides
To function, after executing verification of data function, differentiate commodity b national total sales volume whether with the sales volume in all parts of the country of commodity b
Summation is equal, illustrates that verification of data is consistent if equal, and this differentiation process can correspond to the comparison type of classification polymerization, in turn
The present embodiment process can realize that polymerization index is compared with the adduction of corresponding detail/timesharing.
Further, the comparison generated in the present embodiment returns use-case, is generated based on business datum on line, with
Test case makes number compared to test directive significance is had more, therefore, after step 206, alternatively, originally under line
Embodiment may also include that will compare recurrence use-case is stored in increment real-time regression use-case verification library, wherein periodically or non-periodically
Use-case is returned to the comparison that the various time points saved in increment real-time regression use-case verification library generate in real time and carries out duplicate removal processing,
So that the comparison that is all different as far as possible saved in increment real-time regression use-case verification library returns use-case；Then duplicate removal processing is utilized
The comparison saved in increment real-time regression use-case verification library afterwards returns the regression test on use-case progress line or under line.Pass through this
A large amount of comparisons generated based on business datum on line after kind of duplicate removal return use-cases, can be preferably under line or off-line test data
Verification, which provides, instructs foundation, and environment or the work of the data test of offline environment under better line are realized in help.
Since verification of data amount is larger sometimes, can inevitably there is a situation where individual core to exception, in order to find the problem in time
Place further can periodically be checked, and where finding problem, corresponding the present embodiment may also include that statistics when default
Between the comparison that generates in section return use-case as history and compare recurrence use-case；History comparison recurrence use-case full dose is stored in again to determine
Shi Huigui use-case is checked in library；Then the history comparison that timing compares recurrence use-case preservation to history returns use-case and carries out data core
To review, the history for obtaining verification of data mistake, which compares, returns use-case；The history of verification of data mistake is compared return use-case into
Row analysis obtains verification error reason information.
Wherein, preset time period was daily 0: 01 separated beginning to 24 points, i.e., the comparison generated this day returns use-case and makees
For history compare return use-case be stored in full dose timing return use-case check library in, then timing to the same day this intraday history
It compares and returns use-case progress verification of data review, find and compare recurrence use-case in the presence of abnormal or mistake history, then carry out deep
Degree analysis, note abnormalities reason in time, and notifies to user.
Based on above-mentioned each specific embodiment, in order to better understand, below with reference to current state of the art problem,
Again overall description once the implementation process of the present embodiment method and it is corresponding the utility model has the advantages that
Nowadays it includes: that people imitates relationship more (such as people and shops, people and trade company, people and city, people and machines that business datum, which faces,
Have equipment, shops and a variety of relationships of plant etc.), analysis dimension it is more (such as industry, great Qu, head trade company, city, commercial circle,
Service provider etc.), index calculation of diameter is complicated and changeable (be such as related to marketing, businessman, air control, return servant, reconciliation critical data index
Have more complex calculation formula and logical relation), service export it is more (such as same index due to business visual angle difference, can exist
Different data product, data outlet are shown) etc. several features.These features are directed to, how in faster business number
According to business datum quality is ensured under iteration and limited human resources, need to rely on efficient verification of data mode and automation core
To tool, and then it can accomplish quality of data guarantee and find the problem in time.
The mode of current operation verification of data may also include offline verification of data other than testing verification scheme under line
Mode, for this mode major applications in the quality of data guarantee of data warehouse, verification rule configuration facilitates can be effectively to abnormal number
According to progress quality indicator.But this mode is limited in that, just for off-line data, real time data scene can not cover.
The problem of being directed to the verification scheme of the test under being mostly offline or line in current industry, using this reality
Apply a method be equivalent to provide data real-time core on a kind of line to and automatic returning verification of data scheme, for example, such as Fig. 6 institute
Show, contains log query parsing on line, query information association comparison rules match filtering, comparison returns use-case and generates, is regular
Comparison engine, increasing/full dose return the module compositions such as comparison and comparison result statistics.When user needs business datum on information trunk
When, the present embodiment on-line checking log parsing is extracted and report query relevant information.It is associated again with comparison rules allocation list
Filter and by whether be same query information sentence weight, find query information relevant to comparison rules configuration and be stored in inquiry believe
It ceases in table.Then query information to be compared is merged into according to the query information table of generation and comparison rules allocation list, and combined
Parameter association relation table, which generates to compare, returns use-case.The number in use-case is returned by the comparison that regular comparison engine executes the generation
It is investigated that asking, query result passes through regular comparison engine and provides ratio according to different comparison type progress logic judgment/classification polymerizations
To result；Finally in order to ensure the integrality for checking scene, increment real-time regression use-case is included into for real time data inquiry on line
In verification, full dose timing is included into for history use-case and is returned in use-case verification.
The scheme of method by applying this embodiment can solve the accuracy monitoring verification of data target bore on line, with
And the stability of daily core index.And can using following real time data check scene: 1) different data processing links for
The verifying of same bore/measurement compares；2) there are the verifying of logical relation comparisons between different indexs；3) polymerization index with it is corresponding
Detail/timesharing adduction compares., it can be achieved that whenever user compared with the test verification scheme under offline or line in the prior art
The real-time core pair of business datum on line can be realized on information trunk when business datum, guarantee the accuracy of business datum index on line
And stability.No longer need to test case and make number, can reduce testing cost, and using be that truthful data carries out data core on line
It is right, it is ensured that test quality.The real-time automatic checking of business datum in this general line based on data service of the present embodiment simultaneously
Scheme have the ability that index on line monitors in real time.
Further, the specific implementation as Fig. 1 and Fig. 2 method, the embodiment of the present application provide a kind of business datum core
To device, as shown in fig. 7, the device includes: to obtain module 31, processing unit 32, generation unit 33, determination unit 34.
Module 31 is obtained, can be used for obtaining the corresponding newest inquiry log information of service data manipulating on information trunk in real time；
Processing module 32, it may also be used for according to default comparison rules, newest inquiry log information is associated at filtering
Reason obtains query information；
Generation module 33 can be used for generating according to query information and default comparison rules and comparing recurrence use-case；
Determining module 34 can be used for executing the data query logic for comparing and returning in use-case, and according to default comparison rules
Corresponding comparison type determines the verification of data result of business datum on line.
In specific application scenarios, processing module 32 is particularly used in the newest inquiry log information of parsing and extracts report
Table query-related information；Inquiry letter relevant to default comparison rules content is obtained from the report query relevant information of extraction
Breath；
Generation module 33 is particularly used in obtain the inquiry for needing the both data compared from query information and pass and joins letter
Breath；Ginseng information is passed using the inquiry of both data and default comparison rules merge establishment, is generated and is compared recurrence use-case, and makes
The both sides' relevant parameter returned in use-case must be compared to be consistent.
In specific application scenarios, generation module 33 specifically can also be used to close based on the both sides compared in recurrence use-case
Join parameter consistency principle, parses the verification of data function of the default corresponding both data of comparison rules；By looking into for both data
It askes biography ginseng information to be respectively filled in corresponding verification of data function, returns use-case to generate to compare.
In specific application scenarios, determining module 34 is particularly used in inquiry both sides corresponding with inquiry biography ginseng information
Data；Inquiry in verification of data function is passed into ginseng information and replaces with corresponding both data inquired；Obtain both sides
The corresponding implementing result of verification of data function after replacement data；The implementing result of both sides is compared, and according to pre-
If the corresponding comparison type of comparison rules carries out logic judgment or classification polymerization, the verification of data knot of business datum on line is obtained
Fruit.
In specific application scenarios, determining module 34, specifically can also be used in from query information obtain need to compare
Both data inquiry pass ginseng information before, according to whether for same query information to sentence weight table quasi-, to query information progress
Duplicate removal processing；The inquiry of the both data compared is needed to pass ginseng information correspondingly, obtaining from the query information after duplicate removal processing.
In specific application scenarios, as shown in figure 8, the present apparatus may also include that preserving module 35 and test module 36；
Preserving module 35 can be used for compare recurrence use-case and be stored in increment real-time regression use-case verification library；
Processing module 32, it may also be used for periodically or non-periodically to increment real-time regression use-case verification library in save it is each when
Between put the comparison that generates in real time and return use-case and carry out duplicate removal processing；
Test module 36 can be used for returning using the comparison saved in the increment real-time regression use-case verification library after duplicate removal processing
Use-case is returned to carry out the regression test on line or under line.
In specific application scenarios, as shown in figure 8, the present apparatus may also include that statistical module 37, review module 38, divide
Analyse module 39；
Statistical module 37 can be used for counting the comparison generated within a preset period of time and return use-case as history comparison recurrence
Use-case；
Preserving module 35, it may also be used for history is compared into recurrence use-case and is stored in full dose timing recurrence use-case verification library；
Review module 38 can be used for the history comparison that timing returns use-case preservation to history comparison and return use-case progress data
Verification review, the history for obtaining verification of data mistake, which compares, returns use-case；
Analysis module 39 can be used for comparing recurrence use-case to the history of verification of data mistake and analyze, it is wrong to obtain verification
Accidentally cause information.
It should be noted that each functional unit involved by a kind of business datum checking device provided in this embodiment is other
Corresponding description, can be with reference to the corresponding description in Fig. 1 and Fig. 2, and details are not described herein.
Based on above-mentioned method as depicted in figs. 1 and 2, correspondingly, the embodiment of the present application also provides a kind of storage medium,
On be stored with computer program, which realizes above-mentioned business datum verification side as depicted in figs. 1 and 2 when being executed by processor
Method.
Based on this understanding, the technical solution of the application can be embodied in the form of software products, which produces
Product can store in a non-volatile memory medium (can be CD-ROM, USB flash disk, mobile hard disk etc.), including some instructions
With so that computer equipment (can be personal computer, server or the network equipment an etc.) execution the application is each
Method described in implement scene.
Based on above-mentioned method and Fig. 7 as depicted in figs. 1 and 2, virtual bench embodiment shown in Fig. 8, in order to realize
Above-mentioned purpose, the embodiment of the present application also provides a kind of entity devices of business datum verification, are specifically as follows computer, service
Device, smart phone, tablet computer, smartwatch or network equipment etc., the entity device include storage medium and processor；
Storage medium, for storing computer program；Processor is realized above-mentioned as depicted in figs. 1 and 2 for executing computer program
Business datum checking method.
Optionally, which can also include user interface, network interface, camera, radio frequency (Radio
Frequency, RF) circuit, sensor, voicefrequency circuit, WI-FI module etc..User interface may include display screen
(Display), input unit such as keyboard (Keyboard) etc., optional user interface can also connect including USB interface, card reader
Mouthful etc..Network interface optionally may include standard wireline interface and wireless interface (such as WI-FI interface).
It will be understood by those skilled in the art that a kind of entity device structure of business datum verification provided in this embodiment is simultaneously
The restriction to the entity device is not constituted, may include more or fewer components, perhaps combines certain components or different
Component layout.
It can also include operating system, network communication module in storage medium.Operating system is the above-mentioned business datum of management
The program of the entity device hardware and software resource of verification supports the fortune of message handling program and other softwares and/or program
Row.Network communication module for realizing the communication between each component in storage medium inside, and in information processing entities equipment
It is communicated between other hardware and softwares.
Through the above description of the embodiments, those skilled in the art can be understood that the application can borrow
It helps software that the mode of necessary general hardware platform is added to realize, hardware realization can also be passed through.Pass through the skill of application the application
Art scheme, it can be achieved that whenever business on user query line compared with the test verification scheme under offline or line in the prior art
The real-time core pair of business datum on line can be realized when data, guarantee the Stability and veracity of business datum index on line.Nothing
Need re-test use-case to make number, can reduce testing cost, and using be that truthful data carries out verification of data on line, it is ensured that survey
Try quality.The scheme of the real-time automatic checking of business datum has line in this general line based on data service of the present embodiment simultaneously
The ability of upper index real time monitoring.
It will be appreciated by those skilled in the art that the accompanying drawings are only schematic diagrams of a preferred implementation scenario, module in attached drawing or
Process is not necessarily implemented necessary to the application.It will be appreciated by those skilled in the art that the mould in device in implement scene
Block can according to implement scene describe be distributed in the device of implement scene, can also carry out corresponding change be located at be different from
In one or more devices of this implement scene.The module of above-mentioned implement scene can be merged into a module, can also be into one
Step splits into multiple submodule.
Above-mentioned the application serial number is for illustration only, does not represent the superiority and inferiority of implement scene.Disclosed above is only the application
Several specific implementation scenes, still, the application is not limited to this, and the changes that any person skilled in the art can think of is all
The protection scope of the application should be fallen into.
Claims (10)
1. a kind of business datum checking method characterized by comprising
The corresponding newest inquiry log information of service data manipulating on information trunk is obtained in real time；
According to default comparison rules, filtration treatment is associated to the newest inquiry log information and obtains query information；
According to the query information and the default comparison rules, generates and compare recurrence use-case；
The data query logic for comparing and returning in use-case is executed, and according to the corresponding comparison class of the default comparison rules
Type determines the verification of data result of business datum on the line.
2. the method according to claim 1, wherein the basis presets comparison rules, to the newest inquiry
Log information is associated filtration treatment and obtains query information, specifically includes:
It parses the newest inquiry log information and extracts report query relevant information；
The inquiry letter relevant with the default comparison rules content is obtained from the report query relevant information of extraction
Breath；
Described according to the query information and the default comparison rules, generation, which compares, returns use-case, specifically includes:
It is obtained from the query information and the inquiry of the both data compared is needed to pass ginseng information；
Ginseng information is passed using the inquiry of the both data and the default comparison rules merge establishment, generates the comparison
Use-case is returned, and the both sides' relevant parameter returned in use-case that compares is consistent.
3. according to the method described in claim 2, it is characterized in that, the inquiry using the both data pass ginseng information and
The default comparison rules merge establishment, generate the comparison and return use-case, and the comparison is returned in use-case
Both sides' relevant parameter is consistent, and is specifically included:
Based on the both sides' relevant parameter consistency principle for comparing and returning in use-case, it is corresponding described to parse default comparison rules
The verification of data function of both data；
The inquiry of the both data is passed ginseng information to be respectively filled in corresponding verification of data function, to generate
It states comparison and returns use-case.
4. according to the method described in claim 3, it is characterized in that, described execute the data query for comparing and returning in use-case
Logic, and according to the corresponding comparison type of the default comparison rules, determine the verification of data of business datum on the line as a result,
It specifically includes:
The inquiry both data corresponding with inquiry biography ginseng information；
The inquiry in the verification of data function is passed into ginseng information and replaces with corresponding described pair inquired
Number formulary evidence；
The corresponding implementing result of verification of data function after obtaining both sides' replacement data；
The implementing result of both sides is compared, and carries out logic according to the corresponding comparison type of the default comparison rules
Judgement or classification polymerization, obtain the verification of data result of business datum on the line.
5. according to the method described in claim 2, it is characterized in that, obtaining what needs compared from the query information described
Before the inquiry of both data passes ginseng information, the method also includes:
Weight table standard is sentenced according to whether for same query information, and duplicate removal processing is carried out to the query information；
Described obtain from the query information needs the inquiry of the both data compared to pass ginseng information, specifically includes:
It is obtained from the query information after duplicate removal processing and the inquiry of the both data compared is needed to pass ginseng information.
6. being looked into the method according to claim 1, wherein returning the data in use-case in the execution comparison
Logic is ask, and according to the corresponding comparison type of the default comparison rules, determines the verification of data knot of business datum on the line
After fruit, the method also includes:
Comparison recurrence use-case is stored in increment real-time regression use-case verification library；
The comparison that periodically or non-periodically various time points saved in increment real-time regression use-case verification library are generated in real time
It returns use-case and carries out duplicate removal processing；
Using the comparison that saves in the increment real-time regression use-case verification library after duplicate removal processing return use-case carry out on line or
Regression test under line.
7. being looked into the method according to claim 1, wherein returning the data in use-case in the execution comparison
Logic is ask, and according to the corresponding comparison type of the default comparison rules, determines the verification of data knot of business datum on the line
After fruit, the method also includes:
It counts the comparison generated within a preset period of time and returns use-case as history comparison recurrence use-case；
The history is compared recurrence use-case to be stored in full dose timing recurrence use-case verification library；
The history comparison that timing compares recurrence use-case preservation to the history returns use-case and carries out verification of data review, acquisition data
The history of verification mistake, which compares, returns use-case；
Recurrence use-case is compared to the history of the verification of data mistake to analyze, and obtains verification error reason information.
8. a kind of business datum checking device characterized by comprising
Module is obtained, for obtaining the corresponding newest inquiry log information of service data manipulating on information trunk in real time；
Processing module is also used to be associated filtration treatment according to comparison rules are preset to the newest inquiry log information and obtain
To query information；
Generation module returns use-case for generating to compare according to the query information and the default comparison rules；
Determining module, for executing the data query logic compared in recurrence use-case, and according to the default comparison rules
Corresponding comparison type determines the verification of data result of business datum on the line.
9. a kind of storage medium, is stored thereon with computer program, which is characterized in that realization when described program is executed by processor
Business datum checking method described in any one of claims 1 to 7.
10. a kind of business datum checking apparatus, including storage medium, processor and storage are on a storage medium and can be in processor
The computer program of upper operation, which is characterized in that the processor is realized any in claim 1 to 7 when executing described program
Business datum checking method described in.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811427258.4A CN109739742B (en) | 2018-11-27 | 2018-11-27 | Service data checking method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811427258.4A CN109739742B (en) | 2018-11-27 | 2018-11-27 | Service data checking method, device and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109739742A true CN109739742A (en) | 2019-05-10 |
| CN109739742B CN109739742B (en) | 2021-11-02 |
Family
ID=66359063
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811427258.4A Active CN109739742B (en) | 2018-11-27 | 2018-11-27 | Service data checking method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109739742B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110222042A (en) * | 2019-05-30 | 2019-09-10 | 口碑(上海)信息技术有限公司 | For determining the method, apparatus, equipment and system architecture of having checked business datum |
| CN110990414A (en) * | 2019-10-31 | 2020-04-10 | 口碑(上海)信息技术有限公司 | Data processing method and device |
| CN111240928A (en) * | 2020-01-06 | 2020-06-05 | 上海闻泰信息技术有限公司 | Automatic detection method, device and equipment for equipment drive and storage medium |
| CN111382075A (en) * | 2020-03-10 | 2020-07-07 | 北京同邦卓益科技有限公司 | Data processing method and device for automatic test |
| CN112100066A (en) * | 2020-09-10 | 2020-12-18 | 杭州览众数据科技有限公司 | Data index accuracy verification method and automatic test tool |
| CN112380167A (en) * | 2020-11-17 | 2021-02-19 | 深圳市和讯华谷信息技术有限公司 | Batch data verification method and device, computer equipment and storage medium |
| CN112540996A (en) * | 2020-11-12 | 2021-03-23 | Oppo（重庆）智能科技有限公司 | Service data verification method and device, electronic equipment and storage medium |
| CN114020608A (en) * | 2021-10-27 | 2022-02-08 | 中国铁道科学研究院集团有限公司通信信号研究所 | Railway CTC system background program regression test implementation method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060053083A1 (en) * | 2003-07-31 | 2006-03-09 | Robert Wiest | Transaction server and computer programme product |
| CN107644077A (en) * | 2017-09-19 | 2018-01-30 | 杭州贝购科技有限公司 | Data consistency monitoring method, computer equipment and storage medium |
| CN108319547A (en) * | 2017-01-17 | 2018-07-24 | 阿里巴巴集团控股有限公司 | Method for generating test case, device and system |
-
2018
- 2018-11-27 CN CN201811427258.4A patent/CN109739742B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060053083A1 (en) * | 2003-07-31 | 2006-03-09 | Robert Wiest | Transaction server and computer programme product |
| CN108319547A (en) * | 2017-01-17 | 2018-07-24 | 阿里巴巴集团控股有限公司 | Method for generating test case, device and system |
| CN107644077A (en) * | 2017-09-19 | 2018-01-30 | 杭州贝购科技有限公司 | Data consistency monitoring method, computer equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| WEIXIN_33939380: "《***业务流程测试》", 《HTTPS://BLOG.CSDN.NET/WEIXIN_33939380/ARTICLE/DETAILS/90505605?UTM_SOURCE=APP&APP_VERSION=4.6.1》 * |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110222042B (en) * | 2019-05-30 | 2020-06-16 | 口碑(上海)信息技术有限公司 | Method, device, equipment and system architecture for determining checked business data |
| CN110222042A (en) * | 2019-05-30 | 2019-09-10 | 口碑(上海)信息技术有限公司 | For determining the method, apparatus, equipment and system architecture of having checked business datum |
| CN110990414B (en) * | 2019-10-31 | 2023-06-16 | 口碑(上海)信息技术有限公司 | Data processing method and device |
| CN110990414A (en) * | 2019-10-31 | 2020-04-10 | 口碑(上海)信息技术有限公司 | Data processing method and device |
| CN111240928A (en) * | 2020-01-06 | 2020-06-05 | 上海闻泰信息技术有限公司 | Automatic detection method, device and equipment for equipment drive and storage medium |
| CN111240928B (en) * | 2020-01-06 | 2024-04-09 | 上海闻泰信息技术有限公司 | Automatic detection method, device, equipment and storage medium for equipment drive |
| CN111382075A (en) * | 2020-03-10 | 2020-07-07 | 北京同邦卓益科技有限公司 | Data processing method and device for automatic test |
| CN111382075B (en) * | 2020-03-10 | 2023-09-26 | 北京同邦卓益科技有限公司 | Automatic test data processing method and device |
| CN112100066A (en) * | 2020-09-10 | 2020-12-18 | 杭州览众数据科技有限公司 | Data index accuracy verification method and automatic test tool |
| CN112100066B (en) * | 2020-09-10 | 2023-07-04 | 杭州览众数据科技有限公司 | Verification method for accuracy of data index and automatic test tool |
| CN112540996A (en) * | 2020-11-12 | 2021-03-23 | Oppo（重庆）智能科技有限公司 | Service data verification method and device, electronic equipment and storage medium |
| CN112540996B (en) * | 2020-11-12 | 2023-11-24 | Oppo（重庆）智能科技有限公司 | Service data verification method and device, electronic equipment and storage medium |
| CN112380167A (en) * | 2020-11-17 | 2021-02-19 | 深圳市和讯华谷信息技术有限公司 | Batch data verification method and device, computer equipment and storage medium |
| CN114020608A (en) * | 2021-10-27 | 2022-02-08 | 中国铁道科学研究院集团有限公司通信信号研究所 | Railway CTC system background program regression test implementation method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109739742B (en) | 2021-11-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109739742A (en) | Business datum checking method, device and equipment | |
| CN106470133B (en) | System pressure testing method and device | |
| US20170109657A1 (en) | Machine Learning-Based Model for Identifying Executions of a Business Process | |
| US20170109668A1 (en) | Model for Linking Between Nonconsecutively Performed Steps in a Business Process | |
| US20170109667A1 (en) | Automaton-Based Identification of Executions of a Business Process | |
| CN110992167A (en) | Bank client business intention identification method and device | |
| CN103069749B (en) | The method and system of the isolation of the problem in virtual environment | |
| CN106326248A (en) | A storage method and device for data of databases | |
| US20170109639A1 (en) | General Model for Linking Between Nonconsecutively Performed Steps in Business Processes | |
| CN102968374A (en) | Data warehouse testing method | |
| CN110213238A (en) | Threat detection method and device, storage medium, the computer equipment of data | |
| CN110309052A (en) | A kind of data verification method and relevant device | |
| CN107168844B (en) | Performance monitoring method and device | |
| US20190050435A1 (en) | Object data association index system and methods for the construction and applications thereof | |
| CN109684052A (en) | Transaction analysis method, apparatus, equipment and storage medium | |
| CN110457175A (en) | Business data processing method, device, electronic equipment and medium | |
| US20170109638A1 (en) | Ensemble-Based Identification of Executions of a Business Process | |
| CN111400189A (en) | Code coverage rate monitoring method and device, electronic equipment and storage medium | |
| CN109873790A (en) | Network security detection method, device and computer readable storage medium | |
| CN114880405A (en) | Data lake-based data processing method and system | |
| CN115757150A (en) | Production environment testing method, device, equipment and storage medium | |
| CN108243046B (en) | Service quality assessment method and device based on data audit | |
| US20170109640A1 (en) | Generation of Candidate Sequences Using Crowd-Based Seeds of Commonly-Performed Steps of a Business Process | |
| CN110377519A (en) | Performance capability test method, device, equipment and the storage medium of big data system | |
| US20170109670A1 (en) | Crowd-Based Patterns for Identifying Executions of Business Processes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |