CN101827346B - Automatic test method and device for charge system - Google Patents

Automatic test method and device for charge system Download PDF

Info

Publication number
CN101827346B
CN101827346B CN 200910047257 CN200910047257A CN101827346B CN 101827346 B CN101827346 B CN 101827346B CN 200910047257 CN200910047257 CN 200910047257 CN 200910047257 A CN200910047257 A CN 200910047257A CN 101827346 B CN101827346 B CN 101827346B
Authority
CN
China
Prior art keywords
wholesale price
metering data
charge system
measured
test cases
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN 200910047257
Other languages
Chinese (zh)
Other versions
CN101827346A (en
Inventor
蔡加祺
沈铖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Group Shanghai Co Ltd
Original Assignee
China Mobile Group Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Group Shanghai Co Ltd filed Critical China Mobile Group Shanghai Co Ltd
Priority to CN 200910047257 priority Critical patent/CN101827346B/en
Publication of CN101827346A publication Critical patent/CN101827346A/en
Application granted granted Critical
Publication of CN101827346B publication Critical patent/CN101827346B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Meter Arrangements (AREA)

Abstract

The invention discloses an automatic test method and an automatic test device for a charge system. The method comprise that: the automatic test device for the charge system acquires the generated test case, wherein the test case is generated according to charging data subjected to daily actual processing; the automatic test device for the charge system analyzes the test cases to acquire an operating mode of the original charge system, first charging data before rating and first charging data after rating in the test case, and sequentially inputs the first charging data before rating into a charge system to be tested to acquire second charging data after rating of the charge system to be tested, which is output by performing the rating processing by adopting the same operating mode as the operating mode of the original charge system; and the automatic test device for the charge system compares the second charging data after rating with the first charging data after rating to determine whether the charging of the charge system to be tested is accurate. The automatic test method for the charge system can realize automatic generation of the test case and the automatic test on the charge system, and has high test efficiency and accuracy.

Description

A kind of charge system automatic test approach and device
Technical field
The present invention relates to the business support field, refer to a kind of charge system automatic test approach and device for the telecommunication service operation support especially.
Background technology
In the telecommunication service OSS, charge system can be carried out wholesale price to user's ticket according to subscriber data.Improve afterwards or the test of the performance (comprising billing accuracy etc.) of the new charge system of exploitation for charge system, certain methods is also arranged at present, but generally all derive from traditional automatic test, the characteristics at charge system are not optimized.Charge system method of testing commonly used comprises following two kinds:
Method one comprises the following steps:
1, starts original charge system, import subscriber data in batches to original charge system.
2, to original charge system input appointment ticket corresponding with subscriber data, original charge system is carried out wholesale price to the ticket of input.
3, obtain subscriber data and corresponding ticket after original charge system wholesale price.
4, start new charge system, to new charge system import in batches with step 1 in identical subscriber data.
5, to the new charge system input ticket identical with appointment ticket in the step 2, new charge system is carried out wholesale price to the ticket of input.
6, with the subscriber data after the new charge system wholesale price and corresponding ticket, compare with the subscriber data that obtains in the step 3 and corresponding ticket.
By new charge system ticket is handled the ruuning situation of verifying new charge system, by the billing accuracy of the new charge system of comparison checking.
Method two comprises the following steps:
1, the tester carries out the design of test cases, with information such as subscriber data, tickets, and the typing test cases.
2, start original charge system, automatic or manual arranges subscriber data in original charge system, imports corresponding ticket, and ticket is carried out wholesale price.
3, subscriber data and the corresponding ticket after the original charge system wholesale price of backup.
4, start new charge system, automatic or manual arranges subscriber data in new charge system, imports corresponding ticket, and ticket is carried out wholesale price.
5, the subscriber data and the ticket that back up in the subscriber data after the new charge system wholesale price and corresponding ticket and the step 3 are compared.
In the method one because subscriber data is to import in batches, in original charge system and/or new charge system, there is parallel processing, then might be because the processing speed difference of each treatment progress of parallel processing, after a process is handled a record, can obtain next bar record continues to handle, because the genesis sequence to ticket after the wholesale price of original charge system and new charge system does not mate, thereby cause the order of ticket writing in the ticket after original charge system and the wholesale price that new charge system obtains may be different, therefore what cause being in ticket writing correspondence after the wholesale price of same order most probably when comparing is not ticket writing before the same wholesale price, as seen, this comparison method is more coarse, accuracy is lower.
In the method two, test cases relies on tester's manual typing, and efficient is lower, when testing, depends on manual input to a great extent, reflects the ticket distribution situation of actual wholesale price if desired, then needs to do very many statistical analysis work.Cause workload big, testing efficiency is low, and accuracy is not lower yet.
The present application people finds, various charge system method of testing of the prior art all can't realize the automatic test of charge system, can not generate test cases automatically based on the ticket of wholesale price of daily processing, when new charge system has increased the record clauses and subclauses with respect to original charge system, can not realize that test cases is simple, the automatic adjustment of adaptivity, adapting to new charge system, and realize test to new charge system.
Summary of the invention
The embodiment of the invention provides a kind of charge system automatic test approach and device, has solved to realize the charge system problem of test automatically in the prior art, has improved testing efficiency and test accuracy.
A kind of charge system automatic test approach comprises:
Generation module is used for generating test cases in advance according to the metering data of setting screening conditions that meets that the metering data from daily processing extracts;
The test cases storehouse is used for the described test cases that the described generation module of storage generates;
Acquisition module, be used for obtaining described test cases, described test cases is to generate according to the metering data of daily actual treatment, the operational mode, first metering data before the wholesale price and first metering data after the wholesale price that wherein comprise former charge system, wherein, first metering data before the described wholesale price comprises subscriber data and the corresponding Original CDR before the wholesale price, and first metering data after the described wholesale price comprises subscriber data and the corresponding ticket after the wholesale price;
Parsing module is used for described test cases is resolved first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price;
Scheduler module, be used for first metering data before the described wholesale price is imported charge system to be measured successively, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the wholesale price of wholesale price processing back output;
Comparing module is used for second metering data after the described wholesale price and first metering data after the described wholesale price are compared, and determines whether the charging of described charge system to be measured is accurate.
In the said apparatus of the present invention, described generation module specifically comprises:
The screening unit, the metering data for obtaining daily actual treatment screens according to the screening conditions that set in advance;
First generation unit, the metering data that meets described screening conditions for selecting according to described screening sieve unit directly generates described test cases;
Second generation unit, be used for according to the adaptation rule of setting corresponding with described charge system to be measured, the metering data that meets described screening conditions that described screening sieve unit is selected upgrades, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading.
Said apparatus of the present invention also comprises:
Adaptation module, be used for when determining described test cases and described charge system to be measured and be not complementary, according to the adaptation rule of setting corresponding with described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in the original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price do not arrange and/or adding described wholesale price and the metering data after the wholesale price are default value, the coupling metering data before the wholesale price that obtains being complementary with described charge system to be measured and the coupling metering data after the wholesale price;
Described scheduler module, be used for the coupling metering data before the described wholesale price is imported charge system to be measured successively, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the described wholesale price of wholesale price processing back output;
Described comparing module is used for second metering data after the described wholesale price and the coupling metering data after the described wholesale price are compared, and determines whether the charging of described charge system is accurate.
A kind of charge system automatic test approach comprises:
The charge system automatic testing equipment obtains the test cases of generation, described test cases is to generate in advance according to the metering data of setting screening conditions that meets that extracts from the metering data of daily processing, and, be stored in advance in the test cases storehouse, the operational mode that wherein comprises former charge system, first metering data before the wholesale price and first metering data after the wholesale price, wherein, first metering data before the described wholesale price comprises subscriber data and the corresponding Original CDR before the wholesale price, and first metering data after the described wholesale price comprises subscriber data and the corresponding ticket after the wholesale price;
Described charge system automatic testing equipment is resolved described test cases, first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price;
First metering data of charge system automatic testing equipment before with described wholesale price imported charge system to be measured successively, obtains described charge system to be measured and adopts the operational mode identical with described former charge system operational mode to carry out second metering data after wholesale price is handled the wholesale price of exporting the back;
The charge system automatic testing equipment after with described wholesale price second metering data and first metering data after the described wholesale price compare, determine whether the charging of described charge system to be measured accurate.
According to said method of the present invention, generate test cases, specifically comprise:
Obtain the metering data of daily actual treatment, screen according to the screening conditions that set in advance;
The metering data that meets described screening conditions according to filtering out directly generates described test cases; Or according to the adaptation rule of setting corresponding with described charge system to be measured, the metering data that meets described screening conditions that filters out is upgraded, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading.
According to said method of the present invention, the metering data that meets described screening conditions that described basis filters out directly generates described test cases, specifically comprises:
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price, obtain subscriber data and corresponding ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price, and obtain former charge system operational mode;
With first metering data of the original charging data before the described wholesale price before as described wholesale price, with first metering data of the metering data after the described wholesale price after as wholesale price, generate the operational mode, first metering data before the wholesale price and the test cases of first metering data after the wholesale price that comprise described charge system.
According to said method of the present invention, according to the adaptation rule of setting corresponding with described charge system to be measured, the metering data that meets described screening conditions that filters out is upgraded, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading, specifically comprise:
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price, obtain subscriber data and corresponding wholesale price ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price, and obtain former charge system operational mode;
According to the adaptation rule of setting corresponding with described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in the original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price do not arrange and/or adding described wholesale price and the metering data after the wholesale price are default value, obtain renewal metering data before the wholesale price and the renewal metering data after the wholesale price;
With first metering data of the renewal metering data before the wholesale price that obtains before as described wholesale price, with first metering data of the renewal metering data after the wholesale price that obtains after as wholesale price, generate the operational mode, first metering data before the wholesale price and the test cases of first metering data after the wholesale price that comprise described charge system.
According to said method of the present invention, the screening conditions of described setting comprise one of following parameters that comprises in the metering data at least:
At least a relevant billing parameter at least a user profile in the operational mode of charge system, the subscriber data, the ticket.
According to said method of the present invention, after the described parsing test cases, first metering data before the described wholesale price is imported before the charge system to be measured successively, also comprise: determine whether described test cases and described charge system to be measured are complementary, and when coupling, continue to carry out first metering data before the wholesale price is imported this step of charge system to be measured successively; When not matching, described method also comprises in definite result:
According to the adaptation rule of setting corresponding with described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in the original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price do not arrange and/or adding described wholesale price and the metering data after the wholesale price are default value, the coupling metering data before the wholesale price that obtains being complementary with described charge system to be measured and the coupling metering data after the wholesale price;
Coupling metering data before the described wholesale price is imported charge system to be measured successively carry out wholesale price, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the described wholesale price of wholesale price processing back output;
Second metering data after the described wholesale price and the coupling metering data after the described wholesale price are compared, determine whether the charging of described charge system to be measured is accurate.
According to said method of the present invention, whether described definite described test cases and described charge system to be measured are complementary, and specifically comprise:
At least one operational factor that in the operational mode of judging described charge system, comprises, at least a user profile in the subscriber data that comprises in first metering data before the described wholesale price, at least a relevant billing parameter in the ticket that comprises in first metering data before the described wholesale price, at least a relevant billing parameter in the ticket that comprises at least a user profile in the subscriber data that comprises in first metering data after the described wholesale price or first metering data after the described wholesale price, when not being complementary with the record clauses and subclauses that arrange in the described charge system to be measured, determine that described test cases and described charge system to be measured are not complementary; Otherwise coupling.
According to said method of the present invention, the described test cases that obtains generation specifically comprises:
Metering data according to daily actual treatment generates test cases, directly obtains the described test cases of generation; Or
Obtain the test cases that the metering data according to daily actual treatment of storage in advance generates in the test cases storehouse.
Charge system automatic test approach and device that the embodiment of the invention provides, by obtaining the test cases of generation, and the test cases that obtains resolved first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price; Wherein, test cases is to generate according to the metering data of setting screening conditions that meets that extracts from the metering data of daily processing.First metering data before the wholesale price is imported charge system to be measured successively, after charge system to be measured adopts the operational mode identical with above-mentioned former charge system operational mode to carry out wholesale price, obtain second metering data after the wholesale price; Second metering data after the wholesale price and first metering data after the wholesale price are compared, determine whether the charging of charge system is accurate.Said method not only can be realized the automatic generation of test cases, and can realize the automatic test to charge system to be measured, and its test cases derives from the metering data of daily processing, is used for the test of charge system to be measured, and its data are true, reliable; And can carry out calling automatically, resolve, according to identical pattern data being carried out the wholesale price processing, reached the automatic comparison after charge system to be measured is handled of test cases, testing efficiency and test accuracy are all very high.
Description of drawings
Fig. 1 is the flow chart of charge system automatic test approach in the embodiment of the invention;
Fig. 2 is the adaptive principle schematic of test cases in the embodiment of the invention;
Fig. 3 is the structural representation of charge system automatic testing equipment in the embodiment of the invention.
Embodiment
The charge system automatic test approach that the embodiment of the invention provides, from the handled metering data of the charge system of day-to-day operation, extract and meet the metering data that imposes a condition and generate test cases automatically, offer charge system to be measured charge (wholesale price) by the test cases that calls generation, and with the test cases that generates in the charging result comparison that comprises, verify the billing accuracy of charge system to be measured, test the ruuning situation of charge system to be measured.Its flow process as shown in Figure 1, execution in step is as follows:
Step S101: generate test cases.Wherein, test cases is to generate according to the metering data of the daily actual treatment of obtaining is automatic.
Especially, test cases can be according to the screening conditions that set in advance, filters out to meet the metering data generation of setting screening conditions from the metering data of the daily processing of charge system normally used.
Test cases can generate the test cases generation by the metering data according to daily actual treatment when test needs, and directly uses; Also can generate some test cases and storage in advance, prepare against when testing in the future and use.
Step S102: the test cases that obtains generation.
The test cases that obtains generation comprises: directly obtain the test cases of generation, or obtain the test cases of storing in the test cases storehouse that generates in advance.
Step S103: the test cases that gets access to is resolved first metering data before the former charge system operational mode that is wherein comprised, the wholesale price and first metering data after the wholesale price.
When more than one of the test cases that obtains, adopt the mode of resolving one by one, obtain first metering data before each self-contained former charge system operational mode, the wholesale price and first metering data after the wholesale price respectively.
Step S104: first metering data before the wholesale price that parses is imported charge system to be measured.
First metering data before the wholesale price comprises: the Original CDR of the subscriber data before the wholesale price that comprises in the test cases and correspondence etc.
Step S105: charge system to be measured adopts the operational mode identical with the former charge system operational mode that parses, and first metering data before the wholesale price of importing is carried out wholesale price, obtains second metering data after the wholesale price.
Need to prove: when charge system is handled metering data, according to the ticket after the order generation wholesale price of charge system operational mode defined, thereby make by the operational mode of charge system to be measured and former charge system is mated, realize to access ticket writing after the wholesale price of sequence consensus at the metering data before the identical wholesale price.
Step S106: second metering data after the charge system output wholesale price to be measured.
Second metering data after the wholesale price comprises: the ticket after the wholesale price of the subscriber data after the charge system wholesale price to be measured and correspondence.
Step S107: first metering data after second metering data after the wholesale price that obtains and the wholesale price that parses in the test cases is compared.
Subscriber data and ticket after the wholesale price that is about to parse in subscriber data after the charge system wholesale price to be measured and the ticket after the corresponding wholesale price and the test cases are compared, with the operation conditions of definite charge system to be measured and the accuracy of charging.
The process that step S101 generates test cases specifically comprises:
Obtain the metering data of daily actual treatment, screen according to setting in advance screening conditions, what filter out meets the metering data of setting screening conditions.Can in every day actual treatment ticket, according to the screening conditions of typing in advance, filter out the ticket of the screening conditions that meet setting, the corresponding charging data record of the ticket of setting screening conditions that meets that filters out is got off.Generate test cases according to the metering data of meeting of filtering out setting screening conditions and can comprise following two kinds of situations:
(1) according to the metering data of setting screening conditions that meets that filters out, directly generates test cases.
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price.Obtain subscriber data and corresponding ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price.And obtain former charge system operational mode.
With first metering data of the original charging data before the wholesale price before as wholesale price, with first metering data of the metering data after the wholesale price after as wholesale price, generate the operational mode, first metering data before the wholesale price and the test cases of the various metering datas such as first metering data after the wholesale price that comprise charge system.
The metering data that in the embodiment of the invention test cases that generates is comprised is called five-tuple, wherein, subscriber data before the wholesale price and corresponding ticket can be referred to as first metering data before the wholesale price, and the subscriber data after the wholesale price and corresponding ticket can be referred to as first metering data after the wholesale price.As seen, five-tuple just refers to the related data that wholesale price relates to, and comprising:
(i) operational mode of charge system.
The operational mode of charge system comprises: according to the system time order generate ticket after the wholesale price, press the ticket time sequencing generate ticket after the wholesale price, by ticket etc. after the processing time order generation wholesale price.
The (ii) subscriber data before the wholesale price.
The scope that subscriber data comprises is very extensive, can comprise in the following message one or more:
Users' self such as user brand, product, user gradation, customer relationship curing information; Users' self such as user's no-charge call the number of minutes variable information; To brand, product, user gradation, the customer relationship of end subscriber, the curing of expansion such as user place customer group or available information etc.
The (iii) Original CDR before the wholesale price.
At least comprise user this employed business and operating position in the Original CDR, operating position can comprise: use duration, data traffic etc.Can also comprise: system time, ticket time, bill services type, ticket roaming type etc.
The (iv) subscriber data after the wholesale price.
Subscriber data after the wholesale price also can comprise one or more in the information of listing in above-mentioned (1).
Some variations may take place in the subscriber data that the subscriber data after the wholesale price is compared before the wholesale price, and for example: after the ticket wholesale price of user's communication, information such as no-charge call the number of minutes of user may change.
(the v) ticket after the wholesale price.
At least comprise the expense that the business of this use of user produces in the ticket after the wholesale price, i.e. the ticket amount of money.
A five-tuple is exactly a complete test cases.For example: can set up a generation module, and use mode such as database to store the test cases of generation.
(2) when variation has taken place with respect to the charge system that generates test cases in charge system to be measured, according to the adaptation rule of setting corresponding with charge system to be measured, the metering data of setting screening conditions that meets that filters out is upgraded, obtain and the metering data for the treatment of after the renewal that examining system is complementary, and generate test cases according to the metering data after upgrading.
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price.Obtain subscriber data and corresponding wholesale price ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price.And obtain former charge system operational mode.
The adaptation rule corresponding with charge system to be measured according to setting upgrades the original charging data before the wholesale price and the metering data after the wholesale price.Be specially: the record clauses and subclauses that comprise in the original charging data before the wholesale price of obtaining and the metering data after the wholesale price are compared with the record clauses and subclauses of charge system setting to be measured.When inequality, if the record clauses and subclauses that the record clauses and subclauses that comprise in the original charging data before the wholesale price of obtaining and the metering data after the wholesale price arrange more than charge system to be measured, then the record clauses and subclauses that do not arrange of the charge system to be measured that comprises in the original charging data before the wholesale price that gets access to of deletion and the metering data after the wholesale price; If and/or the record clauses and subclauses that comprise in the original charging data before the wholesale price of obtaining and the metering data after the wholesale price are less than the record clauses and subclauses that charge system to be measured arranges, be default value with the record clauses and subclauses of adding the charge system setting to be measured that it did not comprise in the original charging data before wholesale price and the metering data after the wholesale price, obtain the preceding renewal metering data of wholesale price and the renewal metering data after the wholesale price.
With first metering data of the renewal metering data before the wholesale price that obtains before as wholesale price, with first metering data of the renewal metering data after the wholesale price that obtains after as wholesale price, generate the operational mode, first metering data before the wholesale price and the test cases of the various metering datas such as first metering data after the wholesale price that comprise charge system.
The variation of above-mentioned charge system can comprise: variation has taken place at least one system operational parameters that comprises in the operational mode of charge system to be measured with respect to the above-mentioned charge system of charge system that generates test cases, variation has taken place at least a user profile in the subscriber data that comprises in first metering data before the wholesale price, variation has taken place at least a relevant billing parameter in the ticket that comprises in first metering data before the wholesale price, variation has taken place at least a user profile in the subscriber data that comprises in first metering data after the wholesale price, or variation etc. has taken place at least a relevant billing parameter in the ticket that comprises in first metering data after the wholesale price; Can also comprise that especially variation has taken place the charge system operational mode.
For example increased column etc. in a certain metering data.When then upgrading metering data, the value of the column that increases in this metering data that has taken place to change is made as default value etc.
Concrete screening conditions can be the environmental variances of charge system, i.e. the operational factor that comprises in the operational mode of charge system; Also can be at least a relevant billing parameter in the ticket, for example: system time, ticket time, bill services type, ticket roaming type, ticket amount of money etc.; Can also be at least a user profile in the subscriber data, for example: user brand, product, user gradation, customer relationship, user's no-charge call the number of minutes etc.
For example: certain operator newly releases after the product of cluster conversation, and original test cases storehouse needs to expand, and namely needs to generate new test cases.Then can in the case generation module, be configured, screening conditions be arranged as follows:
Air time: 2008.8.10:00 ~ 2008.9.10:00;
Ticket matching product: group's cluster basic product, the preferential bag of group's cluster A, the preferential bag of group's cluster B;
Screening time of implementation: 2008.8.10:00 ~ 2008.9.12:00.
Generally in order to include the delay ticket in, screening time can proper extension.For example above-mentioned prolongation two hours was exactly in order to include the delay ticket in.
After configuration is finished, charge system is when carrying out normal wholesale price, can start screening sequence, if match the ticket that meets screening conditions, system can call test cases automatically and go into library, the corresponding five-tuple of ticket that will meet screening conditions carries out layout, generates test cases, in the typing test cases storehouse.Like this, all of in August, 2008 meet the cluster ticket of setting screening conditions and all have been included into the test cases storehouse, and the integrality of test cases is guaranteed in mode very accurately and efficiently.
Among the step S103 test cases that gets access to is resolved first metering data before the former charge system operational mode of the meter that is wherein comprised, the wholesale price and first metering data after the wholesale price.Specifically comprise:
By test cases is resolved, original input data when restoring normal wholesale price, comprise first metering data before the former charge system operational mode, wholesale price (comprise the wholesale price that comprises in the test cases before subscriber data and corresponding Original CDR) etc., offer charge system to be measured as original input data; Parsing first metering data after the wholesale price (comprise the wholesale price that comprises in the test cases after subscriber data and corresponding ticket) uses as normal data as a result the time at follow-up contrastive test.
And the system parameterss such as former charge system operational mode by parsing, guarantee that charge system to be measured is consistent with internal environment and the external environment condition of the charge system that generates test cases.
First metering data among the step S104 before the wholesale price of input charge system to be measured comprises subscriber data before the wholesale price that parses in the test cases and corresponding Original CDR etc.
Among the step S105, when generating second metering data after the wholesale price, be that the order according to former charge system operational mode defined generates.
When comparing among the step S107, ticket after the wholesale price that comprises in ticket after the wholesale price that charge system to be measured is generated according to the order of former charge system operational mode defined and each test cases is compared one by one, obtains the charge system to be measured shared proportion of ticket accurately that charges.
After the step S103, before the step S104, can also comprise: determine whether test cases and described charge system to be measured are complementary, and when coupling, continue to carry out former step S104; When determining test cases and charge system to be measured and not being complementary, according to the adaptation rule of setting corresponding with charge system to be measured before to wholesale price first metering data and first metering data after the wholesale price carry out adaptive, the coupling metering data before the wholesale price that obtains being complementary with charge system to be measured and the coupling metering data after the wholesale price.
Wherein, carry out adaptive being specially: the record clauses and subclauses that comprise in the original charging data before the wholesale price of obtaining and the metering data after the wholesale price are compared with the record clauses and subclauses of charge system setting to be measured.When inequality, if the record clauses and subclauses that comprise in the original charging data before the wholesale price of obtaining and the metering data after the wholesale price, are then deleted the record clauses and subclauses that the charge system to be measured that comprises in original charging data before the wholesale price and the metering data after the wholesale price does not arrange more than the record clauses and subclauses that charge system to be measured arranges; If and/or the record clauses and subclauses that comprise are less than the record clauses and subclauses that charge system to be measured arranges in the original charging data before the wholesale price of obtaining and the metering data after the wholesale price, are default value with the record clauses and subclauses of adding the charge system setting to be measured that it did not comprise in the original charging data before wholesale price and the metering data after the wholesale price.
The principle of the metering data comparison after the test cases charge system wholesale price adaptive and to be measured is illustrated as shown in Figure 2:
According to the adaptation rule of setting corresponding with charge system to be measured, respectively the subscriber data before the wholesale price that comprises in the operational mode of charge system, first metering data before the wholesale price and the Original CDR before the wholesale price are carried out adaptively, obtain subscriber data adaptive before the wholesale price and the adaptive Original CDR before the wholesale price; After adaptive Original CDR before charge system to be measured is to wholesale price charges, obtain adaptive subscriber data after the wholesale price and the adaptive ticket after the wholesale price.Respectively with the adaptive subscriber data after the wholesale price and the adaptive ticket after the wholesale price, compare with subscriber data after the wholesale price that comprises in first metering data after the wholesale price and the ticket after the wholesale price, when comparison, consider the adaptation rule corresponding with charge system to be measured of above-mentioned setting.
At least one operational factor that in the operational mode of judging charge system, comprises, at least a user profile in the subscriber data that comprises in first metering data before the wholesale price, at least a relevant billing parameter in the ticket that comprises in first metering data before the wholesale price, at least a relevant billing parameter in the ticket that comprises at least a user profile in the subscriber data that comprises in first metering data after the wholesale price or first metering data after the wholesale price, when not being complementary with the record clauses and subclauses for the treatment of to arrange in the examining system, determine that this test cases and charge system to be measured are not complementary.
Especially, when charge system to be measured in column setting (being the parameter that comprises in a certain the metering data) variation has taken place with respect to the charge system of extracting test cases, that is to say: variation has taken place in the record clauses and subclauses of setting, for example: when having increased column newly, need carry out adaptive migration to test cases.
For example: charge system to be measured is changed with respect to the charge system that generates test cases: when subscriber data has increased a column newly, the test cases that generates can't be directly used in charge system to be measured, it is tested, then need to carry out the adaptive migration of test cases.
The embodiment of the invention can realize original test cases is carried out adaptive simply automatically.
Variation has taken place in the transformation by charge system which parameter in the five-tuple as can be known, according to the adaptation rule of setting, after resolving test cases, the value of newly-increased column is set.For example: the value that newly-increased column is set is unified default value.When the metering data after the wholesale price that parses in the metering data after the follow-up wholesale price that test is obtained and the test cases is compared, consider this adaptation rule, i.e. other set points that new projects are default value or obtain by default value in the metering data after the wholesale price.For example: for having increased free talk time, the value of these new projects also can be that default value deducts message minute etc.
Among the step S104, need that then the coupling metering data before the wholesale price is imported charge system to be measured successively and carry out wholesale price, obtain second metering data after the charge system employing to be measured operational mode identical with former charge system operational mode carried out the wholesale price of wholesale price processing back output.
Among the step S107, then need second metering data after the wholesale price and the coupling metering data after the wholesale price are compared, determine whether the charging of described charge system to be measured is accurate.
Above-mentioned charge system automatic test approach according to the embodiment of the invention provides can make up a kind of charge system automatic testing equipment, as shown in Figure 3, comprising: acquisition module 101, parsing module 102, scheduler module 103 and comparing module 104.
Acquisition module 101 is used for obtaining the test cases of generation, and wherein, test cases is to generate according to the metering data from daily actual treatment, can extract wherein to meet to generate behind the metering data of setting screening conditions.
Parsing module 102 is used for the test cases that acquisition module 101 gets access to is resolved first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price.
Scheduler module 103, first metering data before the wholesale price that is used for parsing module 102 is parsed is imported charge system to be measured successively, obtains charge system to be measured and adopts the identical operational mode of former charge system operational mode that parses with parsing module 102 to carry out second metering data after wholesale price is handled the wholesale price of exporting the back.
Comparing module 104, first metering data after the wholesale price that second metering data after the wholesale price that is used for scheduler module 103 is obtained and parsing module 102 parse is compared, and determines whether the charging of charge system to be measured is accurate.
Above-mentioned charge system automatic testing equipment also comprises: generation module 105 and test cases storehouse 106.
Generation module 105 is used for generating test cases according to the metering data of setting screening conditions that meets that the metering data from daily actual treatment extracts.
Preferable, generation module 105 further can comprise: screening unit 1051, first generation unit 1052 or second generation unit 1053.
Screening unit 1051 is used for obtaining the metering data of daily processing, screens according to the screening conditions that set in advance.
First generation unit 1052, the metering data for the screening conditions that meet setting that filter out according to screening unit 1051 directly generates test cases.
Second generation unit 1053, be used for according to the adaptation rule of setting corresponding with charge system to be measured, metering data to the screening conditions that meet setting that filter out of screening unit 1051 upgrades, obtain and the metering data for the treatment of after the renewal that examining system is complementary, and generate test cases according to the metering data after upgrading.
Test cases storehouse 106 is used for the test cases that storage generation module 105 generates.
Acquisition module 101, concrete being used for directly obtained the test cases of generation from generation module 105; Or obtain in the test cases storehouse 106 test cases that generates in advance of storage.
Above-mentioned charge system automatic testing equipment, also comprise: adaptation module 107, be used for when determining test cases and charge system to be measured and be not complementary, according to the adaptation rule of setting corresponding with charge system to be measured before to the wholesale price that comprises in the test cases first metering data and first metering data after the wholesale price carry out adaptive, deletion before the wholesale price original charging data and the metering data after the wholesale price in the record clauses and subclauses that do not arrange of the charge system described to be measured that comprises and/or be default value with the record clauses and subclauses of adding the charge system setting to be measured that does not comprise in original charging data before the wholesale price and the metering data after the wholesale price, the coupling metering data before the wholesale price that obtains being complementary with charge system to be measured and the coupling metering data after the wholesale price.
Scheduler module 103 also is used for the coupling metering data before the wholesale price is imported charge system to be measured successively, obtains second metering data after the charge system employing to be measured operational mode identical with former charge system operational mode carried out the wholesale price of wholesale price processing back output.
Comparing module 104 also is used for second metering data after the wholesale price and the coupling metering data after the wholesale price are compared, and determines whether the charging of charge system is accurate.
Above-mentioned charge system automatic test approach and device that the embodiment of the invention provides, screen by the metering data to daily actual treatment, obtain and meet the metering data generation test cases of setting screening conditions, realized the automatic generation of test cases, the mistake of having avoided the human-edited to occur has easily improved efficient and accuracy.Make to be used for treating that the metering data of examining system derives from the daily deal with data of the charge system of having used that data are objective, true, the reliability height has high fidelity and confidence level.
Above-mentioned charge system automatic test approach and device that the embodiment of the invention provides, can realize the automatic test to all types of service, by obtaining the test cases of generation, and the test cases that obtains resolved first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price; Adopt the operational mode identical with above-mentioned former charge system operational mode, first metering data before the wholesale price is imported charge system to be measured successively carry out wholesale price, obtain second metering data after the wholesale price; Second metering data after the wholesale price and first metering data after the wholesale price are compared, determine whether the charging of charge system is accurate.Can realize the automatic test to charge system to be measured, and can carry out calling automatically, resolve, according to identical pattern data being carried out the wholesale price processing, reached the automatic comparison after charge system to be measured is handled of test cases, testing efficiency and test accuracy are all very high.By the pattern matching of charge system, make the record that is able to metering data after second data after the wholesale price and the wholesale price can be good at coupling in proper order, thereby can access test result more accurately.
And when charge system to be measured has been carried out change with the charge system that generates test cases relatively, can carry out adaptive migration, to adapt to the requirement of charge system to be measured according to the test cases that generates.Adaptive migration can be at the test cases of storing in the test cases storehouse, and the test cases after will upgrading after carrying out adaptive migration is stored in the test cases storehouse; Adaptive migration also can be found to carry out when itself and charge system to be measured do not match after obtaining test cases, and flexibility height, adaptability are strong.
The above; only be the preferable embodiment of the present invention; but protection scope of the present invention is not limited thereto; anyly be familiar with those skilled in the art in the technical scope that the present invention discloses; the variation that can expect easily, replace or be applied to other similar devices, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of claims.

Claims (11)

1. a charge system automatic testing equipment is characterized in that, comprising:
Generation module is used for generating test cases in advance according to the metering data of setting screening conditions that meets that the metering data from daily processing extracts;
The test cases storehouse is used for the described test cases that the described generation module of storage generates in advance;
Acquisition module, be used for obtaining described test cases, described test cases is to generate according to the metering data of daily actual treatment, the operational mode, first metering data before the wholesale price and first metering data after the wholesale price that wherein comprise former charge system, wherein, first metering data before the described wholesale price comprises subscriber data and the corresponding Original CDR before the wholesale price, and first metering data after the described wholesale price comprises subscriber data and the corresponding ticket after the wholesale price;
Parsing module is used for described test cases is resolved first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price;
Scheduler module, be used for first metering data before the described wholesale price is imported charge system to be measured successively, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the wholesale price of wholesale price processing back output;
Comparing module is used for second metering data after the described wholesale price and first metering data after the described wholesale price are compared, and determines whether the charging of described charge system to be measured is accurate.
2. device as claimed in claim 1 is characterized in that, described generation module specifically comprises:
The screening unit, the metering data for obtaining daily actual treatment screens according to the screening conditions that set in advance;
First generation unit, the metering data that meets described screening conditions for selecting according to described screening sieve unit directly generates described test cases;
Second generation unit, be used for according to the adaptation rule of setting corresponding with described charge system to be measured, the metering data that meets described screening conditions that described screening sieve unit is selected upgrades, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading.
3. as the arbitrary described device of claim 1-2, it is characterized in that, also comprise:
Adaptation module, be used for when determining described test cases and described charge system to be measured and be not complementary, according to the adaptation rule of setting corresponding with described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in the original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price do not arrange and/or adding described wholesale price and the metering data after the wholesale price are default value, the coupling metering data before the wholesale price that obtains being complementary with described charge system to be measured and the coupling metering data after the wholesale price;
Described scheduler module, be used for the coupling metering data before the described wholesale price is imported charge system to be measured successively, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the described wholesale price of wholesale price processing back output;
Described comparing module is used for second metering data after the described wholesale price and the coupling metering data after the described wholesale price are compared, and determines whether the charging of described charge system is accurate.
4. a charge system automatic test approach is characterized in that, comprising:
The charge system automatic testing equipment obtains the test cases of generation, described test cases is to generate in advance according to the metering data of setting screening conditions that meets that extracts from the metering data of daily processing, and, be stored in advance in the test cases storehouse, the operational mode that wherein comprises former charge system, first metering data before the wholesale price and first metering data after the wholesale price, wherein, first metering data before the described wholesale price comprises subscriber data and the corresponding Original CDR before the wholesale price, and first metering data after the described wholesale price comprises subscriber data and the corresponding ticket after the wholesale price;
Described charge system automatic testing equipment is resolved described test cases, first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price;
First metering data of charge system automatic testing equipment before with described wholesale price imported charge system to be measured successively, obtains described charge system to be measured and adopts the operational mode identical with described former charge system operational mode to carry out second metering data after wholesale price is handled the wholesale price of exporting the back;
The charge system automatic testing equipment after with described wholesale price second metering data and first metering data after the described wholesale price compare, determine whether the charging of described charge system to be measured accurate.
5. method as claimed in claim 4 is characterized in that, generates test cases, specifically comprises:
Obtain the metering data of daily actual treatment, screen according to the screening conditions that set in advance;
The metering data that meets described screening conditions according to filtering out directly generates described test cases; Or according to the adaptation rule of setting corresponding with described charge system to be measured, the metering data that meets described screening conditions that filters out is upgraded, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading.
6. method as claimed in claim 5 is characterized in that, the metering data that meets described screening conditions that described basis filters out directly generates described test cases, specifically comprises:
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price, obtain subscriber data and corresponding ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price, and obtain former charge system operational mode;
With first metering data of the original charging data before the described wholesale price before as described wholesale price, with first metering data of the metering data after the described wholesale price after as wholesale price, generate the operational mode, first metering data before the wholesale price and the test cases of first metering data after the wholesale price that comprise described charge system.
7. method as claimed in claim 5, it is characterized in that, according to the adaptation rule of setting corresponding with described charge system to be measured, the metering data that meets described screening conditions that filters out is upgraded, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading, specifically comprise:
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price, obtain subscriber data and corresponding wholesale price ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price, and obtain former charge system operational mode;
According to the adaptation rule of setting corresponding with described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in the original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price do not arrange and/or adding described wholesale price and the metering data after the wholesale price are default value, obtain renewal metering data before the wholesale price and the renewal metering data after the wholesale price;
With first metering data of the renewal metering data before the wholesale price that obtains before as described wholesale price, with first metering data of the renewal metering data after the wholesale price that obtains after as wholesale price, generate the operational mode, first metering data before the wholesale price and the test cases of first metering data after the wholesale price that comprise described charge system.
8. as claim 6 or 7 described methods, it is characterized in that the screening conditions of described setting comprise one of following parameters that comprises in the metering data at least:
At least a relevant billing parameter at least a user profile in the operational mode of charge system, the subscriber data, the ticket.
9. as the arbitrary described method of claim 4-7, it is characterized in that, after the described parsing test cases, first metering data before the described wholesale price is imported before the charge system to be measured successively, also comprise: determine whether described test cases and described charge system to be measured are complementary, and when coupling, continue to carry out first metering data before the wholesale price is imported this step of charge system to be measured successively; When not matching, described method also comprises in definite result:
According to the adaptation rule of setting corresponding with described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in the original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price do not arrange and/or adding described wholesale price and the metering data after the wholesale price are default value, the coupling metering data before the wholesale price that obtains being complementary with described charge system to be measured and the coupling metering data after the wholesale price;
Coupling metering data before the described wholesale price is imported charge system to be measured successively carry out wholesale price, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the described wholesale price of wholesale price processing back output;
Second metering data after the described wholesale price and the coupling metering data after the described wholesale price are compared, determine whether the charging of described charge system to be measured is accurate.
10. method as claimed in claim 9 is characterized in that, whether described definite described test cases and described charge system to be measured are complementary, and specifically comprise:
At least one operational factor that in the operational mode of judging described charge system, comprises, at least a user profile in the subscriber data that comprises in first metering data before the described wholesale price, at least a relevant billing parameter in the ticket that comprises in first metering data before the described wholesale price, at least a relevant billing parameter in the ticket that comprises at least a user profile in the subscriber data that comprises in first metering data after the described wholesale price or first metering data after the described wholesale price, when not being complementary with the record clauses and subclauses that arrange in the described charge system to be measured, determine that described test cases and described charge system to be measured are not complementary; Otherwise coupling.
11. method as claimed in claim 10 is characterized in that, the described test cases that obtains generation specifically comprises:
Metering data according to daily actual treatment generates test cases, directly obtains the described test cases of generation; Or
Obtain the test cases that the metering data according to daily actual treatment of storage in advance generates in the test cases storehouse.
CN 200910047257 2009-03-04 2009-03-04 Automatic test method and device for charge system Active CN101827346B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200910047257 CN101827346B (en) 2009-03-04 2009-03-04 Automatic test method and device for charge system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200910047257 CN101827346B (en) 2009-03-04 2009-03-04 Automatic test method and device for charge system

Publications (2)

Publication Number Publication Date
CN101827346A CN101827346A (en) 2010-09-08
CN101827346B true CN101827346B (en) 2013-07-17

Family

ID=42691001

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200910047257 Active CN101827346B (en) 2009-03-04 2009-03-04 Automatic test method and device for charge system

Country Status (1)

Country Link
CN (1) CN101827346B (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102231876A (en) * 2011-06-24 2011-11-02 华为软件技术有限公司 Compatibility test method and device of billing system
TWI493336B (en) * 2013-03-20 2015-07-21 Chunghwa Telecom Co Ltd Application of new case feedback in automated software verification system and its method
CN104780074B (en) * 2015-02-02 2018-04-06 广州天源迪科信息技术有限公司 Multi-protocols smart message analogue system and method
CN105139184A (en) * 2015-08-10 2015-12-09 北京思特奇信息技术股份有限公司 Diversified data calculation method and diversified data calculation system
CN105374131A (en) * 2015-10-28 2016-03-02 深圳怡化电脑股份有限公司 Method and device for automatic testing
CN105405220A (en) * 2015-10-28 2016-03-16 深圳怡化电脑股份有限公司 Method and device for automated test
WO2017116338A1 (en) 2015-12-30 2017-07-06 Turkcell Teknoloji Arastirma Ve Gelistirme Anonim Sirketi A verification system for charging changes
CN108632047B (en) * 2017-03-21 2020-10-09 华为技术有限公司 Method and device for determining tariff data
CN109871309B (en) * 2017-12-04 2020-12-04 ***通信集团公司 Method and system for generating test case of charging system
CN110706010B (en) * 2018-07-09 2024-04-16 北京京东尚科信息技术有限公司 Charging model monitoring method and system, computer system and computer readable medium
CN111367875B (en) * 2018-12-25 2023-04-07 中移信息技术有限公司 Ticket file processing method, system, equipment and medium
CN111858291B (en) * 2019-04-30 2022-04-22 华为技术有限公司 Root cause determination method, equipment and system for data abnormity in charging system migration test
CN111309758B (en) * 2020-01-19 2024-02-13 北京金堤科技有限公司 Charging data verification comparison method and device
CN113452533B (en) * 2020-03-24 2022-08-02 ***通信集团山东有限公司 Charging self-inspection and self-healing method and device, computer equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1409514A (en) * 2002-09-10 2003-04-09 ***通信计量中心 Charge detector
CN1521994A (en) * 2003-02-14 2004-08-18 华为技术有限公司 Method for implementing automatic test of intelligent service

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1852155A (en) * 2005-10-27 2006-10-25 华为技术有限公司 Method for realizing charge of advertisement business

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1409514A (en) * 2002-09-10 2003-04-09 ***通信计量中心 Charge detector
CN1521994A (en) * 2003-02-14 2004-08-18 华为技术有限公司 Method for implementing automatic test of intelligent service

Also Published As

Publication number Publication date
CN101827346A (en) 2010-09-08

Similar Documents

Publication Publication Date Title
CN101827346B (en) Automatic test method and device for charge system
CN109871309B (en) Method and system for generating test case of charging system
CN103150696A (en) Method and device for selecting potential customer of target value-added service
CA2677534C (en) Tariff management test automation
CN108632047B (en) Method and device for determining tariff data
CN103365765A (en) Test case screening method and test case screening system for testing
CN103593465A (en) Method and device for diagnosing abnormality of application popularization channel
CN101730043A (en) Pricing test method and system
CN111240983A (en) Method and device for realizing automatic test of telecommunication charging service
EP2090089B1 (en) Method and system for monitoring traffic revenue flows for communications companies
CN105245396A (en) Fee verification method and fee verification system
CN102486748A (en) Method and device for performance test
CN102572806A (en) Mobile terminal adapting system and method based on Msky platform
CN102025555A (en) Method and device for testing IP multimedia sub-system performance
CN101227349B (en) Device and method for automatically testing system change
CN105139184A (en) Diversified data calculation method and diversified data calculation system
CN109429260A (en) A kind of method of calibration and device of northbound data
CN103902450A (en) Analyzing method and system of advertisement piece normal behavior in mobile application
CN109359279B (en) Report generation method, report generation device, computer equipment and storage medium
CN113452533B (en) Charging self-inspection and self-healing method and device, computer equipment and storage medium
CN113011869A (en) Test data generation method and device and computer readable storage medium
CN101511075A (en) Communication service billing method and communication service billing system
CN110166636A (en) Device, method and the storage medium of pressure test
WO2014200427A1 (en) Verification method and system
CN112364058B (en) Auditing method and device for commodity price configuration

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant