CN110908892A - Interface data testing method and device and readable storage medium - Google Patents
Interface data testing method and device and readable storage medium Download PDFInfo
- Publication number
- CN110908892A CN110908892A CN201910883067.7A CN201910883067A CN110908892A CN 110908892 A CN110908892 A CN 110908892A CN 201910883067 A CN201910883067 A CN 201910883067A CN 110908892 A CN110908892 A CN 110908892A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- key
- interface
- test
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 234
- 238000000034 method Methods 0.000 claims abstract description 29
- 238000004590 computer program Methods 0.000 claims description 11
- 238000012163 sequencing technique Methods 0.000 claims description 8
- 230000004044 response Effects 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 14
- 230000001174 ascending effect Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention provides an interface data testing method, an interface data testing device and a readable storage medium. The method comprises the following steps: the method comprises the steps of obtaining interface information of a target test interface, sending the interface information to a server, receiving first data returned by the server through the target test interface, extracting target test data in the first data, counting the number of first items of the target test data, sending a first query instruction to a database server, wherein the first query instruction is generated according to Key data in Key value pairs in a target data group, receiving second data returned by the database server, and counting the number of second items of the second data; and if the number of the first entries is not equal to that of the second entries, determining a first test result and displaying the first test result, wherein the first test result indicates that the target test interface fails in testing. The testing time and the labor cost are saved to a certain extent, and the interface data testing efficiency is improved.
Description
Technical Field
The present invention relates to the field of communications, and in particular, to a method and an apparatus for testing interface data, and a readable storage medium.
Background
One means of web Interface testing, i.e., automated testing standing above the User Interface (UI) layer of a web service program, is to test the correctness of the web service program's business logic from the User's perspective. The focus of the test is to check the correctness of the interface data around the exposed interface of the web service program.
The interface testing tools which are widely used at present are a meter, a souui, a postman and the like. The existing interface data testing method comprises the following steps: the method comprises the steps that terminal equipment (such as a computer) obtains a database query instruction written by a tester, the database query instruction is sent to a database server with a database deployed, and the terminal equipment receives data (including fields and field values corresponding to the fields) returned by the database server. Then, in an interface test tool, a tester inputs interface information, the test tool sends the interface information to a system server deployed by a system providing an interface so as to obtain interface data (json string format) returned by the interface, and the interface data is compared with data returned by a database server manually to judge whether the interface data is correct.
Disclosure of Invention
The embodiment of the invention provides an interface data testing method, an interface data testing device and a readable storage medium, and aims to solve the problems that time is consumed and efficiency is low when the interface data is judged to be correct by comparing the interface data with data returned by a database server manually at present.
In a first aspect of the embodiments of the present invention, a method for testing interface data is provided, including:
acquiring interface information of a target test interface and sending the interface information to a server;
receiving first data returned by the server through the target test interface, extracting target test data in the first data, and counting the number of first items of the target test data;
sending a first query instruction to a database server, wherein the first query instruction is generated according to Key data in a Key value pair in a target data group, the target data group is any one data group in the target test data, and the data group comprises at least one Key value pair;
receiving second data returned by the database server, and counting the number of second entries of the second data;
and if the number of the first entries is not equal to the number of the second entries, determining a first test result and displaying the first test result, wherein the first test result indicates that the target test interface fails in testing.
In a second aspect of the embodiments of the present invention, there is provided an interface data testing apparatus, including:
the acquisition module is used for acquiring interface information of the target test interface and sending the interface information to the server;
the statistical module is used for receiving first data returned by the server through the target test interface, extracting target test data in the first data and counting the first number of items of the target test data;
a sending module, configured to send a first query instruction to a database server, where the first query instruction is generated according to Key data in a Key value pair in a target data group, the target data group is any one of the target test data, and the data group includes at least one Key value pair;
the statistical module is further used for receiving second data returned by the database server and counting the number of second entries of the second data;
and the first determining module is used for determining a first test result and displaying the first test result if the first number of the entries is not equal to the second number of the entries, wherein the first test result indicates that the target test interface fails to test.
In a third aspect of the embodiments of the present invention, a computer-readable storage medium is provided, on which a computer program is stored, and the computer program, when being executed by a processor, implements the steps of the interface data testing method described above.
In a fourth aspect of the embodiments of the present invention, there is provided an electronic device, including:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the interface data testing method described above via execution of the executable instructions.
Aiming at the prior art, the invention has the following advantages:
the method comprises the steps of obtaining interface information of a target test interface, sending the interface information to a server, receiving first data returned by the server through the target test interface, extracting target test data in the first data, counting the number of first items of the target test data, sending a first query instruction to a database server, wherein the first query instruction is generated according to Key data in Key value pairs in a target data group, receiving second data returned by the database server, and counting the number of second items of the second data; and if the number of the first entries is not equal to that of the second entries, determining a first test result and displaying the first test result, wherein the first test result indicates that the target test interface fails in testing. As the data returned by the interface and the data returned by the database server do not need to be compared manually to determine whether the data returned by the interface is consistent or not in the prior art, the testing time and the labor cost are saved to a certain extent, and the testing efficiency of the interface data is improved.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a system architecture diagram of an interface data testing method according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating steps of a method for testing interface data according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating first data according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating second data according to an embodiment of the present invention;
FIG. 5 is a flowchart illustrating steps of another method for testing interface data according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating third data according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a first data set obtaining process provided by an embodiment of the invention;
FIG. 8 is a schematic diagram of a second data set acquisition process provided by an embodiment of the invention;
fig. 9 is a schematic structural diagram of an interface data testing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
It should be understood that the specific embodiments described herein are merely illustrative of the invention, but do not limit the invention to only some, but not all embodiments.
Referring to fig. 1, fig. 1 is a system architecture diagram of an interface data testing method according to an embodiment of the present invention. The system comprises a terminal device 101, a database server 102 and a server 103. The terminal device may include an electronic device such as a desktop computer, a notebook computer, and a tablet computer, and a browser or an interface test tool may be deployed on the terminal device 101. The database server 102 has a database deployed thereon. Server 103 is a server deployed by a system that provides a target test interface.
In the prior art, if a target test interface needs to be tested, a tester needs to understand a service logic, write a database query statement (i.e., a query instruction) according to the understanding of the tester, so as to query data in the database server 102 through the database query statement, and the database server 102 queries the data in the database in response to the query instruction and returns a data table structure including a field and a field value corresponding to the field. Then, in the interface test tool or the browser, interface information of the target test interface is input to obtain data returned by the target test interface, where the data returned by the target test interface is obtained by the target test interface from the server 103, and the data returned by the target test interface is data in a json string format. And then, manually comparing the data in the data table structure with the data returned by the target test interface to check the correctness of the target test interface, wherein if the data returned by the target test interface is completely consistent with the data in the data table structure, the target test interface tests to be passed, and if the data returned by the target test interface is inconsistent with the data in the data table structure, the target test interface tests to be failed. This manual comparison is time consuming and inefficient. And the data returned by the target test interface is often unordered, i.e., both the rows and columns of data are unordered. The fixed row and column of data in the data table structure makes it difficult for the tester to write the automatic test script.
For example: the data returned by the target test interface is data in a json string format, and for simplicity of explanation, the data returned by the target test interface is represented in the following form:
{
"gender" means "male",
"name" means "zhang feng",
“age”:“35”,
"acquired background": master ",
native Place, Shanghai "
}
{
"acquired background": scholar,
"name": "plum red",
“age”:“20”,
"gender" means "women",
native Place, Beijing "
}
For example, "male" indicates a Key Value pair, "male" indicates a Key (Key data) in the Key Value pair, and "male" indicates a Value (Value data) in the Key Value pair.
The data in the data table structure is shown in table 1 below, where name represents a field, liptin represents a field value of the field, the first row of data is a row of data arranged horizontally, liptin is data in a first row and a first column in table 1, zhang is data in a second row and a first column in table 1, and so on, and no other exemplary data is described one by one.
name | gender | age | nativePlace | educationalBackground | |
Plum | Woman | 20 | Beijing | Bachelor | |
Zhang Feng (a Chinese character of 'Zhang Feng') | For |
35 | Shanghai province | Master's soldier |
TABLE 1
And taking the data included in one pair of the data returned by the target test interface as a set of data, wherein the first data included in the pair of the data is taken as a first set of data, and the second data included in the pair of the data is taken as a second set of data. As can be seen from the data returned by the target test interface and the data shown in table 1, Key data (generator) in the first Key-Value pair in the first set of data is inconsistent with the field corresponding to the data in the first row and the first column in table 1, that is, the columns are inconsistent, and Value data in the first Key-Value pair in the first set of data is inconsistent with the data in the first row and the first column. Thus, for example, a field matching Key data (sender) in a first Key Value pair needs to be found in table 1, a field matching Key data (name) in a second Key Value pair in the first group of data needs to be found in table 1, Value data (male) corresponding to comparison Key data (sender) is not consistent with a field Value corresponding to field sender in table 1, and Value data (span) corresponding to comparison Key data (name) is not consistent with a field Value corresponding to field name in table 1. Therefore, the workload required for manually comparing the target interface return data and the data of the data table structure is huge, so that the time required for testing whether the target test interface passes the test is long, the labor cost is high, and the efficiency is low.
And when the data returned by the target test interface is huge, for example, more than one hundred pieces of data, the manual comparison is more time-consuming, and the efficiency is lower.
In order to solve the above technical problem, based on fig. 1, an embodiment of the present invention provides an interface data testing method. Referring to fig. 2 and fig. 2 are flowcharts illustrating steps of an interface data testing method according to an embodiment of the present invention, where the interface data testing method according to the embodiment is suitable for determining whether interface data is correct without manually comparing the interface data with data returned by a database server. The method provided by the embodiment can be executed by a terminal device, such as a computer, deployed with a browser or an interface testing tool. The method of the embodiment comprises the following steps:
The interface information includes a Uniform Resource Locator (URL). The URL includes, for example, a Protocol, an Internet Protocol (IP) address, a port, an interface path, and the like. The Protocol is, for example, HyperText Transfer Protocol (HTTP), HyperText Transfer Protocol security Protocol (HTTPs); the IP address is the address of a server deployed by a system providing the interface; if the port is not filled, the port is regarded as a default port; the interface path refers to the location of the interface provided by the system. For example, the interface information is http://10.130.214.111:8010/ltcfsc/pia/app/custapp/v 1/customer/customerinfoList; the protocol is an HTTP protocol, the address of the server is 10.130.214.111, the port is 8010, and the interface path is/ltcfsc/pia/app/cuprapp/v 1/customer/customerinfoList. The server is deployed for a system providing an access point mapping test port, acquires interface data through the target test interface after receiving the interface information, and returns the interface data to the terminal equipment through the target test interface.
The first data returned by the server through the target test interface is interface data, the first data returned by the interface is, for example, data shown in fig. 3, and fig. 3 is a schematic diagram of the first data provided in the embodiment of the present invention, that is, data shown as follows:
{ "total": 333, "head: { "id": null, "time": null, "systemname": null, "uid": null, "status": "success", "status code": null, "msg": "query success", "infoMsg": null, "code": null, "customerCode": null, "customeId": null }, "data":
[ { "gender": "male", "name": open peak "," age ": 35", "textual background": master "," native place ": shanghai" }, { "textual background": scholar "," name ": li red", "age": 20 "," gender ": female", "native place": beijing "}"
Extracting data (data) to be verified from the first data, where the data to be verified is target test data, and for example, the extracted target test data is as follows:
and counting the number of the first entries of the target test data, for example, the number of the first entries of the target test data is equal to 2, that is, there are two groups of data in total. The first data set is: "sender": male "," name ": zhang", "age": 35 "," organizational background ": master", "native place": shanghai ". The second data set is: "acquired background": scholars "," names ": plum red", "age": 20 "," gender ": women", "native place": Beijing ".
As introduced in step 202, a first data set may be selected as a target data set, where the target data set includes 5 key-value pairs: "sender": male "," name ": zhangfeng", "age": 35 "," organizational background ": master", "native place": shanghai ", wherein, the key value pair" sender ": the "sender" in the "male" is the Key data in the Key Value pair, the "male" is the Value data in the Key Value pair, the "name" in the Key Value pair "name", the "span" is the Key data in the Key Value pair, the "span" is the Value data in the Key Value pair, and so on, and the description is omitted. For example, a first group of data is selected as a target data group, a first query instruction may be generated according to Key data in a Key value pair in the first data group, the Key data in the Key value pair in the first data group includes a sender, a name, a age, an organizational background, and a native place, a first query instruction may be generated according to the Key data in the Key value pair in the first data group, and the query instruction is sent to a database server, where the generated first query instruction is, for example: the select generator, name, age, organizational background, native place from table, table is the table name of the data table.
And step 204, receiving second data returned by the database server, and counting the number of second entries of the second data.
And after receiving the first query instruction, the database server responds to the first query instruction to acquire second data and returns the second data to the terminal equipment. Referring to fig. 4, fig. 4 is a schematic diagram of second data provided in an embodiment of the present invention. I.e., second data such as the data shown in table 2 below:
gender | name | age | educationalBackground | nativePlace |
for male | Zhang Feng (a Chinese character of 'Zhang Feng') | 35 | Master's soldier | Shanghai province |
Woman | |
20 | Bachelor | Beijing |
TABLE 2
The second number of entries, i.e., the number of rows of the second data, is 2.
If the number of the first entries is not equal to the number of the second entries, it may be determined that the target test interface fails the test, and a first test result of the target test interface failing the test may be displayed. For example, if the first number of entries obtained in step 202 is not equal to 2, it may be determined that the target test interface failed the test.
According to the interface data testing method provided by the embodiment, the number of the first entries and the number of the second entries can be compared, if the number of the first entries is not equal to the number of the second entries, the target testing interface can be directly determined not to pass the test, and the first testing result that the target testing interface does not pass the test is displayed, and whether the data returned by the interface is consistent with the data returned by the database server through manual comparison in the prior art is not needed, so that the testing time and the labor cost are saved to a certain extent, and the interface data testing efficiency is improved.
Referring to fig. 5, fig. 5 is a flowchart illustrating steps of another interface data testing method according to an embodiment of the present invention. The interface data testing method comprises the following steps:
And step 504, receiving second data returned by the database server, and counting the number of second entries of the second data.
And 505, judging whether the number of the first entries is equal to that of the second entries.
If the number of the first entries is not equal to the number of the second entries, go to step 506; if the first number of entries is equal to the second number of entries, go to step 507.
And step 507, obtaining a target sequence according to Key data in a Key value pair in the target data group.
The obtaining of the target sequence according to the Key data in the Key value pair in the target data group can be realized by the following steps:
judging whether the number of Key data in a Key value pair in a target data group is equal to 1 or not;
if the number of the Key data in the Key value pair in the target data group is equal to 1, not sequencing the Key data in the Key value pair in the target data group, obtaining a first sequence according to the Key data in the Key value pair in the target data group, and taking the first sequence as a target sequence;
and if the number of the Key data in the Key value pairs in the target data group is not equal to 1, sorting the Key data in the Key value pairs in the target data group according to a preset sorting rule to obtain a second sequence, and taking the second sequence as the target sequence.
It should be noted that the preset sorting rule may be an ascending sorting rule or a descending sorting rule according to a character string, for example, taking a target data group as a first data group in the above embodiment, if only one Key value pair in the first data group is, for example, "name": zhan ", because only one Key data name is in the target data group, the Key data (name) is not required to be sorted, and the first sequence (name) is directly obtained according to the Key data (name), so that time required for sorting and resources occupied by sorting can be reduced, and test efficiency is improved. Because there are 5 Key value pairs in the first data group, the Key data in the Key value pairs in the first data group can be sorted according to the ascending sort rule or the descending sort rule of the character string, and a second sequence is obtained. Ascending ordering rule of character strings: the first character of the Key data in each Key value pair is compared, and if the first character of a certain Key data is positioned in the first character of other Key data in the alphabetical order, the position of the Key data in the second sequence is ranked before other Key data. For example, Key data in a Key-value pair in the first data group includes a generator, a name, an age, an organizational background, and a native place, where the first character in the age is a, and the character a is located in the alphabetical order before the first character (g) of the generator, the first character (n) of the name, the first character (e) of the organizational background, and the first character (n) of the native place, so that the age is the first character string in the second sequence. If the rule is ordered according to the ascending order of the character strings, the obtained second order is as follows: age, organizational background, genre, name, native place, with comma separation between each Key data in the second sequence. Since the first characters of the name and the native place are the same, the second character is compared, and the third character is compared if the second character is the same. Similarly, Key data in Key value pairs in the first data group can also be sorted according to a descending sorting rule of character strings to obtain a second sequence. And the second sequence is taken as the target sequence.
508. And generating a target query instruction according to the target sequence, and sending the target query instruction to the database server.
Replacing variables at two positions in the query statement by the target sequence, wherein the selected variables represent the sequence of fields in the query instruction, the variables after order by represent the sequence of each row of data, and the query instruction is, for example: the target query instruction can be generated by replacing the variable a in the query instruction with the target sequence. The field value corresponding to the first field of the queried row of data can be sorted according to the field value corresponding to the second field in the target sequence by ordering by $ { a }, for example, when the field values corresponding to the field age in the two rows of data in table 2 are both 20, the field values corresponding to the second field explicit background are sorted. By executing the target query instruction, the database server may sort the fields with the names of tables according to the sequence of Key data in the target sequence, and sort each row of data in the query result according to the data corresponding to the first Key data in the target sequence, so as to obtain third data, that is, the third data returned by the database server in step 509. Taking the target sequence as: age, organizational background, genre, name, native place are taken as examples and are described in connection with the examples in the above embodiments. Referring to fig. 6, fig. 6 is a schematic diagram of third data provided in an embodiment of the present invention. That is, the third data is shown in the following table 3:
age | educationalBackground | | name | nativePlace | |
20 | bachelor | Woman | Plum | Beijing | |
35 | Master's soldier | For male | Zhang Feng (a Chinese character of 'Zhang Feng') | Shanghai province |
TABLE 3
Namely, according to the target sequence: age, organizational background, generator, name, native place sorts the fields in table 2 above (column sort) while the row data in table 2 is sorted (row sort). The first row of data in table 2 is, in order: zhang Feng, Man, 35, Master, Shanghai, the second row of data is: the two rows of data are sorted according to order by $ { a }, namely, the data corresponding to the age are sorted according to a character string ascending sorting rule, and the data in the first row in the table 2 is changed into the data in the second row in the table 3 because 20 is smaller than 35. It should be noted that if the ages of the two rows of data are both 20, the data corresponding to the lower background is subjected to row sorting, and similarly, if the data corresponding to the lower background is the same, the data corresponding to the sender is subjected to row sorting. That is, the first row data in table 2 is changed to the second row data in table 3, and the fields are sorted according to age, organizational background, generator, name, native place (as shown in the two rows data in table 3 above).
509. And receiving third data returned by the database server, wherein the third data is returned to the client by the database server in response to the target query instruction.
That is, in this step, the terminal device may receive the third data returned by the database server, and the third data is data subjected to row sorting and column sorting.
510. And sequencing the Key value pairs in each data group according to the sequence of each Key data in the target sequence to obtain a first data set.
It should be noted that if there is one Key data in the target sequence, that is, there is only one Key value pair in the array group, the Key value pairs in the data group do not need to be sorted. When a plurality of Key data in the target sequence exist, the Key value pairs in each data group can be sorted according to the sequence of each Key data in the target sequence, and a first data set is obtained. With the first data set and the second data set in the above embodiment, the target sequence is: taking age, organizational background, genre, name, and native place as an example, the first data group and the second data group are sorted according to the sequence of each Key data in the target sequence to obtain a first data set. For convenience of explaining the sorting of the key-value pairs in each data set, the following describes, with reference to fig. 7, sorting the first data set and the second data set to obtain a first data set, and fig. 7 is a schematic diagram of a first data set obtaining process according to an embodiment of the present invention. To the left of the dashed line in fig. 7 are a first data set 701 and a second data set 702 when step 510 is not performed, and to the right of the dashed line in fig. 7 is a first data set obtained, the first data set comprising a data set 703 having key-value pairs sorted in the first data set 701 and a data set 704 having key-value pairs sorted in the second data set 702.
It should be noted that, if there is only one Key data in the target sequence and the number of the first entries is equal to the number of the second entries, that is, the target test data is a row and only one column of data, the target test data and the second data may be directly compared, if they are consistent, it is determined that the target test interface passes the test, and if they are not consistent, it is determined that the target test interface does not pass the test. If there are multiple Key data in the target test data and the number of the first entries is equal to that of the second entries is equal to 1, step 411 need not be executed, that is, only one data group is in the first data set, so that the sequence of the data groups in the target test data does not need to be sequenced, and the test efficiency can be improved. If there is one Key data in the target test data and the number of the first entries is equal to the number of the second entries and is greater than 1, the Key value pairs in each data group may not be sorted without executing this step, and only step 411 needs to be executed to sort the order of each data group in the target test data. If there are multiple Key data in the target test data and the number of the first entries is equal to the number of the second entries and is greater than 1, step 510 and step 511 are executed to perform row-column sorting.
511. And sequencing the sequence of each data group in the first data set according to a preset sequencing rule and Value data in a key Value pair in each data group in the first data set to obtain a second data set.
For ease of explanation of the process of obtaining the second data set, the following example is provided in conjunction with FIG. 8. Referring to fig. 8, fig. 8 is a schematic diagram of a second data set obtaining process according to an embodiment of the present invention. The left side of the dotted line in fig. 8 is the sorting order of the data group 703 and the data group 704 in the first data set when step 511 is not executed, that is, 703 is a first data group in the first data set, 704 is a second data group in the first data set, the right side of the dotted line in fig. 8 is the obtained second data set, and the second data set is the data set in which the data group 703 and the data group 704 in the first data set are sorted in order. The first data set in the second data set is data set 704 and the second data set is data set 703.
It should be noted that, since the Key values in the data group are sorted in step 510, the Value data corresponding to the first Key data in the data group 703 is 35, the Value data corresponding to the first Key data in the data group 704 is 20, and the 20 is smaller than 35 according to the preset sorting rule (the ascending sorting rule of character strings), in this step, the data group 704 is sorted in front of the data group 703 to obtain the second data set. And if the Value data corresponding to the first Key data in the two data sets are both 20, sequencing the sequence of each data set in the first data set according to a preset sequencing rule and the Value data corresponding to the second Key data.
It should be noted that, if there is only one data set in the first data set, this step may not be performed, so that the test efficiency may be improved to some extent.
512. And comparing Value data in the jth key Value pair in the ith data group in the second data set with data in the ith row and the jth column in the third data.
If the Value data in the jth key-Value pair in the ith data group in the second data set is successfully compared with the data in the ith row and the jth column in the third data, executing step 513; if the Value data in the jth key-Value pair in the ith data group in the second data set is not successfully compared with the data in the ith row and the jth column in the third data, step 514 is executed.
For example, Value data in the 1 st key Value pair in the 1 st data group in the second data set is 20, and is compared with data in the first row and the first column in the third data; if the Value data in the 2 nd key Value pair in the 1 st data set is "scholar" and is compared with the data "scholar" in the first row and the second column in the third data, the data in all the data sets can be compared with the data in the third data, and if the Value data in the jth key Value pair in the ith data set in the second data set is successfully compared with the data in the ith row and the jth column in the third data set, the target test interface passes the test. If the Value data in the jth key Value pair in the ith data group in the second data set is not successfully compared with the data in the ith row and the jth column in the third data, it can be determined that the target test interface fails the test.
It should be noted that, because the data returned by the target test interface is unordered, as shown in fig. 3, especially when the returned data is huge, the manual comparison consumes labor cost and test time, and the test efficiency is low. In this embodiment, when the data returned by the target test interface is huge, the data returned by the target test interface may be automatically sorted (Key data in each group of data returned by the interface is sorted according to a preset sorting rule (column sorting), and the arrangement order of each group of data in the data set is sorted (row sorting)), and meanwhile, the third data returned by the database server is also sorted according to the same preset sorting rule to generate data (data after row-column sorting). Therefore, the comparison between the data returned by the target test interface and the data received from the database server is facilitated, the test time and the labor cost are reduced to a certain extent, and the test efficiency is improved.
And 513, determining a second test result and displaying the second test result, wherein the second test result indicates that the target test interface passes the test.
And step 514, determining a first test result and displaying the first test result.
Referring to fig. 9, fig. 9 is a schematic structural diagram of an interface data testing apparatus according to an embodiment of the present invention, where the interface data testing apparatus 900 includes:
an obtaining module 910, configured to obtain interface information of a target test interface, and send the interface information to a server;
a counting module 920, configured to receive first data returned by the server through the target test interface, extract target test data in the first data, and count a first number of items of the target test data;
a sending module 930, configured to send a first query instruction to a database server, where the first query instruction is generated according to Key data in a Key value pair in a target data group, the target data group is any one data group in the target test data, and the data group includes at least one Key value pair;
the counting module 920 is further configured to receive second data returned by the database server, and count a second number of entries of the second data;
a first determining module 940, configured to determine a first test result and display the first test result if the first number of entries is not equal to the second number of entries, where the first test result indicates that the target test interface fails to test.
Optionally, the apparatus 900 may further include:
the judging module is used for judging whether the number of the first entries is equal to that of the second entries;
a first obtaining module, configured to obtain a target sequence according to Key data in a Key value pair in the target data group if the first number of entries is equal to the second number of entries;
the generating module is used for generating a target query instruction according to the target sequence and sending the target query instruction to the database server;
and the receiving module is used for receiving third data returned by the database server, wherein the third data is returned to the client by the database server in response to the target query instruction.
Optionally, the obtaining module is specifically configured to determine whether the number of Key data in a Key value pair in the target data group is equal to 1;
if the number of the Key data in the Key value pair in the target data group is equal to 1, not sorting the Key data in the Key value pair in the target data group, and obtaining a first sequence according to the Key data in the Key value pair in the target data group, and taking the first sequence as the target sequence;
if the number of the Key data in the Key value pairs in the target data group is not equal to 1, sorting the Key data in the Key value pairs in the target data group according to a preset sorting rule to obtain a second sequence, and taking the second sequence as the target sequence.
Optionally, the apparatus 900 may further include:
a second obtaining module, configured to sort, according to a sequence of each Key data in the target sequence, Key value pairs in each data group to obtain a first data set;
and a third obtaining module, configured to rank, according to the preset ranking rule and Value data in the key Value pair in each data group in the first data set, a sequence of each data group in the first data set, so as to obtain a second data set.
Optionally, the apparatus 900 may further include:
a comparison module, configured to compare Value data in a jth key Value pair in an ith data group in the second data set with data in an ith row and a jth column in the third data;
and the second determining module is configured to determine a second test result and display the second test result if all Value data in a jth key Value pair in an ith data group in the second data set is successfully compared with data in an ith row and a jth column in the third data, where the second test result indicates that the target test interface passes the test.
Optionally, the second determining module is further configured to determine the first test result and display the first test result if the Value data in the jth key-Value pair in the ith data group in the second data set is not successfully compared with the data in the ith row and the jth column in the third data.
In addition, an embodiment of the present invention further provides an electronic device, where the electronic device includes a processor and a memory, and the memory is used for storing executable instructions of the processor, where the processor is configured to execute each process of the embodiment of the interface data testing method provided in the foregoing embodiment by executing the executable instructions, and the same technical effects can be achieved, and details are not repeated here to avoid repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned interface data testing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
The embodiment of the invention also provides a computer program, and the computer program can be stored on a cloud or a local storage medium. When being executed by a computer or a processor, the computer program is used for executing the corresponding steps of the interface data testing method of the embodiment of the invention and is used for realizing the corresponding modules in the interface data testing device of the embodiment of the invention.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As is readily imaginable to the person skilled in the art: any combination of the above embodiments is possible, and thus any combination between the above embodiments is an embodiment of the present invention, but the present disclosure is not necessarily detailed herein for reasons of space.
The interface data testing methods provided herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems may also be used with the teachings herein. The structure required to construct a system incorporating aspects of the present invention will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the invention and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.
The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components of the interface data testing method according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
Claims (14)
1. An interface data testing method, comprising:
acquiring interface information of a target test interface and sending the interface information to a server;
receiving first data returned by the server through the target test interface, extracting target test data in the first data, and counting the number of first items of the target test data;
sending a first query instruction to a database server, wherein the first query instruction is generated according to Key data in a Key value pair in a target data group, the target data group is any one data group in the target test data, and the data group comprises at least one Key value pair;
receiving second data returned by the database server, and counting the number of second entries of the second data;
and if the number of the first entries is not equal to the number of the second entries, determining a first test result and displaying the first test result, wherein the first test result indicates that the target test interface fails in testing.
2. The method of claim 1, further comprising, after said counting a second number of entries of said second data:
judging whether the number of the first entries is equal to the number of the second entries;
if the number of the first entries is equal to the number of the second entries, obtaining a target sequence according to Key data in a Key value pair in the target data group;
generating a target query instruction according to the target sequence, and sending the target query instruction to the database server;
and receiving third data returned by the database server, wherein the third data is returned to a client by the database server in response to the target query instruction.
3. The method of claim 2, wherein obtaining a target sequence from Key data in a Key-value pair in the target data group comprises:
judging whether the number of Key data in a Key value pair in the target data group is equal to 1 or not;
if the number of the Key data in the Key value pair in the target data group is equal to 1, not sorting the Key data in the Key value pair in the target data group, and obtaining a first sequence according to the Key data in the Key value pair in the target data group, and taking the first sequence as the target sequence;
if the number of the Key data in the Key value pairs in the target data group is not equal to 1, sorting the Key data in the Key value pairs in the target data group according to a preset sorting rule to obtain a second sequence, and taking the second sequence as the target sequence.
4. The method according to claim 3, further comprising, after said receiving third data returned by said database server:
sorting the Key value pairs in each data group according to the sequence of each Key data in the target sequence to obtain a first data set;
and sequencing the sequence of each data group in the first data set according to the preset sequencing rule and Value data in the key Value pair in each data group in the first data set to obtain a second data set.
5. The method of claim 4, further comprising, after said obtaining the second data set:
comparing Value data in a jth key Value pair in an ith data group in the second data set with data in an ith row and a jth column in the third data;
if the Value data in the jth key Value pair in the ith data group in the second data set is successfully compared with the data in the ith row and the jth column in the third data, determining a second test result and displaying the second test result, wherein the second test result indicates that the target test interface passes the test.
6. The method of claim 5, further comprising:
and if the Value data in the jth key Value pair in the ith data group in the second data set is not successfully compared with the data in the ith row and the jth column in the third data, determining the first test result and displaying the first test result.
7. An interface data testing apparatus, comprising:
the acquisition module is used for acquiring interface information of the target test interface and sending the interface information to the server;
the statistical module is used for receiving first data returned by the server through the target test interface, extracting target test data in the first data and counting the first number of items of the target test data;
a sending module, configured to send a first query instruction to a database server, where the first query instruction is generated according to Key data in a Key value pair in a target data group, the target data group is any one of the target test data, and the data group includes at least one Key value pair;
the statistical module is further used for receiving second data returned by the database server and counting the number of second entries of the second data;
and the first determining module is used for determining a first test result and displaying the first test result if the first number of the entries is not equal to the second number of the entries, wherein the first test result indicates that the target test interface fails to test.
8. The apparatus of claim 7, further comprising:
the judging module is used for judging whether the number of the first entries is equal to that of the second entries;
a first obtaining module, configured to obtain a target sequence according to Key data in a Key value pair in the target data group if the first number of entries is equal to the second number of entries;
the generating module is used for generating a target query instruction according to the target sequence and sending the target query instruction to the database server;
and the receiving module is used for receiving third data returned by the database server, wherein the third data is returned to the client by the database server in response to the target query instruction.
9. The apparatus of claim 8,
the obtaining module is specifically configured to determine whether the number of Key data in a Key value pair in the target data group is equal to 1;
if the number of the Key data in the Key value pair in the target data group is equal to 1, not sorting the Key data in the Key value pair in the target data group, and obtaining a first sequence according to the Key data in the Key value pair in the target data group, and taking the first sequence as the target sequence;
if the number of the Key data in the Key value pairs in the target data group is not equal to 1, sorting the Key data in the Key value pairs in the target data group according to a preset sorting rule to obtain a second sequence, and taking the second sequence as the target sequence.
10. The apparatus of claim 9, further comprising:
a second obtaining module, configured to sort, according to a sequence of each Key data in the target sequence, Key value pairs in each data group to obtain a first data set;
and a third obtaining module, configured to rank, according to the preset ranking rule and Value data in the key Value pair in each data group in the first data set, a sequence of each data group in the first data set, so as to obtain a second data set.
11. The apparatus of claim 10, further comprising:
a comparison module, configured to compare Value data in a jth key Value pair in an ith data group in the second data set with data in an ith row and a jth column in the third data;
and the second determining module is configured to determine a second test result and display the second test result if all Value data in a jth key Value pair in an ith data group in the second data set is successfully compared with data in an ith row and a jth column in the third data, where the second test result indicates that the target test interface passes the test.
12. The apparatus of claim 11,
the second determining module is further configured to determine the first test result and display the first test result if Value data in a jth key Value pair in an ith data group in the second data set is not successfully compared with data in an ith row and a jth column in the third data.
13. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the interface data testing method according to any one of claims 1 to 6.
14. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the interface data testing method of any one of claims 1 to 6 via execution of the executable instructions.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910883067.7A CN110908892A (en) | 2019-09-18 | 2019-09-18 | Interface data testing method and device and readable storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910883067.7A CN110908892A (en) | 2019-09-18 | 2019-09-18 | Interface data testing method and device and readable storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110908892A true CN110908892A (en) | 2020-03-24 |
Family
ID=69814981
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910883067.7A Pending CN110908892A (en) | 2019-09-18 | 2019-09-18 | Interface data testing method and device and readable storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110908892A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111581083A (en) * | 2020-04-26 | 2020-08-25 | 北京字节跳动网络技术有限公司 | Interface testing method and device, electronic equipment and storage medium |
CN112131128A (en) * | 2020-09-29 | 2020-12-25 | 网易(杭州)网络有限公司 | Data testing method, device, storage medium and electronic device |
CN115357478A (en) * | 2022-07-25 | 2022-11-18 | 武汉未来幻影科技有限公司 | Interface data testing method and device and processing equipment |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104951399A (en) * | 2015-06-19 | 2015-09-30 | 北京齐尔布莱特科技有限公司 | Software test system and method |
CN106815100A (en) * | 2015-11-27 | 2017-06-09 | 北京国双科技有限公司 | Interface test method and device |
CN107122296A (en) * | 2017-04-18 | 2017-09-01 | 上海雷腾软件股份有限公司 | The method and apparatus that data for test interface are asserted |
CN107741911A (en) * | 2017-11-01 | 2018-02-27 | 广州爱九游信息技术有限公司 | Interface test method, device, client and computer-readable recording medium |
CN108089982A (en) * | 2017-12-08 | 2018-05-29 | 北京小度信息科技有限公司 | Test method, device, electronic equipment and computer readable storage medium |
CN109101415A (en) * | 2018-06-25 | 2018-12-28 | 平安科技(深圳)有限公司 | Interface test method, system, equipment and the storage medium compared based on database |
CN109325041A (en) * | 2018-08-14 | 2019-02-12 | 中国平安人寿保险股份有限公司 | Business data processing method, device, computer equipment and storage medium |
CN109614309A (en) * | 2018-10-22 | 2019-04-12 | 中国平安财产保险股份有限公司 | Compare the method, apparatus, computer equipment and storage medium of test result |
-
2019
- 2019-09-18 CN CN201910883067.7A patent/CN110908892A/en active Pending
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104951399A (en) * | 2015-06-19 | 2015-09-30 | 北京齐尔布莱特科技有限公司 | Software test system and method |
CN106815100A (en) * | 2015-11-27 | 2017-06-09 | 北京国双科技有限公司 | Interface test method and device |
CN107122296A (en) * | 2017-04-18 | 2017-09-01 | 上海雷腾软件股份有限公司 | The method and apparatus that data for test interface are asserted |
CN107741911A (en) * | 2017-11-01 | 2018-02-27 | 广州爱九游信息技术有限公司 | Interface test method, device, client and computer-readable recording medium |
CN108089982A (en) * | 2017-12-08 | 2018-05-29 | 北京小度信息科技有限公司 | Test method, device, electronic equipment and computer readable storage medium |
CN109101415A (en) * | 2018-06-25 | 2018-12-28 | 平安科技(深圳)有限公司 | Interface test method, system, equipment and the storage medium compared based on database |
CN109325041A (en) * | 2018-08-14 | 2019-02-12 | 中国平安人寿保险股份有限公司 | Business data processing method, device, computer equipment and storage medium |
CN109614309A (en) * | 2018-10-22 | 2019-04-12 | 中国平安财产保险股份有限公司 | Compare the method, apparatus, computer equipment and storage medium of test result |
Non-Patent Citations (6)
Title |
---|
LINKING12: "比较两个数组元素是否相同,顺序可以不同,维数必须一样", 《HTTPS://BLOG.CSDN.NET/LINKING12/ARTICLE/DETAILS/2709955》, pages 40 - 41 * |
WI100SH: "【转】byte[]数组比较(内容比较)--不错", 《HTTPS://WWW.CNBLOGS.COM/WI100SH/P/4474532.HTML》, pages 1 * |
ZYOOOOXIE: "数据完整性测试之【一】接口返回值和数据库表里的记录", 《HTTPS://BLOG.CSDN.NET/ZYOOOOXIE/ARTICLE/DETAILS/100020958》, pages 1 - 4 * |
奔奔-武: "python 判断两个列表中相同和不同的元素", 《HTTPS://WWW.CNBLOGS.COM/BENBEN-WU/P/10404547.HTML》, pages 1 * |
我是龙俊: "Java判断两个List是否相同", 《HTTPS://WWW.JIANSHU.COM/P/E96216367A81》, pages 1 - 2 * |
笑笑曦: "接口返回数据与数据数据的对比、数据表之间的拆分重组对比", 《HTTPS://BLOG.CSDN.NET/LSSRAIN/ARTICLE/DETAILS/85062582》, pages 1 - 3 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111581083A (en) * | 2020-04-26 | 2020-08-25 | 北京字节跳动网络技术有限公司 | Interface testing method and device, electronic equipment and storage medium |
CN111581083B (en) * | 2020-04-26 | 2024-02-09 | 抖音视界有限公司 | Interface testing method and device, electronic equipment and storage medium |
CN112131128A (en) * | 2020-09-29 | 2020-12-25 | 网易(杭州)网络有限公司 | Data testing method, device, storage medium and electronic device |
CN112131128B (en) * | 2020-09-29 | 2023-08-22 | 网易(杭州)网络有限公司 | Data testing method and device, storage medium and electronic device |
CN115357478A (en) * | 2022-07-25 | 2022-11-18 | 武汉未来幻影科技有限公司 | Interface data testing method and device and processing equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110908892A (en) | Interface data testing method and device and readable storage medium | |
CN109167816B (en) | Information pushing method, device, equipment and storage medium | |
CN102122265B (en) | System and method for verifying computer software test results | |
CN105653701B (en) | Model generating method and device, word assign power method and device | |
CN110377356B (en) | Task processing method, device and system and computer readable storage medium | |
CN110221948A (en) | Test script generation method, device, computer installation and storage medium | |
CN105630937A (en) | Method and device for searching answers to exam questions | |
CN111767350A (en) | Data warehouse testing method and device, terminal equipment and storage medium | |
CN111143359A (en) | Query statement generation method and device | |
CN105808605B (en) | A kind of search log merging method and system | |
CN111752846A (en) | Interface testing method and device | |
CN113297078B (en) | MOCK system and data testing method based on same | |
CN110019762B (en) | Problem positioning method, storage medium and server | |
CN111158973B (en) | Web application dynamic evolution monitoring method | |
CN111241821A (en) | Method and device for determining behavior characteristics of user | |
CN110297751A (en) | Detection method, device, storage medium and the processor of page elements | |
CN110083540B (en) | Interface testing method and device | |
CN113407593A (en) | Data sampling method and device, electronic equipment and readable storage medium | |
CN111177236A (en) | Medical care scene-based scale generation method, system, device and medium | |
CN112035336A (en) | Test method, test device and readable storage medium | |
CN103514278B (en) | A kind of method and device verifying open type summary information of webpage | |
CN110765016A (en) | Game test instruction processing method, system, server and storage device | |
CN111198821B (en) | Interface abnormity judgment method and device and readable storage medium | |
CN113987010B (en) | Method and device for realizing insight of multi-dimensional data set | |
CN113434432B (en) | Performance test method, device, equipment and medium for recommendation platform |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |