CN114745749A - Virtual network element testing method and device, electronic equipment and readable storage medium - Google Patents
Virtual network element testing method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN114745749A CN114745749A CN202210435317.2A CN202210435317A CN114745749A CN 114745749 A CN114745749 A CN 114745749A CN 202210435317 A CN202210435317 A CN 202210435317A CN 114745749 A CN114745749 A CN 114745749A
- Authority
- CN
- China
- Prior art keywords
- test case
- test
- target
- virtual network
- network element
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 883
- 238000000034 method Methods 0.000 claims abstract description 34
- 238000013515 script Methods 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 19
- 230000006870 function Effects 0.000 description 36
- 230000008569 process Effects 0.000 description 11
- 238000011161 development Methods 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 10
- 230000004044 response Effects 0.000 description 9
- 238000010295 mobile communication Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012163 sequencing technique Methods 0.000 description 3
- 238000004088 simulation Methods 0.000 description 3
- 238000010998 test method Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000013256 coordination polymer Substances 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 235000019580 granularity Nutrition 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000004801 process automation Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000032258 transport Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/10—Scheduling measurement reports ; Arrangements for measurement reports
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/06—Testing, supervising or monitoring using simulated traffic
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the application provides a virtual network element testing method and device, electronic equipment and a readable storage medium, and relates to the technical field of testing. The method comprises the following steps: receiving a test request, wherein the test request comprises test case determination information, determining a target test case matched with the test case information based on the test case determination information, and executing each target test case respectively to obtain a test result file of each target test case, wherein the test result file of each target test case can contain message data of at least one corresponding service interface. The virtual network element testing method can determine the target test cases based on the test case determination information in the test request, respectively execute the target test cases to obtain corresponding test results, and generate the test report based on the test result statistics of the target test cases, so that the automatic testing of the virtual network element is conveniently and quickly realized, the test efficiency is improved, and the actual application requirements are better met.
Description
Technical Field
The present application relates to the field of testing technologies, and in particular, to a virtual network element testing method, an apparatus, an electronic device, and a readable storage medium.
Background
With the development of 5G (Generation Mobile Communication Technology, fifth Generation Mobile Communication Technology), the development and deployment of a 5G core network becomes more convenient and faster.
As a novel mobile communication network, the 5G not only needs to solve the person-to-person communication, provides more immersive and extremely-intensive business experience such as augmented reality, virtual reality, ultra-high definition (3D) video and the like for a user, but also needs to solve the problem of person-to-object and object-to-object communication, and meets the application requirements of the Internet of things such as mobile medical treatment, Internet of vehicles, smart home, industrial control and environmental monitoring.
When the 5G technology leaves great leadership in every industry, a great deal of test requirements for 5G core network elements and related business processes are generated correspondingly. In the existing test system, the configuration process of the test flow is complex, and the configuration options are not diverse and flexible enough, so that the test method of the core network element is not convenient enough, the test efficiency is low, and the actual test requirements are difficult to meet.
Disclosure of Invention
The embodiment of the application aims to solve the problems that a testing method is not convenient and fast enough and testing efficiency is low.
In a first aspect, a method for testing a virtual network element is provided, where the method includes:
receiving a test request aiming at the virtual network element, wherein the test request comprises test case determination information;
determining at least one target test case matched with the test case determination information from the pre-configured test cases based on the test case determination information, wherein each target test case corresponds to at least one service interface, and the service interfaces are interfaces between the virtual network elements;
and executing each target test case respectively to obtain the test result of each target test case, and generating a test report based on the test result statistics of each target test case.
In an optional embodiment of the first aspect, the test case determination information is at least one of test case storage location information and a keyword, and based on the test case determination information, at least one target test case matching the test case determination information is determined from the plurality of test cases, including:
if the test case determining information is the test case storage position information, taking the test case corresponding to the test case storage path as a target test case;
and if the test case determination information is a keyword, matching the keyword with test case description information of each test case in the pre-configured test cases, and determining each test case corresponding to the test case description information containing the keyword as a target test case.
If the test case determination information comprises test case storage position information and keywords, determining at least one candidate test case according to the test case storage position information, matching the keywords with test case description information of each candidate test case, and determining the candidate test case corresponding to the test case description information containing the keywords as a target test case.
In an alternative embodiment of the first aspect, the preconfigured test case is obtained by:
receiving test case configuration information through a test case configuration interface, generating a test case based on the test case configuration information and storing the test case;
and aiming at each test case, the test case configuration information comprises a test case identifier and a test flow file, wherein the test flow file comprises a test script and service parameters of at least one service interface corresponding to the test script.
In an optional embodiment of the first aspect, the test case configuration interface includes a virtual network element selection control, receives test case configuration information through the test case configuration interface, and generates a test case based on the test case configuration information, including:
responding to the triggering operation aiming at the virtual network element selection control, and displaying a virtual network element list;
receiving selection operation aiming at the virtual network elements in the virtual network element list, and determining the selected virtual network elements as target virtual network elements;
and receiving test case configuration information aiming at the target virtual network element, and generating a test case corresponding to the target virtual network element based on the test case configuration information.
In an optional embodiment of the first aspect, the test case configuration interface includes a template selection control, receives test case configuration information through the test case configuration interface, and generates a test case based on the test case configuration information, including:
responding to the trigger operation aiming at the template selection control, and displaying a template list;
receiving selection operation aiming at the test case template in the template list, and determining the selected test case template as a target template;
and receiving the configuration information of the test case based on the target template, and generating the test case according to the target template and the configuration information of the test case.
In an optional embodiment of the first aspect, the test case configuration information of each test case further includes at least one of:
waiting time after any one servitization interface corresponding to the test case is called;
interface call conditions pre-configured for any of the serviced interfaces.
In an optional embodiment of the first aspect, the method further comprises:
aiming at each target test case, comparing the test result file with a reference result file corresponding to the target test case to obtain a comparison result;
and generating a test report based on the test result file and the comparison result of each target test case.
In a second aspect, an apparatus for testing a virtual network element is provided, the apparatus including:
the test request receiving module is used for receiving a test request aiming at the virtual network element, and the test request comprises test case determination information;
the test case determining module is used for determining at least one target test case matched with the test case determining information from the pre-configured test cases based on the test case determining information, each target test case corresponds to at least one service interface, and the service interfaces are interfaces among the virtual network elements;
the test case execution module is used for respectively executing each target test case to obtain a test result of each target test case;
and the test report generating module is used for generating a test report based on the test result statistics of each target test case.
In an optional embodiment of the second aspect, the test case determination information is at least one of test case storage location information and a keyword, and the test case determination module is specifically configured to, when determining at least one target test case matching the test case determination information from the plurality of test cases based on the test case determination information:
if the test case determining information is the test case storage position information, taking the test case corresponding to the test case storage path as a target test case;
and if the test case determination information is a keyword, matching the keyword with test case description information of each test case in the pre-configured test cases, and determining each test case corresponding to the test case description information containing the keyword as a target test case.
If the test case determination information comprises test case storage position information and keywords, determining at least one candidate test case according to the test case storage position information, matching the keywords with test case description information of each candidate test case, and determining the candidate test case corresponding to the test case description information containing the keywords as a target test case.
In an optional embodiment of the second aspect, the system further includes a test case configuration module, specifically configured to:
receiving test case configuration information through a test case configuration interface, generating a test case based on the test case configuration information and storing the test case;
and aiming at each test case, the test case configuration information comprises a test case identifier and a test flow file, wherein the test flow file comprises a test script and service parameters of at least one service interface corresponding to the test script.
In an optional embodiment of the second aspect, the test case configuration interface includes a virtual network element selection control, and the test case configuration module is specifically configured to, when receiving the test case configuration information through the test case configuration interface and generating the test case based on the test case configuration information:
responding to the triggering operation aiming at the virtual network element selection control, and displaying a virtual network element list;
receiving selection operation aiming at the virtual network elements in the virtual network element list, and determining the selected virtual network elements as target virtual network elements;
and receiving test case configuration information aiming at the target virtual network element, and generating a test case corresponding to the target virtual network element based on the test case configuration information.
In an optional embodiment of the second aspect, the test case configuration interface includes a template selection control, and the test case configuration module is specifically configured to, when receiving the test case configuration information through the test case configuration interface and generating the test case based on the test case configuration information:
responding to the trigger operation aiming at the template selection control, and displaying a template list;
receiving selection operation aiming at the test case template in the template list, and determining the selected test case template as a target template;
and receiving test case configuration information based on the target template, and generating a test case according to the target template and the test case configuration information.
In an optional embodiment of the second aspect, the test case configuration information of each test case further includes at least one of:
waiting time after any one servitization interface corresponding to the test case is called;
interface call conditions pre-configured for any of the serviced interfaces.
In an optional embodiment of the second aspect, the system further includes a test result comparing module, specifically configured to:
aiming at each target test case, comparing the test result file with a reference result file corresponding to the target test case to obtain a comparison result;
and generating a test report based on the test result file and the comparison result of each target test case.
In a third aspect, an electronic device is provided, which includes:
the virtual network element testing method comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, wherein the processor executes the program to realize the virtual network element testing method of any one of the embodiments.
In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, which when executed by a processor implements the virtual network element testing method of any of the above embodiments.
In a fifth aspect, a computer program product or computer program is provided, the computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device implements the method provided in the embodiment of the first aspect when executed.
The virtual network element testing method receives the testing request, the testing request comprises the testing case determining information, and at least one target testing case matched with the testing case information can be determined from the plurality of testing cases based on the testing case determining information. And executing each target test case respectively to obtain a test result file of each target test case, wherein the test result file of each target test case can contain message data sent by at least one corresponding service interface, and the message data can be a request message and/or a response message. The virtual network element testing method can determine the target test cases based on the test case determination information in the test request, respectively execute the target test cases to obtain corresponding test results, and generate the test report based on the test result statistics of the target test cases, so that the automatic testing of the virtual network element is conveniently and quickly realized, the test efficiency is improved, and the actual application requirements are better met.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments of the present application will be briefly described below.
Fig. 1 is a schematic functional architecture diagram of a system for implementing a virtual network element testing method according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a virtual network element testing method according to an embodiment of the present application;
fig. 3 is a schematic diagram of a storage directory and a test case identifier corresponding to each test case in the virtual network element testing method according to the embodiment of the present application;
fig. 4 is a schematic flowchart of a virtual network element testing method according to an embodiment of the present application;
fig. 5 is a schematic diagram of a test report in a virtual network element testing method according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a virtual network element testing apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device for virtual network element testing according to an embodiment of the present application.
Detailed Description
Embodiments of the present application are described below in conjunction with the drawings in the present application. It should be understood that the embodiments set forth below in connection with the drawings are exemplary descriptions for explaining technical solutions of the embodiments of the present application, and do not limit the technical solutions of the embodiments of the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should be further understood that the terms "comprises" and/or "comprising," when used in this specification in connection with embodiments of the present application, specify the presence of stated features, information, data, steps, operations, elements, and/or components, but do not preclude the presence or addition of other features, information, data, steps, operations, elements, components, and/or groups thereof, as embodied in the art. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. The term "and/or" as used herein indicates at least one of the items defined by the term, e.g., "a and/or B" may be implemented as "a", or as "B", or as "a and B".
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
The terms referred to in this application will first be introduced and explained:
fifth generation mobile communication technology (i.e., 5G): the new generation broadband mobile communication technology with the characteristics of high speed, low time delay and large connection is a network infrastructure for realizing man-machine-object interconnection. The core network architecture realized based on the fifth-generation mobile communication technology breaks through the traditional network architecture, abandons the traditional network architecture mode of special hardware, special communication links and paths, special platforms and point-to-point interfaces, and is dedicated to an efficient, software and developed system network architecture.
3GPP (3rd Generation Partnership Project, third Generation Partnership Project): a standardization organization for defining complete end-to-end system specifications, ensuring compliance with industry requirements, seamless interoperability between different vendors and the global scale necessary to provide mobility.
Core Network (Core Network): when a mobile network is divided into three parts: when the base station subsystem, the network subsystem and the system support part are used, the core network part is positioned in the network subsystem, and the core network is mainly used for connecting a call request or a data request from the A port to different networks.
The network element: the devices in the network, which may also be referred to as network entities, may be composed of one or more chassis or subracks, and may independently perform certain transmission functions. There are many granularities of division of network elements, and different network elements can provide different services.
Protocol Data Units (PDUs) are established at each level of the transmission system in a layered network structure, such as in the open system interconnection model. The PDU, which contains information from the upper layer and information attached to the entity of the current layer, is transferred to the next lower layer. The physical layer actually transports these PDUs in a framed bitstream, which are built up by the higher layers of the protocol stack. The receiving system passes these packets from bottom to top through the protocol stack and separates out the relevant information in the PDUs at each layer of the protocol stack.
A User Plane Function (UPF), which is a basic component of the 5GC, is used to implement separation of a User Plane (CP) and a Control Plane (UP).
Access and Mobility Management Function (AMF): is responsible for managing handovers between base stations within the next generation radio access network.
With the development of 5G mobile communication technology, 5G technology is increasingly used in various application scenarios, and in order to improve development efficiency and accelerate research and development iterations, the requirement for 5G business process automation test is particularly prominent. However, in the existing test scheme, a test system that comprehensively supports a 5G service architecture and a 3GPP interface specification is lacking, and the test system is often not flexible and convenient enough to perform test flow configuration, so that the test efficiency is low.
The application provides a virtual network element testing method, a virtual network element testing device, an electronic device and a readable storage medium, which aim to solve at least one of the above technical problems in the prior art.
The embodiment of the application provides a virtual network element testing method, which can be implemented as a 5G network element automatic testing system. Optionally, the functional architecture diagram of the system may be as shown in fig. 1, and the technical effect of flexibly, conveniently and automatically testing the network element of the core network can be achieved by using the technical scheme of the embodiment of the present application.
Specifically, the main functions of the 5G network element automatic test system may include two parts, namely, a test case scheduling function and a network element test simulator function.
The test case scheduling function may mean that the system can implement scheduling execution in units of test cases. Specifically, for example, the automated test case execution function in fig. 1 may refer to that the system matches the storage directories and test case identifiers of all test cases according to the specified test case storage path and keywords, determines a target test case, and then invokes a specified command to complete execution of the target test case; the case result collection and reading function (case result collection in fig. 1) may refer to that the system can collect the test result file of each target test case, and can also compare the test result file with a result file (i.e., a reference result file) that is configured in advance and whose test result of the case test is successful; the automatic test report generation function can be that the system can integrate the result file of each use case into the test report, and can also automatically count the information such as passing rate, time consumption and the like in the whole test process.
The network element test simulator can be used for simulating a 5G core network element to initiate service interface access by combining a virtual machine technology, so as to realize corresponding service flow calling, including UE (User Equipment) access, PDU session establishment and the like. Optionally, as shown in fig. 1, the network element test simulator may implement service flow configuration, test flow scheduling, test information management, test parameter configuration, network element simulation, and service interface access, where: the test parameter configuration function refers to reading parameter information required to be provided by each service interface in the test flow from a test case; the service flow configuration function can be that flow scheduling information can be read from a test case, wherein the flow scheduling information comprises information such as a test step, whether interface access is completed for waiting, whether failure is quit and the like; the test flow scheduling function can call the service interfaces one by one according to the parameters in the test cases to realize the execution of the whole business flow; the network element simulation function can mean that the system can start corresponding HTTP/2 service according to the test case to receive the service access request of other network elements; the service interface access function can access the corresponding service interface in an HTTP/2 mode based on the configured interface parameters to complete the call of the interface; the test information management function may refer to collecting request and response messages of each service interface to generate a test case result file.
Optionally, the test flow configuration function and the use case information configuration function on the left side of fig. 1 may be to provide an optional test case template to a tester, so that the tester can write a source code file of a test case based on the test case template, and configure the test flow and the test case information in the source code file of the test case.
To sum up, the 5G network element automation test system provided in fig. 1 of the present application can mainly implement the following functions:
(1) aiming at a single test case, determining a service interface to be tested according to the test case, sequentially testing each service interface according to a test flow in the test case to obtain a test result of each service interface, and comparing the test result of each service interface with a reference result file to obtain a corresponding result file;
(2) aiming at the test case library, a plurality of test cases can be arranged in the test case library, each test case can be sequentially executed to realize the test of the service interface related to each test case, the result file of each test case is obtained, then the result file of each test case can be integrated into the test report, and meanwhile, the information of passing rate, time consumption and the like in the whole test process is automatically counted.
The technical solutions of the embodiments of the present application and the technical effects produced by the technical solutions of the present application will be described below through descriptions of several exemplary embodiments. It should be noted that the following embodiments may be referred to, referred to or combined with each other, and the description of the same terms, similar features, similar implementation steps, etc. in different embodiments is not repeated.
An embodiment of the present application provides a method for testing a virtual network element, and as shown in fig. 2, the method includes:
step S201, receiving a test request for a virtual network element, where the test request may include test case determination information.
In the embodiment of the present application, a test case configuration interface may be provided, and a technician may configure a plurality of test cases in advance through the test case configuration interface, where each test case may include input data, test steps, expected results, test scripts, and the like for different test targets and test environments.
The test case determination information includes, but is not limited to, at least one of test case storage location information (e.g., a storage path) and a keyword of a test case, where the keyword may be matched with test case description information of each test case, and the test case description information may include a test case identifier, a test environment of the test case, or a network element identifier of a virtual network element corresponding to the test case, and is used to screen out a test case of a specific type, such as a test case running in a specific test environment or a test case for a specific virtual network element.
Step S202 may determine, based on the test case determination information, at least one target test case matched with the test case determination information from the plurality of test cases, where each target test case corresponds to at least one servization interface, and the servization interfaces are interfaces between the virtual network elements.
In the embodiment of the application, at least one target test case matched with the test case determination information can be determined from a plurality of test cases configured in advance based on the test case determination information. Specifically, each test case may include a configurable test flow, and each test flow may include a series of test steps, such as a set of 5G service interface calls or test scripts.
The service interface in this application refers to an interface between virtual network elements, and a virtual network element may refer to a network element of an analog simulation core network in a virtual test environment built based on a virtual machine, for example, in an example, one virtual network element may be a base station, an access and mobility management function AMF network element, a session management function SMF network element, or a user plane function UPF network element, or the like. Various virtual network elements can be simulated according to the actual test application requirements.
In the embodiment of the present application, each test case may correspond to at least one business process in the 5G communication system, that is, one test case may be used to implement automated testing on at least one business process.
In one example, each test case may include a configurable test flow file, and the test flow file may include at least one test script and corresponding business parameters of at least one service interface.
In particular, a test script may include computer-readable instructions for automatically executing a test procedure (or portions thereof), which may be executed by an automated test tool.
The Service-based interface may be an interface that exposes a function body to the outside, which is implemented by Service registration and Service discovery similar to a micro-Service architecture, and this interface may be specific to a single function body, where a related function body interacts with other function bodies through the Service interface to the outside, and other function bodies interact with this function body through the interface exposed by the function body. This mechanism provides a many-to-one access mechanism and since service registration and service discovery are used, access is possible without mutual knowledge of the addresses of the partners.
In this embodiment, the test flow file may include a test script and a service parameter of at least one corresponding service interface, where the service parameter may be a parameter required for invoking the service interface, and includes, but is not limited to, an identifier of a virtual network element corresponding to each service interface and Protocol stack information, a manufacturer, a type, an IP (Internet Protocol) address, a port, and the like of the virtual network element.
When the test case is executed, the test script in the test case can be executed, and the service parameter of at least one service interface corresponding to the test script is called.
It can be understood that the test case may include a test script, and a test case description file, where the test case description file may include a service parameter of at least one service interface corresponding to the test case, so that a tester may conveniently view the service parameter.
Step S203, executing each target test case respectively to obtain a test result file of each target test case; the content contained in the test result file of each target test case can be set according to the test requirements, and different test requirements can be set to return different data.
Specifically, the message data may be a request message and a response message, and the test result file may be generated based on the request message and the response message of each service interface corresponding to the target test case. As an example, the message structure of the hypertext Transfer Protocol (HTTP) may be:
the starting line is used for describing the message;
the header is used for adding some additional information into the message, and the header and the protocol work cooperatively to jointly determine the functions which can be realized by the client and the server;
a body containing a body portion of data.
In the embodiment of the application, aiming at each target test case, the test result file is compared with the reference result file corresponding to the target test case, so that a comparison result can be obtained; then, a test report may be generated based on the test result file and the comparison result of each target test case.
Each test case may have a corresponding reference result file. After the target test cases are executed to obtain the test result files of the target test cases, the reference result files and the test result files corresponding to the target test cases can be compared with each other to obtain comparison results. The comparison result may include, but is not limited to, a similarity between the reference result file and the test result file, and the test result for the target test case may be further evaluated based on the similarity.
The test result files and the comparison results of all target test cases can be integrated, the test report of the detection is generated and is filed and stored, and the test result files and the comparison results are convenient for testers to check and analyze.
As a possible implementation manner, when a plurality of target test cases are determined based on test case determination information in a test request in the detection for the virtual network element, each target test case may be executed respectively to obtain a test result file of each target test case, and for each target test case, a reference result file and a test result file corresponding to the target test case may be compared to obtain a comparison result, where the comparison result may be a similarity between the reference result file and the test result file.
A similarity threshold may be further set, and for each target test case, when the comparison result (the similarity between the reference result file and the test result file) is greater than the similarity threshold, the test result of the target test case is recorded as a pass in the test report detected this time. The information such as passing rate, time consumption and the like can be counted in the finally generated test report, and the test result can be integrally evaluated.
And step S204, generating a test report based on the test result statistics of each target test case.
In the embodiment of the application, the result file of each target test case can be integrated into the test report, meanwhile, the information such as passing rate, time consumption and the like in the whole test process is automatically counted, the virtual network element is automatically tested, the test report is generated, and research personnel can clearly and conveniently know the test result of the virtual network element from the test report.
The virtual network element testing method receives the testing request, the testing request comprises the testing case determining information, and at least one target testing case matched with the testing case information can be determined from the plurality of testing cases based on the testing case determining information. And executing each target test case respectively to obtain a test result file of each target test case, wherein the test result file of each target test case can contain message data sent by at least one corresponding service interface, and the message data can be a request message and/or a response message. The virtual network element testing method provided by the application can determine the target test cases based on the test case determination information in the test request, respectively execute each target test case to obtain the corresponding test result, and generate the test report based on the test result statistics of each target test case, so that the virtual network element can be conveniently and quickly automatically tested, the development cost is reduced, the development efficiency is improved, and the rapid iteration of the 5G core network development can be promoted.
The embodiment of the application provides a possible implementation manner, the test case determination information is at least one of test case storage location information and a keyword, and based on the test case determination information, at least one target test case matched with the test case determination information is determined from a plurality of test cases, which may include the following conditions:
(1) if the test case determining information is the test case storage position information, taking the test case corresponding to the test case storage path as a target test case;
(2) and if the test case determination information is a keyword, matching the keyword with test case description information of each test case in the pre-configured test cases, and determining each test case corresponding to the test case description information containing the keyword as a target test case.
(3) If the test case determination information comprises test case storage position information and keywords, determining at least one candidate test case according to the test case storage position information, matching the keywords with test case description information of each candidate test case, and determining the candidate test case corresponding to the test case description information containing the keywords as a target test case.
The test case description information may be a test case identifier, and the embodiment of the present application is not limited to a specific form of the test case identifier, for example, the test case identifier may be a name or an ID (Identity document) of the test case, the keyword may be a character in the test case identifier, a test case corresponding to the test case identifier including the keyword may be determined from a plurality of test cases based on the keyword, and the determined test case is used as a target test case.
The test case description information may further include a service interface identifier, a test environment identifier, and the like. The servitization interface identifier in the test case identifier of the test case may be an identifier (including but not limited to a number of the servitization interface, etc.) of a servitization interface to be tested by the test case, and the test environment identifier may be a version number of a test environment to which the test case is applicable or a test environment parameter. Correspondingly, the keyword can also be set as a service interface identifier and a test environment identifier for determining at least one target test case.
In one example, as shown in fig. 3, it is assumed that there are pre-configured test case a, test case B, test case C, test case D, and test case E, and each test case has a corresponding test case identifier: the test case identifiers respectively describe functions to be tested for each test case.
The test cases A and B are stored in the path A, and the test cases C, D and E are stored in the path B.
When the test case determination information is the test case storage path (i.e., the test case storage location information) and the keyword, assuming that the test case storage path in the test case determination information is the path a, and the keyword is the "function two", the test case a and the test case B may be determined based on the test case storage path first, and then the test case B may be determined as the target test case according to the keyword "function two";
when the test case storage path is path b and the keyword is "function three", the test case C, the test case D, and the test case E may be determined based on the test case storage path, and then the test case D and the test case E may be determined as the target test case according to the keyword "function three".
The embodiment of the application provides a possible implementation mode, and the test case can be obtained through the following modes:
receiving test case configuration information through a test case configuration interface, generating a test case based on the test case configuration information and storing the test case; the test case configuration information can be a source code of a test case written by a tester, and can also be configuration information obtained by the tester through configuration of a test case interface;
specifically, generating the test case based on the test case configuration information may include directly compiling the test case by a tester according to the test case template, where the test case configuration information may be various parameters used in the test of the test case; the test case may also be a rough frame of the test case given by a pre-configured test case template, and test case configuration information is filled in the template by a tester, so as to generate the configured test case.
For each test case, the test case configuration information may include a test case identifier and a test flow file, where the test flow file includes a test script and a service parameter of at least one service interface corresponding to the test script. Where a test script may refer to a series of instructions for a particular test that may be executed by an automated test tool.
In an embodiment of the present application, the service parameters of at least one service interface may include at least one of the following:
(1) the waiting time after any service interface corresponding to the test case is called;
(2) interface calling conditions pre-configured for any of the servitization interfaces; specifically, the interface calling condition may be set for a parameter in a response message returned by the last called servization interface, and when the parameter in the response message returned by the last called servization interface meets a preset interface calling condition, the servization interface corresponding to the interface calling condition may be continuously called.
(3) The service parameter of each servitization interface may include a number corresponding to the servitization interface in the test case, and the number is used to determine a calling sequence of each servitization interface when the test case is executed.
In the embodiment of the present application, the configuration of the test flow corresponding to the test case can be implemented by configuring the service parameter of at least one service interface in the test case configuration information, and specifically, the implemented configuration effect may be at least one of the following:
(1) repeatedly executing the specified test steps in the test flow of the test case for multiple times; specifically, a process of calling a service interface for testing can be used as a testing step, a certain specified service interface can be repeatedly called for testing according to requirements, specified testing steps can be repeatedly executed, and flexibility of a testing process is improved.
(2) After the current testing step is finished, waiting for a specified time length, and continuing to execute the next testing step; the test data fed back after the current test step is executed can be received in the waiting time;
(3) whether the test process is continuously executed or not can be determined according to whether the test data obtained after the execution of the previous step meets the preset condition corresponding to the current step or not, and if so, the test process is continuously executed;
(4) the calling sequence among the servitization interfaces can be determined according to the number corresponding to each servitization interface in the test case, so that the execution sequence of the test steps is determined.
In this embodiment of the present application, the test case configuration interface may include a virtual network element selection control, and then receives the test case configuration information through the test case configuration interface, and generates the test case based on the test case configuration information, which may include the following steps:
(1) responding to the triggering operation aiming at the virtual network element selection control, and displaying a virtual network element list; the trigger operation may include but is not limited to mouse click, keyboard input, touch operation, voice command, and the like; the virtual network element list can display the identification of each virtual network element in a preset virtual network element library;
(2) receiving selection operation aiming at the virtual network elements in the virtual network element list, and determining the selected virtual network elements as target virtual network elements; specifically, a target virtual network element can be determined from a preset virtual network element library; the virtual network element library comprises virtual network elements which are subjected to basic configuration in advance, each virtual network element has corresponding basic configuration information (for example, configuration information which is not easy to change such as manufacturers and types), and a tester does not need to repeatedly configure the basic configuration information, so that the network element testing efficiency is improved;
(3) receiving test case configuration information aiming at the target virtual network element, and generating a test case corresponding to the target virtual network element based on the test case configuration information; specifically, the test case configuration information for the target virtual network element may be configuration information that the target virtual network element needs to be flexibly configured according to the test content except the basic configuration information; for example, one virtual network element may have a plurality of callable service interfaces, and the test case configuration information may include service interface selection information and service interface configuration information, where the service interface selection information is used to determine which service interface of the virtual network element is called, and the service interface configuration information may include configuration information of service parameters (e.g., protocol stack information, IP address, port, and the like) for the service interfaces, a waiting time after the service interfaces are called, and the like.
Specifically, in this embodiment of the present application, the configuration method of the execution sequence of the service interface may include, but is not limited to, the following:
respectively numbering a plurality of two servitization interfaces in the test case, reading the number of each servitization interface when the test case is executed, and determining the execution sequence of each servitization interface in a test script of the test case according to the number; if a certain service interface needs to be called for many times, a code segment for calling the service interface can be written in a test script for many times, and the code segment corresponding to the service interface is numbered for many times, or the code segment of the service interface is written only once, but the code segment corresponds to a plurality of numbers in the test script, and the specific implementation method is not limited in the application;
a test case configuration interface can be preset in a 5G network element automatic test system obtained after the virtual network element test method provided by the application is realized, and at least two service interfaces are sequenced based on the test case configuration interface; the specific implementation method can be as follows: firstly, respectively configuring the business parameters of each service interface in the test case, then referring the relevant data of each service interface by the identification of each service interface, sequencing the execution sequence of each corresponding service interface in the test case configuration interface by sequencing the identification of each service interface, and automatically generating the test case with the configured execution sequence by the system after the sequencing of the identification of the service interface is completed.
(3) Providing a preset test case template for a tester, wherein a code compiling rule is provided in the test case template, and the code compiling rule can prompt the tester how to sequence the execution sequence of each service interface when compiling codes; for example, each servitization interface may have a corresponding servitization interface identifier, a parameter may be set as a "next servitization interface identifier" in the service parameter of each servitization interface, and a value of the parameter is set as an identifier of a next servitization interface in the execution order, so as to connect the servitization interfaces in series.
The embodiment of the application provides a possible implementation manner, and the method includes the following steps that a test case configuration interface comprises a template selection control, test case configuration information is received through the test case configuration interface, and a test case is generated based on the test case configuration information:
(1) displaying a template list in response to a trigger operation for the template selection control; the template list can display each test case template in a preset test case template library;
(2) receiving selection operation aiming at the test case template in the template list, and determining the selected test case template as a target template;
(3) and receiving test case configuration information based on the target template, and generating a test case according to the target template and the test case configuration information.
In order to explain the virtual network element testing method of the present application more clearly, the virtual network element testing method will be further described with reference to specific examples.
In an example, as shown in fig. 4, the virtual network element testing method provided by the present application may include the following steps:
step S401, receiving a test request, wherein the test request can include test case determination information; the test case determination information may include a test case storage path (i.e., test case storage location information) and a keyword;
step S402, traversing each test case, and determining a storage directory and a test case identifier of each test case;
step S403, aiming at the current test case, firstly determining whether the test case storage path in the test case determination information is matched with the storage directory of the test case, if so, entering step S404, otherwise, entering step S402, and matching the next test case;
step S404, aiming at the current test case, matching the keywords in the test case determination information with the test case identification of the test case, if the test case identification is matched with the keywords, entering step S405, otherwise entering step S402;
step S405, executing the current test case to obtain a test result file;
step S406, comparing the test result file with the corresponding reference result file to obtain a comparison result;
step S407, updating a test report based on the comparison result and the test result file;
step S408, detecting whether the test case is traversed completely, if so, entering step S409, otherwise, entering step S402;
step S409, a test report is generated statistically.
In one example, the test report may include the items shown in fig. 5 and specific contents of the items, for example, for the item "start" in fig. 5, that is, the test start time is recorded, that is, the time when the test case starts to execute.
Specifically, the comparison result may be a similarity, a similarity threshold may be further set, and for each target test case, when the comparison result (the similarity between the reference result file and the test result file) is greater than the similarity threshold, the test result of the target test case is recorded as a pass in the test report of the current detection. The information such as passing rate, time consumption and the like can be counted in the finally generated test report, and the test result can be integrally evaluated.
An embodiment of the present application provides a virtual network element testing apparatus, as shown in fig. 6, the virtual network element testing apparatus 60 may include: a test request receiving module 601, a test case determining module 602, a test case executing module 603, and a test report generating module 604, wherein,
the test request receiving module is used for receiving a test request, and the test request comprises test case determination information;
the test case determining module is used for determining at least one target test case matched with the test case determining information from a plurality of test cases based on the test case determining information, each target test case corresponds to at least one service interface, and the service interfaces are interfaces between the virtual network elements;
the test case execution module is used for respectively executing each target test case to obtain a test result of each target test case;
and the test report generation module is used for generating a test report based on the test result statistics of each target test case.
The virtual network element testing method receives the testing request, the testing request comprises the testing case determining information, and at least one target testing case matched with the testing case information can be determined from the plurality of testing cases based on the testing case determining information. And executing each target test case respectively to obtain a test result file of each target test case, wherein the test result file of each target test case can contain message data sent by at least one corresponding service interface, and the message data can be a request message and/or a response message. The virtual network element testing method provided by the application can determine the target test cases based on the test case determination information in the test request, and respectively execute each target test case to obtain the corresponding test result file, so that the virtual network element can be conveniently and rapidly automatically tested, the development cost is reduced, the development efficiency is improved, and the rapid iteration of the 5G core network development can be promoted.
In this embodiment of the present application, the test case determination information is at least one of test case storage location information and a keyword, and the test case determination module is specifically configured to, when determining, from the plurality of test cases, at least one target test case that matches the test case determination information based on the test case determination information:
if the test case determining information is the test case storage position information, taking the test case corresponding to the test case storage path as a target test case;
and if the test case determination information is a keyword, matching the keyword with test case description information of each test case in the pre-configured test cases, and determining each test case corresponding to the test case description information containing the keyword as a target test case.
If the test case determination information comprises test case storage position information and keywords, determining at least one candidate test case according to the test case storage position information, matching the keywords with test case description information of each candidate test case, and determining the candidate test case corresponding to the test case description information containing the keywords as a target test case.
In the embodiment of the present application, the test case configuration module is further included, and is specifically configured to:
receiving test case configuration information through a test case configuration interface, generating a test case based on the test case configuration information and storing the test case;
and aiming at each test case, the test case configuration information comprises a test case identifier and a test flow file, wherein the test flow file comprises a test script and service parameters of at least one service interface corresponding to the test script.
In this embodiment of the present application, the test case configuration interface includes a virtual network element selection control, and the test case configuration module is specifically configured to, when receiving the test case configuration information through the test case configuration interface and generating a test case based on the test case configuration information:
responding to the triggering operation aiming at the virtual network element selection control, and displaying a virtual network element list;
receiving selection operation aiming at the virtual network elements in the virtual network element list, and determining the selected virtual network elements as target virtual network elements;
and receiving test case configuration information aiming at the target virtual network element, and generating a test case corresponding to the target virtual network element based on the test case configuration information.
In the embodiment of the present application, the test case configuration interface includes a template selection control, and the test case configuration module is specifically configured to, when receiving the test case configuration information through the test case configuration interface and generating the test case based on the test case configuration information:
responding to the trigger operation aiming at the template selection control, and displaying a template list;
receiving selection operation aiming at the test case template in the template list, and determining the selected test case template as a target template;
and receiving the configuration information of the test case based on the target template, and generating the test case according to the target template and the configuration information of the test case.
In the embodiment of the present application, the test case configuration information of each test case further includes at least one of the following:
waiting time after any one servitization interface corresponding to the test case is called;
interface call conditions pre-configured for any of the serviced interfaces.
In an embodiment of the present application, the apparatus further includes a test result comparison module, specifically configured to:
aiming at each target test case, comparing the test result file with a reference result file corresponding to the target test case to obtain a comparison result;
and generating a test report based on the test result file and the comparison result of each target test case.
The apparatus of the embodiment of the present application may execute the method provided by the embodiment of the present application, and the implementation principle is similar, the actions executed by the modules in the apparatus of the embodiments of the present application correspond to the steps in the method of the embodiments of the present application, and for the detailed functional description of the modules of the apparatus, reference may be specifically made to the description in the corresponding method shown in the foregoing, and details are not repeated here.
In an embodiment of the present application, an electronic device (computer apparatus/device/system) is provided, which includes a memory, a processor, and a computer program stored in the memory, where the processor executes the computer program to implement the steps of the virtual network element testing method, and compared with the related art, the method can implement: the automatic testing of the virtual network element is conveniently and quickly realized, the testing efficiency is improved, and the actual application requirements are better met.
In an alternative embodiment, an electronic device is provided, as shown in fig. 7, an electronic device 4000 shown in fig. 7 comprising: a processor 4001 and a memory 4003. Processor 4001 is coupled to memory 4003, such as via bus 4002. Optionally, the electronic device 4000 may further include a transceiver 4004, and the transceiver 4004 may be used for data interaction between the electronic device and other electronic devices, such as transmission of data and/or reception of data. In addition, the transceiver 4004 is not limited to one in practical applications, and the structure of the electronic device 4000 is not limited to the embodiment of the present application.
The Processor 4001 may be a CPU (Central Processing Unit), a general-purpose Processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other Programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor 4001 may also be a combination that performs a computing function, e.g., comprising one or more microprocessors, a combination of DSPs and microprocessors, etc.
The Memory 4003 may be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical Disc storage, optical Disc storage (including Compact Disc, laser Disc, optical Disc, digital versatile Disc, blu-ray Disc, etc.), a magnetic Disc storage medium, other magnetic storage devices, or any other medium that can be used to carry or store a computer program and that can be Read by a computer, without limitation.
The memory 4003 is used for storing computer programs for executing the embodiments of the present application, and is controlled by the processor 4001 to execute. The processor 4001 is used to execute computer programs stored in the memory 4003 to implement the steps shown in the foregoing method embodiments.
Among them, electronic devices include but are not limited to: mobile terminals such as mobile phones, notebook computers, PADs, etc. and fixed terminals such as digital TVs, desktop computers, etc.
Embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, and when being executed by a processor, the computer program may implement the steps and corresponding contents of the foregoing method embodiments.
Embodiments of the present application further provide a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps and corresponding contents of the foregoing method embodiments may be implemented.
The terms "first," "second," "third," "fourth," "1," "2," and the like in the description and in the claims of the present application and in the above-described drawings (if any) are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in other sequences than illustrated or otherwise described herein.
It should be understood that, although each operation step is indicated by an arrow in the flowchart of the embodiment of the present application, the implementation order of the steps is not limited to the order indicated by the arrow. In some implementation scenarios of the embodiments of the present application, the implementation steps in the flowcharts may be performed in other sequences as desired, unless explicitly stated otherwise herein. In addition, some or all of the steps in each flowchart may include multiple sub-steps or multiple stages based on an actual implementation scenario. Some or all of these sub-steps or stages may be performed at the same time, or each of these sub-steps or stages may be performed at different times, respectively. In a scenario where execution times are different, an execution sequence of the sub-steps or the phases may be flexibly configured according to requirements, which is not limited in the embodiment of the present application.
The foregoing is only an optional implementation manner of a part of implementation scenarios in the present application, and it should be noted that, for those skilled in the art, other similar implementation means based on the technical idea of the present application are also within the protection scope of the embodiments of the present application without departing from the technical idea of the present application.
Claims (10)
1. A method for testing a virtual network element, comprising:
receiving a test request aiming at a virtual network element, wherein the test request comprises test case determination information;
determining at least one target test case matched with the test case determination information from pre-configured test cases based on the test case determination information, wherein each target test case corresponds to at least one service interface, and the service interfaces are interfaces between virtual network elements;
respectively executing each target test case to obtain a test result of each target test case; and generating a test report based on the test result statistics of each target test case.
2. The virtual network element testing method of claim 1, wherein the test case determination information is at least one of test case storage location information and a keyword, and the determining at least one target test case matching the test case determination information from among a plurality of test cases based on the test case determination information comprises:
if the test case determining information is test case storage position information, taking a test case corresponding to the test case storage path as the target test case;
and if the test case determination information is a keyword, matching the keyword with the test case description information of each test case in the preconfigured test cases, and determining each test case corresponding to the test case description information containing the keyword as the target test case.
If the test case determination information comprises test case storage position information and keywords, determining at least one candidate test case according to the test case storage position information, matching the keywords with test case description information of each candidate test case, and determining the candidate test case corresponding to the test case description information containing the keywords as the target test case.
3. The virtual network element testing method according to any of claims 1-2, wherein the preconfigured test case is obtained by:
receiving test case configuration information through a test case configuration interface, generating a test case based on the test case configuration information and storing the test case;
for each test case, the test case configuration information includes a test case identifier and a test flow file, where the test flow file includes a test script and a service parameter of at least one service interface corresponding to the test script.
4. The virtual network element testing method of claim 3, wherein the test case configuration interface comprises a virtual network element selection control, the receiving of the test case configuration information through the test case configuration interface and the generation of the test case based on the test case configuration information comprises:
responding to the triggering operation aiming at the virtual network element selection control, and displaying a virtual network element list;
receiving selection operation aiming at the virtual network elements in the virtual network element list, and determining the selected virtual network elements as target virtual network elements;
and receiving test case configuration information aiming at the target virtual network element, and generating a test case corresponding to the target virtual network element based on the test case configuration information.
5. The method of claim 3, wherein the test case configuration interface includes a template selection control, and wherein receiving test case configuration information via the test case configuration interface and generating test cases based on the test case configuration information comprises:
responding to the trigger operation aiming at the template selection control, and displaying a template list;
receiving selection operation aiming at the test case template in the template list, and determining the selected test case template as a target template;
and receiving the test case configuration information based on the target template, and generating the test case according to the target template and the test case configuration information.
6. The virtual network element testing method of claim 4, wherein the test case configuration information of each test case further comprises at least one of the following:
the waiting time after any service interface corresponding to the test case is called;
an interface call condition preconfigured for said any of the serviced interfaces.
7. The method of claim 1, wherein the method further comprises:
aiming at each target test case, comparing the test result file with a reference result file corresponding to the target test case to obtain a comparison result;
and generating a test report based on the test result file and the comparison result of each target test case.
8. A virtual network element testing apparatus, comprising:
a test request receiving module, configured to receive a test request for a virtual network element, where the test request includes test case determination information;
the test case determining module is used for determining at least one target test case matched with the test case determining information from pre-configured test cases based on the test case determining information, each target test case corresponds to at least one service interface, and the service interfaces are interfaces between virtual network elements;
the test case execution module is used for respectively executing each target test case to obtain a test result of each target test case;
and the test report generating module is used for generating a test report based on the test result statistics of each target test case.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory, characterized in that the processor executes the computer program to implement the steps of the method of any of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the virtual network element testing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210435317.2A CN114745749A (en) | 2022-04-24 | 2022-04-24 | Virtual network element testing method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210435317.2A CN114745749A (en) | 2022-04-24 | 2022-04-24 | Virtual network element testing method and device, electronic equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114745749A true CN114745749A (en) | 2022-07-12 |
Family
ID=82284202
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210435317.2A Pending CN114745749A (en) | 2022-04-24 | 2022-04-24 | Virtual network element testing method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114745749A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117555813A (en) * | 2024-01-11 | 2024-02-13 | 天津异乡好居网络科技股份有限公司 | Method, device, equipment and medium for determining common test case |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109902002A (en) * | 2019-02-14 | 2019-06-18 | 浙江口碑网络技术有限公司 | Generation method and device, storage medium, the computer equipment of combined test use-case |
| CN111221743A (en) * | 2020-03-18 | 2020-06-02 | 时时同云科技(成都)有限责任公司 | Automatic testing method and system |
| CN112463599A (en) * | 2020-11-18 | 2021-03-09 | 平安消费金融有限公司 | Automatic testing method and device, computer equipment and storage medium |
| CN113918864A (en) * | 2021-11-10 | 2022-01-11 | 工银科技有限公司 | Website page testing method, testing system, testing device, electronic equipment and medium |
| CN114020642A (en) * | 2021-11-26 | 2022-02-08 | 中国银行股份有限公司 | Big data task testing method and device, storage medium and electronic equipment |
| CN114205273A (en) * | 2020-08-26 | 2022-03-18 | 腾讯科技（深圳）有限公司 | System testing method, device and equipment and computer storage medium |
-
2022
- 2022-04-24 CN CN202210435317.2A patent/CN114745749A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109902002A (en) * | 2019-02-14 | 2019-06-18 | 浙江口碑网络技术有限公司 | Generation method and device, storage medium, the computer equipment of combined test use-case |
| CN111221743A (en) * | 2020-03-18 | 2020-06-02 | 时时同云科技(成都)有限责任公司 | Automatic testing method and system |
| CN114205273A (en) * | 2020-08-26 | 2022-03-18 | 腾讯科技（深圳）有限公司 | System testing method, device and equipment and computer storage medium |
| CN112463599A (en) * | 2020-11-18 | 2021-03-09 | 平安消费金融有限公司 | Automatic testing method and device, computer equipment and storage medium |
| CN113918864A (en) * | 2021-11-10 | 2022-01-11 | 工银科技有限公司 | Website page testing method, testing system, testing device, electronic equipment and medium |
| CN114020642A (en) * | 2021-11-26 | 2022-02-08 | 中国银行股份有限公司 | Big data task testing method and device, storage medium and electronic equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117555813A (en) * | 2024-01-11 | 2024-02-13 | 天津异乡好居网络科技股份有限公司 | Method, device, equipment and medium for determining common test case |
| CN117555813B (en) * | 2024-01-11 | 2024-05-14 | 天津异乡好居网络科技股份有限公司 | Method, device, equipment and medium for determining common test case |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110765024B (en) | Simulation test method, simulation test device, electronic equipment and computer readable storage medium | |
| CN108228444B (en) | Test method and device | |
| CN107807841B (en) | Server simulation method, device, equipment and readable storage medium | |
| CN109683997B (en) | Method for accessing application program interface through sandbox, sandbox and sandbox equipment | |
| CN111078556B (en) | Application testing method and device | |
| CN110320378B (en) | Method, apparatus, device and computer readable storage medium for applying for a quality control test | |
| CN114745749A (en) | Virtual network element testing method and device, electronic equipment and readable storage medium | |
| CN112241362A (en) | Test method, test device, server and storage medium | |
| CN114610598A (en) | Test method, test device, electronic equipment and computer readable storage medium | |
| CN114328250A (en) | Automatic self-checking method, medium and device for software system | |
| CN111488286B (en) | Method and device for independently developing Android modules | |
| KR101794016B1 (en) | Method of analyzing application objects based on distributed computing, method of providing item executable by computer, server performing the same and storage media storing the same | |
| CN110838929B (en) | System error checking method and system error checking device | |
| CN111414154A (en) | Method and device for front-end development, electronic equipment and storage medium | |
| CN115022201B (en) | Data processing function test method, device, equipment and storage medium | |
| CN110020166B (en) | Data analysis method and related equipment | |
| CN114745313A (en) | Terminal remote testing method and device, electronic equipment and readable medium | |
| CN112073462B (en) | Positioning method and device | |
| CN112379967B (en) | Simulator detection method, device, equipment and medium | |
| CN111813407B (en) | Game development method, game running device and electronic equipment | |
| CN114466000A (en) | CDN gateway source returning method and device | |
| CN113986723A (en) | Mock testing method and related equipment thereof | |
| CN111797009A (en) | Method and device for detecting code compatibility and electronic equipment | |
| CN110851254A (en) | Equipment production method, device, server and storage medium based on microservice | |
| CN112306032A (en) | Consistency testing method, device and system for automobile open system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |