CN116107879A - Soft AC performance test method and system - Google Patents
Soft AC performance test method and system Download PDFInfo
- Publication number
- CN116107879A CN116107879A CN202211685176.6A CN202211685176A CN116107879A CN 116107879 A CN116107879 A CN 116107879A CN 202211685176 A CN202211685176 A CN 202211685176A CN 116107879 A CN116107879 A CN 116107879A
- Authority
- CN
- China
- Prior art keywords
- test
- soft
- time
- recording
- item
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a soft AC performance test method and system, and belongs to the technical field of soft AC test. The soft AC performance test method logs in the soft AC; acquiring a test item; processing each test item concurrently; recording a test result until all test items are tested, and ending; in step S2, the test item includes: configuration issuing, multi-AP concurrency upgrading, concurrency project creation, multi-AP online time detection and multi-project multi-AP concurrency management. The beneficial effects of the invention are as follows: the soft AC performance testing device can be used for more comprehensively testing the soft AC performance, and overcomes the defect that the traditional manual mode cannot be used for concurrent, batch and accurate test time recording.
Description
Technical Field
The invention relates to the technical field of soft AC performance test, in particular to a soft AC performance test method and system.
Background
In testing various performance metrics of soft AC, the prior art passed manual testing, which had the following drawbacks:
(1) For performance test, the operation time needs to be recorded accurately, and the operation time is not recorded accurately by manual operation, so that an error exists in a test result;
(2) For operations requiring concurrency, multithreading is required, and manual implementation cannot be achieved.
In testing various performance indexes of soft AC, manual operation cannot test the limit of software and some items cannot be tested, so it must be achieved by means of tools.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides a soft AC performance test method and a soft AC performance test system, which can accurately record the time spent by each test item, finish the test item which cannot be realized manually, and automatically record and judge the test result.
The invention discloses a soft AC performance test method, which comprises the following steps:
s1: logging in soft AC;
s2: acquiring a test item;
s3: processing each test item concurrently;
s4: recording a test result until all test items are tested, and ending;
in step S2, the test item includes: configuration issuing, multi-AP concurrency upgrading, concurrency project creation, multi-AP online time detection and multi-project multi-AP concurrency management.
The invention further improves, the realization method for configuring the issuing test item is as follows: and modifying wireless configuration and issuing to a certain number of APs, recording issuing time and configuration synchronization time, judging whether the issuing time, the configuration synchronization time and CPU utilization rate are within a certain range or not, and if so, testing to be qualified.
The invention further improves the testing method of the multi-AP online time detection item, which comprises the following steps:
firstly, preparing a front-end environment to be online for a specified number of APs and then offline;
logging in soft AC and recording the current time;
acquiring the current online AP quantity, and calculating the time difference between the current time and the beginning of the test when the current online AP quantity reaches an expected value;
and (5) recording a test result and ending.
The invention is further improved, and the performance test standard of the multi-AP online time detection item is as follows: the soft AC manages 100 APs on-line times less than 3 minutes, the soft AC manages 300 APs on-line times 5 minutes, and the soft AC manages 500 APs on-line times less than 10 minutes.
The invention further improves the testing method of the multi-item multi-AP concurrency management test item, which comprises the following steps:
adding a fixed number of projects, managing a designated number of APs under each project, continuously running for a certain time, and judging whether the test is qualified or not according to the running condition of the computer.
The invention further improves, and the test method for creating the test item by the concurrent item comprises the following steps:
logging in a soft AC to obtain an access_token;
replacing an access_token in a header in the created item interface;
recording the current time;
circularly adding and starting the processes for creating the projects, and when the number of the processes is the same as the number of the expected projects, calculating and recording the operation time;
and if the operation time meets the requirement, the test is qualified.
The invention further improves the testing method of the multi-AP concurrent upgrade test item, which comprises the following steps:
logging in a soft AC to obtain an access_token;
replacing an access_token in a header in the created item interface;
acquiring a device list, and uploading an upgrade file according to the device type;
recording the current time;
batch upgrading, namely obtaining the quantity of APs which are on line again after upgrading is completed;
if the number of the online APs reaches the expected value, calculating and recording the time of online again;
and if the operation time meets the requirement, the test is qualified.
The invention also provides a system for realizing the soft AC performance test method, which comprises the following steps:
a login module: for logging in soft AC;
the acquisition module is used for: for obtaining test items;
and an operation module: for concurrently processing the test items;
and a recording module: for recording the results of the test(s),
wherein the test item comprises: configuration issuing, multi-AP concurrency upgrading, concurrency project creation, multi-AP online time detection and multi-project multi-AP concurrency management.
Compared with the prior art, the invention has the beneficial effects that: the testing method is more suitable for practical application and is more scientific and reasonable, the performance of the soft AC can be tested more comprehensively, and the defect that the traditional manual mode cannot be used for concurrent, batch and accurate test time recording is overcome.
The traditional manual testing method cannot operate one account to add a plurality of items at the same time. Therefore, the traditional manual test cannot meet the performance test requirement of concurrent project creation, and an accurate test result cannot be obtained. The invention can rapidly test the concurrent project creation performance, automatically record accurate test time and ensure more reliable performance test results;
the conventional manual test method has a too large error in test results when testing time-dependent performance items. Such as batch configuration down, configuration synchronization time performance testing, may take several seconds or even less to complete. When manual configuration is performed, configuration may be synchronized after configuration is issued, but manual operation is too slow to check whether configuration is synchronized or not, so that errors of test results are large and accuracy of the test results is affected. According to the invention, the script is used for issuing the configuration and checking whether the configuration is synchronous or not, so that the time spent by the test can be automatically recorded, and the precision of the test result is greatly improved;
the invention has simple configuration, and the script running environment is replaced by replacing the driver corresponding to the browser version on the computer, thereby being convenient and quick to deploy; the script encapsulates various operations of the soft AC into a method, the operation flow can be customized according to the test requirement, and the method is simply called, so that the investment of test personnel and time is effectively reduced.
Drawings
For a clearer description of the present application or of the solutions of the prior art, a brief introduction will be given below to the drawings used in the description of the embodiments or of the prior art, it being apparent that the drawings in the description below are some embodiments of the present application, from which other drawings can be obtained, without the inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of the method of the present invention;
FIG. 2 is a logical block diagram of the present invention;
FIG. 3 is a flow chart of a multi-AP online time detection test method;
FIG. 4 is a flow chart of a test method for multi-project multi-AP concurrency management test project;
FIG. 5 is a flow chart of a test method for creating test items for concurrent items;
fig. 6 is a flow chart of a test method for multi-AP concurrent upgrade test items.
Detailed Description
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs; the terminology used in the description of the applications herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application; the terms "comprising" and "having" and any variations thereof in the description and claims of the present application and in the description of the figures above are intended to cover non-exclusive inclusions. The terms first, second and the like in the description and in the claims or in the above-described figures, are used for distinguishing between different objects and not necessarily for describing a sequential or chronological order.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.
In order to better understand the technical solutions of the present application, the following description will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings.
As shown in FIG. 1, the invention can accurately record the time of soft AC management AP online, automatically add multiple projects and manage multiple APs, concurrently execute project creation operation and record time spent, automatically issue configuration and record time, automatically upgrade equipment in batches and record equipment online again by using the soft AC performance automatic test tool. The soft AC performance automatic testing tool performs a soft AC performance testing method, and the testing method comprises the following steps:
s1: logging in soft AC;
s2: acquiring a test item;
s3: processing each test item concurrently;
s4: recording a test result until all test items are tested, and ending;
in step S2, the test item includes: configuration issuing, multi-AP concurrency upgrading, concurrency project creation, multi-AP online time detection and multi-project multi-AP concurrency management.
The implementation of the present invention will be described in detail below.
1. Test environment
The system supports: 64-bit windows7 and above system
Programming language: python3.9
Test frame: logging, os, time, requests, threading, random, selenium, chromedrive
The logging is a log module built in python, and the running state of the code can be recorded in detail through simple configuration, so that the logging is very convenient for recording the test result.
os is a self-contained library in python that provides a rich operating system-related operating interface.
time is a self-contained library in python that provides time-dependent operations.
random is a standard library of python for generating random numbers, random selections, etc
selenium is a powerful third party library that can operate a browser by writing a python script as if the actual user were operating the browser.
The requests are a powerful third party library that can quickly send various http and https requests.
threading is a library that provides multi-threading and multi-process operations.
chromadrive is a driver file for the Google browser, and selenium operates the browser actually by driving.
2. Module package
1. softwareacttools.py: a series of operation interfaces for web pages of the soft AC are packaged and are mainly used for testing multi-AP online time and multi-project multi-AP performance.
2. conciseprojectadd. Py: for concurrent creation of a specified number of soft AC items and recording the time required to create the items.
3. mangypapuppgrad.py: the method is used for issuing upgrading commands in batches by the soft AC, and recording the time of online again after AP upgrading.
4. softWareAcResourceLock. Py: the method is used for detecting the conditions of CPU and memory of the computer occupied by the soft AC in real time, and recording the conditions into a log file.
3. Logic framework
As shown in fig. 2, the present example is implemented based on a three-layer framework of an application layer, a control layer and a function execution layer, where the application layer provides a running main function and acquires a log record returned by the control layer, the control layer completes console printing, log record and function module call, and each function module in the function execution layer implements concurrent testing of different projects.
4. Detailed description of the modules
(1) Login Web: and the web page is used for logging in the soft AC, judging whether a private connection page of the security check occurs, and automatically skipping the page after the private connection page occurs.
(2) wirelessEdit: the method is used for modifying wireless configuration and issuing, and recording issuing time and configuration synchronization time. The performance test criteria of this example are: 100 APs are configured and issued for less than 3 seconds, the synchronization time deviation of configuration parameters is less than 15 seconds, and the CPU utilization rate is less than 80%.
(3) manypaponline lock: the performance test standard is used for testing the multi-AP online time and comprises the following steps: the soft AC manages 100 ap on-line times less than 3 minutes, the soft AC manages 300 ap on-line times 5 minutes, and the soft AC manages 500 ap on-line times less than 10 minutes. Or the test result is equivalent to or better than the bid.
As shown in fig. 3, the test method of the multi-AP online time detection item is as follows:
firstly, preparing a front-end environment to be online for a specified number of APs and then offline;
logging in soft AC and recording the current time;
acquiring the current online AP quantity, and calculating the time difference between the current time and the beginning of the test when the current online AP quantity reaches an expected value;
and (5) recording a test result and ending.
(4) manageallAp: for adding a fixed number of items and managing a specified number of APs under each item. The performance test criteria were: 10 projects, each project manages 50 APs and 100 projects, each project manages 5 APs, 7 x 24 does not drop lines, old computers and memory CPUs are not higher than 50% (normal system and page response speed are normal).
As shown in fig. 4, the test method for multi-item multi-AP concurrency management test item in this example is as follows:
adding a fixed number of projects, managing a designated number of APs under each project, continuously running for a certain time, and judging whether the test is qualified or not according to the running condition of the computer.
The invention further improves, and the test method for creating the test item by the concurrent item comprises the following steps:
logging in a soft AC to obtain an access_token;
replacing an access_token in a header in the created item interface;
recording the current time;
circularly adding and starting the processes for creating the projects, and when the number of the processes is the same as the number of the expected projects, calculating and recording the operation time;
and if the operation time meets the requirement, the test is qualified.
(5) conciseprojectadd. Py: for concurrent creation of a specified number of soft AC items and recording the time required to create the items. The performance test criteria were: the single user creates 20 items concurrently with less than 0.5 seconds and 100 items concurrently with less than 1 second. Or the time is comparable to or better than the bid. The complete implementation is shown in fig. 5.
(6) mangypapuppgrad.py: the method is used for issuing upgrading commands in batches by the soft AC, and recording the time of online again after AP upgrading. The performance test standard is that 100 APs are upgraded for less than 5 minutes at the same time.
As shown in fig. 6, the test method for the multi-AP concurrent upgrade test item in this example is as follows:
logging in a soft AC to obtain an access_token;
replacing an access_token in a header in the created item interface;
acquiring a device list, and uploading an upgrade file according to the device type;
recording the current time;
batch upgrading, namely obtaining the quantity of APs which are on line again after upgrading is completed;
if the number of the online APs reaches the expected value, calculating and recording the time of online again;
and if the operation time meets the requirement, the test is qualified.
In addition, the invention also provides a system for realizing the soft AC performance test method, which comprises the following steps:
a login module: for logging in soft AC;
the acquisition module is used for: for obtaining test items;
and an operation module: for concurrently processing the test items;
and a recording module: for recording the results of the test(s),
wherein the test item comprises: configuration issuing, multi-AP concurrency upgrading, concurrency project creation, multi-AP online time detection and multi-project multi-AP concurrency management.
The division of the modules in the embodiment of the invention is schematic, only one logic function is divided, and other division modes can be adopted in actual implementation. In addition, each functional unit in the embodiments of the present invention may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules.
Compared with the prior art, the invention creatively provides a set of testing method which is more suitable for practical application and is more scientific and reasonable, can more comprehensively test the performance of the soft AC, and overcomes the defect that the traditional manual mode cannot be used for concurrent, batch and accurate test time recording.
The traditional manual testing method cannot operate one account to add a plurality of items at the same time. Therefore, the traditional manual test cannot meet the performance test requirement of concurrent project creation, and an accurate test result cannot be obtained. The invention can rapidly test the concurrent project creation performance, automatically record accurate test time and ensure more reliable performance test results.
The conventional manual test method has a too large error in test results when testing time-dependent performance items. Such as batch configuration down, configuration synchronization time performance testing, may take several seconds or even less to complete. When manual configuration is performed, configuration may be synchronized after configuration is issued, but manual operation is too slow to check whether configuration is synchronized or not, so that errors of test results are large and accuracy of the test results is affected. According to the invention, the script is used for issuing the configuration and checking whether the configuration is synchronous or not, so that the time spent in the test can be automatically recorded, and the precision of the test result is greatly improved.
The invention has the following advantages:
1. the configuration is simple, the script running environment is replaced by only replacing the driver of the corresponding browser version on the computer, the quick deployment is convenient, the maintainability, the expandability and the portability are realized, and more operation interfaces can be added subsequently;
2. the script encapsulates various operations of the soft AC into a method, the operation flow can be customized according to the test requirement, and the method is simply called;
3. the test result can be automatically recorded;
4. the investment of testers and time is effectively reduced, the testing resources are saved, the testing efficiency is improved, and the testing accuracy is improved.
The above embodiments are preferred embodiments of the present invention, and are not intended to limit the scope of the present invention, which includes but is not limited to the embodiments, and equivalent modifications according to the present invention are within the scope of the present invention.
Claims (8)
1. A soft AC performance test method, comprising the steps of:
s1: logging in soft AC;
s2: acquiring a test item;
s3: processing each test item concurrently;
s4: recording a test result until all test items are tested, and ending;
in step S2, the test item includes: configuration issuing, multi-AP concurrency upgrading, concurrency project creation, multi-AP online time detection and multi-project multi-AP concurrency management.
2. The soft AC performance test method of claim 1, wherein: the implementation method for the configuration issuing test item comprises the following steps: and modifying wireless configuration and issuing to a certain number of APs, recording issuing time and configuration synchronization time, judging whether the issuing time, the configuration synchronization time and CPU utilization rate are within a certain range or not, and if so, testing to be qualified.
3. The soft AC performance test method of claim 1, wherein: the test method of the multi-AP online time detection item comprises the following steps:
firstly, preparing a front-end environment to be online for a specified number of APs and then offline;
logging in soft AC and recording the current time;
acquiring the current online AP quantity, and calculating the time difference between the current time and the beginning of the test when the current online AP quantity reaches an expected value;
and (5) recording a test result and ending.
4. A soft AC performance test method according to claim 3, characterized in that: the performance test standard of the multi-AP online time detection item is as follows: the soft AC manages 100 APs on-line times less than 3 minutes, the soft AC manages 300 APs on-line times 5 minutes, and the soft AC manages 500 APs on-line times less than 10 minutes.
5. The soft AC performance test method of claim 1, wherein: the test method for the multi-item multi-AP concurrency management test item comprises the following steps:
adding a fixed number of projects, managing a designated number of APs under each project, continuously running for a certain time, and judging whether the test is qualified or not according to the running condition of the computer.
6. The soft AC performance test method of claim 1, wherein: the test method for creating the test item by the concurrent item comprises the following steps:
logging in a soft AC to obtain an access_token;
replacing an access_token in a header in the created item interface;
recording the current time;
circularly adding and starting the processes for creating the projects, and when the number of the processes is the same as the number of the expected projects, calculating and recording the operation time;
and if the operation time meets the requirement, the test is qualified.
7. The soft AC performance test method of claim 1, wherein: the test method for the multi-AP concurrent upgrade test item comprises the following steps:
logging in a soft AC to obtain an access_token;
replacing an access_token in a header in the created item interface;
acquiring a device list, and uploading an upgrade file according to the device type;
recording the current time;
batch upgrading, namely obtaining the quantity of APs which are on line again after upgrading is completed;
if the number of the online APs reaches the expected value, calculating and recording the time of online again;
and if the operation time meets the requirement, the test is qualified.
8. A system for implementing the soft AC performance test method of any one of claims 1-7, comprising:
a login module: for logging in soft AC;
the acquisition module is used for: for obtaining test items;
and an operation module: for concurrently processing the test items;
and a recording module: for recording the results of the test(s),
wherein the test item comprises: configuration issuing, multi-AP concurrency upgrading, concurrency project creation, multi-AP online time detection and multi-project multi-AP concurrency management.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211685176.6A CN116107879A (en) | 2022-12-27 | 2022-12-27 | Soft AC performance test method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211685176.6A CN116107879A (en) | 2022-12-27 | 2022-12-27 | Soft AC performance test method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116107879A true CN116107879A (en) | 2023-05-12 |
Family
ID=86255411
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211685176.6A Pending CN116107879A (en) | 2022-12-27 | 2022-12-27 | Soft AC performance test method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116107879A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116594965A (en) * | 2023-05-16 | 2023-08-15 | 矩阵时光数字科技有限公司 | System and method for detecting random number supporting multithreading |
-
2022
- 2022-12-27 CN CN202211685176.6A patent/CN116107879A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116594965A (en) * | 2023-05-16 | 2023-08-15 | 矩阵时光数字科技有限公司 | System and method for detecting random number supporting multithreading |
| CN116594965B (en) * | 2023-05-16 | 2024-05-07 | 矩阵时光数字科技有限公司 | System and method for detecting random number supporting multithreading |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111414172B (en) | Automatic deployment and release system and method for application software | |
| US8407672B2 (en) | Systems and methods for synchronizing software execution across data processing systems and platforms | |
| US5146460A (en) | Logic simulation using a hardware accelerator together with an automated error event isolation and trace facility | |
| US9519571B2 (en) | Method for analyzing transaction traces to enable process testing | |
| CN111897724B (en) | Automatic testing method and device suitable for cloud platform | |
| CN107368313B (en) | Code detection method, device and electronic equipment | |
| CN108519943A (en) | Testing and control and test execution device, method and computer storage media | |
| CN104850499A (en) | Automatic test method and device for base band software | |
| CN110673936A (en) | Breakpoint continuous operation method and device for arranging service, storage medium and electronic equipment | |
| CN116107879A (en) | Soft AC performance test method and system | |
| CN115686540A (en) | RPA control method and system based on Hongmong system | |
| CN109992509A (en) | The automated execution method, apparatus of test case, electronic equipment | |
| CN107832176A (en) | Hard disk pressure automatic test approach and system under a kind of Windows | |
| CN112100085B (en) | Android application program stability testing method, device and equipment | |
| US20230367936A1 (en) | Verification method, electronic device and storage medium | |
| CN116087752A (en) | Chip testing method, system, device and medium | |
| CN109522217A (en) | The internal storage testing method and terminal device of application program | |
| RU2729210C1 (en) | Electronic devices software testing system | |
| CN114218072A (en) | Test script generation method and device, storage medium and computer equipment | |
| CN112181853A (en) | Program debugging method, device and system | |
| US9053239B2 (en) | Systems and methods for synchronizing software execution across data processing systems and platforms | |
| CN111597101A (en) | SDK access state detection method, computer device and computer readable storage medium | |
| US20230418728A1 (en) | Method and system for generating real-time test environment activity view for functional simulations | |
| AU2023201696B2 (en) | Method and device for determining coverage in HIL testing, and storage medium | |
| CN114430300B (en) | Method, system, equipment and medium for testing wireless communication module |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |