Specific embodiment
The application in order to facilitate understanding is described more fully the application below with reference to relevant drawings.In attached drawing
Give the preferred embodiment of the application.But the application can realize in many different forms, however it is not limited to this paper institute
The embodiment of description.On the contrary, purpose of providing these embodiments is make it is more thorough and comprehensive to disclosure of this application.
It should be noted that it can be directly to separately when an element is considered as " connection " another element
One element and it is in combination be integrated, or may be simultaneously present centering elements.
Unless otherwise defined, all technical and scientific terms used herein and the technical field for belonging to the application
The normally understood meaning of technical staff is identical.The term used in the description of the present application is intended merely to description tool herein
The purpose of the embodiment of body, it is not intended that in limitation the application.Term " and or " used herein includes one or more phases
Any and all combinations of the listed item of pass.
In traditional NM server performance test methods, communication system mainly is built in laboratory and is tested.
But it is difficult to build the system that thousands of base stations are communicated with equipment under test network management under laboratory environment;Large-scale equipment
System to build cost big, and system function is complicated.
For this purpose, present applicant proposes the modes that anolog base station information is communicated with NM server, using performance testing tool
According to Test Strategy, each behavior of simulation of bulk base station equipment simultaneously carries out single or multiple concurrent industry to NM server
Business, obtains the test result of NM server performance according to the disposition of NM server.Wherein, base station can provide for user
The covering in a region is completed in voice, data service, batch base station.NM server can obtain base-station voice under the region,
Data service traffic conditions, moreover it is possible to which the fault condition for getting the origin base station upgrades, again the website under monitoring area
It opens and Breakdown Maintenance etc..Base station simulator unit can be load machine, can be used for the letter that anolog base station is interacted with NM server
Breath;By a large number of services of load machine, the performance data that NM server can be supported can be obtained;Specifically, base station, base station simulation
Interchanger can be used between device unit, NM server to be connected with each other.
Window of the NM server as each equipment can accurately learn the real-time status of equipment;Connect NM server
Number of devices it is more, it is all the more stringent to the performance requirement of NM server.The embodiment of the present application can measure network management clothes in advance
Business device performance the equipment amount that NM server can accommodate can be calculated according to performance indicator, for client selection provide according to
According to.
In typical NM server performance test, related simulation message may include heartbeat message, performance file, announcement
Alert message, upgrading message, boot message and registration message etc..Each simulation behavior can the single multiple mode per second of business
It is sent, can also be sent with the multiple mode per second of composite service, table 1 is NM server in one embodiment existing
Actual performance index in net.
Actual performance index of the NM server in existing net in 1. one embodiment of table
In one embodiment, a kind of NM server test method is provided, as shown in FIG. 1, FIG. 1 is one embodiment
First schematic flow chart of middle NM server test method, comprising:
Step S110, base station simulator unit are based on test scene model, send respective counts to NM server to be tested
The simulation message of amount;Simulate message be base station simulator unit according to it is grabbing, for base station and NM server to be tested
What interactive true messages packet generated.
Step S120, base station simulator unit obtain the performance test results;The performance test results are by simulation message through to be measured
It is obtained after examination NM server processing.
Specifically, base station simulator unit generates phase according to the true messages packet and test scene model grabbed
The simulation message of quantity is answered, and according to the sending strategy of test scene model, simulation message is sent to network manager service to be tested
Device;The performance test results obtained when obtaining NM server processing simulation message.
It should be noted that base station simulator unit can be used for grabbing true messages packet, the quantity that Virtual NE is arranged, fortune
Row performance testing tool software generates simulation message, simulation message is sent to NM server and obtains NM server
The performance test results.Specifically, base station simulator unit may include for grab truthful data packet, runnability testing tool with
And the controller of simulation message is sent, and the load device for generating simulation message.It should be noted that controller and processing
Device can belong to different servers, can also belong to a server.
True messages packet is base station and the message package that NM server interacts, and is generated by base station side and can reflect base station
Running truthful data situation.In the test process of the embodiment of the present application, at least one true messages packet can be obtained and generated
Corresponding simulation message, realizes the diversification of simulation message, so that test is more comprehensive.Specifically, base station simulator unit can
It acquires a true messages packet and generates a plurality of simulation message, can also acquire multiple true messages packets, and really disappear based on each
Breath packet generates corresponding simulation message
It simulates message to generate based on true messages packet, type of message can be corresponding with the type of true messages packet, is used for base
The message that simulator unit of standing anolog base station is interacted with NM server.Specifically, simulation message can realize base station simulator list
Member and heartbeat message, performance file, alarm information, upgrading message, boot message and the registration message of NM server etc.
Interaction.
In the application environment of NM server, the type of message that each base station is interacted with NM server is in the same time
Point is not quite similar, and the performance pressures of network management are also different in different time points.For this purpose, the test scene model in the application includes
Send the parameters such as the quantity of the type of simulation message, the strategy for sending simulation message and transmission simulation message.
Specifically, test scene model may include the type for the simulation message that test is related to, the hair of all types of simulation message
Send the sending time etc. of quantity and all types of simulation message.For example, can be according to the curriculum offering concurrent user number and pressure of table 1
Power model, and give more sustained attention the performance change of NM server.It treats test NM server and carries out several scenes test, foundation
The performance test results of NM server can be obtained in the disposition of NM server.According to test scene model, base station simulation
Device unit can be tested in the simulation message that synchronization sends batch to NM server to be tested, can also be in setting time
Simulation message NM server to be tested is sent in batches in section to test.
Based on true messages packet and test scene model, the behavior of base station simulator unit analog real ones,
It is comprehensive to simulate message.The mode accessed using limited real ones equipment, the application are only capable of in relative experimental room test environment
The perfect method of NM server performance test of embodiment, improves the accuracy to NM server performance test.
In order to which the performance test of NM server is more abundant, to the transmission of simulation message can there are many test scene,
One of be each message independent Batch sending;Two to be sent out after obtaining several message efficient combinations according to orthogonal test in batches
It send;Three for message on the basis of pressure model or be greater than pressure model combination after Batch sending;Four at the appointed time
Batch sending is carried out to single message or combined message;Network management performance test result is obtained according to network management disposition.
Traditional technology is tested using a large amount of real ones, and the networking for testing environment is difficult and expensive, this
The method that the test method of application uses base station simulator unit anolog base station message, can be obtained the performance test of NM server
As a result, greatly reducing testing cost.
The embodiment of the present application uses test scene model and base station simulator unit, batch anolog base station and network manager service
The information of device communication can accurately measure the performance of NM server to NM server forming properties pressure, meanwhile, it is capable to
Reduce the networking difficulty and cost of test;According to performance indicator, the number of devices of NM server energy capacity can be calculated, for visitor
The selection at family provides foundation.
In one embodiment, true messages packet is the message package that base station is generated based on TR069 agreement.
True messages packet includes any one or any combination in following message: heartbeat message, performance file, alarm disappear
Breath, upgrading message, boot message and registration message.
Specifically, base station equipment is communicated with NM server using TR069 agreement, can be given birth to according to TR069 agreement
At the true messages packet interacted with NM server;Simulation message may be based on what true messages packet and TR069 agreement generated
Message.True messages packet includes in heartbeat message, performance file, alarm information, upgrading message, boot message and registration message
At least one.The true messages packet that base station simulator unit crawl real ones are interacted with NM server, passage capacity are surveyed
Trial work tool Software Coding can realize that each simulation message is communicated with NM server;Accordingly, simulation message may include that heartbeat disappears
Breath, performance file, alarm information, upgrading message, boot message and registration message etc..
It should be noted that base station communicate with NM server the agreement existing defects of use in traditional technology.With
For snmp protocol (Simple Network Management Protocol, Simple Network Management Protocol), SNMP is UDP association
Discuss (User Datagram Protocol, User Datagram Protocol), be by the direct transmitting order to lower levels of NM server to equipment,
In, transmitting order to lower levels only has set and get to act, other then need to control by device parameter;When network quality is bad, use
Snmp protocol is easy to produce packet loss;NM server issues parameter to equipment, and when equipment is not replied, NM server is not known
Whether equipment receives parameter;The content interacted using snmp protocol is simple, can only depend on MIB (Management
Information Base, management information bank) node operated.
The TR069 agreement that the embodiment of the present application uses is that (Transmission Control Protocol is passed Transmission Control Protocol
Transport control protocol view), it is possible to provide reliable transmission, situations such as avoiding the occurrence of mistake, repeat or lose.The connection mould that TR069 is supported
Type has high flexibility ratio, and NM server and base station equipment can all initiate the connection request, and base station equipment IP variation not will lead to
Maintenance failure;Meanwhile TR069 defines list and the property parameters of many kinds of parameters, powerful, the net based on TR069 agreement
The ease for use of equipment can be improved in guard system.The order that NM server issues may include set, get, download, reboot
Deng movement, and connection can be closed by NM server.Base station equipment is communicated with NM server using TR069 agreement,
Base station simulator unit passes through the communication information of batch anolog base station and NM server, and the performance of NM server can be obtained,
Theoretical foundation is provided for the practical application of NM server.
In one embodiment, as shown in Fig. 2, Fig. 2 shows for second of NM server test method in one embodiment
Meaning property flow chart, base station simulator unit are based on test scene model, and the mould of respective numbers is sent to NM server to be tested
Before the step of quasi- message, further comprise the steps of:
Step S108, base station simulator unit obtain simulation message template according to TR069 protocol-decoding true messages packet.
Base station simulator unit is based on test scene model, and the simulation for sending respective numbers to NM server to be tested disappears
The step of breath includes:
Step S112, base station simulator unit are based on test scene model, the quantity forwarded of confirmation simulation message.
Step S114, base station simulator unit generate the simulation message of quantity forwarded according to simulation message template;Simulation disappears
Breath includes the acquisition time of network element sequence number, base station parameter and true messages packet;Base station parameter includes the online user of base station
Quantity and the handling capacity of base station.
Specifically, base station simulator unit grabs true messages packet, true messages packet is solved according to TR069 agreement
Code forms simulation message template.Quantity based on the simulation message that test scene model, confirmation need to send, and according to simulation
Message template generates the simulation message of corresponding quantity forwarded.Wherein, simulation message template may include file name, network element sequence
Number, base station parameter and the acquisition time of truthful data packet etc..
It should be noted that simulation message template is generated according to true messages packet, the type of message comprising true messages packet,
Acquire time started and the acquisition information such as end time and base station parameter.Base station parameter includes online user's quantity of base station
With the handling capacity of base station.
It simulates message to be generated according to simulation message template, gives the mistake of NM server to be tested in Batch sending simulation message
Cheng Zhong, each message of simulating can be generated by each Virtual NE in base station simulator unit is corresponding;Based on network element sequence number or really
The acquisition time of message package can distinguish different simulation message, realize that NM server to be tested simulates the place of message to batch
Reason.Specifically, when the corresponding acquisition time of each simulation message is the same, area can be carried out to simulation message by network element sequence number
Point;When the corresponding network element sequence number of each simulation message is identical, simulation message can be distinguished by acquisition time.
Different test scene models can correspond to different simulation message quantity forwardeds can be true according to test scene demand
Recognize and generate the simulation message of corresponding quantity forwarded.
In one embodiment, as shown in figure 3, the third that Fig. 3 is NM server test method in one embodiment is shown
Meaning property flow chart, base station simulator unit is according to simulation message template, after the step of generating the simulation message of quantity forwarded, also
Comprising steps of
Step S116, base station simulator unit are based on test scene model, the sending instant of confirmation simulation message;Base station mould
The simulation message of quantity forwarded is sent to NM server to be tested in sending instant by quasi- device unit.
Or, step S118, base station simulator unit is based on test scene model, the sending time section of confirmation simulation message;
Base station simulator unit is successively sent to NM server to be tested in sending time section, by the simulation message of quantity forwarded.
Specifically, test scene model can include at least two kinds of simulation message sending strategys, it can be used for corresponding to network management clothes
The case where business device faces.Specifically, it may include: base station simulator unit is same by the simulation message of quantity forwarded in sending instant
When be sent to NM server to be tested, performance when test NM server handles bulk messages;Base station simulator
Simulation message can be also sent to NM server to be tested in batches, test NM server by unit in sending time section
Performance when handling in stipulated time section multiple bulk messages.
It should be noted that the sending strategy of test scene model may also include that the independence of single simulation message, batch are sent out
It send;Different types of simulation message carries out Batch sending after efficient combination;Message is simulated on the basis of pressure model or greater than pressure
Power model is combined rear Batch sending;Batch hair is carried out to the simulation message or combined message of single type at the appointed time
It send.
In one embodiment, simulation message further includes that message generates time and organization unique identifier.
Specifically, the message of simulation message generates the time and organization unique identifier is used equally for network management to be tested to take
Business device distinguishes each simulation message.
It should be noted that generating time, network element sequence number and tissue unique identification may be disposed at the text of simulation message
In part title, distinguished convenient for NM server.
In one embodiment, as shown in figure 4, Fig. 4 shows for the 4th of NM server test method in one embodiment
Meaning property flow chart, base station simulator unit are based on test scene model, and the mould of respective numbers is sent to NM server to be tested
After the step of quasi- message, further comprise the steps of:
Step S130, the operating status letter between base station simulator unit obtains NM server to be tested at runtime in section
Breath;Runing time section includes starting point and ending point;Starting point is at the time of generating simulation message;Terminating point is to get performance
At the time of test result;Running state information includes handling capacity and clicking rate.
Specifically, in the test process of the embodiment of the present application, the starting point and destination node of settable test;Specifically,
Arrival starting point is reported when generating simulation message, starts timing;Simulating after the completion of message uploads waits network management NM server to return
Multiple, base station simulator unit receives reply, obtains reaching terminating point when the performance test results.It is between starting point and terminating point
The runing time of NM server to be tested in the test;When completing test, runing time can react in the result, also,
Scene will record the numerical value such as handling capacity, clicking rate and response time of NM server to be tested in this time.
In one embodiment, the performance test results include any one or any combination of following values: the response time,
Cpu busy percentage and disk utilization.
Specifically, the performance test results may include at least one in response time, cpu busy percentage and disk utilization
Kind.After base station simulator unit sends simulation message to NM server to be tested based on test scene model, network management can be obtained
The resource utilization of server, such as cpu busy percentage, the disk utilization of NM server;The transaction response time can also be obtained
(trans response time), i.e., make a response the required time to request: the response time is slack-off, illustrates network manager service
The decline of device performance;TPS (Transaction Per Second), i.e., the transaction or thing that master slave system per second is capable of handling can also be obtained
The quantity of business.
The embodiment of the present application realizes heartbeat, performance file, the alarm, liter of base station simulator unit and NM server
The interaction of the message such as grade, boot, registration, analog carries out several scenes test, and the disposition according to NM server obtains
To the performance test results of NM server.Base is simulated using the true messages packet that base station simulator unit and base station generate
The behavior stood is realized simulation message generalization and the perfect performance test process of NM server, is improved to net
The accuracy of pipe server performance test.Meanwhile solving using real ones and carrying out test bring environment networking difficulty,
Expensive problem, substantially reduces testing cost.
It should be understood that although each step in the flow chart of Fig. 1-4 is successively shown according to the instruction of arrow,
These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps
Execution there is no stringent sequences to limit, these steps can execute in other order.Moreover, at least one in Fig. 1-4
Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps
Completion is executed, but can be executed at different times, the execution sequence in these sub-steps or stage is also not necessarily successively
It carries out, but can be at least part of the sub-step or stage of other steps or other steps in turn or alternately
It executes.
In one embodiment, a kind of NM server test device is provided, as shown in figure 5, Fig. 5 is one embodiment
The structural schematic diagram of middle NM server test device, comprising:
Message transmission module 110 is simulated, for being based on test scene model, sends respective counts to NM server to be tested
The simulation message of amount;True messages being grabbed according to simulation message, being interacted for base station with NM server to be tested
Wrap the message generated.
Test result obtains module 120, for obtaining the performance test results;The performance test results are by simulation message through to be measured
It is obtained after examination NM server processing.
In one embodiment, true messages packet is the message package that base station is generated based on TR069 agreement.
True messages packet includes any one or any combination in following message: heartbeat message, performance file, alarm disappear
Breath, upgrading message, boot message and registration message.
In one embodiment, further includes: message package decoder module is used for according to TR069 protocol-decoding true messages packet,
Obtain simulation message template.
Simulating message transmission module includes:
Quantity forwarded confirmation unit, for being based on test scene model, the quantity forwarded of confirmation simulation message.
Message generation unit is simulated, for generating the simulation message of quantity forwarded according to simulation message template;Simulate message
Acquisition time including network element sequence number, base station parameter and true messages packet;Base station parameter includes the online user number of base station
Amount and the handling capacity of base station.
In one embodiment, message transmission module is simulated further include:
Message sending unit, for being based on test scene model, the sending instant of confirmation simulation message;It is incited somebody to action in sending instant
The simulation message of quantity forwarded is sent to NM server to be tested;Or, it is based on test scene model, the hair of confirmation simulation message
Send the period;In sending time section, the simulation message of quantity forwarded is successively sent to NM server to be tested.
In one embodiment, simulation message further includes that message generates time and organization unique identifier.
In one embodiment, further includes:
Operating status obtains module, for the operating status letter in section between obtaining NM server to be tested at runtime
Breath;Runing time section includes starting point and ending point;Starting point is at the time of generating simulation message;Terminating point is to get performance
At the time of test result;Running state information includes handling capacity and clicking rate.
In one embodiment, the performance test results include any one or any combination of following values: the response time,
Cpu busy percentage and disk utilization.
Specific restriction about NM server test device may refer to above for NM server test method
Restriction, details are not described herein.Modules in above-mentioned NM server test device can be fully or partially through software, hard
Part and combinations thereof is realized.Above-mentioned each module can be embedded in the form of hardware or independently of in the processor in computer equipment,
It can also be stored in a software form in the memory in computer equipment, execute the above modules in order to which processor calls
Corresponding operation.
In one embodiment, as shown in fig. 6, Fig. 6 shows for first of NM server test macro in one embodiment
Meaning property structure chart, provides a kind of NM server test macro, comprising: NM server 300 to be tested, base station 400, and
Realize the base station simulator unit 200 such as above-mentioned NM server test method;Base station simulator unit 200 be separately connected to
Test NM server 300 and base station 400;NM server 300 to be tested connects base station 400.
Base station simulator unit 200 can realize following steps:
Based on test scene model, the simulation message of respective numbers is sent to NM server 300 to be tested;Simulate message
According to grab, message that the true messages packet that is interacted with NM server 300 to be tested for base station 400 generates.
Obtain the performance test results;The performance test results are obtained after NM server 300 to be tested processing by simulation message
It arrives.
Specifically, the Test Networking framework of NM server performance may include NM server to be tested, base station simulation
Device unit and base station etc..Wherein, NM server to be tested is for receiving and processing base station simulator unit system simulation message
The true messages sent with base station;Base station simulator unit is for generating and sending analog information to NM server to be tested;
Base station is used to send and handle the message that NM server to be tested is sent.
It should be noted that deployment base station simulator unit and real ones equipment, are connected by establishing with NM server
It connects, base station simulator unit and real ones are to NM server forming properties pressure.Base station simulator unit has disposed performance
Testing tool software, also, software includes registration, heartbeat, performance file, the alarm, liter for grabbing base station equipment and interacting with network management
Grade, boot and the script file of registration.Meanwhile the corresponding parameter information of base station simulator unit has been arranged completely;Network management
The service of server is opened;Base station equipment is registered in NM server;Each Virtual NE is equal in base station simulator unit
It is registered in NM server.
Based on base station simulator unit, using performance testing tool software and above-mentioned test method, pass through load
It realizes the performance test of NM server, obtains the performance data of NM server.Wherein, performance testing tool software can be
After completing coding, realizing that each scene is interacted with NM server, on change parametrization script backing wire pipe IP, URL, performance file
Pass the information such as path and store path.Base station simulator unit is according to type of message, message sending strategy, by respective numbers
Simulation message is sent to NM server and is handled, and according to the disposition of NM server, determines the property of NM server
It can test result.
In one embodiment, true messages packet is the message package that base station is generated based on TR069 agreement.
True messages packet includes any one or any combination in following message: heartbeat message, performance file, alarm disappear
Breath, upgrading message, boot message and registration message.
In one embodiment, base station simulator unit, which executes, is based on test scene model, to NM server to be tested
Before the step of sending the simulation message of respective numbers, also perform the steps of
According to TR069 protocol-decoding true messages packet, simulation message template is obtained.
Base station simulator unit, which executes, is based on test scene model, and the mould of respective numbers is sent to NM server to be tested
When the step of quasi- message, also perform the steps of
Based on test scene model, the quantity forwarded of confirmation simulation message.
According to simulation message template, the simulation message of quantity forwarded is generated;Simulation message includes network element sequence number, base station ginseng
Several and true messages packet acquisition time;Base station parameter includes online user's quantity of base station and the handling capacity of base station.
In one embodiment, base station simulator unit is executed according to simulation message template, generates the simulation of quantity forwarded
After the step of message, also perform the steps of
Based on test scene model, the sending instant of confirmation simulation message;The simulation of quantity forwarded is disappeared in sending instant
Breath is sent to NM server to be tested;Or, it is based on test scene model, the sending time section of confirmation simulation message;It is sending
In period, the simulation message of quantity forwarded is successively sent to NM server to be tested.
In one embodiment, simulation message further includes that message generates time and organization unique identifier.
In one embodiment, base station simulator unit, which executes, is based on test scene model, to NM server to be tested
After the step of sending the simulation message of respective numbers, also perform the steps of
Running state information between obtaining NM server to be tested at runtime in section;Runing time section includes starting point
And terminating point;Starting point is at the time of generating simulation message;Terminating point is at the time of getting the performance test results;Operating status
Information includes handling capacity and clicking rate.
In one embodiment, the performance test results include any one or any combination of following values: the response time,
Cpu busy percentage and disk utilization.
In one embodiment, as shown in fig. 7, Fig. 7 shows for second of NM server test macro in one embodiment
Meaning property structure chart, further includes interchanger;Base station simulator unit includes control machine and the load machine of at least one.
Base station connects NM server to be tested by interchanger.Control machine is separately connected network management to be tested by interchanger
Server, base station and each load machine.Load machine is separately connected NM server to be tested and base station by interchanger.Load machine
It is the equipment for including at least one Virtual NE;Virtual NE is for generating simulation message.
Specifically, interchanger is for the information exchange between each network element.NM server, base station and base station simulator
Load machine and control machine in unit are in communication with each other by interchanger realization.Control machine can be used for running NM server test side
Method;Load machine includes the Virtual NE that at least one is used to generate simulation message.
It should be noted that performability energy testing tool software on control machine, is opened from performance testing tool software
Scenario Design interface can add load machine;Since the Virtual NE quantity that every load machine can simulate is limited by hardware condition,
Therefore, more load machines can be added according to the needs of test scene.Also, the machine of control can also be load machine.
In one embodiment, performance file is one of the type of message that base station and NM server carry out communications,
Base station simulator unit, which uploads performance file, can be used for verifying NM server in a large amount of base station performance text of synchronization processing
Part and the ability for carrying out parsing presentation, the specific steps implemented include:
The performance file message package that base station simulator unit crawl real ones are interacted with Network Management Equipment (belongs to true messages
Packet).Based on true messages packet, according to TR069 protocol encoding and decoding message package, forming properties file template (belongs to simulation message mould
Plate).Performance file template may include the title of performance file, the sequence number of network element, true messages packet the acquisition time started and
Acquisition end time, the base station parameter item and corresponding parameter value for needing to report;The performance file template storage read is arrived
In performance testing tool, it is convenient for subsequent modification performance file template, generates performance file and uploaded.Wherein, in template content
The parameter item in face refers mainly to online user number and handling capacity of base station etc..Performance template content is modified, is produced needed for test
Multiple analog message:, can content and name to the performance file got according to parameter information parameterized in script
Title is modified;Specifically, the modification content of performance file includes start and end time and the performance file of performance file
Title.Wherein, the title of file may include SN (sequence number), OUI (organization unique identifier) and the generation time of network element
Composition.
The test scene model being ready for, the transmission number of confirmation simulation message are read in performance testing tool script
Amount.Meeting point is added in script using function in performance testing tool script, meeting point is set in test scene, sends number
The performance file of amount is all arrived at behind meeting point while being reported, and reaches the requirement of load testing.In addition, different test scenes can be right
Meeting point carries out different settings, such as percentage or quantity mode etc., when the performance file simulation quantity of base station reaches corresponding
When percentage or numerical value, reporting for performance file is carried out.
As shown in figure 8, the upload that Fig. 8 is performance file in NM server test in one embodiment encodes flow chart,
Things starting point and things destination node are added in performance testing tool script, are reached starting point when generating performance file, are started to count
When;Performance file waits NM server to reply after the completion of uploading, and things terminates after base station simulator unit receives reply;Operation
To the affairs destination node when, the runing time of affairs can react in the result at this time, also, scene will record in this time
Handling capacity, clicking rate and response time etc..
Base station simulator unit uploads path according to performance file, sends NM server for performance file in batches;Net
After pipe server is successfully received performance file, return information is then shut off and base station simulator list to base station simulator unit
The connection of member;According to the disposition of NM server, the performance test results of NM server to be tested are determined.
It should be noted that the processing mode of other single piece of information such as alarm, upgrading is similar with performance file upload, according to
The disposition of NM server to be tested, it may be determined that be directed to a certain message, the performance test results of NM server.Practical fortune
In row scene, also there is the case where multiple message exist simultaneously, it can be according to 1 content of table as typical scene, on this basis, gradually
Portfolio is increased, the performance test results of NM server are determined according to the disposition of NM server.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated
Machine program performs the steps of when being executed by processor
Based on test scene model, the simulation message of respective numbers is sent to NM server to be tested;Simulating message is
According to the message of true messages packet generation grabbing, being interacted for base station with NM server to be tested.
Obtain the performance test results;The performance test results are obtained after NM server to be tested processing by simulation message.
In one embodiment, true messages packet is the message package that base station is generated based on TR069 agreement.
True messages packet includes any one or any combination in following message: heartbeat message, performance file, alarm disappear
Breath, upgrading message, boot message and registration message.
In one embodiment, computer program is executed by processor based on test scene model, is taken to network management to be tested
Before the step of simulation message for device transmission respective numbers of being engaged in, also perform the steps of
According to TR069 protocol-decoding true messages packet, simulation message template is obtained.
Computer program is executed by processor based on test scene model, sends respective numbers to NM server to be tested
Simulation message step when, also perform the steps of
Based on test scene model, the quantity forwarded of confirmation simulation message.
According to simulation message template, the simulation message of quantity forwarded is generated;Simulation message includes network element sequence number, base station ginseng
Several and true messages packet acquisition time;Base station parameter includes online user's quantity of base station and the handling capacity of base station.
In one embodiment, computer program is executed by processor according to simulation message template, generates quantity forwarded
After the step of simulating message, also perform the steps of
Based on test scene model, the sending instant of confirmation simulation message;The simulation of quantity forwarded is disappeared in sending instant
Breath is sent to NM server to be tested;Or, it is based on test scene model, the sending time section of confirmation simulation message;It is sending
In period, the simulation message of quantity forwarded is successively sent to NM server to be tested.
In one embodiment, simulation message further includes that message generates time and organization unique identifier.
In one embodiment, computer program is executed by processor based on test scene model, is taken to network management to be tested
After the step of simulation message for device transmission respective numbers of being engaged in, also perform the steps of
Running state information between obtaining NM server to be tested at runtime in section;Runing time section includes starting point
And terminating point;Starting point is at the time of generating simulation message;Terminating point is at the time of getting the performance test results;Operating status
Information includes handling capacity and clicking rate.
In one embodiment, the performance test results include any one or any combination of following values: the response time,
Cpu busy percentage and disk utilization.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer
In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein,
To any reference of memory, storage, database or other media used in each embodiment provided herein,
Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of embodiment described above can be combined arbitrarily, for simplicity of description, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
The limitation to the application range therefore cannot be interpreted as.It should be pointed out that for those of ordinary skill in the art,
Without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection model of the application
It encloses.Therefore, the scope of protection shall be subject to the appended claims by the application.