CN105391601B - A kind of performance test methods and system of Network Management Equipment - Google Patents
A kind of performance test methods and system of Network Management Equipment Download PDFInfo
- Publication number
- CN105391601B CN105391601B CN201510906398.XA CN201510906398A CN105391601B CN 105391601 B CN105391601 B CN 105391601B CN 201510906398 A CN201510906398 A CN 201510906398A CN 105391601 B CN105391601 B CN 105391601B
- Authority
- CN
- China
- Prior art keywords
- equipment
- virtual
- network element
- element device
- test
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/084—Configuration by using pre-existing information, e.g. using templates or copying from other elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
Abstract
The invention discloses a kind of performance test methods of Network Management Equipment and system, which includes mainly the Virtual NE equipment and test equipment of the network element device, multiple configurations of Network Management Equipment, a small amount of necessary being in Network Management Equipment.Wherein, one network element device is correspondingly connected with multiple Virtual NE equipment, and network element device sends test messages to Network Management Equipment by least one Virtual NE equipment, to, management and control of the Network Management Equipment to multiple network element devices is realized, the demand of multigroup test data has been reached；Since network element device is necessary being, which can really reflect that the configuration result and configuration time delay of network element device, true reflection configure existing various problems during time delay.Secondly, the number of Virtual NE equipment can be adjusted according to the configuration of current Network Management Equipment and the change of place test environment in the case where not increasing network element device, reduce the input of equipment to a certain extent, reduce later maintenance cost.
Description
Technical field
The present invention relates to field of communication technology more particularly to the performance test methods and system of a kind of Network Management Equipment.
Background technology
Increasingly huge for network size, scene is increasingly sophisticated, telecommunication management network (Telecom Management
Network, TMN) it provides to the FCAPS of communication apparatus (mistake is configured, accounted, performance and safety) network management.Webmaster is set
The communication equipment (being specially network element device) that standby (espespecially webmastering software) is managed for its, complete alarm-monitor, configuration management,
Performance monitoring, client and safety management etc..Current communication system is not only made of communication equipment, and Network Management Equipment is also communication
The indispensable part of system.So the quality of Network Management Equipment is from the availability for determining communication system to a certain degree, for
The test of Network Management Equipment is also the guarantee of communication system robustness.
Network Management Equipment test includes many aspects, can be divided into functional test, performance test, ease for use from test content
Test etc..Wherein performance test includes benchmark test, load testing, strength test etc., and the performance for evaluating Network Management Equipment needs
Seeking Truth is no up to specification, is the important embodiment of Network Management Equipment robustness.Wherein important specification is the management of equivalent network element
Ability, alarming processing efficiency, performance collecting efficiency etc..
It is at present to use analogue network element for the main stream approach of the performance test of Network Management Equipment, specifically：Use software mould
Intend the performance test that a large amount of network elements, a large amount of alarms etc. carry out Network Management Equipment.Wherein, there are two types of method comparative maturities, and one is make
With the analogue network element of pure software, another kind is the analogue network element based on recording and playback.However, since its operation is detached from really
Network element, so there are the following problems.
1) analogue network element can not support failure and specific failure cause completely.The analogue network element of easy configuration be only capable of return at
Work(message can not really feed back Network Management Equipment to the configuration successful of network element device, the tool of failure and failure according to actual disposition
Body reason.If according to concrete configuration design simulation network element, and the complexity of analogue network element software can be increased.The side of recording and playback
Formula can solve the problems, such as this to a certain degree, but if configuration change, still record again, underaction.
2) analogue network element can not actual response configuration delay.True network element is returned in configuration has certain system processing to prolong
When, network delay, the problem of some need detection can expose in network delay, regardless of be the analogue network element of pure software, also
It is the analogue network element of recording and playback, is to directly read configuration message, return is too fast, can not reappear actual scene and actual field
The scape problem.
3) analogue network element can attract additional maintenance work in system variation.From technical standpoint consider, producer's webmaster with
The interface of network element device is substantially privately owned interface, if simulated using pure software, when interface increase, deletion, change are required for
Software is remodified, the mode of recording and playback is also required to record again, and the maintenance workload in later stage is too big.
4) alarm test is not easy to realize.The analogue network element configuration alarm of pure software is more demanding to tester, needs depth
Enter to understand communication message.And alarm or system alarm of the mode of recording and playback when needing to test non-recording change
When, it needs to record again.All things considered is all not easy to use.
In conclusion how effectively to the performance test of Network Management Equipment, can effectively reappear true network element environment and
The problem of network element device input is current Network Management Equipment performance test urgent need to resolve.
Invention content
The embodiment of the present invention provides a kind of performance test methods and system of Network Management Equipment, to solve to deposit in the prior art
Cause the performance test to Network Management Equipment ineffective due to can not effectively reappear the webmaster environment of true network element device
The problem of.
The embodiment of the present invention uses following technical scheme：
In a first aspect, a kind of Performance Test System of Network Management Equipment is provided, including：Network Management Equipment, M network element device,
Test equipment；Wherein, the Network Management Equipment is configured with N number of Virtual NE equipment, and M and N is positive integer, and N is more than M, institute
The mapping relations stated between network element device and Virtual NE equipment are：One network element device corresponds to multiple Virtual NE equipment；
The network element device, for sending test packet；
The test equipment, the test packet sent for receiving any network element device, and according to network element device and virtually
Mapping relations between network element device determine at least one Virtual NE equipment corresponding with the network element device, and, it is used for
The test packet is sent to determining Virtual NE equipment, the webmaster is set according to the disposition of the Network Management Equipment
It is standby to be tested for the property；
The Network Management Equipment, for receiving the survey that the test equipment is sent by least one Virtual NE equipment
Message is tried, and is handled.
With reference to first aspect, in the first possible implementation, N number of Virtual NE equipment is in the following manner
Configuration：
The test equipment initializes current configuration file；
The test equipment simulates N number of Virtual NE according to the configuration information in configuration file in the Network Management Equipment
Equipment；
Wherein, the configuration information includes at least：Network element device number M, Virtual NE number of devices N and network element device
With the mapping relations between Virtual NE equipment.
The possible realization method of with reference to first aspect the first, in second of possible realization method, the test
Equipment is specifically used for when simulating N number of Virtual NE equipment in the Network Management Equipment according to the configuration information in configuration file：
According to the Virtual NE number of devices N in configuration file, N number of Virtual NE is simulated in the Network Management Equipment and is set
It is standby；
According in configuration file network element device number M and network element device and Virtual NE equipment between mapping close
System, establishes the mapping relations between the M network element device and N number of Virtual NE equipment.
Second of possible realization method with reference to first aspect, in the third possible realization method, the webmaster
N number of Virtual NE equipment in equipment is obtained by replicating the M network element device respectively.
With reference to first aspect, second of possible reality of the possible realization method of the first of first aspect or first aspect
The third possible realization method of existing mode or first aspect, in the 4th kind of possible realization method, the test packet
For the response message of inquiry and/or setting message for the Network Management Equipment, then the test equipment is in any network element of reception
Before the test packet that equipment is sent, it is additionally operable to：
Receive the inquiry and/or message is set that the Network Management Equipment is sent by any Virtual NE equipment；
According to the mapping relations between network element device and Virtual NE equipment, determination is corresponding with the Virtual NE equipment
Network element device；
The inquiry and/or setting message are sent to determining network element device, so that the network element device carries out phase
It should inquire and/or be arranged operation.
The 4th kind of possible realization method with reference to first aspect is additionally operable to supervise in the 5th kind of possible realization method
It surveys and records the message transmissions information between the Virtual NE equipment and the network element device.
Second aspect provides a kind of performance test methods of Network Management Equipment, applied to including at least being configured with N number of void
In the test system of the Network Management Equipment of quasi- network element device, test equipment and M network element device, M and N are positive integer, and N is big
In M, the method includes：
Test equipment receives the test packet that any network element device is sent；
According to the mapping relations between network element device and Virtual NE equipment, determination is corresponding with the network element device at least
One Virtual NE equipment, wherein the mapping relations between the network element device and Virtual NE equipment are：One network element device
Corresponding multiple Virtual NE equipment；
The test packet is sent to determining Virtual NE equipment, so that the Network Management Equipment passes through Virtual NE
Equipment receives the test packet and is handled；
The Network Management Equipment is tested for the property according to the disposition of the Network Management Equipment.
In conjunction with second aspect, in the first possible implementation, N number of Virtual NE equipment is in the following manner
Configuration：
Initialize current configuration file；
According to the configuration information in configuration file, N number of Virtual NE equipment is simulated in the Network Management Equipment；
Wherein, the configuration information includes at least：Network element device number M, Virtual NE number of devices N and network element device
With the mapping relations between Virtual NE equipment.
In conjunction with the first possible realization method of second aspect, in second of possible realization method, according to configuration
Configuration information in file is simulated N number of Virtual NE equipment in the Network Management Equipment, is specifically included：
According to the Virtual NE number of devices N in configuration file, N number of Virtual NE is simulated in the Network Management Equipment and is set
It is standby；
According in configuration file network element device number M and network element device and Virtual NE equipment between mapping close
System, establishes the mapping relations between the M network element device and N number of Virtual NE equipment.
In conjunction with second of possible realization method of second aspect, in the third possible realization method, the webmaster
N number of Virtual NE equipment in equipment is obtained by replicating the M network element device respectively.
In conjunction with the first possible realization method of second aspect, second aspect or second of possible reality of second aspect
The third possible realization method of existing mode or second aspect, in the 4th kind of possible realization method, the test packet
For the response message of inquiry and/or setting message for the Network Management Equipment, then the survey sent in any network element device of reception
Before trying message, the method further includes：
Test equipment receives the inquiry that the Network Management Equipment is sent by any Virtual NE equipment and/or message is arranged；
According to the mapping relations between network element device and Virtual NE equipment, determination is corresponding with the Virtual NE equipment
Network element device；
The inquiry and/or setting message are sent to determining network element device, so that the network element device carries out phase
It should inquire and/or be arranged operation.
In conjunction with the 4th kind of possible realization method of second aspect, in the 5th kind of possible realization method, the method
Further include：
Test equipment monitors and records the message transmissions information between the Virtual NE equipment and the network element device.
Through the above technical solutions, using the network element device and configuration information of a small amount of necessary being, in Network Management Equipment
Simulating multiple and network element device, there are the Virtual NE equipment of mapping relations, to which the test packet that network element device is sent passes through
The corresponding Virtual NE equipment of at least one of Network Management Equipment receives, and is transmitted to Network Management Equipment, to ensure Network Management Equipment
Data in the test packet (i.e. response message) received are the data that the network element device of necessary being returns, and improve reception
Authenticity, the reliability of some row message informations such as the configuration successful, failure, the specific failure cause that arrive.Moreover, because test report
Text is the response message that the network element device of necessary being returns, when therefore, it is possible to really reflect the processing in configuration operating process
Prolong, network delay etc., in turn, there are problems that for time delay and some row for deriving can also really be exposed, so as to timely
Reply is obtained to solve.The most key is, it is contemplated that resistance to compression energy of the performance test of Network Management Equipment primarily directed to Network Management Equipment
Power is tested, and therefore, in the flow of specific reported by network element equipment status information, leads to the network element device of too small amount of necessary being
In any one or more network element devices, to network element device have mapping relations some or all Virtual NE equipment send out
Sending test packet, it is assumed that the status information is warning information, then, a small amount of warning information can pass through multicast or broadcast
Mode, or the mode that replicates, are doubled and redoubled as a large amount of warning information, and be sent respectively to corresponding void by test equipment
Quasi- network element device, in turn, the quantity for the warning information that Network Management Equipment receives will be very big, compared with prior art in pure simulation
For the mode of reported by network elements or recording and playback, the more convenient performance for effectively handling Network Management Equipment warning information is surveyed
Examination.In addition, though present invention utilizes the network element device of necessary being, but the number of the network element device is a small amount of, the survey
Test system can receive, and can also be tested using limited network element device according to actual test environment, therefore, will not
The maintenance cost for influencing whole system, when the interface of Network Management Equipment and network element device changes, it is only necessary to update network element
Equipment, it can be new test system service that test equipment, which only updates configuration information, thus, the network element of the test system is set
Standby less input, and later maintenance cost is relatively low, and practicability is higher.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly introduced, it should be apparent that, drawings in the following description are only some embodiments of the invention, for this
For the those of ordinary skill in field, without having to pay creative labor, it can also be obtained according to these attached drawings
His attached drawing.
Fig. 1 is the system architecture schematic diagram involved by the testing scheme of the embodiment of the present invention；
Fig. 2 illustrates for the correspondence of middle Virtual NE equipment and network element device in the system architecture of the embodiment of the present invention
Figure；
Fig. 3 is the flow diagram that network element device sends test packet by Virtual NE equipment to Network Management Equipment；
Fig. 4 is the system architecture schematic diagram configured with network element agency and Virtual NE agency；
Fig. 5 is the flow diagram of the first test method provided in an embodiment of the present invention.
Specific implementation mode
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with attached drawing to the present invention make into
It is described in detail to one step, it is clear that described embodiments are only a part of the embodiments of the present invention, rather than whole implementation
Example.Based on the embodiments of the present invention, obtained by those of ordinary skill in the art without making creative efforts
All other embodiment, shall fall within the protection scope of the present invention.
In the existing performance test scheme for Network Management Equipment, the processing capacity etc. to message to Network Management Equipment is needed
Performance carries out pressure test, accurately to embody the practical adaptibility to response of the Network Management Equipment.However, in actual test process, it is
The accuracy for improving test, had both needed the higher webmaster environment of authenticity, considered that the occupancy of network element device cannot mistake again
Height, for this purpose, the present invention proposes a kind of performance test scheme being more effectively directed to Network Management Equipment.
In embodiments of the present invention, a kind of performance test methods for Network Management Equipment are provided, wherein in Network Management Equipment
The middle multiple Virtual NE equipment of configuration, wherein multiple Virtual NE equipment is by the network element device to a small amount of necessary being
Formation is replicated, in this way, network element device sends test messages to Network Management Equipment by Virtual NE equipment, to, on the one hand,
Management and control of the Network Management Equipment to multiple network element devices is realized, the demand of multigroup test data has been reached；On the other hand, due to existing
A small amount of true network element device, therefore, which more can truly reflect the configuration result of network element device and match
Set time delay.Moreover, during the test, the survey that Network Management Equipment is sent by any Virtual NE equipment is received using test equipment
Message is tried, and is sent to network element device corresponding with Virtual NE equipment and the operations such as is inquired, is arranged, then, by before
Virtual NE equipment receive network element device return carry inquiry, be arranged result test packet, be transmitted to Network Management Equipment；
And the test packet for carrying network element state information of any reported by network element equipment is received by all Virtual NE equipment, and
It is transmitted to Network Management Equipment.To which not only the effective rendering communication environment of the network element of necessary being, really reflects network element
Inquiry, setting result and configuration status can also avoid blanketing a question for the existing configuration time delay of analogue network element, true to reflect
Configure time delay existing various problems in the process.Moreover, the number of the Virtual NE equipment in the program is really deposited not increasing
Network element device number in the case of, can be carried out according to the configuration of current Network Management Equipment and the change of place test environment
Adjustment, reduces the input of equipment, reduces later maintenance cost to a certain extent.
First, it to introduce the system architecture involved by testing scheme of the present invention shown in Fig. 1, is mainly wrapped in the system architecture
It includes：The network element device 13 of Network Management Equipment 11, test equipment 12 and a small amount of necessary being.Wherein, it is configured in Network Management Equipment 11
Multiple Virtual NE equipment.It is assumed that the network element device 13 in Fig. 1 is M, Virtual NE equipment is N number of, it is preferable that M is much small
In N.Each network element device 13 is connected with several Virtual NE equipment, wherein the virtual net that each network element device 13 connects
The number of element device can be equal, can not also wait；The Network Management Equipment 11 can be the net of one or more network management unit compositions
Tube apparatus carries out management and control operation for multiple network elements under the webmaster environment to being implemented；Test equipment 12 can be it is independent or
The test software being integrated in Network Management Equipment 11 and/or network element device 13, is made of multiple function modules, is mainly used for assisting net
Element device 13 carries out information exchange with Network Management Equipment 11, to realize management and control of the Network Management Equipment 11 to network element device 13, to really
The webmaster environment for reflecting Network Management Equipment 11 is prepared for the performance test of subsequent Network Management Equipment 11.
The allocation plan of Virtual NE equipment according to the present invention is described below.
Under normal circumstances, may include for the allocation plan of Virtual NE equipment：The initialization of Virtual NE equipment and
The configuration of Virtual NE equipment；
The initialization of Virtual NE equipment：
In above-mentioned test system, test equipment initializes currently stored configuration file, then reads configuration file, and
N number of Virtual NE equipment is simulated in Network Management Equipment according to the configuration information in configuration file；Wherein, include net in configuration file
Mapping relations between element device information, Virtual NE facility information and network element device and Virtual NE equipment.Specifically, net
Element device information is that user is arranged according to actual test environment and testing requirement, is included at least：It is currently available, need into
Number, IP address, IP masks, the network element device type of network element device etc. of row test；Virtual NE facility information is user's root
According to the setting of network management performance testing requirement, include at least：Meet the number of the Virtual NE equipment of current testing requirement.It is therein
Mapping relations are：One network element device corresponds to multiple Virtual NE equipment.When specific implementation, the specific correspondence of mapping relations
It can be adjusted flexibly according to user demand.
Preferably, test equipment is simulating N number of Virtual NE according to the configuration information in configuration file in Network Management Equipment
When equipment, it is specifically used for：According to the Virtual NE number of devices N in configuration file, simulated in the Network Management Equipment N number of virtual
Network element device；According in configuration file network element device number M and network element device and Virtual NE equipment between mapping close
System, establishes the mapping relations between the M network element device and N number of Virtual NE equipment.
In addition, the above-mentioned configuration information being related to can be the configuration information that can not be changed, pass through the configuration information every time
It carries out initialization and carries out test preparation, can also be revisable configuration information or history configuration information；If configuration allows,
It can also modify in subsequent test process or to the configuration information in the configuration file during initialization, with symbol
Close the test environment demand.Shown in Fig. 2, for network element device side, the network element device in the test system is only M, and
For Network Management Equipment side, in the test system by the network element device of Network Management Equipment management and control it is practical can be understood as it is N number of virtual
Network element device.Specifically, network element device 1 corresponds to Virtual NE equipment 1-A to Virtual NE equipment 1-X1；Network element device 2 corresponds to
Virtual NE equipment 2-A to Virtual NE equipment 2-X2；And so on, network element device M corresponds to Virtual NE equipment M-A to virtual
Network element device M-XM.A kind of more preferably realization method：N number of Virtual NE equipment in Network Management Equipment is by replicating respectively
What the M network element device obtained.For example, Virtual NE equipment 1-A to Virtual NE equipment 1-X1 is set by replicating network element
What standby 1 simulation obtained, the equipment of the device type of the Virtual NE equipment replicated and the corresponding network element device being replicated
Type is identical, it is thus possible to disposition of the network element device of more efficiently simulation necessary being to message.
The configuration of Virtual NE equipment：
It configures and is formed after multiple Virtual NE equipment in Network Management Equipment, according to the mapping relations in configuration information, with
And the IP address range in Network Management Equipment administrative area, it is configured for the network environment of each Virtual NE equipment, such as：It is right
Each Virtual NE equipment distributes corresponding IP address, IP masks etc..
After the above configuration is completed, when Virtual NE equipment can indicate that unlatching snoop-operations or configuration are completed according to user
It has carved and has opened snoop-operations at once.
As shown in figure 3, the structural schematic diagram of the Performance Test System for Network Management Equipment provided in an embodiment of the present invention, the survey
Test system includes mainly：Network Management Equipment 31, network element device 32, test equipment 33；Wherein, network element device 32, for according to configuration
Test packet is sent at least one void for having mapping relations with itself by the sending strategy in file by test equipment 33
Quasi- network element device 311；Test equipment 33, the test packet for receiving the transmission of any network element device 32, and according to network element device
Mapping relations between 32 and Virtual NE equipment 311 determine at least one Virtual NE equipment corresponding with network element device 32
311, and, for sending test messages to determining Virtual NE equipment 311, according to the disposition pair of Network Management Equipment 31
Network Management Equipment 31 is tested for the property；Network Management Equipment 31 is set for receiving test by least one Virtual NE equipment
Standby 33 test packets sent, and handled.
Preferably, it when implementing test, is set with each network element as shown in figure 4, can be configured in test equipment 33
The standby 32 network element agencies 331 being correspondingly connected with；Meanwhile connect corresponding with each Virtual NE equipment 311 is configured in test equipment 33
The Virtual NE agency 332 connect.Wherein, network element agency 331 and Virtual NE agency 332 open monitoring after configuration is formed
Function is used for the network communication state of monitoring device port.Specifically, net of the network element agency 331 for monitoring network element device 32
Network port, to obtain the message information that network element device 32 is sent to Network Management Equipment 31；Virtual NE agency 332 is virtual for monitoring
The network port of network element device 311.
Belong to same inventive concept with the scheme of above-mentioned test system, an embodiment of the present invention provides a kind of test method,
This method includes mainly：
Receive the test packet that any network element device is sent；It is closed according to the mapping between network element device and Virtual NE equipment
System determines and sends the corresponding at least one Virtual NE equipment of the network element device of test packet, wherein the network element device and
Mapping relations between Virtual NE equipment are：One network element device corresponds to multiple Virtual NE equipment；By the test packet
It is sent to determining Virtual NE equipment, so that the Network Management Equipment receives the test packet simultaneously by Virtual NE equipment
It is handled；The Network Management Equipment is tested for the property according to the disposition of the Network Management Equipment.
Preferably, N number of Virtual NE equipment configures in the following manner：Initialize current configuration file；According to
The configuration information in file is set, N number of Virtual NE equipment is simulated in the Network Management Equipment；Wherein, the configuration information is at least
Including：Mapping relations between network element device number M, Virtual NE number of devices N and network element device and Virtual NE equipment.
Preferably, according to the configuration information in configuration file, N number of Virtual NE equipment is simulated in the Network Management Equipment,
It specifically includes：According to the Virtual NE number of devices M in configuration file, N number of Virtual NE is simulated in the Network Management Equipment and is set
It is standby；According in configuration file network element device number N and network element device and Virtual NE equipment between mapping relations, establish
Mapping relations between N number of network element device and the M Virtual NE equipment.
Preferably, the test packet is the response message of the inquiry and/or setting message for the Network Management Equipment, then
Before receiving the test packet that any network element device is sent, the method further includes：Receive the Network Management Equipment pass through it is any
The inquiry and/or setting message that Virtual NE equipment is sent；According to the mapping relations between network element device and Virtual NE equipment,
Determine network element device corresponding with the Virtual NE equipment；The inquiry and/or setting message are sent to determining network element
Equipment, to indicate that the network element device carries out respective queries and/or setting operates.
Preferably, the method further includes：Test equipment monitors and records the Virtual NE equipment and set with the network element
Message transmissions information between standby.
Test system according to the present invention is described in detail below by specific testing scheme.
As shown in figure 5, for the flow diagram of the first test method provided in an embodiment of the present invention, test method master
Include the following steps：
Step 51：Virtual NE agency monitors Network Management Equipment and is asked by the webmaster that arbitrary Virtual NE device port is sent
Message.
Wherein, which can be that Network Management Equipment is matched for what is inquired respective network elements equipment, be arranged
Set message, or it is used to indicate message of the respective network elements equipment in predetermined time to Network Management Equipment uploaded state information,
In, message information can be warning information, NE type information, alarm cause number, reason description information, device type information,
And alarm level etc..
Step 52：Test equipment determines that the Virtual NE for listening to webmaster request message acts on behalf of 1-A, and by the Virtual NE
The mark for acting on behalf of 1-A marks the webmaster request message.
Specifically, as shown in figure 4, when there is N number of Virtual NE opening of device monitor function, it is assumed that Network Management Equipment is only at this time
Webmaster request message is sent by Virtual NE equipment 1-A, then correspondingly, Virtual NE acts on behalf of 1-A and listens to webmaster request
After message, which is labeled as：Req-1-A.
Step 53：Test equipment is indexed note according to the label to the webmaster request message to the webmaster request message
Record.
It should be noted that the step 53 is optional step, the configuration mainly acted on behalf of according to Virtual NE agency and network element,
And the agreement of definition is selected.Specifically：
If each Virtual NE agency and network element agency are assigned virtual ip address, can be by adding in messages
The mode of source, destination address is added to be sent to webmaster request message and the response message for test of subsequent return correctly
Network element device or Virtual NE equipment.So, which can be omitted.
If each Virtual NE agency and network element agency are only to be assigned virtual ip address, still, protocol definition is only
Can by way of identifying index marker transmitting message, then, which needs to retain.
Step 54：Test equipment determines according to the mapping relations between network element device and Virtual NE equipment and receives the net
The network element device 1 of pipe request message.
In embodiments of the present invention, the mapping relations between network element device and Virtual NE equipment can be a form
Storage in a test device, or stores in a test device in such a way that other can be inquired.
Step 55：Virtual NE acts on behalf of 1-A and webmaster request message is sent to 1 corresponding network element of network element device agency 1, and
Network element device 1 is transmitted to by network element agency 1.
Preferably, can also be according to configuration needs, the equipment and port passed through to the webmaster request message are remembered
Record, in order to which the later stage positions, to the performance of subtest Network Management Equipment.
Step 56：After network element device 1 receives the webmaster request message, the content phase with the webmaster request message is carried out
The configuration of symbol operates, and returns to response message to network element agency 1.
Wherein, response message is denoted as Res-1, test packet as above-mentioned.Specifically, in the step 56, network element is set
Standby 1 is inquired according to the webmaster request message received, operation is arranged, and returns to response message to Network Management Equipment；Either
According to webmaster request message in predetermined time to the message of Network Management Equipment uploaded state information.
If the response message be inquiry, setting as a result, if hold and go to step 57；If the response message is believed for state
Breath, then go to step 58.
Special, after network element device 1 receives webmaster request message, certain handling duration is needed, if however, network element is set
The overlong time either damage of network element device 1 of standby 1 processing can not return to response message in time, then network element agency 1 will be to
Corresponding Virtual NE acts on behalf of 1-A and sends time-out response, to inform the current processing state of Network Management Equipment.
Step 57：Network element agency 1 receives response message, and is closed according to the mapping between network element device and Virtual NE equipment
System determines the Virtual NE equipment 1-A for receiving the response message.
It is main since the response message in the step is inquiry, setting as a result, the response message is test packet above-mentioned
The feedback of the response message for the webmaster request message for being used to issue for Network Management Equipment is tested.In view of the response
Message is targetedly, can only to return to the Virtual NE equipment for sending the webmaster request message, therefore, which can
Rational method of determination, which is selected, according to the presence or absence of above-mentioned steps 53 is sent for before with ensureing determining Virtual NE equipment
The Virtual NE equipment of webmaster request message, and then acted on behalf of by the Virtual NE of the Virtual NE equipment and receive and forward response
Message.
It preferably, in this step, can also be by depositing before in order to ensure the correctness of determining Virtual NE equipment
The index record of storage verifies determining Virtual NE equipment.
Step 58：Network element agency 1 receives response message, and is closed according to the mapping between network element device and Virtual NE equipment
System determines some or all Virtual NE equipment corresponding with network element device.
Response message in the step 58 is the status information of network element device, such as：Warning information, NE type information,
Alarm cause number, reason description information, device type information and alarm level etc..In actual test process, in order to
True webmaster environment is simulated, tests the anti-pressure ability of Network Management Equipment, the status information that network element device 1 can be reported to the greatest extent
It is sent to network element agency 1, then, using the mapping relations between network element device and Virtual NE equipment, determination is set with the network element
Standby 1 has some or all of mapping relations Virtual NE equipment 1-A to Virtual NE equipment 1-X1, then by broadcast or
Response message is sent respectively to the corresponding Virtual NE of determining Virtual NE equipment and acted on behalf of by the mode of multicast.To simulation
Go out the network communication status of multiple reported by network element equipment status informations.
Step 59：Corresponding Virtual NE equipment receives the response message of Virtual NE agency's forwarding, and hands to webmaster
Equipment.
In fact, it in actual test process, is asked for webmaster if Virtual NE agency does not receive in predetermined period
The response message for asking message to return, i.e. test packet, will report overtime response, to inform the Network Management Equipment time-out operations.One
As in the case of, if not receiving response message within the 10S after sending webmaster request message, you can think exist time-out behaviour
Make.
In addition, the embodiment of the present invention additionally provides second of test method, it is similar with the first above-mentioned test method, only
The status information wherein reported is sent automatically according to the configuration information of network element device, and the webmaster for not needing to Network Management Equipment is asked
Ask the triggering of message.Specifically test process similar step 58 and step 59, this will not be repeated here.
However, being directed to second of test method, a kind of concrete implementation mode is：It is followed by being arranged in a test device
Round trip sequence is to realize to reporting all Virtual NE equipment corresponding to the network element device of test packet to report the test report respectively
The purpose of text；Alternatively, the portion that will be sent in the way of the broadcast or multicast in the first scheme corresponding to the network element device
Point or all Virtual NE equipment.The present invention can also include the others side of reporting not to reporting scheme specifically to be limited
Formula.
Through the above technical solutions, using the network element device and configuration information of a small amount of necessary being, in Network Management Equipment
Simulating multiple and network element device, there are the Virtual NE equipment of mapping relations, to which the test packet that network element device is sent passes through
The corresponding Virtual NE equipment of at least one of Network Management Equipment receives, and is transmitted to Network Management Equipment, to ensure Network Management Equipment
Data in the test packet (i.e. response message) received are the data that the network element device of necessary being returns, and improve reception
Authenticity, the reliability of some row message informations such as the configuration successful, failure, the specific failure cause that arrive.Moreover, because test report
Text is the response message that the network element device of necessary being returns, when therefore, it is possible to really reflect the processing in configuration operating process
Prolong, network delay etc., in turn, there are problems that for time delay and some row for deriving can also really be exposed, so as to timely
Reply is obtained to solve.The most key is, it is contemplated that resistance to compression energy of the performance test of Network Management Equipment primarily directed to Network Management Equipment
Power is tested, and therefore, in the flow of specific reported by network element equipment status information, leads to the network element device of too small amount of necessary being
In any one or more network element devices, to network element device have mapping relations some or all Virtual NE equipment send out
Sending test packet, it is assumed that the status information is warning information, then, a small amount of warning information can pass through multicast or broadcast
Mode, or the mode that replicates, are doubled and redoubled as a large amount of warning information, and be sent respectively to corresponding void by test equipment
Quasi- network element device, in turn, the quantity for the warning information that Network Management Equipment receives will be very big, compared with prior art in pure simulation
For the mode of reported by network elements or recording and playback, the more convenient performance for effectively handling Network Management Equipment warning information is surveyed
Examination.In addition, though present invention utilizes the network element device of necessary being, but the number of the network element device is a small amount of, the survey
Test system can receive, and can also be tested using limited network element device according to actual test environment, therefore, will not
The maintenance cost for influencing whole system, when the interface of Network Management Equipment and network element device changes, it is only necessary to update network element
Equipment, it can be new test system service that test equipment, which only updates configuration information, thus, the network element of the test system is set
Standby less input, and later maintenance cost is relatively low, and practicability is higher.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, the present invention can be used in one or more wherein include computer usable program code computer
The computer program production implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
The form of product.
The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that can be realized by computer program instructions every first-class in flowchart and/or the block diagram
The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided
Instruct the processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine so that the instruction executed by computer or the processor of other programmable data processing devices is generated for real
The device for the function of being specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that instruction generation stored in the computer readable memory includes referring to
Enable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device so that count
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, in computer or
The instruction executed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Although preferred embodiments of the present invention have been described, it is created once a person skilled in the art knows basic
Property concept, then additional changes and modifications may be made to these embodiments.So it includes excellent that the following claims are intended to be interpreted as
It selects embodiment and falls into all change and modification of the scope of the invention.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
God and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (12)
1. a kind of Performance Test System of Network Management Equipment, which is characterized in that including：Network Management Equipment, M network element device, test are set
It is standby；Wherein, the Network Management Equipment is configured with N number of Virtual NE equipment, and M and N is positive integer, and N is more than M, the network element
Mapping relations between equipment and Virtual NE equipment are：One network element device corresponds to multiple Virtual NE equipment；
The network element device, for sending test packet；
The test equipment, the test packet sent for receiving any network element device, and according to network element device and Virtual NE
Mapping relations between equipment determine at least one Virtual NE equipment corresponding with the network element device, and, it is used for institute
It states test packet and is sent to determining Virtual NE equipment, according to the Network Management Equipment to the disposition pair of the test packet
The Network Management Equipment is tested for the property；
The Network Management Equipment, for receiving the test report that the test equipment is sent by least one Virtual NE equipment
Text, and handled.
2. the system as claimed in claim 1, which is characterized in that N number of Virtual NE equipment configures in the following manner：
The test equipment initializes current configuration file；
The test equipment simulates N number of Virtual NE equipment according to the configuration information in configuration file in the Network Management Equipment；
Wherein, the configuration information includes at least：Network element device number M, Virtual NE number of devices N and network element device and void
Mapping relations between quasi- network element device.
3. system as claimed in claim 2, which is characterized in that the test equipment is according to the configuration information in configuration file
When simulating N number of Virtual NE equipment in the Network Management Equipment, it is specifically used for：
According to the Virtual NE number of devices N in configuration file, N number of Virtual NE equipment is simulated in the Network Management Equipment；
According in configuration file network element device number M and network element device and Virtual NE equipment between mapping relations, build
Vertical mapping relations between the M network element device and N number of Virtual NE equipment.
4. system as claimed in claim 3, which is characterized in that N number of Virtual NE equipment in the Network Management Equipment is to pass through
Replicate what the M network element device obtained respectively.
5. the system as described in claim 1-4 is any, which is characterized in that the test packet is for the Network Management Equipment
The response message of inquiry and/or setting message, then the test equipment receive test packet that any network element device is sent it
Before, it is additionally operable to：
Receive the inquiry and/or message is set that the Network Management Equipment is sent by any Virtual NE equipment；
According to the mapping relations between network element device and Virtual NE equipment, network element corresponding with the Virtual NE equipment is determined
Equipment；
The inquiry and/or setting message are sent to determining network element device, so that the network element device is accordingly looked into
It askes and/or setting operates.
6. system as claimed in claim 5, which is characterized in that the test equipment is additionally operable to monitor and record described virtual
Message transmissions information between network element device and the network element device.
7. a kind of performance test methods of Network Management Equipment, which is characterized in that applied to including at least being configured with N number of Virtual NE
In the test system of the Network Management Equipment of equipment, test equipment and M network element device, M and N is positive integer, and N is more than M, institute
The method of stating includes：
Test equipment receives the test packet that any network element device is sent；
According to the mapping relations between network element device and Virtual NE equipment, determination is corresponding with the network element device at least one
Virtual NE equipment, wherein the mapping relations between the network element device and Virtual NE equipment are：One network element device corresponds to
Multiple Virtual NE equipment；
The test packet is sent to determining Virtual NE equipment, so that the Network Management Equipment passes through Virtual NE equipment
It receives the test packet and is handled；
The Network Management Equipment is tested for the property according to the disposition of the Network Management Equipment.
8. the method for claim 7, which is characterized in that N number of Virtual NE equipment configures in the following manner：
Initialize current configuration file；
According to the configuration information in configuration file, N number of Virtual NE equipment is simulated in the Network Management Equipment；
Wherein, the configuration information includes at least：Network element device number M, Virtual NE number of devices N and network element device and void
Mapping relations between quasi- network element device.
9. method as claimed in claim 8, which is characterized in that according to the configuration information in configuration file, set in the webmaster
The standby middle N number of Virtual NE equipment of simulation, specifically includes：
According to the Virtual NE number of devices N in configuration file, N number of Virtual NE equipment is simulated in the Network Management Equipment；
According in configuration file network element device number M and network element device and Virtual NE equipment between mapping relations, build
Vertical mapping relations between the M network element device and N number of Virtual NE equipment.
10. method as claimed in claim 9, which is characterized in that N number of Virtual NE equipment in the Network Management Equipment is to pass through
Replicate what the M network element device obtained respectively.
11. the method as described in claim 7-10 is any, which is characterized in that the test packet is for the Network Management Equipment
Inquiry and/or the response message of message is set, then before receiving the test packet that any network element device is sent, the method
Further include：
Test equipment receives the inquiry that the Network Management Equipment is sent by any Virtual NE equipment and/or message is arranged；
According to the mapping relations between network element device and Virtual NE equipment, network element corresponding with the Virtual NE equipment is determined
Equipment；
The inquiry and/or setting message are sent to determining network element device, so that the network element device is accordingly looked into
It askes and/or setting operates.
12. method as claimed in claim 11, which is characterized in that the method further includes：
Test equipment monitors and records the message transmissions information between the Virtual NE equipment and the network element device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510906398.XA CN105391601B (en) | 2015-12-09 | 2015-12-09 | A kind of performance test methods and system of Network Management Equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510906398.XA CN105391601B (en) | 2015-12-09 | 2015-12-09 | A kind of performance test methods and system of Network Management Equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105391601A CN105391601A (en) | 2016-03-09 |
| CN105391601B true CN105391601B (en) | 2018-08-07 |
Family
ID=55423453
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510906398.XA Active CN105391601B (en) | 2015-12-09 | 2015-12-09 | A kind of performance test methods and system of Network Management Equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105391601B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106569950B (en) * | 2016-11-03 | 2019-03-26 | 瑞斯康达科技发展股份有限公司 | A kind of test macro of webmastering software and the test method of webmastering software |
| CN108347356B (en) * | 2017-01-24 | 2020-12-22 | 北京京东尚科信息技术有限公司 | Multi-protocol unit testing method and device, electronic equipment and storage medium |
| CN110875840B (en) * | 2018-09-03 | 2021-10-15 | 中兴通讯股份有限公司 | Network element management method, device, system and storage medium |
| CN112564957B (en) * | 2020-12-01 | 2022-05-17 | 武汉绿色网络信息服务有限责任公司 | Method and device for acquiring running data of virtual network element |
| CN112653578B (en) * | 2020-12-16 | 2022-05-31 | 广州鲁邦通物联网科技股份有限公司 | Data simulation method and system of communication bus |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1805381A (en) * | 2005-01-13 | 2006-07-19 | 中兴通讯股份有限公司 | Multi-network element emulation test system and implementation method |
| CN1901479A (en) * | 2005-07-19 | 2007-01-24 | 中兴通讯股份有限公司 | Analogue method based on custom-made multiple type net element |
| CN103875213A (en) * | 2013-11-26 | 2014-06-18 | 华为技术有限公司 | Network device performance testing method, terminals, management device and system |
| CN104683190A (en) * | 2015-03-26 | 2015-06-03 | 重庆金美通信有限责任公司 | Webmaster managed network simulation system and webmaster managed network simulation method |
| CN104796302A (en) * | 2015-04-17 | 2015-07-22 | 大唐移动通信设备有限公司 | Method and system for testing network element simulators |
-
2015
- 2015-12-09 CN CN201510906398.XA patent/CN105391601B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1805381A (en) * | 2005-01-13 | 2006-07-19 | 中兴通讯股份有限公司 | Multi-network element emulation test system and implementation method |
| CN1901479A (en) * | 2005-07-19 | 2007-01-24 | 中兴通讯股份有限公司 | Analogue method based on custom-made multiple type net element |
| CN103875213A (en) * | 2013-11-26 | 2014-06-18 | 华为技术有限公司 | Network device performance testing method, terminals, management device and system |
| CN104683190A (en) * | 2015-03-26 | 2015-06-03 | 重庆金美通信有限责任公司 | Webmaster managed network simulation system and webmaster managed network simulation method |
| CN104796302A (en) * | 2015-04-17 | 2015-07-22 | 大唐移动通信设备有限公司 | Method and system for testing network element simulators |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105391601A (en) | 2016-03-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105391601B (en) | A kind of performance test methods and system of Network Management Equipment | |
| US20130305091A1 (en) | Drag and drop network topology editor for generating network test configurations | |
| CN110036600A (en) | The convergence service of network health data | |
| CN106789323A (en) | A kind of communication network management method and its device | |
| US20140215077A1 (en) | Methods and systems for detecting, locating and remediating a congested resource or flow in a virtual infrastructure | |
| CN110036599A (en) | The programming interface of network health information | |
| CN108011846A (en) | The method and device of management business in network function virtualization architecture | |
| CN107743076A (en) | A kind of NCSI shares interface switching method and device | |
| CN107094091B (en) | A kind of intelligent substation station level network configuration method of calibration and system | |
| CN103430482A (en) | Network switching device for quantifying available service-level capacity of a network for projected network traffic | |
| US8654654B2 (en) | Traffic distribution control | |
| EP3085030A1 (en) | Offline queries in software defined networks | |
| CN110086640A (en) | The enabled method and apparatus of business | |
| CN106569950A (en) | Network management software testing system and network management software testing method | |
| CN110519122A (en) | A kind of network quality automatic monitoring device and method based on Mtr | |
| CN109510777A (en) | Flow table method of combination, device and SDN controller | |
| CN109981377B (en) | Distributed data center link monitoring method and system | |
| US8966321B2 (en) | Logical port and layer protocol test configuration resource manager | |
| CN113453260B (en) | Method for realizing random selection and guarantee of 5G transmission sub-slices based on dynamic scheduling algorithm | |
| CN111130927A (en) | Method for automatically realizing service test of network layer communication terminal equipment | |
| CN108494625A (en) | A kind of analysis system on network performance evaluation | |
| CN109997337A (en) | Network health information visuallization | |
| CN110166322A (en) | A kind of detection method and relevant apparatus of metering automation terminal | |
| CN111669290B (en) | Network element management method, management server and storage medium | |
| CN111064605B (en) | Visual end-to-end private line automatic opening method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |