CN109348498A - NM server test method, device and system - Google Patents

NM server test method, device and system Download PDF

Info

Publication number
CN109348498A
CN109348498A CN201811279675.9A CN201811279675A CN109348498A CN 109348498 A CN109348498 A CN 109348498A CN 201811279675 A CN201811279675 A CN 201811279675A CN 109348498 A CN109348498 A CN 109348498A
Authority
CN
China
Prior art keywords
server
base station
message
tested
test
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811279675.9A
Other languages
Chinese (zh)
Inventor
陈云俊
邱桥春
李喜源
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Comba Network Systems Co Ltd
Original Assignee
Comba Telecom Technology Guangzhou Ltd
Comba Telecom Systems China Ltd
Comba Telecom Systems Guangzhou Co Ltd
Tianjin Comba Telecom Systems Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Comba Telecom Technology Guangzhou Ltd, Comba Telecom Systems China Ltd, Comba Telecom Systems Guangzhou Co Ltd, Tianjin Comba Telecom Systems Co Ltd filed Critical Comba Telecom Technology Guangzhou Ltd
Priority to CN201811279675.9A priority Critical patent/CN109348498A/en
Publication of CN109348498A publication Critical patent/CN109348498A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/06Testing, supervising or monitoring using simulated traffic

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

This application involves a kind of NM server test method, device and systems.Wherein, NM server test method includes: that base station simulator unit is based on test scene model, and the simulation message of respective numbers is sent to NM server to be tested;Simulation message is that base station simulator unit is generated according to the true messages packet that base station and NM server to be tested interact;Base station simulator unit obtains the performance test results;The performance test results are obtained after NM server to be tested processing by simulation message.Using test scene model and base station simulator unit, the information that batch anolog base station is communicated with NM server can accurately measure the performance of NM server to NM server forming properties pressure, meanwhile, it is capable to reduce the networking difficulty and cost of test;According to performance indicator, the number of devices of NM server energy capacity can be calculated, provides foundation for the selection of client.

Description

NM server test method, device and system
Technical field
This application involves communication test technical fields, more particularly to a kind of NM server test method, device and are System.
Background technique
Universal with mobile Internet and smart phone, the requirement to signal seamless coverage is higher and higher, so that base station The demand of quantity is increasing, and therefore, to the performance of NM server, more stringent requirements are proposed.In actual NM server In operation, due to performance issue, it is commonplace to there is situations such as memory overflows, process extension is dead, response speed is slow and upper offline. With the development of information age, the test of NM server performance is more and more important.
Inventor find traditional technology at least there are the following problems: conventional method in laboratory environments, performance test Environment networking is difficult, and at high cost.
Summary of the invention
Based on this, it is necessary under laboratory environment, NM server performance detection environment it is difficult there are networking and at This high problem provides a kind of NM server test method, device and system.
To achieve the goals above, on the one hand, the embodiment of the present application provides a kind of NM server test method, packet It includes:
Base station simulator unit is based on test scene model, and the simulation for sending respective numbers to NM server to be tested disappears Breath;Simulation message be base station simulator unit according to it is grabbing, interact with NM server to be tested for base station it is true What message package generated.
Base station simulator unit obtains the performance test results;The performance test results are by simulation message through network manager service to be tested It is obtained after device processing.
True messages packet is the message package that base station is generated based on TR069 agreement in one of the embodiments,.True messages Packet includes any one or any combination in following message: heartbeat message, performance file, alarm information, upgrading message, boot Message and registration message.
Base station simulator unit is based on test scene model in one of the embodiments, to NM server to be tested Before the step of sending the simulation message of respective numbers, further comprise the steps of:
Base station simulator unit obtains simulation message template according to TR069 protocol-decoding true messages packet.
Base station simulator unit is based on test scene model, and the simulation for sending respective numbers to NM server to be tested disappears The step of breath includes:
Base station simulator unit is based on test scene model, the quantity forwarded of confirmation simulation message.
Base station simulator unit generates the simulation message of quantity forwarded according to simulation message template;Simulating message includes net The acquisition time of metasequence number, base station parameter and true messages packet;Base station parameter include base station online user's quantity and The handling capacity of base station.
Base station simulator unit generates the simulation of quantity forwarded according to simulation message template in one of the embodiments, After the step of message, further comprise the steps of:
Base station simulator unit is based on test scene model, the sending instant of confirmation simulation message;Base station simulator unit The simulation message of quantity forwarded is sent to NM server to be tested in sending instant.
Or, base station simulator unit is based on test scene model, the sending time section of confirmation simulation message;Base station simulator Unit is successively sent to NM server to be tested in sending time section, by the simulation message of quantity forwarded.
Simulation message further includes that message generates time and organization unique identifier in one of the embodiments,.
Base station simulator unit is based on test scene model in one of the embodiments, to NM server to be tested After the step of sending the simulation message of respective numbers, further comprise the steps of:
Running state information between base station simulator unit obtains NM server to be tested at runtime in section;When operation Between section include starting point and ending point;Starting point is at the time of generating simulation message;Terminating point is to get the performance test results At the time of;Running state information includes handling capacity and clicking rate.
The performance test results include any one or any combination of following values in one of the embodiments: response Time, cpu busy percentage and disk utilization.
On the other hand, the embodiment of the present application also provides a kind of NM server test devices, comprising:
Message transmission module is simulated, for being based on test scene model, sends respective numbers to NM server to be tested Simulation message;True messages packet being grabbed according to simulation message, being interacted for base station with NM server to be tested The message of generation.
Test result obtains module, for obtaining the performance test results;The performance test results are by simulation message through to be tested It is obtained after NM server processing.
A kind of NM server test macro is provided in one of the embodiments, comprising: network manager service to be tested Device, base station, and realize the base station simulator unit such as above-mentioned NM server test method.
Base station simulator unit is separately connected NM server to be tested and base station.NM server linker to be tested It stands.
It in one of the embodiments, further include interchanger;Base station simulator unit include control machine and at least one Load machine.
Base station connects NM server to be tested by interchanger.Control machine is separately connected network management to be tested by interchanger Server, base station and each load machine.Load machine is separately connected NM server to be tested and base station by interchanger.Load machine It is the equipment for including at least one Virtual NE;Virtual NE is for generating simulation message.
A kind of computer storage medium is provided in one of the embodiments, is stored thereon with computer program, the journey Such as above-mentioned NM server test method is realized when sequence is executed by processor.
A technical solution in above-mentioned technical proposal is had the following advantages and beneficial effects:
Base station simulator unit is based on test scene model, and the simulation for sending respective numbers to NM server to be tested disappears Breath;Simulation message is to be generated according to the true messages packet that base station and NM server to be tested interact;Performance is obtained to survey Test result;The performance test results are obtained after NM server to be tested processing by simulation message.Use test scene model with And base station simulator unit, the information that batch anolog base station is communicated with NM server, to NM server forming properties pressure, The performance of NM server can be accurately measured, meanwhile, it is capable to reduce the networking difficulty and cost of test;According to performance indicator, The number of devices of NM server energy capacity can be calculated, provides foundation for the selection of client.
Detailed description of the invention
By being more particularly described for preferred embodiment of the present application shown in the drawings, the above and other mesh of the application , feature and advantage will become more fully apparent.Identical appended drawing reference indicates identical part in all the attached drawings, and does not carve Meaning draws attached drawing by actual size equal proportion scaling, it is preferred that emphasis is shows the purport of the application.
Fig. 1 is the first schematic flow chart of NM server test method in one embodiment;
Fig. 2 is the second schematic flow chart of NM server test method in one embodiment;
Fig. 3 is the third schematic flow chart of NM server test method in one embodiment;
Fig. 4 is the 4th schematic flow chart of NM server test method in one embodiment;
Fig. 5 is the structural schematic diagram of NM server test device in one embodiment;
Fig. 6 is the first schematic diagram of NM server test macro in one embodiment;
Fig. 7 is the second schematic diagram of NM server test macro in one embodiment;
Fig. 8 is that the upload of performance file in NM server test in one embodiment encodes flow chart.
Specific embodiment
The application in order to facilitate understanding is described more fully the application below with reference to relevant drawings.In attached drawing Give the preferred embodiment of the application.But the application can realize in many different forms, however it is not limited to this paper institute The embodiment of description.On the contrary, purpose of providing these embodiments is make it is more thorough and comprehensive to disclosure of this application.
It should be noted that it can be directly to separately when an element is considered as " connection " another element One element and it is in combination be integrated, or may be simultaneously present centering elements.
Unless otherwise defined, all technical and scientific terms used herein and the technical field for belonging to the application The normally understood meaning of technical staff is identical.The term used in the description of the present application is intended merely to description tool herein The purpose of the embodiment of body, it is not intended that in limitation the application.Term " and or " used herein includes one or more phases Any and all combinations of the listed item of pass.
In traditional NM server performance test methods, communication system mainly is built in laboratory and is tested. But it is difficult to build the system that thousands of base stations are communicated with equipment under test network management under laboratory environment;Large-scale equipment System to build cost big, and system function is complicated.
For this purpose, present applicant proposes the modes that anolog base station information is communicated with NM server, using performance testing tool According to Test Strategy, each behavior of simulation of bulk base station equipment simultaneously carries out single or multiple concurrent industry to NM server Business, obtains the test result of NM server performance according to the disposition of NM server.Wherein, base station can provide for user The covering in a region is completed in voice, data service, batch base station.NM server can obtain base-station voice under the region, Data service traffic conditions, moreover it is possible to which the fault condition for getting the origin base station upgrades, again the website under monitoring area It opens and Breakdown Maintenance etc..Base station simulator unit can be load machine, can be used for the letter that anolog base station is interacted with NM server Breath;By a large number of services of load machine, the performance data that NM server can be supported can be obtained;Specifically, base station, base station simulation Interchanger can be used between device unit, NM server to be connected with each other.
Window of the NM server as each equipment can accurately learn the real-time status of equipment;Connect NM server Number of devices it is more, it is all the more stringent to the performance requirement of NM server.The embodiment of the present application can measure network management clothes in advance Business device performance the equipment amount that NM server can accommodate can be calculated according to performance indicator, for client selection provide according to According to.
In typical NM server performance test, related simulation message may include heartbeat message, performance file, announcement Alert message, upgrading message, boot message and registration message etc..Each simulation behavior can the single multiple mode per second of business It is sent, can also be sent with the multiple mode per second of composite service, table 1 is NM server in one embodiment existing Actual performance index in net.
Actual performance index of the NM server in existing net in 1. one embodiment of table
In one embodiment, a kind of NM server test method is provided, as shown in FIG. 1, FIG. 1 is one embodiment First schematic flow chart of middle NM server test method, comprising:
Step S110, base station simulator unit are based on test scene model, send respective counts to NM server to be tested The simulation message of amount;Simulate message be base station simulator unit according to it is grabbing, for base station and NM server to be tested What interactive true messages packet generated.
Step S120, base station simulator unit obtain the performance test results;The performance test results are by simulation message through to be measured It is obtained after examination NM server processing.
Specifically, base station simulator unit generates phase according to the true messages packet and test scene model grabbed The simulation message of quantity is answered, and according to the sending strategy of test scene model, simulation message is sent to network manager service to be tested Device;The performance test results obtained when obtaining NM server processing simulation message.
It should be noted that base station simulator unit can be used for grabbing true messages packet, the quantity that Virtual NE is arranged, fortune Row performance testing tool software generates simulation message, simulation message is sent to NM server and obtains NM server The performance test results.Specifically, base station simulator unit may include for grab truthful data packet, runnability testing tool with And the controller of simulation message is sent, and the load device for generating simulation message.It should be noted that controller and processing Device can belong to different servers, can also belong to a server.
True messages packet is base station and the message package that NM server interacts, and is generated by base station side and can reflect base station Running truthful data situation.In the test process of the embodiment of the present application, at least one true messages packet can be obtained and generated Corresponding simulation message, realizes the diversification of simulation message, so that test is more comprehensive.Specifically, base station simulator unit can It acquires a true messages packet and generates a plurality of simulation message, can also acquire multiple true messages packets, and really disappear based on each Breath packet generates corresponding simulation message
It simulates message to generate based on true messages packet, type of message can be corresponding with the type of true messages packet, is used for base The message that simulator unit of standing anolog base station is interacted with NM server.Specifically, simulation message can realize base station simulator list Member and heartbeat message, performance file, alarm information, upgrading message, boot message and the registration message of NM server etc. Interaction.
In the application environment of NM server, the type of message that each base station is interacted with NM server is in the same time Point is not quite similar, and the performance pressures of network management are also different in different time points.For this purpose, the test scene model in the application includes Send the parameters such as the quantity of the type of simulation message, the strategy for sending simulation message and transmission simulation message.
Specifically, test scene model may include the type for the simulation message that test is related to, the hair of all types of simulation message Send the sending time etc. of quantity and all types of simulation message.For example, can be according to the curriculum offering concurrent user number and pressure of table 1 Power model, and give more sustained attention the performance change of NM server.It treats test NM server and carries out several scenes test, foundation The performance test results of NM server can be obtained in the disposition of NM server.According to test scene model, base station simulation Device unit can be tested in the simulation message that synchronization sends batch to NM server to be tested, can also be in setting time Simulation message NM server to be tested is sent in batches in section to test.
Based on true messages packet and test scene model, the behavior of base station simulator unit analog real ones, It is comprehensive to simulate message.The mode accessed using limited real ones equipment, the application are only capable of in relative experimental room test environment The perfect method of NM server performance test of embodiment, improves the accuracy to NM server performance test.
In order to which the performance test of NM server is more abundant, to the transmission of simulation message can there are many test scene, One of be each message independent Batch sending;Two to be sent out after obtaining several message efficient combinations according to orthogonal test in batches It send;Three for message on the basis of pressure model or be greater than pressure model combination after Batch sending;Four at the appointed time Batch sending is carried out to single message or combined message;Network management performance test result is obtained according to network management disposition.
Traditional technology is tested using a large amount of real ones, and the networking for testing environment is difficult and expensive, this The method that the test method of application uses base station simulator unit anolog base station message, can be obtained the performance test of NM server As a result, greatly reducing testing cost.
The embodiment of the present application uses test scene model and base station simulator unit, batch anolog base station and network manager service The information of device communication can accurately measure the performance of NM server to NM server forming properties pressure, meanwhile, it is capable to Reduce the networking difficulty and cost of test;According to performance indicator, the number of devices of NM server energy capacity can be calculated, for visitor The selection at family provides foundation.
In one embodiment, true messages packet is the message package that base station is generated based on TR069 agreement.
True messages packet includes any one or any combination in following message: heartbeat message, performance file, alarm disappear Breath, upgrading message, boot message and registration message.
Specifically, base station equipment is communicated with NM server using TR069 agreement, can be given birth to according to TR069 agreement At the true messages packet interacted with NM server;Simulation message may be based on what true messages packet and TR069 agreement generated Message.True messages packet includes in heartbeat message, performance file, alarm information, upgrading message, boot message and registration message At least one.The true messages packet that base station simulator unit crawl real ones are interacted with NM server, passage capacity are surveyed Trial work tool Software Coding can realize that each simulation message is communicated with NM server;Accordingly, simulation message may include that heartbeat disappears Breath, performance file, alarm information, upgrading message, boot message and registration message etc..
It should be noted that base station communicate with NM server the agreement existing defects of use in traditional technology.With For snmp protocol (Simple Network Management Protocol, Simple Network Management Protocol), SNMP is UDP association Discuss (User Datagram Protocol, User Datagram Protocol), be by the direct transmitting order to lower levels of NM server to equipment, In, transmitting order to lower levels only has set and get to act, other then need to control by device parameter;When network quality is bad, use Snmp protocol is easy to produce packet loss;NM server issues parameter to equipment, and when equipment is not replied, NM server is not known Whether equipment receives parameter;The content interacted using snmp protocol is simple, can only depend on MIB (Management Information Base, management information bank) node operated.
The TR069 agreement that the embodiment of the present application uses is that (Transmission Control Protocol is passed Transmission Control Protocol Transport control protocol view), it is possible to provide reliable transmission, situations such as avoiding the occurrence of mistake, repeat or lose.The connection mould that TR069 is supported Type has high flexibility ratio, and NM server and base station equipment can all initiate the connection request, and base station equipment IP variation not will lead to Maintenance failure;Meanwhile TR069 defines list and the property parameters of many kinds of parameters, powerful, the net based on TR069 agreement The ease for use of equipment can be improved in guard system.The order that NM server issues may include set, get, download, reboot Deng movement, and connection can be closed by NM server.Base station equipment is communicated with NM server using TR069 agreement, Base station simulator unit passes through the communication information of batch anolog base station and NM server, and the performance of NM server can be obtained, Theoretical foundation is provided for the practical application of NM server.
In one embodiment, as shown in Fig. 2, Fig. 2 shows for second of NM server test method in one embodiment Meaning property flow chart, base station simulator unit are based on test scene model, and the mould of respective numbers is sent to NM server to be tested Before the step of quasi- message, further comprise the steps of:
Step S108, base station simulator unit obtain simulation message template according to TR069 protocol-decoding true messages packet.
Base station simulator unit is based on test scene model, and the simulation for sending respective numbers to NM server to be tested disappears The step of breath includes:
Step S112, base station simulator unit are based on test scene model, the quantity forwarded of confirmation simulation message.
Step S114, base station simulator unit generate the simulation message of quantity forwarded according to simulation message template;Simulation disappears Breath includes the acquisition time of network element sequence number, base station parameter and true messages packet;Base station parameter includes the online user of base station Quantity and the handling capacity of base station.
Specifically, base station simulator unit grabs true messages packet, true messages packet is solved according to TR069 agreement Code forms simulation message template.Quantity based on the simulation message that test scene model, confirmation need to send, and according to simulation Message template generates the simulation message of corresponding quantity forwarded.Wherein, simulation message template may include file name, network element sequence Number, base station parameter and the acquisition time of truthful data packet etc..
It should be noted that simulation message template is generated according to true messages packet, the type of message comprising true messages packet, Acquire time started and the acquisition information such as end time and base station parameter.Base station parameter includes online user's quantity of base station With the handling capacity of base station.
It simulates message to be generated according to simulation message template, gives the mistake of NM server to be tested in Batch sending simulation message Cheng Zhong, each message of simulating can be generated by each Virtual NE in base station simulator unit is corresponding;Based on network element sequence number or really The acquisition time of message package can distinguish different simulation message, realize that NM server to be tested simulates the place of message to batch Reason.Specifically, when the corresponding acquisition time of each simulation message is the same, area can be carried out to simulation message by network element sequence number Point;When the corresponding network element sequence number of each simulation message is identical, simulation message can be distinguished by acquisition time.
Different test scene models can correspond to different simulation message quantity forwardeds can be true according to test scene demand Recognize and generate the simulation message of corresponding quantity forwarded.
In one embodiment, as shown in figure 3, the third that Fig. 3 is NM server test method in one embodiment is shown Meaning property flow chart, base station simulator unit is according to simulation message template, after the step of generating the simulation message of quantity forwarded, also Comprising steps of
Step S116, base station simulator unit are based on test scene model, the sending instant of confirmation simulation message;Base station mould The simulation message of quantity forwarded is sent to NM server to be tested in sending instant by quasi- device unit.
Or, step S118, base station simulator unit is based on test scene model, the sending time section of confirmation simulation message; Base station simulator unit is successively sent to NM server to be tested in sending time section, by the simulation message of quantity forwarded.
Specifically, test scene model can include at least two kinds of simulation message sending strategys, it can be used for corresponding to network management clothes The case where business device faces.Specifically, it may include: base station simulator unit is same by the simulation message of quantity forwarded in sending instant When be sent to NM server to be tested, performance when test NM server handles bulk messages;Base station simulator Simulation message can be also sent to NM server to be tested in batches, test NM server by unit in sending time section Performance when handling in stipulated time section multiple bulk messages.
It should be noted that the sending strategy of test scene model may also include that the independence of single simulation message, batch are sent out It send;Different types of simulation message carries out Batch sending after efficient combination;Message is simulated on the basis of pressure model or greater than pressure Power model is combined rear Batch sending;Batch hair is carried out to the simulation message or combined message of single type at the appointed time It send.
In one embodiment, simulation message further includes that message generates time and organization unique identifier.
Specifically, the message of simulation message generates the time and organization unique identifier is used equally for network management to be tested to take Business device distinguishes each simulation message.
It should be noted that generating time, network element sequence number and tissue unique identification may be disposed at the text of simulation message In part title, distinguished convenient for NM server.
In one embodiment, as shown in figure 4, Fig. 4 shows for the 4th of NM server test method in one embodiment Meaning property flow chart, base station simulator unit are based on test scene model, and the mould of respective numbers is sent to NM server to be tested After the step of quasi- message, further comprise the steps of:
Step S130, the operating status letter between base station simulator unit obtains NM server to be tested at runtime in section Breath;Runing time section includes starting point and ending point;Starting point is at the time of generating simulation message;Terminating point is to get performance At the time of test result;Running state information includes handling capacity and clicking rate.
Specifically, in the test process of the embodiment of the present application, the starting point and destination node of settable test;Specifically, Arrival starting point is reported when generating simulation message, starts timing;Simulating after the completion of message uploads waits network management NM server to return Multiple, base station simulator unit receives reply, obtains reaching terminating point when the performance test results.It is between starting point and terminating point The runing time of NM server to be tested in the test;When completing test, runing time can react in the result, also, Scene will record the numerical value such as handling capacity, clicking rate and response time of NM server to be tested in this time.
In one embodiment, the performance test results include any one or any combination of following values: the response time, Cpu busy percentage and disk utilization.
Specifically, the performance test results may include at least one in response time, cpu busy percentage and disk utilization Kind.After base station simulator unit sends simulation message to NM server to be tested based on test scene model, network management can be obtained The resource utilization of server, such as cpu busy percentage, the disk utilization of NM server;The transaction response time can also be obtained (trans response time), i.e., make a response the required time to request: the response time is slack-off, illustrates network manager service The decline of device performance;TPS (Transaction Per Second), i.e., the transaction or thing that master slave system per second is capable of handling can also be obtained The quantity of business.
The embodiment of the present application realizes heartbeat, performance file, the alarm, liter of base station simulator unit and NM server The interaction of the message such as grade, boot, registration, analog carries out several scenes test, and the disposition according to NM server obtains To the performance test results of NM server.Base is simulated using the true messages packet that base station simulator unit and base station generate The behavior stood is realized simulation message generalization and the perfect performance test process of NM server, is improved to net The accuracy of pipe server performance test.Meanwhile solving using real ones and carrying out test bring environment networking difficulty, Expensive problem, substantially reduces testing cost.
It should be understood that although each step in the flow chart of Fig. 1-4 is successively shown according to the instruction of arrow, These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps Execution there is no stringent sequences to limit, these steps can execute in other order.Moreover, at least one in Fig. 1-4 Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps Completion is executed, but can be executed at different times, the execution sequence in these sub-steps or stage is also not necessarily successively It carries out, but can be at least part of the sub-step or stage of other steps or other steps in turn or alternately It executes.
In one embodiment, a kind of NM server test device is provided, as shown in figure 5, Fig. 5 is one embodiment The structural schematic diagram of middle NM server test device, comprising:
Message transmission module 110 is simulated, for being based on test scene model, sends respective counts to NM server to be tested The simulation message of amount;True messages being grabbed according to simulation message, being interacted for base station with NM server to be tested Wrap the message generated.
Test result obtains module 120, for obtaining the performance test results;The performance test results are by simulation message through to be measured It is obtained after examination NM server processing.
In one embodiment, true messages packet is the message package that base station is generated based on TR069 agreement.
True messages packet includes any one or any combination in following message: heartbeat message, performance file, alarm disappear Breath, upgrading message, boot message and registration message.
In one embodiment, further includes: message package decoder module is used for according to TR069 protocol-decoding true messages packet, Obtain simulation message template.
Simulating message transmission module includes:
Quantity forwarded confirmation unit, for being based on test scene model, the quantity forwarded of confirmation simulation message.
Message generation unit is simulated, for generating the simulation message of quantity forwarded according to simulation message template;Simulate message Acquisition time including network element sequence number, base station parameter and true messages packet;Base station parameter includes the online user number of base station Amount and the handling capacity of base station.
In one embodiment, message transmission module is simulated further include:
Message sending unit, for being based on test scene model, the sending instant of confirmation simulation message;It is incited somebody to action in sending instant The simulation message of quantity forwarded is sent to NM server to be tested;Or, it is based on test scene model, the hair of confirmation simulation message Send the period;In sending time section, the simulation message of quantity forwarded is successively sent to NM server to be tested.
In one embodiment, simulation message further includes that message generates time and organization unique identifier.
In one embodiment, further includes:
Operating status obtains module, for the operating status letter in section between obtaining NM server to be tested at runtime Breath;Runing time section includes starting point and ending point;Starting point is at the time of generating simulation message;Terminating point is to get performance At the time of test result;Running state information includes handling capacity and clicking rate.
In one embodiment, the performance test results include any one or any combination of following values: the response time, Cpu busy percentage and disk utilization.
Specific restriction about NM server test device may refer to above for NM server test method Restriction, details are not described herein.Modules in above-mentioned NM server test device can be fully or partially through software, hard Part and combinations thereof is realized.Above-mentioned each module can be embedded in the form of hardware or independently of in the processor in computer equipment, It can also be stored in a software form in the memory in computer equipment, execute the above modules in order to which processor calls Corresponding operation.
In one embodiment, as shown in fig. 6, Fig. 6 shows for first of NM server test macro in one embodiment Meaning property structure chart, provides a kind of NM server test macro, comprising: NM server 300 to be tested, base station 400, and Realize the base station simulator unit 200 such as above-mentioned NM server test method;Base station simulator unit 200 be separately connected to Test NM server 300 and base station 400;NM server 300 to be tested connects base station 400.
Base station simulator unit 200 can realize following steps:
Based on test scene model, the simulation message of respective numbers is sent to NM server 300 to be tested;Simulate message According to grab, message that the true messages packet that is interacted with NM server 300 to be tested for base station 400 generates.
Obtain the performance test results;The performance test results are obtained after NM server 300 to be tested processing by simulation message It arrives.
Specifically, the Test Networking framework of NM server performance may include NM server to be tested, base station simulation Device unit and base station etc..Wherein, NM server to be tested is for receiving and processing base station simulator unit system simulation message The true messages sent with base station;Base station simulator unit is for generating and sending analog information to NM server to be tested; Base station is used to send and handle the message that NM server to be tested is sent.
It should be noted that deployment base station simulator unit and real ones equipment, are connected by establishing with NM server It connects, base station simulator unit and real ones are to NM server forming properties pressure.Base station simulator unit has disposed performance Testing tool software, also, software includes registration, heartbeat, performance file, the alarm, liter for grabbing base station equipment and interacting with network management Grade, boot and the script file of registration.Meanwhile the corresponding parameter information of base station simulator unit has been arranged completely;Network management The service of server is opened;Base station equipment is registered in NM server;Each Virtual NE is equal in base station simulator unit It is registered in NM server.
Based on base station simulator unit, using performance testing tool software and above-mentioned test method, pass through load It realizes the performance test of NM server, obtains the performance data of NM server.Wherein, performance testing tool software can be After completing coding, realizing that each scene is interacted with NM server, on change parametrization script backing wire pipe IP, URL, performance file Pass the information such as path and store path.Base station simulator unit is according to type of message, message sending strategy, by respective numbers Simulation message is sent to NM server and is handled, and according to the disposition of NM server, determines the property of NM server It can test result.
In one embodiment, true messages packet is the message package that base station is generated based on TR069 agreement.
True messages packet includes any one or any combination in following message: heartbeat message, performance file, alarm disappear Breath, upgrading message, boot message and registration message.
In one embodiment, base station simulator unit, which executes, is based on test scene model, to NM server to be tested Before the step of sending the simulation message of respective numbers, also perform the steps of
According to TR069 protocol-decoding true messages packet, simulation message template is obtained.
Base station simulator unit, which executes, is based on test scene model, and the mould of respective numbers is sent to NM server to be tested When the step of quasi- message, also perform the steps of
Based on test scene model, the quantity forwarded of confirmation simulation message.
According to simulation message template, the simulation message of quantity forwarded is generated;Simulation message includes network element sequence number, base station ginseng Several and true messages packet acquisition time;Base station parameter includes online user's quantity of base station and the handling capacity of base station.
In one embodiment, base station simulator unit is executed according to simulation message template, generates the simulation of quantity forwarded After the step of message, also perform the steps of
Based on test scene model, the sending instant of confirmation simulation message;The simulation of quantity forwarded is disappeared in sending instant Breath is sent to NM server to be tested;Or, it is based on test scene model, the sending time section of confirmation simulation message;It is sending In period, the simulation message of quantity forwarded is successively sent to NM server to be tested.
In one embodiment, simulation message further includes that message generates time and organization unique identifier.
In one embodiment, base station simulator unit, which executes, is based on test scene model, to NM server to be tested After the step of sending the simulation message of respective numbers, also perform the steps of
Running state information between obtaining NM server to be tested at runtime in section;Runing time section includes starting point And terminating point;Starting point is at the time of generating simulation message;Terminating point is at the time of getting the performance test results;Operating status Information includes handling capacity and clicking rate.
In one embodiment, the performance test results include any one or any combination of following values: the response time, Cpu busy percentage and disk utilization.
In one embodiment, as shown in fig. 7, Fig. 7 shows for second of NM server test macro in one embodiment Meaning property structure chart, further includes interchanger;Base station simulator unit includes control machine and the load machine of at least one.
Base station connects NM server to be tested by interchanger.Control machine is separately connected network management to be tested by interchanger Server, base station and each load machine.Load machine is separately connected NM server to be tested and base station by interchanger.Load machine It is the equipment for including at least one Virtual NE;Virtual NE is for generating simulation message.
Specifically, interchanger is for the information exchange between each network element.NM server, base station and base station simulator Load machine and control machine in unit are in communication with each other by interchanger realization.Control machine can be used for running NM server test side Method;Load machine includes the Virtual NE that at least one is used to generate simulation message.
It should be noted that performability energy testing tool software on control machine, is opened from performance testing tool software Scenario Design interface can add load machine;Since the Virtual NE quantity that every load machine can simulate is limited by hardware condition, Therefore, more load machines can be added according to the needs of test scene.Also, the machine of control can also be load machine.
In one embodiment, performance file is one of the type of message that base station and NM server carry out communications, Base station simulator unit, which uploads performance file, can be used for verifying NM server in a large amount of base station performance text of synchronization processing Part and the ability for carrying out parsing presentation, the specific steps implemented include:
The performance file message package that base station simulator unit crawl real ones are interacted with Network Management Equipment (belongs to true messages Packet).Based on true messages packet, according to TR069 protocol encoding and decoding message package, forming properties file template (belongs to simulation message mould Plate).Performance file template may include the title of performance file, the sequence number of network element, true messages packet the acquisition time started and Acquisition end time, the base station parameter item and corresponding parameter value for needing to report;The performance file template storage read is arrived In performance testing tool, it is convenient for subsequent modification performance file template, generates performance file and uploaded.Wherein, in template content The parameter item in face refers mainly to online user number and handling capacity of base station etc..Performance template content is modified, is produced needed for test Multiple analog message:, can content and name to the performance file got according to parameter information parameterized in script Title is modified;Specifically, the modification content of performance file includes start and end time and the performance file of performance file Title.Wherein, the title of file may include SN (sequence number), OUI (organization unique identifier) and the generation time of network element Composition.
The test scene model being ready for, the transmission number of confirmation simulation message are read in performance testing tool script Amount.Meeting point is added in script using function in performance testing tool script, meeting point is set in test scene, sends number The performance file of amount is all arrived at behind meeting point while being reported, and reaches the requirement of load testing.In addition, different test scenes can be right Meeting point carries out different settings, such as percentage or quantity mode etc., when the performance file simulation quantity of base station reaches corresponding When percentage or numerical value, reporting for performance file is carried out.
As shown in figure 8, the upload that Fig. 8 is performance file in NM server test in one embodiment encodes flow chart, Things starting point and things destination node are added in performance testing tool script, are reached starting point when generating performance file, are started to count When;Performance file waits NM server to reply after the completion of uploading, and things terminates after base station simulator unit receives reply;Operation To the affairs destination node when, the runing time of affairs can react in the result at this time, also, scene will record in this time Handling capacity, clicking rate and response time etc..
Base station simulator unit uploads path according to performance file, sends NM server for performance file in batches;Net After pipe server is successfully received performance file, return information is then shut off and base station simulator list to base station simulator unit The connection of member;According to the disposition of NM server, the performance test results of NM server to be tested are determined.
It should be noted that the processing mode of other single piece of information such as alarm, upgrading is similar with performance file upload, according to The disposition of NM server to be tested, it may be determined that be directed to a certain message, the performance test results of NM server.Practical fortune In row scene, also there is the case where multiple message exist simultaneously, it can be according to 1 content of table as typical scene, on this basis, gradually Portfolio is increased, the performance test results of NM server are determined according to the disposition of NM server.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated Machine program performs the steps of when being executed by processor
Based on test scene model, the simulation message of respective numbers is sent to NM server to be tested;Simulating message is According to the message of true messages packet generation grabbing, being interacted for base station with NM server to be tested.
Obtain the performance test results;The performance test results are obtained after NM server to be tested processing by simulation message.
In one embodiment, true messages packet is the message package that base station is generated based on TR069 agreement.
True messages packet includes any one or any combination in following message: heartbeat message, performance file, alarm disappear Breath, upgrading message, boot message and registration message.
In one embodiment, computer program is executed by processor based on test scene model, is taken to network management to be tested Before the step of simulation message for device transmission respective numbers of being engaged in, also perform the steps of
According to TR069 protocol-decoding true messages packet, simulation message template is obtained.
Computer program is executed by processor based on test scene model, sends respective numbers to NM server to be tested Simulation message step when, also perform the steps of
Based on test scene model, the quantity forwarded of confirmation simulation message.
According to simulation message template, the simulation message of quantity forwarded is generated;Simulation message includes network element sequence number, base station ginseng Several and true messages packet acquisition time;Base station parameter includes online user's quantity of base station and the handling capacity of base station.
In one embodiment, computer program is executed by processor according to simulation message template, generates quantity forwarded After the step of simulating message, also perform the steps of
Based on test scene model, the sending instant of confirmation simulation message;The simulation of quantity forwarded is disappeared in sending instant Breath is sent to NM server to be tested;Or, it is based on test scene model, the sending time section of confirmation simulation message;It is sending In period, the simulation message of quantity forwarded is successively sent to NM server to be tested.
In one embodiment, simulation message further includes that message generates time and organization unique identifier.
In one embodiment, computer program is executed by processor based on test scene model, is taken to network management to be tested After the step of simulation message for device transmission respective numbers of being engaged in, also perform the steps of
Running state information between obtaining NM server to be tested at runtime in section;Runing time section includes starting point And terminating point;Starting point is at the time of generating simulation message;Terminating point is at the time of getting the performance test results;Operating status Information includes handling capacity and clicking rate.
In one embodiment, the performance test results include any one or any combination of following values: the response time, Cpu busy percentage and disk utilization.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, To any reference of memory, storage, database or other media used in each embodiment provided herein, Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms, Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of embodiment described above can be combined arbitrarily, for simplicity of description, not to above-mentioned reality It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited In contradiction, all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously The limitation to the application range therefore cannot be interpreted as.It should be pointed out that for those of ordinary skill in the art, Without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection model of the application It encloses.Therefore, the scope of protection shall be subject to the appended claims by the application.

Claims (11)

1. a kind of NM server test method characterized by comprising
Base station simulator unit is based on test scene model, and the simulation message of respective numbers is sent to NM server to be tested; The simulation message be the base station simulator unit according to it is grabbing, for base station and the NM server to be tested friendship What mutual true messages packet generated;
The base station simulator unit obtains the performance test results;The performance test results by the simulation message through it is described to It is obtained after test network management server process.
2. NM server test method according to claim 1, which is characterized in that the true messages packet is the base Stand based on TR069 agreement generate message package;
The true messages packet includes any one or any combination in following message: heartbeat message, performance file, alarm disappear Breath, upgrading message, boot message and registration message.
3. NM server test method according to claim 2, which is characterized in that base station simulator unit is based on test Model of place, to NM server to be tested send respective numbers simulation message the step of before, further comprise the steps of:
Base station simulator unit true messages packet according to the TR069 protocol-decoding obtains simulation message template;
Base station simulator unit is based on test scene model, sends the simulation message of respective numbers to NM server to be tested Step includes:
The base station simulator unit is based on the test scene model, confirms the quantity forwarded of the simulation message;
The base station simulator unit generates the simulation message of the quantity forwarded according to the simulation message template;The mould Quasi- message includes the acquisition time of network element sequence number, base station parameter and the true messages packet;The base station parameter includes institute State online user's quantity of base station and the handling capacity of the base station.
4. NM server test method according to claim 3, which is characterized in that the base station simulator unit according to The simulation message template further comprises the steps of: after the step of generating the simulation message of the quantity forwarded
The base station simulator unit is based on the test scene model, confirms the sending instant of the simulation message;The base The simulation message of the quantity forwarded is sent to the NM server to be tested in the sending instant by simulator unit of standing; Or,
The base station simulator unit is based on the test scene model, confirms the sending time section of the simulation message;It is described The simulation message of the quantity forwarded is successively sent to described to be tested by base station simulator unit in the sending time section NM server.
5. NM server test method according to claim 3, which is characterized in that the simulation message further includes message Generate time and organization unique identifier.
6. NM server test method according to claim 3, which is characterized in that base station simulator unit is based on test Model of place, to NM server to be tested send respective numbers simulation message the step of after, further comprise the steps of:
Running state information between the base station simulator unit obtains the NM server to be tested at runtime in section;Institute Stating runing time section includes starting point and ending point;The starting point is at the time of generating the simulation message;The terminating point At the time of to get the performance test results;The running state information includes handling capacity and clicking rate.
7. according to claim 1 to NM server test method described in 6 any one, which is characterized in that the performance is surveyed Test result includes any one or any combination of following values: response time, cpu busy percentage and disk utilization.
8. a kind of NM server test device characterized by comprising
Message transmission module is simulated, for being based on test scene model, the mould of respective numbers is sent to NM server to be tested Quasi- message;It is being grabbed according to the simulation message, for base station interacted with the NM server to be tested really disappear The message that breath packet generates;
Test result obtains module, for obtaining the performance test results;The performance test results are by the simulation message through institute It is obtained after stating NM server processing to be tested.
9. a kind of NM server test macro characterized by comprising NM server to be tested, base station, and realize such as The base station simulator unit of NM server test method described in claim 1 to 7 any one;
The base station simulator unit is separately connected the NM server to be tested and the base station;
The NM server to be tested connects the base station.
10. NM server test macro according to claim 9, which is characterized in that further include interchanger;The base station Simulator unit includes control machine and the load machine of at least one;
The base station connects the NM server to be tested by the interchanger;
The control machine is separately connected the NM server to be tested, the base station and each described negative by the interchanger Carrier aircraft;
The load machine is separately connected the NM server to be tested and the base station by the interchanger;
The load machine is the equipment for including at least one Virtual NE;The Virtual NE is for generating simulation message.
11. a kind of computer storage medium, is stored thereon with computer program, which is characterized in that the program is executed by processor Shi Shixian NM server test method as claimed in any one of claims 1 to 7.
CN201811279675.9A 2018-10-30 2018-10-30 NM server test method, device and system Pending CN109348498A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811279675.9A CN109348498A (en) 2018-10-30 2018-10-30 NM server test method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811279675.9A CN109348498A (en) 2018-10-30 2018-10-30 NM server test method, device and system

Publications (1)

Publication Number Publication Date
CN109348498A true CN109348498A (en) 2019-02-15

Family

ID=65312622

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811279675.9A Pending CN109348498A (en) 2018-10-30 2018-10-30 NM server test method, device and system

Country Status (1)

Country Link
CN (1) CN109348498A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109743212A (en) * 2019-02-26 2019-05-10 京信通信***(中国)有限公司 Realize method, apparatus, computer storage medium and the equipment of opening base station
CN111142139A (en) * 2019-11-29 2020-05-12 苏州科达科技股份有限公司 Method and device for acquiring simulated positioning information and storage medium
CN114124727A (en) * 2021-11-08 2022-03-01 中信科移动通信技术股份有限公司 Network management communication pressure testing method and system
WO2023051002A1 (en) * 2021-09-30 2023-04-06 中兴通讯股份有限公司 Terminal simulation test method and apparatus, storage medium, and electronic device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101179447A (en) * 2006-11-10 2008-05-14 中兴通讯股份有限公司 Integrated network management data simulator system
CN102036275A (en) * 2010-12-08 2011-04-27 大唐移动通信设备有限公司 Simulator and message processing method
CN102740342A (en) * 2012-06-08 2012-10-17 大唐移动通信设备有限公司 Network management equipment performance simulation test method and system
CN104301150A (en) * 2014-10-28 2015-01-21 上海斐讯数据通信技术有限公司 Network device configuration method
CN104796302A (en) * 2015-04-17 2015-07-22 大唐移动通信设备有限公司 Method and system for testing network element simulators
CN105515825A (en) * 2015-11-25 2016-04-20 成都广达新网科技股份有限公司 SNMP simulator for network management capacity testing and testing method thereof
CN107332689A (en) * 2017-05-27 2017-11-07 烽火通信科技股份有限公司 Embedded PON terminal devices TR069 protocol interconnections simulation system and method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101179447A (en) * 2006-11-10 2008-05-14 中兴通讯股份有限公司 Integrated network management data simulator system
CN102036275A (en) * 2010-12-08 2011-04-27 大唐移动通信设备有限公司 Simulator and message processing method
CN102740342A (en) * 2012-06-08 2012-10-17 大唐移动通信设备有限公司 Network management equipment performance simulation test method and system
CN104301150A (en) * 2014-10-28 2015-01-21 上海斐讯数据通信技术有限公司 Network device configuration method
CN104796302A (en) * 2015-04-17 2015-07-22 大唐移动通信设备有限公司 Method and system for testing network element simulators
CN105515825A (en) * 2015-11-25 2016-04-20 成都广达新网科技股份有限公司 SNMP simulator for network management capacity testing and testing method thereof
CN107332689A (en) * 2017-05-27 2017-11-07 烽火通信科技股份有限公司 Embedded PON terminal devices TR069 protocol interconnections simulation system and method

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109743212A (en) * 2019-02-26 2019-05-10 京信通信***(中国)有限公司 Realize method, apparatus, computer storage medium and the equipment of opening base station
CN111142139A (en) * 2019-11-29 2020-05-12 苏州科达科技股份有限公司 Method and device for acquiring simulated positioning information and storage medium
CN111142139B (en) * 2019-11-29 2022-08-26 苏州科达科技股份有限公司 Method and device for acquiring simulated positioning information and storage medium
WO2023051002A1 (en) * 2021-09-30 2023-04-06 中兴通讯股份有限公司 Terminal simulation test method and apparatus, storage medium, and electronic device
CN114124727A (en) * 2021-11-08 2022-03-01 中信科移动通信技术股份有限公司 Network management communication pressure testing method and system
CN114124727B (en) * 2021-11-08 2023-10-31 中信科移动通信技术股份有限公司 Network management communication pressure testing method and system

Similar Documents

Publication Publication Date Title
CN109348498A (en) NM server test method, device and system
CN111355780B (en) Internet of things monitoring management method and system based on block chain
CN108322356A (en) A kind of industrial network gateway compatibility test method based on MQTT
CN104579822B (en) Mobile application automated performance testing system and method based on Http agreements
CN100367235C (en) Method for realizing automatic test and its system
CN103220292B (en) Cross-safe-area data transmission and system
CN110413591A (en) A kind of industrial data acquisition method and edge calculations gateway
CN103795762B (en) A kind of test method and system of reverse proxy
CN102413068A (en) Cloud computing-based system and method for controlling internet of things terminal device
CN103067225B (en) A kind of test system
CN108306804A (en) A kind of Ethercat main station controllers and its communication means and system
WO2011150715A1 (en) Method and device for collecting data of third-party equipment in distributed control system
CN107819611B (en) Client test method based on IEC61850 multi-server simulation
CN103901847A (en) Printing machine remote fault monitoring system and method
CN105915529B (en) A kind of message forming method and device
CN107070752B (en) Testing method and testing system for long connection capacity
CN113419920B (en) Real-time monitoring method for joint debugging test process of simulation test system of Internet of things management platform
CN105183299A (en) Human-computer interface service processing system and method
CN108366356A (en) The interoperability methods and device of M2M systems and identification (RNC-ID) analytic system
CN115174454A (en) Virtual-real combined network test implementation method and storage medium
CN114490356A (en) Pressure testing method, system, equipment and storage medium
CN106407061A (en) Northbound interface testing device and northbound interface testing method
CN103944779B (en) A kind of WAP service features monitoring method and system
CN101969442B (en) Process running environment perception and migration based network analog framework implementation method
CN115941538B (en) Test system, test method and test device for multiparty security calculation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20200108

Address after: 510663 Shenzhou Road, Guangzhou Science City, Guangzhou economic and Technological Development Zone, Guangdong, 10

Applicant after: COMBA TELECOM SYSTEMS (CHINA) Ltd.

Address before: 510663 Shenzhou Road 10, Guangzhou Science City, Guangzhou economic and Technological Development Zone, Guangzhou, Guangdong

Applicant before: COMBA TELECOM SYSTEMS (CHINA) Ltd.

Applicant before: COMBA TELECOM SYSTEMS (GUANGZHOU) Ltd.

Applicant before: COMBA TELECOM TECHNOLOGY (GUANGZHOU) Ltd.

Applicant before: TIANJIN COMBA TELECOM SYSTEMS Ltd.

CB02 Change of applicant information
CB02 Change of applicant information

Address after: 510663 Shenzhou Road, Guangzhou Science City, Guangzhou economic and Technological Development Zone, Guangdong, 10

Applicant after: Jingxin Network System Co.,Ltd.

Address before: 510663 Shenzhou Road, Guangzhou Science City, Guangzhou economic and Technological Development Zone, Guangdong, 10

Applicant before: COMBA TELECOM SYSTEMS (CHINA) Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190215