CN116264556A

CN116264556A - Network equipment interoperability test method and device

Info

Publication number: CN116264556A
Application number: CN202111526052.9A
Authority: CN
Inventors: 邰博; 潘欣宇
Original assignee: Beijing Huawei Digital Technologies Co Ltd
Current assignee: Beijing Huawei Digital Technologies Co Ltd
Priority date: 2021-12-14
Filing date: 2021-12-14
Publication date: 2023-06-16

Abstract

The embodiment of the application discloses a network equipment interoperability test method and device, which are used for obtaining a reliable interoperability test result. The method may include: the testing device acquires a first message sent by the second network device to the first network device; the testing device sends a first message to the target network equipment, and the target network equipment is configured to process and send the first message; the testing device respectively acquires a second message sent by the first network equipment and a third message sent by the target network equipment; the testing device compares whether the second message is consistent with the third message, and determines an interoperability test result between the first network device and the target network device according to the comparison result. The control message and/or flow message information among running devices is acquired through information acquisition on the current network environment and is used for test activities such as intercommunication, compatibility and performance, the consistency of the test environment and the current network environment is ensured, and the evaluation result can more accurately meet the current network use environment.

Description

Network equipment interoperability test method and device

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a method and an apparatus for testing interoperability of a network device.

Background

Network devices and components are physical entities connected into a network. Common network devices include routers, switches, gateways, and the like, which may be used to process protocol messages and/or user messages in a network. Fig. 1 shows part of network devices in a certain networking environment, called a target networking environment, which, referring to fig. 1, comprises a network device 11 and a network device 12, where a communication connection is established. The network device 12 may send the message 1 to the network device 11, and the network device 11 may process the message 1 and return the processed message 11 to the network device 12. The message 1 may be a protocol message or a user message, and the network device 11 or the network device 12 may be a router, a switch, a gateway, or the like.

If the network device 11 needs to be replaced by another network device (referred to as a target network device), a manufacturer of the target network device needs to simulate the target networking environment to build a test networking environment, and performs an interoperability test on the target network device in the test networking environment to prove whether the target network device can perform the same function as the first network device after the target network device is replaced by the first network device to access the target networking environment, so as to ensure the normal operation of the target networking environment.

However, the difficulty of setting up the test networking environment the same as the target networking environment by the equipment manufacturer is large, and the difficulty of proving that the actual test networking environment is the same as the target networking environment is also large, so that it is difficult to obtain a reliable interoperability test result.

Disclosure of Invention

The embodiment of the application provides a network equipment interoperability test method and device, which are used for obtaining a reliable interoperability test result.

In a first aspect, an embodiment of the present application provides a method for testing interoperability of network devices. The method can be applied to a target networking environment, the target networking environment comprises a first network device and a second network device, the first network device and the second network device are used for establishing communication connection, the second network device is used for sending messages to the first network device, the first network device is used for processing and sending the messages from the second network device, and the method comprises the following steps: the testing device obtains a first message sent by the second network device to the first network device; the testing device sends the first message to target network equipment, and the target network equipment is configured to process and send the first message; the testing device respectively acquires a second message sent by the first network device and a third message sent by the target network device; the testing device compares whether the second message is consistent with the third message, and determines an interoperability test result between the first network device and the target network device according to the comparison result.

The control message and/or flow message information among running devices is acquired through information acquisition on the current network environment and is used for test activities such as intercommunication, compatibility and performance, the consistency of the test environment and the current network field environment is ensured, and the evaluation result can more accurately meet the current network use environment. The consistency between the current network message and the message captured by the local test environment is analyzed by adopting the test device, so that the reliability of the test result is improved.

Optionally, the first network device is configured to process and send the packet from the second network device according to a target network protocol, where the target network protocol includes a control plane protocol; the first message is a protocol message encapsulated according to the target network protocol, and the target network device is configured to process and send the first message according to the target network protocol.

The interoperability testing method provided by the embodiment of the application can be used for testing the interoperability of the network equipment for processing the protocol message.

Optionally, the testing device compares whether the second message and the third message are consistent, including: the test device compares whether a target field in the second message and a target field in the third message are consistent, wherein the target field corresponds to the control plane protocol.

And the interoperability test result is determined by comparing the target fields in the message, so that the high efficiency and the flexibility of the test are guaranteed.

Optionally, the target field does not include a physical address.

Optionally, the first network device is configured to perform network flow-based processing on the packet from the second network device; the first message is a user message, and the target network device is configured to perform network flow-based processing on the first message.

The interoperability test method provided by the embodiment of the application can be used for carrying out the interoperability test on the network equipment for processing the user message.

Optionally, the testing device compares whether the second message and the third message are consistent, including: the test device compares whether the value of the statistical parameter of the second message is the same as the value of the statistical parameter of the third message.

Optionally, the testing device compares whether the second message and the third message are consistent, including: and the testing device compares whether the forwarding path of the second message is consistent with the forwarding path of the third message.

Optionally, the testing device compares whether the second message and the third message are consistent, including: and the testing device compares whether the flow identifier of the second message is consistent with the flow identifier of the third message.

Optionally, if the second message is consistent with the third message, the interoperability test result indicates that the target network device may be used to replace the first network device in the target networking environment, so as to process and send the message from the second network device.

Optionally, before the testing apparatus sends the first message to the target network device, the method further includes: the testing device acquires mapping information between the first network equipment and the target network equipment, and the mapping information records the corresponding relation between the identification of the first network equipment and the identification of the target network equipment; the testing device modifies the identification of the first network device in the first message into the identification of the target network device according to the mapping information.

Optionally, the test device obtains a first message sent by the second network device to the first network device, including: the testing device acquires the first message through a message acquisition module, wherein the message acquisition module is arranged in a transmission channel between the first network device and the second network device, or the message acquisition module is arranged in the first network device.

Optionally, the first message includes a plurality of messages, and the target network device is configured to perform an upgrade operation in a process of processing the plurality of messages; the test device sends the first message to a target network device, including: the testing device sends a first sub-message in the plurality of messages to the target network equipment in a first stage; the testing device sends a second sub-message in the plurality of messages to the target network equipment in a second stage; wherein the first stage and the second stage are any two different stages of the following plurality of stages: before the upgrade operation is performed, during the upgrade operation is performed, and after the upgrade operation is completed.

The network equipment interoperability test method provided by the embodiment of the application can be also expanded to tests of upgrading compatibility, performance comparison and the like, and has the advantages that all service and flow model scenes of the current network scene can be restored at a ratio of 1:1, and the compatibility and performance of the test equipment can be tested.

In a second aspect, an embodiment of the present application provides a testing apparatus, which may be applied to a target networking environment, where the target networking environment includes a first network device and a second network device, where the first network device is configured to establish a communication connection, and the second network device is configured to send a packet to the first network device, and the first network device is configured to process and send a packet from the second network device, where the testing apparatus includes: the acquisition module is used for acquiring a first message sent by the second network equipment to the first network equipment; a sending module, configured to send the first message to a target network device, where the target network device is configured to process and send the first message; the acquisition module is further configured to acquire a second packet sent by the first network device and a third packet sent by the target network device; and the comparison module is used for comparing whether the second message is consistent with the third message or not and determining an interoperability test result between the first network equipment and the target network equipment according to a comparison result.

In a third aspect, embodiments of the present application provide a computing device, the computing device including a processor and a memory for storing instructions, the memory being coupled to the processor, the processor implementing any one of the possible methods described in the first aspect above when executing the instructions stored in the memory.

Drawings

FIGS. 1 and 2 are each schematically illustrating a networking environment to which embodiments of the present application are applicable;

FIG. 3 illustrates one possible flow of the method of embodiments of the present application;

FIGS. 4-1 and 4-2 illustrate another possible flow of the method of embodiments of the present application, respectively;

FIG. 5 illustrates another possible flow of the method of embodiments of the present application;

FIGS. 6-1 and 6-2 illustrate another possible flow of the method of embodiments of the present application, respectively;

FIG. 7 illustrates one possible configuration of a computing device according to an embodiment of the present application;

fig. 8 schematically shows one possible configuration of the test device according to the embodiment of the present application.

Detailed Description

The embodiment of the application provides a network equipment interoperability test method and device.

Optionally, the embodiment of the present application is applicable to the networking environment shown in fig. 1, and optionally, the embodiment of the present application may also be applicable to other networking environments. Fig. 2 illustrates another networking environment to which embodiments of the present application are applicable.

The networking environment shown in fig. 2 includes a network device 21, a network device 22, and a network device 23, and the network device 21 establishes communication connections with the network device 22 and the network device 23, respectively. The network device 22 may send the message 1 to the network device 21, and the network device 21 may process the message 1 to obtain the message 11 and send the processed message 11 to the network device 23. Alternatively, after the network device 23 receives and processes the message 11, the message 2 may be sent to the network device 21. The network device 21 may process the message 2 to obtain the message 21, and send the message 21 to the network device 22. Alternatively, the message 2 may be a response message of the message 11.

When a certain network device (called a first network device) in a certain networking environment (called a target networking environment) needs to be replaced by other network devices (called target network devices), an interoperability test needs to be performed on the target network device to judge whether the target network device can perform the same operation as the first network device on a received message after the target network device is accessed to the target networking environment instead of the first network device, so that the normal operation of the target networking environment is ensured. For example, when the network device 11 in the networking environment corresponding to fig. 1 or the network device 21 in the networking environment corresponding to fig. 2 needs to be replaced with the target network device, interoperability test needs to be performed on the target network device.

To perform an interworking test on a target network device, a device manufacturer may simulate a target networking environment to build a specific networking environment, and perform an interworking test on the target network device in the built networking environment to prove that the network device of the manufacturer can be used in a local networking environment, and cooperate with an existing network device, for example, cooperate with the network device 12 shown in fig. 1, or cooperate with the network device 22 and the network device 23 shown in fig. 2. However, the scheme of the intercommunication test cannot be implemented under the condition of lacking other manufacturer environments, or the A party may question that the intercommunication environment built by the manufacturer and the local networking cannot achieve 1:1 simulation.

Alternatively, in order to perform an interworking test on the target network device, the device manufacturer may implement message processing according to a protocol standard. However, the specification of the protocol standard for the message processing procedure is generally not all-inclusive, and the corresponding specification includes various implementations for terms such as "should" or "make" in the protocol, and thus, the difficulty of utilizing protocol consistency for the certificate is generally great.

In order to improve the reliability of the interworking test result, the embodiment of the application provides an interworking test method, which uses a target networking environment (or called a current network environment) and a message (or called a current network message) in the target networking environment as much as possible to execute the interworking test on the target network device. The following describes an interworking test method provided in the embodiments of the present application with reference to the accompanying drawings.

Fig. 3 illustrates a possible flowchart of a network device interoperability test method according to an embodiment of the present application.

The method shown in fig. 3 may be applied to a target networking environment, where the target networking environment includes a first network device and a second network device that establish a communication connection, the second network device is configured to send a message to the first network device, and the first network device is configured to process and send a message from the second network device. The first network device and the second network device may be, for example, the network device 11 and the network device 12 shown in fig. 1, or the network device 21 and the network device 22 shown in fig. 2, or the network device 21 and the network device 23 shown in fig. 2, respectively.

In order to perform an interoperability test on the target network device to verify whether the target network device can replace the first network device in the target networking environment, a test apparatus and the target network device may be introduced in the target networking environment, where the target network device is configured to process and send the first message, and the test apparatus is used to perform the method flow shown in fig. 3.

301. The testing device acquires a first message sent by the second network device to the first network device;

In the embodiment of the application, the testing device may be configured to obtain a first packet sent by the second network device to the first network device. The embodiment of the application does not limit the mode of the testing device for acquiring the first message, and optionally, the testing device can acquire the first message through the message acquisition module. The message collection module may be configured to obtain a first message sent by the second network device to the first network device. The message collection module may be disposed in a transmission channel between the first network device and the second network device, or alternatively, the message collection module may be disposed in the first network device. The message collection module may be implemented by a hardware element or a software module or a combination of hardware and software.

Alternatively, the second network device may refer to a different one of the network devices than the first network device, or alternatively, the second network device may include a plurality of network devices different from the first network device.

The embodiment of the application does not limit the precedence relationship between the time when the first message is acquired by the testing device and the time when the first message is acquired by the first network device. Optionally, the testing device may acquire the first message before the first network device acquires the first message, or acquire the first message simultaneously with the first network device, or acquire the first message after the first network device acquires the first message.

302. The testing device sends a first message to the target network equipment;

after the testing device obtains the first message, the testing device may send the first message to the target network device.

The communication mode adopted by the test device to send the first message to the target network device is not limited, alternatively, the test device may send the first message to the target network device through a wireless communication link between the test device and the target network device, or alternatively, the test device may send the first message to the target network device through a wired communication link between the test device and the target network device.

Optionally, after the testing device obtains the first message, the first message may be preprocessed before the first message is sent to the target network device. Assuming that the first message is obtained by encapsulation according to the target network protocol, correspondingly, the testing device is configured to support the target network protocol, the first message can be decapsulated according to the target network protocol, the first message is preprocessed, and then the preprocessed first message is encapsulated according to the target network protocol and sent to the target network device.

Optionally, the testing device may obtain mapping information between the first network device and the target network device, where the mapping information is associated with and records an identifier of the first network device and an identifier of the target network device, and the testing device may pre-process the first packet according to the mapping information, for example, the testing device may modify the identifier of the first network device in the first packet to be an identifier of the target network device according to the mapping information.

As an example, the mapping information may be as shown in table 1. It should be noted that, if the target network device passes the interoperability test, the embodiments of the present application do not limit that all functions of the target network device and the first network device are the same, and may be only used to indicate that the target functions of the target network device and the first network device are the same. Alternatively, the testing device may preprocess the fields for content that is not relevant to the correctness of the target function but may need to be adapted. Optionally, the testing apparatus may modify at least one field of the sequence number, the interface index, the internet protocol (internet protocol, IP) address, and the route identification (router ID) in the first packet into a corresponding field of the target network device according to mapping information, for example, as shown in table 1. For example, the sequence number in the first message is modified to sequence number 2, and/or the interface index is modified to interface 2, and/or the IP address is modified to IP2, and/or the route identification is modified to r2. The purpose of the preprocessing is to enable the target network device to receive a first message matching its interface, address, etc.

TABLE 1

Mapping information	First network device	Target network device
			Sequence number	Sequence number	1	Sequence number 2
Interface index	Interface	1					Interface 2
			IP address	IP1	IP2
Route identification	r1	r2

303. The testing device respectively acquires a second message sent by the first network equipment and a third message sent by the target network equipment;

the testing device may obtain a second message sent by the first network device after obtaining the first message. Alternatively, the second message may be a message that the first network device sends to the second network device after obtaining the first message, for example, the first message and the second message may be a message 1 and a message 11 shown in fig. 1, respectively. Alternatively, the second message may be a message that is sent by the first network device to another network device other than the second network device after the first message is acquired, for example, the first message and the second message may be a message 1 and a message 11 shown in fig. 2, respectively.

After step 302, the testing apparatus may obtain a third packet sent by the target network device. Optionally, the target network device may be configured to send a third message to the testing apparatus after the first message is acquired.

304. The testing device compares whether the second message is consistent with the third message, and determines an interoperability test result between the first network device and the target network device according to the comparison result.

After the testing device obtains the second message and the third message, whether the second message is consistent with the third message or not can be compared, and an interoperability test result of the target network device in the target networking environment is determined according to the comparison result, for example, the interoperability test result is an interoperability test result between the target network device and the first network device in the target networking environment.

Optionally, if the second message is consistent with the third message, the interoperability test result may indicate that the target network device passes the interoperability test, specifically indicates that the target network device may be used to replace the first network device in the target networking environment, so as to process and send the message from the second network device.

It should be noted that, if the target network device passes the interoperability test, the embodiments of the present application do not limit that all functions of the target network device and the first network device are the same, and may be only used to indicate that the target functions of the target network device and the first network device are the same. For example, if the target network device passes the interoperability test, it may indicate that the target network device is capable of performing the same process as the first network device on the first message from the second network device, and may perform the same process as the first network device or a different process on the messages from other network devices than the second network device. The embodiment of the application does not limit the first message to any type of message sent by the second network device to the first network device, and alternatively, the first message may be a certain type or a plurality of types of messages.

Embodiments of the present application are not limited to a particular type of target function to be verified by the interoperability test. The interoperability test method provided in the embodiment of the present application is described below by taking several types of target functions as examples.

1. The target function is used for processing the protocol message.

Optionally, the second network device may send a first packet to the first network device according to a target network protocol, where the target network protocol may include a control plane protocol, and the first packet is a protocol packet. The target function enables the first network device to process and send protocol messages encapsulated according to the target network protocol. After the target network device is configured to process and send the first packet according to the target network protocol, in order to verify whether the target function identical to the first network device can be executed after the target network device is replaced with the target network device in the target networking environment, the flow shown in fig. 3 may be implemented.

In the process of executing step 304, optionally, the testing device may determine whether the second message and the third message are consistent by comparing whether the target field in the second message and the target field in the third message are consistent. For example, if the target field in the second message is consistent with the target field in the third message, then it may be determined that the second message is consistent with the third message. Thus, the comparison efficiency of the test device to the messages is improved. Optionally, the target field corresponds to a control plane protocol. Alternatively, the target field may not include content that is independent of the correctness of the target network protocol under test. For example, the target field may not include a physical address.

The target field in the second message is identical to the target field in the third message, which may mean that the target field and the target field are identical, or that the target field and the target field satisfy the corresponding relation indicated by the mapping information, or that part of the fields in the target field are identical, and that the other fields in the target field satisfy the corresponding relation indicated by the mapping information.

The method for testing the interoperability of the network device according to the embodiment of the present application is described below by way of example with reference to the networking environment shown in fig. 1 or fig. 2.

Referring to fig. 4-1, in combination with the networking environment shown in fig. 1, the method for testing interoperability of network devices provided in the embodiment of the present application may include the following steps:

(1) The network device 12 sends a message 1 to the network device 11;

message 1 may be understood corresponding to the first message in the embodiment corresponding to fig. 3, where message 1 is encapsulated according to a target network protocol, and the target network protocol includes a control plane protocol, and message 1 is a protocol message.

Alternatively, the message 1 may be a border gateway protocol (border gateway protocol, BGP) message, and specifically may be an open (open) message. According to the actual configuration, the network device 12 initiates a neighbor set-up request to the network device 11, and sends a neighbor set-up request message 1.

(2) The message acquisition module c1 acquires a message 1 and sends the acquired message 1 to the testing device;

a message collection module (denoted as c 1) may be provided in advance in the link (referred to as link 1) in which the network device 12 sends messages to the network device 11, and this message collection module c1 may alternatively be a splitter or a hub.

The beam splitter is a passive device and does not need external energy, as long as there is input light. The beam splitter consists of entrance and exit slits, mirrors and a dispersive element, which acts to separate the desired resonant absorption line. The key component of the optical splitter is a dispersive element, and the grating is used in the current commercial instruments.

The purpose of the HUB (HUB) is to regenerate and retime the network signals. It behaves very similar to a repeater, also known as a multiport repeater (multiport repeater). Hubs are common connection points for individual devices in a network, which are commonly used to connect segments of a local area network (local area network, LAN). The hub contains a plurality of ports. When each packet arrives at a port, it is copied to all other ports so that all LAN segments can see all packets. The hub does not recognize any information patterns in the signal, address or data.

According to the actual planning of the current network, the network device 12 needs to establish BGP protocol neighbors with the network device 11, so that in order to verify that the target network device can replace the network device 11 to access the network, and can correctly establish neighbors with the network device 12, an interworking test verification is arranged. In the traditional intercommunication test, a service similar to the existing network is built in a third party environment, or a single tested protocol is directly adopted for verification, so that the complete consistency with the site cannot be ensured. The method and the device can acquire from the current network environment to perform interoperability test, and are favorable for ensuring that the test scene is consistent with the current network environment.

(3) The testing device preprocesses the message 1 and sends the preprocessed message 1 to the target network equipment;

wherein the target network device configures the device under test to be consistent with the network device 11, with the intention of simulating the situation when the target network device is replaced with the network device 11, for example simulating the establishment of BGP protocol neighbors with the network device 22.

The test device needs to support the message encapsulation and decapsulation of the tested protocol (i.e. the target network protocol), and perform necessary test data preprocessing for the fields which are irrelevant to the correctness of the tested protocol and may need to be adapted, such as media access control (media access control, MAC) address, serial number, interface index, IP address, routerID and other information, where the purpose of the preprocessing is to enable the target network device to receive the correct message matched with the interface and address of the target network device and then verify the message.

Optionally, after the testing device obtains the message 1, the target field of the message in the interoperability test may be determined according to the message 1. For example, if message 1 is a BGP open message, at least one of the following fields may be interpreted: hold time (holdtime), route identification (routerID), version (version), my autonomous system (my autonomous system, my AS), optional, etc. These field information are stored in the test device in a suitable data structure after being unpackaged.

(4) The network device 11 sends a message 11 to the network device 12;

after the network device 11 obtains the message 1 sent by the network device 12, the network device 11 can perform corresponding processing on the message 1 according to implementation and setting of the network device to obtain and send the message 11 to the network device 12. Message 11 may be a reply message to message 1.

For example, the network device 11 performs neighbor negotiation according to the current network configuration reply open message, and may also carry field information such AS hold time (holdtime), route identifier (routerID), version (version), my autonomous system (my autonomous system, my AS), optional (optional), etc.

(5) After the message collection module c2 obtains the message 11, the message 11 can be sent to the testing device;

a message collection module (denoted as c 2) may be disposed in a link (called link 2) in which the network device 11 sends a message to the network device 12, and the message collection module c2 may be a beam splitter or a hub. The message collection module c2 is configured to obtain a message sent by the network device 11 to the network device 12, and send the obtained message to the testing device.

After the test device obtains the message 11 sent by the message collection module c2, the message 11 can be stored. Optionally, the testing device may preprocess the message 11, and save the result after preprocessing. For example, the target field may be extracted from the message 11, and the target field in the message 11 may be saved.

(6) The target network equipment responds to the message 1 from the testing device and issues a returned/responded message 12 to the testing device;

the target network device receives the message 1, discovers that the configurations of the MAC address, the interface index, the IP address, the route identifier and the like are all correct, does not discard the message 1, but further decapsulates the content of the protocol message 1, obtains field information such AS hold time (holdtime), route identifier (routerID), version (version), my autonomous system (my autonomous system, my AS), optional (optional) and the like, and then replies the opened message to the test device according to the configuration of the device.

After receiving the message 12 issued by the target network device, the testing device can store the message 12. Optionally, the message 12 may be preprocessed in step (5), and the preprocessed result is saved. For example, the target field may be extracted from the message 12 and stored in the message 12. The destination field includes field information such AS hold time (holdtime), route identification (routerID), version (version), my autonomous system (my autonomous system, my AS), optional, and the like.

The test device may then compare the data saved in step (5) and step (6) to determine whether the target functions of the target network device and the network device 11 are consistent. If so, it can be determined that the interoperability test passes. If not, the result and the reason for the failure may be returned.

Alternatively, the testing device may compare messages received from the target network device with messages received from the network device 11 according to the value of each field (i.e., the target field) in the data structure. On the one hand, the interference caused by the environmental factors such as the MAC address, the interface index, the IP address, the route identification and the like is ignored, and on the other hand, which field is inconsistent can be rapidly positioned, and the result is accurately returned. Alternatively, the binary message segments may be compared directly as needed, where no mandatory restrictions are imposed, but the influence of environmental factors is removed. If the target fields of the two are consistent, the interoperability test can be judged to pass, otherwise, the reasons can be analyzed.

Fig. 4-1 illustrates the manner in which the test module obtains the messages between the network device 11 and the network device 12, using the message collection module deployed in the transmission channel as an example, and the message collection module may be deployed in other manners, such as in the network device 11. Optionally, referring to fig. 4-2, after step (1), the network device 11 may perform debug (debug) information collection on the received message 1 and the sent message 11, and save the collected data into a file. A message collection module may be understood as a module provided in the network device 11 for performing debugging. Thereafter, referring to step (2) and step (5) in fig. 4-2, the network device 11 may issue the debug acquired message 1 and message 11 to the test apparatus. The other steps in fig. 4-2 may be understood with reference to the corresponding steps in fig. 4-1, and will not be described again here.

Referring to fig. 5, in combination with the networking environment shown in fig. 2, the method for testing interoperability of network devices provided in the embodiment of the present application may include the following steps:

(1) The network device 22 may send the message 1 to the network device 21;

According to the actual configuration, the network device 22 issues a message 1 to the network device 21 through the protocol neighbor, and the message 1 may be a routing message, for example, an update (update) message of BGP.

(2) The message acquisition module c1 acquires a message 1 and sends the acquired message 1 to the testing device 1;

a message collection module (denoted as c 1) may be provided in advance in a link (referred to as link 1) in which the network device 22 sends a message to the network device 21, and the message collection module c1 may alternatively be a splitter or a hub.

According to the actual planning of the current network, the network device 22 needs to send protocol messages to the network device 21, so that the tested device can replace the network device 21 to access the network for verification, and can correctly establish neighbors with the network device 22, and the scene of intercommunication test verification is arranged. In the traditional intercommunication test, a service similar to the existing network is built in a third party environment, or a single tested protocol is directly adopted for verification, so that the complete consistency with the site cannot be ensured. The method and the device can acquire from the current network environment to perform interoperability test, and are favorable for ensuring that the test scene is consistent with the current network environment.

(3) The testing device 1 preprocesses the message 1 and sends the preprocessed message 1 to the target network equipment;

wherein the target network device configures the device under test to be consistent with the network device 11, with the intention of simulating the situation when the target network device is replaced with the network device 11.

The Tester2 unpacks the tested protocol, such AS routing update message of BGP protocol, according to the message packaging and unpacking model of the tested protocol, and reads the field information of NLRI, AS-path, origin, MED, nextHop, local_pref and the like; this information is stored in the test device 1 in a suitable data structure after being unpackaged.

The test device 1 needs to support the message encapsulation and decapsulation of the tested protocol (i.e. the target network protocol), and perform necessary test data preprocessing for the fields that are irrelevant to the correctness of the tested protocol and may need to be adapted, such as the media access control (media access control, MAC) address, serial number, interface index, IP address, routerID, etc., where the purpose of the preprocessing is to enable the target network device to receive the correct message matching the interface and address thereof, and then perform verification.

(4) The target network equipment processes the message 1 and sends the processed message 12 to the testing device 2;

The target network device receives the protocol message 1, discovers that the configuration of the MAC address, the interface index, the IP address, the route identifier and the like are all correct, does not discard the message 1, further decapsulates the content of the protocol message, obtains field information such AS NLRI, AS-path, origin, MED, nextHop, local_pref and the like, and then floods other protocols and neighbors, such AS the testing device 2, according to the configuration of the target network device.

The test device 2 receives the message 12 and obtains field information such AS "NLRI", "AS-path", "Origin", "MED", "NextHop", "local_pref" and the like therein, and these information are stored in the test device 2 in a suitable data structure after being unpackaged.

(5) The network device 21 may process the packet 1 and send the processed packet 11 to the network device 23;

the network device 21 also receives the original protocol packet 1 issued by the network device 22, and floods the protocol neighbor network device 23 according to the current network configuration, and also carries field information such AS "NLRI", "AS-path", "Origin", "MED", "NextHop", "local_pref", etc. The beam splitter/hub in the link acquires the returned Update message and sends the acquired message to the Tester1;

(6) After the message collection module c2 obtains the message 11, the message 11 can be sent to the testing device 2;

a message collection module (denoted as c 2) may be provided in advance in the link (called link 2) in which the network device 22 sends messages to the network device 23, and this message collection module c2 may alternatively be a splitter or a hub. The message collection module c2 is configured to obtain a message sent by the network device 21 to the network device 23, and send the obtained message to the testing device 2.

The testing device 2 unpacks the returned message 11, acquires field information such AS "NLRI", "AS-path", "Origin", "MED", "Next hop", "local_pref", and the like, and stores the field information in a proper data structure.

The test device 2 may then compare the data saved in step (4) and step (6) to determine whether the target functions of the target network device and the network device 11 are consistent. If so, it can be determined that the interoperability test passes. If not, the result and the reason for the failure may be returned.

The test apparatus 2 compares the message 12 from the target network device with the message 11 from the link between the network device 21 and the network device 23 according to the value of each field in the data structure, i.e. the target field. On the one hand, the interference caused by the environmental factors such as the MAC address, the interface index, the IP address, the route identification and the like is ignored, and on the other hand, which field is inconsistent can be rapidly positioned, and the result is accurately returned. Alternatively, the binary message segments may be compared directly as needed, where no mandatory restrictions are imposed, but the influence of environmental factors is removed. If the target fields of the two are consistent, the interoperability test can be judged to pass, otherwise, the reasons can be analyzed.

Referring to fig. 5, after the network device 23 receives the message 11 from the network device 21, referring to step (7), the network device 23 may process the message 11 and send the message 2 to the network device 21. The method for testing the interoperability of the network device may further include steps (7) to (12), and the steps (7) to (12) may be understood with reference to the steps (1) to (6) in fig. 5, respectively, which are not described herein again.

It should be noted that, the test device 1 and the test device 2 in fig. 5 may be different test devices, or different interfaces of the same test device.

2. The target function is used for processing the user message.

Optionally, the second network device may send a first packet to the first network device according to the target network protocol, where the first packet may be a user packet. The target function enables the first network device to process and send messages from the second network device based on network flows. After the target network device is configured to perform the network flow-based processing on the first packet, in order to verify whether the target function identical to that of the first network device can be performed after the target network device is replaced with the target network device in the target networking environment, the flow shown in fig. 3 may be implemented.

In the process of executing step 304, optionally, the testing device may determine whether the second message and the third message are consistent by comparing whether the target parameter of the second message is the same as the target parameter of the third message. For example, if the target parameter of the second message is consistent with the target parameter of the third message, then it may be determined that the second message is consistent with the third message. Optionally, the target parameter of the message may be at least one of the following parameters: statistical parameters of the message, forwarding paths of the message and flow identification of the message. The flow identifier of the message is used to determine the network flow to which the message belongs, and the flow identifier of the message may be a triplet, a quadruple, a quintuple or the like in the message. The statistical parameter of the message may be a statistical parameter of the message based on a network flow, for example, the statistical parameter of the message may be a parameter obtained based on a statistical count of the message corresponding to the same flow identifier.

Referring to fig. 6-1, in combination with the networking environment shown in fig. 2, the method for testing interoperability of network devices provided in the embodiment of the present application may include the following steps:

(1) The network device 22 sends the traffic 1 to the network device 21;

traffic 1 (or traffic 1) may include a plurality of messages, and traffic 1 may correspond to the first message in the embodiment corresponding to fig. 3, where it is understood that traffic 1 may be a user message.

(2) The message acquisition module c1 acquires the flow 1 and sends the acquired flow 1 to the testing device 1;

a message collection module (denoted as c 1) may be provided in advance in a link (referred to as link 1) in which the network device 22 sends a message to the network device 21, and the message collection module c1 may alternatively be a splitter or a hub. The message collection module c1 may grab the traffic 1 in the network, and then may send the traffic 1 to the testing device 1.

(3) The testing device 1 can analyze the flow 1 and create the same flow 1 to be issued to the target network equipment;

(4) After receiving the flow 1 sent by the testing device 1, the target network equipment sends the flow 12 to the testing device 2 through a mapping interface after local table entry processing;

the local table entry of the target network device may be set according to the local table entry of the network device 21, for example, the target network device is mapped with the network device 11 (such as the target network device interface GE 3/0/1 and the GE 4/0/1 of the network device 11), and the control plane table entry output interface corresponds to the mapped interface. The transmission interface selected by the target network device according to the local entry may be considered as a mapping interface for the network device 21.

(5) After receiving the flow 1, the network device 21 sends the flow 11 to the network device 23 through local entry processing;

(6) The message acquisition module c2 acquires the flow 11 and sends the acquired flow 11 to the testing device 2;

a message collection module (denoted as c 2) may be provided in advance in the link (called link 2) in which the network device 22 sends messages to the network device 23, and this message collection module c2 may alternatively be a splitter or a hub. The message collection module c2 may grab the traffic 11 in the network and then send the traffic 11 to the testing device 1.

The testing device 2 can compare and judge whether the processing behaviors of the target network device and the network device 11 on the traffic 1 are consistent by analyzing the traffic 11 and the traffic 12. If the test is consistent, the test is passed, and if the test is inconsistent, the failure cause can be analyzed.

Optionally, the analysis processing of the flow by the testing device 2 may be determined according to the target parameters of the message described above, and multiple comparison modes may be supported.

It should be noted that the test device 1 and the test device 2 in fig. 6-1 may be different test devices or different interfaces of the same test device.

In fig. 6-1, taking a manner that a message collection module deployed in a transmission channel is taken as an example to describe a manner that a test module obtains a message between a network device 21 and a network device 22 or a network device 23, the message collection module may also adopt other deployment manners, for example, referring to fig. 6-2, after step (1), the test device may perform traffic packet capturing and analysis on an input interface and an output interface of the network device 21, respectively. Then, referring to step (2) in fig. 6-2, after analyzing the incoming interface traffic 1, the testing device issues the incoming interface traffic 1 to the target network device through the testing device interface B after preprocessing, and referring to step (6) in fig. 6-2, the testing device analyzes the outgoing interface traffic 11. After receiving the traffic 1 from the interface B, the target network device refers to step (4) in fig. 6-2, and issues the processed traffic to the testing device through the testing device interface a. The test device compares the traffic 12 received by the interface a with the traffic 11 received by the network device 21, and the comparison process may refer to the corresponding content in the embodiment corresponding to fig. 6-1, which is not described herein.

According to the method and the device, the message is collected through accessing the current network environment (namely the target networking environment), and the intercommunication verification is completed in a mirror image and comparison mode.

Based on the corresponding embodiment of fig. 3, optionally, the first packet may include a plurality of packets, and the target network device is configured to perform an upgrade operation during processing of the plurality of packets, so as to detect whether the upgrade operation of the target network device has an effect on a target function of the target network device. Step 302 in the corresponding embodiment of fig. 3 may specifically include:

3021. the testing device sends a first sub-message in a plurality of messages to the target network equipment in the first stage;

3022. the testing device sends a second sub-message in the plurality of messages to the target network equipment in the second stage;

wherein the first stage and the second stage are any two different stages of the following plurality of stages: before the upgrade operation is performed, during the upgrade operation is performed, and after the upgrade operation is completed.

Optionally, step 302 may further include:

3023. the testing device sends a third sub-message of the plurality of messages to the target network device in a third stage.

The target network devices in the first, second, and third stages may correspond to before, during, and after the target network device performs the upgrade operation, respectively.

For example, assuming that the first network device in the target networking environment needs to be replaced by the target network device, in order to ensure that the target network device can correctly respond to the service of the target networking environment after being upgraded, the interoperability test method provided by the embodiment of the application can be executed before the target network device is upgraded to determine whether the target network device passes the interoperability test before being upgraded. Then, the interoperability test method can be executed again in the upgrading process of the target network equipment to determine whether the target network equipment passes the interoperability test in the upgrading process. After that, the interoperability test method can be executed again after the upgrading of the target network equipment is completed, so as to determine whether the target network equipment passes the interoperability test after the upgrading is completed. The interoperability test method may be any one of the interoperability test methods described in the embodiments of the present application. The testing device can compare the target functions before, during and after the upgrading of the target network equipment, and if the target functions are not different, the behavior during and after the upgrading can meet the requirement of the correct processing of the target networking environment (namely the current network service), and the current network service is not influenced.

The following beneficial effects of the embodiments of the present application can be seen from the above description:

1) The control message and/or flow message information among running devices is acquired through information acquisition on the current network environment and is used for test activities such as intercommunication, compatibility and performance, the consistency of the test environment and the current network field environment is ensured, and the evaluation result can more accurately meet the current network use environment.

2) The consistency between the current network message and the message captured by the local test environment is analyzed and compared by adopting the test device, so that the reliability of the test result is improved;

3) The testing device is used for supporting preprocessing of the current network message or flow and then issuing the current network message or flow to the target network equipment, and the sequence number, the interface index, the IP address, the route identification and the like of the preprocessed message are irrelevant to the correctness of the tested protocol (namely the target network protocol), so that the high efficiency and the flexibility of the testing are ensured. Similarly, the data preprocessing can be performed before the control message (or protocol message) and the flow message are compared and checked, so that the influence of the fields on the test result is removed, and the high efficiency and the flexibility of the test are ensured.

Having described the methods provided by the embodiments of the present application, the devices and apparatuses provided by the embodiments of the present application are described below.

FIG. 7 is a schematic diagram of a computing device according to an embodiment of the present application. Referring to fig. 7, the computing device 7 includes a processor 701, a memory 702.

The processor 701 may be one or more CPUs, which may be a single core CPU or a multi-core CPU.

The Memory 702 includes, but is not limited to, random access Memory (random access Memory, RAM), read Only Memory (ROM), erasable programmable Read only Memory (erasable programmable Read-only Memory, EPROM or flash Memory), flash Memory, or optical Memory, among others. Memory 1202 stores code for the operating system and program instructions.

Optionally, the computing device 7 further comprises a communication interface 703. The communication interface 703 may be a wired interface, such as a fiber optic distributed data interface (Fiber Distributed Data Interface, FDDI), gigabit Ethernet (GE) interface; the communication interface 703 may also be a wireless interface. The communication interface 703 is used to receive routing information from BGP neighbors.

Optionally, the network device 7 further comprises a bus 704, and the processor 701 and the memory 702 are typically connected to each other through the bus 704, but may be connected to each other in other manners.

Optionally, the processor 701 implements any one of the possible embodiments of the interoperability test method of the application by reading the program instructions stored in the memory 702, or the processor 701 may implement any one of the possible embodiments of the interoperability test method of the application by using the program instructions stored therein. For example, processor 701 may perform the corresponding embodiments of FIG. 3 or FIG. 4-1 or FIG. 4-2 or FIG. 5 or FIG. 6-1 or FIG. 6-2.

Referring to fig. 8, the embodiment of the present application further provides a testing apparatus 8, where the testing apparatus 8 may be applied to a target networking environment (for example, the networking environment shown in fig. 1 or fig. 2), where the target networking environment includes a first network device and a second network device that establish a communication connection, the second network device is used to send a packet to the first network device, and the first network device is used to process and send a packet from the second network device, and the testing apparatus 8 may include: an obtaining module 801, configured to obtain a first packet sent by a second network device to a first network device; a sending module 802, configured to send a first message to a target network device, where the target network device is configured to process and send the first message; the obtaining module 801 is further configured to obtain a second packet sent by the first network device and a third packet sent by the target network device; and the comparison module 803 is configured to compare whether the second message and the third message are consistent, and determine an interoperability test result between the first network device and the target network device according to the comparison result. Alternatively, the acquiring module 801 may be used to perform the

steps

301 and 303 in the embodiment corresponding to fig. 3, the transmitting module 802 may be used to perform the step 302 in the embodiment corresponding to fig. 3, and the comparing module 803 may be used to perform the step 304 in the embodiment corresponding to fig. 3. Alternatively, the acquiring module 801 may be used to perform steps (2), (5) and (6) in the embodiment corresponding to fig. 4-1, the transmitting module 802 may be used to perform step (3) in the embodiment corresponding to fig. 4-1, and the comparing module 803 may be used to perform the processing after step (6) in the embodiment corresponding to fig. 4-1. Alternatively, the obtaining module 801 may be used to perform steps (2), (5) and (6) in the embodiment corresponding to fig. 4-2, the sending module 802 may be used to perform step (3) in the embodiment corresponding to fig. 4-2, and the comparing module 803 may be used to perform the processing procedure after step (6) in the embodiment corresponding to fig. 4-2. Alternatively, the obtaining module 801 may be configured to perform steps (2), (4), (6), (8), (10) and (12) in the embodiment corresponding to fig. 5, the sending module 802 may be configured to perform steps (3) and (9) in the embodiment corresponding to fig. 5, and the comparing module 803 may be configured to perform the processing procedure after step (6) and/or step (12) in the embodiment corresponding to fig. 5. Alternatively, the acquiring module 801 may be used to perform steps (2), (4) and (6) in the embodiment corresponding to fig. 6-1, the transmitting module 802 may be used to perform step (3) in the embodiment corresponding to fig. 6-1, and the comparing module 803 may be used to perform the processing after step (6) in the embodiment corresponding to fig. 6-1. Alternatively, the acquiring module 801 may be used to perform steps (2), (4) and (6) in the embodiment corresponding to fig. 6-2, the transmitting module 802 may be used to perform step (3) in the embodiment corresponding to fig. 6-2, and the comparing module 803 may be used to perform the processing procedure after step (6) in the embodiment corresponding to fig. 6-2. Reference is made to the detailed description of the corresponding steps in the above method embodiments for specific execution, and details are not repeated here.

The coupling in the embodiments of the present application is an indirect coupling or communication connection between devices, units, or modules, which may be in electrical, mechanical, or other forms for information interaction between the devices, units, or modules. The embodiment of the apparatus depicted in fig. 8 is merely illustrative. The modules in fig. 8 may be implemented in hardware or in software functional units.

For more details on the technical effects that the computing device shown in fig. 7 and the testing apparatus shown in fig. 8 can achieve, and the implementation of the above functions by each module, reference should be made to the corresponding descriptions in the foregoing method embodiments, which are not repeated here.

The above-described embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof, and when implemented in software, may be implemented in whole or in part in the form of a computer program product.

The computer program product includes one or more computer instructions. When the computer-executable instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be stored by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a Solid State Disk (SSD)), or the like.

In the embodiments of the present application, at least one refers to one or more, and a plurality refers to two or more, which is not limited in the present application. In the embodiment of the present application, "/" may indicate that the associated object is an "or" relationship, for example, a/B may indicate a or B; "and/or" may be used to describe that there are three relationships associated with an object, e.g., a and/or B, which may represent: there are three cases, a alone, a and B together, and B alone, wherein a, B may be singular or plural. In order to facilitate description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second", etc. may be used to distinguish between technical features that are the same or similar in function. The terms "first," "second," and the like do not necessarily denote any order of quantity or order of execution, nor do the terms "first," "second," and the like. In this application embodiment, the terms "exemplary" or "such as" and the like are used to denote examples, illustrations, or descriptions, and any embodiment or design described as "exemplary" or "such as" should not be construed as preferred or advantageous over other embodiments or designs. The use of the word "exemplary" or "such as" is intended to present the relevant concepts in a concrete fashion to facilitate understanding.

In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.

Those of ordinary skill in the art will appreciate that, when implemented in software, aspects of the embodiments of the present application, or possible implementations of aspects, the various aspects, or possible implementations of aspects, may be implemented, in whole or in part, in the form of a computer program product. Computer program product refers to computer readable instructions stored in a computer readable medium. When the computer instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present application are produced in whole or in part.

The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer-readable storage medium includes, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Such as random access Memory (Random Access Memory, RAM), read Only Memory (ROM), erasable programmable read Only Memory (Erasable Programmable Read Only Memory, EPROM), or portable read Only Memory (Compact Disc Read-Only Memory, CD-ROM).

It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the scope of the invention. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present invention, the present invention is intended to include such modifications and variations as well.

Claims

1. The method for testing the interoperability of the network equipment is characterized by being applied to a target networking environment, wherein the target networking environment comprises a first network equipment and a second network equipment which are connected with each other in a communication mode, the second network equipment is used for sending messages to the first network equipment, and the first network equipment is used for processing and sending the messages from the second network equipment, and the method comprises the following steps:

the testing device obtains a first message sent by the second network device to the first network device;

the testing device sends the first message to target network equipment, and the target network equipment is configured to process and send the first message;

the testing device respectively acquires a second message sent by the first network device and a third message sent by the target network device;

the testing device compares whether the second message is consistent with the third message, and determines an interoperability test result between the first network device and the target network device according to the comparison result.

2. The method of claim 1, wherein the first network device is configured to process and send the message from the second network device according to a target network protocol, the target network protocol comprising a control plane protocol;

the first message is a protocol message encapsulated according to the target network protocol, and the target network device is configured to process and send the first message according to the target network protocol.

3. The method of claim 2, wherein the testing device comparing whether the second message and the third message are identical comprises:

the test device compares whether a target field in the second message and a target field in the third message are consistent, wherein the target field corresponds to the control plane protocol.

4. A method according to claim 3, wherein the target field does not include a physical address.

5. The method of claim 1, wherein the first network device is configured to perform network flow based processing on the packets from the second network device;

the first message is a user message, and the target network device is configured to perform network flow-based processing on the first message.

6. The method of claim 4, wherein the testing means for comparing whether the second message and the third message are identical comprises:

the test device compares whether the value of the statistical parameter of the second message is the same as the value of the statistical parameter of the third message.

7. The method according to claim 5 or 6, wherein the testing means comparing whether the second message and the third message are identical comprises:

and the testing device compares whether the forwarding path of the second message is consistent with the forwarding path of the third message.

8. The method according to any one of claims 5 to 7, wherein the testing means comparing whether the second message and the third message are identical comprises:

and the testing device compares whether the flow identifier of the second message is consistent with the flow identifier of the third message.

9. The method according to any one of claims 1 to 8, wherein if the second message and the third message are identical, the interoperability test result indicates that the target network device is available to replace the first network device in the target networking environment for processing and sending the message from the second network device.

10. The method according to any one of claims 1 to 9, wherein before the testing device sends the first message to the target network device, the method further comprises:

the testing device acquires mapping information between the first network equipment and the target network equipment, and the mapping information records the corresponding relation between the identification of the first network equipment and the identification of the target network equipment;

the testing device modifies the identification of the first network device in the first message into the identification of the target network device according to the mapping information.

11. The method according to any one of claims 1 to 10, wherein the testing means obtaining a first message sent by the second network device to the first network device comprises:

the testing device acquires the first message through a message acquisition module, wherein the message acquisition module is arranged in a transmission channel between the first network device and the second network device, or the message acquisition module is arranged in the first network device.

12. The method according to any one of claims 1 to 11, wherein the first message comprises a plurality of messages, and the target network device is configured to perform an upgrade operation during processing of the plurality of messages;

The test device sends the first message to a target network device, including:

the testing device sends a first sub-message in the plurality of messages to the target network equipment in a first stage;

the testing device sends a second sub-message in the plurality of messages to the target network equipment in a second stage;

wherein the first stage and the second stage are any two different stages of the following plurality of stages:

before the upgrade operation is performed, during the upgrade operation is performed, and after the upgrade operation is completed.

13. A test apparatus, applied to a target networking environment, where the target networking environment includes a first network device and a second network device that establish a communication connection, the second network device is configured to send a message to the first network device, and the first network device is configured to process and send a message from the second network device, the test apparatus includes:

the acquisition module is used for acquiring a first message sent by the second network equipment to the first network equipment;

a sending module, configured to send the first message to a target network device, where the target network device is configured to process and send the first message;

The acquisition module is further configured to acquire a second packet sent by the first network device and a third packet sent by the target network device;

and the comparison module is used for comparing whether the second message is consistent with the third message or not and determining an interoperability test result between the first network equipment and the target network equipment according to a comparison result.