CN109361603B - Method and system for dynamically adjusting equivalent path flow based on programmable switching chip - Google Patents

Method and system for dynamically adjusting equivalent path flow based on programmable switching chip Download PDF

Info

Publication number
CN109361603B
CN109361603B CN201811416729.1A CN201811416729A CN109361603B CN 109361603 B CN109361603 B CN 109361603B CN 201811416729 A CN201811416729 A CN 201811416729A CN 109361603 B CN109361603 B CN 109361603B
Authority
CN
China
Prior art keywords
path
bandwidth
data stream
equivalent
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811416729.1A
Other languages
Chinese (zh)
Other versions
CN109361603A (en
Inventor
刘绍洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Cisco Networking Technology Co Ltd
Original Assignee
Inspur Cisco Networking Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Cisco Networking Technology Co Ltd filed Critical Inspur Cisco Networking Technology Co Ltd
Priority to CN201811416729.1A priority Critical patent/CN109361603B/en
Publication of CN109361603A publication Critical patent/CN109361603A/en
Application granted granted Critical
Publication of CN109361603B publication Critical patent/CN109361603B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/14Routing performance; Theoretical aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/22Alternate routing

Abstract

The embodiment of the invention discloses a method and a system for dynamically adjusting equivalent path flow based on a programmable switching chip, wherein the method comprises the steps of monitoring and collecting bandwidth information of each equivalent path in each forwarding group; calculating the residual bandwidth of each path according to the bandwidth information, determining the data stream to be migrated and the migration mode, and forming a policy route; and migrating the data flow needing to be migrated among the equivalent paths according to the policy routing. The invention is based on the programmable switching chip, checks and analyzes the flow of the equivalent multipath of the switch in real time, dynamically adjusts the multipath flow according to the current flow situation, uniformly distributes the flow on the multipath to each equivalent path, and improves the bandwidth utilization rate of the switch under the condition of the equivalent multipath.

Description

Method and system for dynamically adjusting equivalent path flow based on programmable switching chip
Technical Field
The invention relates to the technical field of computer communication, in particular to a method and a system for dynamically adjusting equivalent path flow based on a programmable switching chip.
Background
With the rapid development of cloud computing, internet of things and internet industry, the internal flow of a large-scale data center is rapidly increased. Data centers have been rapidly developed in recent years, and many large organizations and companies build numerous data centers, and transfer their computing, storage and cloud services to the data centers, from common applications to scientific computing to network searching and social networking, these applications require a large amount of network bandwidth between cabinets, and with the large scale expansion of the data centers and their applications, great challenges are created to the carrying capacity of the network.
Related applications of cloud computing make protocol and architecture involvement of networks difficult due to the several characteristics described above. 1. The network load of the data center is sudden and difficult to measure, and the original static resource allocation cannot fully meet the requirement due to the variable application requirement; 2. customers need their software to run on commercial systems, which, when the size of applications increases dramatically, results in the data center network size also having to be enlarged, while increasing bandwidth, and need to maintain the compatibility requirements of the software or protocol; 3. the data center is built on a large-scale two-layer network, the expansion of the large two-layer network is realized by utilizing multipath, a spanning tree is eliminated, the flow convergence is reduced, the bandwidth utilization rate is improved, and the bottleneck of insufficient network resource distribution of the data center is faced. Therefore, the number of end-to-end equivalent multilinks is introduced, the redundancy of the data center network is increased, but the same troubles are brought, the congestion of one link can rapidly deteriorate the performance of the whole network, and the load balance of providing bottleneck links becomes the difficult point and the research focus of the data center.
The existing equal cost multi-path protocol is usually based on static hash of flow by flow, and when a switch forwards a data flow, a path is selected from equal cost multi-paths for forwarding according to a fixed algorithm. Generally, according to a HASH algorithm, when a data stream is forwarded, a path is calculated according to a five-tuple HASH of the data stream, and the data stream is forwarded on the path.
Therefore, the static machine maps the flow into the link, and the utilization condition of the network at that time is not considered, so that the flow excessively occupies the hot link, thereby reducing the exchange and forwarding efficiency of the whole network.
Disclosure of Invention
The embodiment of the invention provides a method and a system for dynamically adjusting equivalent path flow based on a programmable switching chip, which aim to solve the problem of low switching and forwarding efficiency of the whole network of a data center in the prior art.
In order to solve the technical problem, the embodiment of the invention discloses the following technical scheme:
the first aspect of the present invention provides a method for dynamically adjusting equal-cost path traffic based on a programmable switching chip, where the method includes:
monitoring and collecting bandwidth information of each equivalent path in each forwarding group;
calculating the residual bandwidth of each path according to the bandwidth information, determining the data stream to be migrated and the migration mode, and forming a policy route;
and migrating the data flow needing to be migrated among the equivalent paths according to the policy routing.
With reference to the first aspect, in a first possible implementation manner of the first aspect, the bandwidth information includes a total bandwidth, an occupied bandwidth, quintuple information of the TOPN data flow set, and a bandwidth occupied by the TOPN data flow of each equal cost path.
With reference to the first aspect, in a second possible implementation manner of the first aspect, the specific process of determining a data flow to be migrated and a migration manner and forming a policy routing is:
screening out a path B with the least residual bandwidth and a path A with the most residual bandwidth, comparing the difference value of the residual bandwidths of the path B and the path A, and selecting a data stream in the path B to migrate to the path A when the difference value is larger than a threshold value;
and repeating the operation of the previous step, and stopping the migration of the data stream when the difference value of the residual bandwidths of the at most two equivalent paths and the at least two equivalent paths is not greater than the threshold value.
With reference to the first aspect, in a second possible implementation manner of the first aspect, when the difference is greater than the threshold, a specific process of selecting one data stream in B to migrate to a is as follows:
screening the bandwidth of the TOPN data flow in the path B according to the bandwidth information;
and comparing the bandwidth of the TOPN data stream, and selecting a data stream except the maximum bandwidth for migration.
The second aspect of the present invention provides a system for dynamically adjusting equal-cost path traffic based on a programmable switching chip, the system comprising:
the real-time monitoring unit is used for monitoring the bandwidth information of the equivalent path of the switch and reporting the bandwidth information to the path calculation control unit;
the path calculation control unit is used for calculating the residual bandwidth of each path according to the bandwidth information, determining the data stream and the migration mode to be transferred, forming a strategy route and issuing the strategy route to the forwarding control unit;
and the forwarding control unit migrates the data stream to be migrated among the equivalent paths according to the five-tuple HASH algorithm and the policy routing.
With reference to the second aspect, in a first possible implementation manner of the second aspect, the real-time monitoring unit includes N1 equal cost multi-path monitoring groups, and each equal cost multi-path monitoring group includes N2 monitoring paths.
With reference to the second aspect, in a second possible implementation manner of the second aspect, the path calculation control unit includes
The information acquisition module is used for screening out a path B with the minimum residual bandwidth and a path A with the maximum residual bandwidth;
and the comparison processing module is used for comparing the difference value of the screened residual bandwidths of the two paths, and selecting one data stream in the B to be migrated to the A when the difference value is larger than a threshold value.
With reference to the second aspect, in a second possible implementation manner of the second aspect, the comparison processing module further includes
The information processing submodule screens the bandwidth of the TOPN data flow in the path B according to the bandwidth information;
and the information comparison submodule is used for comparing the bandwidth size of the TOPN data stream and selecting a data stream except the maximum bandwidth for migration.
The system according to the second aspect of the present invention is capable of implementing the methods according to the first aspect and the respective implementation manners of the first aspect, and achieves the same effects.
The effect provided in the summary of the invention is only the effect of the embodiment, not all the effects of the invention, and one of the above technical solutions has the following advantages or beneficial effects:
1. the invention is based on the programmable switching chip, checks and analyzes the flow of the equivalent multipath of the switch in real time, dynamically adjusts the multipath flow according to the current flow situation, uniformly distributes the flow on the multipath to each equivalent path, and improves the bandwidth utilization rate of the switch under the condition of the equivalent multipath.
2. The data streams in the equivalent paths with the most and least residual bandwidths are selected for migration by calculating and analyzing the collected bandwidth information of each path, and when the migration data streams are selected, a data stream except the maximum bandwidth is selected for migration, so that the migration times of the data streams are reduced, and the data transmission safety is guaranteed.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
FIG. 1 is a schematic flow diagram of the process of the present invention;
FIG. 2 is a schematic flow diagram of an embodiment of the method of the present invention;
FIG. 3 is a schematic diagram of the system of the present invention;
FIG. 4 is a schematic diagram of bandwidth and traffic distribution before the method of the present invention is used;
fig. 5 is a schematic diagram of the distribution of bandwidth and traffic after the method of the present invention is used.
Detailed Description
In order to clearly explain the technical features of the present invention, the following detailed description of the present invention is provided with reference to the accompanying drawings. The following disclosure provides many different embodiments, or examples, for implementing different features of the invention. To simplify the disclosure of the present invention, the components and arrangements of specific examples are described below. Furthermore, the present invention may repeat reference numerals and/or letters in the various examples. This repetition is for the purpose of simplicity and clarity and does not in itself dictate a relationship between the various embodiments and/or configurations discussed. It should be noted that the components illustrated in the figures are not necessarily drawn to scale. Descriptions of well-known components and processing techniques and procedures are omitted so as to not unnecessarily limit the invention.
As shown in fig. 1, the method for dynamically adjusting the equal-cost path traffic based on the programmable switching chip of the present invention includes the following steps:
s1, monitoring and collecting the bandwidth information of each equivalent path in each forwarding group;
s2, calculating the residual bandwidth of each path according to the bandwidth information, determining the data flow and the migration mode to be migrated, and forming a strategy route;
and S3, migrating the data flow to be migrated among the equal cost paths according to the policy routing.
As shown in fig. 2, when a packet needs to be forwarded, a fixed five-tuple HASH algorithm is preferentially adopted to calculate a forwarding path, and meanwhile, bandwidth information of each equivalent path of the switch is monitored in real time, and the unit is mbp. The bandwidth information includes: { multipath group, path 1: total bandwidth, occupied bandwidth, quintuple information of TOPN data flow and occupied bandwidth information; route 2: total bandwidth, occupied bandwidth, TOPN flow quintuple information and occupied bandwidth information … … path N: total bandwidth, occupied bandwidth; quintuple information and occupied bandwidth information of the TOPN data stream }. The TOPN is the first N data stream bandwidths from large to small, and the TOPN is set by self and can be used for identifying larger data.
According to the bandwidth information, subtracting the occupied bandwidth from the total bandwidth of each equal cost path to obtain the residual bandwidth of the equal cost path; and screening the path B with the least residual bandwidth and the path A with the most residual bandwidth, comparing the difference value of the residual bandwidths of the path B and the path A, and selecting one data stream in the path B to be migrated to the path A when the difference value is larger than a threshold value. Selecting the data stream migrated in the step B specifically as follows: screening out the bandwidth of the TOPN data flow in the path B; and comparing the bandwidth of the TOPN data stream, and selecting a data stream except the maximum bandwidth for migration. And repeatedly monitoring and collecting the bandwidth information of each equivalent path in each forwarding group, carrying out data stream migration, and finishing the migration when the difference value of the two equivalent paths with the largest and the smallest residual bandwidths is less than or equal to a threshold value.
As shown in fig. 3, the system for dynamically adjusting equal-cost path traffic based on a programmable switching chip of the present invention includes a real-time monitoring unit 1, a path computation control unit 2, and a forwarding control unit 3.
The real-time monitoring unit 1 is used for monitoring the bandwidth information of the equivalent path of the switch and reporting the bandwidth information to the path calculation control unit; the path calculation control unit 2 is used for calculating the residual bandwidth of each path according to the bandwidth information, determining the data stream and the migration mode to be transferred, forming a policy route and issuing the policy route to the forwarding control unit; and the forwarding control unit 3 migrates the data stream to be migrated among the equivalent paths according to the five-tuple HASH algorithm and the policy routing.
The real-time monitoring unit 1 comprises N1 equal cost multi-path monitoring groups, each of which comprises N2 monitoring paths. N1 is determined by the specification of the programmable switching chip selected, such as 512 groups of 8096 chips in the department of pedigree and 1024 groups of Barefoot chips. N2, depending on the actual configuration, the total does not exceed the specification of the switch chip, which is typically 8, 16, 32. The total number of the paths monitored by the real-time monitoring unit is N1 × N2, the real-time monitoring unit periodically monitors the equivalent paths, and reports the monitoring results to the path calculation control unit.
The path calculation control unit comprises an information acquisition module and a comparison processing module. The information acquisition module is used for screening out a path B with the minimum residual bandwidth and a path A with the maximum residual bandwidth; and the comparison processing module is used for comparing the difference value of the screened residual bandwidths of the two paths, and selecting one data stream in the B to be migrated to the A when the difference value is larger than a threshold value. The comparison processing module also comprises an information processing submodule and an information comparison submodule. The information processing submodule screens the bandwidth of the TOPN data flow in the path B according to the bandwidth information; and the information comparison submodule is used for comparing the bandwidth size of the TOPN data stream and selecting a data stream except the maximum bandwidth for migration.
As shown in fig. 4 and 5, the effects of the present invention will be further described.
Assuming that the total bandwidth of path 1, path 2 and path 3 is the same, the threshold is set to 100M. As shown in fig. 4, path 3 has a larger bandwidth occupation, while path 1 and path 2 have a smaller bandwidth occupation. According to the method, a path 1 with the most residual bandwidth and a path 3 with the least residual bandwidth are screened out through calculation and analysis, the bandwidth of a data Flow3 in the path 3 is 300M at most, and the data Flow 2200M is selected to be migrated into the path 1; at this time, the bandwidth usage of the path 1, the path 2 and the path 3 is respectively 300M, 300M and 700M, calculation and analysis are performed again, the path 1 (the path 2) with the most residual bandwidth and the path 3 with the least residual bandwidth are screened out, the bandwidth of the data Flow3 in the path 3 is 300M at most, and the data Flow 1100M is selected and migrated to the path 1; at this time, the bandwidth usage of the path 1, the path 2 and the path 3 is 400M, 300M and 600M, respectively, the calculation analysis is performed again, the path 2 with the largest residual bandwidth and the path 3 with the smallest residual bandwidth are screened out, and the data Flow 4100M is selected and migrated to the path 2. As shown in fig. 5, at this time, the bandwidth usage of path 1, path 2, and path 3 is 400M, and 500M, respectively, and the migration is stopped when the threshold condition is satisfied. The data flows within the boxes in fig. 5 represent data flows migrated from path 3.
The foregoing is only a preferred embodiment of the present invention, and it will be apparent to those skilled in the art that various modifications and improvements can be made without departing from the principle of the invention, and such modifications and improvements are also considered to be within the scope of the invention.

Claims (6)

1. The method for dynamically adjusting the equivalent path flow based on the programmable switching chip is characterized by comprising the following steps:
monitoring and collecting bandwidth information of each equivalent path in each forwarding group;
calculating the residual bandwidth of each path according to the bandwidth information, determining the data stream to be migrated and the migration mode, and forming a policy route;
migrating the data flow to be migrated among the equal cost paths according to the strategy route;
the specific process of determining the data stream to be migrated and the migration mode and forming the policy routing is as follows:
screening out a path B with the least residual bandwidth and a path A with the most residual bandwidth, comparing the difference value of the residual bandwidths of the path B and the path A, and selecting a data stream in the path B to migrate to the path A when the difference value is larger than a threshold value;
and repeating the operation of the previous step, and stopping the migration of the data stream when the difference value of the residual bandwidths of the at most two equivalent paths and the at least two equivalent paths is not greater than the threshold value.
2. The method of claim 1, wherein the bandwidth information comprises total bandwidth, occupied bandwidth, quintuple information of TOPN data flow set and occupied bandwidth of TOPN data flow of each equal cost path.
3. The method according to claim 1, wherein when the difference is greater than the threshold, the specific process of selecting one data stream in B to migrate to a is as follows:
screening the bandwidth of the TOPN data flow in the path B according to the bandwidth information;
and comparing the bandwidth of the TOPN data stream, and selecting a data stream except the maximum bandwidth for migration.
4. The system for dynamically adjusting the equivalent path flow based on the programmable switching chip is characterized by comprising:
the real-time monitoring unit is used for monitoring the bandwidth information of the equivalent path of the switch and reporting the bandwidth information to the path calculation control unit;
the path calculation control unit is used for calculating the residual bandwidth of each path according to the bandwidth information, determining the data stream and the migration mode to be transferred, forming a strategy route and issuing the strategy route to the forwarding control unit;
the forwarding control unit is used for migrating the data stream to be migrated among the equivalent paths according to the five-tuple HASH algorithm and the strategy route;
the path calculation control unit includes
The information acquisition module is used for screening out a path B with the minimum residual bandwidth and a path A with the maximum residual bandwidth;
and the comparison processing module is used for comparing the difference value of the screened residual bandwidths of the two paths, and selecting one data stream in the B to be migrated to the A when the difference value is larger than a threshold value.
5. The system according to claim 4, wherein the real-time monitoring unit comprises N1 equal cost multi-path monitoring groups, each equal cost multi-path monitoring group comprising N2 monitoring paths.
6. The system according to claim 4, wherein the comparison module further comprises
The information processing submodule screens the bandwidth of the TOPN data flow in the path B according to the bandwidth information;
and the information comparison submodule is used for comparing the bandwidth size of the TOPN data stream and selecting a data stream except the maximum bandwidth for migration.
CN201811416729.1A 2018-11-26 2018-11-26 Method and system for dynamically adjusting equivalent path flow based on programmable switching chip Active CN109361603B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811416729.1A CN109361603B (en) 2018-11-26 2018-11-26 Method and system for dynamically adjusting equivalent path flow based on programmable switching chip

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811416729.1A CN109361603B (en) 2018-11-26 2018-11-26 Method and system for dynamically adjusting equivalent path flow based on programmable switching chip

Publications (2)

Publication Number Publication Date
CN109361603A CN109361603A (en) 2019-02-19
CN109361603B true CN109361603B (en) 2021-03-23

Family

ID=65338906

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811416729.1A Active CN109361603B (en) 2018-11-26 2018-11-26 Method and system for dynamically adjusting equivalent path flow based on programmable switching chip

Country Status (1)

Country Link
CN (1) CN109361603B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110417674B (en) * 2019-07-26 2022-06-21 新华三技术有限公司合肥分公司 Data traffic sharing method and device
CN117579543B (en) * 2024-01-16 2024-04-05 苏州元脑智能科技有限公司 Data stream segmentation method, device, equipment and computer readable storage medium

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107852519A (en) * 2015-07-07 2018-03-27 三星电子株式会社 Method and apparatus for providing Video service in a communications system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102710489B (en) * 2011-03-28 2015-07-29 日电(中国)有限公司 Dynamic shunt dispatching patcher and method
US9538439B2 (en) * 2013-05-10 2017-01-03 Qualcomm Incorporated Method and apparatus for estimating an achievable link throughput based on assistance information
CN103607358B (en) * 2013-11-29 2017-01-11 哈尔滨工业大学深圳研究生院 Dynamic ECMP method and system based on link utilization rate average sum
US9467384B2 (en) * 2013-12-05 2016-10-11 Mediatek Singapore Pte. Ltd. Packet forwarding apparatus and method using flow subgroup based path selection for dynamic load balancing
US10129043B2 (en) * 2015-11-04 2018-11-13 Huawei Technologies Canada Co., Ltd. Apparatus and method for network flow scheduling
CN106533939B (en) * 2016-11-25 2019-07-16 北京邮电大学 A kind of wide dynamic adjusting method of software definition soft exchange convergence mesh belt and device
CN108055203B (en) * 2017-12-26 2020-10-02 杭州迪普科技股份有限公司 Equivalent routing load sharing method and device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107852519A (en) * 2015-07-07 2018-03-27 三星电子株式会社 Method and apparatus for providing Video service in a communications system

Also Published As

Publication number Publication date
CN109361603A (en) 2019-02-19

Similar Documents

Publication Publication Date Title
JP7417825B2 (en) slice-based routing
CN107770096B (en) SDN/NFV network dynamic resource allocation method based on load balancing
CN105379196B (en) Method, system and computer storage medium for the routing of fault-tolerant and load balance
CN107579922B (en) Network load balancing device and method
CN110768837A (en) Network slice virtual resource allocation method, system and device
CN102710489A (en) Dynamic flow division scheduling system and method
CN101127689B (en) Method for minimizing priority seizing cost
CN108476175B (en) Transfer SDN traffic engineering method and system using dual variables
CN109327401B (en) Flow scheduling method and system of SDN (software defined network)
CN109361603B (en) Method and system for dynamically adjusting equivalent path flow based on programmable switching chip
JP5364183B2 (en) Network resource management device
CN105357124A (en) MapReduce bandwidth optimization method
CN114095075B (en) Optical network fault recovery method based on service customization demand perception
CN108923961B (en) Multi-entry network service function chain optimization method
CN112822233B (en) Traffic redirection method and device
KR20220024853A (en) Apparatus and method for improving load balancing with constrained forwarding rules in software-defined networks
U-chupala et al. Application-aware network: Network route management using SDN based on application characteristics
He et al. Hidden Markov Model-based Load Balancing in Data Center Networks
CN114938327A (en) Routing method, routing device, controller and computer readable storage medium
Szymanski Low latency energy efficient communications in global-scale cloud computing systems
Liu et al. An adaptive failure recovery mechanism based on asymmetric routing for data center networks
CN102668470B (en) Method and allocation unit for allocating a communication pipe in a communication network
Levi et al. Avoiding bottlenecks in networks by short paths
Stepanov et al. On bandwidth on demand problem
Chen et al. On the benefits of multipath routing for distributed data-intensive applications with high bandwidth requirements and multidomain reach

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant