CN111865812B - SDN-supported high-performance service mixed transmission method in distributed network - Google Patents
SDN-supported high-performance service mixed transmission method in distributed network Download PDFInfo
- Publication number
- CN111865812B CN111865812B CN202010641715.0A CN202010641715A CN111865812B CN 111865812 B CN111865812 B CN 111865812B CN 202010641715 A CN202010641715 A CN 202010641715A CN 111865812 B CN111865812 B CN 111865812B
- Authority
- CN
- China
- Prior art keywords
- tcp
- flow
- forwarding
- sdn
- queue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/11—Identifying congestion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/163—In-band adaptation of TCP data exchange; In-band control procedures
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate
Abstract
The invention relates to a distributed network, in particular to a method for supporting high-performance service mixed transmission by an SDN in the distributed network. The method comprises the following steps: 101. the switch analyzes the message, obtains information of IPDA, IPSA, IP protocol number, TCP/UDP protocol and the like in an analysis module, and carries the message information obtained by analysis to the SDN controller; the SDN controller distinguishes TCP flow and RoCEv2 flow according to the IP protocol number and the TCP/UDP protocol obtained through analysis, and executes EFD elephant flow detection processing on the TCP flow; 103. in a scheduling module of the SDN controller, a forwarding module puts TCP elephant flow into a best effort forwarding queue according to an EFD elephant flow detection result, puts TCP mouse flow into a bandwidth guarantee queue, and puts RoCEv2 flow into a low delay queue; 104. according to the global management of the SDN controller, the forwarding processing in the outgoing direction of the switch is mainly to finish the next hop editing of the message and the forwarding at the exit end. And uniformly managing and scheduling the traffic by using the SDN controller, so as to realize mixed running of RDMA (remote direct memory Access) traffic and TCP (Transmission control protocol) traffic.
Description
Technical Field
The invention relates to a distributed network, in particular to a method for supporting high-performance service mixed transmission by an SDN in the distributed network.
Background
In a distributed network scenario, there are multiple service flows, SDN first solves the connectivity problem, and guarantees performance through model identification and dynamic management in a scenario where UDP flows including RDMA and traditional TCP flows run in a mixed manner. In a modified scenario, the RDMA network needs to meet the requirement of high performance service, and meanwhile, in order to provide compatibility with the traditional existing service, the TCP network forwarding capability needs to be provided. Under complex distributed service mixed deployment, the method also brings challenges to the performance of the edge RDMA network, and especially when congestion occurs, the method has great influence on the performance and the delay of the network. Compared with the TCP, the RDMA RoCEv2 flow packet loss and congestion influence is larger than that of the TCP, so that multiple means are required to ensure the network forwarding performance of the RDMA in a distributed network forwarding module. When mixed running of RMDA traffic and TCP traffic occurs in a conventional storage network, the traffic is generally configured to different ports by using adapter cards, and global management and scheduling of an SDN controller are lacked. Therefore, the adoption of the adapter card has great limitation, high cost and no flexibility, and the fixed configuration is only suitable for the scene of single core computer room service.
Therefore, a method for supporting high-performance service mixed transmission by an SDN in a distributed network is provided.
Disclosure of Invention
The invention aims to provide a method for supporting high-performance service mixed transmission by an SDN in a distributed network, which ensures that the bandwidth of RoCEv2 is not maliciously preempted when RDMA (remote direct memory Access) flow and TCP (transmission control protocol) flow are mixed by the whole network control management scheduling of the SDN, and puts TCP elephant flow into a non-guaranteed forwarding queue through EFD (extended edge discovery) detection. Putting the TCP mouse flow into a bandwidth guarantee queue; by dynamically managing switch resources through the SDN, under a distributed network congestion scene, the consumption of TCP flow on Buffer cache of distributed network equipment is larger, impact is easily caused on RDMA forwarding queue cache, the congestion degree of RDMA is aggravated, and the forwarding performance is influenced. And aiming at the queues distributed by elephant flow detection, a self-defined ECN congestion marking algorithm is adopted. Compared with the RDMA flow, the ECN marking which is more aggressive to the TCP elephant flow is realized under the same queue congestion degree, the TCP elephant flow is reduced more quickly, and the RDMA forwarding performance under the congestion condition is guaranteed.
In order to achieve the purpose, the invention provides the following technical scheme: a method for supporting high-performance service mixed transmission by an SDN in a distributed network comprises the steps that through distributed management and resource scheduling of the SDN, firstly, network access of TCP (transmission control protocol) services can be provided through a forwarding module, and meanwhile, the access requirement of edge RDMA (remote direct memory access) services can be met; and secondly, aiming at the characteristics of TCP and RDMA network flow, different queues are distributed, and each queue can adopt a flexible ECN congestion marking algorithm to ensure the high-performance conversion of the RDMA flow under the mixed running scene of the RDMA and TCP services.
The method for supporting the mixed transmission of the high-performance service in the SDN in the distributed network comprises the following steps:
101. the switch analyzes the message, acquires information such as IPDA, IPSA, IP protocol number, TCP/UDP protocol and the like in an analysis module, and carries the information of the message acquired by analysis to the SDN controller;
the SDN controller distinguishes TCP flow and RoCEv2 flow according to the IP protocol number and the TCP/UDP protocol obtained through analysis, and EFD elephant flow detection processing is carried out on the TCP flow;
103. in a scheduling module of the SDN controller, a forwarding module puts TCP elephant flow into a best effort forwarding queue according to an EFD elephant flow detection result, puts TCP mouse flow into a bandwidth guarantee queue, and puts RoCEv2 flow into a low delay queue;
104. according to the global management of the SDN controller, the forwarding processing in the outgoing direction of the switch is mainly completed by editing the next hop of the message and forwarding at the exit end.
Further, in the method, when the EFD elephant flow detection processing module is used, whether the TCP elephant flow exists is judged according to the message length and statistics of the TCP service data flow and the data flow life cycle length, and the EFD elephant flow detection result is carried to a subsequent queue distribution processing flow.
Furthermore, in the method, different ECN congestion marking algorithms are adopted when queue congestion occurs for various queues and service data flows, and a more aggressive ECN congestion marking algorithm is adopted for a best-effort forwarding queue distributed by a TCP elephant flow, so that the TCP elephant flow is decelerated more quickly, and the influence of congestion on the RoCEv2 flow forwarding performance is reduced.
Further, the SDN controller places critical traffic into a relatively low-latency queue.
Compared with the prior art, the invention has the beneficial effects that:
in a distributed network, the SDN controller is used for carrying out unified management and scheduling on traffic, the method is suitable for complex distributed networking, low-delay RMDA traffic exchange can be realized, the traffic is not only stored, the traffic is identified by using the network forwarding module, high priority of RDMA traffic is ensured, elephant traffic in TCP traffic can be identified, buffer cache is prevented from being excessively consumed, and the SDN controller-based RDMA and TCP traffic mixed running is more advantageous in cost.
Drawings
FIG. 1 is a schematic diagram of the ECN congestion marking algorithm of the present invention;
fig. 2 is a schematic diagram of a more aggressive ECN marking algorithm of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1 to 2, the present invention provides a technical solution: the method for supporting the mixed transmission of the high-performance service by the SDN in the distributed network comprises the steps that firstly, network access of TCP (transmission control protocol) service can be provided through a forwarding module through distributed management and resource scheduling of the SDN, and meanwhile, the access requirement of edge RDMA (remote direct memory access) service can be met; and secondly, aiming at the characteristics of TCP and RDMA network flow, different queues are distributed, and each queue can adopt a flexible ECN congestion marking algorithm to ensure the high-performance conversion of the RDMA flow under the mixed running scene of the RDMA and TCP services. The method for supporting the mixed transmission of the high-performance service in the SDN in the distributed network comprises the following steps:
101. the switch analyzes the message, obtains information of IPDA, IPSA, IP protocol number, TCP/UDP protocol and the like in an analysis module, and carries the message information obtained by analysis to the SDN controller;
the SDN controller distinguishes TCP flow and RoCEv2 flow according to the IP protocol number and the TCP/UDP protocol obtained through analysis, and executes EFD elephant flow detection processing on the TCP flow;
103. in a scheduling module of the SDN controller, a forwarding module puts TCP elephant flow into a best effort forwarding queue according to an EFD elephant flow detection result, puts TCP mouse flow into a bandwidth guarantee queue, and puts RoCEv2 flow into a low delay queue;
104. according to the global management of the SDN controller, the forwarding processing in the outgoing direction of the switch is mainly completed by editing the next hop of the message and forwarding at the exit end.
Further, in the method, when the EFD elephant flow detection processing module is used, whether the TCP elephant flow exists is judged according to the message length and statistics of the TCP business data flow and the data flow life cycle length, and the EFD elephant flow detection result is carried to a subsequent queue distribution processing flow.
Furthermore, in the method, different ECN congestion marking algorithms are adopted when queue congestion occurs for various queues and service data flows, and a more aggressive ECN congestion marking algorithm is adopted for a best-effort forwarding queue distributed by a TCP elephant flow, so that the TCP elephant flow is decelerated more quickly, and the influence of congestion on the RoCEv2 flow forwarding performance is reduced.
Further, the SDN controller places critical traffic into a relatively low-latency queue.
As shown in fig. 1, global network classification is performed for a distributed network. The TCP elephant flow is allocated to the best effort forwarding queue for EFD detection results, a smaller ECN threshold B is used for the TCP elephant flow, which is smaller relative to the ECN threshold a of the RDMA allocated low latency queue, which represents the queue length occupied by the TCP elephant flow when the ECN marking is triggered, and ECN marking is started as soon as the threshold B is exceeded. The smaller the queue length is, the lighter the congestion degree of the TCP elephant flow is, so that the effect of informing the source server of starting to reduce the speed of the TCP elephant flow in advance can be achieved as early as possible by adopting a smaller ECN threshold value;
as shown in fig. 2, the SDN controller puts critical traffic into a best effort forwarding queue using a more aggressive ECN marking algorithm 1 versus a low latency queue. When the TCP elephant flow and the RoCEv2 flow respectively occupy the same queue length, the ECN marking probability of the algorithm 1 is larger than that of the algorithm 2, so that more TCP elephant flow messages are marked by the ECN, the speed reduction of the TCP elephant flow is greatly performed, and the forwarding bandwidth of the RDMA flow during congestion is finally improved.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (4)
1. A method for supporting high-performance service mixed transmission by an SDN in a distributed network is characterized by comprising the following steps:
101. the switch analyzes the message, acquires information such as IPDA, IPSA, IP protocol number, TCP/UDP protocol and the like in an analysis module, and carries the information of the message acquired by analysis to the SDN controller;
the SDN controller distinguishes TCP flow and RoCEv2 flow according to the IP protocol number and the TCP/UDP protocol obtained through analysis, and executes EFD elephant flow detection processing on the TCP flow;
103. in a scheduling module of the SDN controller, a forwarding module puts TCP elephant flow into a best effort forwarding queue according to an EFD elephant flow detection result, puts TCP mouse flow into a bandwidth guarantee queue, and puts RoCEv2 flow into a low delay queue;
104. according to the global management of the SDN controller, the forwarding processing in the outgoing direction of the switch is mainly to finish the next hop editing of the message and the forwarding at the exit end.
2. The method of claim 1, wherein the SDN supports high performance service mediation, the method comprising: the method comprises the steps of judging whether TCP elephant flow exists or not according to the message length and statistics of TCP service data flow and the data flow life cycle length when an EFD elephant flow detection processing module is used, and carrying an EFD elephant flow detection result to a subsequent queue distribution processing flow.
3. The method of claim 2, wherein the SDN supports high performance service mediation, the method comprising: the method comprises the steps that different ECN congestion marking algorithms are adopted when queue congestion occurs for various queues and service data flows, a more aggressive ECN congestion marking algorithm is adopted for best effort forwarding queues distributed by a TCP elephant flow, the TCP elephant flow is decelerated more quickly, and the influence of congestion on RoCEv2 flow forwarding performance is reduced.
4. The method of claim 3, wherein the SDN supports the high-performance service mixing transmission, and the method comprises: the SDN controller places critical traffic into a relatively low-latency queue.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010641715.0A CN111865812B (en) | 2020-07-06 | 2020-07-06 | SDN-supported high-performance service mixed transmission method in distributed network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010641715.0A CN111865812B (en) | 2020-07-06 | 2020-07-06 | SDN-supported high-performance service mixed transmission method in distributed network |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111865812A CN111865812A (en) | 2020-10-30 |
| CN111865812B true CN111865812B (en) | 2023-04-07 |
Family
ID=73152265
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010641715.0A Active CN111865812B (en) | 2020-07-06 | 2020-07-06 | SDN-supported high-performance service mixed transmission method in distributed network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111865812B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023272532A1 (en) * | 2021-06-29 | 2023-01-05 | 新华三技术有限公司 | Congestion processing method and apparatus, network device, and storage medium |
| CN114024913B (en) * | 2021-09-30 | 2024-03-08 | 浪潮电子信息产业股份有限公司 | Network performance optimization method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016000358A1 (en) * | 2014-06-30 | 2016-01-07 | 中兴通讯股份有限公司 | Outer label encoding method, traffic congestion control method and device |
| CN106062726A (en) * | 2014-03-21 | 2016-10-26 | 思科技术公司 | Flow aware buffer management for data center switches |
| CN108494817A (en) * | 2018-02-08 | 2018-09-04 | 华为技术有限公司 | Data transmission method, relevant apparatus and system |
| CN109714275A (en) * | 2019-01-04 | 2019-05-03 | 电子科技大学 | A kind of SDN controller and its control method for access service transmission |
| CN111131050A (en) * | 2019-12-31 | 2020-05-08 | 盛科网络（苏州）有限公司 | Flow table matching method and device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10158538B2 (en) * | 2013-12-09 | 2018-12-18 | Nicira, Inc. | Reporting elephant flows to a network controller |
| US10567300B2 (en) * | 2017-11-22 | 2020-02-18 | Cisco Technology, Inc. | Layer 3 fair rate congestion control notification |
| US10476803B2 (en) * | 2017-12-18 | 2019-11-12 | Mellanox Technologies, Ltd. | Elephant flow detection in network access |
| CN109245959B (en) * | 2018-09-25 | 2021-09-03 | 华为技术有限公司 | Method, network equipment and system for counting number of active streams |
| US11575609B2 (en) * | 2019-07-19 | 2023-02-07 | Intel Corporation | Techniques for congestion management in a network |
| US11467873B2 (en) * | 2019-07-29 | 2022-10-11 | Intel Corporation | Technologies for RDMA queue pair QOS management |
-
2020
- 2020-07-06 CN CN202010641715.0A patent/CN111865812B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106062726A (en) * | 2014-03-21 | 2016-10-26 | 思科技术公司 | Flow aware buffer management for data center switches |
| WO2016000358A1 (en) * | 2014-06-30 | 2016-01-07 | 中兴通讯股份有限公司 | Outer label encoding method, traffic congestion control method and device |
| CN108494817A (en) * | 2018-02-08 | 2018-09-04 | 华为技术有限公司 | Data transmission method, relevant apparatus and system |
| CN109714275A (en) * | 2019-01-04 | 2019-05-03 | 电子科技大学 | A kind of SDN controller and its control method for access service transmission |
| CN111131050A (en) * | 2019-12-31 | 2020-05-08 | 盛科网络（苏州）有限公司 | Flow table matching method and device |
Non-Patent Citations (2)
| Title |
|---|
| 王远."数据中心网络拥塞控制研究综述".《信息工程大学学报》.2019,第第20卷卷(第第20卷期),第714-719页. * |
| 陆一飞 ; 朱书宏 ; .数据中心网络下基于SDN的TCP拥塞控制机制研究与实现.计算机学报.2017,第40卷(第09期),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111865812A (en) | 2020-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108616458B (en) | System and method for scheduling packet transmissions on a client device | |
| US8848715B2 (en) | Combined hardware/software forwarding mechanism and method | |
| US9185047B2 (en) | Hierarchical profiled scheduling and shaping | |
| CN1770734B (en) | Traffic control method for network equipment | |
| US8284789B2 (en) | Methods and apparatus for providing dynamic data flow queues | |
| US8149708B2 (en) | Dynamically switching streams of packets among dedicated and shared queues | |
| US11968111B2 (en) | Packet scheduling method, scheduler, network device, and network system | |
| CN111865812B (en) | SDN-supported high-performance service mixed transmission method in distributed network | |
| US8929372B2 (en) | Grid router | |
| CN112585914A (en) | Message forwarding method and device and electronic equipment | |
| US20050068798A1 (en) | Committed access rate (CAR) system architecture | |
| US10069747B2 (en) | Real-time analysis of quality of service for multimedia traffic in a local area network | |
| KR100601043B1 (en) | Router for scheduling a packet and method therefor | |
| EP3188419B1 (en) | Packet storing and forwarding method and circuit, and device | |
| CN111108728B (en) | Method and device for processing message | |
| CN113904997B (en) | Method and device for caching and scheduling multi-priority service of receiving end of switching chip | |
| KR100916835B1 (en) | METHOD OF PROCESSING PACKETS PER-FLOW USING NETWORK PROCESSOR IN DiffServ-over-MPLS | |
| CN112188557B (en) | Method and device for ensuring priority QoS of green packet during congestion | |
| Fukuda et al. | Unfair and inefficient share of wireless LAN resource among uplink and downlink data traffic and its solution | |
| US20060215567A1 (en) | Method and apparatus for monitoring path statistics | |
| CN110830380A (en) | Method and device for determining dequeuing rate of message | |
| CN111092825A (en) | Method and device for transmitting message | |
| EP1694002A1 (en) | Memory access in a shared memory switch | |
| US11240169B2 (en) | Packet queuing | |
| CN113050703A (en) | Flow control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |