H04L47/215

Systems and methods for rate-based load balancing

According to examples, a system for rate-based load balancing may include a processor and a memory storing instructions. The processor may, through execution of the instructions, cause the system to receive a request for processing. The system may further identify a target server to transmit the request using a rate-based load balancing technique. In some examples, the rate-based load balancing technique may include: selecting a server, from a plurality of servers, as a potential target; receiving a readiness indicator for the selected server; and designating the selected server as the target server based on the readiness indicator. The system may transmit the request to the target server for processing.

Probabilistic service level agreements (SLA)

Regulating transmission of data packets between a first network and a second network over a datalink. Embodiments include determining a first plurality of token bucket rate (TBR) parameters, each TBR parameter corresponding to a one of a first plurality of packet drop precedence (DP) levels and one of a first plurality of timescales (TS). The determination of the first plurality of bucket rate parameters is based on a peak rate requirement, the data link capacity, and a nominal speed requirement associated with the data link. Embodiments also include determining a second plurality of TBR parameters based on the first plurality of TBR parameters and a guaranteed rate requirement, the second plurality comprising a further DP level than the first plurality. Embodiments also include regulating data packets sent between the first network and the second network via the data link based on the second plurality of TBR parameters.

Probabilistic service level agreements (SLA)

Regulating transmission of data packets between a first network and a second network over a datalink. Embodiments include determining a first plurality of token bucket rate (TBR) parameters, each TBR parameter corresponding to a one of a first plurality of packet drop precedence (DP) levels and one of a first plurality of timescales (TS). The determination of the first plurality of bucket rate parameters is based on a peak rate requirement, the data link capacity, and a nominal speed requirement associated with the data link. Embodiments also include determining a second plurality of TBR parameters based on the first plurality of TBR parameters and a guaranteed rate requirement, the second plurality comprising a further DP level than the first plurality. Embodiments also include regulating data packets sent between the first network and the second network via the data link based on the second plurality of TBR parameters.

TRAFFIC SHAPING OFFLOAD ON A NETWORK INTERFACE CONTROLLER
20220182328 · 2022-06-09 ·

Systems, methods, and apparatuses, including network interface controllers and computer-readable media, for traffic shaping offload. A network computing device can receive data packets for transmission and implement a traffic policy that includes transmitting at least some data packets without delay to their intended destination. Confirmation tokens for non-delayed packets can be queued in a time-indexed data structure and dequeued according to a traffic shaping policy. Confirmation tokens can be generated and stored independent of the time at which corresponding packets for the tokens are transmitted. Dequeued confirmation tokens can cause the network computing device to receive additional packets for transmission. The device can flag at least some packets for transmission without delay according to aspects of the disclosure, while un-flagged packets can be shaped according to a different traffic shaping policy.

Ephemeral data stream routing service

Systems and methods are described for streaming data between a user device and a remote computing environment via a “switchboard” service that enables interaction without the user device or the remote computing environment establishing additional connections. A first routing device receives a connection from a user device that requests routing a data stream to or from a remote computing environment. The first routing device processes the request by generating a token, which is passed to the remote computing environment along with the request. The remote computing environment passes the token to a second routing device, which decodes the routing token to identify the first routing device. The second routing device then passes the request token to the first routing device, which responds by establishing a route for streaming data between the connection made with the user device and the remote computing environment via the routing devices.

Ephemeral data stream routing service

Systems and methods are described for streaming data between a user device and a remote computing environment via a “switchboard” service that enables interaction without the user device or the remote computing environment establishing additional connections. A first routing device receives a connection from a user device that requests routing a data stream to or from a remote computing environment. The first routing device processes the request by generating a token, which is passed to the remote computing environment along with the request. The remote computing environment passes the token to a second routing device, which decodes the routing token to identify the first routing device. The second routing device then passes the request token to the first routing device, which responds by establishing a route for streaming data between the connection made with the user device and the remote computing environment via the routing devices.

Programmable traffic management engine

Examples herein describe a programmable traffic management engine that includes both programmable and non-programmable hardware components. The non-programmable hardware components are used to generate features that can then be used to perform different traffic management algorithms. Depending on which traffic management algorithm the PTM engine is configured to do, the PTM engine may use a subset (or all) of the features to perform the algorithm. The programmable hardware components in the PTM engine are programmable (e.g., customizable) by the user to perform a selected algorithm using some or all of the features provided by the non-programmable hardware components.

Per service microburst monitoring systems and methods for Ethernet
20220158922 · 2022-05-19 ·

Systems and methods in a node in an Ethernet network include, responsive to enabling burst monitoring between the node and a peer node in the Ethernet network, obtaining rate and burst size information from the peer node; configuring a counter at a traffic disaggregation point based on the rate and the burst size information, wherein the counter is based on a dual token bucket that is used to count out-of-profile frames in excess of a Committed Information Rate (CIR); and detecting a burst based on the out-of-profile frames during a monitored time interval.

METHOD AND APPARATUS FOR ALLOCATING RESOURCES FROM V2X TO VEHICLE
20230269728 · 2023-08-24 ·

Provided are a method by which a first device performs wireless communication, and an apparatus for supporting same. The method may comprise the steps of: generating at least one token on the basis of a bucket size and a token generation rate; determining, on the basis of the triggering of the first manipulation intent, the number of tokens for executing a first manipulation intent; transmitting, to a second device, sidelink control information (SCI) for scheduling a physical sidelink shared channel (PSSCH) through a physical sidelink control channel (PSCCH), the SCI including information related to priorities, information related to resource allocation, and information related to a modulation and coding scheme (MCS); and transmitting, to the second device through the PSSCH, a medium access control protocol data unit (MAC PDU) including the information related to the number of tokens and a request for the first manipulation intent.

Network device having flexible rate limiter

A network device for a communications network includes a port configured to transmit data to the network at a maximum transmit data rate. The device also includes a transmit buffer configured to buffer data units that are ready for transmission to the network, and a packet buffer configured to buffer data units before the data units are ready for transmission. The packet buffer is configured to output data units at a maximum packet buffer transmission rate faster than the maximum transmit data rate. The device includes a rate controller configured to control a transmission rate of data from the packet buffer to the transmit buffer so that averaged over a period, the transmission rate from the packet buffer to the transmit buffer is at most equal to the maximum transmit data rate, while allowing the transmission rate, at one or more time intervals, to exceed the maximum transmit data rate.