H04L67/1004

METHOD AND APPARATUS FOR COMPUTING NETWORK EDGE, DEVICE, AND MEDIUM
20220394084 · 2022-12-08 ·

A network edge computing method includes receiving, by an edge data node, a service request; and routing, by the edge data node and according to a virtual IP address and port information in the service request, the service request to one or more containers corresponding to a service, to be processed by the one or more containers.

METHOD AND APPARATUS FOR COMPUTING NETWORK EDGE, DEVICE, AND MEDIUM
20220394084 · 2022-12-08 ·

A network edge computing method includes receiving, by an edge data node, a service request; and routing, by the edge data node and according to a virtual IP address and port information in the service request, the service request to one or more containers corresponding to a service, to be processed by the one or more containers.

MANAGEMENT DEVICE, STORAGE SYSTEM, AND INFORMATION PROCESSING METHOD
20220394086 · 2022-12-08 · ·

A management device of a storage system, the management devices includes a memory and a processor. The processor coupled to the memory and configured to acquire workload load information and system load information when executing a container, and determine a workload arrangement destination and a replica position of a volume based on the workload load information and the system load information when activating a workload.

ONBOARDING NEW MACHINE LEARNING APPLICATIONS IN A MULTI-TENANT ON-DEMAND MODEL SERVING INFRASTRUCTURE USING CONFIGURATION OBJECTS

A method by a router component in a multi-tenant on-demand serving infrastructure to route scoring requests to scoring containers. The method includes receiving a scoring request, determining a machine learning application associated with the scoring request, determining whether a router instance for the machine learning application exists, and responsive to a determination that a router instance for the machine learning application does not exist, obtaining a configuration object for the machine learning application and instantiating the router instance for the machine learning application based on the configuration object for the machine learning application. The method further includes invoking the router instance for the machine learning application to route the scoring request associated with the machine learning application to a scoring container that provides scoring functionality for the machine learning application.

CONFIGURATION MAP BASED SHARDING FOR CONTAINERS IN A MACHINE LEARNING SERVING INFRASTRUCTURE

A machine learning serving infrastructure implementing a method of receiving or detecting an update of container metrics including resource usage and serviced requests per model or per container, processing the container metrics per model or per container to determine recent resource usage and serviced requests per model or per container, and rebalancing distribution of models to a plurality of containers to decrease a detected load imbalance between containers or a stressed container in the plurality of containers.

METHOD AND SYSTEM FOR MIGRATION OF ONE OR MORE VIRTUAL MACHINES

A system [100] and method [200] for migration of virtual machine(s). The method [200] encompasses identifying, the virtual machine(s) hosted under a first server unit configured in a network to migrate to a second server unit. The method [200] thereafter comprises broadcasting in the network, a GARP response generated by one of the virtual machine(s) and the first server unit. Further the method [200] comprises enabling, an IP forwarding on the second server unit. The method [200] thereafter encompasses enabling, a Proxy ARP on a first network node associated with the first server unit and a second network node associated with the second server unit. Further the method [200] comprises migrating, the virtual machine(s) to the second server unit from the first server unit based at least on the GARP, the enabled IP forwarding and the enabled Proxy ARP.

METHOD AND SYSTEM FOR MIGRATION OF ONE OR MORE VIRTUAL MACHINES

A system [100] and method [200] for migration of virtual machine(s). The method [200] encompasses identifying, the virtual machine(s) hosted under a first server unit configured in a network to migrate to a second server unit. The method [200] thereafter comprises broadcasting in the network, a GARP response generated by one of the virtual machine(s) and the first server unit. Further the method [200] comprises enabling, an IP forwarding on the second server unit. The method [200] thereafter encompasses enabling, a Proxy ARP on a first network node associated with the first server unit and a second network node associated with the second server unit. Further the method [200] comprises migrating, the virtual machine(s) to the second server unit from the first server unit based at least on the GARP, the enabled IP forwarding and the enabled Proxy ARP.

METHODS AND SYSTEMS FOR SERVICE DISTRIBUTION USING DATA PATH STATE REPLICATION AND INTERMEDIATE DEVICE MAPPING
20220377012 · 2022-11-24 ·

Network traffic flows can be processed by routers, switches, or service nodes. Service nodes may be ASICs that can provide the functionality of a switch or a router. Service nodes can be configured in a circular replication chain, thereby providing benefits such as high reliability. The service nodes can implement methods that include receiving a first packet that includes a source address in a source address field and that includes a destination address in a destination address field. The first packet can be routed to a selected service node that is in the replication chain that includes a plurality of service nodes that are configured for chain replication of a service state information. A service node configured for NAT or some other service can use the first packet to produce a translated packet that can be transmitted toward a destination indicated by the destination address.

TRANSPARENT MULTIPLE AVAILABILITY ZONES IN A CLOUD PLATFORM
20220377135 · 2022-11-24 ·

The present disclosure relates to computer-implemented methods, software, and systems for managing cloud application in a transparent multiple availability zone cloud platform. A request to access a cloud application running on the multiple availability zone cloud platform is received. The request can include an application location for accessing the cloud application. A network address corresponding to the application location is determined. In response to determining the network address, a first availability zone of the multiple availability zone cloud platform that is currently active to process the request is determined. A plurality of network locations corresponding to a host component of the application location is determined by a first load balancer. A network location of the plurality of network locations for processing the request is identified based on load balancing criteria. The received request is provided to the identified network location for processing by a first instance of the cloud application.

Technologies for switching network traffic in a data center

Technologies for switching network traffic include a network switch. The network switch includes one or more processors and communication circuitry coupled to the one or more processors. The communication circuitry is capable of switching network traffic of multiple link layer protocols. Additionally, the network switch includes one or more memory devices storing instructions that, when executed, cause the network switch to receive, with the communication circuitry through an optical connection, network traffic to be forwarded, and determine a link layer protocol of the received network traffic. The instructions additionally cause the network switch to forward the network traffic as a function of the determined link layer protocol. Other embodiments are also described and claimed.