NETWORK EXTENDED TCP SPLICING

Abstract

A system for offloading information transfer between a client and a server in a communications network is disclosed. The system includes a network agent to issue a data transfer offload command responsive to receiving a TCP (transmission control protocol) splice command from an application proxy. The system additionally includes a network controller to offload data transfer from a kernel space to a network responsive to the data transfer offload command.

Claims

1. A system for offloading information transfer between a client and a server in a communications network comprising: a network agent to issue a data transfer offload command responsive to receiving a TCP (transmission control protocol) splice command from an application proxy; and a network controller to offload data transfer from a kernel space to a network responsive to the data transfer offload command.

2. A system according to claim 1 wherein said network agent resides in the kernel space of a TCP/IP stack.

3. A system according to claim 1 wherein said network agent resides in the TCP stack in the kernel space of a TCP/IP stack.

4. A system according to claim 1 wherein said network controller resides on the network.

5. A system according to claim 1 wherein said network controller comprises a load balancer.

6. A system according to claim 1 wherein said network agent receives the TCP splice command in a socket layer of a TCP/IP stack.

7. A system according to claim 1 further comprising said network.

8. A system according to claim 7 wherein said network is a software-defined network (SDN).

9. A system according to claim 8 wherein said network controller comprises a protocol oblivious forwarding controller.

10. A system according to claim 1 wherein said network controller directly connects the client with the server through said network.

11. A method for offloading information transfer between a client and a server from a TCP/IP stack in a communications network, the method comprising: transferring proxy functionality from an application proxy to a network controller responsive to the application proxy issuing a TCP splice command.

12. A method according to claim 11 further comprising receiving the TCP splice command by a network agent.

13. A method according to claim 12 wherein said receiving comprises intercepting the TCP command.

14. A method according to claim 12 further comprising the network agent sending an offload command to the network controller responsive to said receiving.

15. A method according to claim 12 wherein said receiving is through a socket layer of the TCP/IP stack.

16. A method according to claim 12 further comprising said network controller modifying a TCP and/or an IP header in a packet.

17. A method according to claim 11 further comprising the network controller maintaining proxy functionality according to any one of a duration of the lifetime of sockets; an amount of time required to transfer information from the client to the server and/or from the server to the client; an amount of information transferred from the client to the server and/or from the server to the client; a time-out value to set up a network splice; and a request or override received from the application proxy.

18. A method according to claim 11 further comprising the network controller returning proxy functionality to the application proxy.

19. A method according to claim 11 further comprising the network controller offloading the information transfer to a network.

Description

BRIEF DESCRIPTION OF DRAWINGS

[0031] The subject matter regarded as the invention is particularly pointed out and distinctly claimed in the concluding portion of the specification. The invention, however, both as to organization and method of operation, together with objects, features, and advantages thereof, may best be understood by reference to the following detailed description when read with the accompanying drawings in which:

[0032] FIG. 1 schematically illustrates a representative client-server network connection;

[0033] FIG. 2 schematically illustrates a representative client-server network connection including use of TCP splicing;

[0034] FIG. 3 schematically illustrates a client-server network connection including a Network Extended TCP Splicing system, according to an embodiment of the present invention; and

[0035] FIG. 4 is a flow chart of a method of offloading information to a network using the Network Extended TCP Splicing system, according to an embodiment of the present invention.

[0036] It will be appreciated that for simplicity and clarity of illustration, elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements.

DESCRIPTION OF EMBODIMENTS

[0037] In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the invention. However, it will be understood by those skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known methods, procedures, and components have not been described in detail so as not to obscure the present invention.

[0038] Applicants have realized that, despite the advantages provided by the use of known TCP splicing techniques, the functionality of the TCP splicing may be limited by the capacity of the hardware on which the application proxy sits. For example, a CPU may have insufficient processing power to drive the TCP/IP software, or may experience increased utilization due to latency in memory devices and I/O devices. Whichever may be the case, hardware capacity limitations may degrade overall system performance.

[0039] Applicants have further realized that the above problem associated with limited hardware capacity may be overcome by offloading information transfer to the network and recalling the information “on request”. Applicants have additionally realized that techniques used for TCP splicing which enable the application proxy to offload information transfer between two sockets to the OS kernel (kernel space) may be applied to enable the application proxy to offload information transfer between the two sockets to the network. Offloading to the network, Applicants have realized, may leverage network forwarding performance through increased proxy capacity.

Description of Network Extended TCP Splicing System

[0040] Reference is now made to FIG. 3 which schematically illustrates a client-server network connection 30 including a Network Extended TCP Splicing (NETS) system 31, according to an embodiment of the present invention. Client-server connection 30 may additionally include application proxy 12 in user space 14, and IP layer 16 and TCP stack 18 in kernel space 20. NETS system 31 may include a NETS agent 32 and a NETS controller 34. NETS system 31 may additionally an altered configuration of TCP stack 18 which may include NETS agent 32 as described further on below. NETS system 31 may additionally include a network 36 which may be implemented through SDN (software-defined networking) and may include use of protocol oblivious forwarding (POF).

[0041] NETS system 31 may use application proxy 12 interceptions of client-server connections at the socket layer to offload information transfer between two sockets (client and server) to network 36. At network 36, NETS system 31 may create a NETS TCP splice 23 to allow a direct connection of the client with the server over the network instead of through kernel space 20 as is commonly done in the art. Furthermore, NETS system 31 may transfer proxy functionality from application proxy 12 to network 36 to allow load balancing to be performed at the network.

[0042] As part of the offloading process, NETS system 31 may maintain proxy functionality at network 36 based on one or more predetermined criteria. These may include (a) a duration of the lifetime of the sockets; (b) an amount of time required to transfer the information from the client to the server and/or from the server to the client; (c) an amount of information to be transferred from the client to the server and/or from the server to the client; (d) a time-out value to set up the splice; (f) an override received from the application proxy; (g) or other events which may be associated with the client-server connection and information transfer; (h) or any combination thereof. NET system 31 may additionally transfer proxy functionality from network 36 to application proxy 12 to return control of the sockets “on request”, which may be upon termination of any one or any combination of the previously mentioned events or upon determination that there is no need to offload information.

[0043] As may be appreciated from FIG. 3, as a result of creating NETS TCP splice 23 interconnecting network connections 22 and 24, packets may be directly transferred between the client and the server through network 36 without passing through kernel space 20 (and also without passing through user space 14). In operation, the connection between the client and the server may be initially established by proxy 12, for example, through connections 37A and 37B in a similar fashion to connections 27A and 27B in FIG. 2. Once the connection is established NETS system 31 may then create NETS TCP splice 23 offloading information transfer to network 36 with proxy functionality transferred to the NETS system. Upon termination of the offloading, proxy functionality may be returned back to application proxy 12 as shown by connection 37A for packets sent by the client and by connection 37B for packets sent by the server.

[0044] NETS agent 32 may receive TCP splicing commands from proxy 12 and, responsively, send offload commands to NETS controller 34, as shown by double headed arrow 35. The splicing commands may be intended for the socket layer and may be intercepted by NETS agent 32 acting as a proxy. Alternatively, the splicing commands may be specifically intended for NETS agent 32. On some occasion, NETS agent 32 may receive the splicing commands from proxy 12 and may not act on the commands (i.e. not send offload commands to NETS controller 34), for example, when network 36 capacity is not suitable for offloading.

[0045] NETS agent 32 may include a module which may be integrated into TCP stack 18 (altered TCP stack) in kernel space 20. The module may be integrated within the socket layer, or in addition to the socket layer in TCP stack 18. Alternatively, NETS agent 32 may replace the socket layer. NETS agent 32 may include hardware and/or software, and may additionally include an API (application program interface) for interfacing with application proxy 12 and/or NETS controller 34.

[0046] NETS controller 34 may be integrated to network 36 and may receive the offload commands from NETS agent 32. NETS controller 34 may additionally translate the commands into network device configurations to create NETS TCP splice 23 and allow load balancing to be performed in network 36. NETS controller 34 may additionally send information to NETS agent 32 associated with network 36 capacity. The network information may be sent to NETS agent 32 through a northbound interface, also indicated by double headed arrow 35.

[0047] NETS controller 34 may use fast path offloading (FPO) to offload traffic processing to network 36. Use of FPO may allow NETS controller 34 to forward and redirect one or more packets in network 31 to another destination by modifying the TCP and IP fields, for example, by changing TCP and IP headers in the packets. The modifications made to the TCP and IP headers may include information associated with source and destination IP, source and destination port and event TCP.seq and TCP.ack number.

Implementation Example of Socket Extension in NETS System

[0048] Following are exemplary function calls which may be used by the NETS System to perform the various functions described below:

TABLE-US-00001 (a) int NETS_attach(int fd1, int fd2)     /* attaches two sockets for future offload.    returns fd to newly created control socket */ (b) int write(int ctl_sckt, char *ctl_buf, int)   /* ctl_buf contains request for offloading + parameters such as  timeout, byte number etc. . . if request successful, the application is expected not to read and/or write from the sockets attached to the control socket. */ (c) struct pollfd   /* new event : NETS_resume This is the event we expect to  receive while polling on a control socket. It means that NETS has returned control of the attached sockets to the application/ Upon reception of the NETS_resume the application can read from the control socket data relevant to the resume such as number of bytes transferred. Also, after NETS_resume that application can resume reading and writing from/to the attached sockets. */ int read(int ctl_sckt, char *CTL_buf, int)   /* read from control socket a control buf. Called after NETS_resume received on control socket during poll. Contains information such as - number of bytes sent since last offload, time elapsed since last offload & flags such a FIN/RST sent etc. . .*/

Exemplary Method for Offloading Using NETS

[0049] Following is described an exemplary method 400 of offloading information transfer to a network including a NETS TCP splice, according to an embodiment of the present invention. For clarity, exemplary method 400 described herein will be explained with reference to NETS system 31 and client-server connection 30. Furthermore, the ordinary person skilled in the art may realize that method 400 may be practiced with more or less steps and/or with a different sequence of steps.

[0050] At step 402, the server socket and the client socket may be determined by application proxy 12. The sockets may be determined from one or more initial packets received through network connection 22 and/or server connection 24 and which pass through kernel space 20 and are intercepted in the socket layer by application proxy 12.

[0051] At step 404, application proxy 12 may issue a TCP splice command to create a TCP splice in kernel space 20 based on the sockets' information. The TCP splice command may be intercepted by NETS agent 32.

[0052] At step 406, an offload command may be issued by NETS agent 32 to NETS controller 34 responsive to the TCP splice command from application proxy 12.

[0053] At step 408, NETS controller 34 may receive the offload command from NETS agent 32 and responsive to the command, takes proxy control of network 36. NETS controller may adjust network device configurations in the packets, for example, by modifying the TCP and IP headers in the packets to perform load balancing. NETS controller 34 may retain control of the proxy functionality according to predetermined criteria which may include any one or combination of (a) a duration of the lifetime of the sockets; (b) an amount of time required to transfer the information from the client to the server and/or from the server to the client; (c) an amount of information to be transferred from the client to the server and/or from the server to the client; (d) a time-out value to set up the splice; (f) a request or override received from the application proxy; (g) or other events which may be associated with the client-server connection and information transfer. While proxy functionality is maintained by NETS controller 34, information transfer between the client and the server is direct through network 36 (through network splice 23).

[0054] At step 410, NETS controller 34 returns control of the proxy functionality to application proxy 12 upon termination of the offloading. Termination may be based on the predetermined criteria for returning control and may include signaling to NETS agent 32 that the control is to be returned. Alternatively, signaling that the control of proxy functionality is to be returned to proxy 12 may originate from NETS agent 32 according to the predetermined criteria. The signaling may include signaling to application proxy 12. Network splice 23 is broken and information transfer returns to proxy 12 through kernel 20 into user space 14.

[0055] Unless specifically stated otherwise, as apparent from the preceding discussions, it is appreciated that, throughout the specification, discussions utilizing terms such as “processing,” “computing,” “calculating,” “determining,” or the like, refer to the action and/or processes of a computer, computing system, or similar electronic computing device that manipulates and/or transforms data represented as physical, such as electronic, quantities within the computing system's registers and/or memories into other data similarly represented as physical quantities within the computing system's memories, registers or other such information storage, transmission or display devices.

[0056] Embodiments of the present invention may include apparatus for performing the operations herein. This apparatus may be specially constructed for the desired purposes, or it may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a computer readable storage medium, such as, but not limited to, any type of disk, including floppy disks, optical disks, magnetic-optical disks, read-only memories (ROMs), compact disc read-only memories (CD-ROMs), random access memories (RAMs), electrically programmable read-only memories (EPROMs), electrically erasable and programmable read only memories (EEPROMs), magnetic or optical cards, Flash memory, or any other type of media suitable for storing electronic instructions and capable of being coupled to a computer system bus.

[0057] The processes and displays presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose systems may be used with programs in accordance with the teachings herein, or it may prove convenient to construct a more specialized apparatus to perform the desired method. The desired structure for a variety of these systems appears from the description above. In addition, embodiments of the present invention are not described with reference to any particular programming language. It will be appreciated that a variety of programming languages may be used to implement the teachings of the invention as described herein.

[0058] While certain features of the invention have been illustrated and described herein, many modifications, substitutions, changes, and equivalents will now occur to those of ordinary skill in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.