Multi-RPO data protection

Abstract

A system for disaster recovery including a controller (i) for controlling bandwidth usage of a disaster recovery system in accordance with a plurality of recovery point objectives (RPOs), each RPO designating a maximal time loss constraint for data recovery for an enterprise production system, and a corresponding bandwidth allocation for the disaster recovery system to use in replicating data for the enterprise production system, wherein the RPOs are applied in accordance with a calendar-based schedule of dates and times, and (ii) for issuing an RPO alert when the RPO maximal time loss constraint for a current date and time is not satisfied.

Claims

1. A system for disaster recovery, comprising: a virtual manager that executes on a computing device having one or more processors and memory to cause the one or more processors to: control usage of bandwidth by a virtual server in accordance with a calendar- based schedule defining a first recovery point objective for a first time period and a second recovery point objective for a second time period different from the first time period, the first recovery point objective specifying a first maximum loss constraint for data recovery and a first allocation of the bandwidth for data replication for the first time period, the second recovery point objective specifying a second maximum loss constraint for data recovery and a second allocation of the bandwidth for data replication for the second time period, the first allocation of the bandwidth for the first time period different from the second allocation of the bandwidth for the second time period; adjust the usage of bandwidth by the virtual server in accordance with the first recovery point objective and the second recovery point objective; and issue an alert, responsive to determination that at least one of the first recovery point objective and the second recovery point objective is not satisfied.

2. The system of claim 1, comprising: the virtual manager to control the usage of the bandwidth by the virtual server in accordance with the calendar-based schedule, the calendar-based schedule specifying a third allocation of the bandwidth for data production for the first time period and a fourth allocation of the bandwidth for data production for the second time period.

3. The system of claim 1, comprising the virtual manager to: adjust the calendar-based schedule based on the alert.

4. The system of claim 1, comprising: the virtual manager to identify one of the first recovery point objective or the second recovery point objective to apply based on a current time.

5. The system of claim 1, comprising: the virtual manager to increase the first allocation of the bandwidth for data replication for the first time period, the first time period corresponding to a peak usage time period.

6. The system of claim 1, comprising: the virtual manager to decrease the second allocation of the bandwidth for data replication for the second time period corresponding to an off-peak usage time period.

7. The system of claim 1, comprising: the virtual manager to share the bandwidth of the virtual server at a first site with a second virtual server at a second site.

8. The system of claim 1, comprising: the virtual manager to control bandwidth usage of a first type of network traffic in accordance with the first recovery point objective and to control bandwidth usage of a second type of network traffic in accordance with the second recovery point objective.

9. The system of claim 1, wherein the first time period includes a first period of a day and the second time period includes a second period of the day different from the first period of the day.

10. A method of disaster recovery, comprising: controlling, by a virtual manager executing on a computing device having one or more processors and memory, usage of bandwidth by a virtual server in accordance with calendar- based schedule defining a first recovery point objective for a first time period and a second recovery point objective for a second time period different from the first time period, the first recovery point objective specifying a first maximum loss constraint for data recovery and a first allocation of the bandwidth for data replication for the first time period, the second recovery point objective specifying a second maximum loss constraint for data recovery and a second allocation of the bandwidth for data replication for the second time period, the first allocation of the bandwidth for the first time period different from the second allocation of the bandwidth for the second time period; adjusting, by the virtual manager, the bandwidth usage of the virtual server in accordance with the first recovery point objective and the second recovery point objective; and issuing, by the virtual manager, an alert, responsive to determination that at least one of the first recovery point objective and the second recovery point objective is not satisfied.

11. The method of claim 10, comprising: controlling, by the virtual manager, the usage of the bandwidth by the virtual server in accordance with the calendar-based schedule, the calendar-based schedule specifying a third allocation of the bandwidth for data production for the first time period and a fourth allocation of the bandwidth for data production for the second time period.

12. The method of claim 10, comprising: adjusting, by the virtual manager, the calendar-based schedule, responsive to the issuing of the alert.

13. The method of claim 10, comprising: identifying, by the virtual manager, one of the first recovery point objective or the second recovery point objective to apply based on a current time.

14. The method of claim 10, comprising: increasing, by the virtual manager, the first allocation of the bandwidth for data replication for the first time period corresponding to a peak usage time period.

15. The method of claim 10, comprising: decreasing, by the virtual manager, the second allocation of the bandwidth for data replication for the second time period corresponding to an off-peak usage time period.

16. The method of claim 10, comprising: sharing, by the virtual manager, the bandwidth of the virtual server at a first site with a second virtual server at a second site.

17. The method of claim 10, comprising: controlling, by the virtual manager, a bandwidth usage of a first type of network traffic in accordance with the first recovery point objective and to control a bandwidth usage of a second type of network traffic in accordance with the second recovery point objective.

18. The method of claim 10, comprising controlling, by the virtual manager, the bandwidth usage of the virtual server in accordance with the first recovery point objective and the second recovery point objective, the first time period of the first recovery point objective including a first period of a day, the second time period of the second recovery point objective including a second period of the day different from the first period of the day.

19. The system of claim 1, comprising: the virtual manager to control the usage of the bandwidth by the virtual server in accordance with the calendar-based schedule.

20. The system of claim 1, comprising: the virtual manager in communication with a hypervisor including the virtual server and a virtual data services appliance for virtual data replication.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) The present invention will be more fully understood and appreciated from the following detailed description, taken in conjunction with the drawings in which:

(2) FIG. 1 is a screen shot of a prior art single-RPO console for a disaster recovery application;

(3) FIG. 2 is a simplified block diagram of a hypervisor architecture that includes a tapping driver and a virtual data services appliance, in accordance with an embodiment of the present invention;

(4) FIG. 3 is a simplified data flow chart for a virtual data services appliance, in accordance with an embodiment of the present invention;

(5) FIG. 4 is a simplified block diagram of a virtual replication system, in accordance with an embodiment of the present invention;

(6) FIG. 5 is a simplified block diagram of a cross-host multiple hypervisor system that includes data services managers for multiple sites that have multiple hypervisors, in accordance with an embodiment of the present invention;

(7) FIG. 6 is a user interface screenshot of bi-directional replication of virtual protection groups, in accordance with an embodiment of the present invention;

(8) FIG. 7 is a user interface screenshot of assignment of a replication target for a virtual protection group, in accordance with an embodiment of the present invention;

(9) FIG. 8 is an example an environment for the system of FIG. 4, in accordance with an embodiment of the present invention;

(10) FIG. 9 is a simplified block diagram of a system for multi-tenant and multi-site cloud-based data services, in accordance with an embodiment of the present invention;

(11) FIG. 10 is a simplified block diagram of a first architecture for providing hypervisor level multi-tenant cloud-based data services, in accordance with an embodiment of the present invention;

(12) FIG. 11 is a simplified block diagram of a second architecture for providing hypervisor level multi-tenant cloud-based data services, in accordance with an embodiment of the present invention;

(13) FIG. 12 is a simplified block diagram of a third architecture for providing hypervisor level multi-tenant cloud-based data services, in accordance with an embodiment of the present invention;

(14) FIG. 13 is a simplified block diagram of a fourth architecture for providing hypervisor level multi-tenant cloud-based data services, in accordance with an embodiment of the present invention;

(15) FIG. 14 is a simplified block diagram of a system for multi-tenant and multi-site cloud-based data services with jurisdictional data separation, in accordance with an embodiment of the present invention;

(16) FIG. 15 is a screen shot of a multi-RPO console for a disaster recovery application, in accordance with an embodiment of the present invention;

(17) FIG. 16 is a simplified block diagram of an exemplary multi-RPO data protection system, in accordance with an embodiment of the present invention; and

(18) FIG. 17 is a simplified flow diagram of a method for multi-RPO data protection, in accordance with an embodiment of the present invention.

LIST OF APPENDICES

(19) Appendix I is an application programming interface for virtual replication site controller web services, in accordance with an embodiment of the present invention;

(20) Appendix II is an application programming interface for virtual replication host controller web services, in accordance with an embodiment of the present invention;

(21) Appendix III is an application programming interface for virtual replication protection group controller web services, in accordance with an embodiment of the present invention;

(22) Appendix IV is an application programming interface for virtual replication command tracker web services, in accordance with an embodiment of the present invention; and

(23) Appendix V is an application programming interface for virtual replication log collector web services, in accordance with an embodiment of the present invention.

DETAILED DESCRIPTION

(24) Aspects of the present invention relate to disaster recovery with multiple RPOs that are applied in accordance with a schedule of dates and times.

(25) Reference is made to FIG. 2, which is a simplified block diagram of a hypervisor architecture that includes a tapping driver and a VDSA, in accordance with an embodiment of the present invention. Shown in FIG. 2 is a hypervisor 100 with three virtual servers 110, three virtual disks 120, an I/O backend 130 and a physical storage array 140. Hypervisor 100 uses a single physical server, but runs multiple virtual servers 110. Virtual disks 120 are a storage emulation layer that provide storage for virtual servers 110. Virtual disks 120 are implemented by hypervisor 100 via I/O backend 130, which connects to physical disk 140.

(26) Hypervisor 100 also includes a tapping driver 150 installed within the hypervisor kernel. As shown in FIG. 2, tapping driver 150 resides in a software layer between virtual servers 110 and virtual disks 120. As such, tapping driver 150 is able to access I/O requests performed by virtual servers 110 on virtual disks 120. Tapping driver 150 has visibility to I/O requests made by virtual servers 110.

(27) Hypervisor 100 also includes a VDSA 160. In accordance with an embodiment of the present invention, a VDSA 160 runs on a separate virtual server within each physical hypervisor. VDSA 160 is a dedicated virtual server that provides data services via one or more data services engines 170. However, VDSA 160 does not reside in the actual I/O data path between I/O backend 130 and physical disk 140. Instead, VDSA 160 resides in a virtual I/O data path.

(28) Whenever a virtual server 110 performs I/O on a virtual disk 120, tapping driver 150 identifies the I/O requests that the virtual server makes. Tapping driver 150 copies the I/O requests, forwards one copy via the conventional path to I/O backend 130, and forwards another copy to VDSA 160. In turn, VDSA 160 enables the one or more data services engines 170 to provide data services based on these I/O requests.

(29) Reference is made to FIG. 3, which is a simplified data flow chart for a VDSA, in accordance with an embodiment of the present invention. Shown in FIG. 3 are an I/O receiver 210, a hash generator 220, a TCP transmitter 230, a data analyzer and reporter 240, a journal manager 250 and a remote VDSA 260. Remote VDSA 260 resides on different physical hardware, at a possibly different location.

(30) As shown in FIG. 3, I/O receiver 210 receives an intercepted I/O request from tapping driver 150. VDSA 160 makes up to three copies of the received I/O requests, in order to perform a set of actions which enable the one or more data services engines 170 to provide various services.

(31) A first copy is stored in persistent storage, and used to provide continuous data protection. Specifically, VDSA 160 sends the first copy to journal manager 250, for storage in a dedicated virtual disk 270. Since all I/O requests are journaled on virtual disk 270, journal manager 250 provides recovery data services for virtual servers 110, such as restoring virtual servers 110 to an historical image. In order to conserve disk space, hash generator 220 derives a one-way hash from the I/O requests. Use of a hash ensures that only a single copy of any I/O request data is stored on disk.

(32) An optional second copy is used for disaster recovery. It is sent via TCP transmitter 230 to remote VDSA 260. As such, access to all data is ensured even when the production hardware is not available, thus enabling disaster recovery data services.

(33) An optional third copy is sent to data analyzer and reporter 240, which generates a report with information about the content of the data. Data analyzer and reporter 240 analyzes data content of the I/O requests and infers information regarding the data state of virtual servers 110. E.g., data analyzer and reporter 240 may infer the operating system level and the status of a virtual server 110.

(34) Reference is made to FIG. 4, which is a simplified block diagram of a virtual replication system, in accordance with an embodiment of the present invention. Shown in FIG. 4 is a protected site designated Site A, and a recovery site designated Site B. Site A includes a hypervisor 100A with three virtual servers 110A-1, 110A-2 and 110A-3, and a VDSA 160A. Site A includes two physical disks 140A-1 and 140A-2. Site B includes a hypervisor 100B with a VDSA 160B. Site B includes two physical disks 140B-1 and 140B-2. All or some of virtual servers 110A-1, 110A-2 and 110A-3 may be designated as protected. Once a virtual server is designated as protected, all changes made on the virtual server are replicated at the recovery site.

(35) In accordance with an embodiment of the present invention, every write command from a protected virtual server in hypervisor 100A is intercepted by tapping driver 150 (FIG. 2) and sent asynchronously by VDSA 160A to VDSA 160B for replication, via a wide area network (WAN) 320, while the write command continues to be processed by the protected server.

(36) At Site B, the write command is passed to a journal manager 250 (FIG. 3), for journaling on a Site B virtual disk 270 (FIG. 3). After every few seconds, a checkpoint is written to the Site B journal, and during a recovery one of the checkpoints may be selected for recovering to that point. Additionally, checkpoints may be manually added to the Site B journal by an administrator, along with a description of the checkpoint. E.g., a checkpoint may be added immediately prior to an event taking place that may result in the need to perform a recovery, such as a planned switch over to an emergency generator.

(37) In addition to write commands being written to the Site B journal, mirrors 110B-1, 110B-2 and 110B-3 of the respective protected virtual servers 110A-1, 110A-2 and 110A-3 at Site A are created at Site B. The mirrors at Site B are updated at each checkpoint, so that they are mirrors of the corresponding virtual servers at Site A at the point of the last checkpoint. During a failover, an administrator can specify that he wants to recover the virtual servers using the latest data sent from the Site A. Alternatively the administrator can specify an earlier checkpoint, in which case the mirrors on the virtual servers 110B-1, 110-B-2 and 110B-3 are rolled back to the earlier checkpoint, and then the virtual servers are recovered to Site B. As such, the administrator can recover the environment to the point before any corruption, such as a crash or a virus, occurred, and ignore the write commands in the journal that were corrupted.

(38) VDSAs 160A and 160B ensure write order fidelity; i.e., data at Site B is maintained in the same sequence as it was written at Site A. Write commands are kept in sequence by assigning a timestamp or a sequence number to each write at Site A. The write commands are sequenced at Site A, then transmitted to Site B asynchronously, then reordered at Site B to the proper time sequence, and then written to the Site B journal.

(39) The journal file is cyclic; i.e., after a pre-designated time period, the earliest entries in the journal are overwritten by the newest entries.

(40) It will be appreciated by those skilled in the art that the virtual replication appliance of the present invention operates at the hypervisor level, and thus obviates the need to consider physical disks. In distinction, conventional replication systems operate at the physical disk level. Embodiments of the present invention recover write commands at the application level. Conventional replication systems recover write commands at the SCSI level. As such, conventional replication systems are not fully application-aware, whereas embodiment of the present invention are full application-aware, and replicate write commands from an application in a consistent manner.

(41) The present invention offers many advantages. Hardware Agnostic: Because VDSA 160 manages recovery of virtual servers and virtual disks, it is not tied to specific hardware that is used at the protected site or at the recovery site. The hardware may be from the same vendor, or from different vendors. As long as the storage device supports the iSCSI protocol, any storage device, known today or to be developed in the future, can be used. Fully Scalable: Because VDSA 160 resides in the hypervisor level, architectures of the present invention scale to multiple sites having multiple hypervisors, as described hereinbelow with reference to FIG. 5. Efficient Asynchronous Replication: Write commands are captured by VDSA 160 before they are written to a physical disk at the protected site. The write commands are sent to the recovery site asynchronously, and thus avoid long distance replication latency. Moreover, only delta changes are sent to the recovery site, and not a whole file or disk, which reduces the network traffic, thereby reducing WAN requirements and improving recovery time objective and recovery point objective. Control of Recovery: An administrator controls when a recovery is initiated, and to what point in time it recovers. Near-Zero Recovery Point Objective (RPO): VDSA 160 continuously protects data, sending a record of every write command transacted at the protected site to the recovery site. As such, recovery may be performed within a requested RPO. Near-Zero Recovery Time Objective (RTO): During recovery the mirrors of the protected virtual servers are recovered at the recovery site from VDSA 160B, and synchronized to a requested checkpoint. In accordance with an embodiment of the present invention, during synchronization and while the virtual servers at the recovery site are not yet fully synchronized, users can nevertheless access the virtual servers at the recovery site. Each user request to a virtual server is analyzed, and a response is returned either from the virtual server directly, or from the journal if the information in the journal is more up-to-date. Such analysis of user requests continues until the recovery site virtual environment is fully synchronized. WAN Optimization between Protected and Recovery Sites: In accordance with an embodiment of the present invention, write commands re compressed before being sent from VDSA 160A to VDSA 160B, with throttling used to prioritize network traffic. As such, communication between the protected site and the recovery site is optimized. WAN Failover Resilience: In accordance with an embodiment of the present invention, data is cached prior to being transmitted to the recovery site. If WAN 320 goes down, the cached data is saved and, as soon as WAN 320 comes up again, the data is sent to the recovery site and both sites are re-synchronized. Single Point of Control: In accordance with an embodiment of the present invention, both the protected and the recovery site are managed from the same client console. Secure Multi-Tenant Solution on Shared Hardware: The present invention enables multiple enterprises to use shared hardware at a recovery site for data replication, while maintaining security between the enterprises, as described hereinbelow with reference to FIGS. 10-13.

(42) As indicated hereinabove, the architecture of FIG. 2 scales to multiple sites having multiple hypervisors. Reference is made to FIG. 5, which is a simplified block diagram of a cross-host multiple hypervisor system 300 that includes data services managers for multiple sites that have multiple hypervisors, in accordance with an embodiment of the present invention. The architecture of FIG. 5 includes three sites, designated Site A, Site B and Site C, the three sites being communicatively coupled via a network 320. Each site includes one or more hypervisors 100. Specifically, Site A includes three hypervisors, 100A/1, 100A/2 and 100A/3, Site B includes two hypervisors, 100B/1 and 100B/2, and Site C includes one hypervisor 100C/1. The sites have respective one or more physical disks 140A, 140B and 140C.

(43) The hypervisors are shown in system 300 with their respective VDSA's 160A/1, 160A/2, . . . , and the other components of the hypervisors, such as the virtual servers 110 and virtual disks 120, are not shown for the sake of clarity. An example system with virtual servers 110 is shown in FIG. 8, and described hereinbelow.

(44) The sites include respective data services managers 310A, 310B and 310C that coordinate hypervisors in the sites, and coordinate hypervisors across the sites.

(45) The system of FIG. 5 may be used for data replication, whereby data at one site is replicated at one or more other sites, for protection. The solid communication lines 330 in FIG. 5 are used for in-site traffic, the dashed communication lines 340 are used for replication traffic between sites, and the dotted communication lines 350 are used for control traffic between data services managers.

(46) Data services managers 310A, 310B and 310C are control elements. The data services managers at each site communicate with one another to coordinate state and instructions. The data services managers track the hypervisors in the environment, and track health and status of the VDSAs 160A/1, 160A/2, . . . .

(47) It will be appreciated by those skilled in the art that the environment shown in FIG. 5 may be re-configured by moving one or more virtual servers 110 from one hypervisor 100 to another, by moving one or more virtual disks 120 from one hypervisor 100 to another, and by adding one or more additional virtual servers 110 to a hypervisor 100.

(48) In accordance with an embodiment of the present invention, the data services managers enable designating groups of specific virtual servers 110, referred to as virtual protection groups, to be protected. For virtual protection groups, write order fidelity is maintained. The data services managers enable designating a replication target for each virtual protection group; i.e., one or more sites, and one or more hypervisors in the one or more sites, at which the virtual protection group is replicated. A virtual protection group may have more than one replication target. The number of hypervisors and virtual servers within a virtual protection group and its replication target are not required to be the same.

(49) Reference is made to FIG. 6, which is a user interface screenshot of bi-directional replication of virtual protection groups, in accordance with an embodiment of the present invention. Shown in FIG. 4 are virtual protection groups 301 (Exchange), 302 (WebApp), 303 (Dummy-R1), 304 (Windows 2003) and 305 (Dummies-L). Arrows 306 indicate direction of replication.

(50) Reference is made to FIG. 7, which is a user interface screenshot of assignment of a replication target for a virtual protection group, in accordance with an embodiment of the present invention. Shown in FIG. 7 is an entry 307 for designating a recovery host, and an entry 308 for designating a recovery datastore for virtual protection group 304 (Windows 2003) of FIG. 6. Respective source and target datastores, [SAN ZeRTO-30] 309A and [datastore1] 309B, are shown as being paired.

(51) More generally, the recovery host may be assigned to a cluster, instead of to a single hypervisor, and the recovery datastore may be assigned to a pool of resources, instead of to a single datastore. Such assignments are of particular advantage when different enterprises share the same physical infrastructure for target replication, as such assignments mask the virtual infrastructure between the different enterprises.

(52) The data services managers synchronize site topology information. As such, a target site's hypervisors and datastores may be configured from a source site.

(53) Virtual protection groups enable protection of applications that run on multiple virtual servers and disks as a single unit. E.g., an application that runs on virtual servers many require a web server and a database, each of which run on a different virtual server than the virtual server that runs the application. These virtual servers may be bundled together using a virtual protection group.

(54) Referring back to FIG. 5, data services managers 310A, 310B and 310C monitor changes in the environment, and automatically update virtual protection group settings accordingly. Such changes in the environment include inter alia moving a virtual server 110 from one hypervisor 100 to another, moving a virtual disk 120 from one hypervisor 100 to another, and adding a virtual server 110 to a hypervisor 100.

(55) For each virtual server 110 and its target host, each VDSA 160A/1, 160A/2, . . . replicates IOs to its corresponding replication target. The VDSA can replicate all virtual servers to the same hypervisor, or to different hypervisors. Each VDSA maintains write order fidelity for the IOs passing through it, and the data services manager coordinates the writes among the VDSAs.

(56) Since the replication target hypervisor for each virtual server 110 in a virtual protection group may be specified arbitrarily, all virtual servers 110 in the virtual protection group may be replicated at a single hypervisor, or at multiple hypervisors. Moreover, the virtual servers 110 in the source site may migrate across hosts during replication, and the data services manager tracks the migration and accounts for it seamlessly.

(57) Reference is made to FIG. 8, which is an example an environment for system 300, in accordance with an embodiment of the present invention. As shown in FIG. 8, system 300 includes the following components.

(58) Site A

(59) Hypervisor 100A/1: virtual servers 110A/1-1, 110A/1-2, 110A/1-3.

(60) Hypervisor 100A/2: virtual servers 110A/2-1, 110A/2-2, 110A/2-3.

(61) Hypervisor 100A/3: virtual servers 110A/3-1, 110A/3-2, 110A/3-3.

(62) Site B

(63) Hypervisor 100B/1: virtual servers 110B/1-1, 110B/1-2, 110B/1-3.

(64) Hypervisor 100B/2: virtual servers 110B/2-1, 110B/2-2, 110B/2-3.

(65) Site C

(66) Hypervisor 100C/1: virtual servers 110C/1-1, 110C/1-2, 110C/1-3, 110C/1-4.

(67) As further shown in FIG. 8, system 300 includes the following virtual protection groups. Each virtual protection group is shown with a different hatching, for clarity.

(68) VPG1 (shown with upward-sloping hatching)

(69) Source at Site A: virtual servers 110A/1-1, 110A/2-1, 110A/3-1 Replication Target at Site B: virtual servers 110B/1-1, 110B/1-2, 110B/2-1
VPG2 (shown with downward-sloping hatching) Source at Site B: virtual servers 110B/1-3, 110B/2-2 Replication Target at Site A: virtual servers 110A/1-2, 110A/2-2
VPG3 (shown with horizontal hatching) Source at Site A: virtual server 110A/3-3 Replication Target at Site B: virtual serer 110B/2-3 Replication Target at Site C: virtual server 110C/1-4
VPG4 (shown with vertical hatching) Source at Site A: virtual servers 110A/1-3, 110A/2-3, 110A/3-2 Replication Target at Site C: virtual servers 110C/1-1, 110C/1-2, 110C/1-3

(70) As such, it will be appreciated by those skilled in the art that the hypervisor architecture of FIG. 2 scales to multiple host sites, each of which hosts multiple hypervisors. The scaling flexibly allows for different numbers of hypervisors at different sites, and different numbers of virtual services and virtual disks within different hypervisors.

(71) The scaling flexibility of the present invention also allows extension to cloud-based data services provided by a cloud provider on a shared infrastructure, as explained hereinbelow.

(72) Cloud-based data services enable data center providers to service multiple enterprises at data centers that are remote from the enterprises. Cloud-based data services offer many advantages. Enterprises that use cloud-based data services obviate the needs for servers, SAN/NAS, networks, communication lines, installation, configuration and ongoing maintenance of information technology systems, and overhead expenses for electricity, cooling and space. However, conventional cloud-based data suffer from weakness of security due to multiple enterprises sharing the same physical infrastructure, and due to multiple enterprises using the same networks and IPs for their services.

(73) Cloud-based systems of the present invention overcome these weaknesses. Reference is made to FIG. 9, which is a simplified block diagram of a system 500 for multi-tenant and multi-site cloud-based data services, in accordance with an embodiment of the present invention. Shown in FIG. 9 are three enterprises, designated A, B and C, and a remote cloud-based facility 490 with two data centers, designated 1 and 2. Enterprise A uses a NETAPP data management system, Enterprise B uses an IBM data management system, and Enterprise C uses an EMC2 data management system. Data Center 1 uses an EMC2 data management system and services Enterprise A. Data Center 2 uses a NETAPP data management system and services Enterprises B and C.

(74) System 500 has many advantages over conventional data service systems. Inter alia, system 500 enables protection of heterogenic environments, enables remote control of enterprise sites, enables economies of scale, enables complete workload mobility, enables a complete web services API for seamless integration, and enables integration with other cloud-based management systems.

(75) Reference is made to FIG. 10, which is a simplified block diagram of a first architecture of system 500 for providing hypervisor level multi-tenant cloud-based data services, in accordance with an embodiment of the present invention. The architecture shown in FIG. 10 includes two enterprises; namely, a smaller enterprise A and a larger enterprise B. Enterprise A infrastructure includes a single hypervisor 100A/1 with five virtual servers 100A/1-1, 100A/1-2, 100A/1-3, 100A/1-4 and 100A/1-5 and a VDSA 160A/1, includes two physical disks 120A-1 and 120A-2, and includes a data services manager 310A. Enterprise B infrastructure includes two hypervisors 100B/1 and 100B/2, includes three physical disks 120B-1, 120B-2 and 120B-3, and a data services manager 310B. Hypervisor 100B/1 includes five virtual servers 100B/1-1, 100B/1-2, 100B/1-3, 100B/1-4 and 100B/1-5 and a VDSA 160B/1; and hypervisor 100B/2 includes five virtual servers 100B/2-1, 100B/2-2, 100B/2-3, 100B/2-4 and 100B/2-5 and a VDSA 160B/2.

(76) Cloud-based facility 490 infrastructure includes two hypervisors 400/1 and 400/2, and four physical disks 420-1, 420-2, 420-3 and 420-4. Hypervisor 400/1 includes six virtual servers 410/1-1, 410/1-2, 410/1-3, 410/1-4, 410/1-5 and 410/1-6; and hypervisor 400/2 includes two virtual servers 410/2-1 and 410/2-2. Hypervisor 400/1 services Enterprises A and B, and hypervisor 400/2 services Enterprise B. As such, the infrastructure of cloud-based facility 490 is shared between Enterprises A and B.

(77) The architecture of FIG. 10 allocates one data services manager per enterprise and one VDSA per hypervisor. Specifically, hypervisor 400/1 includes a VDSA 460/1 and hypervisor 400/2 includes a VDSA 460/2. A data services manager 510A services Enterprise A, and a data services manager 510B services Enterprise B.

(78) Reference is made to FIG. 11, which is a simplified block diagram of a second architecture of system 500 for providing hypervisor level multi-tenant cloud-based data services, in accordance with an embodiment of the present invention. The architecture of FIG. 11 allocates one data services manager per enterprise and one VDSA per enterprise per hypervisor. Specifically, hypervisor 400/1 includes a VDSA 460A/1 for Enterprise A and a VDSA 460B/1 for Enterprise B, and hypervisor 400/2 includes a VDSA 460B/2 for Enterprise B.

(79) Reference is made to FIG. 12, which is a simplified block diagram of a third architecture of system 500 for providing hypervisor level multi-tenant cloud-based data services, in accordance with an embodiment of the present invention. The architecture of FIG. 12 allocates one data services manager in the cloud, and one VDSA per hypervisor. In addition, one enterprise connector is allocated per enterprise. Specifically, a connector 480A is allocated to Enterprise A, and a connector 480B is allocated to Enterprise B. Connector 480A is connected to both VDSA 460/1 and VDSA 460/2 and to a cloud data services manager 510 on the cloud side, and is connected to Enterprise A data services manager 310A and VDSA 160A/1 on the enterprise side. Similarly, connector 480B is connected to VDSA 460/1, VDSA 460/2 and cloud data services manager 510 on the cloud side, and is connected to Enterprise B data services manager 310B, VDSA 160B/1 and VDSA 160B/2 on the enterprise side. As such, each enterprise is connected to the entire infrastructure on the cloud side via its own connector.

(80) Reference is made to FIG. 13, which is a simplified block diagram of a fourth architecture of system 500 for providing hypervisor level multi-tenant cloud-based data services, in accordance with an embodiment of the present invention. The architecture of FIG. 13 also allocates one data services manager in the cloud, and one VDSA per hypervisor. In addition, one enterprise connector is allocated per enterprise. Connectors 480A and 480B on the cloud side are paired with respective connectors 380A and 380B on the enterprise side. Use of connectors 380A and 380B eliminates the need for a virtual private network (VPN), and enables installation of system 500 behind network address translators (NATs).

(81) The different architectures in FIGS. 10-13 offer different advantages. The architecture of FIG. 10 minimizes the cloud footprint of the VDSA, by using a shared VDSA per hypervisor, and only one data services manager per enterprise. Specifically, the VDSA is shared between enterprises and security is enforced via the data services managers. In this architecture, the data services manager is duplicated per enterprise and centralized cloud management is lacking.

(82) The architecture of FIG. 11 maximizes data path security for enterprises, but the cloud footprint is larger, since multiple data services managers may be required per hypervisor.

(83) The architectures of FIGS. 12 and 13 provides data security, network security, minimal cloud footprint, and single point of control for cloud vendors. In this architecture, there is only one centralized data service manager on the cloud side, and only one VDSA per hypervisor. One cloud connector element is deployed on the cloud side, per enterprise. The cloud connector securely routes enterprise traffic from the enterprise network to the cloud infrastructure replication network, thus providing full network security and deployment features, including inter alia duplicate IP range utilization for different enterprises while maintaining unique network deployment on the cloud infrastructure side. The data services manager and VDSA's perform secure site authentication and data security, for end-to-end secure multi-tenant service.

(84) As such, it will be appreciated by those skilled in the art that the cloud-based hypervisor level data services systems of the present invention enable multi-tenancy and multi-site services. I.e., multiple enterprises and multiple sites may be serviced by the same physical infrastructure including inter alia the same hypervisors and storage, with minimized footprint on the cloud side, allowing for centralized cloud management. By providing each enterprise with its own data services manager on the clod side, as in FIGS. 10 and 11, or alternatively with its own connector and a centralized data services manager on the cloud side, as in FIGS. 12 and 13, the systems of the present invention provide path separation between enterprises, thus ensuring that each enterprise is only able to view and access his own virtual servers and storage, and each enterprise can only control its own data replication.

(85) By deploying additional cloud connectors on the enterprise side, as in FIG. 13, the systems of the present invention may be installed behind NATs, and do not require a VPN. As such, these systems may obviate VPN setups for enterprises, and obviate use of dedicated public IPs. For additional security, the cloud connectors encrypt traffic, thus eliminating the need for additional network security elements.

(86) The systems of the present invention provide bi-directional cloud-based data replication services; i.e., from an enterprise to the cloud, and from the cloud to an enterprise, for the same enterprise or for different enterprises, simultaneously using the same shared infrastructure. Moreover, replication targets may be set as resources that do not expose the enterprise infrastructure, thus providing an additional layer of security and privacy between enterprises.

(87) It will be appreciated by those skilled in the art that systems of the present invention may be used to enforce jurisdictional data export regulations. Specifically, cloud-based facility 490 infrastructure is partitioned according to jurisdictions, and data recovery and failover for an enterprise is limited to one or more specific partitions according to jurisdictional regulations.

(88) Reference is made to FIG. 14, which is a simplified block diagram of a system 600 for multi-tenant and multi-site cloud-based data services with jurisdictional data separation, in accordance with an embodiment of the present invention. Shown in FIG. 14 are three jurisdictional enterprises; namely, a USA Enterprise A, a UK Enterprise B, and an APAC Enterprise C. Also shown in FIG. 14 are four data centers; namely, Data Center 1 and Data Center 2 in the USA, Data Center 3 in the UK and Data Center 4 in APAC.

(89) Privacy and data security regulations prevent data from being exported from one jurisdiction to another. In order to enforce these regulations, system 600 includes a rights manager 610 that blocks access to a data center by an enterprise if data export is regulations restrict data transfer between their respective jurisdictions. Thus rights manager 610 blocks access by Enterprise A to Data Centers 3 and 4, blocks access by Enterprise B to Data Centers 1, 2 and 4, and blocks access by Enterprise C to Data Centers 1, 2, and 3. Enterprises A, B and C may be commonly owned, but access of the data centers by the enterprises is nevertheless blocked, in order to comply with data export regulations.

(90) In accordance with an embodiment of the present invention, when configuring a virtual protection group, an administrator may set a territory/data center restriction. When the administrator subsequently selects a destination resource for data replication for a virtual protection group, system 600 verifies that the resource is located in a geography that does not violate a territory/data center restriction.

(91) The present invention may be implemented through an application programming interface (API), exposed as web service operations. Reference is made to Appendices I-V, which define an API for virtual replication web services, in accordance with an embodiment of the present invention.

(92) It will thus be appreciated that the present invention provides many advantages, including inter alia: heterogeneous hypervisor replication, for different types of sources and target hypervisor; e.g., from a VMWARE hypervisor to a XEN hypervisor; heterogeneous storage replication, for different types of storage systems; e.g., from an EMC storage system to a NETAPP storage systems; bi-directional replication, whereby one enterprise may replicate from the enterprise to a cloud data center, while another enterprise simultaneously replicates from a cloud data center back to the enterprise; and security, whereby the cloud infrastructure is not exposed.

(93) Aspects of the present invention provide disaster recovery systems with calendar-based, or date and time-based, RPO objectives and bandwidth allocations, thereby achieving greater flexibility and cost effectiveness vis--vis conventional single-RPO systems.

(94) Using the present invention, a disaster recovery system may share a link between sites for replication and applications, and effectively cope with varying application change rates. The disaster recovery system may set a higher RPO objective during peak times and a lower RPO objective during off-peak times, limit data replication bandwidth during peak times, and relax data replication bandwidth during off-peak times. The disaster recovery system may use the different RPO objectives to advantage for allowing as much bandwidth as possible for production, taking into account that a higher RPO objective is met during peak times, while catching up afterwards during off-peak times when the RPO objective is lower.

(95) Conversely, the disaster recovery system may set a lower RPO objective during peak times and a higher RPO objective during off-peak times, to enable sharing the link with other systems during off-peak times.

(96) In accordance with an embodiment of the present invention, a control element is installed, to control bandwidth at a site level, protection group level. The control element monitors RPO objective in accordance with a calendar-based, or a date and time-based schedule.

(97) In accordance with an embodiment of the present invention, a disaster recovery system may set different limits for data seeding traffics vs. data replication traffic over a WAN.

(98) Reference is made to FIG. 15, which is a screen shot of a multi-RPO console for a disaster recovery application, in accordance with an embodiment of the present invention. The data recovery policy shown in FIG. 15 designates four timeframes, each timeframe having its own RPO objective and bandwidth limitation. The timeframes are scheduled using a weekly calendar. Timeframe 1 corresponds to 12:00 AM-4:00 AM, Mon.-Sun. Timeframe 2 corresponds to 4:00 AM-8:00 AM, Mon.-Thurs. Timeframe 4 corresponds to 8:00 AM-2:00 PM, Mon.-Fri. and 2:00 PM-6:00 PM, Mon.-Thurs. Timeframe 3 corresponds to the remainder of the week.

(99) Reference is made to FIG. 16, which is a simplified block diagram of an exemplary multi-RPO data protection system, in accordance with an embodiment of the present invention. Shown in FIG. 16 are a protected site 700 and a replication site 800. Protected site 700 includes a vCenter server 710, ESX/ESXi hypervisors 720 and 730, and physical disks 740, 750 and 760. Server 710 includes a virtual manager 715. Hypervisor 720 includes virtual machines 721,722 and 723, and hypervisor 730 includes virtual machines 731, 732 and 733. Hypervisors 720 and 730 also include respective virtual replication appliances 725 and 735. Physical disk 740 includes virtual disks 741 and 742, physical disk 750 includes virtual disks 751 and 752, and physical disk 760 includes virtual disks 761 and 762. Physical disks 740, 750 and 760 may be heterogeneous; e.g., physical disk 740 may be a NETAPP disk, physical disk 750 may be an IBM disk, and physical disk 760 may be an EMC.sup.2 disk.

(100) Replication site 800 includes a vCenter server 810, an ESX/ESXi hypervisor 820, and physical disks 840 and 850. Server 810 includes a virtual manager 815. Hypervisor 820 includes virtual machines 821, 822 and 823. Hypervisor 820 also includes a virtual replication appliance 825. Physical disk 840 includes virtual disks 841 and 842, and physical disk 850 includes virtual disks 851 and 852. Physical disks 840 and 850 may be heterogeneous; e.g., physical disk 840 may be a NETAPP disk, and physical disk 850 may be an EMC.sup.2 disk.

(101) Reference is made to FIG. 17, which is a simplified flow diagram of a method for multi-RPO data protection, in accordance with an embodiment of the present invention. At operation 1010 virtual manager 715 accesses a calendar-based schedule of RPO objectives and corresponding bandwidth allocations. At operation 1020 virtual manager 715 retrieves the designated RPO for a virtual protection group and the designated bandwidth allocation, for a given date and time, in accordance with the schedule. At operation 1030 virtual manager 715 limits bandwidth usage of a disaster recovery system for replicating data for the virtual protection group, based on the retrieved designated bandwidth allocation. At operation 1040 virtual manager 715 determines the current RPO for the virtual protection group.

(102) At operation 1050 virtual manager 715 determines whether or not the current RPO, determined at operation 1040, exceeds the designated RPO retrieved at operation 1020. If so, then at operation 1060 virtual manager 715 issues a virtual protection group RPO alert. Otherwise, at operation 1070, virtual manager 715 turns off the virtual protection group RPO alert.

(103) In an embodiment of the present invention, virtual manager 715 is operative to adjust the schedule of RPO objectives and corresponding bandwidth allocations in response to having issued multiple RPO alerts at operation 1060.

(104) An RPO alert is a notification to an operator, generally indicating a data replication write rate that is too high relative to a bandwidth constraint, which in turn means that there is a service level agreement issue or risk to be addressed. For conventional disaster recovery systems, because of the difference between peak and off-peak data write demands, some RPO alerts are expected, and represent warnings that can be ignored, and other RPO alerts are not expected and represent serious concernswhich is generally confusing to the operator.

(105) By using the present invention to schedule RPO objectives in accordance with peak and off-peak write demand times, ignorable RPO alerts are avoided, and the operator knows that the RPO alerts that are issued represent serious concerns that need to be addressed.

(106) In the foregoing specification, the invention has been described with reference to specific exemplary embodiments thereof. It will, however, be evident that various modifications and changes may be made to the specific exemplary embodiments without departing from the broader spirit and scope of the invention as set forth in the appended claims. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.