The invention relates to a method for managing a buffer memory space associated with a persistent data storage system of a computing machine. The buffer memory space is suitable for temporarily storing in the RAM of the machine one or more portions of a single data file of the persistent data storage system that was previously accessed by one or more processes executed on the machine. The operating system of the machine tracks each of the portions of the file that are projected in the buffer memory space by a descriptor belonging to a plurality of buffer memory projection descriptors which are all associated with the tracking of one or more portions of the file projected in the buffer memory space.

A network system for providing long haul network connection between endpoint devices is disclosed. The network system includes a first and a second endpoint devices, a first and a second exchange servers, a first access point server coupled between the first endpoint device and the first exchange server, a second access point server coupled between the second endpoint device and the second exchange server, a first storage node coupled between the first exchange server and the second exchange server, and a second storage node coupled between the first exchange server and the second exchange server. The first exchange server is configured to convert first packetized traffic into a carrier file and write the carrier file to the second storage node. The second exchange server is configured to read the carrier file from the second storage node and convert the carrier file into second packetized traffic.

A management server in a parallel data system stores a correspondence-relationship between a first response-time for communication-processing and a second response-time for data-processing, executed by each of a plurality of data servers in relation to first processing by a client node, acquires, at a time of execution of second processing by the client node, a third response-time desired for communication-processing and a fourth response-time desired for data-processing, which are related to second processing, in each of a plurality of data servers, based on the first response-time and the second response-time, determines combinations of the data servers used to execute the second processing, based on the third response-time and fourth response-time, and selects a combination that satisfies a response-time to be satisfied by the second processing and that includes a smallest number of processor cores allocated to the communication-processing of a data server, among the determined combinations.

Described is a system for cloud-based processing of backup data for storage onto various types of object storage systems. A specialized cloud-based component (e.g. proxy server) may act as an intermediary when backing up data from a client system to an object storage. For example, the cloud-based component may be provided as part of backup service that operates in conjunction with a client system. Accordingly, the system may allow different clients of a backup service to efficiently and seamlessly interact with the different third-party object storage providers via a single cloud-based component. To provide such object-storage-agnostic functionality, the cloud-based component may include a function library that includes object-storage-specific functions. For example, the cloud-based component may invoke a specific set of operations that interact with a storage API provided by a particular object storage provider.

Systems and methods include reception of a request for changed data of an object from a subscriber, determination of a logging table associated with the object and comprising a plurality of logging table entries, determination of a pointer to a last-processed entry of the logging table based on the object and the subscriber, definition of a plurality of sub-portions of logging table entries subsequent to the last-processed entry, and reconstruction and transfer of first data associated with a first one of the plurality of sub-portions to the subscriber using a first process, and reconstruction and transfer, in parallel with the first process, second data associated with a second one of the plurality of sub-portions to the subscriber using a second process.

The subject technology receives an operation to perform on an external data source accessible via a network, the external data source being hosted by an external system separate from a network-based database system. The subject technology determines a set of shards corresponding to the external data source. The subject technology determines a set of offsets of each shard of the set of shards. The subject technology, based on the set of shards and the set of offsets, performs the operation on the external data source. The subject technology provides an indication that the operation is complete.

The present invention contemplated the use of Change Data Capture (CDC) between a source database and a target database. To execute CDC, one or more computer processors execute the steps of obtaining a plurality of log records comprising information on transactions processed in the source database, grouping the plurality of log records into a plurality of groups based on a predetermined condition, and determining that the plurality of obtained log records is to be replicated from the source database to the target database in parallel in a unit of a group.

Creating a modifiable cloned image of a dataset, including: generating, based on a dataset stored within a source data repository, a tracking copy of replica data on a target data repository; generating, after receiving an indication to begin accepting modifications to the tracking copy of the replica data, a cloned image of the dataset that is modifiable without modifying the tracking copy of the replica data; and responsive to a storage operation directed to the target data repository, modifying the cloned image of the dataset without modifying the tracking copy of the replica data.

A method, apparatus, and computer program product uses a SELECT FOR UPDATE, to pick up events from a TARGET_EVENT table. Selected events are reserved for processing by a cluster node which triggers a query. PICKUP_TIME and SERVER_ID values are inserted for each of the events picked from the TARGET_EVENT table. The events are grouped by TARGET and UID while preserving a relative order in an overall event sequence. A group of events is then submitted for processing.

Systems and methods for providing data beacons are disclosed. In some embodiments the system can include a first node and a second node. Each node includes a read queue, a write queue and a parallel file system. Data is written from the write queue on the first node to the parallel file system on the second node and from the write queue on the second node to the parallel file system on the first node. The read queue on each node receives data from the parallel file system on the node itself.