Methods are provided for efficiently encoding and decoding multivariate correlated data sequences for transmission over multiple channels of a network. The methods include transforming data vectors from correlated sources into vectors that comprise substantially independent and correlated components, and generating a common information vector based on the correlated components, and two private information vectors. The methods also include computing the amount of information, such as Wyner's lossy common information, in the common information vector, computing rates that lie on the Gray-Wyner rate region, and choosing compression rates based on the amount of common information. The methods may be applicable, in general, to a wide range of communications and/or storage systems and, particularly, to sensor networks and multi-user virtual environments for gaming and other applications.

Certain aspects of the present disclosure provide techniques for performing federated learning, including receiving a global model from a federated learning server; determining an updated model based on the global model and local data; and sending the updated model to the federated learning server using relative entropy coding.

A method, which is performed by a computer for management of distributed data, includes: associating device information items including information acquired from devices with first identification information items to be used to identify the devices and storing the device information items and the first identification information items in a storage device; calculating co-occurrence probabilities of combinations of the associated first identification information items for the device information items stored in the storage device; assigning second identification information items to the first identification information items based on the co-occurrence probabilities; generating compressed data by compressing the device information items using the second identification information items assigned to the first identification information items associated with the device information items upon the compression of the device information items; and transmitting the compressed data to a managing device.

There is provided a communication system (100) comprising: a first network node (200) that transmits a flow of data records to a second network node (300) via a network (500), the second network node having a data record processing module (600) that receives and processes the data records; and a controller (700) for controlling the transmission of data records by the first network node. The controller comprises: an acquisition.sub.7, -dule (710) operable to acquire data records of the flow of data records; a pattern recognition module (720) arranged to determine whether the data records acquired by the acquisition module (710) follow a pattern of one or more patterns each defining a respective sequence of data records and, when the acquired 'ata records follow a pattern of the one or more patterns, to determine which of the one or more patterns is being followed; aa control signal generator module (730) that generates, when the pattern recognition module has determined a pattern being followed by the acquired data records, an indication of the pattern being followed and at least one transmission control signal for the first network node to prevent the first network node from transmitting remaining data records to the second network node which correspond to data records that complete the sequence of data records defined by the pattern being followed. The system (100) also includes a pattern handler (800) having a data store (820) that stores the one or more patterns, the pattern handler being communicatively coupled to the data record processing module (600) via a communication path (900) that is separate from the network and responsive to the indication to predict the remaining data records using the pattern of the stored patterns that is indicated by the indication, and provide the predicted data records to the data record processing module (600) via the communication path (900).

Systems, devices and methods for adaptive compression of stored information includes a memory management computing device programmed to monitor a size of a plurality of data structures stored in a data repository. The computing device compares the size of each of a plurality of data structures to a predetermined threshold. When a size of an uncompressed data structure meets the threshold, the memory management computing device calculates a value of a first compression parameter based on a value of a first parameter and a value of a second parameter of each data element of the uncompressed data structure, calculates a value of a second compression parameter based the value of the first parameter of each data element of the uncompressed data structure, generates a compressed data structure based on the value of the first compression parameter and the second compression parameter; and replaces, in the data repository, the uncompressed data structure with the compressed data structure.

Various embodiments for data compression by a processor. Levels of data distribution are configured for data processing, including a first level of the data distribution incorporating a GRID network of data storage nodes, and a second level of the data distribution incorporating a GRID network of compressive nodes in communication with the GRID network of data storage nodes. Input/output (I/O) for an associated storage volume is load balanced between the data storage nodes, as data passes through the first level into the second level to be compressed or uncompressed.

Systems, devices and methods for adaptive compression of stored information includes a memory management computing device programmed to monitor a size of a plurality of data structures stored in a data repository. The computing device compares the size of each of a plurality of data structures to a predetermined threshold. When a size of an uncompressed data structure meets the threshold, the memory management computing device calculates a value of a first compression parameter based on a value of a first parameter and a value of a second parameter of each data element of the uncompressed data structure, calculates a value of a second compression parameter based the value of the first parameter of each data element of the uncompressed data structure, generates a compressed data structure based on the value of the first compression parameter and the second compression parameter; and replaces, in the data repository, the uncompressed data structure with the compressed data structure.

Certain aspects of the present disclosure provide data compression and channel coding techniques for variable length payloads. A method performed at a wireless node may include obtaining a payload for transmission, compressing the payload using a variable length compression technique to obtain a compressed payload having compressed payload bits of a first length, adding padding bits to the compressed payload to obtain a padded compressed payload. The padded compressed payload comprises information bits including the compressed payload bits and the padding bits. The method further includes encoding the padded compressed payload and outputting the encoded padded compressed payload.