Patent classifications
H03M7/6082
System and method for effective compression, representation and decompression of diverse tabulated data
A method for controlling compression of data includes accessing genomic annotation data in one of a plurality of first file formats, extracting attributes from the genomic annotation data, dividing the genomic annotation data into multiple chunks, and processing the extracted attributes and chunks into correlated information. The method also includes selecting different compressors for the attributes and chunks identified in the correlated information and generating a file in a second file format that includes the correlated information and information indicative of the different compressors for the chunks and attributes indicated in the correlated information. The information indicative of the different compressors is processed into the second file format to allow selective decompression of the attributes and chunks indicated in correlated information.
Power-aware transmission of quantum control signals
A computer-implemented method of selecting a power-optimal compression scheme for transmitting digital control signals from a classical interface of a quantum computer to a quantum processing unit (QPU) of the quantum computer is disclosed. The method involves receiving static and dynamic power consumption values associated with operations performable by the QPU; determining compression schemes implementable by the QPU; calculating total power consumption values associated with receiving and decompressing a representative control signal at the QPU using the compression schemes; and selecting the compression scheme having the lowest total power consumption value. A corresponding method for transmitting control signals from a classical interface of the quantum computer to the QPU is also disclosed in which a compressed control signal is transmitted from the classical interface to the QPU with one or more delays.
Optimizing storage-related costs with compression in a multi-tiered storage device
Some techniques described herein relate to determining how to optimally store datasets in a multi-tiered storage device with compression. In one example, a method includes assigning, to a data partition of a dataset, a priority based on access patterns of the data partition. Compression data is accessed describing results of compressing a data sample associated with the data partition using multiple compression schemes. Based both on the priority of the data partition and the compression data, a storage tier is determined for storing the data partition in the multi-tiered storage device. Further, based both on the priority of the data partition and the compression data, a compression scheme is determined for compressing the data partition for storage in the multi-tiered storage device. The data partition is compressed using the compression scheme to produce a compressed data partition, and the compressed data partition is stored in the storage tier.
DATA COMPRESSION FOR COLUMNAR DATABASES INTO ARBITRARILY-SIZED PERSISTENT PAGES
A method for compressing columnar data may include generating, for a data column included in a data chunk, a dictionary enumerating, in a sorted order, a first set of unique values included in the first data column. A compression technique for generated a compressed representation of the data column having a fewest quantity of bytes may be identified based at least on the dictionary. The compression technique including a dictionary compression applying the dictionary and/or another compression technique. A compressed data chunk may be generated by applying the compression technique to compress the data column included in the data chunk. The compressed data chunk may be stored at a database in a variable-size persistent page whose size is allocated based on the size of the compressed representation of the data column. Related systems and articles of manufacture are also provided.
Computer-readable recording medium storing information processing program, information processing method, and information processing apparatus
A recording medium stores an information processing program for managing a plurality of storage devices and a plurality of servers. The program causes a computer to execute a process including: while changing a compression ratio setting, obtaining an actual compression ratio by using some of data pieces to be used by the plurality of servers and a decompression rate at which the servers decompress a compressed dataset in which the some data pieces are compressed; and determining the compression ratio setting to be used based on a maximum total bandwidth of the plurality of storage devices and a number of the plurality of servers by using the obtained actual compression ratio and the decompression rate for each of the compression ratio settings.
METHOD, APPARATUS, AND COMPUTER PROGRAM PRODUCT FOR DETERMINING DATA TRANSFER MANNER
The present disclosure provides a method, apparatus and computer program product for determining a data transfer manner. The method comprises determining a first transfer completion time for transferring a data block from a first device to a second device without compression; determining a second transfer completion time for transferring the data block from the first device to the second device with the compression performed; and selecting, based on a comparison of the first and second transfer completion time, a transfer manner for the data block from a first transfer manner comprising compressing the data block and transferring the compressed data block and a second transfer manner of directly transferring the data block without compression. Through the embodiments, compressing and uncompressing are evaluated based on the transfer completion time before data transfer, so as to select a transfer manner suitable for data to be transferred and for devices that perform data transfer.
INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND RECORDING MEDIUM STORING PROGRAM
An information processing apparatus includes: a processor; and a processing circuit coupled to the processor, wherein the processing circuit is configured to: generate compressed data by compressing send data; and determine whether to transmit the compressed data or the send data before the compression to a network, based on a size of the compressed data, and wherein the processor is configured to transmit the compressed data or the send data before the compression to the network, based on a result of the determination.
System, Apparatus And Method For Dynamic Priority-Aware Compression For Interconnect Fabrics
In one embodiment, an apparatus includes: a compression circuit to compress data blocks of one or more traffic classes; and a control circuit coupled to the compression circuit, where the control circuit is to enable the compression circuit to concurrently compress data blocks of a first traffic class and not to compress data blocks of a second traffic class. Other embodiments are described and claimed.
Device and method of compressing data using tiered data compression
A processing device is provided which includes a plurality of encoders each configured to compress a portion of data using a different compression algorithm. The processing device also includes one or more processors configured to cause an encoder, of the plurality of encoders, to compress the portion of data when it is determined that the portion of data, which is compressed by another encoder configured to compress the portion of data prior to the encoder in an encoder hierarchy, is not successfully compressed according to a compression metric by the other encoder in the encoder hierarchy. The one or more processors are also configured to prevent the encoder from compressing the portion of data when it is determined that the portion of data is successfully compressed according to the compression metric by the other encoder in the encoder hierarchy.
USE OF DATA PREFIXES TO INCREASE COMPRESSION RATIOS
A data compression system includes a memory to store a plurality of predetermined prefixes corresponding to a plurality of classes of data. A classifying module is configured to receive data, receive a class of the data, and select a prefix to compress the data from the plurality of predetermined prefixes based on the data and the class of the data. A compressing module is configured to compress the data using the prefix. A header generating module is configured to generate a header including an indication of the prefix used to compress the data, and to output the header and the compressed data for storage or transmission. Using the prefix from the predetermined prefixes to compress the data eliminates an overhead of fetching the prefix from outside the data compression system.