H03M7/3088

Data compression for columnar databases into arbitrarily-sized persistent pages
11824565 · 2023-11-21 · ·

A method for compressing columnar data may include generating, for a data column included in a data chunk, a dictionary enumerating, in a sorted order, a first set of unique values included in the first data column. A compression technique for generated a compressed representation of the data column having a fewest quantity of bytes may be identified based at least on the dictionary. The compression technique including a dictionary compression applying the dictionary and/or another compression technique. A compressed data chunk may be generated by applying the compression technique to compress the data column included in the data chunk. The compressed data chunk may be stored at a database in a variable-size persistent page whose size is allocated based on the size of the compressed representation of the data column. Related systems and articles of manufacture are also provided.

Encoding / Decoding System and Method
20230125345 · 2023-04-27 ·

A computer-implemented method, computer program product and computing system for: processing an unencoded data file to identify a plurality of file segments, wherein the unencoded data file is a dataset for use with an ML process; mapping each of the plurality of file segments to a portion of a dictionary file to generate a plurality of mappings that each include a starting location and a length, thus generating a related encoded data file based, at least in part, upon the plurality of mappings; receiving a request to manipulate the unencoded data file from the ML process; and processing the related encoded data file based, at least in part, upon the plurality of mappings and the dictionary file to generate a modified encoded data file that represents the requested manipulations of the unencoded data file.

Encoding / Decoding System and Method
20230128017 · 2023-04-27 ·

A computer-implemented method, computer program product and computing system for: processing an unencoded data file to identify a plurality of file segments; mapping each of the plurality of file segments to a portion of a dictionary file to generate a plurality of mappings that each include a starting location and a length, thus generating a related encoded data file based, at least in part, upon the plurality of mappings; receiving a request to manipulate the unencoded data file; and processing the related encoded data file based, at least in part, upon the plurality of mappings and the dictionary file to generate a modified encoded data file that represents the requested manipulations of the unencoded data file.

Encoding / Decoding System and Method
20230119517 · 2023-04-20 ·

A computer-implemented method, computer program product and computing system for: receiving an unencoded data file; processing the unencoded data file to identify a plurality of file segments; mapping each of the plurality of file segments to a portion of a dictionary file, thus generating a plurality of mappings, wherein each of the plurality of mappings includes a starting location and a length; and generating a related encoded data file based, at least in part, upon the plurality of mappings.

Encoding / Decoding System and Method
20230117293 · 2023-04-20 ·

A computer-implemented method, computer program product and computing system for: processing an unencoded data file to identify a plurality of file segments; mapping each of the plurality of file segments to a portion of a dictionary file to generate a plurality of mappings, wherein each of the plurality of mappings includes a starting location and a length, thus generating a related encoded data file based, at least in part, upon the plurality of mappings; and storing the related encoded data file at a first location.

Encoding / Decoding System and Method
20230118450 · 2023-04-20 ·

A computer-implemented method, computer program product and computing system for: processing an unencoded data file to identify a plurality of file segments wherein the unencoded data file is a dataset for use with a short-range wireless communication platform; mapping each of the plurality of file segments to a portion of a dictionary file to generate a plurality of mappings, wherein each of the plurality of mappings includes a starting location and a length, thus generating a related encoded data file based, at least in part, upon the plurality of mappings; and transmitting the related encoded data file from a first location to a second location using the short-range wireless communication platform.

Encoding / Decoding System and Method
20230120900 · 2023-04-20 ·

A computer-implemented method, computer program product and computing system for: encoding a first data file to generate a related encoded data file based, at least in part, upon a plurality of mappings to a plurality of portions of a dictionary file; receiving a request to manipulate the first data file; and processing the related encoded data file based, at least in part, upon the plurality of mappings and the dictionary file to generate a modified encoded data file that represents the requested manipulations of the first data file.

Encoding / Decoding System and Method
20230122351 · 2023-04-20 ·

A computer-implemented method, computer program product and computing system for: processing an unencoded data file to identify a plurality of file segments, wherein the unencoded data file is a dataset for use with a satellite-based communication network; mapping each of the plurality of file segments to a portion of a dictionary file to generate a plurality of mappings, wherein each of the plurality of mappings includes a starting location and a length, thus generating a related encoded data file based, at least in part, upon the plurality of mappings; and transmitting the related encoded data file from a first location to a second location using the satellite-based communication network.

Encoding / Decoding System and Method
20230122581 · 2023-04-20 ·

A computer-implemented method, computer program product and computing system for: processing an unencoded data file to identify a plurality of file segments; mapping each of the plurality of file segments to a portion of a dictionary file to generate a plurality of mappings, wherein each of the plurality of mappings includes a starting location and a length, thus generating a related encoded data file based, at least in part, upon the plurality of mappings; and transmitting the related encoded data file from a first location to a second location.

Encoding / Decoding System and Method
20230122359 · 2023-04-20 ·

A computer-implemented method, computer program product and computing system for: encoding an unencoded data file to generate a related encoded data file based upon a plurality of mappings to a plurality of portions of a dictionary file; receiving a request to manipulate the unencoded data file, wherein the request would require a first sequence of operations to be performed on the unencoded data file; and processing the related encoded data file based, at least in part, upon the plurality of mappings and the dictionary file to generate a modified encoded data file, wherein processing the related encoded data file includes performing the first sequence of operations on the encoded data file to achieve the requested manipulations of the unencoded data file.