Patent classifications
G06F12/0261
Fast and safe storage space reclamation for a data storage system
The disclosed technology generally describes efficient garbage collection operations based on chunk filters (e.g., Bloom filters) maintained in association with object table partitions (e.g., trees). When an object update impacts a chunk, a corresponding chunk filter is updated, using the chunk's identifier as a chunk filter key by hashing the chunk identifier into chunk filter locations and setting bits at those locations. When garbage collection occurs, a garbage collection candidate chunk's identifier is similarly hashed to read the bit values at those locations in the chunk filters for the partitions. If any bit is zero, the chunk is definitely not in use in a partition; if no chunk filter for any partition indicates the candidate chunk is possibly in use, the chunk is garbage collected without tree scanning. If tree scanning is needed, only the partition(s) with an associated chunk filter that indicates “possibly in use” need to be scanned.
Data partitioning and ordering
Described are methods, systems and computer readable media for data partitioning and ordering.
Query task processing based on memory allocation and performance criteria
Described are methods, systems and computer readable media for query task operations based on memory allocation and performance criteria.
Automatic reference counting
In a method for automatic reference counting, source code with automatic reference counting is executed, such that the source code executes an object destructor on demand irrespective of whether there are live references to an object, wherein the object destructor marks the object as disposed without freeing a portion of memory associated with the object and without impacting validity of a reference to the object. The object destructor is executed during execution of the source code, wherein the object destructor is for use in an explicit disposal process of a reference associated with the source code, wherein the object destructor collects a reference, removes the reference from being a live reference, and marks the object as disposed of.
Computer data distribution architecture
Described are methods, systems and computer readable media for computer data distribution architecture.
SINGLE INPUT GRAPHICAL USER INTERFACE CONTROL ELEMENT AND METHOD
Described are methods, systems and computer readable media for GUI control elements and associated processing methods.
Memory system and method for controlling nonvolatile memory
According to one embodiment, a memory system manages a plurality of management tables corresponding to a plurality of first blocks in a nonvolatile memory. Each management table includes a plurality of reference counts corresponding to a plurality of data in a corresponding first block. The memory system copies a set of data included in a copy-source block for garbage collection and corresponding respectively to reference counts belonging to a first reference count range to a first copy-destination block, and copies a set of data included in the copy-source block and corresponding respectively to reference counts belonging to a second reference count range having a lower limit higher than an upper limit of the first reference count range to a second copy-destination block.
Managing objects stored in memory
A method for managing objects stored in memory is presented. The method may include receiving, by a memory allocator in a garbage collected system, a first free memory chunk. The method may include creating a node to associate with the first free memory chunk and ensuring that a first memory region containing the node will be considered to be free memory during a sweeping phase of the garbage collected system.
Garbage collection based on transmission object models
System generates data structure based on unique identifiers of objects in object storages and sets indicators in positions that correspond to hashes of unique identifiers of active objects. If a first number of regions of active data objects in first data storage and second number of regions of active data objects in second data storage each fail to satisfy data threshold, then system creates model identifying locations and sizes of regions of active data objects in first data storage and regions of active data objects in second data storage. System resets indicators in positions in data structure which correspond to hashes of unique identifiers of active data objects associated with model and enables remote storage to use model to copy regions of active data objects in first data storage and second data storage to third data storage, and to delete first data storage and second data storage.
MANAGEMENT OF REPEATEDLY SEEN DATA
A method for extending data lifetime for reference in deduplication is provided. The method includes determining that a quantity of user data has at least a threshold amount of data that is re-created in a storage system. The method includes protecting at least portions of the quantity of user data from erasure by garbage collection in the storage system during a predetermined time interval, wherein the protected at least portions are available for data deduplication of further user data in the storage system during the predetermined time interval.