In the field of data storage, a metadata query method and an apparatus are disclosed to improve metadata searching efficiency. The method is applied to a linked snapshot. A metadata query request is received. A first time sequence identifier is obtained from the first snapshot volume based on the volume identifier of the first snapshot volume. A historical index information is queried based on the data block identifier and the first time sequence identifier. When the data block identifier exists, and the first time sequence identifier falls within a corresponding query time sequence interval a corresponding target volume identifier is obtained from the historical index information. Address metadata corresponding to the data block identifier are obtained from a second snapshot volume indicated by the target volume identifier.

Various embodiments of the present application set forth a computer-implemented method for accessing data comprising identifying a first set of read operations occurring during a first time period, where each read operation included in the set of read operations is associated with retrieving a different portion of at least one object from a storage system, determining a byte density associated with the set of read operations, where the byte density indicates a size of contiguous portions of the at least one object that were retrieved during the first time period, and determining, based on the byte density, a pre-buffering block size for a read operation during a second period, where the pre-buffering block size specifies a size of a portion of at least one object that is to be retrieved from the storage system.

Systems and methods are described for providing a user interface through which a user can program operation of a data processing pipeline by specifying a graph of nodes that transform data and interconnections that designate routing of data between individual nodes within the graph. In response to a user request, a preview mode can be activated that causes the data processing pipeline to retrieve data from at least one source specified by the graph, transform the data according to the nodes of the graph, sample the transformed data, and display the sampling of the transformed data to at least one node without writing the transformed data to at least one destination specified by the graph.

Systems and methods are described for processing ingested data, detecting anomalies in the ingested data, and providing explanations of a possible cause of the detected anomalies as the data is being ingested. For example, a token or field in the ingested data may have an anomalous value. Tokens or fields from another portion of the ingested data can be extracted and analyzed to determine whether there is any correlation between the values of the extracted tokens or fields and the anomalous token or field having an anomalous value. If a correlation is detected, this information can be surfaced to a user.

A computer-implemented method for analyzing log files generated by complex physical equipment includes receiving one or more log file generated by one or more components of physical equipment. Each of the log files comprises one or more log entries. A plurality of templates are extracted from each log file describing fixed portions of the log entries. The log entries are grouped in log files into a plurality of instances. Each instance corresponds to one of a plurality of partitions along one or more dimensions describing data in the log entries. A representation of each instance is created that describes a set of the templates included in the instance. A plurality of clusters are generated by applying a clustering process to the representations of the instances. A visual depiction of the clusters and the instances may then be created in a graphical user interface (GUI).

The present technology pertains to a organization directory hosted by a synchronized content management system. The corporate directory can provide access to user accounts for all members of the organization to all content items in the organization directory on the respective file systems of the members' client devices. Members can reach any content item at the same path as other members relative to the organization directory root on their respective client device. In some embodiments novel access permissions are granted to maintain path consistency.

A method, computer program product, and computing system for maintaining a first cursor pointer for a memory system, wherein the first cursor pointer concerns a first search criteria and identifies an initial first cursor starting location; receiving a first search request for the memory system that satisfies the first search criteria; executing the first search request within an initial first search window starting at the initial first cursor starting location; and updating the first cursor pointer to identify an updated first cursor starting location based, at least in part, upon the initial first search window.

Methods and systems for redirection of requests received by a service or an API are provided. According to one embodiment, a request, relating to a domain or a focal point of related data (e.g., an OData entity), is received from a client by a service (e.g., an OData service) operable to serve data from a data source or an in-memory cache. When the request involves manipulation of a portion of the data, automatic updating of values of the data that are dependent thereon is facilitated by directing fulfilment of the request to the cache; otherwise: it is determined whether to fulfill the request based on the in-memory cache. When the determination is affirmative, then the portion of the data is retrieved from the in-memory cache. When the determination is negative, then the portion of the data is retrieved from the data source.

A technique performs file-based time series management. The technique involves initiating a recordation operation that records a source-provided time series in rows of a row-formatted file. The technique further involves, after the recordation operation is initiated, encountering a conversion event. The technique further involves, in response to encountering the conversion event, performing a conversion operation that converts the source-provided time series recorded in the rows of the row-formatted file into a file-provided time series and saving the file-provided time series in columns of a column-formatted file.

A method and system for migrating data and metadata from a first backup system to a second backup system via a content staging system is disclosed. The system accesses the backup data from the first backup system and restores it, along with the associated metadata, to a staging system. A metadata file is created at the staging system which comprises of the metadata that is to be migrated to the second backup system. The system then migrates the data from the staging system to the second backup system. The metadata is also migrated to the second backup system in a format such that it can be indexed. As a result, the migrated data can be browsed and searched based on one or more search criteria based on the associated metadata. Other details are provided herein.