An apparatus comprises a processing device configured to receive, at a given node of a distributed file system cluster, a request to store one or more portions of data and to monitor performance parameters for each storage device associated with the given node, the performance parameters comprising a first performance parameter characterizing data access frequency and at least a second performance parameter characterizing available space. The processing device is also configured to determine an overall performance metric for each of the storage devices associated with the given node based at least in part on the monitored performance parameters and to select, based at least in part on the overall performance metrics, at least one of the storage devices associated with the given node on which to store the one or more portions of data.

Embodiments for a method performing data migration such as backups and restores in a network by identifying characteristics of data in a data saveset to separate the data into defined types based on respective characteristics, assigning a data label to each defined type, defining migration rules for each data label, discovering assigned labels during a migration operation; and applying respective migration rules to labeled data in the data saveset. The migration rules can dictate storage location, access rights, replication periods, retention periods, and similar parameters.

A recording medium stores a communication program executed by communication devices and causing: a first computer of a first communication device, on a side of providing data, to register first metadata including the data and attribute information; a second computer of a second communication device, on a side of using the data, to register second metadata including a processing service when processing and using the data and attribute information; the first computer to determine whether or not to approve the processing service based on the first and second metadata; and when the determination of whether or not to approve is to approve, a third computer of a third communication device, on a side of processing the data, to execute data processing based on the processing service in a data processing environment that disapproves access from the first and second communication devices to the data and the processing service.

Disclosed are various embodiments for generating an index. A computing device provides a location of a requested file to a client device in response to receiving a search query of a master index from the client device. The computing device updates the master index with index data associated with the requested file, wherein the index data associated with the requested file is received from the client device.

Disclosed herein is a system for enabling a default label to be configured for a network location created to store files. The default label can be assigned at a time when the files are uploaded to the network location. An owner of the network location can define the default label to be assigned to the files. Whenever an unlabeled file is uploaded to the network location, the unlabeled file automatically inherits the default label. Furthermore, the system is configured to consider an order of label priority when determining whether to assign a default label to a previously labeled file to be uploaded to the network location. The system is configured to upgrade a file with a preassigned label of lower priority to the default label, while permitting another file to be stored without a label change if the preassigned label is of higher priority compared to the default label.

An index node (inode) allocation method, a corresponding data processing device and a corresponding computer-readable medium are provided. The method is applicable to a file system and includes the following steps: allocating a range including a plurality of consecutive inodes to a directory in the file system when a directory order mode is already activated, wherein files in the directory are sorted according to hash values of the files; dividing the range of inodes into a plurality of sub-regions; and when a new file is created in the directory, selecting one of the sub-regions according to a hash value of the new file, so as to allocate an inode in the selected sub-region to the new file.

Methods, non-transitory machine readable media, and computing devices that ensure correctness of file system analytics are disclosed. With this technology, a first generation number for a volume is incremented in response to a modification of a rule set that defines properties of objects of a file system associated with the volume. A determination is made when a second generation number in a first inode for a first one of the objects matches the first generation number. The first inode is identified based on a traversal of a directory tree associated with the file system. The modified rule set is applied to the properties for the first one of the objects to obtain values, when the second generation number fails to match the first generation number. Analytics data is output after the traversal has completed. The analytics data is generated in response to a query and is based on the values.

One aspect facilitates a global map in a distributed system. The system generates a first data structure which comprises key-value pairs, wherein, in a respective key-value pair, the respective key is an integer and the respective value comprises a pointer to a sparse array which includes a bitmap (such as an ordered two-bit bitmap). The system stores the first data structure as a first partition of the global map. The system searches, based on a pattern, the first data structure to obtain a first value. If the first value comprises a two-bit bitmap, the system converts, based on the pattern, the first value to a two-dimensional bitmap, and performs a function on the first value to obtain a first result. The system uses the first value or the first result as metadata to execute a read or write operation in a filesystem associated with the distributed system.

Programmer input in a programming language is received, the programmer input for adding data to an electronic storage object that is accessible via a network. The programmer input includes i) a built-in function corresponding to adding data to electronic storage objects, ii) a first parameter specifying the electronic object to which data is to be stored, and iii) one or more second parameters indicating the data that is to be stored. The programmer input is evaluated with a computational application to generate one or more messages to a server for the server to add the data to the electronic object, and the one or more messages are sent to cause the data indicated by the second parameter to be added to the electronic storage object.

A pervasive search architecture that indexes personal content of a querying user and made accessible to the user by other users. A compute node of a personal content location facilitates index generation and serve of the index. The index is generated for personal content stored at the personal content location. For a given content location, the index may encapsulate content stored in a set of locations with access permissions. The indexing application runs periodically at the personal content location and incrementally indexes content that is added to the shared locations. The same application allows the user to configure locations with the desired access permissions for participation in the search.