Methods and systems for dynamically provisioning storage on a blockchain are provided. In one embodiment, a method is provided that includes receiving a request that includes a data unit for storage. The data unit may be buffered in a data stack that stores one or more data units. The data unit may be stored in the data stack until (i) a predetermined amount of time has passed and/or (ii) a size of the data stack exceeds a predetermined threshold. The data units stored in the data stack may then be encrypted and included in one or more storage transactions. The storage transactions may also include encryption keys used to encrypt the data units. The storage transactions may then be transmitted to nodes for storage on a blockchain.

Data content delivery and validation in a computer environment may provide a file system in the computer environment, the file system subdivided into unique folder locations per content type, each of the unique folder locations representing a content type folder. The file system is monitored for changes to a content type folder. An occurrence of a manifest file in the content type folder may be detected, the occurrence of the manifest file ensuring that all files in a package of files associated with the manifest file have arrived. Content of the manifest file may be analyzed to check validity of the files. A content package registry may be queried to determine a base job for processing a given content type associated with the package of files, and the base job may be run to process the package of files.

A document search system allowing a user to easily and intuitively designate a search condition including a feature amount of a document is provided. The document search system searches for at least one document stored in a file server by referring to at least one index including a feature amount relating to at least one object included in each of the at least one document stored in the file server. The document search system searches for the document matched with the search condition from among the at least one document stored in the file server by referring to the search condition including disposition information about at least one symbol on the virtual page and the at least one index.

A virtual tape library system includes multiple copies of a LockFS that are mounted on all nodes. One of the LockFSs is designated as the active copy. A primary node manages recovery when a secondary node signals loss of connectivity with the active copy by posting a sync request file to at least one of the LockFSs. The primary node posts status request files to the LockFSs and the secondary nodes respond by writing status to the status request files. A LockFS that is reachable by all nodes is selected as the new active LockFS. Switchover is accomplished by the primary node posting a disable request file to the selected LockFS and waiting for all secondary nodes to acknowledge by writing to the disable request file. The primary node then posts an activate request file to the selected LockFS and waits for all secondary nodes to acknowledge by writing to the activate request file.

A file system manager implemented at a provider network identifies a storage device of a first group of storage devices of a provider network as an initial location of a file system object. Based on an access metric associated with the object, the file system manager initiates a transfer of contents of the object to a second storage device of a different storage device group, without receiving a client request specifying the transfer. In response to an access request received via a file system programmatic interface, contents of the object are provided from the second storage device. Based on a second access metric, the object is transferred back to the first group of storage devices.

An apparatus for multi-bit rate content streaming includes a receiving module configured to capture media content, a streamlet module configured to segment the media content and generate a plurality of streamlets, and an encoding module configured to generate a set of streamlets. The system includes the apparatus, wherein the set of streamlets comprises a plurality of streamlets having identical time indices and durations, and each streamlet of the set of streamlets having a unique bit rate, and wherein the encoding module comprises a master module configured to assign an encoding job to one of a plurality of host computing modules in response to an encoding job completion bid. A method includes receiving media content, segmenting the media content and generating a plurality of streamlets, and generating a set of streamlets.

Techniques are shown for enabling a network system to index data stored on a third-party server to allow the data stored on the third-party server to be searchable by searching functionality of the network system.

Disclosed are mechanisms for sharing content through content consumption systems. A sharing module publishes content in a share and metadata associated therewith to a content consumption system external to a managed repository. The share represents a folder or directory in the managed repository. The publication can be made through application programming interface (API) calls handled by a first sharing module API, a repository API, a second sharing module API, and a content consumption system API. These APIs together provide a one-to-one mapping of communications protocols used by the managed repository and the external system. The share in the managed repository and the share published to the content consumption system are synced and any conflict between the two is detected and resolved. The shared content can be repatriated back to the managed repository and the shared version deleted from the content consumption system.

In some examples, a first computing device may receive, from a server, an indication that the server has recovered data. For instance, the first computing device may store metadata including a mapping for one or more file systems accessed by one or more client devices. Furthermore, a second computing device may store a copy of the mapping stored on the first computing device. The first computing device may receive, from the server, a mapping of the one or more file systems determined by the server based on the recovered data. The first computing device may compare the mapping from the server with the mapping of the one or more file systems on the first computing device, and may send, to the server, information about changes determined between the two mappings to enable the server to update the mapping on the server based on the changes.

According to one embodiment, distributing data across a plurality of storage shards can comprise generating a file key for each file of a plurality of files stored in a plurality of physical shards, each physical shard maintained by a node of a plurality of nodes in one or more clusters. The file key can comprise a hash of an enterprise identifier for an entity to which the creator of the file is a member, a hash of a folder identifier for a location in which the file is stored, and a hash of a file identifier uniquely identifying the file. The generated file keys can be sorted into an ordered list and the ordered list can be logically partitioning into a plurality of logical shards. Each logical shard of the plurality of logical shards can then be mapped to one of the plurality of physical shards.