G06F16/2471

Copying buckets from a remote shared storage system to memory associated with a search node for query execution

Systems and methods are disclosed for processing and executing queries in a data intake and query system. The data intake and query system receives a query identifying a set of data to be processed and a manner of processing the set of data. The data intake and query system identifies buckets that are to be searched and stores a copy of buckets in memory associated with one or more search nodes. A search node performs a search on buckets residing in its memory.

Tree-based format for data storage

A tree-based format may be implemented for data stored in a data store. A table may be maintained across one or multiple storage nodes in storage slabs. Storage slabs may be mapped to different nodes of a tree. Each node of the tree may be assigned a different range of distribution scheme values which identify what portions of the table are stored in the storage slab. Storage slabs mapped to child nodes in the tree may be assigned portions of the range of distribution scheme values assigned to a parent. Storage nodes may be added or removed for storing the table. Storage slabs may be moved from one storage node to another in order to accommodate the addition or removal of storage nodes.

Federation optimization using ordered queues
11709849 · 2023-07-25 · ·

Methods, systems, and computer program products for optimization of query processing in a data federation system using priority queuing techniques are provided. Priority queuing techniques may include generating a query vector corresponding to a query, comparing the query vector to historical query vectors to determine similarity, determining an expected processing time for the query based on the determined similarity, and inserting the query into a priority ordered queue at a particular position based on the expected processing time.

BIOMETRIC DATA DISTRIBUTED MANAGEMENT SYSTEM, AND BIOMETRIC RECOGNITION METHOD USING SAME
20230026106 · 2023-01-26 · ·

A method for performing biometric recognition in a system in which biometric information is distributed and stored in a plurality of databases includes extracting biometric information of a user, generating a plurality of biometric information segments by dividing the extracted biometric information, calculating distances between pre-stored biometric information template segments for each of the plurality of databases and a corresponding one of the plurality of biometric information segments, and detecting a biometric information template matching the biometric information by using the calculated distances.

Method and system for data processing
20230229664 · 2023-07-20 ·

System (100) comprising several edge computing devices (ECD), each comprising a sensor (S); a memory (M); a Central Processing Unit, CPU; and digital communication interface (IF), for communication across a network (NW).

The invention is characterised in that each edge computing device is arranged with a respective interpreting software function, arranged to execute on said CPU and to interpret computer code, received via said digital communication interface and stored in said memory, according to a query language having a predetermined syntax; in that said syntax is arranged to define queries the results of which are streams of data; in that a first such software function is arranged to pose a first query to a second edge computing device (120), in that a second such software function of said type is arranged to, in response thereto, generate and communicate a second stream of data; in that the first software function is arranged to preprocessing said second stream so that it adheres to a predefined global data ontology, and to perform a first calculation using said second stream.

The invention also relates to a method.

METHOD OF PROCESSING INFORMATION, ELECTRONIC DEVICE, AND STORAGE MEDIUM
20230229665 · 2023-07-20 ·

A method of processing an information, an electronic device, and a storage medium are provided, which relate to a field of an artificial intelligence technology, in particular to a field of a knowledge graph technology. An implementation includes: determining a first information, in response to receiving a first query request; querying an information associated with the first information from a current graph database, so as to obtain a first query result; determining at least one federation node, according to at least one of the first query result and the first information; and sending a second query request to the at least one federation node, so that the at least one federation node queries an information associated with a second information in the second query request from a graph database corresponding to the at least one federation node, so as to obtain at least one second query result.

IMAGE-BASED POPULARITY PREDICTION
20230229692 · 2023-07-20 ·

A machine may be configured to access an image of an item described by a description of the item. The machine may determine an image quality score of the image based on an analysis of the image. A request for search results that pertain to the description may be received by the machine, and the machine may present a search result that references the item's image, based on its image quality score. Also, the machine may access images of items and descriptions of items and generate a set of most frequent text tokens included in the item descriptions. The machine may identify an image feature exhibited by an item's image and determine that a text token from the corresponding item description matches one of the most frequent text tokens. A data structure may be generated by the machine to correlate the identified image feature with the text token.

Query conversion for querying disparate data sources

Methods, systems, and devices supporting querying disparate data sources are described. Querying disparate data sources may include receiving an input for data stored at a first data source from a plurality of data sources, selecting a first data connector from a plurality of data connectors, wherein the first data connector corresponds to the first data source, and identifying a first query language corresponding to the first data source from a plurality of query languages. Querying the disparate data sources may further include generating a converted query based at least in part on the first query language and retrieving the data from the first data source using the first data connector based at least in part on the converted query.

Merging buckets in a data intake and query system

Systems and methods are disclosed for processing and executing queries in a data intake and query system. An indexing system of the data intake and query system receives data and stores at least a portion of it in buckets, which are then stored in a shared storage system. The indexing system merges multiple buckets to generate merged buckets and uploads the merged buckets to the shared storage system.

Querying distributed databases

Embodiments are disclosed for a method. The method includes parsing a distributed database query into component queries corresponding to distributed nodes. The method also includes matching component queries to central cache to determine whether the component queries can be satisfied. This matching generates matched and unmatched component queries. The method further includes transforming the matched component query to a cache query and local delta query for a first node. Additionally, the method includes executing the cache query to generate a cache result. Also, the method includes providing the local delta query for the first node to generate a local delta. Further, the method includes providing the unmatched component query for a second node to generate a remote result. The method also includes generating a global delta based on the local delta. The method additionally includes generating a result by combining the cache result, local delta, and remote result.