Patent classifications
G06V10/426
Graph convolutional networks with motif-based attention
Various embodiments describe techniques for making inferences from graph-structured data using graph convolutional networks (GCNs). The GCNs use various pre-defined motifs to filter and select adjacent nodes for graph convolution at individual nodes, rather than merely using edge-defined immediate-neighbor adjacency for information integration at each node. In certain embodiments, the graph convolutional networks use attention mechanisms to select a motif from multiple motifs and select a step size for each respective node in a graph, in order to capture information from the most relevant neighborhood of the respective node.
Graph convolutional networks with motif-based attention
Various embodiments describe techniques for making inferences from graph-structured data using graph convolutional networks (GCNs). The GCNs use various pre-defined motifs to filter and select adjacent nodes for graph convolution at individual nodes, rather than merely using edge-defined immediate-neighbor adjacency for information integration at each node. In certain embodiments, the graph convolutional networks use attention mechanisms to select a motif from multiple motifs and select a step size for each respective node in a graph, in order to capture information from the most relevant neighborhood of the respective node.
IDENTIFICATION DEVICE, IDENTIFICATION METHOD, AND IDENTIFICATION PROGRAM
An identification apparatus includes processing circuitry configured to determine whether or not a first image and a second image are similar based on feature points extracted from each of the first image and the second image, and determine whether or not the first image and the second image are similar by comparing neighborhood graphs generated for each of the first image and the second image, the feature points being as nodes.
IDENTIFICATION DEVICE, IDENTIFICATION METHOD, AND IDENTIFICATION PROGRAM
An identification apparatus includes processing circuitry configured to determine whether or not a first image and a second image are similar based on feature points extracted from each of the first image and the second image, and determine whether or not the first image and the second image are similar by comparing neighborhood graphs generated for each of the first image and the second image, the feature points being as nodes.
Deep neural network system for similarity-based graph representations
There is described a neural network system implemented by one or more computers for determining graph similarity. The neural network system comprises one or more neural networks configured to process an input graph to generate a node state representation vector for each node of the input graph and an edge representation vector for each edge of the input graph; and process the node state representation vectors and the edge representation vectors to generate a vector representation of the input graph. The neural network system further comprises one or more processors configured to: receive a first graph; receive a second graph; generate a vector representation of the first graph; generate a vector representation of the second graph; determine a similarity score for the first graph and the second graph based upon the vector representations of the first graph and the second graph.
INDOOR NAVIGATION METHOD, INDOOR NAVIGATION EQUIPMENT, AND STORAGE MEDIUM
An indoor navigation method is provided, including: receiving an instruction for navigation, and collecting an environment image; extracting an instruction room feature and an instruction object feature carried in the instruction, and determining a visual room feature, a visual object feature, and a view angle feature based on the environment image; fusing the instruction object feature and the visual object feature with a first knowledge graph representing an indoor object association relationship to obtain an object feature, and determining a room feature based on the visual room feature and the instruction room feature; and determining a navigation decision based on the view angle feature, the room feature, and the object feature.
INDOOR NAVIGATION METHOD, INDOOR NAVIGATION EQUIPMENT, AND STORAGE MEDIUM
An indoor navigation method is provided, including: receiving an instruction for navigation, and collecting an environment image; extracting an instruction room feature and an instruction object feature carried in the instruction, and determining a visual room feature, a visual object feature, and a view angle feature based on the environment image; fusing the instruction object feature and the visual object feature with a first knowledge graph representing an indoor object association relationship to obtain an object feature, and determining a room feature based on the visual room feature and the instruction room feature; and determining a navigation decision based on the view angle feature, the room feature, and the object feature.
System and method of graph feature extraction based on adjacency matrix
A method and system of graph feature extraction and graph classification based on adjacency matrix is provided. The invention first concentrates the connection information elements in the adjacency matrix into a specific diagonal region of the adjacency matrix which reduces the non-connection information elements in advance. Then the subgraph structure of the graph is further extracted along the diagonal direction using the filter matrix. Further, it uses a stacked convolutional neural network to extract a larger subgraph structure. On one hand, it greatly reduces the amount of computation and complexity, getting rid of the limitations caused by computational complexity and window size. On the other hand, it can capture large subgraph structure through a small window, as well as deep features from the implicit correlation structures at both vertex and edge level, which improves speed and accuracy of graph classification.
Systems and methods for inspecting a railroad
A method for analyzing one or more conditions of a transportation pathway includes obtaining, using an imaging device of an inspection system, image data reproducible as a plurality of images of the transportation pathway, each of the plurality of images being reproducible as an image of a portion of the transportation pathway, each portion of the transportation pathway having an associated location along a length of the transportation pathway, analyzing, using one or more processors of the inspection system, the image data to determine a first plurality of metrics indicative of a condition of the transportation pathway at each of the associated locations, and generating a first graph, using the determined first plurality of metrics, that is indicative of the condition of the transportation pathway at each of the associated locations.
Systems and methods for inspecting a railroad
A method for analyzing one or more conditions of a transportation pathway includes obtaining, using an imaging device of an inspection system, image data reproducible as a plurality of images of the transportation pathway, each of the plurality of images being reproducible as an image of a portion of the transportation pathway, each portion of the transportation pathway having an associated location along a length of the transportation pathway, analyzing, using one or more processors of the inspection system, the image data to determine a first plurality of metrics indicative of a condition of the transportation pathway at each of the associated locations, and generating a first graph, using the determined first plurality of metrics, that is indicative of the condition of the transportation pathway at each of the associated locations.