Embodiments of the present disclosure discloses a scene-aware video encoder system. The scene-aware encoder system transforms a sequence of video frames of a video of a scene into a spatio-temporal scene graph. The spatio-temporal scene graph includes nodes representing one or multiple static and dynamic objects in the scene. Each node of the spatio-temporal scene graph describes an appearance, a location, and/or a motion of each of the objects (static and dynamic objects) at different time instances. The nodes of the spatio-temporal scene graph are embedded into a latent space using a spatio-temporal transformer encoding different combinations of different nodes of the spatio-temporal scene graph corresponding to different spatio-temporal volumes of the scene. Each node of the different nodes encoded in each of the combinations is weighted with an attention score determined as a function of similarities of spatio-temporal locations of the different nodes in the combination.

Embodiments of the present disclosure discloses a scene-aware video encoder system. The scene-aware encoder system transforms a sequence of video frames of a video of a scene into a spatio-temporal scene graph. The spatio-temporal scene graph includes nodes representing one or multiple static and dynamic objects in the scene. Each node of the spatio-temporal scene graph describes an appearance, a location, and/or a motion of each of the objects (static and dynamic objects) at different time instances. The nodes of the spatio-temporal scene graph are embedded into a latent space using a spatio-temporal transformer encoding different combinations of different nodes of the spatio-temporal scene graph corresponding to different spatio-temporal volumes of the scene. Each node of the different nodes encoded in each of the combinations is weighted with an attention score determined as a function of similarities of spatio-temporal locations of the different nodes in the combination.

A workpiece image search apparatus includes: a workpiece image deformation unit that generates a third workpiece image by deforming a second workpiece image so that a difference in workpiece shape between a first workpiece image and the second workpiece image becomes smaller, wherein the first workpiece image is obtained by projecting a first workpiece shape of a first workpiece on a two-dimensional plane, and the second workpiece image is obtained by projecting a second workpiece shape of a second workpiece on a two-dimensional plane; and a similarity calculation unit that calculates a similarity between the first workpiece shape and the second workpiece shape by comparing the third workpiece image with the first workpiece image.

A workpiece image search apparatus includes: a workpiece image deformation unit that generates a third workpiece image by deforming a second workpiece image so that a difference in workpiece shape between a first workpiece image and the second workpiece image becomes smaller, wherein the first workpiece image is obtained by projecting a first workpiece shape of a first workpiece on a two-dimensional plane, and the second workpiece image is obtained by projecting a second workpiece shape of a second workpiece on a two-dimensional plane; and a similarity calculation unit that calculates a similarity between the first workpiece shape and the second workpiece shape by comparing the third workpiece image with the first workpiece image.

An image processing apparatus, an image processing method, a program, and a recording medium storing the program capable of extracting, from an input first image group, an image similar to an image extracted from a reference image group are provided. A first image group including a plurality of images of a user is transmitted to an order reception server. A second image group similar to the first image group is searched from a plurality of reference image groups stored in the order reception server. An image similar to an image previously extracted from the second image group is extracted from the first image group. An album is generated by arranging the image extracted from the first image group in a layout similar to a layout of an album generated from the second image group.

An image processing apparatus, an image processing method, a program, and a recording medium storing the program capable of extracting, from an input first image group, an image similar to an image extracted from a reference image group are provided. A first image group including a plurality of images of a user is transmitted to an order reception server. A second image group similar to the first image group is searched from a plurality of reference image groups stored in the order reception server. An image similar to an image previously extracted from the second image group is extracted from the first image group. An album is generated by arranging the image extracted from the first image group in a layout similar to a layout of an album generated from the second image group.

Embodiments of the present disclosure provide a search method, a device, and a storage medium. The method includes: identifying, by an AR technology, a target object to be searched, and acquiring search information of the target object, transmitting a search request to a server according to the search information, receiving a search result of the target object returned by the server. The method provided in the embodiments can quickly obtain an accurate search result and improves user experience.

Embodiments of the present disclosure provide a search method, a device, and a storage medium. The method includes: identifying, by an AR technology, a target object to be searched, and acquiring search information of the target object, transmitting a search request to a server according to the search information, receiving a search result of the target object returned by the server. The method provided in the embodiments can quickly obtain an accurate search result and improves user experience.

This disclosure relates to improved sketch-based image retrieval (SBIR) techniques. The SBIR techniques utilize a neural network architecture to train a domain migration function and a hashing function. The domain migration function is configured to transform sketches into synthetic images, and the hashing function is configured to generate hash codes from synthetic images and authentic images in a manner that preserves semantic consistency across the sketch and image domains. The hash codes generated from the synthetic images can be used for accurately identifying and retrieving authentic images corresponding to sketch queries, or vice versa.

This disclosure relates to improved sketch-based image retrieval (SBIR) techniques. The SBIR techniques utilize a neural network architecture to train a domain migration function and a hashing function. The domain migration function is configured to transform sketches into synthetic images, and the hashing function is configured to generate hash codes from synthetic images and authentic images in a manner that preserves semantic consistency across the sketch and image domains. The hash codes generated from the synthetic images can be used for accurately identifying and retrieving authentic images corresponding to sketch queries, or vice versa.