A video generation method includes: performing video shooting in response to a trigger operation for a video duet option; obtaining a second video currently shot, where the second video corresponds to a video clip including a target character in a first video; and fusing the second video into video content of the first video based on one or more characters recognized in the first video, to obtain a duet video, the one or more characters including the target character.

The described aspects and implementations enable efficient identification of real and image signs in autonomous vehicle (AV) applications. In one implementation, disclosed is a method and a system to perform the method that includes obtaining, using a sensing system of the AV, a combined image that includes a camera image and a depth information for a region of an environment of the AV, classifying a first sign in the combined image as an image-true sign, performing a spatial validation of the first sign, which includes evaluation of a spatial relationship of the first sign and one or more objects in the region of the environment of the AV, and identifying, based on the performed spatial validation, the first sign as a real sign.

A system includes a processor and a memory in communication with the processor, the memory storing instructions that when executed by the processor cause the processor to receive from a portable device coupled to a vehicle one or more images and at least one sensor datum, compute based, at least in part, upon the one or more images and at least one sensor datum a pose estimate of the vehicle, identify based, at least in part, upon the pose estimate a geofence containing the pose estimate; and if the geofence comprises, at least in part, a parking zone, transmit a parking validation to the portable device.

An electronic device is provided. The electronic device includes a memory, and at least one processor electrically connected to the memory, wherein the at least one processor is configured to obtain a video including an image and an audio, obtain information on at least one object included in the image from the image, obtain a visual feature of the at least one object, based on the image and the information on the at least one object, obtain a spectrogram of the audio, obtain an audio feature of the at least one object from the spectrogram of the audio, combine the visual feature and the audio feature, obtain, based on the combined visual feature and audio feature, information on a position of the at least one object the information indicating the position of the at least one object in the image, obtain an audio part corresponding to the at least one object in the audio, based on the combined visual feature and audio feature, and store, in the memory, the information on the position of the at least one object and the audio part corresponding to the at least one object.

A method, system and mobile device can be used by a subject in diagnosing a disease or virus or other illness. The system can capture and analyze olfactory information providing a diagnosis based on the olfactory information. The system can also capture and output biometric data corresponding to the subject and can further include at least one camera or video sensor that can result in a diagnosis or a microphone or other acoustic sensor that can result in another diagnosis. Other sensors providing other corresponding diagnoses can be included. A sensor fusion component can receive and combine the biometric data and the various diagnoses results and further determine a confidence score. An event record creator compiles the biometric data and the confidence scores to create an event record having a higher confidence score with respect to a final diagnosis result. A data storage device stores the event record.

A device and a method and a non-transitory readable storage medium, for face recognition are provided, the method comprise: extracting a face sample image from a predetermined face sample library and performing feature point detection to obtain multiple face feature points; obtaining multiple mask images; selecting first to fourth face feature points from the multiple face feature points; defining a distance between the first and second face feature point as a mask image height, and defining a distance between the third and fourth face feature point as a mask image width; adjusting a size of each mask image according to the mask image height and the mask image width; fusing each adjusted mask image with the face sample image to obtain multiple face mask images to save into the predetermined face sample library; training a face recognition model based on the predetermined face sample library for face recognition.

Disclosed are techniques for determining a motion state of a target object. In an aspect, an on-board computer of an ego vehicle detects the target object in one or more images, determines one or more first attributes of the target object based on measurements of the one or more images, determines one or more second attributes of the target object based on measurements of a map of a roadway on which the target object is travelling, and determines the motion state of the target object based on the one or more first attributes and the one or more second attributes of the target object.

A physical access control (PAC) system configured to perform a two-factor authentication prior to granting access to a secure area. The PAC system includes an access point device configured to perform facial recognition on a person proximate to the access point device, and perform wireless handshake with a mobile device associated with the person prior to granting or denying entry to the secure area.

A method and activity recognition system for recognising activities in surrounding environment for controlling navigation of an autonomous vehicle is disclosed. The activity recognition system receives first data feed from neuromorphic event-based camera and second data feed from frame-based RGB video camera. The first data feed comprises high-speed temporal information encoding motion associated with change in surrounding environment at each spatial location, and second data feed comprises spatio-temporal data providing scene-level contextual information associated with surrounding environment. An adaptive sampling of second data feed is performed with respect to foreground activity rate based on amount of foreground motion encoded in first data feed. Further, the activity recognition system recognizes activities associated with at least one object in surrounding environment by identifying correlation between both data feed by using two-stream neural network model. Thereafter, based on the determined activities, the activity recognition system controls the navigation of the autonomous vehicle.

A method for detecting objects and labeling the objects with distances in an image includes steps of: obtaining a thermal image from a thermal camera, an RGB image from an RGB camera, and radar information from an mmWave radar; adjusting the thermal image based on the RGB image to generate an adjusted thermal image, and generating a fused image based on the RGB image and the adjusted thermal image; generating a second fused image based on the fused image and the radar information; detecting objects in the images, and generating, based on the fused image, another fused image including bounding boxes marking the objects; and determining motion parameters of the objects.