Provided is an information processing device that processes information regarding augmented reality.

The information processing device includes an acquisition unit configured to acquire a position and a posture, or a shape of a first part on a body of a user, and a control unit configured to control a virtual object to be displayed in a real space on a display device on the basis of the position and the posture, or the shape of the first part. When recognizing that the first part has performed a first operation for a second part on the body of the user on the basis of the position and the posture, or the shape of the first part acquired by the acquisition unit, the control unit stores an execution state of the virtual object in association with the second part, and stops display of the virtual object by the display device.

A kit to facilitate identifying at least one glove particularly suitable to be worn by a particular individual includes a backdrop having at least two visually-discernible calibration marks disposed thereon, a camera, a memory having stored therein characterizing parameters for a variety of different gloves, and a control circuit that operably couples to the latter. The control circuit presents to a kit user via a display an image of the particular individual's hand as placed on the backdrop, and then presents a plurality of user-placeable markers by which the kit user marks particular locations of the particular individual's hand. The control circuit then processes the image of the particular individual's hand as marked by the kit user and as a function of the two visually-discernible calibration marks to identify at least one glove that is particularly suitable to be worn by the particular individual.

The technology described in this document can be embodied in a method that includes obtaining, by one or more image acquisition devices, a first image of a portion of a human body under illumination by electromagnetic radiation in a first wavelength range, and obtaining a second image of the portion of the human body under illumination by electromagnetic radiation in a second wavelength range. The method also includes generating, by one or more processing devices, a third image or template that combines information from the first image with information from the second image. The method also includes determining that one or more metrics representing a similarity between the third image and a template satisfy a threshold condition, and responsive to determining that the one or more metrics satisfy a threshold condition, providing access to the secure system.

Example systems, devices, media, and methods are described for capturing still images in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. A localization system determines the eyewear location relative to the physical environment. An image processing system detects a hand shape in the video data and determines whether the detected hand shape matches a border gesture or a shutter gesture. In response to a border gesture, the system establishes a border that defines the still image to be captured. In response to a shutter gesture, the system captures a still image from the frames of video data. The system determines a shutter gesture location relative to the physical environment. The captured still image is presented on the display at or near the shutter gesture location, such that the still image appears anchored relative to the physical environment. The captured still image is viewable by other devices that are using the image capture system.

Provided are a gesture recognition method and apparatus, and a storage medium. The method includes: obtaining a first feature map corresponding to a target region in a depth image, and determining a target key point from the first feature map; establishing a three-dimensional coordinate system in the first feature map by using the target key point, and predicting other three-dimensional coordinates of other key points in the three-dimensional coordinate system, the other key points being key points other than the target key point in the first feature map; and determining, based on the target key point and the other three-dimensional coordinates, a plurality of absolute coordinates of a plurality of key points, to determine a gesture of a target recognition object in the target region based on the plurality of absolute coordinates, the plurality of key points including the target key point and the other key points.

A device for authenticating a user is described that comprises a sensor configured to measure the movement of a user in response to the interaction of the user with a displayed image and controller circuitry configured to authenticate the user in response to a positive comparison between the movement of the user and a stored movement associated with the user.

An information processing method and apparatus, a computer device, and a storage medium are disclosed. In the method, a request to perform a payment operation is received. A service page is displayed and an image of at least one part of a user is captured, in response to the request to perform the payment operation. Authentication of the user is performed based on the captured image of the at least one part of the user. While the authentication of the user is performed, a graphical representation of the at least one part of the user that is generated based on the captured image of the at least one part of the user is displayed. The graphical representation is unique to the user. The payment operation is performed when the user is authenticated based on the captured image of the at least one part of the user.

A determiner includes a memory and at least one processor. In the memory, a program is stored. The processor executes the program stored in the memory, and obtains an image of a hand including at least a first finger placed on a placement surface, and determines a type of the first finger based on a placement state of second fingers recognized as fingers in the image.

A method includes: sensing, by a mobile device when the mobile device is tethered to a head-mounted display (HMD) and when the mobile device is held by a first hand, first data; detecting, by the mobile device, information indicating which hand is used to perform a gesture from the first data; sending, by the mobile device, the information to the HMD; receiving, by the HMD, the information, and not detecting, by the HMD, the information by an image-based detection method; wherein the gesture is performed by a second hand and the information is an updated indication with respect to the gesture considering a hand switch state during a first elapsed duration from a sensing time of the first data to a sensing time of the first image data; and performing, by the HMD, side-adapted hand pose estimation on the first image data using the information.

A robotic control system directs a robot to take an object from a human grasp by obtaining an image of a human hand holding an object, estimating the pose of the human hand and the object, and determining a grasp pose for the robot that will not interfere with the human hand. In at least one example, a depth camera is used to obtain a point cloud of the human hand holding the object. The point cloud is provided to a deep network that is trained to generate a grasp pose for a robotic gripper that can take the object from the human's hand without pinching or touching the human's fingers.