A method and system for human computer interaction using hand gestures is presented. The system permits a person to precisely control a computer system without wearing an instrumented glove or any other tracking device. In one embodiment, two cameras observe and record images of a user's hands. The hand images are processed by querying a database relating hand image features to the 3D configuration of the hands and fingers (i.e. the 3D hand poses). The 3D hand poses are interpreted as gestures. Each gesture can be interpreted as a command by the computer system. Uses for such a system include, but are not limited to, computer aided design for architecture, mechanical engineering and scientific visualization. Computer-generated 3D virtual objects can be efficiently explored, modeled and assembled using direct 3D manipulation by the user's hands.

An example operation includes one or more of receiving, by a computer associated with a transport, a gait of an individual from at least one camera associated with the transport, validating, by the computer, the gait, receiving, by the computer, a gesture of the individual from the at least one camera, validating, by the computer, the gesture, and performing, by the computer, one or more functions based on the validated gait and the validated gesture.

Human Computer Interfaces (HCI) may allow a user to interact with a computer via a variety of mechanisms, such as hand, head, and body gestures. Various of the disclosed embodiments allow information captured from a depth camera on an HCI system to be used to recognize such gestures. Particularly, the HCI system's depth sensor may capture depth frames of the user's movements over time. To discern gestures from these movements, the system may group portions of the user's anatomy represented by the depth data into classes. This grouping may require that the relevant depth data be extracted from the depth frame. Such extraction may itself require that appropriate clipping planes be determined. Various of the disclosed embodiments better establish floor planes from which such clipping planes may be derived.

Systems, methods, and computer program products are disclosed for improving ease in initiating information transfers between devices. A user of a communications device accesses an image of a target recipient. With that recipient in view in the image, the user selects the portion of the screen where the recipient is displayed in the image. Pattern recognition is performed to extract one or more features of the selected portion of the screen as a recognized pattern. That recognized pattern is compared against multiple stored patterns that are associated with contacts in contact lists and/or other types of databases. Once a match is found, the user is prompted to confirm the identified recipient corresponding to the matching pattern and the data to transfer. Once confirmed, the data transfer is initiated based on the automatically determined recipient information.

An example operation includes one or more of receiving, by a computer associated with a transport, a gait of an individual from at least one sensor associated with the transport, validating, by the computer, the gait when the gait has corresponding frequency occurrence statistics above a predetermined gait threshold, responsive to the validating, providing, by the computer, access to the transport by the individual, receiving, by the computer, a sequence of gestures of the individual from at the at least one sensor, wherein the sequence of gestures corresponds to a function, validating, by the computer, the sequence of gestures, and responsive to the validating, performing, by the computer, the function responsive to the sequence of gestures being recognized as a known match with a pattern stored in memory.

According to various embodiments, a gesture recognition device may be provided. The gesture recognition device may include: a plurality of emitters, each emitter configured to emit a signal; at least one receiver configured to receive signals emitted by the plurality of emitters; a controller configured to control the plurality of emitters to subsequently emit signals in a plurality of patterns of a first subset of the plurality of emitters emitting a signal and a second subset of the plurality of emitters not emitting a signal; and a gesture recognition circuit configured to determine a gesture of a user of the input device based on the signals received by the at least one receiver.

There is provided an information processing device, information processing method, and program capable of realizing the authentication with high security using the movement of line of sight, the information processing device including: a line-of-sight movement identification unit configured to identify movement of line of sight of a user to a body of the user on a basis of an image of an eye of the user and an image of the body of the user positioned in a line-of-sight direction of the user, captured by an imaging unit; and a user authentication unit configured to authenticate the user on a basis of the identified movement of line of sight.

Embodiments are directed to a near eye display (NED) system for displaying artificial reality content to a user and to manipulate displayed content items based upon gestures performed by users of the NED system. A user of the NED system may perform a gesture simulating the throwing of an object to “cast” a content item to a target location in an artificial reality (AR) environment displayed by the NED system. The gesture may comprise a first portion in which the user's hand “grabs” or “pinches” a virtual object corresponding to the content item and moves backwards relative to their body, and a second portion in which the user's hand moves forwards relative to their body and releases the virtual object. The target location may be identified based upon a trajectory associated with the backwards motion of the first portion of the gesture.

A method of controlling an augmented reality (AR) electronic device worn on a head part of a user. The method comprising allocating a display area within a visual field of a user and displaying a virtual object in the display area, obtaining motion information on the basis of a hand image of a user using an image capturing unit, calculating coordinates of a pointer from the motion information and displaying the pointer in the display area, separately displaying a real object and a virtual object not to overlap each other if the pointer is located in an area where the real object and the virtual object overlap each other in the visual field of the user.

There is provided a recognition system adaptable to a portable device or a wearable device. The recognition system senses a body heat using a thermal sensor, and performs functions such as the living body recognition, image denoising and body temperature prompting according to detected results.