A 3D silhouette sensing system is described which comprises a stereo camera and a light source. In an embodiment, a 3D sensing module triggers the capture of pairs of images by the stereo camera at the same time that the light source illuminates the scene. A series of pairs of images may be captured at a predefined frame rate. Each pair of images is then analyzed to track both a retroreflector in the scene, which can be moved relative to the stereo camera, and an object which is between the retroreflector and the stereo camera and therefore partially occludes the retroreflector. In processing the image pairs, silhouettes are extracted for each of the retroreflector and the object and these are used to generate a 3D contour for each of the retroreflector and object.

Systems and methods are disclosed for operating, calibrating, and dynamically optimizing a system for a virtual reality environment where colored marker lights are attached to objects, the objects including players, controllers, and devices related to the game. One or more color cameras are used to view one or more spaces, and track positions and orientations of players and other objects according to the attached marker lights. A hierarchical system of servers may be used to process positions and orientations of objects and provide controls as necessary for the system. A method for color assignment is described as well as a calibration process, and a dynamic optimization process. A synchronization process is also described that ensures that a plurality of cameras and attached servers are properly coordinated. Head-mounted devices may also be used in conjunction with marker lights to provide information regarding players.

According to various embodiments, a gesture recognition device may be provided. The gesture recognition device may include: a plurality of emitters, each emitter configured to emit a signal; at least one receiver configured to receive signals emitted by the plurality of emitters; a controller configured to control the plurality of emitters to subsequently emit signals in a plurality of patterns of a first subset of the plurality of emitters emitting a signal and a second subset of the plurality of emitters not emitting a signal; and a gesture recognition circuit configured to determine a gesture of a user of the input device based on the signals received by the at least one receiver.

A three-dimensional imaging and display system is provided in which user input is optically detected in an imaging volume by measuring the path length of an amplitude modulated scanning beam as a function of the phase shift thereof. Visual image user feedback concerning the detected user input is presented.

The present disclosure provides a method, a video system, and a system for realizing a simple air mouse. The method includes: a video terminal obtaining current position parameters of an air mouse, wherein the current position parameters comprise a deflection angle and a deflection direction of the air mouse with respect to an originally-calibrated coordinate position; and determining a position of a cursor on the video terminal according to the current position parameters and a preset scale parameter. By presetting reference points in the air mouse, the present disclosure obtains the deflection angle and the deflection direction of the air mouse with respect to the original position by the camera device based on the above reference points, and determines the position of the cursor on the video terminal according to the deflection angle and the deflection direction and the preset scale parameter.

An image generating system includes a first attitude data obtaining unit obtaining first attitude data indicating an attitude of a head-mounted display in first timing; a reference image generating unit generating a reference image showing a state of looking at a virtual three-dimensional space from a viewpoint, a position and a sight line direction of the viewpoint being identified on a basis of the first attitude data; a second attitude data obtaining unit obtaining second attitude data indicating the attitude of the head-mounted display in second timing; a corresponding position identifying unit identifying a corresponding position for each pixel within a display image to be displayed on the head-mounted display; a pixel value identifying unit identifying a pixel value of the pixel within the display image, the pixel being associated with the corresponding position; and a display image generating unit generating the display image.

The present invention relates to the computer field, and specifically, to a method and an apparatus for coordinating body devices for communication. The method includes: obtaining, by a mobile personal station, an identifier of a body device, and a location parameter and an ambient parameter that are of a user that carries the body device; obtaining, according to the identifier of the body device, a communication mode supported by the body device; obtaining, according to the identifier of the body device, a communication mode supported by the body device; determining, a networking mode of the body device according to the scenario and the communication mode supported by the body device; and establishing, a connection to the body device according to the networking mode.

A glove for interfacing with a virtual reality scene presented via a head-mounted display (HMD) is provided. The glove includes a plurality of digits associated with the glove, each digit configured to receive a finger of a user of the glove; and, a plurality of sensors, each configured to identify a degree of flexion and being associated with one of a plurality of predefined locations along the plurality of digits, wherein one of the plurality of sensors at each of the predefined locations is selected as an optimal sensor for the respective predefined location.

A method and system are provided for controlling a machine using gestures. The method includes sensing a variation of position of a control object using an imaging system, determining, from the variation, one or more primitives describing a characteristic of a control object moving in space, comparing the one or more primitives to one or more gesture templates in a library of gesture templates, selecting, based on a result of the comparing, one or more gesture templates corresponding to the one or more primitives, and providing at least one gesture template of the selected one or more gesture templates as an indication of a command to issue to a machine under control responsive to the variation.

A method includes receiving sensor data from one or more sensors that corresponds to a location of a stylus device and determining that a tip of the stylus device is in contact with a physical surface based on the sensor data. While in contact, the method includes determining a new location of the tip of the stylus device based on the location data, mitigating a tracking error of the determined new location of the tip of the stylus device by translating the new location from a 3D space domain to a 2D space domain that corresponds to the physical surface and adjusting the new location based on a comparison of the new location and historical locations.