A head-mounted display system and a 6-degree-of-freedom tracking method and apparatus thereof are disclosed. The method includes: controlling two channels of tracking cameras so that central moments of exposure durations of each frame of the two channels of tracking cameras are same, and controlling so that a lightening moment of the LED lights on the handle controller is synchronized with the middle moment of the exposure duration of an even-number frame of the two channels of tracking cameras; calculating 6-degree-of-freedom tracking data of the head-mounted display device in a three-dimensional space in real time according to acquired image data of an odd-number frame of the two channels of tracking cameras; and calculating 6-degree-of-freedom tracking data of the handle controller in the three-dimensional space in real time according to acquired image data of an even-number frame of the two channels of tracking cameras.

A Robotic control system has a wand, which emits multiple narrow beams of light, which fall on a light sensor array, or with a camera, a surface, defining the wand's changing position and attitude which a computer uses to direct relative motion of robotic tools or remote processes, such as those that are controlled by a mouse, but in three dimensions and motion compensation means and means for reducing latency.

An information processing device includes: an acquisition unit that acquires inertial information from an inertial sensor provided in a controller; a detection unit that detects the controller from a captured image acquired through imaging by an imaging device; and a control unit that acquires a position of the controller on a basis of a position of the controller acquired in a past and the inertial information in a case where the controller is not detected from the captured image. The control unit controls a display to display a display item at a position based on the acquired position of the controller.

An entity enabled interactive gaming platform for deepening the engagement of a customer with an entity comprising and entity global eco-system and an interactive gaming system where the entity alters the provision of a product or service to a customer based at least in part upon any one of or any combination of game play datum associated with the customer having played an entity game. The global eco-system comprises a game structure including game rules, a game database and game overlay descriptions sufficient for printing or otherwise creating a physical game overlay. The interactive gaming system comprises a physical game board with a replaceable physical game overlay, game app and one or more electronically trackable physical game pieces including an identifier, where the replaceable game overlay is printed or otherwise created based at least in part upon the game overlay descriptions associated with the entity game to be played.

A handheld electronic device including a holding assembly and a tracking assembly is provided. The tracking assembly includes a main body and a plurality of trackers. The main body is connected to the holding assembly and has an inner surface and an outer surface. The trackers are disposed on the inner surface and the outer surface of the main body. The trackers arranged on the outer surface and a part of the trackers arranged on the inner surface are exposed to the outside in a top view direction and are arranged in interleaving.

An indicator detection method includes operating in a first mode and operating in a second mode. The first mode includes detecting a position of a first indicator on a operation surface by detecting first light emitted by the first indicator, emitting second light by a light emitting device, and detecting a position of a second indicator on the operation surface by detecting reflected light of the second light reflected by the second indicator. The second mode includes reducing a light amount of the second light when it is determined that the first indicator is in contact with the operation surface, and detecting the position of the first indicator on the operation surface by detecting the first light in a state where the light amount of the second light is reduced.

This disclosure relates to detecting hand gesture input using an electronic device, such as a wearable device strapped to a wrist. The device can have multiple photodiodes, each sensing light at a different position on a surface of the device that faces skin of a user. Examples of the disclosure detect hand gestures by recognizing patterns in sensor data that are characteristic of each hand gesture, as the tissue expands and contracts and anatomical features in the tissue move during the gesture.

A projected target location of a handheld object is determined based on applying translation factors, scaling factors, and offsets to a location of a reference element of the handheld object detected by a camera on a two-dimensional plane. The translation factors are determined based on a difference between a calibration location on the plane and an initial location of the reference element corresponding to the calibration location, and serve to shift the location of the reference element to generate the projected target location. The scaling factors are determined based on an estimated length of a user's arm holding the handheld object, and serve to scale the location of the reference element to generate the projected target location. The offsets are determined based on polynomial equations, and serve to extend the distance between the projected target location and the calibration location.

A method of generating a simulation of a physical object in an image of a physical environment. The method also includes generating a planar polygon mesh from at least the image. The method further includes extracting a boundary polygon of the planar polygon mesh. Moreover, the method includes generating a convex hull for the boundary polygon of the surface mesh. In addition, the method includes generating a minimal area oriented boundary polygon from the convex hull. The method may also include generating a maximal area oriented internal polygon (MAOBP) inside of the boundary polygon of the planar polygon mesh. The MAOBP is utilized to generate a 3-D surface model of the physical object, and the 3-D surface model is used to generate a simulation involving an interaction with the 3-D surface model of the physical object.

A system, article, and method of wireless data transmission for virtual or augmented reality head mounted displays.