An electromagnetic tracking system includes a handheld controller including a first phased array element characterized by a first phase and a second phased array element characterized by a second phase different than the first phase. The first phased array element and the second phased array element are configured to generate a steerable electromagnetic beam characterized by an electromagnetic field pattern. The electromagnetic tracking system also includes a head mounted augmented reality display including an electromagnetic sensor configured to sense the electromagnetic field pattern.

A controller for interfacing wirelessly with a game console is provided, including the following: a housing defined by a main body, a first extension extending from a first end of the main body, and a second extension extending from a second end of the main body, the first extension and the second extension for holding by a first hand and a second hand of a user, respectively; a touch-sensitive panel defined along the top surface of the main body between the first extension and the second extension; a first set of buttons disposed on the top surface of the main body proximate to the first extension and on a first side of the touch-sensitive panel; and, a second set of buttons disposed on the top surface of the main body proximate to the second extension and on a second side of the touch-sensitive panel.

A controller for interfacing wirelessly with a game console is provided, including the following: a housing defined by a main body, a first extension extending from a first end of the main body, and a second extension extending from a second end of the main body, the first extension and the second extension for holding by a first hand and a second hand of a user, respectively; a touch-sensitive panel defined along the top surface of the main body between the first extension and the second extension; a first set of buttons disposed on the top surface of the main body proximate to the first extension and on a first side of the touch-sensitive panel; and, a second set of buttons disposed on the top surface of the main body proximate to the second extension and on a second side of the touch-sensitive panel.

To derive three dimensional (3D) position and orientation of a 3-axis (or more) magnetometer/accelerometer device (such as may be implemented in VR or AR headset or computer game controller) without line of sight constraints, a spinning magnetic field is used to discriminate and remove the external (Earth's) magnetic field from the spinning magnetic field. This reduces the problem to finding the distance to the source of the magnetic field using a calibration table (or formula), finding two angles describing the deviation of the magnetic sensor from the axis of rotation of the spinning magnetic field and the phase around this axis, and from these values deriving the orientation of the sensor.

To derive three dimensional (3D) position and orientation of a 3-axis (or more) magnetometer/accelerometer device (such as may be implemented in VR or AR headset or computer game controller) without line of sight constraints, a spinning magnetic field is used to discriminate and remove the external (Earth's) magnetic field from the spinning magnetic field. This reduces the problem to finding the distance to the source of the magnetic field using a calibration table (or formula), finding two angles describing the deviation of the magnetic sensor from the axis of rotation of the spinning magnetic field and the phase around this axis, and from these values deriving the orientation of the sensor.

A method for determining the position of a controller device, comprises: receiving dimensions of the display input by a user of the computer-based system; capturing successive images of the display at the controller device; determining a position of the controller device relative to the display based on the dimensions of the display and a perspective distortion of the display in the captured successive images of the display; providing the determined position of the controller to the computer-based system to interface with the interactive program to cause an action by the interactive program.

An inclination of a first unit is detected based on an output from a first acceleration sensor provided in a first unit of a controller, and an inclination of a second unit is detected based on an output from a second acceleration sensor provided in a second unit separate from the first unit. A difference between the inclinations of the first unit and the second unit is detected, and game control is performed using the detected difference. Thus, with a game apparatus using a plurality of acceleration sensors or a plurality of sensors capable of detecting a motion or a posture, a dynamic play is made possible with a high degree of freedom of motion and an intuitive motion input is realized.

An inclination of a first unit is detected based on an output from a first acceleration sensor provided in a first unit of a controller, and an inclination of a second unit is detected based on an output from a second acceleration sensor provided in a second unit separate from the first unit. A difference between the inclinations of the first unit and the second unit is detected, and game control is performed using the detected difference. Thus, with a game apparatus using a plurality of acceleration sensors or a plurality of sensors capable of detecting a motion or a posture, a dynamic play is made possible with a high degree of freedom of motion and an intuitive motion input is realized.

Methods, systems, and apparatuses are described for providing XR experiences to multiple users. A plurality of XR devices might participate in a group XR experience. Physical environment data may be determined for each XR device. Virtual play areas for each of the XR devices may be determined. The different virtual play areas may be fit into different areas of a predefined virtual play area, and/or may be combined to form a combined virtual play area. Each XR device might be provided a different portion of the virtual play area. The XR devices may be sent different virtual map positioning data to provide the group XR experience.

Methods, systems, and apparatuses are described for providing XR experiences to multiple users. A plurality of XR devices might participate in a group XR experience. Physical environment data may be determined for each XR device. Virtual play areas for each of the XR devices may be determined. The different virtual play areas may be fit into different areas of a predefined virtual play area, and/or may be combined to form a combined virtual play area. Each XR device might be provided a different portion of the virtual play area. The XR devices may be sent different virtual map positioning data to provide the group XR experience.