A server device that incorporates teachings of the present disclosure may include, for example, a memory and a processor. The processor can identify first and second players present at first and second physical locations, to identify first and second boundary and topographical information of the first and second physical locations, to map the first and second boundary and topographical information of the first and second physical locations to a virtual gaming space, to capture first and second position and orientation information for the first and second players, to map the first and second position and orientation information to the virtual gaming space, to generate first and second virtual players corresponding to the first and second players, and to transmit to first goggles information representative of the second virtual player for display superimposed onto a transparent viewing apparatus for viewing of the virtual gaming space. Additional embodiments are disclosed.

A three-dimensional puzzle has a monitoring puzzle piece and multiple monitored puzzle pieces. For puzzle pattern determination, the monitoring puzzle piece is equipped with sensors, a processor, a wireless transceiver, and optionally a gyroscope sensor. The monitored puzzle pieces are rotatably connected to each other and to the monitoring puzzle piece to form the puzzle. The sensors, together with the processor or alternatively with an external client, track the monitored puzzle piece rotating relative to the monitoring puzzle piece. The external client may provide feedback to a user of the puzzle. The system enables the competitions between the user and users of other puzzles without requiring the physical proximity of the competitors.

A method of interpreting a digit-to-digit gesture based on roll values for a wrist-wearable device is disclosed. The method includes, receiving an indication at a first point in time that a user donning the wrist-wearable device is providing a digit-to-digit gesture in which one of the user's digits touches another of the user's digits without contacting the display of the wearable device. The method further includes, in accordance with a determination that the digit-to-digit gesture is provided while data indicates that the wrist-wearable device has a first roll value, causing a target device in communication with the wearable device to perform a first input command and receiving another indication at a second point in time that is after the first point in time that the user is providing the digit-to-digit gesture again, causing the target device to perform a second input command that is distinct from the first input command.

A computer-implemented method in conjunction with mixed reality gear (e.g., a headset) includes imaging a real scene encompassing a user wearing a mixed reality output apparatus. The method includes determining data describing a real context of the real scene, based on the imaging; for example, identifying or classifying objects, lighting, sound or persons in the scene. The method includes selecting a set of content including content enabling rendering of at least one virtual object from a content library, based on the data describing a real context, using various selection algorithms. The method includes rendering the virtual object in the mixed reality session by the mixed reality output apparatus, optionally based on the data describing a real context (“context parameters”). An apparatus is configured to perform the method using hardware, firmware, and/or software.

An information processing apparatus 1 sequentially receives a plurality of input data between predetermined time TS and time TE, and uses model information to estimate predetermined estimated data at a time point of time T (TS<T<TE) based on the received input data, the model information having been trained by machine learning so as to estimate the estimated data at the time point of the time T on the basis of the received input data.

A method and system of generating an image of a subject from the viewpoint of a virtual camera includes obtaining a plurality of source images of a subject and pose data for each source camera or cameras that captured the source images. Virtual camera pose data is also obtained indicating a pose of a virtual camera relative to the subject. Each source image is distorted based on a difference in pose of the corresponding source camera and the pose of the virtual camera. A weighting is determined for each distorted image based on a similarity between the pose of the corresponding source camera and the pose of the virtual camera. The distorted images are then blended together in accordance with the weightings to form an image of the subject from the viewpoint of the virtual camera.

An information processing apparatus includes a captured image acquisition unit that acquires an image captured by imaging a device including plural markers. A marker image coordinate specification unit specifies a representative coordinate of each marker image from the captured image, and a position and posture derivation unit derives position information and posture information of the device using the representative coordinates of the marker images. The marker image coordinate specification unit specifies a first boundary box surrounding a region within which pixels having a first luminance or more continuously appear, specifies a second boundary box surrounding a region within which pixels having a second luminance or more continuously appear in the first boundary box, the second luminance being higher than the first luminance, and derives a representative coordinate of each marker image based on pixels in the first or second boundary box in response to the number of specified second boundary boxes.

A computer implemented method of controlling an interactive hybrid environment representing a motorised sporting event at a track is described. The interactive hybrid environment includes representations of real and virtual vehicles on the track. The method comprises receiving a stream of real sensor data, the real sensor data comprises: real kinematic data of a real vehicle on the track, the real kinematic data being captured by infra-red sensors at the track, and real control data regarding the control of the real vehicle by a driver, the real control data being captured by vehicle sensors and obtained via telemetry systems from the real vehicle; determining the position and kinematic behaviour of the representation of the real vehicle within the interactive hybrid environment using the real kinematic data; using the real control data and the real kinematic data to create a black box determination of the position of the real vehicle on the track based on the real control data; receiving a stream of computer-generated control data which is obtained by user interaction with a computer presenting the interactive hybrid environment to the user and capturing the user inputs to control kinematic behaviour the representation of the virtual vehicle; and determining the position and kinematic behaviour of the representation of the virtual vehicle within the interactive hybrid environment by using the black box determination and the computer-generated control data.

A wearable controller for video games includes: a garment; contact pads detachably secured to the garment via connectors; and a programmable central controller circuit. The contact pads are connected to the central controller circuit and are operable to generate input signals in response to user action.

Described herein are techniques for providing an in-game virtual boundary. First data is received that is indicative of a user position while the user is playing a video game. It is determined whether the user position is within a warning zone, wherein the warning zone comprises an area between a soft boundary indicative of a safe area for the user and a safe boundary indicative of one or more real-world objects around the user. Based on a relationship between the user position and the safe boundary, a visual indication of a plurality of visual indications of the in-game virtual boundary is determined to provide to the user. Second data indicative of the visual indication is transmitted to a display being viewed by the user while playing the video game.