Methods, systems, devices, and software are described for providing supplemental content for presentation on a mobile device that identifies a video and a portion within the video. In one embodiment, a system includes a mobile device with an integrated video camera that tracks a display playing a movie. The mobile device automatically identifies the current scene in the movie and then accesses supplemental non-video content related to the identified scene. The accessed supplemental non-video content (e.g., audio, tactile, olfactory data) is then presented to the user at the same time the movie is played.

A system that incorporates teachings of the present disclosure may include, for example, an accessory having a plurality of tactile-sensitive buttons, a plurality of light sources, wherein each light source emits a controllable spectrum of light through a corresponding one of the plurality of tactile-sensitive buttons, and a controller coupled to the plurality of tactile-sensitive buttons, and the plurality of light sources. The controller can be operable to detect tactile contact of each of the plurality of tactile-sensitive buttons, receive status information associated with a video game, and adjust the spectrum of light emitted by at least a portion of the plurality of light sources according to the status information to indicate one or more aspects of the video game. Additional embodiments are disclosed.

A human-machine interface involves plural spatially-coherent visual presentation surfaces at least some of which are movable by a person. Plural windows or portholes into a virtual space, at least some of which are handheld and movable, are provided by using handheld and other display devices. Aspects of multi-dimensional spatiality of the moveable window (e.g., relative to another window) are determined and used to generate images. As one example, the moveable window can present a first person perspective “porthole” view into the virtual space, this porthole view changing based on aspects of the moveable window's spatiality in multi-dimensional space relative to a stationary window. A display can present an image of a virtual space, and an additional, moveable display can present an additional image of the same virtual space.

An information processing apparatus performs predetermined game processing based on operation inputs from a plurality of operation devices and generates a game image based on the game processing. Then, in accordance with the number of the operation devices used for the game processing, the information processing apparatus generates a game image for multiplayer play using a split screen, and performs a restriction process for, in a case where an output destination to which the game image is to be output is a display, placing a restriction so that multiplayer play is not performed by players exceeding a predetermined number of players, and in a case where the output destination to which the game image is to be output is an external display, not placing the restriction.

A communication game system includes a plurality of game apparatuses which are able to wirelessly communicate with each other. Each of the game apparatus registers identifying information of an opponent obtained by a short-distance wireless communication or by user's manual input in a friend list. Thereafter, the game apparatus connects to the Internet, and inquires whether it is possible to communicate with an opponent in the friend list over the network. If it is possible to communicate, the game apparatus obtains an address of the opponent to make a network communication. Even if a user makes a short distance wireless communication with a friend to exchange and register the identifying information or registers the friend by hand and then is parted from the friend, the user can safely communicate with the friend across the network without being exposed to unknown players. In a case that an additional opponent is to be added to the multiplayer game session, one of the participants transmits identifying information to introduce the communicating opponents to each other. The game apparatuses introduced to each other make a communication over a network, and add the identifying information of the opponents to the friend list, if necessary.

Methods, systems, devices, and software are described for providing supplemental content for display on a mobile device. In one embodiment, a system includes a video display that displays video content. A mobile device with an integrated display may track the video display, with a video camera or other methods, and identify the video content in the tracked video display. The mobile device may access supplemental content related to the identified video content, and display the accessed supplemental content on the integrated display.

A method for presenting visual interface content comprising adjunct visual interface content during application program execution, and the adjunct visual interface content provides visual information associated with application program execution. The method comprising displaying the adjunct visual interface content using a first interface, displaying the adjunct visual interface content using a second interface, and displaying the updated adjunct visual interface content on the at least one of the first and second interfaces based on actuation of the first and second interfaces.

An example game system includes a controller device, and a game process section for performing a game process based on an operation on the controller device. The controller device includes a plurality of direction input sections, a sensor section for obtaining a physical quantity used for calculating an attitude of the controller device, and a display section for displaying a game image. The game process section first calculates the attitude of the controller device based on the physical quantity obtained by the sensor section. Then, the game process section controls an attitude of a virtual camera in a virtual space based on the attitude of the controller device, and controls a position of the virtual camera based on an input on the direction input section. A game image to be displayed on the display section is generated based on the position and the attitude of the virtual camera.

Stereoscopic viewing systems may be adjusted for a user's inter-pupillary distance (IPD). An inter-pupillary distance (IPD) value is determined from a signal from a position sensitive device coupled to two moveable sighting fixtures mounted to a head mounted display (HMD) having two fixed optics configured for a specific inter-pupillary distance. The position sensitive device is configured to produce a signal that corresponds to a distance between the two sighting fixtures. The images are warped with a processor to optimize display of the images with the two fixed optics for the determined IPD value.

Handheld location based games are provided in which a user's physical location correlates to the virtual location of a virtual character on a virtual playfield.

Augmented Reality (AR) systems are provided in which video game indicia are overlaid onto .a user's physical environment. A landscape detector is provided that may obtain information about the user's landscape, in addition to the user's location, in order to provide overlaying information to an AR head-mounted display and control information to non-user controlled video game characters.