An approach is provided for a gaming overlay application to provide automatic in-game subtitles and/or closed captions for video game applications. The overlay application accesses an audio stream and a video stream generated by an executing game application. The overlay application processes the audio stream through a text conversion engine to generate at least one subtitle. The overlay application determines a display position to associate with the at least one subtitle. The overlay application generates a subtitle overlay comprising the at least one subtitle located at the associated display position. The overlay application causes a portion of the video stream to be displayed with the subtitle overlay.

Various embodiments of the present disclosure relate generally to systems and methods for generating multi-view interactive digital media representations in a virtual reality environment. According to particular embodiments, a plurality of images is fused into a first content model and a first context model, both of which include multi-view interactive digital media representations of objects. Next, a virtual reality environment is generated using the first content model and the first context model. The virtual reality environment includes a first layer and a second layer. The user can navigate through and within the virtual reality environment to switch between multiple viewpoints of the content model via corresponding physical movements. The first layer includes the first content model and the second layer includes a second content model and wherein selection of the first layer provides access to the second layer with the second content model.

Techniques for providing an immersive storytelling experience using a plurality of storytelling devices. Each of the storytelling devices may be configured to perform one or more actions based on a current context of a story and in response to a stimulus event. The actions include at least one of an auditory and a visual effect. Embodiments also provide a controller device configured to manage a playback of the story, by adjusting the stimulus event and the effect of each of the plurality of storytelling devices, based on the current context of the story, thereby creating an interactive and immersive storytelling experience.

A system that incorporates teachings of the present disclosure may include, for example, an accessory having a plurality of tactile-sensitive buttons, a plurality of light sources, wherein each light source emits a controllable spectrum of light through a corresponding one of the plurality of tactile-sensitive buttons, and a controller coupled to the plurality of tactile-sensitive buttons, and the plurality of light sources. The controller can be operable to detect tactile contact of each of the plurality of tactile-sensitive buttons, receive status information associated with a video game, and adjust the spectrum of light emitted by at least a portion of the plurality of light sources according to the status information to indicate one or more aspects of the video game. Additional embodiments are disclosed.

A method, system, computer readable media and cloud systems are provided. In one example a method includes generating a virtual reality (VR) environment to be rendered for a head mounted display (HMD) of an HMD player during a session. The HMD player is provided with an HMD view that is controlled by movement of a character in the VR environment by the HMD player. The method includes providing a spectator view into the VR environment. The spectator view is associated with a viewing spot directed into the VR environment. Then, automatically moving said viewing spot of the spectator view to other viewing spots that follow the character in the VR environment. Moving the viewing spot of the spectator view has a delay in movement to follow the HMD view, and said delay in movement does not delay time progress for the session.

Systems and methods for creating personalized exercise programs are disclosed. An image capture device and a computer device are used to capture images of a user while the user performs athletic movements. The images may then be evaluated to create a human movement screen score. The human movement screen score, goal and time commitment information may then be used to create a personalized exercise program tailored to the specific user.

A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes enabling a spectator to view into a virtual reality environment, and control what specific content within the environment the spectator wishes to see. Motions of an HMD worn by an HMD player can be tracked so as to provide a geared spectator view into the virtual reality environment. The gearing of the spectator view enables a spectator to view the virtual reality content in a more normal way which is not tied to the strict movements of the HMD worn by the HMD player. The gearing effects can be programmable or can be set based on the content being navigated by the HMD player or preferences of the individual spectators.

A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes generating a virtual reality environment to be rendered for a head mounted display (HMD) of an HMD player. The HMD player is provided with an HMD view that is controlled by movement of the HMD by the HMD player. Then, providing a spectator view into the virtual reality environment. The spectator view is associated with a viewing spot directed into the virtual reality environment. The viewing spot is decoupled from the HMD view. In some examples, multiple viewing spots are pre-authored and the spectator is provided with different ones of the viewing spots as the HMD players move around the virtual reality environment.

An example game system includes a controller device, and a game process section for performing a game process based on an operation on the controller device. The controller device includes a plurality of direction input sections, a sensor section for obtaining a physical quantity used for calculating an attitude of the controller device, and a display section for displaying a game image. The game process section first calculates the attitude of the controller device based on the physical quantity obtained by the sensor section. Then, the game process section controls an attitude of a virtual camera in a virtual space based on the attitude of the controller device, and controls a position of the virtual camera based on an input on the direction input section. A game image to be displayed on the display section is generated based on the position and the attitude of the virtual camera.

Introduced herein are techniques for producing sensory stimuli that increase the realism of content experienced by a user. Several embodiments pertain to scent delivery system that are able to dispense scented material(s) to the user. A scent delivery system could be a self-contained unit that is attachable to a head-mounted display (HMD) or could be integrated into the HMD itself. The scent delivery system can be used to improve the realism of content (e.g., visual content and audio content) presented to the user. More specifically, the scent delivery system can be configured to dispense one or more scented materials in response to determining a particular scene is being shown. Different scented materials can be dispensed based on characteristics of the content. In some embodiments, the scented material(s) are held in capsules that are housed within the scent delivery system. The capsules may be readily replaceable by the user.