A system that incorporates the subject disclosure may include, for example, a gaming system that cooperates with a graphical user interface to enable user modification and enhancement of one or more audio streams associated with the gaming system. In embodiments, the audio streams may include a game audio stream, a chat audio stream of conversation among players of a video game, and a microphone audio stream of a player of the video game. Additional embodiments are disclosed.

Embodiments provide a voice interaction method, a device, and a storage medium. The method includes: transmitting obtained audio data of a user to a server for semantic understanding, to obtain structured data; receiving the structured data returned by the server; and controlling, according to a running game and the structured data, the game to perform a corresponding operation. In the embodiments, voice recognition and semantic understanding technologies are used to enable a user to complete an operation of a game under a dialogue interaction through a communication between a terminal device and a server, thus enhancing game experience of the user and improving entertainment and convenience.

This application discloses a method and apparatus for determining characteristics of a sound source. The method may include: acquiring a first position of a first virtual role controlled by an application client in a virtual scene; detecting, in a sound source detection area associated with the first position, a second position of a sound source virtual object in the virtual scene; determining transparency of a position mark that matches the sound source virtual object, according to a sound source distance between the first position and the second position, the position mark identifying the second position of the sound source virtual object; and displaying, on an interaction interface of the application client, the position mark of the sound source virtual object according to the transparency.

A computer-implemented system and method are described for managing audio chat for an online video game or application. For example, a system according to one embodiment comprises: an online video game or application execution engine to execute an online video game or application in response to input from one or more users of the video game or application and to responsively generate audio and video of the video game or application; and a chat subsystem to establish audio chat sessions with the one or more users and one or more spectators to the video game or application, the chat subsystem establishing a plurality of audio chat channels including a spectator channel over which the spectators participate in audio chat and a user channel over which the users participate in audio chat.

A mobile computing device provides real-time streaming of multiple sources of audio and video. The mobile computing device receives audio and video streams from multiple sources, including a camera video stream, a microphone audio stream, a game audio stream, and a game video stream. The device adjusts microphone and/or the game input levels based on a user-selected audio mix setting to produce rebalanced microphone and game audio streams, multiplexes the rebalanced microphone and game audio streams to produce a multiplexed audio stream, and encodes the multiplexed audio stream to produce an encoded audio stream. The user-selected audio mix setting may be adjusted by a user of the mobile computing device. The mobile computing device packages the encoded audio stream with an encoded video stream of composited camera and game video streams into one or more streaming packets, and outputs the one or more streaming packets.

A system is provided, including the following: an input device, the input device including, a light emitting diode (LED) array; an image capture device configured to capture images of an interactive environment in which the input device is disposed, the image capture device configured to generate captured image data that is processed to determine a movement of the input device in the interactive environment; wherein a gearing is established that adjusts an amount by which the movement of the input device is mapped to movement of an image that is rendered to a display, the gearing changing to different settings during the movement of the image as the movement of the image is rendered to the display.

A method for managing multi-player interactivity with an interactive application is provided, including the following operations: determining locations of a first controller, a second controller, a first user, and a second user; pairing the first controller to the first user based on the location of the first controller and the location of the first user; pairing the second controller to the second user based on the location of the second controller and the location of the second user; presenting a split-screen view of the interactive application, wherein presenting the split-screen view includes setting positions of a first view and a second view within the split-screen view based on one or more of the locations of the first user, the second user, the first controller, or the second controller.

Embodiments of the present invention enable rich control input data to control video games that are remotely executed. Rich control input includes three-dimensional image data, color video, audio, device orientation data, and touch input. A remotely-executed video game is one executed on a server or other computing device that is networked to a client device receiving the rich control input. Rich control input includes more data than can be uploaded to a game server without degrading game performance. Embodiments of the present invention preprocess the rich control data on the client and into data that may be uploaded to the game server. The rich input stream may be processed in a general way or in a game-specific way.

A computer-implemented system and method are described for managing audio chat for an online video game or application. For example, a system according to one embodiment comprises: an online video game or application execution engine to execute an online video game or application in response to input from one or more users of the video game or application and to responsively generate audio and video of the video game or application; and a chat subsystem to establish audio chat sessions with the one or more users and one or more spectators to the video game or application, the chat subsystem establishing a plurality of audio chat channels including a spectator channel over which the spectators participate in audio chat and a user channel over which the users participate in audio chat.

An image capture device, including: a housing; a first camera defined along a front surface of the housing; a first camera controller configured to control the first camera to capture images of an interactive environment during user interactivity at a first exposure setting, the captured images from the first camera being analyzed to detect a dynamic range of the interactive environment and to track a user; a second camera defined along the front surface of the housing; a second camera controller configured to control the second camera to capture images of the interactive environment during the user interactivity at a second exposure setting based on the detected dynamic range, the second exposure setting being lower than the first exposure setting and configured to enable capture of objects that are the brightest objects in the interactive environment, the captured images from the second camera being analyzed to track an illuminated object.