A system for coordinating reactions of a virtual character with script spoken by a player in a video game or presentation, comprising an internet-connected server executing software and streaming video games or presentations to a player's computerized device. The system senses start of a dialogue between the player and the virtual character, displays a script for the player on a display of the computerized platform, prompts the player to speak the script. A timer then starts, or the system tracks an audio stream of the spoken script, determines where the player is in the script by the timer or the audio stream, and causes specific actions and responses of the virtual character according to pre-programmed association of actions and responses of the character to points of time or specific variations in the audio stream.

A method for processing an audio input for tactile transduction, comprising the steps of: determining for a mount surface a tactile resonance based on the recognized surface characteristic of the mount surface by a resonance sensor within a housing; and controlling an intensity of an actuator coupled to a weight within the housing for generating the tactile sound derived from the controlled housing in contact with the mount surface, said control in synchronization with on-screen content and intensity-matched to the recognized surface characteristic for enhanced immersion.

The application describes techniques for adaptively setting a threshold that will be used to determine the gain applied to a haptics signal.

Methods and systems are provided for generating crowd noise related to a media event being presented using a cloud service is provided. The method includes receiving audio data captured from a viewer of the media event. The method includes processing the audio data to identify utterances of the viewer. In one embodiment, features of the utterances are classified to build a reaction model for identifying reaction states of the viewer. The method includes producing a soundscape for the crowd noise, the soundscape blends together audio of generic crowd noise related to the media event and audio corresponding to one or more of said reaction states of the viewer. In one embodiment, the soundscape is output to a speaker associated with presentation of the media event to the viewer.

Provided is a device for providing motion effects, the device including a first detector configured to detect a movement of a specific object in a video of a content; a second detector configured to detect a sound event from an audio of the content; and a motion synthesizing unit configured to generate a synthesized motion by synthesizing a first motion corresponding to the movement of the specific object and a second motion generated based on the sound event.

An electronic device may receive audio during play of a game on a game console over a network. The electronic device may detect one or more sounds during the monitoring of the audio. The electronic device may control, based on the detected one or more sounds, operation of a game controller that interacts with the game during play. The controlling of the operation of the game controller may comprise adjusting sensitivity of the game controller. The electronic device may determine directionality of the detected one or more sounds and adjust the sensitivity of the game controller based on the determined directionality of the detected one or more sounds. The electronic device may increase and/or decrease the sensitivity of the game controller in response to changes in the determined directionality of the detected one or more sounds.

An electronic device may receive audio during play of a game on a game console over a network. The electronic device may detect one or more sounds during the monitoring of the audio. The electronic device may control, based on the detected one or more sounds, operation of a game controller that interacts with the game during play. The controlling of the operation of the game controller may comprise adjusting sensitivity of the game controller. The electronic device may determine directionality of the detected one or more sounds and adjust the sensitivity of the game controller based on the determined directionality of the detected one or more sounds. The electronic device may increase and/or decrease the sensitivity of the game controller in response to changes in the determined directionality of the detected one or more sounds.

A 3D scene is generated consisting of one or more objects from a natural language description that may consist of text or voice. Relevant keywords like asset attributes and placement are extracted from the description. Using these keywords, a 2D image is generated using a generative model. Another neural model is used to reconstruct the 3D objects from the 2D. The 3D objects can be assembled to meet the placement specifications. Alternatively, the 3D object is generated by either transforming existing 3D objects or by using a 3D generative model to meet the specifications in the description.

A 3D scene is generated consisting of one or more objects from a natural language description that may consist of text or voice. Relevant keywords like asset attributes and placement are extracted from the description. Using these keywords, a 2D image is generated using a generative model. Another neural model is used to reconstruct the 3D objects from the 2D. The 3D objects can be assembled to meet the placement specifications. Alternatively, the 3D object is generated by either transforming existing 3D objects or by using a 3D generative model to meet the specifications in the description.

A voice acquisition section 126 acquires a voice of a user viewing content. A recording processing section 116 records content data and user voice data and generates a content file in which the content data and the user voice data are associated with a recording time. A voice detection section 136 detects whether or not the voice of the user has been acquired by the voice acquisition section 126. An event information generation section 140 generates event information including a start time and an end time of the acquisition of the voice of the user. A communication section 102 transmits the event information to a server.