Methods and systems are provided for enhanced audio experiences in VR/AR applications. The apparatuses of this disclosure are adapted to record multiple binaural stereo pairs and play back select binaural pairs corresponding to users' head positions. A substantially spherical microarray is utilized in various embodiments for recording multiple binaural stereo pairs. A VR/AR headset is further adapted to track a user's head positions and dynamically play back binaural sound pairs corresponding to the head positions.

An apparatus comprising: an input configured to receive at least one audio signal input from at least one microphone; at least one microphone configuration determiner configured to provide for the at least one microphone a location on the apparatus; at least one sensor configured to provide at least one orientation of the apparatus; a recording mode determiner configured to determine at least one recording mode for the apparatus based on the location of the at least one microphone and the at least one orientation of the apparatus; a recording mode controller configured to determine at least one recording parameter for the at least one audio signal input from the at least one microphone based on the at least one recording mode; and a digital signal processor configured to apply the at least one recording parameter to the at least one audio signal input.

Holographic sound is recorded and reproduced by way of a single monaural recording per left and right ear recorded. This is accomplished by determining the phase shift of frequencies recorded after dividing the sound into discrete frequencies in a recording device having resonators, each resonating at a different frequency, placed in a circular arrangement and divided into discrete channels by non-resonant material. The resonators are placed in a pseudo-randomized arrangement within the recording device and the circle of resonators is in front of a microphone which records the sound monaurally. Playback is then by way of arranging speakers or transducers into micro perforated sheets which amplify the sound, the arrangement of speakers/transducers around a central point. The sound is then played back directionally based on the position where the sound originally was recorded from and the position of the particular transducer around the central point.

Holographic sound is recorded and reproduced by way of a single monaural recording per left and right ear recorded. This is accomplished by determining the phase shift of frequencies recorded after dividing the sound into discrete frequencies in a recording device having resonators, each resonating at a different frequency, placed in a circular arrangement and divided into discrete channels by non-resonant material. The resonators are placed in a pseudo-randomized arrangement within the recording device and the circle of resonators is in front of a microphone which records the sound monaurally. Playback is then by way of arranging speakers or transducers into micro perforated sheets which amplify the sound, the arrangement of speakers/transducers around a central point. The sound is then played back directionally based on the position where the sound originally was recorded from and the position of the particular transducer around the central point.

Certain aspects of the technology disclosed herein include generating a virtual sound field based on data from an ambisonic recording device. The ambisonic device records sound of a surrounding environment using at least four microphones having a tetrahedral orientation. An omnidirectional microphone having an audio-isolated portion can be used to isolate sound from a particular direction. Sound received from the plurality of microphones can be used to generate a virtual sound field. The virtual sound field include a dataset indicating a pressure signal and a plurality of velocity vectors. The ambisonic recording device can include a wide angle camera and generate wide angle video corresponding to the virtual sound field.

Methods and systems are provided for enhanced audio experiences in VR/AR applications. The apparatuses of this disclosure are adapted to record multiple binaural stereo pairs and play back select binaural pairs corresponding to users' head positions. A substantially spherical microarray is utilized in various embodiments for recording multiple binaural stereo pairs. A VR/AR headset is further adapted to track a user's head positions and dynamically play back binaural sound pairs corresponding to the head positions.

Holographic sound is recorded and reproduced by way of a single monaural recording per left and right ear recorded. This is accomplished by determining the phase shift of frequencies recorded after dividing the sound into discrete frequencies in a recording device having resonators, each resonating at a different frequency, placed in a circular arrangement and divided into discrete channels by non-resonant material. The resonators are placed in a pseudo-randomized arrangement within the recording device and the circle of resonators is in front of a microphone which records the sound monaurally. Playback is then by way of arranging speakers or transducers into micro perforated sheets which amplify the sound, the arrangement of speakers/transducers around a central point. The sound is then played back directionally based on the position where the sound originally was recorded from and the position of the particular transducer around the central point.

A method of recording sound in a binaural manner and transmitting the sound to an electronic device using a wearable device is provided. The method includes receiving audio at a left microphone externally positioned proximate to a left ear opening of a user and at a right microphone externally positioned proximate to a right ear opening of the user, both the left microphone and the right microphone worn on a head of the user. The method further includes acquiring video with a camera worn on the head of the user while receiving the audio. The method further includes collecting the audio and the video at the electronic device and synchronizing the audio with the video at the electronic device to generate an audio-video file. The method further includes storing the audio-video file on a machine readable non-transitory storage medium of the electronic device.

An information processing device includes an API (Application Programming Interface) only for reading/writing of an offset value, which is data providing disparity to a graphics image to generate an image for the left eye and an image for the right eye from the original image, arranged to store the offset value in an internal storage region that is a storage region inside of a reproducer configured to reproduce images, and to read out the offset value stored in the internal storage region.

An apparatus comprising: an input configured to receive at least one audio signal input from at least one microphone; at least one microphone configuration determiner configured to provide for the at least one microphone a location on the apparatus; at least one sensor configured to provide at least one orientation of the apparatus; a recording mode determiner configured to determine at least one recording mode for the apparatus based on the location of the at least one microphone and the at least one orientation of the apparatus; a recording mode controller configured to determine at least one recording parameter for the at least one audio signal input from the at least one microphone based on the at least one recording mode; and a digital signal processor configured to apply the at least one recording parameter to the at least one audio signal input.