Embodiments of the present disclosure relate to an audio system for artificial reality applications. One or more transducers of the audio system output, in accordance with audio instructions, one or more ultrasonic pressure waves simulating a virtual audio source near an ear of a user of the headset. A controller of the audio system generates the audio instructions such that the one or more ultrasonic pressure waves form at least a portion of audio content for presentation to the user. An array of microphones of the audio system detects audio signals in a local area. A deep neural network of the audio system processes the detected audio signals to generate enhanced audio content, and the one or more transducers present the enhanced audio content to a user.

An audio transducer device includes an audio transducer, a controller and a direction adjusting mechanism. The audio transducer has a sound receiving surface formed with multiple sound collecting holes, and multiple microphones corresponding in position to the sound collecting holes. The controller is detachably mounted to an electronic device, and controls the microphones to cooperatively perform directional sound reception to obtain audio data. The direction adjusting mechanism interconnects an audio transducer shell and the controller such that the sound receiving surface can be rotated to a position where a normal direction thereof and an image capturing direction of the electronic device forming a desired angle therebetween.

A device capable of motion includes an acoustic echo canceller for cancelling a reference signal from received audio data. The device updates an adaptive filter as the device moves to reflect the changing audio channel between a loudspeaker and a microphone of the device. A step size for changing coefficients of the filter is determined based on its velocity. A number of iterations for updating the filter using a frame of audio data is also determined based on the velocity.

A system and method is described for determining whether a loudspeaker device has relocated, tilted, rotated, or changed environment such that one or more parameters for driving the loudspeaker may be modified and/or a complete reconfiguration of the loudspeaker system may be performed. In one embodiment, the system may include a set of sensors. The sensors provide readings that are analyzed to determine 1) whether the loudspeaker has moved since a previous analysis and/or 2) a distance of movement and/or a degree change in orientation of the loudspeaker since the previous analysis. Upon determining the level of movement is below a threshold value, the system adjusts previous parameters used to drive one or more of the loudspeakers. By adjusting previous parameters instead of performing a complete recalibration, the system provides a more efficient technique for ensuring that the loudspeakers continue to produce accurate sound for the listener.

Techniques and systems are described for generating and using a sound localization model. A described technique includes obtaining for a building a sound sensor map indicating locations of first and second sound sensor devices in respective first and second rooms of the building; causing an autonomous device to navigate to the first room and to emit, during a time window, sound patterns at one or more frequencies within the first room; receiving sound data including first and second sound data respectively from the first and second sound sensor devices that are observed during the time window; and generating and storing a sound localization model based on the sound sensor map, autonomous device location information, and the received sound data, the model being configured to compensate for how sounds travels among rooms in at least a portion of the building such that an origin room of a sound source is identifiable.

A method, system, apparatus, and architecture are provided for generating a sound-enhanced sensing envelope by using a plurality of sensors and one or more passive sound sensors of a vehicle to collect and process sensor data signals characterizing an exterior environment of the vehicle, thereby generating a sensing envelope around the vehicle using direct sensing data signals and a sound-enhanced sensing envelope around the vehicle using indirect sensing data signals which is used to evaluate advanced driver assistance system commands for the vehicle with respect to safety-related events identified by the indirect sensing data signals.

Communications involving one or more people wearing face coverings are enhanced over one or more modalities using sensor integrations. In one particular example, a face covering device according to the implementations of this disclosure may include one or more microphones and one or more cameras which capture input directly from the wearer of the face covering device. The input is processed to produce output representing the input in the same modality or in a different modality, and in particular is scaled to, for example, increase a volume of audio and introduce a visual representation of an expression of the wearer's face which is at least partially obscured by the face covering device.

Disclosed is a of monitoring the breathing of a user, comprising receiving a plurality of audio signals from a plurality of microphones and beamforming the plurality of audio signals into a beamformed audio signal. Observed breath-related parameters are derived from the beamformed audio signal and an output of or derived from the observed breath-related parameters is provided to a user of a client device. Breath metrics may be determined by comparing the observed breath-related parameters with reference breath-related parameters, and a breathing score may be derived from the breath metrics. The breathing score may be based on a combination of how closely an observed respiration of the user matches a prompted or desired respiration rate and an observed amount of time that the user's observed respiration rate is within a threshold value of the prompted or desired respiration rate.

A signal processing system and method for delivering spatialized sound by optimizing sound waveforms from a sparse array of speakers to the ears of a user. The system can provide listening areas within a room or space, to provide spatialization sounds to create a 3D audio effect. In a binaural mode, a binary speaker array provides targeted beams aimed towards a user's ears.

In various examples, audio alerts of emergency response vehicles may be detected and classified using audio captured by microphones of an autonomous or semi-autonomous machine in order to identify travel directions, locations, and/or types of emergency response vehicles in the environment. For example, a plurality of microphone arrays may be disposed on an autonomous or semi-autonomous machine and used to generate audio signals corresponding to sounds in the environment. These audio signals may be processed to determine a location and/or direction of travel of an emergency response vehicle (e.g., using triangulation). Additionally, to identify siren types—and thus emergency response vehicle types corresponding thereto—the audio signals may be used to generate representations of a frequency spectrum that may be processed using a deep neural network (DNN) that outputs probabilities of alert types being represented by the audio data. The locations, direction of travel, and/or siren type may allow an ego-vehicle or ego-machine to identify an emergency response vehicle and to make planning and/or control decisions in response.