The glasses with display may include a bridge, two temples hingedly coupled to the bridge, and a directional microphone array, the directional microphone array including two or more microphones positioned on the bridge or the temples. The glasses with display may also include a user microphone array, the user microphone array including one or more microphones positioned on the temples and oriented toward the mouth of a user wearing the glasses with display or one or more bone conduction microphones. In addition, the glasses with display include two lenses positioned in the bridge, at least one of the lenses including a display, the display visible by the user, the display including one or more of a directional display, closed caption display, and user volume display. The glasses with display additionally include a processor adapted to receive audio signals from the directional microphone array and the user microphone array, or from a separate mobile device, the processor adapted to control the display.

A system for tracking the movement of an object includes a radar device having a first field of view. The radar device generates radar data indicating one of a range corresponding to a distance of a moving object within the first field of view from the radar device and a range rate corresponding to a rate at which the distance is changing relative to the radar device. The system also includes an imager having a second field of view at least partially overlapping the first field of view in an overlap field of view. The imager generates imager data measuring, when the object is in the second field of view, an angular position of the object relative to the imager in at least one dimension. In addition, the system includes a processor combining the radar data and imager data, when the object is in the overlap field of view, to identify a track of the object in at least two dimensions.

A system for tracking the movement of an object includes a radar device having a first field of view. The radar device generates radar data indicating one of a range corresponding to a distance of a moving object within the first field of view from the radar device and a range rate corresponding to a rate at which the distance is changing relative to the radar device. The system also includes an imager having a second field of view at least partially overlapping the first field of view in an overlap field of view. The imager generates imager data measuring, when the object is in the second field of view, an angular position of the object relative to the imager in at least one dimension. In addition, the system includes a processor combining the radar data and imager data, when the object is in the overlap field of view, to identify a track of the object in at least two dimensions.

An apparatus and a method for measuring distance by using electronic devices are provided. The apparatus includes an output unit, an input unit, and a controller. The output unit may be configured to transmit the first sound wave, and the input unit may be configured to receive the second sound wave from another apparatus that receives the first sound wave. The controller may be configured to determine the distance between the apparatus and the another apparatus based on a first value and a second value. The first value may correspond to a difference between a timing of initiating a transmission of the first sound wave and a timing of receiving the second sound wave, and the second value may correspond to a difference between a timing when the another apparatus initiates the transmission of the second sound wave and the timing when the another apparatus receives the first sound wave.

An apparatus and a method for measuring distance by using electronic devices are provided. The apparatus includes an output unit, an input unit, and a controller. The output unit may be configured to transmit the first sound wave, and the input unit may be configured to receive the second sound wave from another apparatus that receives the first sound wave. The controller may be configured to determine the distance between the apparatus and the another apparatus based on a first value and a second value. The first value may correspond to a difference between a timing of initiating a transmission of the first sound wave and a timing of receiving the second sound wave, and the second value may correspond to a difference between a timing when the another apparatus initiates the transmission of the second sound wave and the timing when the another apparatus receives the first sound wave.

The glasses with display may include a bridge, two temples hingedly coupled to the bridge, and a directional microphone array, the directional microphone array including two or more microphones positioned on the bridge or the temples. The glasses with display may also include a user microphone array, the user microphone array including one or more microphones positioned on the temples and oriented toward the mouth of a user wearing the glasses with display or one or more bone conduction microphones. In addition, the glasses with display include two lenses positioned in the bridge, at least one of the lenses including a display, the display visible by the user, the display including one or more of a directional display, closed caption display, and user volume display. The glasses with display additionally include a processor adapted to receive audio signals from the directional microphone array and the user microphone array, or from a separate mobile device, the processor adapted to control the display.

Techniques for determining information associated with sounds detected in an environment based on audio data and map data or perception data are discussed herein. A vehicle can use map data and/or perception data to distinguish between multiple audio signals or sounds. A direct source of sound can be distinguished from a reflected source of sound by determining a direction of arrival of sounds and which objects the directions of arrival are associated with in the environment. A reflected sound can be received without receiving a direct sound. Based on the reflected sound and map data or perception data, characteristics of sound in an occluded region of the environment may be determined and used to control the vehicle.

Techniques for determining information associated with sounds detected in an environment based on audio data and map data or perception data are discussed herein. A vehicle can use map data and/or perception data to distinguish between multiple audio signals or sounds. A direct source of sound can be distinguished from a reflected source of sound by determining a direction of arrival of sounds and which objects the directions of arrival are associated with in the environment. A reflected sound can be received without receiving a direct sound. Based on the reflected sound and map data or perception data, characteristics of sound in an occluded region of the environment may be determined and used to control the vehicle.

Embodiments of this application disclose method and apparatus for positioning a target audio signal by an audio interaction device, and an audio interaction device The method includes: obtaining audio signals in a plurality of directions in a space, and performing echo cancellation on the audio signal, the audio signal including a target-audio direct signal; obtaining weights of a plurality of time-frequency points in the audio signals, a weight of each time-frequency point indicating, at the time-frequency point, a relative proportion of the target-audio direct signal in the audio signals; weighting time-frequency components of the audio signal at the plurality of time-frequency points separately for each of the plurality of directions by using the weights of the plurality of time-frequency points, to obtain a weighted audio signal energy distribution; and obtaining a sound source azimuth corresponding to the target-audio direct signal in the audio signals accordingly.

Embodiments of this application disclose method and apparatus for positioning a target audio signal by an audio interaction device, and an audio interaction device The method includes: obtaining audio signals in a plurality of directions in a space, and performing echo cancellation on the audio signal, the audio signal including a target-audio direct signal; obtaining weights of a plurality of time-frequency points in the audio signals, a weight of each time-frequency point indicating, at the time-frequency point, a relative proportion of the target-audio direct signal in the audio signals; weighting time-frequency components of the audio signal at the plurality of time-frequency points separately for each of the plurality of directions by using the weights of the plurality of time-frequency points, to obtain a weighted audio signal energy distribution; and obtaining a sound source azimuth corresponding to the target-audio direct signal in the audio signals accordingly.