Provided are a wearable device for providing a multi-modality, and an operation method of the wearable device. The operation method of the wearable device including obtaining source data including at least one of image data, text data, or sound data, determining whether the image data, the text data, and the sound data are included in the source data, based on determining that at least one of the image data, the text data, or the sound data is not included in the source data, generating the image data, the text data, and the sound data, which are not included in the source data, by using a generator of an generative adversarial network (GAN), which receives the source data as an input, generating a pulse-width modulation (PWM) signal based on the sound data, and outputting the multi-modality based on the image data, the text data, the sound data, and the PWM signal.

Provided are a wearable device for providing a multi-modality, and an operation method of the wearable device. The operation method of the wearable device including obtaining source data including at least one of image data, text data, or sound data, determining whether the image data, the text data, and the sound data are included in the source data, based on determining that at least one of the image data, the text data, or the sound data is not included in the source data, generating the image data, the text data, and the sound data, which are not included in the source data, by using a generator of an generative adversarial network (GAN), which receives the source data as an input, generating a pulse-width modulation (PWM) signal based on the sound data, and outputting the multi-modality based on the image data, the text data, the sound data, and the PWM signal.

Examples described herein involve validating motion of a microphone during calibration of a playback device. An example implementation involves a mobile device detecting, via one or more microphones, audio signals emitted from one or more playback devices as part of a calibration process. After the one or more playback devices emit the audio signals, the mobile device determines whether the detected audio signals indicate that sufficient horizontal translation of the mobile device occurred during the calibration process. When the detected audio signals indicate that insufficient horizontal translation occurred, the mobile device displays a prompt to move the mobile device more while the one or more playback devices emit one or more additional audio signals as part of the calibration process. When the detected audio signals indicate that sufficient horizontal translation occurred, the mobile device calibrates the one or more playback devices with a calibration based on the detected audio signals.

Examples described herein involve validating motion of a microphone during calibration of a playback device. An example implementation involves a mobile device detecting, via one or more microphones, audio signals emitted from one or more playback devices as part of a calibration process. After the one or more playback devices emit the audio signals, the mobile device determines whether the detected audio signals indicate that sufficient horizontal translation of the mobile device occurred during the calibration process. When the detected audio signals indicate that insufficient horizontal translation occurred, the mobile device displays a prompt to move the mobile device more while the one or more playback devices emit one or more additional audio signals as part of the calibration process. When the detected audio signals indicate that sufficient horizontal translation occurred, the mobile device calibrates the one or more playback devices with a calibration based on the detected audio signals.

A method and an electronic device for detecting crosstalk data are provided. The method for detecting crosstalk data can detect whether an audio data stream includes crosstalk data. The method includes: receiving a first audio data block, a second audio data block, and a reference time difference, wherein the first audio data block and the second audio data block separately include a plurality of audio data segments; using a time difference between an acquisition time of an audio data segment in the first audio data block and a corresponding audio data segment in the second audio data block as an audio segment time difference; and determining that the audio data segment of the first audio data block includes crosstalk data when the audio segment time difference does not match the reference time difference.

A method and an electronic device for detecting crosstalk data are provided. The method for detecting crosstalk data can detect whether an audio data stream includes crosstalk data. The method includes: receiving a first audio data block, a second audio data block, and a reference time difference, wherein the first audio data block and the second audio data block separately include a plurality of audio data segments; using a time difference between an acquisition time of an audio data segment in the first audio data block and a corresponding audio data segment in the second audio data block as an audio segment time difference; and determining that the audio data segment of the first audio data block includes crosstalk data when the audio segment time difference does not match the reference time difference.

An audio device for improved talker discrimination is provided. To improve suppression of close talker interference, the audio device comprises at least a first and a second audio input to receive a first and second voice input signal; a first filter bank, configured to provide a plurality of first sub-band signals; a second filter bank, configured to provide a plurality of second sub-band signals; a correlator, configured to determine at least one signal correlation between at least a group of the first sub-band signals and at least a group of the second sub-band signals; and an attenuator, arranged to receive at least the group of the first sub-band signals and configured to conduct signal attenuation on the group of the first sub-band signals to provide gain-controlled sub-band signals, wherein the signal attenuation is based on the determined at least one signal correlation.

An audio device for improved talker discrimination is provided. To improve suppression of close talker interference, the audio device comprises at least a first and a second audio input to receive a first and second voice input signal; a first filter bank, configured to provide a plurality of first sub-band signals; a second filter bank, configured to provide a plurality of second sub-band signals; a correlator, configured to determine at least one signal correlation between at least a group of the first sub-band signals and at least a group of the second sub-band signals; and an attenuator, arranged to receive at least the group of the first sub-band signals and configured to conduct signal attenuation on the group of the first sub-band signals to provide gain-controlled sub-band signals, wherein the signal attenuation is based on the determined at least one signal correlation.

A system configured to perform sound source localization (SSL) using reflection classification is provided. A device processes audio data representing sounds from multiple sound sources to generate sound track data that includes an individual sound track for each of the sound sources. To detect reflections, the device determines whether a pair of sound tracks are strongly correlated. For example, the device may calculate a correlation value for each pairwise combination of the sound tracks and determine whether the correlation value exceeds a threshold value. When the correlation value exceeds the threshold, the device invokes a reflection classifier trained to distinguish between direct sound sources and reflected sound sources. For example, the device extracts feature data from the pair of sound tracks and processes the feature data using a trained model to determine which of the sound tracks corresponds to the direct sound source.

Provided is to prevent a false determination due to an attachment condition of an apparatus that transmits and receives an acoustic signal, and perform accurate personal authentication. A personal authentication device includes: a personal authentication means that authenticates an individual by using first information at least including an acoustic characteristic calculated from an acoustic signal propagating through the head of the user, which is detected by an apparatus being attached on a head of a user for transmitting and receiving the acoustic signal, and a feature amount extracted from the acoustic characteristic; an attachment trouble rule storage means that stores an attachment trouble rule for detecting an attachment trouble with the apparatus; and an attachment trouble detection means that detects a trouble with an attachment state of the apparatus when the first information satisfies the attachment trouble rule.