Wearable Device and Signal Processing Method
20250358562 ยท 2025-11-20
Assignee
Inventors
Cpc classification
G10K11/17881
PHYSICS
H04R2460/09
ELECTRICITY
G10K11/17885
PHYSICS
G10K2210/1081
PHYSICS
International classification
Abstract
The wearable device includes a sound producing device and a sound sensing device. The sound producing device produces a front radiating wave and a back radiating wave while producing the sound. The sound sensing device is disposed on a nodal position where the front radiating wave and the back radiating wave cancel each other on the nodal position.
Claims
1. A wearable device, comprising: a sound producing device and a sound sensing device; wherein the sound producing device produces a front radiating wave and a back radiating wave while producing a sound; wherein the sound sensing device is disposed on a nodal position where the front radiating wave and the back radiating wave cancel each other on the nodal position.
2. The wearable device of claim 1, comprising: a first port and a second port; wherein the front radiating wave propagates outward via the first port and the back radiating wave propagates outward via the second port.
3. The wearable device of claim 1, wherein a first frequency response corresponding to the front radiating wave received at the sound sensing device and a second frequency response corresponding to the back radiating wave received at the sound sensing device are matched.
4. The wearable device of claim 1, comprising: a first sound sensing device, disposed on a first nodal position; and a second sound sensing device, disposed on a second nodal position; wherein on the first and second nodal positions, the front radiating wave and the back radiating wave cancel each other.
5. The wearable device of claim 4, wherein the first sound sensing device is configured to receive a voice from a user; wherein the second sound sensing device is configured to receive an ambient sound from an ambient.
6. The wearable device of claim 1, wherein the wearable device produces the sound toward an open field when a user wears the wearable device.
7. The wearable device of claim 1, wherein the wearable device is an earbud or a smart glass.
8. The wearable device of claim 1, wherein the sound producing device comprises an air pulse generating device; wherein the sound producing device produces the sound by generating a plurality of air pulses at an ultrasonic pulse rate.
9. A wearable device, comprising: a sound producing device, a sound sensing device and a signal processing circuit; wherein the signal processing circuit receives a sensed signal produced by the sound sensing device; wherein the signal processing circuit performs an operation on the sensed signal and produces a cleaned ambient signal; wherein the operation is configured to mitigate a sound signal component corresponding to a sound produced by the sound producing device.
10. The wearable device of claim 9, wherein the wearable device produces the sound toward an open field when a user wears the wearable device.
11. The wearable device of claim 9, wherein the signal processing circuit removes the sound signal component from the sensed signal and produces the cleaned ambient signal.
12. The wearable device of claim 9, wherein the signal processing circuit comprises a discrepancy estimator; wherein the discrepancy estimator is configured to estimate a discrepancy between a front radiating wave and a back radiating wave produced by the sound producing device and generate a discrepancy estimate.
13. The wearable device of claim 12, wherein the signal processing circuit subtracts the discrepancy estimate from the sensed signal to produce the cleaned ambient signal.
14. The wearable device of claim 12, wherein the discrepancy estimator generates the discrepancy estimate according to a driving signal for the sound producing device.
15. The wearable device of claim 12, wherein the discrepancy estimator corresponds to a transfer function related to a difference between a first transfer function and a second transfer function; wherein the first transfer function corresponds to a front channel from a front side of the sound producing device to the sound sensing device; wherein the second transfer function corresponds to a back channel from a back side of the sound producing device to the sound sensing device.
16. The wearable device of claim 9, wherein the signal processing circuit comprises an anti-ambient block; wherein the anti-ambient block produces an anti-ambient signal according to the cleaned ambient signal; wherein a driving signal for the sound producing device comprises the anti-ambient signal.
17. The wearable device of claim 9, wherein the signal processing circuit comprises a feedback loop with a forward block and a feedback block; wherein the feedback block has a transfer function related to a difference between a first transfer function and a second transfer function; wherein the first transfer function corresponds to a front channel from a front side of the sound producing device to the sound sensing device; wherein the second transfer function corresponds to a back channel from a back side of the sound producing device to the sound sensing device.
18. The wearable device of claim 17, wherein the signal processing circuit comprises a subtractor; wherein the subtractor subtracts an output from the feedback block from a sensed signal from the sound sensing device.
19. The wearable device of claim 9, comprising: a first sound sensing device, producing a first sensed signal; and a second sound sensing device, producing a second sensed signal.
20. The wearable device of claim 19, wherein the signal processing circuit performs an equalizing operation on the first sensed signal and the second sensed signal, to mitigate the sound signal component and to produce the cleaned ambient signal.
21. The wearable device of claim 19, wherein the signal processing circuit performs a subtraction operation on the first and second sensed signals, to capture a voice signal.
22. The wearable device of claim 9, wherein the signal processing circuit obtains a difference transfer function between a first transfer function and a second transfer function; wherein the first transfer function corresponds to a front channel from a front side of the sound producing device to the sound sensing device; wherein the second transfer function corresponds to a back channel from a back side of the sound producing device to the sound sensing device.
23. The wearable device of claim 22, wherein the signal processing circuit is controlled to obtain the difference transfer function.
24. The wearable device of claim 23, comprising: a sensor, configured to detect whether the wearable device is mounted on a user; wherein the signal processing circuit obtains the difference transfer function when the sensor detects the wearable device is mounted.
25. The wearable device of claim 9, wherein the signal processing circuit comprises a digital IIR (Infinite Impulse Response) filter.
26. The wearable device of claim 9, wherein the sound producing device comprises an air pulse generating device; wherein the sound producing device produces the sound by generating a plurality of air pulses at an ultrasonic pulse rate.
27. A signal processing method applied in a signal processing circuit disposed within a wearable device, the signal processing method comprising: receiving a sensed signal from a sound sensing device disposed within the wearable device; and performing an operation on the sensed signal, to mitigate a sound signal component corresponding to a sound produced by a sound producing device disposed within the wearable device, and producing a cleaned ambient signal; wherein the wearable device produces the sound toward an open field when a user wears the wearable device.
28. The signal processing method of claim 27, wherein the step of performing the operation on the sensed signal to mitigate the sound signal component further comprises: obtaining a difference transfer function between a first transfer function and a second transfer function; obtaining a discrepancy estimate according to the difference transfer function and a driving signal for the sound producing device; and removing the discrepancy estimate from the sensed signal to produce the cleaned ambient signal; wherein the first transfer function corresponds to a front channel from a front side of the sound producing device to the sound sensing device; wherein the second transfer function corresponds to a back channel from a back side of the sound producing device to the sound sensing device.
29. The signal processing method of claim 27, wherein the step of performing the operation on the sensed signal to mitigate the sound signal component further comprises: receiving a first sensed signal from a first sound sensing device and a second sensed signal from a second sound sensing device; performing an equalizing operation on the first sensed signal and producing an equalized signal; and mitigating the sound signal component according to the equalized signal.
30. The signal processing method of claim 27, wherein the step of performing the operation on the sensed signal to mitigate the sound signal component further comprises: obtaining a ratio of transfer function of a first transfer function and a second transfer function; receiving a first sensed signal from a first sound sensing device and a second sensed signal from a second sound sensing device; performing an equalizing operation on the first sensed signal according to the ratio of transfer function and producing an equalized signal; and combining the equalized signal and the second sensed signal, to mitigate the sound signal component; wherein the first transfer function corresponds to a first channel from the sound producing device to the first sound sensing device; wherein the second transfer function corresponds to a second channel from the sound producing device to the second sound sensing device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
DETAILED DESCRIPTION
[0033] In order to provide ANC (active noise cancellation) or AC (ambient control), an ASM (ambient sensing microphone) is necessary to obtain an ambient sound. In the present application, AC generally refers to technology which is to control/manage ambient sound to be perceived by listener/user.
[0034] An objective of the present application is to establish an isolation between SPD (sound producing device) and ASM (ambient sensing microphone, which is a kind of sound sensing device), such that an ANC/AC module may obtain a cleaned ambient sound free from sound/signal component corresponding to the sound produced by the SPD, or the sound/signal component corresponding to the sound produced by the SPD within the cleaned ambient sound is mitigated or minimized as much as possible.
[0035] In the present application, the isolation between SPD and ASM can be established via acoustic means and/or electric means. For acoustic means, ASM is suggested to be disposed on a nodal position at which front radiating wave and back radiating wave of the SPD cancel each other.
[0036] For electric means, a signal processing operation is performed on a sensed sound/signal from ASM so that the sound/signal component corresponding to the sound produced by the SPD is mitigated/minimized and the cleaned ambient sound/signal can be obtained. Preferably, both acoustic and electric means can be applied, but not limited thereto.
[0037]
[0038] In the present application, the wearable device producing sound toward open field generally can be interpreted that, on a sound propagation pathway the sound outlet (e.g., the port 103/106 shown in
[0039] To alleviate/bypass the problem of ambient sound captured by ASM being polluted by sound produced by SPD, the SSD 107 (functioning as ASM) may be disposed on a nodal plane or nodal position, where the front radiating wave and the back radiating wave may cancel each other or destructively interfere with.
[0040] Illustratively,
[0041] Darkness/brightness in
[0042] From the illustration above, it can be deducted that, when the nodal plane is formed ideally (which means it does not move with frequency) and ASM/SSD is located precisely on this plane, then sound waves from SPD will produce 0 (none) or near-0 (barely) output on ASM/SSD, i.e. sound from SPD becomes invisible/oblivious to or isolated from ASM/SSD. In other words, an isolation between SPD and ASM will be reestablished in OWS scenario, as the SPD-FFM isolation built by TWS housing.
[0043] Therefore, one aspect of this invention is the design of housing of the wearable device, including front chamber, front port, back chamber, back port, placements of SPD, electronics, battery and wiring within back chamber and, most importantly, the placement of ASM, which is tuned to produce as closely matched front channel and back channel frequency responses, in both amplitude and phase, across as broad a frequency band as possible. Herein, front/back channel refers to acoustic propagation pathway/channel from front/back side of SPD to ASM/SSD.
[0044] In other words, placing ASM (e.g., 107/207) on a nodal plane/position between front-/back-radiations of SPD may reestablish a foundation critical for ANC, ambient passthrough, etc., under the operating condition of OWS.
[0045] In an embodiment, SPD of the present application may be or comprise an air-pulse generating (APG) device disclosed in U.S. application Ser. No. 17/553,813, Ser. No. 18/321,759 or Ser. No. 18/829,245, but not limited thereto. It means, SPD of the present application may produce sound via producing a plurality of air pulses at an ultrasonic pulse rate.
[0046] Wearable devices 10 and 20 belong to 1-mic configuration (herein the term mic represents microphone, a kind of SSD), but not limited thereto. Wearable device having the isolation between SPD and ASM may have 2-mic configuration.
[0047] For example,
[0048] Practically,
[0049] Both microphones 507a and 507v may be placed according to the same principle for ASM 207 of the device 20, i.e., both microphones 507a and 507v may be placed on a nodal plane or on two distinct nodal positions. In addition, the second (voice) mic 507v may be placed closer to and/or pointing towards a mouth of the user; while the first (ambient) mic 507a may be placed farther away from the mouth of the user and/or pointing towards the ambient.
[0050] Given wearable device 50 has two microphones, wearable device 50 may incorporate an acoustic beamforming system to extract an ambient signal or a user voice signal, by properly combining signals captured/sensed by microphones 507a and 507v.
[0051] Referring back to 1-mic configuration, note that, even though ASM is disposed on the nodal position/plane, discrepancy still exists between frequency response or transfer function of the front channel and the back channel (or between front radiating wave and back radiating wave).
[0052] For example,
[0053] To redeem such discrepancy or SPL leakage problem, the wearable device of the present invention may comprise a signal processing circuit to remove such unwanted discrepancy.
[0054]
[0055] The discrepancy estimator H2 is configured to estimate a discrepancy between the front radiating wave and the back radiating wave produced by the SPD 102 and generate a discrepancy estimate 723. The discrepancy estimator H2 may correspond to a difference between a first/front transfer function (e.g., with amplitude response 109F) of the front channel (e.g., channel 109) and a second/back transfer function (e.g., with amplitude response 108F) of the back channel (e.g., channel 108). The discrepancy estimator H2 generates the discrepancy estimate 723 according to the difference between the front and back transfer functions and also according to a driving signal 724 for the SPD 102.
[0056] Note that, the discrepancy estimate 723 may be considered as an SPL leakage from SPD 102 to ASM 107. Hence, the signal processing circuit 720 may subtract/remove the discrepancy estimate 723 from a sensed signal 721 from the ASM/SSD 107 to produce a cleaned ambient signal 722. That is, the signal component corresponding to the sound produced by the SPD 102 (e.g., 723) shall be removed from the sensed signal 721 from the ASM/SSD 107. Therefore, an anti-ambient block H1, similar to ANC operation, may produce an anti-ambient signal 725 according to the cleaned ambient signal 722.
[0057] The driving signal 724 may comprise the anti-ambient signal 725 and the SPD 102 may produce an anti-ambient sound to counter against an ambient sound AS (as much as possible). Hence, the listener may perceive more clear music or voice from an intended sound source/signal SS, without or less being disturbed by ambient.
[0058] To visualize ambient sound (may be known as ambient noise) and a process of generating anti-ambient sound (may be known as anti-noise) propagation,
[0059] In
[0060] As shown, the ambient sound AS may propagate through a (primary) acoustic channel P to a neighborhood of eardrum 810. In another way, the ambient sound AS may be received by microphone, and be processed by amplifier/filter, ADC (analog-to-digital converter), an ambient controller (as a part of signal processing circuit), DAC (digital-to-analog converter), amplifier Amp, SPD driver and SPD, such that an anti-ambient sound or anti-noise is generated. The anti-ambient sound or anti-noise may pass through a (secondary) acoustic channel S to reach the neighborhood of eardrum 810. Ideally, the noise (from ambient) and the anti-noise (from SPD) cancel each other, and the listener may enjoy the music without being interfered by the ambient noise/sound.
[0061]
[0062] Note that, rectangular blocks shown in
[0063] In the present application, functional block and its transfer function sometimes share the same notation, which means, notation of transfer function sometimes (not always) is used to denote the corresponding functional block.
[0064] Note that, acoustic feedback path/channel from SPD to ASM/SSD is omitted in
[0065] Suppose front and back radiating waves (radiated from SPD) have substantially equal amplitude and opposite polarity, system 92 shown in
[0066] Suppose the transfer function of the controller can be found as eq. 2, and system 94 shown in
[0067] Note that, the acoustic means for isolating ASM from SPD (disposing the ASM on the nodal position) is to achieve F.fwdarw.0 (mathematically), and therefore N.sub.O.fwdarw.0 from eq. 4, ideally.
[0068] Practically, F.fwdarw.0 might not be perfectly realizable. When F0, which means significant mismatch/discrepancy between (the transfer functions of) the front and back channels, a feedback path/block may further be included in the ambient controller.
[0069] For example,
[0070] If F.sub..fwdarw.0 is desirable for F0, then F.sub.d may be designed such that F.sub.da.fwdarw.F, where F=F.sub.fF.sub.b. It means the feedback block with transfer function F.sub.d shall be related to the difference between transfer function F.sub.f and transfer function F.sub.b.
[0071] Note that,
[0072] No matter whether the feedback block F.sub.d in
[0073] In a short remark, the signal processing circuit of present invention may obtain difference of transfer functions corresponding to the front and back channels, and mitigate the sound signal component corresponding to the sound produced by the SPD, e.g., by subtracting/removing discrepancy estimate 723 (or analogously/equivalently output of feedback block F.sub.d in the ambient controller A42) from the sensed signal 721.
[0074] In addition, since the front and back channels depend not only on the design of housing but also on hair style, earrings, glasses worn that day and how the earbud was mounted at the moment. Lots of variations may occur, so recalibration may be desirable to maintain optimal ambient control performance.
[0075] One embodiment may involve using a calibration test signal/tone (such as a series of log frequency sweeps, of various durations and amplitudes) to refine the (factory) curve of discrepancy response 631. Such recalibration process may be engaged automatically every time device is detected to be mounted on the ear (such as by a proximity sensor) or engaged manually by user indication (via touch, voice or APP control).
[0076] In other words, for recalibration, the signal processing circuit may be controlled (e.g., by a controller) to obtain the difference transfer function. In addition, the wearable device may optionally comprise a sensor (e.g., a sensor 74 within the wearable device 70), configured to detect whether the wearable device (e.g., 70) is mounted on the user. In an embodiment, the sensor 74 may be a proximity sensor.
[0077] Referring back to 2-mic configuration, instead of removing residual, an equalizing operation may be performed on the sensed signals, to mitigate the sound signal component from the sensed signals and to produce a cleaned ambient signal.
[0078] For example,
[0079] In an embodiment, k.sub.v may be found to be k.sub.v=Vmic/Amic (eq. 5)(herein slash symbol / refers to division), and transfer functions Vmic/Amic may be found by system identification tool via simulation software such as MATLAB (herein slash symbol / means or). In an embodiment, k.sub.v may be optimized over a frequency band of interest, e.g., 20 to 8K Hz, which is not limited thereto.
[0080] Note that, in the embodiment shown in
[0081] In an embodiment, the signal processing circuit B0 may perform a subtraction operation on the sensed signals, e.g., perform VmicAmic, to capture a voice signal. Rationale behind the capturing voice by subtraction could be: 1) ambient sound AS, being generally far field, tend to produce nearly identical output from B07a and B07v, and therefore such signals tend to largely cancelling each other out by the subtraction; 2) the voice VC uttered by user is near field, i.e. the intensity 1/r, suppose B07v is closer to and points towards the mouth of the user while B07a is farther from and points away from the mouth of the user, this SPL 1/r cause B07v to generate higher output in response to VC than B07a, and the subtraction will leave behind a significant portion corresponding to voice VC.
[0082] Referring back to eq. 5 or the block B22 with transfer function k.sub.v, it might be beneficial to obtain the ratio of transfer function between the transfer function Vmic and the transfer function Amic, and the equalizing operation is performed according to the ratio Vmic/Amic.
[0083] In other words, in the 2-mic configuration, the signal processing circuit of present invention may obtain a ratio of transfer function, e.g., Vmic/Amic, perform the equalizing operation (e.g., by block B22 with transfer function k.sub.v) on one sensed signal according to the ratio of transfer function, and combine the equalized signal (e.g., output of the block B22) and the other sensed signal, to mitigate the sound signal component.
[0084] In an embodiment, the block B22, the ambient controller (including the forward block H.sub.C and the feedback block F.sub.d), the discrepancy estimator H2, and the anti-ambient block H1 may be realized by digital IIR (Infinite Impulse Response) filter, but not limited thereto.
[0085] The above discussion will also be applicable to ambient control for smart glasses, where the same SPD-to-mic isolation problem exists. Smart glasses in the present application owns functions additional to plain optical functionalities. For example, smart glasses may have electronic devices embedded therein to perform audio/video related operation(s).
[0086] For example,
[0087] In an embodiment, the microphones C07a, C07v may be disposed on nodal positions.
[0088] In an embodiment, the wearable device CO may comprise the signal processing circuit discussed above to mitigate sound signal component corresponding to the sound produced by the SPD from sensed signal sensed by microphones.
[0089] In short, the present invention is to establish SPD-to-SSD or SPD-to-ASM isolation. Acoustic means disposing mic on nodal position and electric means mitigating sound signal component from sensed signal are provide to produces cleaned ambient signal free from component corresponding to sound produced by SPD.
[0090] Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.