Abstract
The present disclosure relates to a device having an output transducer and an input transducer, wherein the device is configured to be operated so as to reduce or cancel signal content that is output via the output transducer in the input transducer signal.
Claims
1. A speakerphone device comprising an input transducer system and an output transducer: a speakerphone housing, the input transducer system comprising a first set of microphones and a second set of microphones, the input transducer being arranged in the housing, the output transducer being arranged in the housing, the output transducer configured to provide an acoustic signal received from a far-end source, wherein two of the first set of microphones are arranged along a first microphone axis, wherein two of the second set of microphones are arranged along a second microphone axis, wherein the device further comprises a cancellation controller configured to adaptively control a combination of individual signals from the set of microphones of the first set of microphones so as to adapt a first cancellation pattern, based on a combination of signals from the set of first microphones, in order to obtain a resulting signal having minimized signal content from the output transducer, and wherein the cancellation controller is further configured to adaptively control a combination of individual signals from the set of microphones of the second set of microphones so as to adapt a second cancellation pattern, being located differently from the first cancellation pattern, based on a combination of signals from the set of second microphones, in order to obtain a second resulting signal having minimized signal content from the output transducer.
2. The speakerphone device of claim 1, wherein the cancellation controller is configured to adapt cancellation based on a correlation calculation between one or more microphone signals and a signal provided to the output transducer.
3. The speakerphone device of claim 1, wherein the cancellation controller is configured to reduce an adaptivity rate of adapting the cancellation when speech is detected in one or more microphone signals.
4. The speakerphone device according to claim 1, where the cancellation controller is configured to initiate adaptation when signal from speaker.
5. The speakerphone device according to claim 1, wherein the second microphone axis is orientated non-parallel with the first microphone axis.
6. The speakerphone device according to claim 1, wherein the first and the second set of microphones comprise at least one common microphone or does not comprise any common microphones.
7. The speakerphone device according to claim 1, wherein one of the microphones of the set of microphones is located closer to the output transducer than the at least other microphones and the device further comprises an adaptive filter configured to process the signal from the closer microphone to ensure the amplitude of the microphone signals are equal.
8. The speakerphone device according to claim 1, wherein in the speakerphone housing, the first microphone axis is arranged perpendicular to the second microphone axis.
9. The speakerphone device according to claim 1, the output transducer defines a output transducer center, and, wherein the output transducer is arranged so that a first line drawn through the output transducer center is perpendicular to the first microphone axis and perpendicular to the second microphone axis.
10. The speakerphone device according to claim 1, wherein the device further comprises an optical sensor configured to obtain an image or video signal.
11. A speakerphone device comprising an input transducer system and an output transducer: a speakerphone housing, the input transducer system comprising a first set of microphones and a second set of microphones, the input transducer being arranged in the housing, the output transducer being arranged in the housing, the output transducer configured to provide an acoustic signal received from a far-end source, wherein two of the first set of microphones are arranged along a first microphone axis, wherein two of the second set of microphones are arranged along a second microphone axis, wherein the device further comprises a cancellation controller configured to adaptively control a combination of individual signals from the set of microphones of the first set of microphones so as to adapt a first cancellation pattern, based on a combination of signals from the set of first microphones, in order to obtain a resulting signal having minimized signal content from the output transducer, wherein the cancellation controller is configured to adapt cancellation based on a correlation calculation between one or more microphone signals and a signal provided to the output transducer.
12. The speakerphone device according to claim 11, wherein the cancellation controller is further configured to adaptively control a combination of individual signals from the set of microphones of the second set of microphones so as to adapt a second cancellation pattern, being located differently from the first cancellation pattern, based on a combination of signals from the set of second microphones, in order to obtain a second resulting signal having minimized signal content from the output transducer.
13. A method of operating a device having a housing wherein an input transducer and an output transducer is arranged, the input transducer comprising a multitude of microphones, the device further comprising a cancellation controller operationally connected to one or more of the multitude of microphones, the method comprising: from the multitude of microphones, defining a first set of microphones, from the multitude of microphones, defining a second set of microphones, wherein the first set and the second set of microphones are defined so that wherein two of the first set of microphones are arranged along a first microphone axis and two of the second set of microphones are arranged along a second microphone axis, operating the cancellation processor to provide an output signal based on a combination of individual signals from the first set of microphones, wherein the operation of the cancellation processor comprises minimizing the energy from the output transducer, thereby providing a first cancellation pattern having minimized signal content from the output transducer.
14. The method according to claim 13, wherein the step of operating the cancellation processor is repeated and/or adapted based on an analysis of signals from the input transducer.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0034] The aspects of the disclosure may be best understood from the following detailed description taken in conjunction with the accompanying figures. The figures are schematic and simplified for clarity, and they just show details to improve the understanding of the claims, while other details are left out. Throughout, the same reference numerals are used for identical or corresponding parts. The individual features of each aspect may each be combined with any or all features of the other aspects. These and other aspects, features and/or technical effect will be apparent from and elucidated with reference to the illustrations described hereinafter in which:
[0035] FIG. 1 schematically illustrates a polar plot of a bidirectional microphone,
[0036] FIG. 2 schematically illustrates nulling plane of a bidirectional microphone,
[0037] FIG. 3 schematically illustrates an implementation of a bidirectional input transducer comprising two microphones,
[0038] FIG. 4 schematically illustrates an implementation of an adaptive bidirectional input transducer comprising two microphones,
[0039] FIG. 5 schematically illustrates an implementation of an adaptive difference canceller transducer comprising two microphones,
[0040] FIG. 6 schematically illustrates a device having a single speaker and two pairs of microphones,
[0041] FIG. 7 schematically illustrates a similar device as FIG. 6, where the output transducer is shifted relative to the bidirectional axes of the two microphone pairs,
[0042] FIG. 8 schematically illustrates a device having a single output transducer arranged in an elongated housing with two pairs of microphones around the output transducer,
[0043] FIG. 9 schematically illustrates a device having an output transducer and three microphones arranged in a triangular pattern,
[0044] FIG. 10 schematically illustrates a device having 6 microphones arranged in a pattern around an output transducer,
[0045] FIG. 11 schematically illustrates device having two output transducers and four microphones,
[0046] FIG. 12 schematically illustrates device having two output transducers and four microphones, where one set of microphones are shifted,
[0047] FIG. 13 schematically illustrates a device having an output transducer and an input transducer and an auxiliary device having an auxiliary input transducer,
[0048] FIG. 14 schematically illustrates a device having an output transducer and an input transducer and two auxiliary device each having an auxiliary input transducer,
[0049] FIG. 15 schematically illustrates a device having two output transducers and an input transducer comprising two microphones arranged between the two output transducers,
[0050] FIG. 16 schematically illustrates a device having two output transducers and an input transducer comprising two microphones arranged between the two output transducers where one microphone is arranged at a front of the device,
[0051] FIG. 17 schematically illustrates a number of 3D nulling planes,
[0052] FIG. 18 schematically illustrates a videophone device, and
[0053] FIG. 19 schematically illustrates steps of a method according to the present disclosure.
DETAILED DESCRIPTION
[0054] The detailed description set forth below in connection with the appended drawings is intended as a description of various configurations. The detailed description includes specific details for the purpose of providing a thorough understanding of various concepts. However, it will be apparent to those skilled in the art that these concepts may be practiced without these specific details. Several aspects of the apparatus and methods are described by various blocks, functional units, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as “elements”). Depending upon particular application, design constraints or other reasons, these elements may be implemented using electronic hardware, computer program, or any combination thereof.
[0055] The electronic hardware may include micro-electronic-mechanical systems (MEMS), integrated circuits (e.g. application specific), microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gated logic, discrete hardware circuits, printed circuit boards (PCB) (e.g. flexible PCBs), and other suitable hardware configured to perform the various functionality described throughout this disclosure, e.g. sensors, e.g. for sensing and/or registering physical properties of the environment, the device, the user, etc. Computer program shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.
[0056] In the present description, it is intended that an input transducer is the term used for the concept of converting acoustic signals to an electrical signal, and that the input transducer may be established using signals from one, two or more microphones.
[0057] The input unit may include multiple input microphones, where two or more individual signals may be combined e.g. for providing direction-dependent audio signal processing.
[0058] Such directional microphone system is adapted to (relatively) enhance a target acoustic source among a multitude of acoustic sources in the user’s environment and/or to attenuate other sources (e.g. noise). In one aspect, the directional system is adapted to detect (such as adaptively detect) from which direction a particular part of the microphone signal originates. This may be achieved by using conventionally known methods. The signal processing unit may include an amplifier that is adapted to apply a frequency dependent gain to the input audio signal. The signal processing unit may further be adapted to provide other relevant functionality such as compression, noise reduction, etc. The output unit may include an output transducer such as a loudspeaker/ receiver for providing an air-borne acoustic signal
[0059] Now referring to FIG. 1, which illustrates a polar plot of a bidirectional input transducer. Implementing a bidirectional transducer which has the polar pattern shown in FIG. 1 may establish an input transducer which effectively cancel any source in the “nulling plane”. The Nulling plane is perpendicular to the plane of the drawing of FIG. 2 and constrained by the line from 90° to 270°.
[0060] Placing the output transducer, also referred to as the speaker, in this plane will significantly lower the amount of speaker originated audio picked up by the input transducer. This “nulling plane” will cancel linear and nonlinear components alike. One downside of this is that it will at the same time cancel any source in that nulling plane, including wanted speech or sound. This is illustrated in FIG. 2.
[0061] FIG. 2 schematically illustrates how the nulling plane of a bidirectional microphone, i.e. a bidirectional input transducer work. Further, FIG. 2 illustrates that sound/speech originating from person 10 is received/recorded by the bidirectional input transducer, whereas sound/speech originating from person 20 is in the nulling plane and thus not received/recorded by the bidirectional input transducer.
[0062] FIG. 3 schematically illustrates an implementation of a bidirectional input transducer comprising two microphones, that is, FIG. 3 schematically illustrates one possible configuration of a bidirectional input transducer comprising two microphones, Mic1 and Mic2. The setup further comprises two calibration circuits — to make the microphones similar. This block can be omitted at the cost of performance or simply because of microphones and mechanics could be considered very similar. An addition circuit, that subtracts the two signals from each other. A compensation circuit that corrects any unwanted impact on the signal that the bidirectional input transducer has caused.
[0063] FIG. 4 schematically illustrates an implementation of an adaptive bidirectional input transducer comprising two microphones. FIG. 4 schematically illustrates components of an improved method compared to the method discussed above. In the figure, an adaptive bidirectional input transducer comprising two microphones, such as a set of two microphones, is illustrated. A block has been added, that manipulates the amplitude and phase of one of the microphones before subtraction. This block could take the form of a filter. The filter optimization could be a steepest decent-like algorithm, but the method for optimization is not crucial. The result of the optimization should minimize the energy at the output of the subtraction when the speaker is playing/rendering sound. This will effectively adjust the filter to a solution very similar to the method discussed above, but would be capable of modeling imperfections in microphone calibration and surrounding acoustics.
[0064] There could be other conditions for adaption than the active speaker. Another situation could be during double talk. In a double talk situation, the speaker will be playing, while the person using the device, either being a speakerphone or videophone, is talking as well. The microphones will pick up both signals. The goal of the device is to cancel the speaker signal, i.e. the signal from the output transducer, and convey the user’s speech to the far end recipient, but it is important to realize that the user’s speech in this situation is considered noise to the adaption algorithm. Hence stopping or slowing down adaption during double talk is most likely needed.
[0065] In FIG. 4 the calibration circuit is maintained, compared to FIG. 3, but could be omitted. It might be worth doing an initial calibration at production to ensure not to use the adaptive filters complexity on trivial tasks but to “save” it for more complex tasks as acoustics and ageing.
[0066] To have good performance, meaning in this context a high attenuation of the speaker signal in the output of the microphones, the microphones should be calibrated to have same frequency response. Also, the acoustics surrounding the microphones and the speaker need to be symmetric. Any flaws in the symmetry will result in degraded performance. Not only does it need to be produced with symmetric microphone performance, but it must also remain as such during the lifespan of the product. As we require echo attenuation of 20-40 dB the required symmetry requirements are high, rendering this method suboptimal for practical use.
[0067] FIG. 5 schematically illustrates an implementation of an adaptive difference canceller transducer comprising two microphones.
[0068] In FIG. 5, a method to avoid cancelling an entire plane is illustrated. This involves physically arranging the microphones of the input transducer in a different relation to the speaker compared to e.g. FIG. 4, where in FIG. 5 Mic2 is closer to the output transducer SPK1 than the microphone Mic1. In FIG. 5, the microphones Mic1 and Mic2 are positioned in a line from the speaker SPK1. The microphone Mic2 closest to the speaker SPK1 will receive a significantly higher signal than the second microphone Mic1. This is true because the microphones in this configuration are in the near field of the source (the speaker). This is usually called “The inverse square law”. This states that the sound pressure is reduced with the square of the distance. When being very close to the source the impact of this is significant which is exploited in this method/configuration.
[0069] The users/persons speaking in the room are considered to be “far away” from the microphones (compared to the output transducer) and, due to the inverse square law, the amplitude difference on the microphones will be insignificant compared to the difference experienced from the speaker/talker.
[0070] The circuity illustrated in FIGS. 4 and 5 are the same, while the microphones are rearranged in relations to each other and the speaker. One thing to note is, that when moving the microphone closer to the speaker it could become important to safeguard against saturation of the microphone/input transducer.
[0071] For the adaptation to be efficient in canceling the contribution from the speaker, the adaptive filter should incorporate a significant attenuation (to ensure the amplitude of the speaker signal are equal) before subtraction. As the distances between speaker and microphones are significantly lower than the distances to the wanted speech, it can be shown that this array type implements a canceling “point” instead of a canceling plane as was the case in FIGS. 2 and 3. The arrangement of FIG. 3 has one significant advantage over more standard directional approaches, namely that the far field polar plot arising from the configuration in FIG. 5 approximate an “omni pattern” in contrast to the “FIG. 8” pattern of a Bidirectional setup as illustrated e.g. in FIG. 3.
[0072] FIG. 6 schematically illustrates a device having a single speaker and two pairs of microphones. The outline of the housing for the device of FIG. 6 has the shape of a circle. Other geometries may be envisioned, such as rectangular, square, hexagonal or any other shape. The housing may have sloping sides that has reduced height at the sides relative to a center point. The housing is preferably relatively small and suitable for being moved, e.g. when not used in a meeting room or the like. The housing may have a bottom surface configured to be positioned on a tabletop or the like relatively flat surface. As mentioned, the device according to the present disclosure may be part of a housing configured to be hung from a wall or ceiling.
[0073] In FIG. 6, a way to avoid creating an entire cancelling plane is achieved by the configuration illustrated. In the device 100 of FIG. 6, two, separate, cancelling beamformers are established via two sets of microphones 112, 114, 116, 118, a first set comprising two microphones 112, 114, and a second set comprising two microphones 116, 118. The first set of microphones 112, 114 are arranged so that they establish a first microphone axis 120. The second set of microphones 116, 118, are arranged so that they establish a second microphone axis 122. The first microphone axis 120 is arranged perpendicular, or at least substantially perpendicular, to the second microphone axis 122. Diverging angles may be compensated via an adaptive filter as will be discussed below. This could e.g. be due to manufacturing tolerances, or by deliberate configuring the device differently. The output transducer 110 define a center 128 where the two lines 124 and 126 cross.
[0074] In FIG. 6, the speaker 110 is on-axis with the microphone pairs, and the adaptive part of the method as discussed in relation to FIG. 4 may be implemented to ensure optimal cancellation of the speaker signal in the microphone 1112, 114, 116, 118 signals. The two Bi-DIRs established by the first and second set of microphones will have perpendicular planes of cancellation and may be combined to provide an optimal, or near-optimal, version of the user’s own voice (e.g., by selecting the best of them based on a SNR estimate of the user’s voice in each of the two Bi-DIRs, full-band or different over time and frequency).
[0075] As illustrated in the device 100′ in FIG. 7, it is possible to locate/arrange the speaker 110′ away from the Bi-DIRs “natural” planes of cancellation if the adaptive as discussed in relation to FIG. 4 may be implemented to fine-tune the Bi-DIRs when the speaker is playing. In that case, the planes of cancellation will move, and no longer be perpendicular. If a significant overlap between the main lobes and planes of cancellation between the two Bi-DIRs are maintained, this should not cause a noticeable drop in performance. There is a natural trade-off between performance and freedom of placement. The speaker distortion however will be removed even for steeper angles, whereas the attenuation of the distortion from the microphones will suffer. Any asymmetric placement will also reduce the attenuation of structural born signals.
[0076] In relation to FIG. 7, the output transducer 110′ defines an output transducer center. The output transducer is arranged so that a first line 124′ drawn through the output transducer center 128′ is non-perpendicular to the first microphone axis 120 and also non-perpendicular to the second microphone axis 122.
[0077] The output transducer 110′ may be arranged so that just one of the two lines 124, 126 perpendicular to the microphone axes pass through the center 128 of the output transducer 110.
[0078] Basically, both FIG. 6 and FIG. 7 may be seen as implementing a device comprising an input transducer system and an output transducer. The input transducer is in both cases constituted by two sets of two microphones. The device comprises a housing. The input transducer system has a first set of microphones and a second set of microphones. The input transducer is here arranged in the housing. The output transducer is also arranged in the housing, and the output transducer configured to provide an acoustic signal received from an external source. The external source could be a far-end speaker in a conference call, e.g. obtained via a softphone or the like. In both FIGS. 6 and 7, two of the first set of microphones are arranged along a first microphone axis, and two of the second set of microphones are arranged along a second microphone axis. The device further comprises a cancellation controller, not illustrated directly in the figures, which is configured to adaptively control a combination of individual signals from the set of microphones of the first set of microphones so as to adapt a first cancellation pattern, based on a combination of signals from the set of first microphones, in order to obtain a resulting signal having minimized signal content from the output transducer.
[0079] FIG. 8 schematically illustrates a device 130 having a single output transducer 132 arranged in an elongated housing 134 with five microphones 136, 138, 140, 142, 144 positioned around the output transducer 132. Here the microphones 136 and 138 could be seen as a natural pair of microphones. The microphones 140 and 144 could be seen as another narual pair of microphones, where the microphone 142 could be seen as a further microphone that could form part of either of the set of microphones.
[0080] The device in FIG. 8 has a more oblong outline, which could be a rectangularly shaped housing with rounded corners. In this configuration, another possible variation is illustrated. The configuration show that it is possible to locate the microphones of a given pair/set to each side of the speaker, and still create a Bi-DIR cancellation plane. From the above example, the “natural” pairs of microphones are 136 and 138 is one group of set and 140 and 144 the other set as these each form the “natural” good pairs, however it is possible to use any combination with varying performance. Depending on actual distances new interesting beamformers can be realized, even the beamformer from the method and configuration as discussed in relation to FIGS. 3, 4, and 5 above.
[0081] FIG. 9 schematically illustrates a device having an output transducer and three microphones arranged in a triangular pattern. Here the sets of microphones may share one microphone so that a first set may be defined by the microphones 152 and 153. A second set of microphones may be defined by the microphones 153 and 154. A third set of microphones may be defined by the microphones 154 and 152. The device 150 may be configured so as to operate based on one set of microphones at any one given point in time. The device 150 may be configured so as to operate based on two sets of microphones at any one given point in time. The device 150 may be configured so as to operate based on three sets of microphones at any one given point in time. E.g. in one mode of operation, the number of sets of microphones used at any one point in time may be different from an earlier point in time.
[0082] FIG. 10 schematically illustrates a device having 6 microphones arranged in a pattern around an output transducer. As each of the six microphones may be combined with one or more of the other microphones, a large number of possible sets of microphones may be established. As with the device in FIG. 9, the set of microphones being used at any one point in time may be chosen dynamically, e.g. as a function of current ambient and/or output conditions. In other configurations with similar number of microphones, the angle relative to the center of the output transdcuer/speaker (SPK) may be one value between two microphones and another between two other microphones Here the angle is 60 degrees between neighboring microphones.
[0083] The lines between the six microphones illustrates possible sets of two microphone combinations. As mentioned, more than two microphones may be part of a set of microphones.
[0084] FIG. 11 schematically illustrates device 200 having two output transducers and four microphones. Here the device have multiple speakers and is operated by exploiting symmetry of placement with regards to both speakers and microphones. In FIG. 11, the output transducer comprises a first speaker 210 and a second speaker 220, wherein each of the first 210 and second speakers 220 each define a output transducer center. The first speaker 210 is arranged so that a first line drawn through the first output transducer center is perpendicular to the first microphone axis, similar to the axis described above going through at least two microphones of the first set of microphones, and similar the second speaker is arranged so that a second line drawn through the second output transducer center is perpendicular to a second microphone axis. The two sets of microphones in the device 200 are also placed so that the respective microphone axis is perpendicular to the other microphone axis.
[0085] Under the condition that the two speakers 210 and 220 are playing the same, possibly synchronized, audio signal (i.e., a mono signal source, like is most often the case during conference calls), two Bi-DIRs that cancels both speakers may be formed.
[0086] Using the microphones 222 and 224, methods disclosed above may be used to form a directional canceller with a plane of cancellation in the direction of the two loudspeakers, resulting in echo being attenuated.
[0087] Using the microphones 226 and 228, methods as disclosed above may again be used to form canceller, but this will have a plane of cancellation perpendicular to the canceller of other microphones. Due to the symmetry of the speakers 210, 220 placement in the device 200 and the fact that they are playing the same audio signal, the subtraction between the microphones 226, 228 will also cancel the speaker signal.
[0088] As above, it is now possible to select between these two canceller signals, to provide the far end with the best version of the local user’s voice.
[0089] FIG. 12 schematically illustrates device having two output transducers and four microphones, where one set of microphones are shifted or sided, relative to the configuration of FIG. 11. It is thus possible to slide the microphone set 226′, 228′ along the symmetry axis between the speakers while still preserving the mic-speaker symmetry. This is contemplated to provide further flexibility in deciding of the device design.
[0090] FIG. 13 schematically illustrates a device 250 having an output transducer SPK and an input transducer Mic2 and an auxiliary device having an auxiliary input transducer Mic1. The signals from the two microphones Mic1 and Mic2 may be used to cancel the signal from the speaker SPK, as the microphone in the auxiliary device receives the same signal as the microphone in the main device, but at a much lower amplitude. This enables subtraction of the speaker signal while maintaining an omnidirectional pickup characteristic from Mic1 in the auxiliary device.
[0091] FIG. 14 schematically illustrates a device 250 having an output transducer SPK and an input transducer Mic2 and two auxiliary device 260, 270 each having an auxiliary input transducer Mic1a, Mic1b. Similar, but not completely identical, to FIG. 13, the system of FIG. 14 provides cancelling patterns that cancel the signal from the output transducer in the main device. In FIG. 14, the microphone in the auxiliary device receives the same signal as the microphone in the main device, but at a much lower amplitude. This enables subtraction of the speaker signal while maintaining an omnidirectional pickup characteristic from the either one or both of the two Mic1a andM1b in the auxiliary devices. The device may choose to use either one of the two signals from the auxiliary devices or a combination thereof. This is an expansion of system of FIG. 13, where there are now two auxiliary units without speakers. Besides that, the functionality has not changed as each additional microphone unit comes with an additional echo canceller.
[0092] The systems illustrated in FIGS. 13 and 14 may include wired or wireless connection between the components, i.e. between the device and the one or two auxiliary devices and/or between the two auxiliary devices. The device 250
[0093] FIG. 15 schematically illustrates a device 300 having two output transducers/speakers 310, 320 and an input transducer comprising two microphones Mic1, Mic2 arranged between the two output transducers 310, 320. The device of FIG. 15 could be a soundbar or videophone that has two speakers placed symmetrically on the front, and a housing which may be configured to be hung from a wall or from a display device or be part of a display device or be positioned on a table. The device 300 of FIG. 15 is seen from above. On the top are placed two microphones that, by subtraction according to earlier described methods and configurations, provide a bidirectional, cancelling, input transducer with a slightly skewed pickup pattern. This bidirectional microphone will still have excellent pickup from the front while nulling out the mono-content from the speakers.
[0094] FIG. 16 schematically illustrates a device 350 similar to that of FIG. 15, having two output transducers/speakers 352, 354 and an input transducer comprising two microphones Mic1, Mic2 arranged between the two speakers 352, 354 where one microphone Mic2 is arranged at a front of the device. This is contemplated to provide enhanced sound pickup from the front of the device, e.g. during a video conference.
[0095] In both the devices of FIGS. 15 and 16, it is worth considering that the cancellation patterns are three-dimensional. FIG. 17 schematically illustrates a range of different nulling planes with varying combinations of microphones.
[0096] FIG. 18 schematically illustrates a videophone 400 having an optical sensor 406, two speakers 402, 404 arranged in a housing and an input transducer comprising two microphones 408, 410. The microphones 408 and 410 may be operated as discussed above.
[0097] FIG. 19 schematically illustrates steps of a method 500 of operating a device as described herein, and in particularly a device as disclosed in FIGS. 6 through 16 and 18. The method is preferably performed using a device having a housing wherein an input transducer and an output transducer is arranged. The input transducer preferably comprises a multitude of microphones, and the device further preferably comprises a cancellation controller operationally connected to one or more of the multitude of microphones.
[0098] The method comprises a step 502 of from the multitude of microphones, defining a first set of microphones. This may be performed when designing the device, or, may in the alternative be defined in one of a range of specific operational modes of the device, or may be defined in dependence of a current acoustic environment, such as based on present ambient sound and/or sound being output via the output transducer.
[0099] The method may comprise an additional a step of, from the multitude of microphones, defining a second set of microphones. As with the first step, this may be performed when designing the device, or, may in the alternative be defined in one of a range of specific operational modes of the device, or may be defined in dependence of a current acoustic environment, such as based on present ambient sound and/or sound being output via the output transducer.
[0100] In the method, the first set and the second set of microphones are defined so that wherein two of the first set of microphones are arranged along a first microphone axis and two of the second set of microphones are arranged along a second microphone axis. This is for instance obtainable in the device as illustrated in FIG. 6 e.g. as fixed sets, or more dynamically in a device as the one illustrated in FIG. 10. The step also apply to the other devices illustrated. The method comprises a step 504 of operating the cancellation processor to provide an output signal based on a combination of individual signals from the first set of microphones. The method is advantageous in that the operation of the cancellation processor comprises minimizing the energy from the output transducer, thereby providing a first cancellation pattern having minimized signal content from the output transducer. This is contemplated to reduce or eliminate echo in the sound picked-up by the input transducer. As indicated by the punctured line 508 going back to the previous step 504, the cancellation processor may be adapted during operation of the device. Also as indicated, a further step may be to repeat, or go back to, the definition of the first and/or second and/or additional set of microphones in 502. This need to define which microphones are part of which set may change over time as discussed or in different operational modes.
[0101] The method preferably includes establishing an output signal the is transmitted to an external device or receiver, such as a far end recipient.
[0102] It is intended that the structural features of the devices described above, either in the detailed description and/or in the claims, may be combined with steps of the method, when appropriately substituted by a corresponding process.
[0103] As used, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well (i.e. to have the meaning “at least one”), unless expressly stated otherwise. It will be further understood that the terms “includes,” “comprises,” “including,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will also be understood that when an element is referred to as being “connected” or “coupled” to another element, it can be directly connected or coupled to the other element, but an intervening element may also be present, unless expressly stated otherwise. Furthermore, “connected” or “coupled” as used herein may include wirelessly connected or coupled. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. The steps of any disclosed method are not limited to the exact order stated herein, unless expressly stated otherwise.
[0104] It should be appreciated that reference throughout this specification to “one embodiment” or “an embodiment” or “an aspect” or features included as “may” means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the disclosure. The previous description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects. Reference to an element in the singular is not intended to mean “one and only one” unless specifically so stated, but rather “one or more.” Unless specifically stated otherwise, the term “some” refers to one or more.
[0105] Accordingly, the scope should be judged in terms of the claims that follow.
