IDENTIFYING METHOD OF SOUND WATERMARK AND SOUND WATERMARK IDENTIFYING APPARATUS
20230142323 · 2023-05-11
Assignee
Inventors
- Po-Jen Tu (New Taipei City, TW)
- Jia-Ren CHANG (New Taipei City, TW)
- Kai-Meng Tzeng (New Taipei City, TW)
Cpc classification
G10L19/018
PHYSICS
International classification
Abstract
An identifying method of a sound watermark and a sound watermark identifying apparatus are provided. The method includes the following. A synthesized sound signal is received through a network. Noise interference transferred through the network in the synthesized sound signal is determined according to a reflection-cancelling sound signal. A coding threshold is determined according to the noise interference. A sound watermark signal in the synthesized sound signal is identified according to the coding threshold.
Claims
1. An identifying method of a sound watermark, the identifying method being adapted for a conference terminal, and the identifying method comprising: receiving a synthesized sound signal through a network, wherein the synthesized sound signal comprises a sound watermark signal, the sound watermark signal is generated by shifting a phase of a reflected sound signal according to a watermark identification code, and the reflected sound signal is a sound signal obtained from simulating a sound emitted by a sound source reflected by an external object and recorded by a sound receiver; determining noise interference transferred through the network in the synthesized sound signal according to at least one reflection-cancelling sound signal, wherein the at least one reflection-cancelling sound signal cancels a sound signal of the watermark identification code of the sound watermark signal being at least one code in the synthesized sound signal; determining a coding threshold according to the noise interference, wherein the coding threshold comprises a first threshold and a second threshold, noise interference corresponding to the first threshold is lower than noise interference corresponding to the second threshold, and the first threshold is greater than the second threshold; and identifying the sound watermark signal in the synthesized sound signal according to the coding threshold.
2. The method according to claim 1, wherein determining the noise interference comprises: generating a pre-processed sound signal according to a delay time and the synthesized sound signal, wherein the pre-processed sound signal is obtained from the synthesized sound signal being phase-shifted and delayed by the delay time; respectively generating a first sound signal and a second sound signal according to the synthesized sound signal and the pre-processed sound signal, wherein the at least one code comprises a first code and a second code, the at least one reflection-cancelling sound signal comprises the first sound signal and the second sound signal, the first sound signal cancels the synthesized sound signal in a case where the watermark identification code is the first code, and the second sound signal cancels the synthesized sound signal in a case where the watermark identification code is the second code; generating a third sound signal according to the first sound signal, and generating a fourth sound signal according to the second sound signal, wherein the first sound signal is phase-shifted and delayed by the delay time to generate the third sound signal, and the second sound signal is phase-shifted and delayed by the delay time to generate the fourth sound signal; and respectively determining a first correlation and a second correlation according to the third sound signal and the fourth sound signal, wherein the first correlation is a correlation between the first sound signal and the third sound signal, the second correlation is a correlation between the second sound signal and the fourth sound signal, and a difference between absolute values of the first correlation and the second correlation corresponds to a magnitude of the noise interference.
3. The method according to claim 1, wherein determining the noise interference comprises: generating a pre-processed sound signal according to a delay time and the synthesized sound signal, wherein the pre-processed sound signal is obtained from the synthesized sound signal being phase-shifted and delayed by the delay time; respectively generating a first sound signal and a second sound signal according to the synthesized sound signal and the pre-processed sound signal, wherein the at least one code comprises a first code and a second code, the at least one reflection-cancelling sound signal comprises the first sound signal and the second sound signal, the first sound signal cancels the synthesized sound signal in a case where the watermark identification code is the first code, and the second sound signal cancels the synthesized sound signal in a case where the watermark identification code is the second code; generating a third sound signal according to the first sound signal, and generating a fourth sound signal according to the second sound signal, wherein the first sound signal is delayed by the delay time to generate the third sound signal, and the second sound signal is delayed by the delay time to generate the fourth sound signal; and respectively determining a first correlation and a second correlation according to the third sound signal and the fourth sound signal, wherein the first correlation is a correlation between the first sound signal and the third sound signal, the second correlation is a correlation between the second sound signal and the fourth sound signal, and a difference between absolute values of the first correlation and the second correlation corresponds to a magnitude of the noise interference.
4. The method according to claim 2, wherein the watermark identification code is a binary system, then two values be provided for each bit, the two values, which are different, respectively correspond to two phase shifts.
5. The method according to claim 2, wherein determining the coding threshold according to the noise interference comprises: determining the coding threshold according to a correlation ratio, wherein the correlation ratio is related to an absolute value of a sum of the first correlation and the second correlation, and to a greatest one of the absolute values of the first correlation and the second correlation, and the coding threshold is configured for identifying whether the sound watermark signal in the synthesized sound signal is the at least one code.
6. The method according to claim 2, wherein determining the coding threshold according to the noise interference comprises: determining the coding threshold according to a sum of the first correlation and the second correlation, wherein the coding threshold is configured for identifying whether the at least one code is present in the sound watermark signal in the synthesized sound signal.
7. The method according to claim 2, wherein the coding threshold comprises a first noise threshold and a second noise threshold, and determining the coding threshold according to the noise interference comprises: determining the first noise threshold according to a third correlation, wherein the third correlation is related to a correlation between a fifth sound signal and a sixth sound signal, the at least one reflection-cancelling sound signal comprises the fifth sound signal, the fifth sound signal cancels the synthesized sound signal in a case where the watermark identification code is not the at least one code, the sixth sound signal is a sound signal of the fifth sound signal being delayed by the delay time, and the first noise threshold is configured for identifying whether the at least one code is present in the sound watermark signal in the synthesized sound signal; determining the second noise threshold according to a correlation ratio, wherein the correlation ratio is related to an absolute value of a sum of the first correlation and the second correlation, and to a greatest one of the absolute values of the first correlation and the second correlation, and the second noise threshold is configured for identifying whether the sound watermark signal in the synthesized sound signal is the at least one code; and determining the coding threshold according to the first noise threshold and the second noise threshold, wherein the coding threshold is related to a greatest one of a difference between the first noise threshold and the second noise threshold, and the second noise threshold, and the coding threshold is configured for identifying whether the at least one code is present in the sound watermark signal in the synthesized sound signal and whether the sound watermark signal in the synthesized sound signal is the at least one code.
8. The apparatus according to claim 7, wherein the third correlation is obtained by calculating a cross-correlation between the fifth sound signal and the sixth sound signal, and the third correlation corresponds to the magnitude of the noise interference.
9. The apparatus according to claim 7, wherein the watermark identification code is identified according to a correlation between the synthesized sound signal and the synthesized sound signal that is phase-shifted.
10. The apparatus according to claim 7, wherein when the watermark identification code is the first code or the second code, results of the first correlation and the second correlation are not correlated.
11. An identifying apparatus of a sound watermark, comprising: a memory, configured to store a programming code; and a processor, coupled to the memory, and configured to load and execute the programming code to: receive a synthesized sound signal through a network, wherein the synthesized sound signal comprises a sound watermark signal, the sound watermark signal is generated by shifting a phase of a reflected sound signal according to a watermark identification code, and the reflected sound signal is a sound signal obtained from simulating a sound emitted by a sound source reflected by an external object and recorded by a sound receiver; determine noise interference transferred through the network in the synthesized sound signal according to at least one reflection-cancelling sound signal, wherein the at least one reflection-cancelling sound signal cancels a sound signal of the watermark identification code of the sound watermark signal being at least one code in the synthesized sound signal; determine a coding threshold according to the noise interference, wherein the coding threshold comprises a first threshold and a second threshold, noise interference corresponding to the first threshold is lower than noise interference corresponding to the second threshold, and the first threshold is greater than the second threshold; and identify the sound watermark signal in the synthesized sound signal according to the coding threshold.
12. The apparatus according to claim 11, wherein the processor is further configured to: generate a pre-processed sound signal according to a delay time and the synthesized sound signal, wherein the pre-processed sound signal is obtained from the synthesized sound signal being phase-shifted and delayed by the delay time; respectively generate a first sound signal and a second sound signal according to the synthesized sound signal and the pre-processed sound signal, wherein the at least one code comprises a first code and a second code, the at least one reflection-cancelling sound signal comprises the first sound signal and the second sound signal, the first sound signal cancels the synthesized sound signal in a case where the watermark identification code is the first code, and the second sound signal cancels the synthesized sound signal in a case where the watermark identification code is the second code; generate a third sound signal according to the first sound signal, and generating a fourth sound signal according to the second sound signal, wherein the first sound signal is phase-shifted and delayed by the delay time to generate the third sound signal, and the second sound signal is phase-shifted and delayed by the delay time to generate the fourth sound signal; and respectively determine a first correlation and a second correlation according to the third sound signal and the fourth sound signal, wherein the first correlation is a correlation between the first sound signal and the third sound signal, the second correlation is a correlation between the second sound signal and the fourth sound signal, and a difference between absolute values of the first correlation and the second correlation corresponds to a magnitude of the noise interference.
13. The apparatus according to claim 11, wherein the processor is further configured to: generate a pre-processed sound signal according to a delay time and the synthesized sound signal, wherein the pre-processed sound signal is obtained from the synthesized sound signal being phase-shifted and delayed by the delay time; respectively generate a first sound signal and a second sound signal according to the synthesized sound signal and the pre-processed sound signal, wherein the at least one code comprises a first code and a second code, the at least one reflection-cancelling sound signal comprises the first sound signal and the second sound signal, the first sound signal cancels the synthesized sound signal in a case where the watermark identification code is the first code, and the second sound signal cancels the synthesized sound signal in a case where the watermark identification code is the second code; generate a third sound signal according to the first sound signal, and generating a fourth sound signal according to the second sound signal, wherein the first sound signal is delayed by the delay time to generate the third sound signal, and the second sound signal is delayed by the delay time to generate the fourth sound signal; and respectively determine a first correlation and a second correlation according to the third sound signal and the fourth sound signal, wherein the first correlation is a correlation between the first sound signal and the third sound signal, the second correlation is a correlation between the second sound signal and the fourth sound signal, and a difference between absolute values of the first correlation and the second correlation corresponds to a magnitude of the noise interference.
14. The apparatus according to claim 12, wherein the watermark identification code is a binary system, then two values be provided for each bit, the two values, which are different, respectively correspond to two phase shifts.
15. The apparatus according to claim 12, wherein the processor is further configured to: determine the coding threshold according to a correlation ratio, wherein the correlation ratio is related to an absolute value of a sum of the first correlation and the second correlation, and to a greatest one of the absolute values of the first correlation and the second correlation, and the coding threshold is configured for identifying whether the sound watermark signal in the synthesized sound signal is the at least one code.
16. The apparatus according to claim 12, wherein the processor is further configured to: determine the coding threshold according to a sum of the first correlation and the second correlation, wherein the coding threshold is configured for identifying whether the at least one code is present in the sound watermark signal in the synthesized sound signal.
17. The apparatus according to claim 12, wherein the coding threshold comprises a first noise threshold and a second noise threshold, and the processor is further configured to: determine the first noise threshold according to a third correlation, wherein the third correlation is related to a correlation between a fifth sound signal and a sixth sound signal, the at least one reflection-cancelling sound signal comprises the fifth sound signal, the fifth sound signal cancels the synthesized sound signal in a case where the watermark identification code is not the at least one code, the sixth sound signal is a sound signal of the fifth sound signal being delayed by the delay time, and the first noise threshold is configured for identifying whether the at least one code is present in the sound watermark signal in the synthesized sound signal; determine the second noise threshold according to a correlation ratio, wherein the correlation ratio is related to an absolute value of a sum of the first correlation and the second correlation, and to a greatest one of the absolute values of the first correlation and the second correlation, and the second noise threshold is configured for identifying whether the sound watermark signal in the synthesized sound signal is the at least one code; and determine the coding threshold according to the first noise threshold and the second noise threshold, wherein the coding threshold is related to a greatest one of a difference between the first noise threshold and the second noise threshold, and the second noise threshold, and the coding threshold is configured for identifying whether the at least one code is present in the sound watermark signal in the synthesized sound signal and whether the sound watermark signal in the synthesized sound signal is the at least one code.
18. The apparatus according to claim 17, wherein the third correlation is obtained by calculating a cross-correlation between the fifth sound signal and the sixth sound signal, and the third correlation corresponds to the magnitude of the noise interference.
19. The apparatus according to claim 17, wherein the watermark identification code is identified according to a correlation between the synthesized sound signal and the synthesized sound signal that is phase-shifted.
20. The apparatus according to claim 17, wherein when the watermark identification code is the first code or the second code, results of the first correlation and the second correlation are not correlated.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification. The drawings illustrate exemplary embodiments of the disclosure and, together with the description, serve to explain the principles of the disclosure.
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
DESCRIPTION OF THE EMBODIMENTS
[0019]
[0020] The conference terminals 10, 20 may be a wired phone, a mobile phone, an Internet phone, a tablet computer, a desktop computer, a notebook computer, or a smart speaker.
[0021] The conference terminal 10 includes (but is not limited to) a sound receiver 11, a loudspeaker 13, a communication transceiver 15, a memory 17, and a processor 19.
[0022] The sound receiver 11 may be a microphone in, for example, a dynamic, condenser, or electret condenser form. The sound receiver 11 may also be a combination of other electronic components, analog-to-digital converters, filters, and audio processors that can receive sound waves (e.g., human voice, environmental sound, and machine operation sound) and convert the sound waves into sound signals. In an embodiment, the sound receiver 11 is configured to receive/record sounds of a speaking person to obtain a conversation-received sound signal. In some embodiments, the conversation-received sound signal may include the sound of the speaking person, the sound emitted by the loudspeaker 13, and/or other environmental sounds.
[0023] The loudspeaker 13 may be a horn or a sound amplifier. In an embodiment, the loudspeaker 13 is configured to play sounds.
[0024] The communication transceiver 15 is, for example, a transceiver (which may include, but is not limited to, elements such as a connection interface, a signal converter, and a communication protocol processing chip) that supports wired networks such as Ethernet, optical fiber networks, or cables. The communication transceiver 15 may also be a transceiver (which may include, but is not limited to, elements such as an antenna, a digital-to-analog/analog-to-digital converter, and a communication protocol processing chip) that supports Wi-Fi, fourth-generation (4G), fifth-generation (5G), or later-generation mobile networks. In an embodiment, the communication transceiver 15 is configured to transmit or receive data.
[0025] The memory 17 may be any type of fixed or removable random access memory (RAM), read only memory (ROM), flash memory, a hard disk drive (HDD), a solid-state drive (SSD), or similar elements. In an embodiment, the memory 17 is configured to store programming codes, software modules, configurations, data (e.g., sound signals, watermark identification codes, or sound watermark signals), or files.
[0026] The processor 19 is coupled to the sound receiver 11, the loudspeaker 13, the communication transceiver 15, and the memory 17. The processor 19 may be a central processing unit (CPU), a graphic processing unit (GPU), or any other programmable general-purpose or special-purpose microprocessor, digital signal processor (DSP), programmable controller, field programmable gate array (FPGA), application-specific integrated circuit (ASIC), or other similar elements or a combination of the above elements. In an embodiment, the processor 19 is configured to perform all or part of operations of the conference terminal 10, and may load and execute the software modules, files, and data stored in the memory 17.
[0027] The conference terminal 20 includes (but is not limited to) a sound receiver 21, a loudspeaker 23, a communication transceiver 25, a memory 27, and a processor 29. For the implementation aspects and functions of the sound receiver 21, the loudspeaker 23, the communication transceiver 25, the memory 27, and the processor 29, reference may be made to the above description of the sound receiver 11, the loudspeaker 13, the communication transceiver 15, the memory 17, and the processor 19, which will not be repeated herein. The sound receiver 21 is configured to receive a reflected sound signal and transmit the reflected sound signal to a processor 59 of the cloud server 50 through the communication transceiver 25.
[0028] The cloud server 50 is directly or indirectly connected to the conference terminals 10, 20 through a network. The cloud server 50 may be a computer system, a server, or a signal processing device. In an embodiment, the conference terminals 10, 20 may also serve as the cloud server 50. In another embodiment, the cloud server 50 may serve as an independent cloud server different from the conference terminals 10, 20. In some embodiments, the cloud server 50 includes (but is not limited to) a same or similar communication transceiver 55, memory 57, and processor 59, and the implementation aspects and functions of the elements will not be repeatedly described.
[0029] In an embodiment, the identifying apparatus 70 of the sound watermark may be the conference terminals 10, 20, and/or the cloud server 50. The identifying apparatus 70 of a sound watermark is configured to identify a sound watermark signal and will be described in detail in later embodiments.
[0030] Hereinafter, a method according to an embodiment of the disclosure in combination with the various devices, elements, and modules in the conference communication system 1 will be described. Each process flow of the method may be adjusted according to the implementation, and is not limited thereto.
[0031] It should also be noted that, for ease of description, the same element may perform the same or similar operations, and will not be repeatedly described. For example, the processor 19 of the conference terminal 10, the processor 29 of the conference terminal 20, and/or the processor 59 of the cloud server 50 may each perform a method same as or similar to the method of the embodiment of the disclosure.
[0032]
[0033] Then, the processor 59 of the cloud server 50 receives the conversation-received sound signal S.sub.Rx from the conference terminal 20 through the communication transceiver 55. The processor 59 generates a reflected sound signal S′.sub.Rx according to a virtual reflection condition and the conversation-received sound signal S.sub.Rx. Specifically, general echo cancellation algorithms may adaptively cancel components (e.g., the conversation-received sound signal S.sub.Rx on a conversation-received path) belonging to reference signals in the sound signals received by the sound receivers 11, 21 from the outside. The sounds recorded by the sound receivers 11, 21 include the shortest paths from the loudspeakers 13, 23 to the sound receivers 11, 21 and different reflection paths of the environment (i.e., paths formed when sounds are reflected by external objects). Positions of reflection affect the time delay and the amplitude attenuation of the sound signal. In addition, the reflected sound signal may also come from different directions, resulting in phase shifts.
[0034] In an embodiment, the processor 59 may determine a time delay and an amplitude attenuation of the reflected sound signal S′.sub.RX relative to the conversation-received sound signal S.sub.Rx according to the positional relationship. For example,
s′.sub.Rx (n)=α.sub.1.Math.s.sub.Rx(n-n.sub.w1) (1)
where α.sub.1 is the amplitude attenuation caused by reflection (i.e., reflection of a sound signal blocked by the wall W), n is the sampling point or time, n.sub.w is the time delay caused by the reflection distance (i.e., the distance from the sound source SS through the wall W to the sound receiver 21).
[0035] In an embodiment of the disclosure, the processor 59 shifts a phase of the reflected sound signal according to a watermark identification code, and generates a sound watermark signal S.sub.WM accordingly. Specifically, the processor 59 shifts the phase of the reflected sound signal according to the watermark identification code to generate a sound watermark signal. During operation of a general echo cancellation mechanism, compared to the phase shift of the reflected sound signal, changes in the time delay and the amplitude of the reflected sound signal have a greater influence on errors of the echo cancellation mechanism. With the changes, it is like being in a completely new interfering environment to which the echo cancellation mechanism needs to be re-adapted. Therefore, in the watermark identification code according to the embodiment of the disclosure, sound watermark signals corresponding to different values have only phase differences, but the time delay and the amplitude are the same. In other words, the sound watermark signals include one or more phase-shifted reflected sound signals.
[0036] In an embodiment, the watermark identification code is encoded in a multi-based positional numeral system, and the multi-based positional numeral system provides multiple values at one bit or each of multiple bits of the watermark identification code. Taking a binary system as an example, the value of each bit in the watermark identification code may be “0” or “1”. Taking a hexadecimal system as an example, the value of each bit in the watermark identification code may be “0”, “1”, “2”, . . . , “E”, or “F”. In another embodiment, the watermark identification code is encoded with an alphabet, a character, and/or a symbol. For example, the value of each bit in the watermark identification code may be any one of “A” to “Z” among English alphabets.
[0037] In an embodiment, the different values at the bits in the watermark identification code correspond to different phase shifts. For example, assuming that the watermark identification code W.sub.0 is in a base-N positional numeral system (where N is a positive integer), then an N number of values may be provided for each bit. The N number of different values respectively correspond to different phase shifts φ.sub.1 to φ.sub.N. For another example, assuming that the watermark identification code W.sub.0 is a binary system, then two values (i.e., 1 and 0) may be provided for each bit. The two different values respectively correspond to two phase shifts φ and −φ. For example, the phase shift φ is 90°, and the phase shift −φ is −90° (i.e., −1).
[0038] The processor 59 may shift the phase of the reflected sound signal (with or without a process of high-pass filtering) according to the value of one or more bits in the watermark identification code. Taking a base-N positional numeral system as an example, the processor 59 selects one or more of the phase shifts φ.sub.1 to φ.sub.N according to one or more values in the watermark identification code, and performs phase shift using the selected one of the phase shifts φ.sub.1 to φ.sub.N. For example, if the value of the first bit of the watermark identification code is 1, an output phase-shifted reflected sound signal Sφ.sub.1 is shifted by φ.sub.1 relative to the reflected sound signal, and inference may be made by analogy for other reflected sound signals Sφ.sub.N. The phase shift may be achieved using Hilbert transform or other phase shift algorithms.
[0039] The processor 19 of the conference terminal 10 receives the sound watermark signal S.sub.WM or a watermark-embedded signal S.sub.Rx+S.sub.WM through the communication transceiver 15 via the network to obtain the synthesized sound signal S.sub.A (i.e., the transmitted sound watermark signal S.sub.WM or watermark-embedded signal S.sub.Rx+S.sub.WM).
[0040] With reference to
[0041] During the transmission from the cloud server 50 to the conference terminal 10 through the network, since the output signal (i.e., the transmitted sound watermark signal S.sub.WM or watermark-embedded signal S.sub.Rx+S.sub.WM) becomes an attenuated sound signal S.sub.T through an amplitude attenuation aT and is interfered with by noise N.sub.T. A signal-to-noise ratio (SNR) between the sound signal and the noise N.sub.T is SNR.sub.T=20.1og(S.sub.T/N.sub.T). It is worth noting that if a fixed threshold is adopted in identification of a sound watermark signal, it may not be applicable to different noise environments.
[0042] With reference to
[0043]
s.sub.A.sup.−90°(n)=s.sub.A.sup.90 °(n-n.sub.w) (2)
In other words, the pre-processed sound signal s.sub.A.sup.−90° is the synthesized sound signal S.sub.A being phase-shifted by 90° and time-delayed by n.sub.w.
[0044] The relationship between the synthesized sound signal S.sub.A and the original conversation-received sound signal S.sub.Rx may be expressed as follows:
where the conversation-received sound signal s.sub.Rx is phase-shifted by 90° into s.sub.RX.sup.90 °, N.sub.T is the noise interference, and α.sub.w is the amplitude attenuation. In addition, the conversation-received sound signal s.sub.RX.sup.90°(n) is delayed by the delay time n.sub.w into s.sub.RX.sup.90°(n-n.sub.w). By the relations between the pre-processed sound signal s.sub.A.sup.−90° and the synthesized sound signal S.sub.A, the following can be drawn about the relationship between the pre-processed sound signal s.sub.A.sup.−90° and the conversation-received sound signal S.sub.Rx:
where α.sub.w is the amplitude attenuation, N.sub.T is the noise interference, and the noise interference N.sub.T is phase-shifted by 90° into N.sub.T.sup.90°.
[0045] Then, the processor 19 generates a first sound signal s.sub.B− and a second sound signal s.sub.B+ according to the synthesized sound signal S.sub.A and the pre-processed sound signal s.sub.A.sup.−90° (step S420). In an embodiment, at least one code of the watermark identification code includes a first code and a second code (e.g., W.sub.0=1 and W.sub.0=0), and the reflection-cancelling sound signal includes the first sound signal s.sub.B− and the second sound signal s.sub.B+. The first sound signal s.sub.R− cancels the sound signal of which the watermark identification code is the first code (e.g., W.sub.0=1), and the second sound signal s.sub.B+ cancels the sound signal of which the watermark identification code is the second code (e.g., W.sub.0=0).
[0046] The relationship between the first sound signal S.sub.B− and the synthesized sound signal S.sub.A may be expressed as follows:
s.sub.B−=s.sub.A−α.sub.w.Math.s.sub.A.sup.−90° (5)
The relationship between the first sound signal S.sub.B− and the conversation-received sound signal S.sub.Rx may be expressed as follows:
The relationship between the second sound signal S.sub.B+ and the synthesized sound signal S.sub.A may be expressed as follows:
s.sub.B+=S.sub.A+α.sub.w.Math.s.sub.A (7)
The relationship between the second sound signal S.sub.B+ and the conversation-received sound signal S.sub.Rx may be expressed as follows:
[0047] With reference to
s.sub.B−.sup.−90°(n)=s.sub.B−.sup.−90°(n-n.sub.w) (9)
[0048] In addition, the second sound signal s.sub.B+.sup.−90° is phase-shifted by 90° and delayed by the delay time n.sub.w to obtain the fourth sound signal s.sub.B+.sup.−90°. The relationship between the fourth sound signal s.sub.B+.sup.−90° and the second sound signal s.sub.B+ may be expressed as follows:
s.sub.B+.sup.−90°(n)=(n-n.sub.w) (10)
[0049] With reference to
[0050] It is worth noting that a difference between absolute values of the first correlation R.sub.B−.sup.90 ° and the second correlation R.sub.B+.sup.90° corresponds to the magnitude of the noise interference. For example, the relationship between the first correlation R.sub.B−.sup.90°, the signal-to-noise ratio SNR.sub.T corresponding to the noise interference, and the watermark identification code W.sub.0 may be expressed as follows:
TABLE-US-00001 TABLE 1 R.sub.B−.sup.90° W.sub.0 = 1 W.sub.0 = 0 W.sub.0 = N/A SNR.sub.T = ∞ dB ±0.4 −8.5 −6 SNR.sub.T = −6 dB −4.8 −5.7 −5
[0051] In other words, when the watermark identification code is the first code (e.g., W.sub.0=1), the parts N.sub.T.sup.90° (n-n.sub.w) in the first sound signal s.sub.B− and the third sound signal s.sub.B−.sup.−90° are negatively correlated only in a large noise environment (e.g., the signal-to-noise ratio SNR.sub.T=−6 dB), and are irrelevant (e.g., R.sub.B−.sup.90°=±0.4) under a noise-free environment (SNR.sub.T=∞dB), and the correlation is high and negative (e.g., R.sub.B−=±0.4) in a large noise environment. When the watermark identification code is the second code (e.g., W.sub.0 =0), the parts s.sub.Rx.sup.90°(n-n.sub.w), s.sub.Rxl (n-2.Math.n.sub.w), and N.sub.T.sup.90°(n-n.sub.w) in the first sound signal s.sub.B− and the third sound signal s.sub.B−.sup.−90° are all negatively correlated. The correlation is high and negative (e.g., R.sub.B−.sup.90°=−8.5) under a noise-free environment (SNR.sub.T=∞dB), and the correlation is high and negative (e.g., R.sub.B−.sup.90°=−5.7) in a large noise environment (SNR.sub.T=−6 dB). When the watermark identification code is not present in the synthesized sound signal S.sub.A (e.g., W.sub.0=N/A or is not any code), s.sub.Rx.sup.90°(n-n.sub.w), s.sub.Rx(n-2.Math.n.sub.w), and N.sub.T.sup.90°(n-n.sub.w) in the first sound signal s.sub.B− and the third sound signal s.sub.B−.sup.−90° are all negatively correlated. The correlation is high and negative (e.g., R.sub.B−.sup.90°=−6) when there is no noise, and the correlation is high and negative (e.g., R.sub.B−.sup.90°=−5) in a large noise environment. In other words, when the watermark identification code is the first code (W.sub.0=1), the noise interference (i.e., SNR.sub.T=∞dB or SNR.sub.T=−6 dB) in the network transfer may be determined through the first correlation R.sub.B−.sup.90°.
[0052] Then, the relationship between the second correlation R.sub.B+.sup.90°, the noise interference SNR.sub.T, and the watermark identification code W.sub.0 may be expressed as follows:
TABLE-US-00002 TABLE 2 R.sub.B+.sup.90° W.sub.0 = 1 W.sub.0 = 0 W.sub.0 = N/A SNR.sub.T = ∞ dB 8.5 ±0.4 6 SNR.sub.T = −6 dB 5.7 4.8 5
[0053] As can be seen from Table (2), when the watermark identification code is the first code (e.g., W.sub.0=1), the parts s.sub.Rx.sup.90°(n-n.sub.w), s.sub.Rx(n-2.Math.n.sub.w), and N.sub.T.sup.90°(n-n.sub.w) in the second sound signal S.sub.B+ and the fourth sound signal s.sub.B+.sup.−90° are all positively correlated in a large noise environment (e.g., SNR.sub.T=−6 dB). The second correlation R.sub.b−.sup.90 ° is high and positive (e.g., R.sub.B+.sup.90°=8.5) under a noise-free environment (e.g., SNR.sub.T=∞dB), and the second correlation R.sub.B+.sup.90 ° is high and positive (e.g., R.sub.B+.sup.90°=5.7) in a large noise environment. When the watermark identification code is the second code (e.g., W.sub.0=0), only the parts of the noise N.sub.T.sup.90°(n-n.sub.w) in the second sound signal S.sub.B+ and the fourth sound signal s.sub.B+.sup.−90° is positively correlated. The correlation is low (e.g., R.sub.B+.sup.90°=±0.4) under a noise-free environment (e.g., SNR.sub.T=∞dB), and the correlation is high and positive (e.g., R.sub.B+.sup.90°=4.8) in a large noise environment (e.g., SNR.sub.T=−6 dB). When the watermark identification code is not present in the synthesized sound signal S.sub.A (i.e., W.sub.0=N/A or is not any code), s.sub.Rx.sup.90°(n-n.sub.w), s.sub.Rx(n-2.Math.n.sub.w), and N.sub.T.sup.90°(n-n.sub.w) in the second sound signal S.sub.B+ and the fourth sound signal s.sub.B+.sup.−90° are all positively correlated. The correlation is high and positive (e.g., R.sub.B+.sup.90°=6) when there is no noise, and the correlation is high and positive (e.g., R.sub.B+.sup.90°=5) in a large noise environment. In other words, when the watermark identification code is the second code (e.g., W.sub.0=0), the noise interference (i.e., SNR.sub.T=∞dB or SNR.sub.T=−6 dB) in the network transfer may be determined through the second correlation R.sub.B+.sup.90°.
[0054] With reference to
[0055] In an embodiment, the processor 19 determines the coding threshold Th.sub.W.sup.N according to a correlation ratio. The correlation ratio is related to an absolute value of a sum of the first correlation R.sub.B−.sup.90° and the second correlation R.sub.B+.sup.90°, and a greatest one of the absolute values of the first correlation R.sub.b−.sup.90° and the second correlation R.sub.B+.sup.90°. In addition, the coding threshold Th.sub.W.sup.N in this embodiment is configured for identifying whether the sound watermark signal S.sub.WM in the synthesized sound signal S.sub.A is the at least one code, for example, whether the sound watermark signal S.sub.WM is one of 1 and 0. The relationship between the coding threshold Th.sub.W.sup.N, the first correlation R.sub.B−.sup.90°, and the second correlation R.sub.B+.sup.90° may be expressed as follows:
With the properties of the first correlation R.sub.B−.sup.90° and the second correlation R.sub.B+.sup.90 °, the relationship between the coding threshold Th.sub.W.sup.N, the noise interference SNR.sub.T, and the watermark identification code W.sub.0 can be drawn, which is expressed as follows:
TABLE-US-00003 TABLE 3 Th.sub.W.sup.N W.sub.0 = 1 W.sub.0 = 0 W.sub.0 = N/A SNR.sub.T = ∞ dB 1.9 1.9 0.3 SNR.sub.T = −6 dB 0.3 0.3 0.3
As can be known from Table (1), Table (2), and Table (3), when the watermark identification code is the first code or the second code and no noise interference is present in the network transfer environment (e.g., SNR.sub.T=∞dB), the difference between the absolute values of the first correlation R.sub.B−.sup.90° and the second correlation R.sub.B+.sup.90° is greater, and the first correlation R.sub.B−.sup.90° and the second correlation R.sub.B+.sup.90° are respectively a positive number and a negative number. Therefore, the value of the coding threshold Th.sub.W.sup.N corresponding to the noise interference is 1.9 (i.e., the first threshold). When noise is present in the network transmission environment (e.g., SNR.sub.T=−6 dB), the difference between the absolute values of the first correlation R.sub.B−.sup.90° and the second correlation R.sub.B+.sup.90° is less, and the first correlation R.sub.B−.sup.90° and the second correlation R.sub.B−.sup.90° are respectively a positive number and a negative number. Therefore, the value of the coding threshold Th.sub.W.sup.N corresponding to the noise interference is 0.3 (i.e., the second threshold). When the watermark identification code is not present in the synthesized sound signal S.sub.A (i.e., W.sub.0=N/A), due to the less difference between the absolute values of the first correlation R.sub.B−.sup.90° and the second correlation R.sub.B+.sup.90°, the value of the coding threshold Th.sub.W.sup.N is 0.3 regardless of the magnitude of the noise interference.
[0056] With reference to
s.sub.B−.sup.n.sup.
In addition, the relationship between the fourth sound signal s.sub.B+.sup.n.sup.
s.sub.B+.sup.n.sup.
[0057] With reference to
TABLE-US-00004 TABLE 4 R.sub.B−.sup.n.sup.
In other words, when the watermark identification code is the first code (e.g., W.sub.0=1) or the second code (e.g., W.sub.0=0), the results of the first correlation R.sub.B−.sup.n.sup.
[0058] Therefore, when the watermark identification code is not present in the synthesized sound signal S.sub.A (i.e., W.sub.0=N/A), the correlation is high and positive (R.sub.B−.sup.n.sup.
[0059] With reference to
Th.sub.D=R.sub.B+.sup.n.sup.
Then, according to Table (4) and the properties of the first correlation R.sub.B−.sup.n.sup.
TABLE-US-00005 TABLE 5 Th.sub.D W.sub.0 = 1 W.sub.0 = 0 W.sub.0 = N/A SNR.sub.T = ∞ dB ±0.3 ±0.3 10 SNR.sub.T = −6 dB ±0.3 ±0.3 0.5
[0060] As can be known from Table (5) and the properties of the first correlation R.sub.B−.sup.n.sup.
[0061]
S.sub.A.sup.n.sup.
The relationship between the pre-processed sound signal s.sub.A.sup.n.sup.
[0062] Then, the processor 19 generates a fifth sound signal s.sub.C according to the synthesized sound signal S.sub.A and the pre-processed sound signal s.sub.A.sup.n.sup.
s.sub.C=s.sub.A-α.sub.w.Math.s.sub.A.sup.n.sup.
The relationship between the fifth sound signal s.sub.C and the conversation-received sound signal S.sub.Rx may be expressed as follows:
In this embodiment, the reflection-cancelling sound signal includes the fifth sound signal s.sub.C. The fifth sound signal s.sub.C cancels the synthesized sound signal in a case where the sound watermark signal is not any code (e.g., W.sub.0=N/A).
[0063] With reference to
s.sub.C.sup.n.sup.
[0064] The processor 19 determines a third correlation R.sub.C.sup.n.sup.
TABLE-US-00006 TABLE 6 R.sub.C.sup.n.sup.
[0065] In other words, when the watermark identification code is the first code (i.e., W.sub.0=1), the result of the third correlation R.sub.C.sup.n.sup.
[0066] The processor 19 determines a first noise threshold Th.sub.NA.sup.N according to the third correlation R.sub.C.sup.n.sup.
Then, according to Table (6) and the properties of the third correlation R.sub.C.sup.n.sup.
TABLE-US-00007 TABLE 7 Th.sub.NA.sup.N W.sub.0 = 1 W.sub.0 = 0 W.sub.0 = N/A SNR.sub.T = ∞ dB 0.3 0.3 2.1 SNR.sub.T = −6 dB 0.3 0.3 0.3
[0067] As can be known from Table (7) and the properties of the third correlation R.sub.C.sup.n.sup.
[0068] In addition, the processor 19 determines a second noise threshold Th.sub.W.sup.N according to a correlation ratio (step S650). Reference may be made to
[0069] Then, the processor 19 determines a final coding threshold Th.sub.D.sup.N according to the first noise threshold Th.sub.NA.sup.N and the second noise threshold Th.sub.W.sup.N (step S660). In an embodiment, the coding threshold Th.sub.D.sup.N is related to a greatest one of a difference (Th.sub.NA.sup.N-Th.sub.w.sup.N) between the first noise threshold Th.sub.NA.sup.N and the second noise threshold Th.sub.W.sup.N, and the second noise threshold Th.sub.W.sup.N. The relationship between the coding threshold Th.sub.D.sup.N, the first noise threshold Th.sub.NA.sup.N, and the second noise threshold Th.sub.W.sup.N may be expressed as follows:
Th.sub.D.sup.N=max{Th.sub.NA.sup.N-Th.sub.w.sup.N, Th.sub.w.sup.N} (21)
The coding threshold Th.sub.D.sup.N is configured for identifying whether at least one code is present in the sound watermark signal in the synthesized sound signal S.sub.A and whether the sound watermark signal in the synthesized sound signal S.sub.A is the at least one code (e.g., W.sub.0=N/A, W.sub.0=1, or W.sub.0=0). According to the properties of Table (5) and Table (7), the relationship between the coding threshold Th.sub.D.sup.N, the signal-to-noise ratio SNR.sub.T corresponding to the noise interference, and the watermark identification code W.sub.0 can be drawn, and may be expressed as follows:
TABLE-US-00008 TABLE 8 Th.sub.D.sup.N W.sub.0 = 1 W.sub.0 = 0 W.sub.0 = N/A SNR.sub.T = ∞ dB 1.9 1.9 1.9 SNR.sub.T = −6 dB 0.3 0.3 0.3
[0070] As can be known from Table (8), regardless of the value of the watermark identification code (e.g., W.sub.0=N/A, 0, or 1), the coding threshold Th.sub.D.sup.N is greater (e.g., Th.sub.D.sup.N=1.9) if there is no noise interference (e.g., SNR.sub.T=∞dB), and the coding threshold Th.sub.D.sup.N is less (e.g., Th.sub.D.sup.N=0.3) if the noise interference is large (e.g., SNR.sub.T=−6 dB), accordingly conforming to the properties and the range of noise changes in the environment.
[0071] With reference to
In other words, if the absolute value of the correlation R.sub.A.sup.90° is lower than the coding thresholds Th.sub.D.sup.N and Th.sub.D, the processor 19 determines that the value of this bit is not any code (e.g., N/A); if the correlation R.sub.A.sup.90° is higher than the coding threshold Th.sub.D.sup.N or Th.sub.D, the processor 19 further determines the correlation R.sub.A.sup.90°, and accordingly determines whether the value of this bit corresponds to the value of a phase shift of −90° (e.g., 0) or the value of a phase shift of 90° (e.g., 1). In other words, the coding threshold Th.sub.D may be configured to assist in checking whether the sound signal is any code in the watermark identification code. In addition, to prevent influences by noise, the other part of the identification is to determine the coding threshold Th.sub.D.sup.N according to the properties of noise interference changes. Finally, the processor 19 may compare the coding threshold Th.sub.D.sup.N or Th.sub.D with the correlation R.sub.A.sup.90° to thus determine the watermark identification code more accurately.
[0072] In another embodiment, the processor 19 may identify the corresponding values of the synthesized sound signal S.sub.A in different time units through a classifier based on deep learning.
[0073] Regarding changing noise interference, for example, according to experimental experiences, in a case where the transmission process of the synthesized sound signal S.sub.A belongs to a large noise interference environment (e.g., SNR.sub.T=−6 dB), the identification accuracy can be improved using a coding threshold of 1.9 to identify the watermark identification code of the sound watermark signal S.sub.WM. In addition, in a case where the transmission process of the synthesized sound signal S.sub.A belongs to a noise-free environment (e.g., SNR.sub.T=∞dB), the watermark identification code in the sound watermark signal S.sub.WM can be correctly identified using a coding threshold of 0.3.
[0074] In summary of the foregoing, in the identifying method of a sound watermark and the sound watermark identifying apparatus of the embodiments of the disclosure, through the properties of the virtual reflected sound signal and the reflection-cancelling sound signal in the synthesized sound signal, the noise interference in the transfer environment is determined accordingly. In addition, the coding threshold of the watermark identification code to be determined is determined through the noise interference. Accordingly, the correct rate of identifying the watermark identification code can be increased using coding thresholds corresponding to different transmission environments.
[0075] It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed embodiments without departing from the scope or spirit of the disclosure. In view of the foregoing, it is intended that the disclosure covers modifications and variations provided that they fall within the scope of the following claims and their equivalents.