Apparatus and method for recognizing a user input

Abstract

The present disclosure relates to an apparatus and method for recognizing a user input. The apparatus comprises a sensor configured to sense an acoustic wave signal generated by knocking a surface of a medium, an extractor configured to separate an initial pulse signal from the acoustic wave signal and extract signal characteristic of the separated initial pulse signal, and a controller configured to recognize a knocking gesture based on the signal characteristic extracted by the extractor and generate a corresponding control signal.

Claims

1. An apparatus for recognizing a user input, the apparatus comprising: a sensor configured to sense an acoustic wave signal; an extractor configured to: separate an initial pulse signal from the acoustic wave signal; and extract a signal characteristic from the separated initial pulse signal, wherein the initial pulse signal includes a first impulse signal in the acoustic wave signal, and wherein the signal characteristic includes a length of the initial pulse signal and a number of peaks included in the initial pulse signal; and a controller configured to: recognize a knocking gesture based on the signal characteristic extracted by the extractor; and generate a corresponding control signal.

2. The apparatus of claim 1, wherein the medium is a case of a device.

3. The apparatus of claim 1, wherein the knocking gesture originates from a specific part of a finger used to knock a surface of a medium.

4. The apparatus of claim 3, wherein the specific part of the finger is one of a fingertip, a finger knuckle (joint), or a nail.

5. The apparatus of claim 1, wherein the controller identifies the knocking gesture as a knocking gesture using a fingertip when the initial pulse signal includes two peaks.

6. The apparatus of claim 1, wherein the controller identifies the knocking gesture as a knocking gesture using a finger knuckle and nail based on a generating peak time of the initial pulse signal when the initial pulse signal includes one peak.

7. A method for recognizing a user input, the method comprising: sensing an acoustic wave signal; separating an initial pulse signal from the acoustic wave signal; extracting a signal characteristic of the initial pulse signal, wherein the initial pulse signal includes a first impulse signal in the acoustic wave signal, and wherein the signal characteristic includes a length of the initial pulse signal and a number of peaks included in the initial pulse signal; and recognizing a knocking gesture based on the signal characteristic.

8. The method of claim 7, wherein recognizing the knocking gesture comprises: determining whether the peak number is two; and identifying the knocking gesture as a knocking gesture using a fingertip when the peak number is two.

9. The method of claim 8, wherein recognizing the knocking gesture comprises: determining whether the peak number is one, when the peak number is not two; determining whether a peak generating time of the initial pulse signal satisfies a first condition when the peak number is one; and identifying the knocking gesture as a knocking gesture using a finger knuckle, when the peak generating time satisfies the first condition.

10. The method of claim 9, wherein recognizing the knocking gesture further comprises: determining whether the peak generating time satisfies a second condition, when the peak generating time does not satisfies the first condition; and identifying the knocking gesture as a knocking gesture using a nail when the peak generating time satisfies the second condition.

Description

DRAWINGS

(1) In order that the disclosure may be well understood, there will now be described various forms thereof, given by way of example, reference being made to the accompanying drawings, in which:

(2) FIG. 1 is a block configuration diagram showing an apparatus for recognizing a user input.

(3) FIG. 2A to FIG. 2C are graphs showing the signal characteristic depending on parts of a hand when knocking a medium.

(4) FIG. 3 is a flow chart showing a method for recognizing a user input.

(5) FIG. 4 is a flow chart showing a process for determining a knocking gesture shown in FIG. 3.

DETAILED DESCRIPTION

(6) Hereinafter, the present disclosure will be described in detail with reference to the drawings.

(7) FIG. 1 is a block configuration diagram showing an apparatus for recognizing a user input.

(8) As shown in FIG. 1, an apparatus for recognizing a user input includes a medium 110, a sensor 120, a converter 130, an extractor 140 and a controller 150.

(9) The medium 110 means a case (housing) which surrounds a part of a device. The medium 110 is manufactured through injection molding such as plastic and metal, etc.

(10) The medium 110 receives a knocking gesture of a user. Here, the knocking gesture means a motion to knock the surface of the medium 110 by using a specific part of a user's finger. The specific part includes a fingertip, a finger knuckle (joint) and a nail.

(11) The sensor 120 is attached via an adhesive or a special structure, etc. in the medium 110 and senses (measures) the acoustic wave signal generated by knocking the surface of the medium 110. The sensor 120 includes an acceleration sensor, an acoustic wave sensor (for example, a microphone) and the like.

(12) The converter 130 serves to convert the analog signal measured by the sensor 120 into a digital signal. The converter 130 may be implemented by an analog-to-digital converter (AC-DC Converter).

(13) The extractor 140 processes an acoustic wave signal or a vibration signal. The extractor 140 separates an initial pulse signal from the acoustic wave signal. Here, the initial impulse signal means the first impulse signal of the acoustic wave signal sensed through the sensor 120.

(14) The extractor 140 extracts the signal characteristics by analyzing the initial pulse signal. The signal characteristic includes a length (pulse duration time) and peak number of the initial pulse signal.

(15) The controller 150 recognizes the knocking gesture on the basis of the extracted signal characteristics, and generates and outputs a control signal for controlling the operation of the electrical component (not shown) in accordance with the recognition result. The electrical equipment (not shown) operates in response to a control signal output from the controller 150. The electrical equipment (not shown) may be a navigation, audio, radio and the like.

(16) The controller 150 determines (recognizes) as the knocking gesture using a fingertip if the peak number of the initial pulse signal is two.

(17) On the other hand, the controller 150 classifies the knocking gesture according to the time when the peak is generated if the peak number of the initial pulse signal is one. The controller 150 identifies the knocking gesture as a knocking gesture using a finger knuckle if the time when the peak of the initial pulse signal is generated satisfies a first condition. And, the controller 150 identifies the knocking gesture as a knocking gesture using a nail if the time when the peak of the initial pulse signal is generated satisfies a second condition.

(18) FIG. 2A to FIG. 2C are graphs showing the signal characteristic depending on parts of a hand when knocking a medium.

(19) The signal characteristic depending on the part of a hand is generated in the early period of the total signal.

(20) Referring to FIG. 2A, the properties of the flesh and bones of the fingertip are shown in sequence when knocking by a fingertip. Since the flesh of the finger is thicker than other part and the flesh has viscoelastic properties, the length of the first signal is relatively long and the signal peak of the beginning of the initial signal is rounded. Since then, a sharp peak appears due to a finger bone characteristic.

(21) When the finger knuckle knocks the medium, as shown in FIG. 2B, the finger knuckle does not include much flesh than the fingertip, and the characteristic of the bone appears larger than the finger. The viscoelastic property by the flesh appears weak at the beginning, and the acoustic/vibration component becomes a major component and so a sharp peak appears. The length of the first signal is relatively short in comparison with the fingertip.

(22) When knocking the medium by a nail, the nail has no flesh and hard contact is major contact. Thus, as shown in FIG. 2C, the viscoelastic characteristic does not appear, the signal is generally sharp and the length of the first signal is very short.

(23) The present disclosure determines the knocking gesture by using the length of the signal and the peak number of the signal.

(24) FIG. 3 is a flow chart showing a method for recognizing a user input, and FIG. 4 is a flow chart showing a process for determining a knocking gesture shown in FIG. 3.

(25) Referring to FIG. 3, firstly, an apparatus for recognizing a user input receives an acoustic wave signal generated by a knocking gesture on the surface of the medium 110 through the sensor 120 (S110). For example, if a user knocks the surface of the medium 110 using a specific part of a finger, the sensor 120 measures the acoustic wave signal generated by knocking the surface of the medium 110.

(26) The extractor 140 of the apparatus for recognizing a user input separates an initial pulse signal from the input (sensed) acoustic wave signal (S120). The extractor 140 receives the acoustic wave signal measured by the sensor 120, and separates a first pulse signal from the received acoustic wave signal. At this time, the converter 130 converts the acoustic wave signal input from the sensor 120 to a digital signal and outputs it to the extractor 140.

(27) The extractor 140 extracts the signal characteristic from the separated signal (S130). Here, the signal characteristic includes the length (duration time) and the peak number of the initial pulse signal.

(28) The controller 150 of a user input apparatus determines (recognizes) the knocking gesture based on the signal characteristic extracted by the extractor 140 (S140).

(29) Next, knocking gesture determination process will be described in more detail.

(30) The controller 150 determines whether the peak number of the initial pulse signal is two (S141). The controller 150 identifies the knocking gesture as a knocking gesture using a fingertip if the peak number is two (S142).

(31) On the other hand, if the peak number of the initial pulse signal is not two in step S141, the controller 150 determines whether the peak number of the initial pulse signal is one (S143).

(32) The controller 150 classifies the knocking gesture depending on the time which the peak is generated, if the peak number of the initial pulse signal is one. Here, the peak generating time (peak time) is represented by the ratio of the time (the duration time of the initial pulse signal after the peak is generated) from the peak generating time to the ending time of the initial pulse signal compared to the duration time of the initial pulse signal. In this embodiment, the example, which determines the peak generating time by using the ratio of the time from the peak generating time to the ending time of the initial pulse signal compared to the duration time of the initial pulse signal, is described, but it can be also implemented to use the ratio of the time from the starting time of the initial pulse signal to the peak generating time compared to the duration time of the initial pulse signal.

(33) The controller 150 determines whether the peak generating time of the initial pulse signal satisfies a first condition (S144). For example, the controller 150 determines whether the peak generating time is less than 0.6%.

(34) The controller 150 identifies the knocking gesture as a knocking gesture using a finger knuckle if the peak generating time of the initial pulse signal satisfies the first condition (S145).

(35) The controller 150 determines whether the peak generating time of the initial pulse signal satisfies a second condition, if the peak generating time of the initial pulse signal does not satisfies the first condition (S146). For example, the controller 150 determines whether the peak generating time is more than 0.8%.

(36) The controller 150 identifies the knocking gesture as a knocking gesture using a nail if the peak generating time of the initial pulse signal satisfies the second condition (S147).

(37) Then, the controller 150 generates the control signal corresponding to the recognized knocking gesture and transmits it to the corresponding electrical component (not shown).

(38) In the above description, the present invention has been described through the preferred embodiments and the applications, but the present invention is not limited to the embodiments and application, and various modifications can be made by those skilled in the art without departing from the gist of the present invention, and these modifications will be not to be understood individually from the technical spirit or prospect of the present invention.