Smartphone-, tablet- or laptop-based motion detection system using Doppler Effect and audio processing

Abstract

A system and methods are described that implement a consumer device (smartphone-, tablet- and/or lap top) configured to detection motion via an application program installed on the devices non-transitory medium. The application program contains computer readable instructions instructing the device to perform a number of tasks and configures the device processor to detect motion using Doppler Effect and audio processing. The system uses existing hardware and software in devices (smartphones, tablets or laptops) including the devices non transitory computer readable medium comprising the application program with computer readable instructions, which upon activation, commands the device to transmit ultrasound (18.0-22.0 kHz) and receive the return sound, while the application program configures the device processor to use audio processing to identify shifts in transmitted sound frequency caused by Doppler Effect created by movement of an object or a person. The audio processing effectively turns the device into a short-range motion detector—effective up to 10 meters—detecting movement (not speed or direction) of human sized objects. When Doppler Effect data processing confirms movement, the application program can command the device to initiate a sequence of actions.

Claims

1. A system comprising a consumer device (smartphone, tablet, lap-top) with a non-transitory computer readable storage medium storing computer readable instructions and wherein a processor coupled to the non-transitory medium can be configured by an application program to execute instructions enabling the device to emit a constant sound frequency, receive the return sound frequency, process and analyze the return sound frequency for frequency shifts caused by Doppler Effects by configuring the processor(-s) to perform audio processing and analyses.

2. A method, comprising: downloading, by a consumer device (smartphone, tablet, lap-top), of at least one application program containing computer readable instructions, to the devices non-transitory storage medium, which upon user activation of the application program configures the device to emit a constant sound frequency, receive the return sound frequency, and configures the device processor(-s) to analyze the return sound frequency for frequency shifts caused by Doppler Effects that are created by a person or object moving in the motion detection range of the device.

3. The method of claim 2, wherein the consumer device (smartphone, tablet, lap-top), is connected to an external loudspeaker emitting the constant sound frequency thereby increasing the motion detection range of the device.

Description

BRIEF DESCRIPTION OF DRAWINGS

[0008] FIG. 1. Chart illustrating system components,

[0009] FIG. 2. Example of devices,

[0010] FIG. 3. Example environment with device-based motion detection program active, emitting ultrasound at a frequency between 18-22 kHz

[0011] FIG. 4. Example of environment with devicebased motion detection program active, and frequency changes (Doppler Effect) caused by motion of a non-distributed object (human body) or a distributed object (door or window) in the example environment,

[0012] FIG. 5. Illustration of method used to process audio and define range of interest,

[0013] FIG. 6a. Range of interest without movement, in which case the emitted ultrasound returns as a constant scattered signal

[0014] FIG. 6b. Range of interest with Movement, in which case the signal scattering becomes reduced and/or amplified depending on the speed, direction and distribution of the moving object.

[0015] FIG. 7. Flow chart illustrating processes and triggered actions.

[0016] FIG. 8. Example illustration of system connected to external loudspeaker.

A DETAILED DESCRIPTION OF THE INVENTION

[0017] Integrating a system adding motion detection capabilities to consumer devices 101-1, 101-2, 101-3, FIG. 2 is challenged by the devices limitations such as available power, position of transmitters (loudspeakers) and sensors (microphones and cameras), data processing power, loudspeaker frequency limitations, microphone sampling rates etc. as well as environmental conditions, and the nature and distance of the object being detected.

[0018] This describes a system and methods FIG. 1 comprising a consumer device 101-1 comprising loudspeaker(-s) 401-2, microphone(-s) 401-3, camera(-s) 401-4, a non-transitory storage medium 201, processor(-s) 501, an application program 301 downloaded to the devices non-transitory medium, enabling a device-based motion detection process capable of detecting motion of human size objects including windows and doors within a range of ca. 10m. and a net-work interface 601.

[0019] When a device 101-1 FIG. 2. emits a constant ultrasound FIG. 3, the device microphone 401-3 can receive the identical signal together with all other sound signals present. If an object or person is moving within the range of the device 101-1 FIG. 4, said object or person will cause small but identifiable shifts in the ultrasound frequency (Doppler Effect), and by configuring the device processor 501 to use audio processing FIG. 5 the Doppler Effect can be identified and isolated from other sounds FIG. 6a and FIG. 6b thereby detecting motion. The application program 301 can then command the device to initiate a sequence of actions FIG. 7, similar to the actions of an alarm system. Connecting the device FIG. 2 to an external loudspeaker can increase the motion detection range covered by the device FIG. 8.

[0020] The described system enables the device to detect such motion using the device loudspeaker(s-) 401-2 to emit an ultrasound signal (18.0-22.0 kHz) and the device microphone 401-3 to receive audio (0.02-22.0 kHz) and to configure the device processor 501 to perform audio processing in order to identify and detect shifts in the emitted ultrasound frequency caused by objects moving within the range of the device.

[0021] The shift in emitted ultrasound frequency is caused by movement of objects reflecting the sound (Doppler Effect).

[0022] Doppler Effect can be created by an object moving through sound waves with frequency (f.sub.0), reflecting the sound waves and causing the sound wave frequency to shift to (f), which depending on the distribution, velocity and direction of the moving object is then given by

[00001]$f=\left(\frac{c}{c\pm v_0}\right)f_0,$

[0023] where:

[0024] c=is the constant speed of the sound waves,

[0025] v.sub.0=the variable speed of the moving object

[0026] Knowing f.sub.0 and c, and estimating v.sub.0, the application program configures the processor 501 to isolate the approximate frequencies (±f) and detect/report significant changes in narrow frequency ranges around ±f caused by motion—FIG. 6a and FIG. 6b.

[0027] A moving distributed object (e.g., a human body) creates a more scattered frequency shift than a non-distributed object (e.g., a door or window) and hence, the frequency shift is not to a specific wavelength but to a range of wavelengths near to (±f).

[0028] The audio processing is performed by a program classifying sound in the 20-22,000 Hz range by Hz and volume, hence configuring the audio processing processor to: [0029] ignore sounds below/above certain levels (volume), and [0030] identify sound in ranges specific to the calculated frequency shift above and below the transmitted frequency (18.0-22.0 kHz).

[0031] The audio processing is performed in real time and identification of sound in the ranges specific to the calculated frequency shift will command the application program to configure the device processor 501 to document the cause of the frequency shift using the device camera 401-4 and non-transitory medium 201, and alert one or more connected devices using the devices network interface 601.

[0032] The described system can be used in a variety of devices with different specifications and using different program languages.