Method for increasing the awareness of headphone users, using selective audio

Abstract

A method for providing elected sounds to a user—isolated from sounds of the environment—of a mobile device to increase his awareness regarding entities or events in his vicinity. The user wears sound isolating headphones connected to his mobile device. A mobile application is installed on the mobile device, and is automatically activated when the headphones are connected to his mobile device. The application is adapted to automatically activate the device's microphone when the isolating headphones are plugged into the device and periodically compare in real-time, sounds received from the environment, to a predefined collection of reference sounds. Sounds of the environment, which match one or more reference sounds from the collection are selectively filtered out and as long as the sounds received from the environment match the one or more reference sounds from the collection, the filtered sounds are continuously passed to the isolating headphones.

Claims

1. A method for providing elected sounds to a user of a cellular mobile device, who is isolated from sounds of the environment, to increase his awareness regarding entities or events in his vicinity, comprising the steps of: a) remotely storing a predefined collection of reference sounds in a database; b) by said user, wearing sound isolating headphones, which are connected to his mobile device; c) installing a mobile application on said mobile device, said mobile application is configured to: c.1) automatically activate a microphone of said mobile device, when the isolating headphones are plugged into said mobile device; c.2) periodically compare in real-time, sounds received from the environment via said microphone, to said collection of reference sounds; c.3) selectively filter sounds out of the environment, which match one or more reference sounds from said collection; and c.4) as long as the sounds received from the environment match said one or more reference sounds from said collection, continuously pass the filtered sounds to said isolating headphones, wherein the filtered sounds that are passed to said isolating headphones are filtered according to a current context and location associated with surrounding threats to which the user wearing said isolating headphones is exposed when being outdoors and constitute sound alerts, wherein a cellular based sound alert is passed to the user to indicate that a movement path of the user should be changed in order to avoid an encounter with an obstacle.

2. The method according to claim 1, wherein the collection of reference sounds are generated by the user or by an administrator.

3. The method according to claim 1, wherein the surrounding threats are selected from the group of: dynamic moving entities along the user's movement path; static stationary entities along the user's movement path; happening events, which take place in real-time along the user's movement path; and caused events, which take place in real-time along the user's movement path, due to said movement.

4. The method according to claim 1, wherein the mobile application includes predetermined filters that select only sounds that match predefined criteria, such that only sounds that are highly correlated with patterns of the reference sounds will be passed to the user's headphones.

5. The method according to claim 1, wherein the mobile application includes one or more of the following modules: a Context Based Filtering Module; a Location Based Filtering Module; a Friends Notification Module; and a Volume Control Module.

6. The method according to claim 1, wherein the mobile application is also configured to increase or decrease a volume of the sounds that will be selected by a filter, according to a distance of the user from an environmental sound source.

7. The method according to claim 1, wherein the obstacle is a place that has become crowded.

8. The method according to claim 7, wherein the place has become crowded due to an accident, fire, demonstration or criminal event.

9. The method according to claim 1, wherein the obstacle is caused by movement of the user along his path.

10. A system for providing elected sounds to a user of a cellular mobile device, who is isolated from sounds of the environment, to increase his awareness regarding entities or events in his vicinity, comprising: a) a cellular mobile device; b) wearable sound isolating headphones connected to said mobile device; c) a remote database in which a predefined collection of reference sounds is stored; d) a mobile application installed on said mobile device, said mobile application configured to perform the following actions: d.1) automatically activate a microphone of said cellular mobile device, when the isolating headphones are plugged into said cellular mobile device; d.2) periodically compare in real-time, sounds received from the environment via said microphone, to said collection of reference sounds; d.3) selectively filter sounds out of the environment, which match one or more reference sounds from said collection; and d.4) as long as the sounds received from the environment match said one or more reference sounds from said collection, continuously pass the filtered sounds to said isolating headphones, wherein the filtered sounds that are passed to said isolating headphones are filtered according to a current context and location associated with surrounding threats to which the user wearing said isolating headphones is exposed when being outdoors and constitute sound alerts, wherein a cellular based sound alert is passed to the user to indicate that a movement path of the user should be changed in order to avoid an encounter with an obstacle.

11. The system according to claim 10, wherein the mobile application includes predetermined filters that select only sounds that match predefined criteria, such that only sounds that are highly correlated with patterns of the reference sounds will be passed to the user's headphones.

12. The system according to claim 10, wherein the mobile application includes one or more of the following modules: a Context Based Filtering Module; a Location Based Filtering Module; a Friends Notification Module; and a Volume Control Module.

13. The system according to claim 10, wherein the mobile application is configured to increase or decrease, by the Volume Control Module, the volume of the sounds that will be selected by a filter, according to a distance of the user from an environmental sound source.

14. The system according to claim 10, comprising a plurality of the cellular mobile devices, to each of which a corresponding pair of the sound isolating headphones is connected and on each of which the mobile application is installed.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) In the drawings:

(2) FIG. 1 schematically illustrates some examples of surrounding threats, to which a user who wares isolating headphones is exposed when being outdoors;

(3) FIG. 2 schematically illustrates the architecture of an awareness mechanism for providing appropriate alerts, according to an embodiment of the invention;

(4) FIG. 3 is a flowchart illustrating the process of providing elected sounds to a user of a mobile device, who is isolated from sounds of the environment, so as to increase his awareness regarding entities or events in his vicinity;

(5) FIG. 4 illustrates a system for providing elected sounds to a user of a mobile device, who is isolated from sounds of the environment; and

(6) FIG. 5 is a block diagram of the modules of the application installed on each mobile device.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

(7) The system and method of the present invention are capable of providing sound alerts to a user, in order increase his awareness regarding risks or entities of interest in his vicinity, of which he is unaware. The suggested platform filters out the important audio hazards while enabling the user enjoying the audio experience with his headphones. The system uses a filtering mechanism that can be tuned to provide different filtering profiles to different scenarios (e.g., avoiding a dog running after the user while jogging with headphones).

(8) FIG. 1 schematically illustrates some examples of surrounding threats, to which a user who wares isolating headphones is exposed when being outdoors. On his way, the user may encounter dynamic (moving) entities, such as moving objects along his path, people in move or animals that pass nearby the path. Any such moving entity may become a potential obstacle, into which the user may crash or by which he may be hurt, due to isolation from environmental sounds and his unawareness of moving (dynamic) entities.

(9) The user may also encounter passive entities 102 which are not moving, such as static objects, standing people or animals that are located along his path. Any such static entity may also become a potential obstacle, into which the user may crash, due to isolation from environmental sounds and his unawareness.

(10) Another type of potential obstacles is happening events 103, which take place in real-time along the user's movement path. For example, these obstacles may be places, which become crowded due to an accident, fire, demonstration or to criminal events, which happen without any connection to the user. An alert that is passed to the user may cause him to change his path, in order to avoid such encounters.

(11) Another type of potential incidents is caused events 104, which take place in real-time along the user's movement path because of him. Such incidents may be events that are initiated by the movement of the user along his path. For example, a user who is running in a park may avoid an event of being bitten by a running dog, if he gets an alert that may cause him to change his path, in order to not to initiate such event.

(12) FIG. 2 schematically illustrates the architecture of an awareness mechanism for providing appropriate alerts, according to an embodiment of the invention. The proposed awareness mechanism 200 is based on selectively filtering sounds of the environment, which are received in real-time by the microphone of the user's mobile device. The received sounds are compared in real-time to a predefined collection of reference sounds, which may be stored offline locally on in a database. For example, such a collection may be generated by recording a characteristic sound for each potential scenario or threat, such as typical voice patterns or voice signatures of a barking dog, a moving vehicle, a moving train, a horning vehicle, crowd, siren of an ambulance or of other rescue vehicle, etc. This reference collection can be created by the user or by an administrator.

(13) The awareness mechanism 200 may be implemented by an application that will be installed on each mobile device. When activated, the application will automatically turn on the inherent microphone of the user's mobile device, and will start receiving sounds from the environment in real-time. The application will have predetermined filters which will select only sounds that match predefined criteria, such as typical patterns that will be pre-recorded. Only sounds that will be highly correlated with the patterns will be passed to the user's headphones, so the user will be able to hear them. All other sounds will be blocked by the application. The application will be able to identify and classify the received sounds, in order to compare them to the relevant patterns.

(14) The application may include the following modules:

(15) Context Based Filtering Module

(16) The Context Based Filtering Module 201 allows the user to select and hear sounds which are filtered from the sounds of his surrounding environment, according to his current context. Instead of filtering static sounds, the user will be able to filter only sounds that comply with his current context. For example, sounds of a barking dog are relevant for a user that is jogging in a park, but are not relevant to a user who is currently traveling on a bus or on a train.

(17) Location Based Filtering Module

(18) The Location Based Filtering Module 202 allows the user to filter sounds from the environment, only when he enters a specific location or to a predefined set of locations. This can be done with every component described above. For example, if the microphone of the mobile device receives sounds of a barking dog which is inside a yard of a house, the application will block this sound and the user will not hear it, since a dog in a yard is not a potential threat. However, if the microphone of the mobile device receives sounds of a barking dog which is on the street, the application will filter this sound from the environment and the user will hear it, since a free dog is a potential threat.

(19) Friends Notification Module

(20) The Friends Notification Module 203 allows the user to filter from the environment, sounds that are originated from friends of the user. This will allow the user to be aware only of the sounds that might be interesting to him and to ignore other sounds. These sounds can be voices of his friends, their sound signatures or other sounds they produce (e.g., coughing). For example, the user can receive a sound from a common friend regarding another friend that is nearby, which (according to the common friend) may be of interest to him. This is a type of filtering that is based on knowing the preferences of each user, such that filtering is tuned by fiends that have knowledge about the user.

(21) The application 43 will also be adapted to increase or decrease the volume (using a volume control module 53) of the sounds that will be selected by a filter, according to the distance of the user from the sounds source. For example, if the user becomes closer to a barking dog, the sound's magnitude will be increased.

(22) FIG. 3 is a flowchart illustrating the process of providing elected sounds to a user of a mobile device, who is isolated from sounds of the environment, so as to increase his awareness regarding entities or events in his vicinity. At the first step 301, the user wears sound isolating headphones to be connected to mobile device. At the next step 302, upon plugging the isolating headphones into mobile device, the mobile application automatically activates the microphone. At the next step 303, sounds received from the environment, are periodically compared in real-time to a predefined collection of reference sounds, stored offline locally, or in a database. At the next step 304, sounds out of the environment, which match one or more reference sounds from the collection, are selectively filtered. At the next step 305, if sounds received from the environment match reference sounds from said collection, the filtered sounds are continuously passed to the isolating headphones. At the next step 306, the volume of the sounds that will be selected by a filter is increased or decreased, according to the distance of the user from the environmental sounds source. At the next step 307, if sounds received from the environment do not match reference sounds from the collection, the filtered sounds are blocked.

(23) FIG. 4 illustrates a system for providing elected sounds to a user of a mobile device (connected to a cellular network 45), who is isolated from sounds of the environment, to increase his awareness regarding entities or events in his vicinity, according to an embodiment of the invention. The system 40 comprises a plurality of mobile devices of users 41, each mobile device is connected to sound isolating headphones 42 that are adapted to be worn. Each mobile device has an application 43 stored therein that is adapted to automatically activate its microphone 44 when the isolating headphones are plugged into the mobile devices. The application periodically compares in real-time, sounds received from the environment, with a collection of reference sounds that may be stored in a database 46, accessible by cellular network 45 via a server (not shown) and selectively filter sounds out of the environment, which matches reference sounds from this collection. As long as the sounds received from the environment match one (or more) reference sounds from the collection, the application 43 continuously passes the filtered sounds, to the isolating headphones 42.

(24) FIG. 5 is a block diagram of the modules of the application 43. The application 43 comprises a Context Based Filtering Module 201 that allows the user to select and hear sounds which are filtered from the sounds of his surrounding environment, according to his current context; a Location Based Filtering Module 202 that allows the user to filter sounds from the environment, only when he enters a specific location or to a predefined set of locations; a Friends Notification Module 203 that allows the user to filter from the environment, sounds that are originated from friends of the user; a Volume Control Module 53, adapted to increase or decrease the volume of the sounds that will be selected by a filter, according to the distance of the user from the sounds source.

(25) While some embodiments of the invention have been described by way of illustration, it will be apparent that the invention can be carried out with many modifications, variations and adaptations, and with the use of numerous equivalents or alternative solutions that are within the scope of persons skilled in the art, without exceeding the scope of the claims.