ARRANGEMENT AND METHOD FOR THE CONVERSION OF AT LEAST ONE DETECTED FORCE FROM THE MOVEMENT OF A SENSING UNIT INTO AN AUDITORY SIGNAL

Abstract

An arrangement for the conversion of at least one detected force from the movement of a sensing unit into an auditory signal. The arrangement includes at least one sensor for generating a force signal from the at least one detected force. A processing unit is configured for converting the force signal into a digital auditory signal. An output unit for converting the digital auditory signal into an auditory signal is further included wherein the digital auditory signal includes in formation of acceleration, strength and duration of a single detected force. The present method is used for converting at least one detected force affecting an object into auditory signal, as well as the use of an arrangement according to the present invention for various entertainment and/or therapeutic purposes.

Claims

1. An arrangement for the conversion of at least one detected force from the movement of a sensing unit into an auditory signal, comprising: a) at least one sensor, for generating a force signal from the at least one detected force; b) a processing unit, configured for converting the force signal into a digital auditory signal; c) an output unit, for converting the digital auditory signal into an auditory signal, and wherein the digital auditory signal comprises information on acceleration, strength and duration of a single detected force.

2. The arrangement according to claim 1, wherein the processing unit is adapted to recognize a pre-learned movement sequence out of the force signal(s), by applying a machine learning algorithm, and converting the movement sequence into a digital auditory signal, a MIDI-signal.

3. The arrangement according to claim 1, comprising: a first casing, wherein the at least one sensor and the processing unit is housed; a second casing, wherein the output unit is housed; and a data exchange unit for wirelessly transferring the digital auditory signal between processing unit and output unit.

4. The arrangement according to claim 1, wherein the first casing and the second casing are arranged to be detachably combinable with each other, in a form fit.

5. The arrangement according to claim 2, wherein the first casing and/or the second casing have one or more fixing device for attaching the respective casing to one or more third device.

6. The arrangement according to claim 1, wherein the arrangement further comprises one or more rechargeable energy sources.

7. The arrangement according to claim 1, wherein the arrangement further comprises at least one communication system having a bus system and respective connections.

8. The arrangement according to claim 1, wherein the processing unit is arranged to convert the force signal into a digital auditory signal by attributing a first digital information to a first force signal dimension, a second digital information to a second force signal dimension, a third digital information to a third force signal dimension, and by attributing a first digital information to an acceleration, a second digital information to an intensity and a third digital information to a duration of a single detected force.

9. The arrangement according to claim 1, wherein the output unit further comprises an audio output and/or an audio output connector.

10. The arrangement according to claim 1, wherein the arrangement comprises a storage medium for storing digital auditory signals.

11. The arrangement according to claim 1, wherein the processing unit is configured for converting a sequence of consecutively sensed force signals into a sequence of digital auditory signals according to a defined algorithm.

12. The arrangement according to claim 1, wherein the force sensor is adapted to sense acceleration in at least three axes.

13. The arrangement according to claim 1, comprising a plurality of sensors, for generating a force signal from a plurality of detected forces, each, and wherein the processor is configured to fuse the plurality of force signals into one digital auditory signal.

14. The arrangement according to claim 13, wherein the processor generates a string of digital auditory signals out of the force signals processed per time interval.

15. The arrangement according to claim 1, wherein the at least one sensor is a sensor adapted at detecting a force affecting the arrangement, wherein the force is a movement and/or an impact affecting the arrangement, wherein the at least one sensor is a sensor selected from the group consisting of: gyroscope, accelerometer and magnetometer.

16. The arrangement according to claim 1, wherein the processing unit is configured for converting the force signal into a digital auditory signal on the basis of a preselected determined conversion protocol.

17. The arrangement according to claim 1, wherein the processor is adapted to categorize the force signal and convert said force signal into a digital auditory signal based on a determined conversion protocol based on categorization.

18. The arrangement according to claim 1, wherein the processor is adapted to converting the force signal into a digital auditory signal with a latency between 5 and 35 ms, between 10 and 20 ms and even more particularly lower than 20 ms.

19. A method of using a motion sensor adapted at generating a force signal from at least one detected force, a sensor comprising one or more force detection sensors selected from the group consisting of: gyroscopes, accelerometers, magnetometer, compasses, inertia sensors, absolute orientation sensors and/or electromagnetic sensors, for generating a force signal in an arrangement adapted at converting said force signal into a digital auditory signal that can be converted into an auditory signal by an output device.

20. A method of converting at least one detected force affecting an object into an auditory signal, comprising the steps of: a) providing an arrangement for the conversion of at least one detected force into an auditory signal according to claim 1; b) affixing at least one sensor, for generating a force signal from the at least one detected force and a processing unit, configured for converting the force signal into a digital auditory signal, both being integral parts of that arrangement, onto said object; c) sensing a force affecting the object with the sensor and converting the force signal into a digital auditory signal, with a latency below 20 ms; d) converting the digital auditory signal into an auditory signal by means of an output unit.

21. The method according to claim 20, whereby an algorithm is provided that attributes each force signal to a digital auditory signal.

Description

BRIEF DESCRIPTION OF SEVERAL VIEWS OF THE DRAWINGS

[0083] In the following, the present invention is further illustrated by means of a schematic drawing and specific examples, without being limited there to though.

[0084] The examples and drawing provide the skilled artisan with further advantages embodiments of the present invention.

[0085] The FIGURE is a schematic block diagram showing the functioning of an arrangement according to the present invention.

DETAILED DESCRIPTION OF THE INVENTION

[0086] The FIGURE shows schematically a block diagram representing two modes of function of an arrangement 10 according to the present invention. The arrangement 10 as shown in the FIGURE can be separated into a sensing unit 11 and in this case a plurality of output units 3. The sensing unit 11 comprises a sensor 1 or in the case of this specific example a sensor array 1 comprising a nine axes sensor each with three axis x, y, z for acceleration, rotation and magnetic field. Suitable sensors are available in the art, such as the BNO 055 from Bosch providing an absolute orientation sensor with integrated accelerometer, gyroscope and magneto meter for measuring linear motion and gravitational forces, the rate of rotation in space (roll, pitch, yaw) the terrestrial earth magnetic fields and coming equipped with all the required sensors for providing said information and processing it into digital readable force signal that can then be processed by the processing unit 2, which in this embodiment forms an integral part of the sensing unit 11. The processing unit then converts the force signal measured by the sensor 1 into a digital auditory signal, which is then transmitted by the Bluetooth module 15. In this particular example the Bluetooth model comes equipped with the required microprocessor for processing the force signal and thus the processing unit 2 and the Bluetooth module 15 can be both part of the same integrated module.

[0087] In the present example the transmission from the Bluetooth module 15 happens in the form of digital auditory signals in the MIDI format.

[0088] In a first mode of operation the output unit can be combined with this sensing unit such that the whole arrangement is made one piece. In the present example the output unit 3 can either be integrally formed with the sensing unit 11 or it can be a separate piece of equipment. In the second case, the output unit 3 would require a further Bluetooth module for receiving the digital auditory signal from the Bluetooth module 15 of the sensing unit 11. The output unit 3 comprises a sound creation module 16 and loud speaker 17.

[0089] Alternatively, or additionally the function of the output unit 3′ can be performed by a smartphone. In this present example, the smartphone takes the form of the output unit 3′. Smartphones come equipped with a Bluetooth module 15′ which is capable of receiving the digital auditory signal in a form of a MIDI signal from the Bluetooth module 15 of the sensing unit 11. Analogous to the functioning of the separate or integral output unit 3, the smartphone output unit 3′ then processes the MIDI file with a sound creation module 16′ which results in a sound output by means of loud speakers 17′. In addition to the functionality provides by the simplest embodiment of integrated or separate output unit 3, the smartphone output unit 3′ can come equipped with configuration means 18 which provide means of choosing from a preselected range of sound types a particular modulation that can then be performed on the MIDI files by means of the sound creation module 16′ which results in a different type of sound output by the loud speakers 17′.

[0090] This configuration module 18 can be controlled by means of a smartphone app, which provides the user with the increased functionality. By using the further smartphone resources, it becomes possible to provide different scopes of configuration for adapting the sound files. This can come in the form of digital downloads and/or preset and preconfigured sound patterns. Of course, the smartphone provides further functionalities, which are not shown in the block diagram but are integral in all modern smartphones, such as a visual representation by a screen, a memory storage and wireless or USB connectivity with the internet.

[0091] The app can further provide means of manipulating and modulating the sounds directly, while they are being generated such as to enable a further interactivity with a movement being processed by the arrangement 10 according to the present invention.

[0092] In a particular example, the loud speaker 17, 17′ is further complemented by an audio jack which can be connected with adjacent loud speaker or further loud speakers.

[0093] In a particular example, where the arrangement is used in connection with an action camera, the audio outjack can be used to connect the arrangement 10 with an audio injack of the action camera, such as to provide the sound process by the arrangement 10 of the present invention directly onto the film file generated by the action camera.

[0094] In this specific example, the latency between actual movement that is registered as a force from the movement sensing unit up to the creation of the auditory signal at the loud speaker 17 is lower than 30 milliseconds. This enables a deep emersion into sound companioned movement. The Bluetooth transmission of the digital auditory signal has a maximal latency of 15 milliseconds, whereas the detection and processing of the force has a maximal latency of 15 milliseconds.

[0095] In a particular example, the algorithm running on the processor for converting the force signal into a digital auditory signal is capable of distinguishing between a sudden, abrupt movement and a continuous movement. In the case of a sudden, abrupt movement the latency is to be kept as low as possible, such as to convey the abruptness of the movement by means of the sound. It has surprisingly found though, that the latency is much less relevant in the conversion of continuous movement. A processor thus equipped to distinguish between sudden, abrupt movements can said respective priorities in the conversion of detected force signals into digital auditory signals that the sudden, abrupt movements are prioritized thereby not jeopardizing the emersion.

[0096] In the following, specific examples are presented for use and implementation of an arrangement according to the present invention.

Example 1: Laser Sword

[0097] In this specific example, an arrangement according to the present invention is used for simulating a laser sword. A laser sword is a fictional and well-known popular media item that provides distinctive “swooshing” sound when handled. In this example an arrangement according to the present invention is used to simulate this sound with any item onto which the arrangement of the present invention can be detachably attached. The processor is adapted to in particular to detect movement of the fictions hilt of the sword, its position, swinging the sword, turning the fictions hilt and the impacting of two swords in its most basic application to broom sticks can be used by attaching to each a sensing element 10 according to the previously discussed setup. One or more output units 3, 3′ can then be adapted to create the respective laser sword sound. In particular concerning swords, the sound can be subdivided into continuous fluid movements that comprise the swinging and turning of the hilt of the sword in contrast to impacting when two light sabers clash during a combat. The processor in this application is adapted to distinguish between the two types of movements and provide a particular priority to the once that require immediate sound effect such as the impact of the sword on an item. Commonly available sensors such as the sensor cited above are capable of distinguishing such movement and provide the required information for the processor to perform its prioritization.

[0098] It is a particular advantage of the arrangement according to the present invention, that two light sabers sound or even more can be processed simultaneously, such as to enhance the user experience and provide an emersion into a laser sword duo by measuring the movement of a plurality of sensors and providing a respective sound feedback.

[0099] This arrangement can come equipped with a specific software product and specific sound files adapted at providing the Doppler effect sounds that light sabers and laser swords are so well-known for.

Example 2: Table Tennis Rackets

[0100] In this particular example, which is quite similar to the one with the laser swords above two sensing units are each attached or integrally formed with table tennis rackets. Alternatively, a Ping-Pong ball can be also equipped with a sensing unit, but considering that light weight is a specific requirement of Ping-Pong balls it might be more advisable to equip the rackets.

[0101] The processing unit is particularly adapted at sensing impact, impact strength, swing speed and direction and for/backhand hitting of the Ping-Pong ball. In a particular example, this sounds can take the form of an arcade like computer game. This makes Ping-Pong much more fun to watch and play.

[0102] A particular use of the arrangement of the present invention could be training purposes. A perfection of a particular hitting movement or a very sensitive detection of a movement within a certain boundary can be monitored by means of the motion detection and sensing of the arrangement according to the present invention. In this example, for instance a trespassing of a certain line with the table tennis racket can lead to a tilt sound with notifies the user or a coach of the event which enables accurate review of a movement.

Example 3: Sound Painting

[0103] In this example one or more sensing units are used to detect a position relative to starting position, a speed of a movement and a turning of the sensing unit as well as a beating of the sensing unit to create a live sound corresponding to a particular movement pattern. A dancing and/or artistic movement can then directly be converted into a corresponding sound effect.

[0104] For sound painting in particular, machine learning can be applied to match a force signal or series of force signals to a pre-learned movement sequence and generate a specific digital auditory signal reflective of said movement sequence. The arrangement can come equipped with a multitude of pre-learned movement sequences, each representing a dancing move and each resulting in a specific auditory signal.

[0105] For this end, parameters can be generated by analyzing dance moves with an arrangement as described above. These parameters can result from indexing force signals from the various sensor means, such as, for instance, accelerometer, magnetometer, of such an arrangement, while a dancing move is performed repeatedly. These parameters, after being embedded in the arrangements' firmware can be matched with force signals resulting from dance moves and can result in a very low latency generation of sound effects upon detection and matching of that sound moves with a pre-learned movement sequence. For this end, machine learning algorithms can be used.

[0106] Further advantages implementation of an arrangement according to the present invention can easily derived by the skilled artisan from the dependent claims and the details description of this invention.