The present technology relates to a signal processing device, a signal processing method, and a program that enable intuitive operation of sound.

The signal processing device includes an acquisition unit that acquires a sensing value indicating a motion of a predetermined portion of a body of a user or motion of an instrument, and a control unit that performs non-linear acoustic processing on an acoustic signal according to the sensing value. The present technology can be applied to an acoustic reproduction system.

Included are: an acquisition unit (13b) configured to acquire identification information and a time-series feature regarding a signal indicating a tactile sensation, the identification information and the time-series feature being visually expressed; and a generation unit (13c) configured to generate a control signal for a tactile-sense presentation device (100) on the basis of the above identification information and the above time-series feature acquired by the acquisition unit (13b).

An arrangement for the conversion of at least one detected force from the movement of a sensing unit into an auditory signal. The arrangement includes at least one sensor for generating a force signal from the at least one detected force. A processing unit is configured for converting the force signal into a digital auditory signal. An output unit for converting the digital auditory signal into an auditory signal is further included wherein the digital auditory signal includes in formation of acceleration, strength and duration of a single detected force. The present method is used for converting at least one detected force affecting an object into auditory signal, as well as the use of an arrangement according to the present invention for various entertainment and/or therapeutic purposes.

A method for adapting auditory biofeedback cues to adjust a user's gait includes receiving a series of respective first signals from each sensor of an integrated sensor system and converting the series of respective first signals into a series of respective second signals. Each respective second signal within the series of respective second signals can be quantized as an audio biofeedback cue and modified so the timing of each respective second signal is aligned to a pre-selected temporal or musical grid. The user's gait is then analyzed as a function of the audio biofeedback cues and the pre-selected temporal or musical grid can be adapted to adjust entrainment of the user's gait.

Systems, devices, media, and methods are presented for playing audio sounds, such as music, on a portable electronic device using a digital color image of a note matrix on a map. A computer vision engine, in an example implementation, includes a mapping module, a color detection module, and a music playback module. The camera captures a color image of the map, including a marker and a note matrix. Based on the color image, the computer vision engine detects a token color value associated with each field. Each token color value is associated with a sound sample from a specific musical instrument. A global state map is stored in memory, including the token color value and location of each field in the note matrix. The music playback module, for each column, in order, plays the notes associated with one or more the rows, using the corresponding sound sample, according to the global state map.

There is provided a signal processing apparatus that includes a control unit that executes, on a basis of a waveform signal generated in accordance with a motion of an attachment portion of a sensor attached to a tool or a body, effect processing for the waveform signal or another waveform signal, the waveform signal being output from the sensor.

A method for adapting auditory biofeedback cues to adjust a user's gait includes receiving a series of respective first signals from each sensor of an integrated sensor system and converting the series of respective first signals into a series of respective second signals. Each respective second signal within the series of respective second signals can be quantized as an audio biofeedback cue and modified so the timing of each respective second signal is aligned to a pre-selected temporal or musical grid. The user's gait is then analyzed as a function of the audio biofeedback cues and the pre-selected temporal or musical grid can be adapted to adjust entrainment of the user's gait.

A 128-note MIDI-range monophonic musical keyboard instrument (100) includes an octave keypad (106) with eleven keys arranged in an analog clock face format for octave selection with the thumb of one hand, a pitch keypad (108) with twelve pitch keys similarly disposed in a clockface arrangement around a central omnivalent thirteenth key (128), enabling the nondisjointed sounding of nonadjacent notes with the thumb of the other hand. Spatial manipulation of the device, such as tilting and jabbing, can switch octaves and activate other functions, enabling one-handed operation and overcoming small-screen space limitation. Aside from producing typical electronic piano or synthesizer sounds, the device can sing in human voice an extended monosyllabic solfege covering all twelve pitch families of the common chromatic 12-tone even-tempered scale. A pictograph-based music notation (156) mirrors the circular geometry of the pitch and octave keyboards and facilitates the intuitive reading and playing of a melody.

Methods and systems are disclosed to facilitate creating the sensation of vibrotactile movement on the body of a user. Vibratory motors are used to generate a haptic language for music or other stimuli that is integrated into wearable technology. The disclosed system in certain embodiments enables the creation of a family of devices that allow people such as those with hearing impairments to experience sounds such as music or other input to the system. For example, a sound vest or other wearable array transforms musical input to haptic signals so that users can experience their favorite music in a unique way, and can also recognize auditory or other cues in the user's real or virtual reality environment and convey this information to the user using haptic signals.

The invention relates to a system for automatically creating a soundtrack, comprising a camera device (1, 1) for recording a user-generated video, at least one wearable sensor (3, 3), and a control unit (2, 2) in communication with the camera device (1, 1) and the at least one wearable sensor (3, 3). The control unit (2, 2) is adapted to generate the soundtrack based on data gathered from the at least one wearable sensor (3, 3) during the recording of the user-generated video. The invention further relates to a method for automatically creating a soundtrack, computer program product, a computer readable memory storage unit computing arrangement or mobile device (1, 11) for executing the method.