The subject matter discloses a system implemented on in a mobile electronic device, the system comprising a processing system of the device; and a memory that contains instructions comprising: detecting ambient sounds in the vicinity of the mobile electronic device; determining at least one property selected from a group consisting of a relative direction and relative distance of the ambient sounds relative to the mobile electronic device; analyzing the detected ambient sounds; outputting audio Interactive Music data based on the analysis of the ambient sounds and based on at least one of a relative direction and relative distance of the ambient sounds relative to the mobile electronic device; wherein said outputting is performed on the mobile electronic device.

Gesture-controlled virtual reality systems and methods of controlling the same are disclosed herein. An example apparatus includes an on-body sensor to output first signals associated with at least one of movement of a body part of a user or a position of the body part relative to a virtual object and an off-body sensor to output second signals associated with at least one of the movement or the position relative to the virtual object. The apparatus also includes at least one processor to generate gesture data based on at least one of the first or second signals, generate position data based on at least one of the first or second signals, determine an intended action of the user relative to the virtual object based on the position data and the gesture data, and generate an output of the virtual object in response to the intended action.

The present technology relates to a signal processing device, a signal processing method, and a program that enable intuitive operation of sound.

The signal processing device includes an acquisition unit that acquires a sensing value indicating a motion of a predetermined portion of a body of a user or motion of an instrument, and a control unit that performs non-linear acoustic processing on an acoustic signal according to the sensing value. The present technology can be applied to an acoustic reproduction system.

An embodiment of the present disclosure provides a portable electronic musical instilment, including a press module, a control module, an angle detection module, and an audio play module; the press module is arranged above the control module; the angle detection module and the audio play module are respectively connected to the control module; the angle detection module is configured to detect a rotating angle of a portable electronic musical instrument body; the control module is configured to adjust, according to the rotating angle detected by the angle detection module, different registers; the press module is configured to receive a press event of a user; and the audio play module is controlled by the control module to play tones of different musical scales.

Various implementations disclosed herein include devices, systems, and methods that determine that a user is interested in audio content by determining that a movement (e.g., a user's head bob) has a time-based relationship with detected audio content (e.g., the beat of music playing in the background). Some implementations involve obtaining first sensor data and second sensor data corresponding to a physical environment, the first sensor data corresponding to audio in the physical environment and the second sensor data corresponding to a body movement in the physical environment. A time-based relationship between one or more elements of the audio and one or more aspects of the body movement is identified based on the first sensor data and the second sensor data. An interest in content of the audio is identified based on identifying the time-based relationship. Various actions may be performed proactively based on identifying the interest in the content.

Described herein are embodiments of sensorized spherical input and output devices, systems, and methods for capturing gestural input from a user's physical interactions with a spherical device, including tossing, bouncing and spinning. In one embodiment, the spherical input and output device includes force sensors in a configuration to capture a variety of user gestures with the sphere. A microprocessor receives sensor input and transmits the sensor data to receiving devices which include computer software to translate the sensor signals to audio output, visual output, or various functions on receiving devices. Embodiments of the invention include the integration of inertial measurement units (IMUs), which may include a combination of accelerometers, gyroscopes and magnetometers to capture complex user gestures involving motion, direction and spin of the sensorized sphere in three dimensional space.

The subject matter discloses a system implemented on in a mobile electronic device, the system comprising a processing system of the device; and a memory that contains instructions comprising: detecting ambient sounds in the vicinity of the mobile electronic device; determining at least one property selected from a group consisting of a relative direction and relative distance of the ambient sounds relative to the mobile electronic device; analyzing the detected ambient sounds; outputting audio Interactive Music data based on the analysis of the ambient sounds and based on at least one of a relative direction and relative distance of the ambient sounds relative to the mobile electronic device; wherein said outputting is performed on the mobile electronic device.

Systems and methods are directed to generating music. In one example, an electronic musical instrument includes a first handheld unit. The electronic musical instrument further includes a second handheld unit, the second handheld unit being communicatively coupled to the first handheld unit. The first handheld unit includes a plurality of input controls configured to indicate a selection of a note of a musical scale. The second handheld unit is configured to initiate output of the selected note.

An information processing apparatus detachable from a human body includes a control unit that generates feedback information that provides feedback in accordance with information based on strength/weakness of a keystroke of a musical instrument.

The present invention relates to a removable electronic device for emulating at least one sound of a drum-type percussion instrument, said device being intended to instrumentalise a striking element. A defining means defines a striking area on a tangible support. An allocating means allocates a drum element associated with a predetermined sound to the striking area, in a database. At least one sensor generates a stroke signal having at least one piece of stroke information on a stroke of a user with the striking element in the striking area. A computer processing means implements a processing algorithm configured to process the stroke signal to spatially locate said stroke in order to detect the area struck and to determine the drum element corresponding to this area struck. A generating means is configured to generate a sound signal comprising information on the sound virtually generated by said stroke of the striking element in said area struck.