A device for detecting the grip pattern when playing a bowed instrument, having a sensor film arrangeable on the fingerboard for detecting the grip pattern. The sensor film is formed from at least one resistance layer, a conductive layer and a spacer layer arranged in-between, and having an evaluation circuit, by which evaluation circuit the resistance changes of the sensor film caused by the grip pattern are able to be detected. The resistance layer is divided into a number of resistance tracks corresponding to the number of strings of the bowed instrument. The width of each resistance track is formed increasing from one end of the sensor film to the other end of the sensor film, and the upper layer of the sensor film is formed by the conductive layer, and the sensor film has a curvature, corresponding to the arch of the fingerboard.

Provided is an information processing device including an acquisition unit that acquires subjective evaluation information from a second user about each performance performed by at least part of a body of a first user moving, a learning unit that performs machine learning on a relationship between the each performance and the corresponding subjective evaluation information and generates relationship information between the each performance and the corresponding subjective evaluation information, and a presentation unit that presents feedback information to the second user based on the relationship information.

A phone app is disclosed that enables a user to place 3D sound in a room. The user of this app is able to locate precisely where sound is perceived to originate by aiming their phone. This app may be used by audio professionals in place of the controls on a traditional sound mixer.

The present disclosure relates to a virtual drum kit device. The virtual drum kit device includes a motion capture device and a drum sound processing device separated from each other; where, the motion capture device includes at least two drumsticks, the drumstick including a first cover body, as well as a first battery, a first control printed circuit board assembly (PCBA) board and a vibration motor which are arranged in the first cover body, the first control PCBA board being connected to the battery and the vibration motor separately, and being capable of transmitting an RF signal to the drum sound processing device according to a motion instruction captured by the drumstick, the drum sound processing device includes a second cover body, as well as a second battery and a second control PCBA board which are arranged in the second cover body.

Systems, devices, media, and methods are described for presenting a tutorial in augmented reality on the display of a smart eyewear device. The system includes a marker registration utility for setting a marker on a musical instrument, a localization utility for locating the eyewear device relative to the marker location and the instrument, a virtual object rendering utility for presenting a series of virtual tutorial objects on the display near one or more actuators on the instrument, and a hand tracking utility for tracking the performer's finger locations in real time during playback of a song file. A high-definition video camera captures sequences of frames of video data. The series of virtual tutorial objects, in one example, includes graphical elements presented on a virtual scroll that appears to move toward the instrument at a speed correlated with the song tempo. The hand tracking utility calculates a set of expected fingertip coordinates based on a detected hand shape and a library of hand poses and landmarks.

Systems and methods are described in which the location of a tap on the body of a handheld device is determined in real time using data streams from an embedded inertial measurement unit (IMU). Taps may be generated by striking the handheld device with an object (e.g., a finger), or by moving the handheld device in a manner that causes it to strike another object. IMU accelerometer, gyroscopic and/or orientation (relative to the magnetic and/or gravitational pull of the earth) measurements are examined for signatures that distinguish a tap at a location on the body of the device compared with signal characteristics produced by taps at other locations. Neural network and/or numerical methods may be used to perform such classifications. Tap locations, tap timing and tap attributes such as the magnitude of applied forces, device orientation, and the amplitude and directions of motions during and following a tap, may be used to control or modulate responses within the handheld device and/or actions within connected devices.

A musical device includes a frame including a plurality of receptacles for receiving three-dimensional parts each having a face capable of swapping between at least two orientations in the receptacle; each part including an indexing element of the orientation of the part among at least two orientations, a plurality of detectors, each detector being associated with a receptacle to determine orientation of the part by detecting an indexing element in its receptacle, at least one audio system, inserting at least two parts into their respective receptacles triggering the sound diffusion by the audio system of at least two given music tracks simultaneously based on each of the orientations of said parts determined; the device further including a calculation system to ensure synchronization of the music tracks, soundly diffused simultaneously.

A signal generation device includes a memory configured to store instructions and a processor communicatively connected to the memory. The processor is configured to execute the instructions to function as a signal generation unit to generate a sound signal based on key operation data associated with a key operation and a decay control unit to control a decay speed of the sound signal based on pedal operation data. The decay control unit is configured to control the decay speed to a first speed in a case where the pedal operation position is in a first range, and the decay control unit is configured to control the decay speed to a second speed in a case where the pedal operation position is in a second range. A first boundary position between the first and the second ranges is determined based on control information obtained by the key operation.

Provided is a musical instrument controller capable of accurately controlling a musical sound parameter. This musical instrument controller includes: a reception means for receiving, from a musical performance device, a sound emission start signal transmitted on the basis of a musical performance operation; a sensor for detecting an amount of displacement from a reference position; and a control means for generating a control signal on the basis of the amount of displacement from the reference position and transmitting the control signal to a sound generation device. The control means sets the reference position on the basis of the sound emission start signal received from the musical performance device.

A system is described for an enhanced bow piece of a stringed musical instrument. The enhancement includes a visual display element attached to the bow. The appearance of the display changes in response to bow motion, bow position, and one or more user-supplied inputs (e.g. buttons). The system can be entirely self-contained and used as a normal instrument bow, providing a light-up/responsive effect while the user plays their instrument in an otherwise normal way. There is some capability for multiple self-contained units to be locally synchronized, providing group-based visualizations. Alternatively, these devices can be monitored and controlled by an external control system.