The present disclosure relates to systems, methods, and devices for music simulation. The methods may include determining one or more simulation actions based on data associated with one or more simulation actions acquired by at least one sensor. The methods may further include determining, based on at least one of the one or more simulation actions and a mapping relationship between simulation actions and corresponding musical instruments, a simulation musical instrument that matches with the one or more simulation actions. The methods may further include determining, based on the one or more simulation actions, one or more first features associated with the simulation musical instrument. The methods may further include playing music based on the one or more first features.

Methods, systems, and computer program products for network-based processing and distribution of multimedia content of a live performance are disclosed. In some implementations, recording devices can be configured to record a multimedia event (e.g., a musical performance). The recording devices can provide the recordings to a server while the event is ongoing. The server automatically synchronizes, mixes and masters the recordings. The server performs the automatic mixing and mastering using reference audio data previously captured during a rehearsal. The server streams the mastered recording to multiple end users through the Internet or other public or private network. The streaming can be live streaming.

Gesture-controlled virtual reality systems and methods of controlling the same are disclosed herein. An example apparatus includes an on-body sensor to output first signals associated with at least one of movement of a body part of a user or a position of the body part relative to a virtual object and an off-body sensor to output second signals associated with at least one of the movement or the position relative to the virtual object. The apparatus also includes at least one processor to generate gesture data based on at least one of the first or second signals, generate position data based on at least one of the first or second signals, determine an intended action of the user relative to the virtual object based on the position data and the gesture data, and generate an output of the virtual object in response to the intended action.

An information processing apparatus according to the present disclosure obtains a real image of a real space, a virtual image, external sound in the real space, and virtual sound. The information processing apparatus then adjusts relative sound levels of the virtual sound and the external sound based on at least one of the obtained images.

A music playing device 100 of the present invention includes an acquisition means 121 for acquiring a plurality of feature points of a person from a captured image in which the person is captured, a detection means 122 for detecting a position relationship between a plurality of the feature points in a feature point set in which the plurality of feature points are combined, and an output means 123 for outputting a sound specified based on the detected position relationship.

Methods, systems, and computer program products for network-based processing and distribution of multimedia content of a live performance are disclosed. In some implementations, recording devices can be configured to record a multimedia event (e.g., a musical performance). The recording devices can provide the recordings to a server while the event is ongoing. The server automatically synchronizes, mixes and masters the recordings. The server performs the automatic mixing and mastering using reference audio data previously captured during a rehearsal. The server streams the mastered recording to multiple end users through the Internet or other public or private network. The streaming can be live streaming.

The present disclosure relates to systems, methods, and devices for music simulation. The methods may include determining one or more simulation actions based on data associated with one or more simulation actions acquired by at least one sensor. The methods may further include determining, based on at least one of the one or more simulation actions and a mapping relationship between simulation actions and corresponding musical instruments, a simulation musical instrument that matches with the one or more simulation actions. The methods may further include determining, based on the one or more simulation actions, one or more first features associated with the simulation musical instrument. The methods may further include playing music based on the one or more first features.

The present technology relates to a signal processing device, a signal processing method, and a program that enable intuitive operation of sound.

The signal processing device includes an acquisition unit that acquires a sensing value indicating a motion of a predetermined portion of a body of a user or motion of an instrument, and a control unit that performs non-linear acoustic processing on an acoustic signal according to the sensing value. The present technology can be applied to an acoustic reproduction system.

The present disclosure is related to systems and methods for assisting a user in practicing a smart musical instrument. The method includes obtaining a real-time image of the user playing the smart musical instrument. The method also includes obtaining information associated with a current key being pressed and information associated with a plurality of reference fingerings from the smart musical instrument. The method also includes displaying the real-time image in real-time. The method also includes determining whether a current fingering associated with the current key being pressed matches with a reference fingering, of the plurality of reference fingerings, associated with the current key being pressed. In response to a determination that the current fingering associated with the current key being pressed does not match the reference fingering, the method further includes generating a reminder. The method still further includes displaying the reference fingering corresponding to the current fingering.

Various implementations disclosed herein include devices, systems, and methods that determine that a user is interested in audio content by determining that a movement (e.g., a user's head bob) has a time-based relationship with detected audio content (e.g., the beat of music playing in the background). Some implementations involve obtaining first sensor data and second sensor data corresponding to a physical environment, the first sensor data corresponding to audio in the physical environment and the second sensor data corresponding to a body movement in the physical environment. A time-based relationship between one or more elements of the audio and one or more aspects of the body movement is identified based on the first sensor data and the second sensor data. An interest in content of the audio is identified based on identifying the time-based relationship. Various actions may be performed proactively based on identifying the interest in the content.