Embodiments are disclosed for determining an answer to a query associated with a graphical representation of data. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving an input including an unprocessed audio sequence and a request to perform an audio signal processing effect on the unprocessed audio sequence. The one or more embodiments further include analyzing, by a deep encoder, the unprocessed audio sequence to determine parameters for processing the unprocessed audio sequence. The one or more embodiments further include sending the unprocessed audio sequence and the parameters to one or more audio signal processing effects plugins to perform the requested audio signal processing effect using the parameters and outputting a processed audio sequence after processing of the unprocessed audio sequence using the parameters of the one or more audio signal processing effects plugins.

A tool is needed for music instrument learners to get feedbacks on the correctness of their performances of a particular piece of music. The invention disclosed here is such a tool that can provide music instrument players instant feedback on note pitch and rhythms accuracy based on sheet music. This is accomplished through audio signal processing, sheet music image processing, and conversion of both analogue images and audio signals into standard digital music representation so a comparison can be done and hence a feedback can be presented to the player. An advanced feature will allow users to save the data to the cloud and retrieve later for comparison of progress. It also will allow user to participate an online competition with other players of the same piece of music.

The present invention comprises a device and process designed to accelerate the maturation of stringed musical instruments, composed of but not limited to a broad spectrum audio generator coupled with one or more fasteners via one or more armatures dimensioned to allow easy installation, secure attachment, and easy uninstallation from the stringed musical instrument.

Provided is an information processing device including an acquisition unit that acquires subjective evaluation information from a second user about each performance performed by at least part of a body of a first user moving, a learning unit that performs machine learning on a relationship between the each performance and the corresponding subjective evaluation information and generates relationship information between the each performance and the corresponding subjective evaluation information, and a presentation unit that presents feedback information to the second user based on the relationship information.

A method for generating a musical score based on user performance during playing a keyboard instrument may include detecting a status change of a plurality of execution devices of the keyboard instrument. The method may include generating a first signal according to the detected status change. The method may include generating a second signal indicating a plurality of timestamps. The method may include determining a tune of the musical score based on the first signal. The method may include determining a rhythm of the musical score based on the second signal. The method may further include generating the musical score based on the tune and the rhythm of the musical score.

Systems, devices, media, and methods are described for presenting a tutorial in augmented reality on the display of a smart eyewear device. The system includes a marker registration utility for setting a marker on a musical instrument, a localization utility for locating the eyewear device relative to the marker location and the instrument, a virtual object rendering utility for presenting a series of virtual tutorial objects on the display near one or more actuators on the instrument, and a hand tracking utility for tracking the performer's finger locations in real time during playback of a song file. A high-definition video camera captures sequences of frames of video data. The series of virtual tutorial objects, in one example, includes graphical elements presented on a virtual scroll that appears to move toward the instrument at a speed correlated with the song tempo. The hand tracking utility calculates a set of expected fingertip coordinates based on a detected hand shape and a library of hand poses and landmarks.

An information processing apparatus (100) includes an estimation unit (132) that estimates time-series information regarding a posture of a finger on the basis of image information including an operation of the finger with respect to an object including a contact operation of the finger with respect to the object and the object. The estimation unit (132) estimates the time-series information regarding the posture of the finger by using a first machine learning model learned to estimate the time-series information regarding the posture of the finger on the basis of the image information including the operation of the finger and the object.

A mobility sound generation apparatus of generating a sound suitable for a landscape while driving of a mobility may include an information acquisition device provided in a mobility to acquire information on an outside landscape of the mobility while driving of the mobility; a sound generation device configured to generate a sound corresponding to the information on the outside landscape; and a sound output device configured to output the generated sound, whereby it is possible to acquire information on an outside landscape while driving of the mobility and generate a sound corresponding to the information on the outside landscape and it is possible for facilitating an occupant to admire a landscape by expressing the outside landscape with sound while driving to generate and provide the sound corresponding to water, mountains, buildings or the like forming the outside landscape of the mobility.

A method for generating virtual and real composite image data includes: acquiring captured image data capturing an image of a real space as seen from a user's point of view; inputting the captured image data into a trained model, the training model outputting segmentation data segmenting the captured image data into a first region in which a target object is displayed, a second region in which at least a part of the user's body is displayed, and a third region that is other than the first and second regions; and compositing data of the first region and data of the second region with a virtual space image data based on the segmentation data.

A virtual-musical-instrument-based audio processing method is provided. In the method, a video is played. A virtual musical instrument is displayed in the video when the virtual musical instrument is matched with at least one musical instrument graphic element in the video. Played audio of the virtual musical instrument is outputted according to interactions with the at least one musical instrument graphic element matched with the virtual musical instrument in the video. Apparatus and non-transitory computer-readable storage medium counterpart embodiments are also contemplated.