The present disclosure is related to systems and methods for assisting a user in practicing a smart musical instrument. The method includes obtaining a real-time image of the user playing the smart musical instrument. The method also includes obtaining information associated with a current key being pressed and information associated with a plurality of reference fingerings from the smart musical instrument. The method also includes displaying the real-time image in real-time. The method also includes determining whether a current fingering associated with the current key being pressed matches with a reference fingering, of the plurality of reference fingerings, associated with the current key being pressed. In response to a determination that the current fingering associated with the current key being pressed does not match the reference fingering, the method further includes generating a reminder. The method still further includes displaying the reference fingering corresponding to the current fingering.

An automatic performance system includes a sign detector configured to detect a sign action of a performer performing a musical piece, a performance analyzer configured to sequentially estimates a performance position in the musical piece by analyzing an acoustic signal representing performed sound in parallel with the performance, and a performance controller configured to control an automatic performance device to carry out an automatic performance of the musical piece so that the automatic performance is synchronized with the sign action detected by the sign detector and a progress of the performance position estimated by the performance analyzer.

An artificial intelligence (AI) method includes generating a first musical interaction behavioral model. The first musical interaction behavioral model causes an interactive electronic device to perform a first set of musical operations and a first set of motional operations. The AI method further includes receiving user inputs received in response to the performance of the first set of musical operations and the first set of motional operations and determining a user learning progression level based on the user inputs. In response to determining that the user learning progression level is above a threshold, the AI method includes generating a second musical interaction behavioral model. The second musical interaction behavioral model causes the interactive electronic device to perform a second set of musical operations and a second set of motional operations. The AI method further includes performing the second set of musical operations and the second set of motional operations.

An electronic keyboard using a camera, and more particularly, to an electronic keyboard using a camera, which includes a retroreflective film, a light source for irradiating light on to the retroreflective film, a camera for capturing light of a light source retroreflected from the retroreflective film, and an image processing means that analyzes the captured image to track the position of the reflected light source, to find a depressed state of the keyboard, and to generate a sound of an instrument corresponding to the depressed state.

A device that supports a performer of a wind instrument, the device including: a processor; and a memory, in which the processor acquires data indicating a myoelectric potential value measured by, a myoelectric sensor arranged on a surface of the face of a performer, the memory stores a table including a listing of conditions for the myoelectric potential value and a corresponding listing of support information for playing the wind instrument, and the processor determines whether the acquired myoelectric potential value satisfies at least a portion of a target condition included in the listing of conditions, determines support information corresponding to the target condition, when the acquired myoelectric potential value is determined to satisfy the at least a portion of the target condition, generates a support image corresponding to the determined support information, and controls a display to display the generated support image.

The object of the present invention concerns a control device (100) for a generation module (GM) of sound effects (EF.sub.A, EF.sub.B) of a musical instrument (MI), such device comprising computer software configured for: —the capture, using a digital camera (10), of at least one digital image (I) comprising at least one portion of the user's (U) face; —processing of such at least one image (I) to define expression data (D_EX.sub.i, i being a positive integer) containing information relating to facial expressions (EX.sub.a, EX.sub.b) of the user (U); —an analysis of such expression data (D_EX.sub.i) using a predefined first database (DB1) to determine a sound effect data (D_EF.sub.j, j being a positive integer) containing information relating to at least one sound effect (EF.sub.A, EF.sub.B) corresponding to the facial expression (EX.sub.a, EX.sub.b) of the user (U).

An environmental sound generating apparatus generates an environmental sound signal representing an environmental sound that forms sound environment by being emitted. The environmental sound has at least one chain of phonemes constituted of individual phonemes which sound-emission start timings as one of attributes thereof are sequentially shifted. A plurality of subgroups are prepared each formed by combining individual plural pitches from pitches constituting a primary pitch group that is a group of phonemes musically treated as consonances if sounded simultaneously. One of the plurality of subgroups selected at random is set to each of the sections of the chain of phonemes, and each of the individual phonemes of each section of the chain of phonemes is set to a pitch selected at random from the plural pitches constituting the selected subgroup to attain hypersonic effects.

An interactive music play system, comprising a plurality of toy elements, an image capturing device, a processing unit and a music rendering device; wherein the image capturing device is configured to capture one or more images of a user-selected subset of said toy elements arranged in a field of view of the image capturing device; wherein the processing unit is configured to: recognise the user-selected subset of toy elements in the one or more captured images; create a musical presentation based on one or more of the recognised toy elements; cause the music rendering device to present the created musical presentation to the user.

A method for stringed instruments' pickup, the method comprising a step of: capturing mechanical vibrations of at least one string; and converting them to a signal representative of a string's current state, the method being characterized in that the capturing comprises the following steps: capturing, using an image capturing device, image frames comprising views of at least one musical instrument's string in a still state; storing the captured image as a reference of a still state; capturing (500), using the image capturing device, image frames comprising views of at least one musical instrument's string in a vibrating state; storing the captured image as a reference of a vibrating state; comparing (520) the still state reference with a vibrating state reference in order to find (530) amplitude of vibrations of each string as well as frequency of each string vibrations based on amplitude height in pixels with reference to the still state and determining a frequency of each vibrating string on the basis of the number of pixels between two nuts of at least half-period of a given periodic function.

[Object] To propose an image processing method, image processing apparatus and program which are capable of exciting the emotions of a viewer more effectively. [Solution] An information processing method including: analyzing a beat of input music; extracting a plurality of unit images from an input image; and generating, by a processor, editing information for switching the extracted unit images depending on the analyzed beat.