Vibratory motors are used to generate a haptic language for music or other sound that is integrated into wearable technology. The disclosed system enables the creation of a family of devices that allow people with hearing impairments to experience sounds such as music or other auditory input to the system. For example, a “sound vest” or one or more straps comprising a set of motors transforms musical input to haptic signals so that users can experience their favorite music in a unique way, and can also recognize auditory cues in the user's everyday environment and convey this information to the user using haptic signals.

An electronic device and a method for controlling the electronic device are provided. The method includes receiving at least one input sound from a user, determining one of a plurality of reference sounds included in a guide track as a device playing sound corresponding to the at least one input sound, and playing the device playing sound.

A device including: first and second input units providing first and second input signals of first and second audio tracks, a decomposition unit to decompose the first input audio signal to obtain decomposed signals, a playback unit to start playback of a first output signal obtained from recombining at least first and second decomposed signals at first and second volume levels, respectively, and a transition unit for performing a transition between playback of the first output signal and playback of a second output signal obtained from the second input signal. The transition unit is adapted for reducing the first/second volume levels according to first/second transition functions. The device includes an analyzing unit to analyze an audio signal to determine a song part junction between two song parts. The transition time interval of at least one of the transition functions is set such as to include the song part junction.

The disclosure provides a method for synthesizing a song multimedia, an electronic device and a storage medium. Material obtaining modes are provided based on a song multimedia synthesis request. User audios provided by a user are obtained based on a selected material obtaining mode. A user timbre output by a timbre extraction model is obtained by inputting the user audios into the timbre extraction model. Lyrics to be synthesized and a tune to be synthesized provided by the user are obtained based on the selected material obtaining mode, and a synthesized song multimedia is obtained by inputting the user timbre, the lyrics to be synthesized and the tune to be synthesized into a song synthesis model.

A musical performance system includes an instrument and a term1nal. Terminal includes a processor. Processor executes outputting first track data or first pattern data obtained by arbitrarily combining pieces of track data. Processor executes automatically outputting second track data or second pattern data obtained by arbitrarily combining pieces of track data. Instrument includes a processor. Processor executes acquiring first track/pattern data from terminal. Processor executes generating a sound of a music composition in accordance with first track/pattern data. Processor executes acquiring second track/pattern data from terminal. Processor executes generating a sound of a music composition in accordance with second track/pattern data.

A non-transitory computer-readable storage medium stored with an automatic music arrangement program, and an automatic music arrangement device are provided. An outer voice note having a highest pitch among notes of which sound production start times are approximately the same in a melody part acquired from musical piece data is identified. A melody part acquired by deleting inner voice notes of which sound production starts within a sound production period of the outer voice note and of which pitches are low from the melody part is generated. Candidate accompaniment parts in which root notes of chords of chord data of the musical piece data are arranged to be produced at sound production timings thereof for each pitch range acquired by shifting a range of pitches corresponding to one octave by one semitone at each time are generated, and an accompaniment part is selected among them.

Systems and methods for mapping parts in a digital sheet music file for a harmony. The method may include receiving a selection of a music segment for part mapping, receiving a digital sheet music representation of the selected music segment, and determining a plurality of plausible part mapping for the digital sheet music representation. A part mapping identifies one or more distinct musical parts in the digital sheet music representation, each of said one or more distinct musical parts corresponding to a performer of the harmony. The method may also include analyzing one or more features of the plurality of plausible part mapping to identify a highest probability part mapping based on previously stored information, and outputting the highest probability part mapping.

The present invention provides a method for processing music audio data, comprising the steps of providing input audio data representing a first piece of music containing a mixture of predetermined musical timbres, decomposing the input audio data to generate at least a first audio track representing a first musical timbre selected from the predetermined musical timbres, and a second audio track representing a second musical timbre selected from the predetermined musical timbres, applying a predetermined first audio effect to the first audio track, applying no audio effect or a predetermined second audio effect, which is different from the first audio effect, to the second audio track, and obtaining recombined audio data by recombining the first audio track with the second audio track.

Audio data of an original work is received. Text in the audio data is translated to a target language. The audio data is passed to a first deep learning model to learn voice features in the audio data. The audio data is passed to a second deep learning model to learn audio properties in the audio data. The translated text is synchronized to play in the position of original text of the original work in a synthesized voice. A translated audio data of the original work is created by combining the synchronized translated text in the synthesized voice with music of the audio data.

A method for processing music audio data, including providing input audio data representing a first piece of music comprising a mixture of musical timbres. The method also includes decomposing the input audio data to generate at least first-timbre decomposed data representing a first timbre selected from the musical timbres of the first piece of music, and second-timbre decomposed data representing a second timbre selected from the musical timbres of the first piece of music. The method also includes applying a transport control to obtain transport controlled first-timbre decomposed data. The method also includes recombining audio data obtained from the transport controlled first-timbre decomposed data with audio data obtained from the second-timbre decomposed data to obtain recombined audio data.