A musical sound processing apparatus, a musical sound processing method, and a storage medium capable of generating musical sound full of interest are provided. The musical sound processing apparatus includes a first control unit configured to control a timing of sounding of a first tone in steps that come with an interval therebetween and a second control unit configured to control a timing of sounding of a second tone following or overlapping the first tone according to a first tempo, wherein the first control unit is configured to control the timing of sounding of the first tone according to the first tempo when timing information has not been acquired from outside and control the timing of sounding of the first tone according to a second tempo which is based on the timing information and different from the first tempo when the timing information has been acquired.

A musical sound processing apparatus, a musical sound processing method, and a storage medium capable of generating musical sound full of interest are provided. The musical sound processing apparatus includes a first control unit configured to control a timing of sounding of a first tone in steps that come with an interval therebetween and a second control unit configured to control a timing of sounding of a second tone following or overlapping the first tone according to a first tempo, wherein the first control unit is configured to control the timing of sounding of the first tone according to the first tempo when timing information has not been acquired from outside and control the timing of sounding of the first tone according to a second tempo which is based on the timing information and different from the first tempo when the timing information has been acquired.

The present invention is designed to allow easy synchronization of the movement of a computer graphics (CG) model with sound data. The data structure according to an embodiment of the present invention presents a data structure that relates to a computer graphics (CG) model, including first time-series information for designating the coordinates of the components of the CG model on a per beat basis, and the first time-series information is used on a computer to process the CG model.

Disclosed herein are computer-implemented method, computer-readable storage medium, and DAW embodiments for implementing a music composition aid. An embodiment includes retrieving a first constraint value, receiving a selection of a set of musical elements, and accepting a second constraint value corresponding to the set of musical elements. Some embodiments further include invoking an iterator function, using at least the second constraint value as an argument, and generating an output of the iterator function, limiting a size of the output of the iterator function, according to the lesser of the first constraint value or a transform of the second constraint value. Output of the iterator function may include, of the set of musical elements, a subset determined by the second constraint value. The size of the output may be no more than the first constraint value. Further embodiments may render the output of the iterator function visually and/or audibly, for example.

Disclosed herein are computer-implemented method, computer-readable storage medium, and DAW embodiments for implementing a music composition aid. An embodiment includes retrieving a first constraint value, receiving a selection of a set of musical elements, and accepting a second constraint value corresponding to the set of musical elements. Some embodiments further include invoking an iterator function, using at least the second constraint value as an argument, and generating an output of the iterator function, limiting a size of the output of the iterator function, according to the lesser of the first constraint value or a transform of the second constraint value. Output of the iterator function may include, of the set of musical elements, a subset determined by the second constraint value. The size of the output may be no more than the first constraint value. Further embodiments may render the output of the iterator function visually and/or audibly, for example.

Systems and methods for viseme data generation are disclosed. Uncompressed audio data is generated and/or utilized to determine the beats per minute of the audio data. Visemes are associated with the audio data utilizing a Viterbi algorithm and the beats per minute. A time-stamped list of viseme data is generated that associates the visemes with the portions of the audio data that they correspond to. An animatronic toy and/or an animation is caused to lip sync using the viseme data while audio corresponding to the audio data is output.

The present invention relates to a method and apparatus to synchronise audio and video data. More particularly, the present invention relates to a loop-based audio-visual mixing apparatus and method for synchronising a plurality of videos and their corresponding audio streams to create audio-visual compositions. According to one aspect, there is provided a method for creating a synchronised lineal sequence from multiple inputs of audio and video data, comprising the steps of: providing a first input, comprising audio and video data; providing one or more subsequent inputs, comprising audio and video data; determining at least one rhythm metric unit for each input; queueing the or each subsequent inputs such that the or each subsequent input is triggered at a beginning of a next said rhythm metric unit of a determined input.

A mobile music listening device synchronizing in a personalized way music and movement, and dedicated to improving the kinematics of the runner. Thanks to inertial units connected to a smartphone, the runner's steps are detected in real time by the mobile application. A dedicated algorithm adapts the pulsation of the musical excerpts in such a way as to bring the runner to a suitable cadence, capable of preventing injuries. A method for the synchronization of the rhythmic stimulation with the biological variability using a Kuramoto model characterized in that phase oscillator with a coupling term from the movement dynamics with parameters of, coupling strength, maximum and minimum frequencies for a fraction of the unmodified song frequency, maximum difference between the tempo and target frequency, Target the target frequency.

A method and device for harmony-aware audio-driven motion synthesis are provided. The method includes determining a plurality of testing meter units according to an input audio, each testing meter unit corresponding to an input audio sequence of the input audio, obtaining an auditory input corresponding to each testing meter unit, obtaining an initial pose of each testing meter unit as a visual input based on a visual motion sequence synthesized for a previous testing meter unit, and automatically generating a harmony-aware motion sequence corresponding to the input audio using a generator of a generative adversarial network (GAN) model. The GAN model is trained by incorporating a hybrid loss function. The hybrid loss function includes a multi-space pose loss, a harmony loss, and a GAN loss. The harmony loss is determined according to beat consistencies of audio-visual beat pairs.

An electronic device modifies a first media content item by superimposing a first set of data over a first accented musical event. The first accented musical event has a first audio profile. The first set of data has a second audio profile configured to be masked by the first audio profile during playback of the first media content item. The electronic device transmits, to a second electronic device, the modified first media content item.