Embodiments are disclosed for re-timing a video sequence to an audio sequence based on the detection of motion beats in the video sequence and audio beats in the audio sequence. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a first input, the first input including a video sequence, detecting motion beats in the video sequence, receiving a second input, the second input including an audio sequence, detecting audio beats in the audio sequence, modifying the video sequence by matching the detected motions beats in the video sequence to the detected audio beats in the audio sequence, and outputting the modified video sequence.

Embodiments described herein relate generally to systems comprising a display device, a display device-coupled computing platform, a mobile device in communication with the computing platform, and a content server in which methods and techniques of capture and/or processing of audiovisual performances are described and, in particular, description of techniques suitable for use in connection with display device connected computing platforms for rendering vocal performance captured by a handheld computing device.

A virtual instrument for real-time musical generation includes a musical rule set unit for defining musical rules, a time constrained pitch generator for synchronizing generated music, an audio generator for generating audio signals, wherein the rule definitions describe real-time morphable music parameters, and said morphable music parameters are controllable directly by the real-time control signal. With this virtual instrument, the user can create new musical content in a simple and interactive way regardless of the level of musical training obtained before using the instrument.

An environment awareness system includes a memory and first and second modules. The memory is configured to store environmental data, one or more music composition templates, and one or more maps, where the environmental data is indicative of at least one of a state, condition, or change in an environment in which the environment awareness system is located. The first module is configured to receive and store the environmental data in the memory. The second module is configured to: based on the one or more music composition templates and the one or more maps, convert the environmental data to a music signal including modifying variables in the one or more music composition templates based on the environmental data; and based on the music signal, play out a musical composition via an audio system to audibly indicate the at least one of the state, condition, or change in the environment.

A device is provided for capturing vibrations produced by an object such as a musical instrument such as a cymbal of a drum kit. The device comprises a detectable element, such as a ferromagnetic element, such as a metal shim and a sensor spaced apart from and located relative to the musical instrument. The detectable element is located between the sensor and the musical instrument. When the musical instrument vibrates, the sensor remains stationary and the detectable element is vibrated relative to the sensor by the musical instrument.

A multi-functional computer implemented system for creation of videos with various effects is provided. The computer implemented system of present invention is comprising of: a guessing subsystem that allows user to create and share a video with guessing option for other users to play a guessing game while watching the video; a challenge subsystem to allow users to challenge other users for video battles; a tracking subsystem that allows user to select any specific segment of the video, determines music/audio effect present within that segment and visualizes that music effect in video too; and a gesture detection subsystem that is provided to detect the gesture of the user and perform action associated with detected gesture.

A video processing device, which inputs a piece of music and selects and outputs one video of a plurality of video sources, is provided. The video processing device includes a music analyzing part, which analyzes a progress of the piece of music; a video selecting part, which selects the one video from the plurality of video sources; and an output part, which outputs the one video at a timing corresponding to the progress of the piece of music that has been analyzed by the music analyzing part.

Embodiments described herein relate generally to systems comprising a display device, a display device-coupled computing platform, a mobile device in communication with the computing platform, and a content server in which methods and techniques of capture and/or processing of audiovisual performances are described and, in particular, description of techniques suitable for use in connection with display device connected computing platforms for rendering vocal performance captured by a handheld computing device.

An information processing device, a tempo detection device and a video processing system are provided. A beat of a piece of performed music is detected from a musical viewpoint. The information processing device includes: an acquisition part that acquires samples of musical sound signals in a time series; an evaluation part that has an adaptive filter using the acquired samples of the musical sound signals as reference signals and using samples of musical sound signals acquired a predetermined time earlier than the samples of the musical sound signals as input signals; and a tempo determination part that sequentially inputs the samples of the musical sound signals to the adaptive filter and determines a tempo corresponding to a musical sound based on a filter coefficient when a value of the filter coefficient of the adaptive filter converges.

Systems, devices, media, and methods are presented for playing audio sounds, such as music, on a portable electronic device using a digital color image of a note matrix on a map. A computer vision engine, in an example implementation, includes a mapping module, a color detection module, and a music playback module. The camera captures a color image of the map, including a marker and a note matrix. Based on the color image, the computer vision engine detects a token color value associated with each field. Each token color value is associated with a sound sample from a specific musical instrument. A global state map is stored in memory, including the token color value and location of each field in the note matrix. The music playback module, for each column, in order, plays the notes associated with one or more the rows, using the corresponding sound sample, according to the global state map.