Digital signal processing and machine learning techniques can be employed in a vocal capture and performance social network to computationally generate vocal pitch tracks from a collection of vocal performances captured against a common temporal baseline such as a backing track or an original performance by a popularizing artist. In this way, crowd-sourced pitch tracks may be generated and distributed for use in subsequent karaoke-style vocal audio captures or other applications. Large numbers of performances of a song can be used to generate a pitch track. Computationally determined pitch trackings from individual audio signal encodings of the crowd-sourced vocal performance set are aggregated and processed as an observation sequence of a trained Hidden Markov Model (HMM) or other statistical model to produce an output pitch track.

In one aspect, provided herein is a device for notating a musical composition. The device, in various implementations, is structured so as to be less laborious to notate, easier to read, and more simple to employ in notating, reading, and/or playing the music of a given composition to be composed and/or played. Accordingly, in its most basic form, the device herein disclosed includes a template, upon which template one or more symbols may be notated, where such notation is configured in a manner that more closely relates the note to be played with the mechanical action needed to be performed so as to play that note, such as on an instrument to be or being played.

A system and method for generating wireless signals from the physical movement of a person utilizing a movement detection mechanism attached to the person wherein the system allows a person to manipulate the generated wireless signals to selectively control digital responses which may be in the form of sensory-perceivable outputs such as sounds and/or visual effects, for example, through the person's physical movement. Movement sensors attached to the person (e.g., on one foot or both feet) communicate with other system components such as microprocessors, transmitters and/or tactile interface controls, for example, to wirelessly send signal pulses from a person to a computer or mobile device and allow the person wearing the sensors and/or another person to selectively control the dynamics of the digital responses so to create a unique sensory output.

Exemplary embodiments relate to the application of media effects such as facial mask overlays, to visual data (such as a video or photo). Publicly-available images may be found and mapped to a mask. In the mapping process, a user may type in the name of a celebrity or public figure, and a system may perform a public image search. In some embodiments, candidate images may be filtered in order to remove images unsuitable for use in masks. Typically, only a single forward-facing image is required for mapping. However, multiple images may be used to provide different angles and allow the user to turn their head while the mask is applied. Mask generation may involve: extracting facial features from the image; mapping the facial features to the user's video; blending/recoloring of either or both of the image or the person's face; and applying the mask in real-time/on the fly.

In one aspect, provided herein is a device for notating a musical composition. The device, in various implementations, is structured so as to be less laborious to notate, easier to read, and more simple to employ in notating, reading, and/or playing the music of a given composition to be composed and/or played. Accordingly, in its most basic form, the device herein disclosed includes a template, upon which template one or more symbols may be notated, where such notation is configured in a manner that more closely relates the note to be played with the mechanical action needed to be performed so as to play that note, such as on an instrument to be or being played.

A system and method for generating wireless signals from the physical movement of a person utilizing a movement detection mechanism attached to the person wherein the system allows a person to manipulate the generated wireless signals to selectively control digital responses which may be in the form of sensory-perceivable outputs such as sounds and/or visual effects, for example, through the person's physical movement. Movement sensors attached to the person (e.g., on one foot or both feet) communicate with other system components such as microprocessors, transmitters and/or tactile interface controls, for example, to wirelessly send signal pulses from a person to a computer or mobile device and allow the person wearing the sensors and/or another person to selectively control the dynamics of the digital responses so to create a unique sensory output.

In one aspect, provided herein is a device for notating a musical composition. The device, in various implementations, is structured so as to be less laborious to notate, easier to read, and more simple to employ in notating, reading, and/or playing the music of a given composition to be composed and/or played. Accordingly, in its most basic form, the device herein disclosed includes a template, upon which template one or more symbols may be notated, where such notation is configured in a manner that more closely relates the note to be played with the mechanical action needed to be performed so as to play that note, such as on an instrument to be or being played.

The present disclosure relates to an apparatus, system, and method that allow non-musicians to compose and perform a musical composition. Although some existing electronic devices can provide a virtual environment to compose and play musical sound digitally, manipulating such a virtual environment can be difficult and may require specific software expertise, as well as knowledge of music theory. The present disclosure provides a platform that facilitates the creation of a musical composition without such software expertise or knowledge of music theory. The platform models a musical composition as a simultaneous playback of one or more musical contents. The platform allows players to control or modify one or more of the plurality of musical contents to generate or synthesize a musical composition.

Digital signal processing and machine learning techniques can be employed in a vocal capture and performance social network to computationally generate vocal pitch tracks from a collection of vocal performances captured against a common temporal baseline such as a backing track or an original performance by a popularizing artist. In this way, crowd-sourced pitch tracks may be generated and distributed for use in subsequent karaoke-style vocal audio captures or other applications. Large numbers of performances of a song can be used to generate a pitch track. Computationally determined pitch trackings from individual audio signal encodings of the crowd-sourced vocal performance set are aggregated and processed as an observation sequence of a trained Hidden Markov Model (HMM) or other statistical model to produce an output pitch track.

The present disclosure relates to an apparatus, system, and method that allow non-musicians to compose and perform a musical composition. Although some existing electronic devices can provide a virtual environment to compose and play musical sound digitally, manipulating such a virtual environment can be difficult and may require specific software expertise, as well as knowledge of music theory. The present disclosure provides a platform that facilitates the creation of a musical composition without such software expertise or knowledge of music theory. The platform models a musical composition as a simultaneous playback of one or more musical contents. The platform allows players to control or modify one or more of the plurality of musical contents to generate or synthesize a musical composition.