Self-produced music
09934772 ยท 2018-04-03
Inventors
Cpc classification
G10H2210/315
PHYSICS
G10H1/366
PHYSICS
G10H2240/181
PHYSICS
G10H2240/105
PHYSICS
G10H1/0033
PHYSICS
G10H2210/331
PHYSICS
G10H1/361
PHYSICS
G10H2220/116
PHYSICS
G10H2240/161
PHYSICS
International classification
Abstract
An application for operating on a smart phone that records a musician's performance, either voice or instrumental, in combination with pre-recorded music. The combination allows for the auto tuning of the recording, the compression of the recording, the equalization of the recording, adding in reverb, and the audio quantization of the rhythm. Once combined, the song is transmitted to social media and/or to an online store for sale. The user can also make a video with the song. Additional marketing such as song competitions or music reviews and ratings are also provided.
Claims
1. An apparatus for self-producing musical piece, the apparatus comprising: a microphone; an audio signal device; an audio codec, electronically connected to a microphone and an audio signal device, where in the audio codec is configured to transmit first audio signals to the audio signal device and to receive second audio signals from the microphone; a memory for storing data and digital representations of the first and the second audio signals; a network communications device that includes a cellular network interface, wherein the network communications device transmits and receives data, including the digital representation of the first audio signals, from a wireless network; a central processing device, electrically connected to the memory, the audio codec, and the network communications device, wherein the central processing device transmits the digital representations of the first audio signals to the audio codec and receives the digital representation of the second audio signals from the audio codec, and combines the first and the second audio signals into a third audio signals by executing, in parallel, algorithms to mix, auto-tune, equalize, compress and audio quantize the first and the second audio signals using preset parameters, wherein the third audio signal is stored in the memory and wherein the third audio signals are incorporated into the musical piece, wherein the audio quantization corrects rhythm.
2. The apparatus of claim 1 wherein the audio signal device is a headphone.
3. The apparatus of claim 1 wherein the audio signal device is a speaker.
4. The apparatus of claim 1 wherein the third audio signal is transmitted to the wireless network through the network communications device.
5. The apparatus of claim 1 wherein the preset parameters include a fidelity parameter that is used by a plurality of the algorithms.
6. The apparatus of claim 1 wherein the central processing device comprise a plurality of processing cores.
7. The apparatus of claim 6 wherein the parallel execution of the algorithms is performed by the plurality of processing cores.
8. The apparatus of claim 1 wherein the parallel execution of the algorithms is performed as different processes on a single core of the central processing device.
9. The apparatus of claim 1 wherein a portion of the processing of the algorithms is executed within the audio codec.
10. The apparatus of claim 1 wherein the first audio signal comprises a plurality of tracks of a song.
11. A method for self-producing a musical piece, the method comprising: receiving, in a memory attached to a central processing device, a first audio signal from a wireless network through a network communications interface; transmitting, from the memory, the first audio signal through an audio codec to an audio signal device; receiving, at the audio codec, a second audio signal from a microphone; storing the second audio signal into the memory; mixing, by the central processing device, the first and the second audio signals into a third audio signal; auto-tuning, by the central processing device, the first and the second audio signal as it is being mixed into the third audio signal; equalizing, by the central processing device, the first and the second audio signal as it is being mixed into the third audio signal; compressing, by the central processing device, the first and the second audio signal as it is being mixed into the third audio signal; audio quantizing, by the central processing device, the first and the second audio signal as it is being mixed into the third audio signal, wherein the audio quantizing corrects rhythm, wherein the mixing, auto-tuning, equalizing, compressing and audio quantizing are processed by the central processing device in parallel using pre-set parameters; and storing the third audio signal into the memory, wherein the third audio signals are incorporated into the musical piece.
12. The method of claim 10 wherein the audio signal device is a headphone.
13. The method of claim 10 further comprising transmitting the third audio signal through the network communications interface to the wireless network.
14. The method of claim 10 wherein the preset parameters include a fidelity parameter.
15. The method of claim 10 wherein the central processing device comprises a plurality of processing cores.
16. The method of claim 15 wherein the parallel processing of the central processing device is performed by a plurality of processing cores.
17. The method of claim 10 wherein the parallel processing of the central processing device is performed as different processes on a single processing core of the central processing device.
18. The method of claim 10 wherein a portion of the parallel processing is performed by the audio codec.
19. The method of claim 10 wherein the first audio signal comprises a plurality of tracks of a song.
20. The method of claim 10 wherein reverb and delay are added to the third audio signal as the third audio signal is being mixed.
Description
BRIEF DESCRIPTION OF FIGURES
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
DETAILED DESCRIPTION OF THE INVENTION
(17) A system for the production of a musical piece is described. The system includes a smart phone with specialized hardware for processing sounds. The system includes software for accessing a library of sound tracks, for editing the tracks, for playing the sound tracks, recording new tracks, and for finishing the musical piece. The finishing may include auto tuning, adding reverb features, compression, equalizing the sound, and audio quantization. The system further includes taking the finished musical piece, creating a short marketing sample of the musical piece, uploading both the marketing sample and the complete musical piece to an online music store. The online music store includes features for pushing the sample to various social media platforms to advertise the musical piece and an online storefront for selling the musical piece.
(18) Hardware Description
(19)
(20) The A9 101 includes an image processor with temporal and spatial noise reduction as well as local tone mapping. The A9 101 directly integrates an embedded M9 motion coprocessor. In addition to servicing the accelerometer, gyroscope, compass, and barometer 112, the M9 coprocessor can recognize Siri voice commands. The A9 101 is also connected to the SIM card 111 for retrieving subscriber identification information.
(21) The A9 101 interfaces to a two chip subsystem that handles the cellular communications 102, 103. These chips 102, 103 interface to LTE, WCDMA, and GSM chips that connect to the cellular antenna through power amps. These chips 102, 103 provide the iPhone with voice and data connectivity through a cellular network.
(22) In addition to the on chip memory of the A9 101, the A9 101 connects to flash memory 104 and DRAM 105 for additional storage of data.
(23) Electrically connected, through the power supply lines and grounds, to the A9 101 and the rest of the chips 102-119 is the power management module 106. This module 106 is also connected via a data channel to the A9 101. The power management module 106 is connected to the battery 113 and the vibrator 114.
(24) The Touch Screen interface controller 107 is connected to the A9 101 CPU. The Touch Screen controller also interfaces to the touch screen of the iPhone.
(25) The Audio codec 108 in the iPhone is connected to the A9 101 and provides audio processing for the iPhone. The Audio codec 108 is also connected to the speaker 115, the headphone jack 116, and the microphone 117. The Audio codec 108 provides a high dynamic range, stereo DAC for audio playback and a mono high dynamic range ADC for audio capture. The Audio codec 108 may feature high performance up to 24-bit audio for ADC and DAC audio playback and capture functions and for the S/PDIF transmitter. The Audio codec 108 architecture may include bypassable SRCs and a bypassable, three-band, 32-bit parametric equalizer that allows processing of digital audio data. A digital mixer may be used to mix the ADC or serial ports to the DACs. There may be independent attenuation on each mixer input. The processing along the output paths from the ADC or serial port to the two stereo DACs may include volume adjustment and mute control. One embodiment of the Audio codec 108 features a mono equalizer, a sidetone mix, a MIPI SoundWire or I.sup.2S/TDM audio interface, audio sample rate converters, a S/PDIF transmitter, a fractional-N PLL, and integrated power management. In some audio codecs, digital signal processing and fast Fourier transformation functionality is available, either integrated into the sound processing or available to the CPU 101 for offloading processing from the CPU.
(26) The A9 101 chip also interfaces to a Camera integrated signal processor 110 chip, the Camera chip 110 connected to the camera 119.
(27) There is also a Display Controller 109 that provides the interface between the A9 101 chip and the LCD (or OLED) screen 118 on the iPhone.
(28) The wireless subsystem 120 provides connectivity to Bluetooth, WLAN, NFC and GPS modules. This handles all of the non-cellular communications to the Internet and to specific devices. The Bluetooth devices could include a variety of microphones, headsets, and speakers. The wireless subsystem 120 interfaces with the A9 101 chip.
(29) In addition to a smartphone, the present invention utilizes a server system to perform electronic commerce, sales, and marketing. This server is connected to one or more smartphones over the Internet.
(30) The server is a specialized computer system designed and tuned to process web traffic efficiently and rapidly. The server has a central processing unit, a storage subsystem and a communications subsystem. The communications system, in one embodiment, is a high performance network interface chip or card for connecting the server central processing unit to an Ethernet network. It could use a fiber optic connection or a copper Gigabit Ethernet (or more, although the use of 10 Base T or 100 Base T would also be another embodiment). Multiple network connections could be used for redundancy, load balancing, or increased bandwidth. The storage subsystem could include any number of storage technologies, such as STAT, SAS, RAID, iSCSI, or NAS. Storage could be on solid state drives, rotating hard drives, CD Roms, or other technologies. Central processing units could be any number of high performance processors, such as those from Intel, AMD, or Motorola. In some embodiments, the server could integrate the CPU with the network functionality in a system on a chip architecture.
(31) Large servers need to be run for long periods without interruption. Availability requirements are very high, making hardware reliability and durability extremely important. Enterprise servers need to be very fault tolerant and use specialized hardware with low failure rates in order to maximize uptime. Uninterruptible power supplies might be incorporated to insure against power failure. Servers typically include hardware redundancy such as dual power supplies, RAID disk systems, and ECC memory, along with extensive pre-boot memory testing and verification. Critical components might be hot swappable, allowing technicians to replace them on the running server without shutting it down, and to guard against overheating, servers might have more powerful fans or use water cooling. They will often be able to be configured, powered up and down or rebooted remotely, using out-of-band management. Server casings can be flat and wide, and designed to be rack-mounted.
(32) The server system in one embodiment is geographically distributed over a wide area, with many interfaces to internet traffic and multiple storage devices. One or more of the multiple storage devices are configured to contain redundant information
(33) System Architecture
(34) The overall architecture of the present system involves one or more servers for storing, marketing, and selling songs created by a user. In one embodiment, there is a series of social media servers for marketing the songs, operating one or more of the back end processing for Facebook, Twitter, Instagram, Snapchat, Wechat, Whatsapp, or other applications. Another one or more servers handle the upload of songs from users and the storage of the songs on the server. A third series of servers incorporate the backend of an electronic store front,
(35) Each of these servers serve client applications running on smartphones or other computing devices. The clients interact with the servers over the internet.
(36) Looking to
(37) Once the song is selected 203, the musician records 204 his voice or instrument in accompaniment to the selected song. The musician starts by causing the recorded song to start playing on the smartphone speakers 115, and then sings into the smartphone microphone 117. In another embodiment, the musician could use headphones 116 to hear the song. In another embodiment, the musician could use an external microphone, perhaps connected through USB or Bluetooth.
(38) When the recording is completed, the musician finishes the song 205 by hitting a button on the screen 118 of the smartphone. By finishing the song, the recording and the pre-recorded song undergo a series of processing steps in the central processor 101 of the smartphone. The processing steps include auto tuning, delay, reverb, compression, equalization, and audio quantization. These steps convert the combined recording into a radio quality musical piece. The musician then selects a twenty second snippet of the musical piece to use for marketing.
(39) Both the musical piece and the marketing snippet are then uploaded from the smartphone to the musical upload server. The uploading could be done through the smartphone Bluetooth or WLAN modules 113 or through the cellular connection 102, 103 to the internet to the servers. The musician then has the choice of one or more of steps to market and sell the musical piece.
(40) The first option is to sell the song 206. The musical piece and the marketing snippet is moved to the sales server and offered to the public for purchase 207. In one embodiment, the marketing snippet is sent via social media to the musician's friends and followers. In another embodiment, the musical piece is sold on a web storefront as an mp3 recording, with a portion of the revenue going to the artist, and the other portion going to the storefront operator.
(41) A second option is to enter the musical piece into a competition 210. The musician uploads the entire musical piece or a snippet to the competition server. Various judges or audience members on the Internet listen to the musical piece, and judge it against other musicians who have similarly uploaded music to the competition.
(42) The third option is to create a musicians web page through the entry of a profile 220. The musician enters 221 his biography, list of friends and followers, custom skins, design, links to the musician's blog, links to twitter feeds, pictures, other songs, links to competitions, dates of the musician's shows and performances, and perhaps a Patreon link for collecting donations.
(43) Patreon allows fans pay to enter a video chat room, and watch a user perform music live. There's a fee to enter the video chat room, and then there's a live video feed of the user. The fans watch him perform live, and can chat with him through live text, and the main user can read what they say and respond back. Basically like webcams but for music. The fans can also donate money to the user at any time. Like a fan can say will you play this song I really like? and the user can say for a donation of $5 and the fan can then donate $5. This will allow other users (fans) to pay to enter a live feed video/webcam room, and watch and interact with a musician's live performance.
(44) The forth option is the creation of a video 230. The user creates a video similar to the Musical.ly app, in combination with the musical piece 231. Filters, lenses and video effects such as those found on Snapchat and Musical.ly are added, and the processing by the CPU 101 synchronizes the video with the musical piece. To create a video, the musician can hit the video record button on their smart phone, and the musical piece will play, and they can record a video of them performing/lip syncing to the song. This music video option will allow for editing, filters to be added, video effects to be added. The app Musical.ly currently does this where users can create their own music videos with many cool filters and effects features, but they're only able to do it lip syncing to cover songs, like a Taylor Swift song. Through the current app, the musician would be making original music videos, to their original songs. They can then enter the competition section with their music video, and compete with the music video.
(45) The musician can then enter the video into a competition 232 similar to the competition described in 210. Or the musician can sell the video 233 as in steps 206 and 207.
(46)
(47) One option shows links to the profiles of other users 302. This option could also include a search feature and/or an index list. It could also include icons highlighting recently changed profiles. If a user selects a link, the user interface displays the profile at the selected link.
(48) Another option is to create a profile for the user. This option creates a web page for the user through the entry of a profile 310. The steps could be the same as is
(49) The third option allows the user to enter a competition 320. This option is similar to option 210 in
(50) At the end of the competition, the user and the song that gets first, second or third based on the number of votes could get special emoticons, perhaps a gold, silver, and bronze unicorn emoticon. Additional prizes could be awarded for those who receive the top vote counts for the year.
(51) In another embodiment, users can call out other users for a live stream singing or rap battle. One competitor could call out another competitor to do a live feed singing battle. If both users agree, they'll enter a split screen live video room. Users/fans can watch a live feed of the two competitors competing against each other. The fans can interact with them live through text chatting, and at the end of a certain time limit, the users/fans vote to see who they liked most. The winner will then bump ahead of their competitor if their competitor was in front of them in the competition. The performance could be recorded and stored for future voting.
(52) The final option is to view competitions 330. In this option, the user is presented with a list of open competitions. This may be in the form of an index listing the competitions, or may allow search through the competitions. The index may be sorted by musical categories, sorted by video or audio, or sorted by the closeness of friends. Icons could be presented on the user interface for popular competitions, or for recently started competitions. In a competition, the user listens, or views, to one or more entries in the competition, and ranks the songs.
(53) Voting could be done using a number of voting algorithms. In one algorithm, each user has one vote per competition, and the musician that receives the most votes wins. In another embodiment, the user ranks the top three (or any other number) of musical pieces with one, two, three, etc. The votes are then counted with the first rating having a higher weight than the second ratings, etc.
(54) In another system, the users vote is weighted higher if he has listened to more musical pieces. For instance, if there are ten songs in the competition, a user who listens to only one song gets one tenth vote, whereas a user who has listened to all ten songs gets a full vote. In another embodiment, the user can only vote if he listens to all songs.
(55) Users could also obtain a weighted voting status based on the number of competitions that they have judged, or based on the resume, or based on how many songs they have uploaded to the site. In another embodiment, users who have purchased songs from the site are given a high weight in their votes.
(56) Voting could also involve run-off competitions amongst the top candidates. Voting could continue until a set number of votes are received or for a fixed amount of time. Voters could be required to pay a fee to vote and could vote an unlimited number of times, or could be restricted to voting once.
(57)
(58) When purchasing songs 402, the user searches through list of available songs for the song and musician, and selects the song for purchase. The song is then delivered to the user as an MP3 file. In some embodiments the song link is first placed in a virtual shopping cart for combination with other items for purchase. In another embodiment the song is purchased directly. The user may setup a method for payment to automatically use, or the site may require a credit card (or other form of payment) for each purchase. On purchase, the money collected goes to the site operator where a portion may be distributed to the musician (or multiple musicians) and or the song writer. Payment may be direct deposited into the musician's (or songwriter's) account.
(59) If the user desires to purchase merchandise 410, the virtual storefront will allow the selection of t-shirts, hoodies, pants, shorts, hats, bracelets, necklaces, posters, and other related items. In addition, audio equipment such as microphones and headphones could be sold in the store. This goes through the same process as in 402, 403, but will also require the user to specify how and where to ship the items 411.
(60) In addition, the merchandise storefront may include facilities for creating custom merchandise based on logo, artwork, or text for specific musicians. For instance, a specific musician could include a logo or artwork on his profile. A fan could then order a hat with that logo custom embroidered on the hat based on the selection of a certain style and color of the hat, with the designation of the placement of the logo on the hat.
(61) The storefront may also be used to order workshops for musicians to improve their skills 420. In ordering a workshop, the user selects the locations, Chicago 421a of Los Angeles 421b. Then the user selects the date and subject of the workshop, and either pays for the workshop or applies for a scholarship 422. Given the user's profile, the user may be entitled to a scholarship 423. Scholarship selection may be based on musical ability shown in musical pieces submitted on the website, or on the amount of activity on the site, or other criteria.
(62) User Interface
(63) The user interface is comprised of a number of screens, some of which are described in the figures and the text below.
(64)
(65)
(66) If the user chooses to record music, the user is taken to a selection list to choose a song, as seen in
(67) The user can then prepare to record the song, as seen in
(68) Once the musician has learned the song, it is time to record, as seen in
(69) As shown in
(70) A separate screen may be available to adjust the settings for each of these functions, so that the musician can fine tune the processing of the musical piece. This could all be done based on the Finish button, or it could be a separate screen. In one embodiment, the musician adjusts a single parameter that adjusts the overall fidelity of the recording to the written musical score. At maximum fidelity, the musical piece will be exact, succinct, and precise. At the other end of the spectrum, the fidelity will be sloppy and expressive of the musician without the electronic manipulations. This fidelity adjustment could be set for the entire musical piece, of could be set for segments of the song.
(71) Using the information from the written music score that was used by the musician during the recording, the app will extract parameters for use by the various processing algorithms. Each component of the super plug in (each individual plug-in) will be pre-set per song from these parameters. In addition, the pre-recorded instrument tracks will contain information used in the processing of those tracks that can be used to coordinate the processing and mixing of the combined musical piece. Using this information, combined with the musician's fidelity parameter, specific parameters are set for each algorithm. For example:
(72) auto-tune: if the song is in C Major, the auto-tune's parameters will be preset so that the notes of all recorded vocals will be placed in the scale of C Major. In one embodiment, the auto-tune and audio quantization parameters can be combined in that the notes are placed on the same grid: the up and down lateral movement being the pitches of the melody, the left and right horizontal movement being the rhythm of the melody.
(73) audio quantization: if the song's tempo is bpm 100, the notes of all rhythms recorded will be placed in the tempo of 100 bpm, and all fractions of that tempo. For example: quarter notes will equal 100 bpms, eighth notes will equal 1,000 bpms, sixteenth notes will equal 10,000 bpms. It will all be placed on the quarter note grid for 100 bpm.
(74) EQ: if the singer is a male, his EQ will be preset so the low end will largely be taken out, and the high end will slightly be boosted. This is a standard preset for male vocals. Females will have standard preset EQ also. See
(75) reverb/delay: The reverb/delay plugin will be preset based on the tempo of the song. So, if the tempo of the song is 100 bpm, the timing of the delay will be based on 100 bpm. If the song's mix indicates that the vocals should have a delay set to quarter notes, with a long decay, then the reverb/delay plug-in will be preset for that song to always be bpm 100 quarter notes, with a long decay.
(76) compression: The compression plugin will be preset so the attack, threshold, gain, and release settings will all be preset based on what is needed per song. See
(77) The next screen, described in
(78) The musician now has the option of selling the song, competing with the song in a musical competition, making a video, competing with the musical video, or shopping for various items.
(79) If the musician decides to sell the musical piece, then, as seen in
(80) The foregoing devices and operations, including their implementation, will be familiar to, and understood by, those having ordinary skill in the art.
(81) The above description of the embodiments, alternative embodiments, and specific examples, are given by way of illustration and should not be viewed as limiting. Further, many changes and modifications within the scope of the present embodiments may be made without departing from the spirit thereof, and the present invention includes such changes and modifications.