G10H1/368

SIGNAL PROCESSING APPARATUS, SIGNAL PROCESSING METHOD, AND PROGRAM
20230413001 · 2023-12-21 ·

The present technology relates to a signal processing apparatus, a signal processing method, and a program each enabling reproduction of images and sounds in a synchronized manner. A signal processing apparatus includes a reproduction control unit configured to control, on the basis of image data of an image associated with a sound based on multichannel audio data, reproduction of the image, and a synchronization signal generation unit configured to generate a synchronization signal for reproducing the sound synchronized with the image on the basis of the multichannel audio data, on the basis of audio data for reproducing the sound, the audio data being smaller in number of channels than the multichannel audio data. The present technology is applicable to an omnidirectional contents reproduction system.

Musical notation, system, and methods
10922993 · 2021-02-16 · ·

In one aspect, provided herein is a device for notating a musical composition. The device, in various implementations, is structured so as to be less laborious to notate, easier to read, and more simple to employ in notating, reading, and/or playing the music of a given composition to be composed and/or played. Accordingly, in its most basic form, the device herein disclosed includes a template, upon which template one or more symbols may be notated, where such notation is configured in a manner that more closely relates the note to be played with the mechanical action needed to be performed so as to play that note, such as on an instrument to be or being played.

System and method for providing a video with lyrics overlay for use in a social messaging environment
10930257 · 2021-02-23 · ·

In accordance with an embodiment, described herein is a system and method for providing a live lyrics overlay in a social messaging environment. The system can utilize advances in three-dimensional mapping technology that allow social messaging services, to offer real time video lenses or overlays to their users, and extends this three-dimensional mapping technology to support for lyrics. During creation of a video with lyrics lens overlay, the lyrics corresponding to a selected song are retrieved from a lyrics source, and are displayed within the video. For example, with the lyrics lens, a user can record an image of themselves on live video, singing along to a song clip, with the lyrics of the song displayed as if they appear to be coming from their mouths. The created live lyrics content can also be shared with other users of a social messaging environment.

Systems and methods for transferring musical drum samples from slow memory to fast memory
10923088 · 2021-02-16 · ·

An electronic-drum module for connection to one or more electronic-drum pads is provided. The module includes an electronic display; a first memory storing audio files for playback when the playback is triggered by a signal received from a pad; and one or more processors coupled to the display and the memory. The processors are configured receive an instruction to transfer a set of samples. The set of samples is associated with a priority-instruction and includes a first subset of samples and a second subset of samples. The processors are also configures to transfer the first subset of samples from a second memory to the first memory based on the priority-instruction before transferring the second subset of samples and to transfer the second subset of samples from the second memory to the first memory.

Network-based processing and distribution of multimedia content of a live musical performance

Methods, systems, and computer program products for network-based processing and distribution of multimedia content of a live performance are disclosed. In some implementations, recording devices can be configured to record a multimedia event (e.g., a musical performance). The recording devices can provide the recordings to a server while the event is ongoing. The server automatically synchronizes, mixes and masters the recordings. The server performs the automatic mixing and mastering using reference audio data previously captured during a rehearsal. The server streams the mastered recording to multiple end users through the Internet or other public or private network. The streaming can be live streaming.

Non-linear media segment capture and edit platform

User interface techniques provide user vocalists with mechanisms for forward and backward traversal of audiovisual content, including pitch cues, waveform- or envelope-type performance timelines, lyrics and/or other temporally-synchronized content at record-time, during edits, and/or in playback. Recapture of selected performance portions, coordination of group parts, and overdubbing may all be facilitated. Direct scrolling to arbitrary points in the performance timeline, lyrics, pitch cues and other temporally-synchronized content allows user to conveniently move through a capture or audiovisual edit session. In some cases, a user vocalist may be guided through the performance timeline, lyrics, pitch cues and other temporally-synchronized content in correspondence with group part information such as in a guided short-form capture for a duet. A scrubber allows user vocalists to conveniently move forward and backward through the temporally-synchronized content.

Role simulation method and terminal apparatus in VR scene

A role simulation method and a terminal apparatus in a VR scene are provided. The role simulation method in the VR scene includes: obtaining a role obtaining instruction triggered by a hand model in the VR scene, movement of the hand model in the VR scene being controlled by an interaction controller; determining a virtual role from the VR scene according to the role obtaining instruction; dynamically adjusting virtual props in the VR scene according to a music file played in the VR scene; displaying the virtual role in the VR scene through a VR display, and displaying the virtual props that are dynamically adjusted.

System, Method and Apparatus for Directing a Presentation of a Musical Score using Artificial Intelligence
20210082381 · 2021-03-18 ·

Aspects of the subject disclosure may include, for example, receiving content in the form of musical score sheets or other data that includes instructions to play notes on a particular instrument, guidance that is enabled with respect to the content, obtaining new input such as musical scores or other instructions responsive to determining that the guidance is enabled, and obtaining the guidance with respect to a display of the content, where the obtained guidance is based on the input. The instructions may include the end user take certain action in playing the instrument or physical action in a marching band context. Artificial intelligence may be used to issue new documents, instructions or guidance. A GPS and drone communications system is also disclosed. Other embodiments are disclosed.

SINGING SCORING METHOD AND SINGING SCORING SYSTEM BASED ON STREAMING MEDIA
20210090541 · 2021-03-25 ·

A singing scoring method and a singing scoring system based on streaming media are provided. In the singing scoring method and the singing scoring system, a first time difference between a moment at which a streaming video player starts to play a song and a moment at which an electronic device starts an audio recording program and a scoring engine is calculated. In addition, in the singing scoring method and the singing scoring system, a playing time difference of the streaming video player within every fixed period of a system time of the electronic device is continuously calculated, and the playing time difference is transferred to the scoring engine for accumulation to form a second time difference. The scoring engine then adjusts a singing time of each note in an entire musical score according to the first time difference and the second time difference.

Method and System for Pairing Visual Content with Audio Content
20210082382 · 2021-03-18 ·

Methods and systems are disclosed herein that provide an automatic song visualization and discovery service with automatic search for content to be paired and/or synchronized with playing of the song. In an example embodiment, while audio content such as a song plays (through user device or other player), the matching service can automatically identify information about the song (e.g., identifying the song by title and artist), transfer the song identification data to a content matching database, and then automatically return to the user a relevant item of additional content for pairing and/or synchronization with the song. As examples, such additional content could take the form of a video, an image (e.g., an album art cover), standard or karaoke-style lyrics, DJ-like lighting, a hologram, and the like (or any combination thereof).