A cloud server (104) receives environmental information of respective installation sites of a plurality of appliances (101a, 101b, 101c, 102a, 102b) via a network (1000), and determines one or more appliances that are installed in a same room among the plurality of appliances (101a, 101b, 101c, 102a, 102b), based on the received environmental information.

Finger-tracking systems and methods for virtual instruments playback. The described system tracks the position of user's ten fingers on a projection surface and can be used to play virtual instruments such as virtual piano, drums, and bells. The system tracks the movement of user's ten fingers while keeping them free of encumbrance or excessive postural constraints. More specifically, in one or more embodiments, a coded light based projector is used to send out location signal onto a flat surface, and ten light sensors are mounted on user's fingers to receive these signals and locate user's fingers. Based on their locations and relative distance to a fixed point, a printed music instrument can be used for virtual instrument music playback. With the described tracking system, various embodiments of virtual music instruments may be implemented, including a system and method for virtual piano playing as well as virtual Chinese bell playing on printed keyboard and printed Chinese bell set.

Finger-tracking systems and methods for virtual instruments playback. The described system tracks the position of user's ten fingers on a projection surface and can be used to play virtual instruments such as virtual piano, drums, and bells. The system tracks the movement of user's ten fingers while keeping them free of encumbrance or excessive postural constraints. More specifically, in one or more embodiments, a coded light based projector is used to send out location signal onto a flat surface, and ten light sensors are mounted on user's fingers to receive these signals and locate user's fingers. Based on their locations and relative distance to a fixed point, a printed music instrument can be used for virtual instrument music playback. With the described tracking system, various embodiments of virtual music instruments may be implemented, including a system and method for virtual piano playing as well as virtual Chinese bell playing on printed keyboard and printed Chinese bell set.

Methods and apparatus to use predicted actions in VR environments are disclosed. An example method includes predicting a predicted time of a predicted virtual contact of a virtual reality controller with a virtual musical instrument, determining, based on at least one parameter of the predicted virtual contact, a characteristic of a virtual sound the musical instrument would make in response to the virtual contact, and initiating producing the sound before the predicted time of the virtual contact of the controller with the musical instrument.

Methods and apparatus to use predicted actions in VR environments are disclosed. An example method includes predicting a predicted time of a predicted virtual contact of a virtual reality controller with a virtual musical instrument, determining, based on at least one parameter of the predicted virtual contact, a characteristic of a virtual sound the musical instrument would make in response to the virtual contact, and initiating producing the sound before the predicted time of the virtual contact of the controller with the musical instrument.

A method in accord with certain implementations involves, at a data interface of a musical instrument effects processor, receiving an extracted characteristic of an audible sound that is captured at a microphone; transferring the extracted characteristic to a digital signal processor residing in the musical instrument effects processor; receiving input signals at an input to the musical instrument effects processor; at the digital signal processor of the musical instrument effects processor, modifying the received input signals using the extracted characteristics to create the electronic audio effect; and outputting the modified input signals as an output signal from the musical instrument effects processor. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

A method in accord with certain implementations involves, at a data interface of a musical instrument effects processor, receiving an extracted characteristic of an audible sound that is captured at a microphone; transferring the extracted characteristic to a digital signal processor residing in the musical instrument effects processor; receiving input signals at an input to the musical instrument effects processor; at the digital signal processor of the musical instrument effects processor, modifying the received input signals using the extracted characteristics to create the electronic audio effect; and outputting the modified input signals as an output signal from the musical instrument effects processor. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

A handheld musical instrument for generating percussion sounds, the handheld musical instrument includes a body part with one or more sensors, a set of control buttons to select a type of audio output to be generated by said handheld musical instrument, and a handle part coupled to said body part, the handle part including the set of control buttons and operable between a first position and a second position.

A handheld musical instrument for generating percussion sounds, the handheld musical instrument includes a body part with one or more sensors, a set of control buttons to select a type of audio output to be generated by said handheld musical instrument, and a handle part coupled to said body part, the handle part including the set of control buttons and operable between a first position and a second position.

A handheld musical instrument for playing a variety of audio program, the handheld musical instrument includes a main body portion with one or more sensors, a handle portion engaged with said main body portion, wherein said handle portion includes one or more control buttons to select a type of program to be played by said handheld musical instrument and a gesture detection module for detecting gestures associated with said handheld musical instrument and controlling a tempo associated with said program played by said handheld musical instrument based on said detected gestures.