Piano systems and methods for the enhanced display of the hands of a pianist
10332490 ยท 2019-06-25
Inventors
Cpc classification
G10H2220/005
PHYSICS
G10H2220/455
PHYSICS
International classification
Abstract
In one embodiment, a method for the enhanced display of the hands of a pianist playing a piano is disclosed, including: (a) recording at least one video stream of at least one hand of a pianist playing a piano; and (b) while the pianist is playing the piano, using at least a portion of the piano as a display for displaying the video stream.
Claims
1. A method for the enhanced display of the hands of a pianist playing a piano having a keyboard and a lid with an underside, the lid having at least an open position and a closed position, the method comprising: (a) providing an imaging device in a position that is both above and to a side of the keyboard, such that the imaging device has a perspective view comprising the keyboard and at least one hand of the pianist, wherein closer keys appear larger than farther keys; (b) recording, using the imaging device, at least one video stream comprising at least a portion of the perspective view; and (c) while the pianist is playing the piano, at least one of: (i) using at least a portion of the underside of the lid of the piano as a display for displaying the video stream; (ii) using at least a portion of the lid as a support structure for a display for displaying the video stream; and (iii) displaying at least a portion of the video stream within the space defined by the body and lid of the piano, when the lid is in the open position, wherein either: (1) the keyboard displayed on the display has a trapezoidal shape, and the display's shape conforms to keyboard's trapezoidal shape, such that the display is not rectangular, and the display's shape is trapezoidal, five-sided, six-sided, or curved, such that the displayed trapezoidal keyboard fits within the display, or (2) the display's shape comprises a curve conforming to a curve of the piano lid, such that the display is not rectangular.
2. The method of claim 1, wherein step (d) comprises using a projector to project the video stream on a surface of the underside of the piano lid.
3. The method of claim 2, wherein the display comprises a screen, and the method further comprises: (e) affixing the screen to the underside of the piano lid to provide a background surface.
4. The method of claim 2, wherein the imaging device is a video camera integrated as a unit into the projector.
5. The method of claim 4, wherein step (c) comprises affixing the screen to the ribs of the piano lid.
6. The method of claim 1, wherein step (b) further comprises operating projector bulb and fan components outside the piano body while operating a projector head inside the piano body.
7. The method of claim 1, wherein the piano lid comprises a flat panel display, and step (b) comprises displaying the video stream on the flat panel display.
8. The method of claim 1, further comprising propping open the piano lid using an extension rod longer than the lid-support rod included as part of the piano, wherein when the pianist uses the lid-support rod, the piano lid is at a first angle, and when the pianist uses the extension rod, the piano lid is at a second angle greater than the first angle, such that the projected video stream is less distorted when the extension rod is used than when the lid-support rod is used to prop up the piano lid.
9. The method of claim 1, wherein step (b) comprises displaying the video stream as a three-dimensional video stream.
10. The method of claim 1, wherein: the keyboard displayed on the display has an trapezoidal shape, and the display's shape conforms to keyboard's trapezoidal shape, such that the display is not rectangular.
11. The method of claim 10, wherein the display's shape is trapezoidal, five-sided, six-sided, or curved, such that the displayed trapezoidal keyboard fits within the display.
12. The method of claim 1, wherein the display's shape comprises a curve conforming to a curve of the piano lid, such that the display is not rectangular.
13. The method of claim 1, further comprising the steps of: (d) providing at least one portable stand, (e) affixing the display to the underside of the piano lid and mounting the imaging device and a projector on the at least one portable stand before a performance; (f) removing the imaging device and the projector from the at least one portable stand and removing the display from the underside of the piano lid after the performance; and (g) transporting the imaging device, the projector, and the display to another performance.
14. The method of claim 8, wherein the extension rod is portable and removable, and not permanently attached on the piano.
15. A method for the enhanced display of the hands of a pianist playing a piano, the method comprising: (a) recording, using an imaging device, at least one video stream of at least one hand of a pianist playing a piano, the piano having a lid with an underside, the lid having at least an open position and a closed position; and (b) while the pianist is playing the piano, at least one of: (i) using at least a portion of the underside of the lid of the piano as a display for displaying the video stream; (ii) using at least a portion of the lid as a support structure for a display for displaying the video stream; and (iii) displaying at least a portion of the video stream within the space defined by the body and lid of the piano, when the lid is in the open position, and (c) affixing a screen to the underside of the piano lid to provide a background surface for projection, wherein step (c) comprises applying a sheet of material that clings to at least a portion of the underside of the piano lid.
16. A system for the enhanced display of the hands of a pianist playing a piano having a keyboard and a lid with an underside, the lid having at least an open position and a closed position, the system comprising: (a) an imaging device in a position that is both above and to the side of the keyboard, such that the imaging device has a perspective view comprising the keyboard and at least one hand of the pianist, wherein closer keys appear larger than farther keys; (b) a video recorder configured to record at least one video stream comprising at least a portion of the perspective view; and (c) a display configured to display the video stream while the pianist is playing the piano, wherein at least one of: (i) at least a portion of the underside of the lid of the piano is configured to serve as the display; (ii) at least a portion of the lid of the piano is configured to serve as a support structure for the display; and (iii) the display is configured to display at least a portion of the video stream within the space defined by the body and lid of the piano, when the lid is in the open position, wherein either: (1) the keyboard displayed on the display has a trapezoidal shape, and the display's shape conforms to keyboard's trapezoidal shape, such that the display is not rectangular, and the display's shape is trapezoidal, five-sided, six-sided, or curved, such that the displayed trapezoidal keyboard fits within the display, or (2) the display's shape comprises a curve conforming to a curve of the piano lid, such that the display is not rectangular.
17. The system of claim 16, wherein the display comprises a projector configured to project the video stream on a surface of a the underside of the lid of the piano.
18. The system of claim 16, wherein the display comprises a screen affixed to the underside of the lid of the piano to provide a background surface.
19. The system of claim 17, wherein the video recorder and the projector are integrated as a unit.
20. The system of claim 19, wherein the screen is affixed to the ribs of the lid of the piano.
21. The system of claim 16, wherein the system comprises bulb and fan components operating outside the piano body and a projector head operating inside the piano body.
22. The system of claim 16, wherein the lid of the piano comprises a flat panel display for displaying the video stream.
23. The system of claim 16, further comprising an extension rod longer than the lid-support rod included as part of the piano, used to prop open the piano lid, wherein when the pianist uses the lid-support rod, the piano lid is at a first angle, and when the pianist uses the extension rod, the piano lid is at a second angle greater than the first angle, such that the projected video stream is less distorted when the extension rod is used than when the lid-support rod is used to prop up the piano lid.
24. The system of claim 16, wherein the display is a three-dimensional video display for displaying the video stream as a three-dimensional image.
25. A system for the enhanced display of the hands of a pianist playing a piano having a keyboard, the system comprising: (a) an imaging device in a position that is both above and to the side of the keyboard, such that the imaging device has a perspective view comprising the keyboard and at least one hand of the pianist, wherein closer keys appear larger than farther keys; (b) a video recorder configured to record at least one video stream comprising at least a portion of the perspective view, the lid having at least an open position and a closed position; and (c) a display configured to display the video stream while the pianist is playing the piano, wherein at least one of: (i) at least a portion of the underside of the lid of the piano is configured to serve as the display; (ii) at least a portion of the lid of the piano is configured to serve as a support structure for the display; and (iii) the display is configured to display at least a portion of the video stream within the space defined by the body and lid of the piano, when the lid is in the open position, wherein the display comprises a screen affixed to the underside of the lid of the piano to provide a background surface for projection, and wherein the screen is a sheet of material applied that clings to at least a portion of the underside of the piano lid.
26. Apparatus for the enhanced display of the hands of a pianist playing a piano having a keyboard and a lid with an underside, the lid having at least an open position and a closed position, the apparatus comprising: (a) an imaging device in a position that is both above and to the side of the keyboard, such that the imaging device has a perspective view comprising the keyboard and at least one hand of the pianist, wherein closer keys appear larger than farther keys; (b) a video recorder configured to record at least one video stream comprising the perspective view; and (c) a projector configured to display the video stream while the pianist is playing the piano, wherein at least one of: (i) the video stream is displayed on at least a portion of the underside of the piano lid; (ii) the video stream is displayed on an element coupled to the piano lid; and (iii) at least a portion of the video stream is displayed within the space defined by the body and lid of the piano, when the lid is in the open position while the pianist is playing the piano, wherein either: (1) the keyboard displayed on the display has a trapezoidal shape, and the display's shape conforms to keyboard's trapezoidal shape, such that the display is not rectangular, and the display's shape is trapezoidal, five-sided, six-sided, or curved, such that the displayed trapezoidal keyboard fits within the display, or (2) the display's shape comprises a curve conforming to a curve of the piano lid, such that the display is not rectangular.
27. A method for the enhanced display of the hands of a pianist playing a piano, the method comprising: (a) recording, using an imaging device, at least one video stream of at least one hand of a pianist playing a piano, the piano having a lid with an underside, the lid having at least an open position and a closed position; and (b) while the pianist is playing the piano, at least one of: (i) using at least a portion of the underside of the lid of the piano as a display for displaying the video stream; (ii) using at least a portion of the lid as a support structure for a display for displaying the video stream; and (iii) displaying at least a portion of the video stream within the space defined by the body and lid of the piano, when the lid is in the open position, using a projector to project the video stream on a surface of the underside of the piano lid; and (c) providing a sheet of material over at least a portion of the underside of the piano lid, the sheet forming at least a portion of the display, upon which sheet the video stream is projected.
28. The method of claim 27, further comprising: (c) affixing a screen to the underside of the piano lid to provide a background surface for projection.
29. The method of claim 27, further comprising: (d) propping open the piano lid using an extension rod longer than the lid-support rod included as part of the piano, wherein when the pianist uses the lid-support rod, the piano lid is at a first angle, and when the pianist uses the extension rod, the piano lid is at a second angle greater than the first angle, such that the projected video stream is less distorted when the extension rod is used than when the lid-support rod is used to prop up the piano lid.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
DETAILED DESCRIPTION
(15)
(16) As shown, video camera 110 is aimed at the keyboard (not visible in the drawing) of piano 199. Video camera 110, which is supported, e.g., by a tripod, is adapted to provide to projector 120, via video-input feed 115, a continuous real-time video stream depicting the keyboard of piano 199. Projector 120, which is supported, e.g., by a tripod, has an output image that is aimed at the underside of the open lid 189 of piano 199.
(17) Screen 130 is affixed to the underside of lid 189 and provides a white background surface for the output image of projector 120.
(18) Extension rod 140 is a rod longer than the pivoting lid-support rod included as part of piano 199 and is desirably used in lieu thereof, to prop open the lid 189 of piano 199 and increase the opening angle beyond the angle intended by the piano manufacturer. This provides several advantages, including a larger viewing surface for the audience and a viewing surface that faces the audience more directly, on the underside of lid 189. Additionally, because of the short distance from projector 120 to piano lid 189, the distance from projector 120 to the bottom of the image is much greater than the distance from projector 120 to the top of the image, which causes the bottom of the image to be relatively larger than the top of the image and creates a keystone effect. Raising the lid with extension rod 140 evens out these distances and reduces the keystone effect.
(19) Accordingly, in system 100, while the pianist plays, his or her hands are displayed to the audience on screen 130. Audience members can thus see, in a single view, and without having to turn their heads back and forth, (i) the pianist, (ii) piano 199, and (iii) an enlarged view of the pianist's hands on screen 130.
(20) As shown in
(21)
(22)
(23)
(24)
(25)
(26)
(27)
(28)
(29)
(30)
(31)
(32)
Alternative Embodiments
(33) In alternative embodiments, the video camera may be situated differently and is desirably positioned so as to prevent obscuring the audience's direct view of the pianist and/or piano. For example, the camera may be anchored at one end of the piano keyboard and mechanically suspended above the keyboard, e.g., via a gooseneck support mechanism. Alternatively, the camera may be suspended from the ceiling, on a tripod, or attached via wires or other means. In some embodiments, multiple cameras are used to create multiple video feeds of the piano keyboard, and those multiple feeds are then processed and used to create a single video image for display to the audience. Multiple cameras may be used, e.g., for left and right cameras, as redundant cameras for stability or sharpness enhancement, to permit display-angle changes or zoom changes during performance, and the like. In one embodiment, the various angles and/or various levels of zoom are determined by a computer program that monitors and reacts to the sound waves of the piano and/or the motion of the performer's hands. For example, if the computer notices that the left fingers are moving more than the right, then the camera would zoom in on that hand.
(34) The projector may be disposed on a stand separate from and outside of the piano body, immediately in front of the piano. The projector may also be disposed within the piano body, such as atop an unoccupied region of the metal plate, or in another location that reduces or eliminates the ability of the audience to see the projector while in use. A shelf may be temporarily mounted to the rim or case to hold the projector at a suitable distance from the lid as a projection surface. Alternatively, the projector may be disposed elsewhere, such as suspended from the ceiling or affixed to another surface or component of the piano. In embodiments where the projector is disposed within the piano body, an ultra-short-throw projector can be used, so that the image is magnified substantially at a very short distance, and it is desirable that the projector emit little or no heat that could cause damage to a piano. The connection between the camera and the projector can be wired or wireless.
(35) The screen can be made from a variety of materials and be held onto the underside of the piano lid using a variety of means. In one embodiment, the screen is a relatively thin plastic sheet held on by static cling. In another embodiment, the screen is a plastic sheet that is slightly sticky on one side but not sticky enough to leave a residue on the lid once removed. In another embodiment, the screen is made of cloth that is stretched tight and held on using one or more clips or other fasteners. In another embodiment, the screen is made from whiteboard material. In another embodiment, the screen is a dark gray high-contrast projection screen. Instead of being removable, in some embodiments, the screen is permanently affixed to or integrated into the lid, such as by the piano manufacturer. In this scenario, piano manufacturers could sell pianos that include a system consistent with embodiments of the invention, including an integrated high-contrast projection screen, projector integrated into or attached to the piano, and attached or integrated video camera.
(36) In one embodiment, instead of using a projector and screen, a display panel, such as an LCD, organic or inorganic LED, or plasma display, affixed to or integrated into a portion of the piano itself, is used to display the pianist's hands. The display panel could be rectangular or could alternatively be custom-shaped to conform to the shape of the lid, thereby maximizing usage of the area on the piano lid for display and providing possible alternatives for horizontal, vertical, and diagonal display of the keyboard.
(37) It should be recognized that parts of the piano other than the open lid could alternatively be used as a display. For example, the top of some upright pianos could be used as a display or attachment surface for a display. Alternatively, the side of a grand piano could be used as a display or attachment surface for a display.
(38) Other real-time images could also be shown on the underside of the lid, such as a view of the printed music, other currently playing musicians, images of the pianist's use of the pedals, and the like. Multiple surfaces of the piano could be used concurrently to display the same view, to increase the number of locations from which the performer's hands can be seen. Alternatively, multiple surfaces of the piano could be used concurrently to display different views.
(39) In some alternative embodiments, instead of recording and displaying a two-dimensional image of the pianist's hands, a three-dimensional (e.g., holographic) image of the hands of the pianist is displayed, e.g., directly in front of the piano lid. In one such exemplary embodiment, a screen fabricated from a photorefractive material capable of refreshing holograms in near-real time can be used with an array of regular cameras, each of which views the pianist's hands from a different perspective. The information from those cameras is encoded onto a fast-pulsed laser beam that interferes with another beam that serves as a reference, and the resulting interference pattern is written into the photorefractive polymer, creating and storing the image. Each laser pulse records an individual holographic, three-dimensional pixel in the polymer. The hologram fades away or can be erased by recording a new image, creating a new diffraction structure, and deleting the old pattern. The use of such an arrangement, or another three-dimensional display arrangement, results in the piano becoming a container for the display of the pianist's hands, such that an enlarged, three-dimensional image of the pianist's hands appears to be contained and showcased within or near the space defined by the body and lid of the piano.
(40) Tripods for the video camera and/or projector may be used that hide wires within the pole of the tripod (i.e., so that wires enter and exit at only the top and bottom of the tripods), to reduce visual clutter from excess wiring.
(41) It should be recognized that devices consistent with embodiments of the present invention may also have utility with instruments other than pianos, including organs, electric pianos, marimbas, and other instruments having surfaces suitable for the display of an enhanced view of one or more portions of a person playing the instrument.
(42) Reference herein to one embodiment or an embodiment means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in one embodiment in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments necessarily mutually exclusive of other embodiments.
(43) Although the invention has been set forth in terms of the exemplary embodiments described herein and illustrated in the attached documents, it is to be understood that such invention is purely illustrative and is not to be interpreted as limiting. Consequently, various alterations, modifications, and/or alternative embodiments and applications may be suggested to those skilled in the art after having read this disclosure. Accordingly, it is intended that the invention be interpreted as encompassing all alterations, modifications, or alternative embodiments and applications as fall within the true spirit and scope of this disclosure.
(44) It will be further understood that various changes in the details, materials, and arrangements of the parts which have been described and illustrated in order to explain the nature of this disclosure may be made by those skilled in the art without departing from the scope of the disclosure as expressed in the following claims.
(45) The embodiments covered by the claims in this application are limited to embodiments that (1) are enabled by this specification and (2) correspond to statutory subject matter. Non-enabled embodiments and embodiments that correspond to non-statutory subject matter are explicitly disclaimed even if they fall within the scope of the claims.