Abstract
A stereoscopic display system includes an image display panel, viewpoint position sensors, and a means to create first or left and second or right stereoscopic images corrected for parallax. This allows for multiple viewpoints to perceive the viewed 3D stereoscopic image as approximately fixed in space. In one embodiment, the first and second images may be perceived as a 3D stereoscopic image by applying shutter glasses. In another embodiment, the first and second images may be perceived as a 3D auto stereoscopic image by applying configurable louvers or light guiding layers. In this embodiment, the display system utilizes information from the position sensors to optimize electronically configurable louvers. This allows for large displays to be seen from multiple viewpoints. The virtual 3D stereoscopic object images, being virtually fixed in space may be interacted with by the user or users in much the same way 2D objects are manipulated by applying a touch screen. This allows for input systems such as virtual keyboards and remote controllers. The methods described may be applied in other ways, including, but not limited to gaming systems, 3D virtual caves, and simulators.
Claims
1. An auto-stereoscopic image display device comprising: at least one sensor to track positions of eyes, based on facial recognition, in relation to the stereoscopic device; a processor configured to map coordinates of a three-dimensional (3D) virtual object generated by the stereoscopic display device, wherein the 3D virtual object has a location in the physical space in front of and relative to the display device; an image display panel configured to display separate pairs of first and second stereoscopic images of the 3D virtual object displayed to the eyes for each viewer of the stereoscopic display device so that the 3D virtual object is seen by each viewer in the same physical location, wherein the first and the second stereoscopic images for each viewer are based upon viewpoint perspectives of an angle and distance of the perspective location of the eyes of each viewer as detected by the at least one sensor, adjust at least two layers of blocking electronically configurable liquid crystal material in a repeating pattern of closed geometric shapes to block light along at least two axes, wherein each of the first and the second stereoscopic images for each viewer are directed to the left and right eyes of each viewer by passing through the layers of blocking electronically configurable liquid crystal material such that a different repeating pattern of closed geometric shapes for layers of material is configured for each individual user independent of a tilt angle of said user's head, and block light from the first and the second stereoscopic images so it may not be seen outside of the corresponding viewpoint in both an X and an Y axis, wherein an Z axis is perpendicular to the stereoscopic display device, so that another viewer does not see the pairs of the first and the second stereoscopic images of the 3D virtual object when the another viewer is located above, below, left, or right of the corresponding viewpoint, wherein the 3D virtual object is viewable by a plurality of viewers, as shown by the separate first and the second stereoscopic images received at individual viewer as configured by the at least two layers of blocking electronically configurable liquid crystal material arranged in repeating patterns of closed geometric shapes, wherein a hand, a finger, or a pointer interacts of the 3D virtual object when detected near the physical location of the 3D virtual object as shown by the first and the second stereoscopic images for each viewer such that the first and the second stereoscopic images are updated for each viewer based on the interaction with the 3D virtual object and the angle and distance of the perspective locations of the eyes of the respective viewer.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) FIG. 1 is a schematic diagram illustrating prior art in which the 3D stereoscopic images virtual location moves as viewpoint shifts.
(2) FIG. 2 is a schematic diagram illustrating prior art in which the 3D virtual image is unable to be viewed stereoscopically when the viewers head is angularly tilted in relation to the display.
(3) FIG. 3 is a schematic diagram illustrating prior art 3D auto stereoscopic displays which limit viewing location.
(4) FIG. 4 is a schematic diagram illustrating an embodiment where the 3D stereoscopic image remains fixed in space as viewing location is shifted.
(5) FIG. 5 is a schematic diagram illustrating an embodiment where the 3D stereoscopic image remains fixed and viewable as the viewers head is angularly tilted in relation to the display.
(6) FIG. 6 is a schematic diagram illustrating an embodiment where the 3D stereoscopic image remains fixed in space as the viewing location is moved closer or farther from the display.
(7) FIG. 7 is a schematic diagram illustrating an embodiment where the 3D virtual object is seen from different viewpoints yet remains fixed in space.
(8) FIG. 8 is a schematic diagram illustrating an embodiment applying viewpoint sensors and shutter glasses.
(9) FIG. 9 is a schematic diagram illustrating an embodiment applying viewpoint sensors and shutter glasses.
(10) FIG. 10 is a schematic diagram illustrating an embodiment applying viewpoint sensors and shutter glasses.
(11) FIG. 11 is a schematic diagram illustrating an embodiment where images may be displayed as time progresses.
(12) FIG. 12 is a schematic diagram illustrating an embodiment applying shutter glasses and viewpoint location sensing where images may be displayed as time progresses.
(13) FIG. 13 is a schematic diagram illustrating an embodiment applying shutter glasses and viewpoint position sensing where images may be displayed as time progresses.
(14) FIG. 14 is a schematic diagram illustrating an embodiment applying shutter glasses and viewpoint position sensing where images may be displayed as time progresses.
(15) FIG. 15 is a schematic diagram illustrating prior art directional louvers and also an embodiment applying directional louvers in both horizontal and vertical directions.
(16) FIG. 16 is a schematic diagram illustrating an embodiment applying directional louvers in both horizontal and vertical directions and applying viewpoint location sensing.
(17) FIG. 17 is a schematic diagram illustrating an embodiment applying directional louvers in both horizontal and vertical directions and applying viewpoint location sensing where images may be displayed as time progresses.
(18) FIG. 18 is a schematic diagram illustrating an embodiment applying directional louvers in both horizontal and vertical directions and applying viewpoint location sensing where images may be displayed as time progresses.
(19) FIG. 19 is a schematic diagram illustrating an embodiment applying directional louvers in both horizontal and vertical directions and applying viewpoint location sensing where images may be displayed as time progresses.
(20) FIG. 20 is a schematic diagram illustrating an embodiment applying viewpoint position sensors and image generators. Either shutter glasses or electronically configurable dual axis louvers may be applied.
(21) FIG. 21 is a schematic diagram illustrating an embodiment applying louvers.
(22) FIG. 22 is a schematic diagram illustrating an embodiment applying louvers and position sensors.
(23) FIG. 23 is a schematic diagram illustrating an embodiment applying louvers and position sensors.
(24) FIG. 24 is a schematic diagram illustrating an embodiment applying louvers and position sensors.
(25) FIG. 25 is a schematic diagram illustrating an embodiment applying louvers and position sensors.
(26) FIG. 26 is a schematic diagram illustrating an embodiment applying louvers and position sensors.
(27) FIG. 27 is a schematic diagram illustrating an embodiment applying louvers and position sensors.
(28) FIG. 28 is a schematic diagram illustrating an embodiment in portrait and landscape modes applying louvers and position sensors.
(29) FIG. 29 is a schematic diagram illustrating an embodiment applying position sensors and illustrating user interaction with a virtual image.
(30) FIG. 30 is a schematic diagram illustrating an embodiment applying position sensors and illustrating user interaction with the virtual image.
(31) FIG. 31 is a schematic diagram illustrating an embodiment applying position sensors and illustrating user interaction with the virtual image.
(32) FIG. 32 is a schematic diagram illustrating an embodiment applying position sensors and illustrating user interaction with the virtual image.
(33) FIG. 33 is a schematic diagram illustrating an embodiment applying position sensors and illustrating user interaction with the virtual image.
(34) FIG. 34 is a schematic diagram illustrating an embodiment applying position sensors and illustrating a virtual cave.
(35) FIG. 35 is a schematic diagram illustrating an embodiment applying position sensors and illustrating a virtual simulator.
(36) FIG. 36 is a schematic diagram illustrating an embodiment applying position sensors and illustrating a virtual gaming system.
DETAILED DESCRIPTION OF THE INVENTION
(37) With reference now to FIG. 1 of the drawings, there is shown an illustration of prior art. A 3D stereoscopic image is presented to viewers positioned at A and B. The left or first image (item 160) as well as the right or second image (item 170) locations is fixed on the image display (item 114) for either viewing from position A or B. The result is 3D image object locations 180 and 182 which differ in space. Each tends to be more in front of the viewing position.
(38) With reference now to FIG. 2 of the drawings, there is shown an illustration of prior art. It is apparent that changing viewing angle results in less than optimal 3D image or possibly failure of 3D imaging.
(39) With reference now to FIG. 3 of the drawings, there is shown an illustration of prior art, a 3D stereoscopic device which employs current louvers to aim or guide the light from an image to the viewer's eyes. The limitation is because the louvers are fixed and not configurable based on viewing location. Therefore the viewing location is limited.
(40) With reference now to FIG. 4 of the drawings, there is shown an illustration of an embodiment of the present invention. Sensors (item 116) locate the viewpoint perspectives. These sensors may be passive receivers, or may be emissive and receptive of signals, or of other methods to determine viewpoint locations. Based on where the viewpoint perspective is sensed, an image is created corresponding to how the intended image would be seen from that viewpoint.
(41) For a viewer located at A, the first or left displayed image (item 160) is now a function of viewer perspective A. The second or right displayed image (item 170) is also now a function of viewer perspective A.
(42) For a viewer located at B, the first or left displayed image (item 162) is now a function of viewer perspective B. The second or right displayed image (item 172) is also now a function of viewer perspective B. As a result, the 3D stereoscopic object image (item 190) is now seen in approximately the same location in space from both viewpoints A and B.
(43) Due to the 3D stereoscopic images location being approximately fixed in space its position in relation to the display may be determined. This may then be compared with the sensed location of a viewer's body part, wearable object, or pointer. In this manner it will be possible for one or more users to interact with the 3D stereographic objects or images.
(44) With reference now to FIG. 5 of the drawings, there is shown an illustration of an embodiment of the present invention. Sensors (item 116) locate the viewpoint perspectives. These sensors may be passive receivers, or may be emissive and receptive of signals, or of other methods to determine viewpoint locations. Based on where the viewpoint perspective is sensed, an image is created corresponding to how the intended image would be seen from that viewpoint.
(45) For a viewer located at A, the first or left displayed image (item 160) is now a function of viewer perspective A. The second or right displayed image (item 170) is also now a function of viewer perspective A.
(46) In this illustration, the viewer located at B has his head tilted in relation to the display (item 114). For the viewer located at B, the first or left displayed image (item 162) is a function of viewer perspective B. The second or right displayed image (item 172) is also a function of viewer perspective B. As a result, the 3D stereoscopic object image (item 190) is now seen in approximately the same location in space from both viewpoints A and B. Viewer B is able to see the 3D stereoscopic image in approximately the same location in space as viewer A sees the 3D stereoscopic image, even though his head is tilted with respect to the display. Prior art is unable to produce this result.
(47) Due to the 3D stereoscopic images location being approximately fixed in space its position in relation to the display may be determined. This may then be compared with the sensed location of a viewer's body part, wearable object, or pointer. In this manner it will be possible for one or more users to interact with the 3D stereographic objects or images when one or more user's viewpoint is tilted in relation to the display.
(48) With reference now to FIG. 6 of the drawings, there is shown an illustration of an embodiment of the present invention. This illustrates the fact that in addition to viewing angle, the viewing distance also is measured in order to create the correct display image presentations (items 260 and 270). In this manner both viewpoint 1 (item 220) and 2 (item 222) are able to see the virtual object image (item 292) in approximately the same location in space. Sensors (item 116) locate the viewpoint perspectives. These sensors may be passive receivers, or may be emissive and receptive of signals, or of other methods to determine viewpoint locations. Based on where the viewpoint perspective is sensed, an image is created corresponding to how the intended image would be seen from that viewpoint.
(49) With reference now to FIG. 7 of the drawings, there is shown an illustration of an embodiment of the how an object might appear when viewed from different perspectives in the present invention.
(50) With reference now to FIG. 8 of the drawings, there is shown an illustration of an embodiment of the present invention. One or more sets of sensors (items 116 and 118) may be used to sense the location of glasses (items 106 and 108) and specifically the lenses (items 109 and 110) of the glasses using position markers (items 112 and 113) located on the glasses. These markers may emit or reflect light which is sensed by the sensors, or be of another technology. Another refinement would be such a system without need for markers to locate viewing perspectives as for example facial recognition technology.
(51) With reference now to FIG. 9 of the drawings, there is shown an illustration of an embodiment of the present invention applying shutter glasses. One or more sets of sensors (item 116) may be used to sense the location of shutter glasses (items 108 and 120) and specifically the lenses (items 109, 110, 122, and 124) of the shutter glasses using position markers (items 112 and 113) located on the shutter glasses. An object image (item 127) would be presented as different images to perspective viewing locations represented by the open shutter lenses (items 110 and 122) of items 108 and 120.
(52) With reference now to FIG. 10 of the drawings, there is shown an illustration of an embodiment of the present invention. An object image (item 128), in this case a cylinder, would be presented as different images to perspective viewing locations represented by items 108 and 120.
(53) With reference now to FIG. 11 of the drawings, there is shown an illustration of an embodiment of the present invention. This illustration shows progression through time. Item 200 shows how as viewing location is changed, the 3D stereoscopic images location remains unchanged in space. Item 240 shows how this is accomplished by enabling each prospective viewpoint to see an image created based on the viewpoints perspective as viewing location differs.
(54) With reference now to FIG. 12 of the drawings, there is shown an illustration of an embodiment of the present invention. This illustration shows progression through time. Item 200 shows how as viewing location is changed, the 3D stereoscopic images location remains unchanged in space. Item 240 shows how this is accomplished by enabling each prospective viewpoint to see an image created based on the viewpoints perspective as viewing location differs. In this illustration, item 240 shows employment of shutter glasses to accomplish this effect.
(55) With reference now to FIGS. 13 and 14 of the drawings, there is shown an illustration of an embodiment of the present invention. This illustrates a more detailed rendering of what is occurring in item 240 from FIG. 12. Images 140, 142, 144, and 146 are created based on the perspective locations sensed of the lenses (items 109, 110, 122 and 124) of the glasses (items 108 and 120) through which the image will be viewed. As the shutters open and close the image is presented with correct optical association so that a 3D image will be seen. Said 3D image is seen from various perspectives as it would be seen were the object immovable. Therefore the 3D object image appears in the same location no matter the viewing angle or distance. The viewing location is only limited by the size of the screen (item 114).
(56) With reference now to FIG. 15 of the drawings, there is shown an illustration of the prior art and also an embodiment of the present invention.
(57) In part A prior art is shown which uses louvers created by layers of liquid crystals which have a blocking function in the position of a Z shape. Since it is created of liquid crystals it may be reconfigured frame by frame to allow light to pass to the left or right eye in correct optical association with a first or second image so that a 3D stereoscopic effect is achieved without the need for glasses. The present invention improves upon this by enabling the louvers to vary position and rotational angle. Thereby a single viewer can see a 3D stereoscopic image in the same location in space as his viewing perspective changes and/or the head is tilted.
(58) In part B the present invention improves upon the concept of louvers by using them in both vertical as well as horizontal planes. However, the louvers may be configured along any combination of axis in any shape or pattern. Several shapes or patterns of louvers will be illustrated further in the description and endless varieties are possible. The result is guiding or aiming light as if through straws. The cross section of the guiding straws may be one of many shapes or patterns. The aiming or guiding viewpoint location is the location picked up by the location sensors. The louvers are created to optimize viewing at the correct perspective location. In the present invention they may be angled differently at different locations of the screen to optimize this effect. This allows the viewpoint to be in any plane or angle. In this configuration it is possible for two or more viewers to observe the intended 3D stereoscopic image in the same location in space.
(59) With reference now to FIG. 16 of the drawings, there is shown an illustration of an embodiment of the present invention. This shows how louvers may be employed to direct the correct image with optical association to the proper viewpoint as determined by sensors (item 116), so a 3D stereoscopic image is seen. Note the 3D stereoscopic object image does not change location in space as viewpoint is changed.
(60) With reference now to FIG. 17 of the drawings, there is shown an illustration of an embodiment of the present invention. This illustration shows progression through time. Item 200 shows how as viewing location is changed, the 3D stereoscopic images location remains unchanged in space. Item 240 shows how this is accomplished by enabling each prospective viewpoint to see an image created based on the viewpoints perspective as viewing location differs. In this illustration, item 240 shows employment of louvers to accomplish this effect.
(61) With reference now to FIGS. 18 and 19 of the drawings, there is shown an illustration of an embodiment of the present invention. This illustrates a more detailed drawing of what is occurring in item 240 from FIG. 17. Images 140, 142, 144, and 146 are created based on the perspective locations sensed of the eye through which the image will be viewed. As the louvers change position to guide the light from the created images to the eye with correct optical association so that a 3D image will be seen. The 3D stereoscopic object image is seen from various perspectives as it would be seen were the object immovable. Therefore the 3D object image appears in the same location no matter the viewing angle or distance. The viewing location is only limited by the size of the screen (item 114).
(62) With reference now to FIG. 20 of the drawings, a flow diagram of an embodiment the present invention is presented which shows two methods for creating 3D stereoscopic images which are seen from different perspectives while the 3D stereoscopic object is seen in the same location in space. One method employs shutters and the second method employs louvers. However this is not intended to limit the device to these two methods, and any method which produces the same results may be used.
(63) With reference now to FIG. 21 of the drawings, there is shown an illustration of an embodiment of the present invention. In this embodiment the display (item 215) has layers of two dimensional louvers placed over it. By two dimensional louvers it is meant the louvers are able to block light (or guide light) in both the horizontal and vertical directions at the same time. This is not meant to be limiting in any way. Any combination of more than one axial direction of louvers which guide the light to the correct viewpoint in coordination with the correct image and in the intended manner may be used. These louvers may be referred to as electronically configurable light guiding louvers, or louvers In this illustration, the louvers are arranged in parallel.
(64) The tubes with arrows represent the path light from the image would take. In the following illustrations, it will be shown how a variable pitch in both horizontal and vertical directions will enable light to pass to the viewing location. Thereby the image is seen only at the intended viewing location. The louvers may be of varying shapes and number of layers. They may also be made to move or change from frame to frame so as not to produce blind spots.
(65) With reference now to FIG. 22 of the drawings, there is shown an illustration of an embodiment of the present invention. Louvers (item 217) with horizontal and vertical components are shown. These shall be referred to as electronically configurable light guiding louvers, or louvers. Using input from the position sensors a computer calculates the optimum configuration of the louvers. These louvers may have variable pitch in more than one axes; thereby they are able to guide light from the image display through imaginary tubes (item 219) towards the intended viewpoint. In this case the eye at point B. It should be noted that the in this illustration the eye at point A is not at an intended viewing location and therefore sees no light from the image when it is projected or guided to viewpoint B.
(66) In this way a first or left image may be viewed by the left eye and a second or right image may be viewed by the right eye. In this way the created images may be directed with correct optical association so that a 3D stereoscopic image is seen. In addition the location from which each image is seen is limited. This permits additional viewers to also receive 3D stereoscopic images which are different from the first viewer. In the case of this invention, those images would be of the same 3D object image in the same location in space as viewed from each viewer's unique individual perspective.
(67) With reference now to FIG. 23 of the drawings, there is shown an illustration of an embodiment of the present invention. In this illustration, we see the dual louver method in time sequence from 1 to 4. In the first sequence the dual louvers direct a first image to viewpoint A. In the second sequence the dual louvers direct a second image to viewpoint B. In the third sequence the dual louvers direct a first image to viewpoint A. In the fourth sequence the dual louvers direct a second image to viewpoint B. In sequences 3 and 4 the viewer may be the same as in sequences 1 and 2 or they may be a second viewer. In each case the image viewed has been created for the particular viewpoint. In this way multiple viewers may enjoy the 3D image regardless of their viewing orientation. Furthermore, in this illustration the louver patterns in sequences 3 and 4 are slightly different than those of sequences 1 and 2. This is a technique which may be used to eliminate dark spots from occurring in the image where the same pixel would be blocked by dual louvers. By moving the louvers from frame to frame this problem can be alleviated.
(68) With reference now to FIG. 24 of the drawings, there is shown an illustration of an embodiment of the present invention. This illustrates dual louvers of various configurations. These are meant to illustrate, but not to limit configurations of dual louvers. The shape of which dual louvers may be made is virtually unlimited. Item 410 illustrates a circular pattern. Item 412 illustrates an alternating pattern. Item 414 illustrates a box pattern. Item 416 illustrates a hexagonal pattern. The size, shape, and number of layers of the dual louvers may be varied to produce the desired light guiding effect. In addition they may be moved around so as to reduce or eliminate the same pixel from being blocked by the louvers over several image presentations.
(69) With reference now to FIG. 25 of the drawings, there is shown an illustration of an embodiment of the present invention. In this illustration, the relationship between the viewpoint position sensed by the sensor (item 116) and the electronically configurable louver patterns is explained in further detail. In this illustration, the display (item 114) has cross sections expanded so that louvers from various locations of the display may be further illustrated. In this illustration, the viewpoint (item 530) is located directly in front of section 518 of the display (a location nearly centered in front of the display). So in order for the image to be seen form the viewpoint of item 530 the louvers of item 510 at the top left of the display must guide the light downward and towards the right. Likewise the louvers of item 516 of the upper right corner must guide the light from the image downwards and to the left. The louvers of item 512 must guide light upwards and to the right. The louvers of item 514 must guide the light upwards. Those of item 520 must guide the light upwards and to the left. Those located directly in front of the viewing location should guide the light mostly straight ahead.
(70) It must be noted that as viewing location changes both the perspective image must be changed, as well as the angle of the louvers at all locations across the viewing display. The viewing location is sensed and a correct image creation and sequence is produced for viewing by left and right eyes of one or more viewers, in correct optical association with the electronically configurable louvers so that a 3D stereoscopic image is seen by one or more viewers.
(71) With reference now to FIG. 26 of the drawings, there is shown an illustration of an embodiment of the present invention. This illustrates sample electronically configurable louver patterns. In these examples the vertical component of the louvers is larger than the horizontal. The taller axis may be rotated to correct for a tilted head angle of the viewer. The taller portion is intended to coincide with the vertical axis of a viewer's face. This has the advantage of allowing more light to pass through the louvers while allowing one of a pair of viewpoints to see the image while the image is blocked form the other in a pair of viewpoints. By pair of viewpoints one may consider a left and right eye. These examples are not meant to limit the shape or pattern of the louvers.
(72) With reference now to FIG. 27 of the drawings, there is shown an illustration of an embodiment of the present invention. This illustrates how electronically configurable louvers may be applied so that the intended viewing location receives the correct optical image while other viewing locations do not.
(73) In this illustration, a small portion (item 602) of the display (item 114) is expanded (item 610). In item 610 we see configurable louvers which operate in both the vertical and horizontal directions to guide the light from the display image. Item 630 shows an approximate area where the light from a first image may strike the intended side of a viewers face. Item 650 shows an approximate area where the light from a second image may strike the other side of a viewers face. In this way a large area of light from the image is able to pass through the louvers to the intended viewers eye while limiting the light from the image which would be seen at another location.
(74) In this illustration, another small portion (item 604) of the display (item 114) is expanded (item 620). In item 620 we see configurable louvers which operate in both the vertical and horizontal directions to guide the light from the display image. In this case the viewers head is tilted at an angle relative to the display (item 114). The configurable louvers (item 620) now tilt to match the angle of tilt of the viewers head. Item 640 shows an approximate area where the light from a first image may strike the intended side of a viewers face. Item 660 shows an approximate area where the light from a second image may strike the other side of a viewers face. By applying louvers which are taller than they are wide, a larger amount of light from the image is able to pass through the louvers to the intended viewer's eye while limiting the light from the image which would be seen at another location.
(75) One means to accomplish this is for the sensors to sense objects which enable a facial recognition and therefore location and pairing information of the eyes. Another method may involve a computing device which compares locations of eyes and creates pairs via an algorithm based on distance between eyes or some other method. Other methods for locating paired eye positions include, but are not limited to sensing light reflective or light transmitting devices located on the face or on a wearable device such as glasses, a hat, necklace etc. The means given to recognize a pair of eyes, viewpoints or facial features is for illustrative purposes only and is not meant to be limiting in any way.
(76) Additionally, the ability to guide the light from the display to a specific area allows a privacy mode. This mode may use but not be limited to, facial recognition computation, eye pattern recognition or other means such as proximity are used to allow viewing by one person only. The electronically configurable light guiding louvers of more than one axis function to channel the light to the eyes of a single viewer. The electronically configurable light guiding louvers of more than one axis function to channel the light from the displayed image to the eyes of a single viewer. If desired, the number of people who may view the displayed image in privacy mode may be manually increased.
(77) With reference now to FIG. 28 of the drawings, there is shown an illustration of an embodiment of the present invention. In this illustration, a handheld device is shown which may be used in both portrait and landscape modes. In this illustration configurable louvers are used to create an auto stereoscopic 3D image. However, the method of shutter glasses may also be applied. To accomplish this end a display orientation sensor is applied. This sensor may be gravity sensing, motion or inertia sensing, but is not limited to these technologies.
(78) With reference now to FIG. 29 of the drawings, there is shown an illustration of an embodiment of the present invention. In this illustration a 3D stereoscopic image of a keyboard is shown. The virtual image of the keyboard in space is approximately the same for most viewing locations. As such, it's virtual location in space and the virual location in space of each individual key on the keyboard may be calculated by the devices computers. In this embodiment, either the method applying shutter glasses, or the method applying louvers may be used.
(79) In addition a pointer, body part or wearable device may be located by the sensors and their position in space may likewise be calculated or quantified. A wearable device such as a glove may contain position markers of reflective or emissive materials which enable sensors to accurately determine it's location in space and for the case of a glove also the fingers. An advanced sensor may be able to detect the location of fingers without the need for gloves with position markers. In this embodiment, either the method applying shutter glasses, or the method applying louvers may be used.
(80) As the location of the 3D stereoscopic keyboard and also a pointer or pointers location is known, it may now be possible through computation to determine when the body part or pointer is in proximity to places on the keyboard. In this manner keyboard entries may be made. This is similar to what occurs on a 2D screen with touch sensing. The difference being the typing takes place on a virtual image as opposed to a solid surface. In this embodiment, either the method applying shutter glasses, or the method applying louvers may be used.
(81) The virtual keyboard and any other virtual object may be interacted in a multitude of other ways. These include stretching and shrinking, twisting and turning and any other ways a 2D touch object could be manipulated. The understanding is that for the 3D virtual touch object, 3 axis rather than 2 axis, may be applied and manipulated. In this embodiment, either the method applying shutter glasses, or the method applying louvers may be used.
(82) In addition, the virtual keyboard or any other virtual interactive device described below may be brought forth and/or removed by user gestures sensed by the systems location sensors. In addition gestures sensed by the location sensors may be used for other functions, such as but not limited to turning the pages of an electronic book, changing stations on a television, or raising or lowering volume of the display system or other components.
(83) With reference now to FIG. 30 of the drawings, there is shown an illustration of an embodiment of the present invention. In this illustration a 3D stereoscopic image of a remote controller is shown. All of the properties described in illustration 29 apply. In addition, the remote controller may be applied to control objects outside the device. This may be accomplished by applying wifi, Bluetooth or other wireless means. In addition by applying the internet items at a large distance from the display may be controlled. In this embodiment, either the method applying shutter glasses, or the method applying louvers may be used.
(84) With reference now to FIG. 31 of the drawings, there is shown an illustration of an embodiment of the present invention. In this illustration a 3D stereoscopic image of a keyboard is shown. All of the properties described in illustration 29 apply. Placing, touching, pressing, or otherwise gesturing at the keyboard may through a computer interface produce sound or music. The virtual keyboard shown is for illustrative purposes and is not intended to be limiting. Other virtual musical instruments include, but are not limited to drums, percussion instruments, wind wood instruments, etc. In this embodiment, either the method applying shutter glasses, or the method applying louvers may be used.
(85) With reference now to FIG. 32 of the drawings, there is shown an illustration of an embodiment of the present invention. In this illustration a 3D stereoscopic image of a pottery wheel is shown. All of the properties described in illustration 29 apply. Such a virtual image may be made to rotate and a virtual pottery creation may be created. All of the properties described in illustration 29 apply. The image may be manipulated by the user and saved for 3D printing or other uses. In like manner other objects may be created which do not require a rotational motion. In this embodiment, either the method applying shutter glasses, or the method applying louvers may be used.
(86) With reference now to FIG. 33 of the drawings, there is shown an illustration of an embodiment of the present invention. In this illustration a 3D stereoscopic image of a box is shown. The box is manipulated by use of a pointing tool (item 700). This pointing tool may have a tip (item 704) of emissive material, reflective material or other means to make it's location easily read by the sensors. The pointer may also have one or more functional buttons (item 702). These buttons may operate in a similar fashion as buttons on a computer controller such as a mouse. By applying this pointer an object may be identified, grabbed and moved, sized or any number of functions commonly associated with the computer mouse. The difference being that the virtual objects and the pointer may be operated in 3 axis or dimensions. In this embodiment, either the method applying shutter glasses, or the method applying louvers may be used.
(87) With reference now to FIG. 34 of the drawings, there is shown an illustration of an embodiment of the present invention. In this illustration a 3D stereoscopic virtual cave is shown which employs the technology previously illustrated. In such a cave the objects appear more real as they remain approximately fixed in space as the viewer and viewpoint location are changed. The objects in the virtual cave may be interacted with in the manner which has been described above. In this embodiment, either the method applying shutter glasses, or the method applying louvers may be used.
(88) With reference now to FIG. 35 of the drawings, there is shown an illustration of an embodiment of the present invention. In this illustration a 3D stereoscopic image of an aircraft simulator is shown. Varying amounts of the simulator may be simulated depending on the wants of the user. It may be that only objects outside of the control environment are simulated. However it is possible for virtual controls, buttons, switches and other controlling devices to be simulated and interacted with, in the manner described above. In addition the interior environment of the simulator may be created virtually. This enables simulators whose configuration may be controlled by applying computer software. For example a virtual flight simulator could be used as a B-737 for one event and reconfigured as an A-320 for the next event. This would save money for the user as fewer simulators would be needed. Other virtual simulations lend application to, but are not limited to, law enforcement and the military. In this embodiment, either the method applying shutter glasses, or the method applying louvers may be used.
(89) With reference now to FIG. 36 of the drawings, there is shown an illustration of an embodiment of the present invention. In this illustration a 3D stereoscopic image of a game (item 196) is shown. The 3D virtual game pieces may be created and also manipulated by any of the methods previously described. All of the properties described in illustration 29 apply. The display system (item 114) may be made to lay flat so as to provide a better gaming surface. In this way board games and other types of games may be played and interacted with by the user or users. Virtual worlds may be created, viewed and/or interacted with. This embodiment of the present invention makes an excellent gaming system. In this embodiment, either the method applying shutter glasses, or the method applying louvers may be used.
(90) Furthermore, the present invention may be switched to other modes of operation. These include but are not limited to prior art 3D stereoscopic imaging where the 3D stereoscopic image location varies with viewer location. This may be a useful mode for viewing prior art technology 3D imagery such as 3D movies. Also, the display may be used to view 2D images in the manner of prior art. The switching among the various 3D and 2D modes may be automatic based on the format of the viewing material. In this embodiment, either the method applying shutter glasses, or the method applying louver technologies may be used.
(91) Furthermore, although exemplary embodiments have been disclosed herein, and although specific terms are employed, they are used and are to be interpreted in a generic and descriptive sense only, and not for purpose of limitation. Accordingly, it will be understood by those of ordinary skill in the art that various changes in form and details may be made without departing from the spirit and scope of the present invention as set forth in the claims.
(92) By way of conclusion, the prior art in this area of technology encompasses displays of two types, one which produce a 3D stereoscopic effect when viewed through wearable shutter glasses, the second which produces a 3D stereoscopic image through the use of light guiding louvers. This prior art, such as the references cited herein, is limited by viewing location. In addition the prior art is limited to 3D stereoscopic images which may not be seen in approximately the same location as viewpoint changes nor when viewed by different users. This does not allow users to communicate about a 3D stereoscopic image by gestures, for example pointing, or gesturing. In the present invention 3D stereoscopic images or virtual images may also be interacted with by the user(s). This is accomplished by applying location sensing technology and comparing the data with the computed 3D virtual object location.
(93) Additional prior art utilizes parallax barriers to obtain 3D stereoscopic effects. There is prior art which enables the parallax barriers to function in different display orientations. However, the prior art parallax barriers limit the eye placement of the viewer to a narrow range for large displays. In addition, since the louvers of prior art function in only one axis at a time they have difficulties sharing the 3D imagery with other viewers. Prior art is also limited to small devices for virtual 3D auto stereoscopic display systems.
(94) The instant invention improves upon the prior art by improving upon the parallax barriers. The electronically configurable light guiding louvers have the advantage of variable pitch and multiple axis of blocking or guiding the light from the display. This allows multiple viewers to view large screen devices and share in the 3D experience. It also allows a privacy mode.
(95) In addition, a 3D stereoscopic image may be created which remains approximately fixed in space. Such a virtual image may be pointed at by one or more viewers. Because the virtual image is nearly fixed in space it's virtual location may be compared with a user's finger, other body parts or pointer. In this way a viewer may interact with a virtual 3D image by pointing or other gestures as sensed by the position sensors. In addition the position sensors may be used to interpret a variety of gestures which correspond to a variety of commands. By using the position sensors gestures may be made which cause the display device to react to the viewer. Examples include but are not limited to gestures which call for a virtual keyboard or remote to be displayed. They may also cause a station of a television to change or the volume to increase or decrease. There are many more possibilities and this list of gestures and results is not intended to be limiting in any way.
(96) These and other advantages are readily apparent to one who has viewed the accompanying figures and read the descriptions.
(97) Exemplary embodiments have been disclosed herein, and although specific terms are employed, they are used and are to be interpreted in a generic and descriptive sense only and not for purpose of limitation. Accordingly, it will be understood by those of ordinary skill in the art that various changes in form and details may be made without departing from the spirit and scope of the present invention as set forth in the following claims.
(98) While the foregoing written description of the invention enables one of ordinary skill to make and use what is considered presently to be the best mode thereof, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the invention is not to be limited by the above described embodiment, method, and examples, but by all embodiments and methods within the scope and spirit of the invention as claimed.
