Holographic display system
10742967 ยท 2020-08-11
Assignee
Inventors
- Marcus Hoggarth (St Albans Herts, GB)
- Jasper Dekker (Brenthouse Road London, GB)
- Edward ROSE (London, GB)
Cpc classification
G06F3/011
PHYSICS
H04N13/388
ELECTRICITY
B60R1/00
PERFORMING OPERATIONS; TRANSPORTING
B60K35/60
PERFORMING OPERATIONS; TRANSPORTING
G06V20/56
PHYSICS
B62D1/046
PERFORMING OPERATIONS; TRANSPORTING
G06F1/1601
PHYSICS
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
G06F3/016
PHYSICS
B60R2300/8086
PERFORMING OPERATIONS; TRANSPORTING
International classification
H04N13/388
ELECTRICITY
H04N9/31
ELECTRICITY
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
Abstract
A display system for a motor vehicle is provided. The display system comprises a holographic projector assembly and a steering wheel assembly. The steering wheel assembly includes a ring-shaped member configured to be held by a driver of the vehicle and rotated about a central axis in order to steer the vehicle. The holographic projector assembly is configured to produce a holographic image inside a central region about which the ring-shaped member circumferentially extends.
Claims
1. A vehicle display system comprising: a steering wheel being laterally movable along a track between first and second positions with respect to a dashboard, and including, a ring defining, a void configured to rotate about a central axis; a support arm having a first end coupled with the ring and a second end movably attached to the track; and a projector including a mirror attached to the support arm, wherein the projector is configured to project a laser light in a lateral direction in parallel with the track toward the mirror, and the mirror is configured to reflect the laser light toward the void to generate a holographic image inside the void such that the holographic image remains stationary relative to the central axis as the steering wheel moves between the first and second positions.
2. The display system of claim 1, wherein a position or angle of the mirror is controllable to adjust a location of the holographic image.
3. The display system of claim 1, wherein the projector includes a pulse laser configured to emit pulses of the laser light, a scanner configured to selectively deflect the pulses of the laser light, and one or more lenses configured to focus the laser light to produce volume elements of the holographic image.
4. The display system of claim 3, wherein the pulse laser is configured to use plasma in a volume element of the holographic image to create a pressure wave sensed by a hand of an occupant.
5. The display system of claim 1, wherein the holographic image represents one or more vehicle controls, and the projector is further configured to vary a number or position of the one or more controls according to a controls setting.
6. The display system of claim 1 further comprising a camera configured to determine a position of a hand of an occupant relative to the holographic image, and determine a control input based on the position of the hand relative to the holographic image.
7. The display system of claim 1 further comprising an eye position sensor configured to determine a location of an eye of an occupant, wherein the projector is further configured to prevent the holographic image from being displayed when the eye is within a threshold distance of the holographic image.
8. The display system of claim 1 further comprising a location sensor configured to determine locations of one or more objects, wherein the holographic image is configured to display a representation of the one or more objects.
9. The display system of claim 1 further comprising a camera configured to capture an external image, wherein the holographic image displays the external image.
10. The display system of claim 1, wherein the projector is further configured to display a portion of the holographic image radially outside of the ring.
11. The display system of claim 1 further comprising a controller configured to: determine a control preference setting; and control the projector such that the holographic image represents one or more controls according to the control preference setting.
12. The display system of claim 1 further comprising a controller configured to: determine a vehicle operating mode, wherein the operating mode includes a manual driving mode and an autonomous driving mode; and control the projector such that in the manual driving mode, the projector projects a holographic image representing a transmission selector, and in the autonomous driving mode the projector omits the holographic image representing the transmission selector and projects a holographic image representing a computer input device.
13. The display system of claim 1 further comprising a controller configured to: determine a position of a hand of an occupant relative to the holographic image; and determine a vehicle control input based on the position of the hand.
14. A vehicle comprising: a projector configured to produce a holographic image; a steering wheel having a ring configured to rotate about a central axis and configured to move laterally between first and second positions relative to a dashboard of the vehicle, wherein the ring defines a void, the holographic image is projected in the void defined with a circumference of the ring and remains stationary relative to the central axis as the ring moves between the first and second positions; and a controller configured to, in response to indication of an operating mode, control the projector such that the holographic image represents one or more controls of the vehicle at least partially according to the operating mode.
15. A vehicle steering wheel assembly comprising: a ring configured to rotate about a central axis and move laterally, relative to a vehicle dashboard, between first and second positions, wherein the ring defines a void; a first projector configured to project a holographic image inside the void responsive to the ring being at the first position, a second projector, configured to project a same holographic image inside the void responsive to the ring being at the second position; and a controller configured to, in response to indication of a control preference setting, control the first and second projector such that the holographic image represents one or more controls according to the control preference setting.
16. The vehicle steering wheel assembly of claim 15, wherein the controller is further configured to, in response to a position of a hand relative to the holographic image, select a control input from the one or more controls within the control preference setting, and wherein the control input is based on the location of the position of the hand.
17. The vehicle of claim 14, wherein the operating mode includes a manual driving mode and an autonomous driving mode, and wherein the controller is further configured to, responsive to the manual driving mode, project a holographic image representing an indicator control.
18. The vehicle of claim 17, wherein the controller is further configured to, responsive to the autonomous driving mode, omit the holographic image representing the indicator control and project a holographic image representing a computer device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
DETAILED DESCRIPTION
(8) As required, detailed embodiments of the present invention are disclosed herein; however, it is to be understood that the disclosed embodiments are merely exemplary of the invention that may be embodied in various and alternative forms. The figures are not necessarily to scale; some features may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention.
(9) With reference to
(10) The steering wheel 60 is configured to rotate about a central axis 64 of the steering wheel. Such rotation may cause a steering system of the vehicle to control the direction of travel of the vehicle, for example by rotating wheels of the vehicle. The steering wheel 60 comprises a ring-shaped member 62 configured to be held by an occupant of the vehicle in order to rotate the steering wheel.
(11) The ring-shaped member 62 may be circular and as such may be toroidal. The ring-shaped member 62 may also be circular in cross-section, although the cross-sectional shape may vary about the circumference of the ring-shaped member.
(12) The steering wheel 60 may be a steer-by-wire steering wheel, which may not be mechanically linked to a steering mechanism of the vehicle. In other words, the steering wheel 60 may send an electrical signal to a controller, which in turn sends a signal to an actuator to adjust the directional position of wheels of the vehicle. The steering wheel 60 may be operatively connected to such a controller wirelessly and/or by virtue of one or more wires.
(13) The steering wheel 60 is supported by a support arm 80, which may connect the steering wheel 60 to a support structure, such as a dashboard 100 or other interior trim portion of the vehicle. As depicted in
(14) The support arm 80 may comprise a boss 90 provided at the first end 80a of the support arm and the support arm 80 may be coupled to the dashboard 100 at the boss 90.
(15) The support arm 80 may connect to the steering wheel 60 at a point that is spaced apart from the center of the steering wheel. For example, the support arm 80 may connect to the steering wheel 60 at the bottom of the steering wheel 60. As depicted in
(16) The support arm 80 may extend away from the steering wheel 60 in a direction with a component parallel to the central axis 64 of the steering wheel 60. The support arm 80 may also extend away from the steering wheel 60 in a direction with a radial component. In other words, the support arm 80 may extend axially and radially away from the central axis 64. The support arm 80 may be substantially straight or as shown, the support arm 80 may be curved, e.g. with a point of inflection between the first and second ends 80a, 80b. The support arm 80 may be elongate.
(17) When the support arm 80 is coupled to the ring-shaped member 62, as depicted in
(18) As depicted in
(19) In an alternative arrangement, the steering wheel 60 may comprise a central hub to which the support arm 80 may connect. The steering wheel 60 may comprise one or more support members configured to couple the ring-shaped member 62 to the central hub. In this case, the holographic projector 40 may be configured to generate the holographic image I in an area radially inside of the ring-shaped member 62 in which the support members are not provided, e.g. between, in front of and/or behind the support members.
(20) In the arrangement depicted in
(21) In the arrangement depicted in
(22) With reference to
(23) The holographic projector 40 may further comprise one or more mirrors 49 and/or one or more lenses 48. The mirrors 49 and/or lenses 48 may be provided between the components of the holographic projector, e.g. between the laser 42 and the scanner 44, and/or between the scanner 44 and the varifocal lens 46, with respect to the passage of the laser light. The mirrors 49 and/or lenses 48 may be configured to direct and/or focus the laser light as it passes between the components of the holographic projector 40. In the arrangements shown in
(24) Each of the components of the holographic projector 40, e.g. the laser 42, the scanner 44, the varifocal lens 46, the mirrors 49 and the lenses 48 may be provided within a housing (not shown) of the holographic projector 40. Alternatively, one or more of the components of the holographic projector 40, such as the lenses 48, mirrors 49 and/or the varifocal lens 46 may be provided outside of the housing of the holographic projector. For example, the lenses 48, mirrors 49 and/or the varifocal lens 46 may be provided on or in an interior trim portion of the vehicle, e.g. between the holographic projector 40 and the steering wheel 60, and/or may be provided on or in the steering wheel 60, support arm 80 and/or boss 90.
(25) The laser 42 may be a pulse laser configured to generate pulses of laser light. For example, in the arrangement shown in
(26) The scanner 44 may comprise a plurality of mirrors (not shown), the mirrors being movable in order to selectively deflect the light. Additionally or alternatively, the laser scanning device may comprise one or more refractive elements (not shown) configured to deflect the laser light through refraction. The scanner 44 may be capable of adjusting the position of the mirrors and/or refractive elements to deflect each pulse of light generated by the laser 42 by a different amount. In some arrangements, the scanner 44 may be a Galvano scanner. Alternatively, the scanner 44 may comprise any other form of scanning device capable of controllably deflecting light from the laser 42.
(27) Laser light leaving the scanner 44 may be deflected by the mirrors 49 and/or focused by the lenses 48 before reaching the varifocal lens 46. The mirrors 49 and/or lenses 48 may be configured to preserve the relative deflections of the laser light pulses that have been caused by the scanner 44.
(28) The varifocal lens 46 may comprise a plurality of lenses 46a, 46b, the relative positions of which being controllable in order to adjust a focal length of the varifocal lens 46. By controlling the operation of the scanner 44 and the varifocal lens 46, the holographic projector 40 may be configured to direct and focus the pulses of laser light from the laser 42 at a desired 3D location, e.g. into a desired volume centered at the 3D location.
(29) Pulses of laser light focused at the desired 3D location may cause air at the 3D location to become ionized and form a plasma. The plasma may produce visible light and may thereby form a volume element (voxel) of the holographic image I. Production of the plasma may also lead to the generation of pressure waves within the air adjacent to the desired 3D location, which may propagate away from the volume element. The pressure waves may be felt by the occupant when an occupant's hand is close to the volume elements, which may enable the occupant to feel the holographic image I.
(30) The controller 50 may control the operation of the scanner 44 and the varifocal lens 46 to scan the laser over a projection volume in order to generate the holographic image I within the projection volume. The varifocal lens 46 may be capable of providing small and accurate changes to its focal length, in order to scan the laser over the projection volume.
(31) In some arrangements, the varifocal lens 46 may be capable of adjusting its focal length by an amount greater than the depth of the projection volume, e.g. in order to focus the laser light outside of a current projection volume. Additionally or alternatively, the scanner 44 may be capable of deflecting the laser light outside of the current projection volume. The size and/or position of the projection volume may therefore be adjusted by varying the operation of the scanner 44 and the varifocal lens 46.
(32) In other arrangements, the scanner 44 and/or the varifocal lens 46 may not be capable of directing and/or focusing the laser light outside of the current projection volume. Alternatively, the position of the projection volume may already have been adjusted to a limit of the scanner 44 or the varifocal lens 46. Hence, if it is desirable to adjust or further adjust the size and/or position of the projection volume, the position of the lenses 48 and/or mirrors 49 of the holographic projector 40 may be varied. Changes to the projection volume that are provided by adjusting the lenses 48 and/or mirrors 49 may not be performed as quickly as changes implemented by adjusting the operating of the scanner 44 and/or the varifocal lens 46. However, adjusting the positions of the lenses 48 and/or the mirrors 49 may allow larger changes to be made to the size and/or position of the projection volume. The positions of the lenses 48 and/or mirrors 49 may be adjusted by one or more actuators (not shown) provided within the holographic projector 40. The actuators may be controlled by the controller 50.
(33) As depicted in
(34) As depicted in
(35) When the steering wheel 60 moves between the first position 60a and the second position 60b, it may be desirable for the holographic image I to be displayed in the same position relative to the steering wheel 60 regardless of the position of the steering wheel 60.
(36) The holographic projector 40 may be configured to provide the holographic image I when the steering wheel 60 is located at or close to the first position 60a, e.g. closer to the first position 60a than the second position 60b. The display system 2 may comprise a further holographic projector 40a configured to generate the holographic image I when the steering wheel 60 is at or close to the second position 60b, e.g. closer to the second position 60b than the first position 60a.
(37) At intermediate positions between the first and second positions 60a, 60b, neither the holographic projector 40 nor the further holographic projector 40a may be capable of producing the holographic image I in the desired position, e.g. relative to the steering wheel 60. For example, the arrangements of the mirrors and lenses within the holographic projectors 40, 40a may not allow the laser light from the holographic projectors 40, 40a to be deflected and/or focused into the void 66 of the steering wheel. In such intermediate positions, the holographic image I may not be provided and may not be visible.
(38) In order to allow the holographic image I to be provided in the desired position relative to the steering wheel 60 at intermediate positions between the first and second positions 60a, 60b, one or more additional holographic projectors (not shown) may be provided within the display system 2, The additional holographic projectors 40 may be coupled to the dashboard 100 between the holographic projector 40 and the further holographic projector 40a and may be configured to generate the holographic image I when the steering wheel 60 is location at an intermediate position between the first and second positions 60a, 60b. Alternatively, the display system 2 depicted in
(39) In the arrangement shown in
(40) The display system 2 further comprises a movable mirror 180. The movable mirror 180 may be movable together with the steering wheel 60 as the steering wheel moves between the first position 60a and the second position 60b. As depicted in
(41) The movable mirror 180 may be a mirror 49 of the holographic projector 40 depicted in
(42) As shown in
(43) As the holographic projector 40 is configured to project the laser light in a direction parallel to the track 160, the laser light from the holographic projector 40 may be incident on the movable mirror 180 regardless of the position of the steering wheel 60. The display system 2 may thereby be configured to provide the holographic image I at a desired location relative to the steering wheel 60 when the steering wheel 60 is located in any position between the first and second positions 60a, 60b.
(44) As described above, the holographic projector 40 creates the holographic image I by scanning the pulses of laser light over the projection volume. The projection volume may be formed at a predetermined projection distance from the holographic projector 40, which may be determined by the arrangement of the mirrors 49 and the lenses 48 within the holographic projector 40.
(45) As the steering wheel 60 moves between the first and second positions 60a, 60b, the distance travelled by the laser light between the holographic projector 40 and the ring-shaped member 62 of the steering wheel may change, e.g. reduce. Hence, it may be desirable to adjust the operation of the holographic projector 40 to reduce the projection distance by a corresponding amount, such that the holographic image I is formed at the same location relative to the steering wheel 60 regardless of the location of the steering wheel 60.
(46) The display system 2 may comprise one or more sensors (not shown) configured to determine the position of the steering wheel 60 between the first and second positions 60a, 60b. For example, the display system 2 may comprise a potentiometer provided along the track 160. A first contact of the potentiometer may be provided at a first end of the track and a second contact of the potentiometer may be provided on the boss 90, such that an electrical resistance between the first and second contacts varies as the steering wheel 60 is moved between the first and second positions 60a, 60b.
(47) The position of the steering wheel 60 determined by the sensors may be input to the controller 50 of the holographic projector 40, which may adjust the varifocal lens 46 and/or the position of the lenses 48 and/or mirrors 49 accordingly, e.g. such that the position of the holographic image I is unchanged relative to the steering wheel 60.
(48) As described above, the ring-shaped member 62 of the steering wheel may be rotated by the occupant about the central axis 64 in order to steer the vehicle. In contrast to when the steering wheel is translated between the first and second positions 60a, 60b, when the ring-shaped member is rotated, it may be desirable for the holographic image, or a portion of the holographic image, not to rotate together with the ring-shaped member 62. In other words, it may be desirable for the holographic image I, or a portion of the holographic image, to remain stationary relative to the dashboard 100 as the ring-shaped member 62 rotates.
(49) In some arrangements, it may be desirable that the holographic image I, or a portion of the holographic image, does rotate together with the ring-shaped member 62. In this case, the controller 50 may determine an angle of rotation of the ring-shaped member 62 and may adjust the operation of the holographic projector 40 to adjust the position and/or orientation of the holographic image I or portion of the holographic image accordingly.
(50) In the arrangements described above, the holographic image I is formed inside a central region of the ring-shaped member 62. However, it is also envisaged that the holographic image I or a portion of the holographic image may be formed outside of the ring-shaped member 62, e.g. outside an outer radius of the ring-shaped member. For example, at least part of the holographic image I may be formed adjacent to the steering wheel 60, as shown in
(51) With reference to
(52) As shown in
(53) The image, e.g. the 3D image, captured by the camera 240 may be processed by a controller 260 of the display system 2 to determine a position, e.g. a 3D position, of an occupant's hand relative to the holographic image I. The controller 260 may determine, based on the position of the occupant's hand, that the occupant is interacting with, e.g. touching, one or more of the controls represented by the holographic image I. The controller may generate a control input based on the position of the occupant's hand.
(54) The control input may be communicated by the controller 260 to a relevant system of the vehicle. The control input may be communicated to the relevant system wirelessly and/or via one or more wires.
(55) Additionally or alternatively, the camera 240, or another camera or sensor provided in the display system 2, may be configured to determine a location of an eye of the occupant. The controller 260 may determine the distance between the occupant's eye and the holographic image I and may prevent the holographic image I from being displayed when the occupant's eye is within a threshold distance of the holographic image I. In this way the controller 260 may prevent laser light from the holographic projector 40 reaching the occupant's eye.
(56) The type, number and/or position of the controls provided by the holographic image I may be determined according to a controls setting. The controls setting may be set by the occupant according to his or her preferences. For example, a first occupant's preference may be to simplify the controls provided in the vehicle while they are driving the vehicle. The first occupant may set the controls setting such that a minimum number of controls are provided, e.g. the controls that are required for operating the vehicle. A second occupant may wish to be able to control one or more accessory systems of the vehicle using controls provided in the holographic image I and may set the controls setting accordingly. For example, the second occupant may wish to control an entertainment system of the vehicle by interacting with the holographic image.
(57) The controls setting may be at least partially determined according to an operating mode of the vehicle, for example whether the vehicle is operating in a manual driving mode, an autonomous driving mode or a semi-autonomous driving mode.
(58) In the arrangement depicted in
(59) In the arrangement depicted in
(60) As depicted in
(61) The exterior position sensor 280 may comprise an ultrasound sensor, a radar sensor or any other type of sensor. For example, the exterior position sensor 280 may comprise a camera, such as a 3D camera.
(62) The exterior position sensor 280 may provide object position data captured by the sensor to the controller 260 or another controller. The controller 260 may process the object positon data to generate a representation, e.g. a 3D representation, of one or more objects in proximity to the vehicle. If the exterior position sensor 280 comprises a camera, the representation may be the image captured by the camera. Alternatively, the image captured by another camera may be combined with position data captured by the exterior position sensor 280 to generate the representation.
(63) As depicted in
(64) The objects to be represented within the holographic image I and/or the extent of an area around the vehicle to be represented may be selected by the occupant. Additionally or alternatively, the objects represented within the holographic image I may be determined according to a direction of travel of the vehicle and/or a maneuver being performed by the vehicle.
(65) The vehicle may further comprise one or more further display systems, such as display panels or head up displays. The further display systems may not be configured to allow the occupant to interact with the displays in the same way as the display system 2. For example, the further display systems may not be capable of determining a control input based on the position of the occupant's hand relative to an image provided by the further display system.
(66) In this case, the occupant may wish to transfer the image or information being displayed on one or more of the further display systems to the display system 2, e.g. to allow the occupant to interact with the image or information using the display system 2. While exemplary embodiments are described above, it is not intended that these embodiments describe all possible forms of the invention. Rather, the words used in the specification are words of description rather than limitation, and it is understood that various changes may be made without departing from the spirit and scope of the invention. Additionally, the features of various implementing embodiments may be combined to form further embodiments of the invention.