Apparatus, vehicle information system and method

Abstract

An apparatus includes an information system with at least one pattern generator having a plurality of light nodes, each light node including at least one light emitting element, such as an LED. The at least one pattern generator is positioned with regard to a user of the apparatus such that it is located in the peripheral view of the user. A controller is operatively coupled to the pattern generator and configured to selectively initiate the generation of a visual light pattern on the pattern generator, the visual light pattern being indicative of information which is to be provided to the user of the apparatus.

Claims

1. An apparatus comprising: a plurality of pattern generators, each pattern generator having a plurality of light nodes, each light node comprising a light emitting element, the pattern generators being positioned at different locations around an interior of the apparatus and around a user located within the apparatus; a controller operatively coupled to the plurality of pattern generators and configured to selectively initiate generation of a visual light pattern on at least one of the plurality of pattern generators, the visual light pattern being recognizable by the user when seen in peripheral vision and indicative of information that is to be provided to the user; and a sensor system configured to monitor the interior of the apparatus and to detect a gaze direction of the user, wherein the sensor system comprises a plurality of sensors operatively coupled to the controller, the controller being configured to generate the visual light pattern on at least one specific pattern generator from the plurality of pattern generators in response to the detected gaze direction of the user, wherein the at least one specific pattern generator is located only in a peripheral vision of the user, wherein the apparatus is an autonomous vehicle, wherein the controller and the plurality of pattern generators are part of a vehicle information system, wherein the user is an occupant of the vehicle, wherein the plurality of pattern generators are positioned within the interior of the vehicle such that at least one of the plurality of pattern generators is viewable in peripheral view by the occupant of the vehicle, and wherein the controller is configured to generate the visual pattern by determining a zone to indicate that the vehicle will perform a left turn, perform a right turn, slow down or stop.

2. The apparatus of claim 1, wherein the controller is adapted to select the visual light pattern from a plurality of light patterns.

3. The apparatus of claim 1, wherein the controller is connected or connectable to an information provider to receive data related to the apparatus and the user from the information provider.

4. The apparatus of claim 3, wherein the controller is configured to modify the visual light pattern based on the data and to initiate the generation of the modified visual light pattern on the at least one specific pattern generator or on any other of the plurality of pattern generators being in peripheral vision of the user.

5. The apparatus of claim 1, wherein the controller is configured to obtain a visual light pattern from an external source.

6. The apparatus of claim 5, wherein the controller is configured to modify the visual light pattern based on data received from an information provider, the data being related to the apparatus or the user, and wherein the controller is configured to initiate the generation of the modified visual light pattern on the at least one specific pattern generator or on any other of the plurality of pattern generators being in peripheral vision of the user.

7. The apparatus of claim 1, wherein the visual light pattern is generated on the at least one specific pattern generator by switching on, for a predetermined period of time, the light emitting elements of at least one set of light nodes of the plurality of light nodes associated with the visual light pattern while keeping switched off the light emitting elements of remaining sets of light nodes of the plurality of light nodes.

8. The apparatus of claim 1, wherein the apparatus is a vehicle and the controller is configured to determine the information based on a vehicle status or a planned motion of the vehicle and to initiate the generation of the visual light pattern based on the determined information on the at least one specific pattern generator or on any other of the plurality of pattern generators being in peripheral vision of the user.

9. The apparatus of claim 1, wherein each light node is configured to emit light in a monochromatic color.

10. The apparatus of claim 1, wherein the apparatus is a vehicle and the plurality of pattern generators are positioned at locations within the interior of the vehicle, each location being a location selected from the group consisting of: above a windshield, along an A-pillar of the vehicle, along a B-pillar of the vehicle, along a C-pillar of the vehicle, above or below a window of the vehicle, following a perimeter of a window of the vehicle, embedded in a window of the vehicle, embedded in a door of the vehicle, embedded in a material of the interior of the vehicle, and in a peripheral viewing region of a head-mounted virtual, augmented, or mixed reality system of the vehicle.

11. The apparatus of claim 1, wherein the apparatus comprises a sound generation system configured to provide spatially orientated sounds indicating a position of a generated light pattern.

12. The apparatus of claim 1, wherein the apparatus comprises a haptic feedback generation system configured to provide haptic feedback associated with the generated light pattern.

13. A method of providing information to a user of an apparatus, the method comprising: determining a visual light pattern associated with information to be provided to the user, the visual light pattern being determined in dependence on data related to the apparatus or the user; detecting a first gaze direction of the user; determining a first zone of a plurality of zones of a pattern generator having a plurality of light nodes to output the visual light pattern, the first zone being in a peripheral vision of the user based on the first gaze direction; outputting the visual light pattern on the first zone of the pattern generator so that the visual light pattern is visualized by the user in the peripheral vision of the user; detecting that the first gaze direction of the user has changed to a second gaze direction; determining a second zone of a plurality of zones of a pattern generator to output the visual light pattern, the second zone being different than the first zone and in an updated peripheral vision of the user based on the second gaze direction; and outputting the visual light pattern on the second zone of the pattern generator so that the visual light pattern is visualized by the user in the updated peripheral vision of the user, wherein the apparatus is an autonomous vehicle and the user is an occupant of the autonomous vehicle, and wherein determining the first zone and determining the second zone each comprises determining a zone to indicate that the vehicle will perform a left turn, or wherein the apparatus is an autonomous vehicle and the user is an occupant of the autonomous vehicle, and wherein determining the first zone and determining the second zone each comprises determining a zone to indicate that that the vehicle will perform a right turn.

14. The method of claim 13, wherein the plurality of zones are disposed at different locations within an interior of the vehicle; and wherein the pattern generator is positioned within an interior of the vehicle such that it is viewable in peripheral view by the occupant of the vehicle.

15. The method of claim 13, wherein determining the first zone and determining the second zone each comprises determining a zone to indicate that the vehicle will slow down or stop.

16. An autonomous vehicle comprising: a plurality of pattern generators, each pattern generator having a plurality of light nodes, each light node comprising a light emitting element, the pattern generators being positioned at different locations around an interior of the vehicle and around an occupant located within the vehicle; and a vehicle information system that includes a controller and the plurality of pattern generators, the vehicle information system configured to: determine a visual light pattern associated with information to be provided to the occupant, the visual light pattern being determined in dependence on data related to the vehicle or the occupant; detect a first gaze direction of the occupant; determine a first zone of a plurality of zones of the pattern generator to output the visual light pattern, the first zone to indicate that the vehicle will perform a left turn, perform a right turn, slow down or stop; output the visual light pattern on the first zone of the pattern generator so that the visual light pattern is visualizable by the occupant in a peripheral vision of the occupant; detect that the first gaze direction of the occupant has changed to a second gaze direction; determine a second zone of a plurality of zones of a pattern generator to output the visual light pattern, the second zone being different than the first zone and in an updated peripheral vision of the occupant based on the second gaze direction, the second zone to indicate that the vehicle will perform a left turn, perform a right turn, slow down or stop; and output the visual light pattern on the second zone of the pattern generator so that the visual light pattern is visualizable by the occupant in the updated peripheral vision of the occupant.

17. A method of providing information to a user of an apparatus, the method comprising: determining a visual light pattern associated with information to be provided to the user, the visual light pattern being determined in dependence on data related to the apparatus or the user; detecting a first gaze direction of the user; determining a first zone of a plurality of zones of a pattern generator having a plurality of light nodes to output the visual light pattern, the first zone being in a peripheral vision of the user based on the first gaze direction; outputting the visual light pattern on the first zone of the pattern generator so that the visual light pattern is visualized by the user in the peripheral vision of the user; detecting that the first gaze direction of the user has changed to a second gaze direction; determining a second zone of a plurality of zones of a pattern generator to output the visual light pattern, the second zone being different than the first zone and in an updated peripheral vision of the user based on the second gaze direction; and outputting the visual light pattern on the second zone of the pattern generator so that the visual light pattern is visualized by the user in the updated peripheral vision of the user, wherein the apparatus is an autonomous vehicle and the user is an occupant of the autonomous vehicle, and wherein determining the first zone and determining the second zone each comprises determining a zone to indicate that the vehicle will slow down or stop.

18. The apparatus of claim 1, wherein the visual light pattern is generated on the at least on specific pattern generator by use of a time sequence of predefined sub-patterns of light, each sub-pattern of light being generated by switching on, for a predetermined period of time, the light emitting elements of a predefined set of light nodes of the plurality of light nodes associated with a particular sub-pattern.

19. The apparatus of claim 1, wherein each light node is configured to change a color of the emitted light.

20. The autonomous vehicle of claim 16, further comprising a sound generation system configured to provide spatially orientated sounds indicating a position of a generated light pattern.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) One or more examples will hereinafter be described in conjunction with the following drawing figures, where like numerals denote like elements, and

(2) FIG. 1A is a schematic illustration of human vision;

(3) FIG. 1B is a schematic illustration of the field of view of the human eye;

(4) FIG. 2 illustrates various possible locations for pattern generators of an exemplary embodiment of a vehicle information system;

(5) FIG. 3A shows a schematic view of an exemplary embodiment of a vehicle information system;

(6) FIG. 3B shows a schematic top view of the system of FIG. 3A;

(7) FIG. 4 shows a schematic side view of the system of FIG. 3A;

(8) FIG. 5 shows a further schematic top view of the system of FIG. 3A;

(9) FIG. 6 shows a block diagram of an exemplary embodiment of a vehicle information system;

(10) FIG. 7 shows a block diagram of a further exemplary embodiment of a vehicle information system;

(11) FIG. 8 shows a flow diagram of an exemplary embodiment of a method of providing information to an occupant of a vehicle; and

(12) FIG. 9 shows a block diagram of an exemplary embodiment of an apparatus.

(13) The following list of reference numerals can be used with the application:

(14) 101 central vision

(15) 103 paracentral vision

(16) 105 macular vision

(17) 107 near peripheral vision

(18) 109 mid peripheral vision

(19) 111 far peripheral vision

(20) 201 dashboard

(21) 203 steering wheel

(22) 205 instrument panel

(23) 207 display

(24) 209 gauge

(25) 211 instrumentation

(26) 213 seat

(27) 215 seat

(28) 217 sun shield

(29) 219 sun shield

(30) 221 windshield

(31) 223 pattern generator

(32) 225 pattern generator

(33) 227 pattern generator

(34) 229 pattern generator

(35) 231 pattern generator

(36) 233 pattern generator

(37) 235 side window

(38) 237 A-pillar

(39) 239 A-pillar

(40) 301 pattern generator

(41) 303 tripod

(42) 305 occupant

(43) 307 traffic signal sightline

(44) 309 pattern generator sightline

(45) 311 cut-off sightline

(46) 313 forward line of sight

(47) 315 zone 1

(48) 317 zone 2

(49) 319 zone 3

(50) 321 zone 4

(51) 323 LED

(52) 325 controller

(53) 327 equipment

(54) 329 camera

(55) 331 sensor system

(56) 701 vehicle information system

(57) 703 light pattern

(58) 705 sound generation system

(59) 707 haptic feedback generation system

(60) 709 database

(61) 711 storage

(62) 713 navigation system

(63) 801 viewing window

(64) 803 pattern generator

(65) 805 controller

(66) 807 information provider

(67) 809 information provider

(68) 810 step

(69) 811 information provider

(70) 820 step

(71) LN light node

(72) L Left

(73) R Right

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

(74) It is common today to use visual, acoustic, and haptic indications to communicate information, for example, vehicle status information and navigation assistance, to an occupant of a vehicle. Visual information is generally designed for the central and paracentral vision systems to understand the information, and the occupant must usually refocus on such information displays to interpret the presented visual information.

(75) The human eye requires very little stimulation to register activity in the peripheral vision. Motion is particularly noticeable in the peripheral vision and can be used to attract attention. As can be seen in FIGS. 1A and 1B, the human vision is commonly divided into various sectors. The so-called central vision 101 is centered at angles of about 0-5 degrees around the fixation point, which is the point at which one's gaze is directed. This 5 degree field of central vision is usually due to a cone-shaped depression in the central retina which is called fovea.

(76) The paracentral vision 103 is at viewing angles of about 5-8 degrees around the fixation point. This is due to a ring-shaped region surrounding the fovea, known as parafovea.

(77) The macula, a region of the retina defined as having at least two layers of ganglia, which are bundles of nerves and neurons, may be taken as defining the boundaries of central vs. peripheral vision. The macula provides a field of vision, the so-called macular vision 105, of around 18 degrees.

(78) The so-called near peripheral vision 107 is at a field of view of around 18-30 degrees. The so-called mid peripheral vision 109 is at a field of view of around 30-60 degrees, and the so-called far peripheral vision is at a field of view of around 60-110 degrees with regard to the point of fixation. The outer boundaries of peripheral vision correspond to the boundaries of the visual field as a whole.

(79) For a single eye, the extent of the visual field may be defined in terms of four angles, each measured from the fixation point. These angles, representing four cardinal directions, are 60 superior (up), 60 nasal (towards the nose), 70-75 inferior (down), and 100-110 temporal (away from the nose and towards the temple). For both eyes the combined visual field is 130-135 vertical and 200-220 horizontal.

(80) Exemplary embodiments of a vehicle information system as described herein seek to provide information to an occupant of the vehicle, the occupant may be the person in the driver's seat, such that the occupant is enabled to use his visual field which is in the regions of the near peripheral vision 107, the mid peripheral vision 109 and the far peripheral vision 111.

(81) An exemplary embodiment of a vehicle information system is described with reference to FIG. 2 which shows in particular a perspective view of a front part of an interior of a vehicle. The interior comprises dashboard 201 with a steering wheel 203 and a central instrument panel 205. The instrument panel 205 may comprise one or more displays 207, gauges 209 and other instrumentation 211. The interior further comprises a driver's seat 213 and a front passenger seat 215. The interior of the vehicle further comprises a left sun shield 217 and a right sun shield 219. Both sun shields are mounted above the windshield 221. The vehicle further comprises in its interior an exemplary embodiment of a vehicle information system which includes at least one of pattern generators 223, 225, 227, 229, 231, and 233.

(82) The pattern generator 223 is located within the interior of the vehicle and above the windshield 221 and above a left front side window 235 and above a right front side window which is not shown in FIG. 2.

(83) The pattern generator 225 is located within the interior of the vehicle, along its left A-pillar 237. The pattern generator 227 is located within the interior of the vehicle, along its right A-pillar 239. The pattern generator 229 is located in the interior of the vehicle and below the left front side window 235. The pattern generator 229 extends along the perimeter of this window as shown in FIG. 2. The pattern generator 231 is located within the interior of the vehicle below the right front side window and follows the perimeter of this window. The patent generator 233 is located within the interior of the vehicle within or on the dashboard 201 and right below the windshield 221.

(84) In preferred embodiments of a vehicle information system, only one or a selection of the shown pattern generators 223 to 233 is employed. In other preferred embodiments, the pattern generators 223 to 233 may represent multiple pattern generators of the vehicle information system. Thus one or multiple pattern generators can be disposed within the interior of a vehicle at different locations.

(85) A further preferred exemplary embodiment of a vehicle information system is described with regard to FIGS. 3A to 5. For simplicity, pattern generator 301 of this vehicle information system is not shown within the interior of a vehicle, but it is placed on tripods 303, like for testing and development purposes, but the tripods 303 are not present when the pattern generator 301 is arranged within the vehicle's interior.

(86) The pattern generator 301 may be intended to be placed within the interior of a vehicle above the windshield 221 (see FIG. 2) and above the left and right front side windows, like front side window 235 of FIG. 2. Thus, the pattern generator 301 may in substance correspond to pattern generator 223 as shown in FIG. 2.

(87) In particular, the pattern generator 301 may be positioned within the interior of the vehicle to be viewable in the peripheral view of an occupant 305, e.g., the person seated in the driver's seat 213, when the occupant 305 is looking forward through the windshield 221 or towards displays 207, gauges 209 or other instrumentation, such as instrumentation 211, primarily positioned, for example, on the dashboard 201, for viewing by the forward looking occupant 305.

(88) As illustrated with regard to FIG. 4, the pattern generator 301, when located above the windshield 221, will be located at a sightline 309, which is above a traffic signal sightline 307 of the occupant 305, and also above a bottom so-called cut-off sightline 311 for other vehicles being ahead of the vehicle.

(89) The traffic signal sightline 307 may, for example, define the maximal viewing angle at which the occupant 305 can still look out of the windshield 221. Thus the traffic signal sightline 307 may, for example, in substance correspond to the line of sight where the upper end of the windshield borders the roof interior.

(90) As indicated in FIG. 4, the pattern generator 301 may, for example, be placed at an angle of around 33 degrees above a forward line of sight 313.

(91) With regard to the horizontal direction, as will be further illustrated in particular with regard to FIGS. 3B and 5, the pattern generator 301 may be located to the left up to a viewing angle of around 110 with regard to the field of view of the left eye of the occupant, and the pattern generator 301 may also be located to the right up to a viewing angle of about 110 with regard to the field of view of the right eye of the occupant 305.

(92) Consequently, the exemplary pattern generator 301 is located within the interior of the vehicle such that during normal driving situations, when the occupant 305 is looking forward through the windshield 221, the pattern generator 301 can be seen or recognized by the occupant 305 by use of the occupant's peripheral view, without the occupant having to turn his head such that his direct line of sight changes from the forward line of sight 313 in the upward direction towards the pattern generator 301.

(93) As shown in FIG. 3B, the pattern generator 301 can be divided into four zones: Zone 1 (reference numeral 315), zone 2 (reference numeral 317), zone 3 (reference numeral 319), and zone 4 (reference numeral 321). Furthermore, as illustrated with reference to FIG. 5, the pattern generator 301 comprises a plurality of light nodes LN. In the described exemplary embodiment, there are in total 64 light nodes. In other examples the total number of light nodes may be different, for example, in the range between 50 and 1000.

(94) Each of the 64 light nodes is denoted with a unique number ranging from 1 to 64. The light node at the very left side of the pattern generator 301 is denoted with number 1 and the light node at the very right of the pattern generator 301 is denoted with number 64.

(95) The table below gives an overview of the angle of each node with respect to the forward line of sight 313 which is located at 0 degrees. Angles below zero are located to the left L of the forward line of sight 313, and angles above zero are located to the right R with regard to the forward line of sight 313.

(96) TABLE-US-00001 LN Number Angle 1 108.66 L 2 106.33 L 3 103.8 L 4 101.02 L 5 97.99 L 6 94.68 L 7 91.09 L 8 87.21 L 9 83.03 L 10 78.58 L 11 73.89 L 12 69. L 13 63.97 L 14 58.88 L 15 53.81 L 16 48.83 L 17 38.79 L 18 34.49 L 19 29.68 L 20 24.38 L 21 18.59 L 22 12.38 L 23 5.86 L 24 +.82 R 25 +7.74 R 26 +13.93 R 27 +20.05 R 28 +25.72 R 29 +30.91 R 30 +35.59 R 31 +39.77 R 32 +43.51 R 33 +46.47 R 34 +49.47 R 35 +52.14 R 36 +54.52 R 37 +56.66 R 38 +58.54 R 39 +60.31 R 40 +61.87 R 41 +63.29 R 42 +64.58 R 43 +65.76 R 44 +66.84 R 45 +67.84 R 46 +68.75 R 47 +69.6 R 48 +70.38 R 49 +73.67 R 50 +75.72 R 51 +77.74 R 52 +79.71 R 53 +81.63 R 54 +83.5 R 55 +85.32 R 56 +87.09 R 57 +88.81 R 58 +90.47 R 59 +92.18 R 60 +93.62 R 61 +95.12 R 62 +96.56 R 63 +97.95 R 64 +99.29 R

(97) Thus light node LN with number 1 is located at an angle of 108.66 to the left (L) of the forward line of sight 313, light node LN with number 2 is located at an angle of 106.33 to the left (L) of the forward line of sight 313, and so on and so forth.

(98) Each light node LN may comprise a light emitting element such as a LED 323, like an RGB LED (R=red, G=green, B=blue). Each light node LN may therefore be color tunable. The LED may also be a RGBW LED, where W means white.

(99) Each light node LN, and thus each LED 323, may be operatively coupled to a controller (see controller 325 in the block diagram of FIG. 6) of the vehicle information system, and the controller may be able to individually control each light node LN, and thus each LED 323. Thus, the controller may be configured to individually switch on and off each LED 323.

(100) In the exemplary vehicle information system as described with regard to FIGS. 3A to 5, the controller may further be configured to selectively generate a visual light pattern of a plurality of predefined visual light patterns by use of the light nodes LN of the pattern generator 301 in order to provide an information associated with the light pattern to the occupant 305.

(101) As explained before, the occupant 305 can view the pattern generator 301 in his peripheral vision in particular when looking along the forward line of sight 313, so that each light pattern of the plurality of light patterns may have a design that is easy to grasp. Thus, each light pattern may be configured to be recognizable by the occupant 305 when seen in his periphery. The light patterns may thereby vary in color, intensity, position on the pattern generator and/or spatial motion or other characteristics so that they can be easily distinguished from each other.

(102) The vehicle in which the vehicle information system described with regard to FIGS. 3A to 5 is employed may, for example, be an autonomous vehicle. Prior to or during carrying out a left pre-turn, followed by a left turn, the controller may generate a light pattern which is associated with this action. For example, the controller may start illuminating light node 16 and further illuminate in a filling sweep from light node 16 to light node 1 for a sharp turn of more than 90 degrees, to light node 8 for a 90 degree turn, and to light node 4 for a Y- or line change.

(103) In order to indicate a right pre-turn and subsequent right turn, the controller may start illuminating light node 49 and then further illuminate in a filling sweep to light node 64 for a sharp right turn of more than 90 degrees, to light node 56 for a 90 degree turn, and to light node 60 for a Y- or line change.

(104) In order to indicate that the vehicle will slow down or stop, the controller may illuminate at least some of the light nodes of zones 2 and 3 (see reference numerals 317 and 319 in FIG. 3B) which are ahead of the occupant 305. More specifically, in order to indicate a stop, the controller may start illuminating light node 32, which is the central one in the line of light nodes 1 to 64, and depending on break intensity, the controller may extend the illumination to light nodes 13 and 48 in both directions.

(105) The controller may further be able to generate a light pattern on pattern generator 301 which may be used as an avatar to provide feedback of receiving voice commands and to visually emphasize audio/voice feedback from the vehicle to the occupant 305. Multiple avatars, which may also be called pixies, may be available and different colors may, for example, be used to differentiate them from each other.

(106) Emergency vehicle notification and hazard warnings may be associated with a light pattern that is characterized by illumination of a single signal light node in bright light with flanking lower intensity nodes. The light nodes in the direction of the emergency vehicle or hazard may be illuminated to indicate the direction. Alternatively, a blinking may be generated over all zones 1 to 4, with alternating switch on and switch off of even and odd zones.

(107) The various exemplary light patterns described in the preceding sections are summarized and further described in the following table:

(108) TABLE-US-00002 Sequence Description Location Color Pre-turn Increased intensity sweep Zone 1 or 4 Ice Blue outward on same side as being turned toward Turn Sweep outward on same Zone 1 or 4 Yellow side as being turned toward; fill by turn duration Lane Intensity fade in and out Zone 1 or 4 Yellow change Stop Increasing intensity Zone 2 and 3 Red Avatar Single bright node with All zones Ice Blue flanking lower intensity nodes; scans around based on command Emergency Blinking alternating even All zones Red vehicle and odd zones notification

(109) As shown in the block diagram of FIG. 6, an exemplary embodiment of a vehicle information system, such as the embodiment in accordance with FIGS. 3A to 5, comprises at least one pattern generator 301 having individually addressable light nodes LN, each with at least one LED 323. The vehicle information system further includes controller 325 operatively coupled to the pattern generator 301. The controller 325 may, for example, use a bus, such as a CAN-bus or a LIN-bus (LIN=Local Interconnect Network), to communicate with the pattern generator 301. The controller 325 may be operatively coupled to equipment 327 of the vehicle, such as a camera or a sensor, for example, via a CAN-Bus (CAN=Controller Area Network).

(110) A further exemplary embodiment of a vehicle information system, which is particular useful in an autonomous vehicle, is described in the following and also with reference to the drawings.

(111) In an autonomous vehicle, the seating may be different than in a non-autonomous vehicle, and thus the orientation of the occupants may vary or may be different from the usual orientation of the occupants seated in a non-autonomous vehicle. Occupants, also the occupant of the driver's seat 213, may not necessarily look in the forward direction through the windshield 221.

(112) An exemplary embodiment of a vehicle information system, which is in particular suitable for an autonomous vehicle, comprises multiple pattern generators, such as the pattern generators 223-233, disposed within the interior of the vehicle at different locations. Each pattern generator 223-233 has a plurality of light nodes LN, and each light node LN comprises at least one light emitting element 323.

(113) A sensor system 331 (see FIG. 2), which may include a camera 329, is configured to monitor the interior of the vehicle and to detect an orientation of an occupant 305 of the vehicle. In particular the sensor system 331 may be used to determine the orientation of the face of the occupant 305 and from this the line of sight of the occupant 305 may be determined. The sensor system 331 may be operatively coupled to a controller (see controller 325 in FIG. 6) which is configured to determine a specific pattern generator from the multiple pattern generators 223-233 in dependence on the detected orientation of the occupant 305 and such that the specific pattern generator is situated in the peripheral vision of the occupant 305. The controller may then generate, for example, based on input from equipment 327 of the vehicle, such as an acceleration sensor or a navigation system, and on the selected pattern generator, a visual light pattern of a plurality of predefined visual light patterns to provide information associated with the light pattern, for example, that a left or a right turn will take place, to the occupant 305 of the vehicle.

(114) In an exemplary embodiment, a vehicle information system 701, as shown in the block diagram of FIG. 7, comprises at least one pattern generator 301 having a plurality of light nodes LN, each light node comprising at least one light emitting element, such as an LED. The at least one pattern generator 301 being positioned within an interior of a vehicle to be viewable in peripheral view by an occupant (see occupant 305 in FIG. 3A) of the vehicle who is looking forward through a windshield 221 of the vehicle or towards displays 207, gauges 209 or instrumentation 211 primarily positioned for viewing by the forward looking occupant. The system 701 further comprises controller 325 which is operatively coupled to the pattern generator 301, for example, via a CAN-bus, and configured to selectively generate a visual light pattern 703 of a plurality of predefined visual light patterns on the pattern generator 301 to provide information associated with the light pattern 703 to the occupant of the vehicle.

(115) The vehicle information system 701 may comprise a sound generation system 705 for providing spatially orientated sound indicating the position of the generated light pattern 703. The sound and the light pattern 703 may be generated synchronously.

(116) The vehicle information system 701 may comprise a haptic feedback generation system 707 for providing haptic feedback associated with the generated light pattern 703. The haptic feedback generation system 707 may, for example, be arranged in at least one of the seats (see seats 213 and 215) of the vehicle. The haptic feedback and the light pattern 703 may be generated synchronously.

(117) The vehicle information system 701 may comprise a sensor system 331, in particular with a camera 329 mounted in the interior of the vehicle. The sensor system 331 may be configured to monitor the interior of the vehicle and to detect the orientation of an occupant 305 in the vehicle. The sensor system 331 may be operatively coupled to the controller 325 which may be configured to select a specific pattern generator from multiple pattern generators (see generators 223-333 in FIG. 2) in dependence on a detected orientation of the occupant in the vehicle such that the selected specific pattern generator is situated in the peripheral vision of the occupant 305.

(118) The vehicle information system 701 may further comprise a database 709 which is stored on storage 711. In the database 709, the plurality of predefined visual light patterns is stored. In the database, a one-to-one relationship between specific information and an associated light pattern is established. For example, a specific light pattern is associated with the information that the vehicle will carry out a left turn. The controller 325 may further be operatively coupled with a navigation system 713 or another equipment of the vehicle which may provide the information to the controller 325 that the vehicle will turn to the left. The controller 325 may then access the database and determine the specific light pattern which is associated with the information left turn ahead. The selected light pattern will then be generated by use of the pattern generator 301 to provide the information to the occupant 305 that a left turn is happening soon.

(119) The vehicle information system 701 may be adapted to the position, orientation and viewing direction of the occupant using the orientation of the occupant determined by the sensor system 331. In some embodiments this adaptation may be initiated manually or carried out automatically when an occupant is seated in the vehicle, or intermittently or continually as long as the occupant 305 is present in the vehicle.

(120) Adjustment or adaptation of the vehicle information system 701 may include selection of a specific one of a plurality of pattern generators (see pattern generators 223-233) based on where that specific pattern generator is located with respect to the orientation of the occupant 305. A pattern generator that is determined to be located in the peripheral vision of the occupant is preferably the one that is selected. In some embodiments several pattern generators may be selected simultaneously, either because they are all located in the peripheral vision of a single occupant, or because they are in the peripheral vision of respective ones of several occupants. This is particularly advantageous in an autonomous vehicle where the seat locations of the passengers may be adjustable such that the actual position and orientation of an occupant cannot be reliably predicted.

(121) The controller 325 may be an on-board computer or some special purpose computing device, and it may be realized as a combination of hardware processing capabilities, various memory modules and other necessary components such as communication buses and interfaces, and software modules stored in the memory modules and including instructions that can be executed by the processor. The controller may also, in whole or in part, be implemented as an application-specific integrated circuit (ASIC), as a field-programmable gate array (FPGA), or a system-on-a-chip (SoC).

(122) The controller 325 can be configured to determine the information in dependence on a vehicle status or a planned motion of the vehicle and to select the visual light pattern from the plurality of light patterns based on the determined information. As such the controller may be a separate component capable of communicating with an autonomous driving system or systems and receive information therefrom, or it may simply be a module or a component of a vehicle control system such as an autonomous driving system.

(123) The sensor system 331 may provide the controller 325 with sensor data from at least one sensor. The sensor may be: a camera, motion detector, accelerometers, system warnings (including but not limited to warnings from the autonomous driving system), a sensor for outside temperature, microphones, etc. The controller may be programmed to analyze the senor data and to classify the data received. The controller may be programed to prioritize the classified data and to provide a visual light pattern according to the data with the highest priority.

(124) The reaction time of changing the light patterns in response to system inputs (e.g., CAN from sensors) may be fast enough to provide smooth transitions for rapidly sweeping or dynamic lighting and react to input from sensors.

(125) In some embodiments the controller 325 may display individual information to each occupant in the same vehicle. The controller 325 may be configured to determine that different information is relevant to different occupants based on their roles (e.g., the relevance of a road hazard to a driver vs. to a passenger in vehicles that are not autonomous or not fully autonomous) or based on their orientation (e.g., the relevance or nature of a planned maneuver to an occupant facing forward vs. an occupant facing sideways).

(126) In some embodiments preferences in the vehicle information system 701, such as the predefined light patterns, may be configured by the occupant.

(127) In some embodiments the senor system 331 can include a set of sensors capable of detecting (or enabling the controller 325 to determine) characteristics of the occupants, including size, demographics, mobility and physical orientations in the vehicle. Based on the received senor data the controller can adapt settings, such as the analyses of other senor data, the classification of senor data, the prioritization of the classified data and the predefined light patterns. This adaptation by the controller will provide the occupants with custom made information, making it more intuitive for the occupants to understand or react to vehicle information.

(128) According to some embodiments a user interface may be provided which enables the controller to receive commands or status inquiries from an occupant or operator. Information related to the commands and inquiries can be presented to the occupant via visual light patterns, but may in some embodiments be presented on a display of the user interface. In some embodiments the controller may be configured to use an already installed user interface of the vehicle, for example, on the dashboard of the vehicle.

(129) The number of light nodes LN could be anywhere from low resolution (less than 100) to high resolution (many thousands). For dimming the light nodes LN with enough control a reasonable resolution may be required (e.g., at least 10 bit dimming on each channel). For high node numbers this means a high data transfer rate to the light nodes (e.g., greater than 1 Mbps).

(130) The vehicle information system 701 may include many light nodes LN at various angles with respect to the observer's visual field of view. The system 701 may have light nodes outside the occupant's immediate field of view to allow head movements and changes in orientation of the occupant. The light nodes may include one or multiple sets of LED chips. The nodes can form a visual pattern. The nodes can act together with similar intensity, color, and tempo to simply cover a larger area of the observer field of view and give a sense of spatial coverage or size or the nodes may create a pattern recognizable by an observer in the direct view. In one embodiment the pattern could be an arrow resembling a green turn indicator icon for turn use cases.

(131) FIG. 8 provides a flow diagram for a method of providing information to an occupant of a vehicle. Box 810 illustrates the step of selecting a visual light pattern from a plurality of predefined light patterns. The selected visual light pattern is associated with information to be provided to the occupant. Box 810 illustrates the step of selectively generating, preferably by use of a controller to which at least one pattern generator is operatively coupled, the selected visual light pattern on at least one pattern generator configured to visualize the selected visual light pattern to provide the information to the occupant.

(132) The method may further include the step of providing the at least one pattern generator having a plurality of light nodes, each light node comprising at least one light emitting element, such as an LED, within an interior of a vehicle to be viewable in peripheral view by an occupant of the vehicle who is looking forward through a windshield of the vehicle or towards displays, gauges or instrumentation primarily positioned for viewing by a forward looking occupant.

(133) The block diagram of FIG. 9 shows an apparatus comprising a viewing window 801, which may be a display when the apparatus is an electronic device such as a virtual reality google, or a windshield when the apparatus is a vehicle. The viewing window is an element at which, under normal circumstances, a user of the apparatus looks at or looks through when the apparatus is in use.

(134) The apparatus further comprises an information system having at least one pattern generator 803 which is provided with, as the previous described pattern generators, a plurality of light nodes. Each light node comprises at least one light emitting element, such as an LED. The pattern generator 803 is positioned with regard to the viewing window 801 in the apparatus such that it is located in the peripheral view of the user when the user looks at or through the viewing window 801.

(135) The apparatus further comprises a controller 805 which is operatively coupled to the pattern generator 803 and configured to initiate the generation of a visual light pattern on the pattern generator 803. The visual light pattern is thereby indicative of information which is to be provided to the user of the apparatus. For example, as outlined before, the pattern generator may output a visual light pattern that indicates an upcoming turn to the occupant of a vehicle.

(136) The controller 805 may be adapted to select the visual light pattern from a plurality of predefined light patterns which are stored on a database (see database 709 in FIG. 7). The predefined light patterns may also be modifiable by the controller, for example, in dependence on received information as will be described below. Furthermore, if a modified light pattern is generated by the controller, the basic light pattern may not be output by the pattern generator 803.

(137) The controller 805 is connected or connectable to a first information provider 807, a second information provider 809 and a third information provider 811 for receivingfrom at least one of the information providers 807-811data which is related to the apparatus and/or the user.

(138) The information provider 807, for example, may be a sensor attached at the apparatus or, in case of a vehicle, a navigation system or another system of a vehicle which can provide information or data. The sensor may, for example, be a camera monitoring the interior of a vehicle.

(139) The information provider 809 may be a cloud service accessible via the internet. The information provider 811 may be a wearable electronic device, such as a fitness tracker, which is worn by a user and to which the controller 805 is also connected, e.g., via Bluetooth. The controller 805 may be connected via a wired or wireless connection to the information provider 807 and/or to the information provider 809.

(140) The data received from the information providers 807, 809, 811 may be any kind of data associated with the apparatus and/or the user. For example, the apparatus may be a vehicle, and the controller 805 may receive from one of the information providers 807-811 medical data about the user, user preferences, user information, traffic data, emergency data, and/or weather data.

(141) The controller may be configured to modify the visual light pattern in dependence on the data and to initiate the generation of the modified visual light pattern on the pattern generator. The data may be related to at least one of the apparatus and the user, and the controller may be configured to initiate the generation of the modified visual light pattern on the pattern generator.

(142) The controller 805 may further be configured to modify a visual light pattern which is intended for an output to the user in dependence on the received data. The controller 805 may further be configured to initiate the generation of the modified visual light pattern on the pattern generator 803.

(143) For example, the visual light pattern used to warn an occupant of an approaching emergency vehicle may be modified with regard to intensity, color and blinking speed in dependence on the distance of the emergency vehicle to the vehicle, and the modified visual light pattern may be output by the pattern generator 803.

(144) The controller 805 may also be configured to obtain at least one visual light pattern from an external source, for example, by downloading a light pattern from the cloud service 809. The controller 805 may further be configured to modify the obtained visual light pattern in dependence on data received from one of the information providers 807-809.

(145) The foregoing description, for purpose of explanation, has been described with reference to specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the techniques and their practical applications. Others skilled in the art are thereby enabled to best utilize the techniques and various embodiments with various modifications as are suited to the particular use contemplated.

(146) Exemplary non-limiting systems and methods are set out in the following items:

(147) 1. An apparatus comprising:

(148) a pattern generator having a plurality of light nodes, each light node comprising a light emitting element, the pattern generator being positioned in a peripheral view of a user of the apparatus; and

(149) a controller operatively coupled to the pattern generator and configured to selectively initiate generation of a visual light pattern on the pattern generator, the visual light pattern being indicative of information that is to be provided to the user of the apparatus.

(150) 2. The apparatus of item 1, wherein the controller is adapted to select the visual light pattern from a plurality of light patterns.

(151) 3. The apparatus of one of the preceding items, wherein the controller is connected or connectable to an information provider to receive data related to the apparatus and the user from the information provider.

(152) 4. The apparatus of item 3, wherein the controller is configured to modify the visual light pattern based on the data and to initiate the generation of the modified visual light pattern on the pattern generator.

(153) 5. The apparatus of one of the preceding items 1, wherein the controller is configured to obtain a visual light pattern from an external source.

(154) 6. The apparatus of item 5, wherein the controller is configured to modify the visual light pattern based on data received from an information provider, the data being related to the apparatus or the user, and wherein the controller is configured to initiate the generation of the modified visual light pattern on the pattern generator.

(155) 7. The apparatus of one of the preceding items, wherein the apparatus is a vehicle, wherein the controller and the pattern generator are part of a vehicle information system, wherein the user is an occupant of the vehicle, and wherein the pattern generator is positioned within an interior of the vehicle such that it is viewable in peripheral view by the occupant of the vehicle.

(156) 8. The apparatus of one of the preceding items, wherein the visual light pattern is configured to be recognizable by the user when seen in peripheral vision.

(157) 9. The apparatus of one of the preceding items, wherein the visual light pattern is generated on the pattern generator by switching on, for a predetermined period of time, the light emitting elements of at least one set of light nodes of the plurality of light nodes associated with the visual light pattern while keeping switched off the light emitting elements of remaining sets of light nodes of the plurality of light nodes.

(158) 9. The apparatus of one of one of the preceding items, wherein the visual light pattern is generated on the pattern generator by use of a time sequence of predefined sub-patterns of light, each sub-pattern of light being generated by switching on, for a predetermined period of time, the light emitting elements of a predefined set of light nodes of the plurality of light nodes associated with a particular sub-pattern.

(159) 10. The apparatus of one of the preceding items, wherein the apparatus is a vehicle and the controller is configured to determine the information in based on a vehicle status or a planned motion of the vehicle and to initiate the generation of the visual light pattern based on the determined information on the pattern generator.

(160) 11. The apparatus of one of the preceding items, wherein each light node is configured to emit light in a monochromatic color, or each light node is configured to change a color of the emitted light.

(161) 12. The apparatus of one of the preceding items, wherein the apparatus is a vehicle and the pattern generator is positioned at a location within an interior of the vehicle, the location being selected from one or more of above a windshield, along an A-pillar of the vehicle, along a B-pillar of the vehicle, along a C-pillar of the vehicle, above or below a window of the vehicle, following a perimeter of a window of the vehicle, embedded in a window of the vehicle, embedded in a door of the vehicle, embedded in a material of the interior of the vehicle, in a peripheral viewing region of a head-mounted virtual, augmented, or mixed reality system of the vehicle.

(162) 13. The apparatus of one of the preceding items, wherein the apparatus is a vehicle and wherein multiple pattern generators are disposed within an interior of the vehicle at different locations.

(163) 14. The apparatus of item 13, wherein the apparatus comprises a sensor system configured to monitor the interior of the vehicle and to detect an identity, orientation, or gaze direction of an occupant in the vehicle.

(164) 15. The apparatus of item 13 or 14, wherein the sensor system comprises a plurality of sensors operatively coupled to the controller, the controller being configured to determine a specific pattern generator from the multiple pattern generators based on the detected identity, orientation, or gaze direction of the occupant in the vehicle such that the specific pattern generator is situated in a peripheral vision of the occupant.

(165) 16. The apparatus of one of the preceding items, wherein the apparatus comprises a sound generation system configured to provide spatially orientated sounds indicating a position of a generated light pattern.

(166) 17. The apparatus of one of the preceding items, wherein the apparatus comprises a haptic feedback generation system configured to provide haptic feedback associated with the generated light pattern.

(167) 18. A vehicle information system of a vehicle, the system comprising:

(168) a plurality of pattern generators disposed at different locations within an interior of the vehicle, each pattern generator having a plurality of light nodes, each light node comprising a light emitting element; and

(169) a sensor system configured to detect an orientation and gaze direction of an occupant of the vehicle, the sensor system being operatively coupled to a controller that is configured to determine a specific pattern generator from the plurality of pattern generators in based on the detected orientation or gaze direction of the occupant.

(170) 19. The system of item 18, wherein the specific pattern generator is selected such that it is located in a peripheral vision of the occupant.

(171) 20. The system of item 18 or 19, wherein the pattern generators are operatively coupled to the controller, and wherein the controller is configured to selectively initiate, on the specific pattern generator, the generation of a visual light pattern to provide information associated with the visual light pattern to the occupant.

(172) 21. A method of providing information to a user of an apparatus, the method comprising:

(173) determining a visual light pattern associated with information to be provided to the user, the visual light pattern being determined in dependence on data related to the apparatus or the user; and

(174) outputting the visual light pattern on a pattern generator configured to visualize the visual light pattern to provide the information to the user.

(175) 22. An apparatus comprising a vehicle or a vehicle information system of a vehicle, the apparatus comprising a plurality of lighting diodes arranged in or on the apparatus within a peripheral view of an occupant in a driver's seat of the vehicle, when the occupant is looking at a viewing window of the apparatus or at an object within the apparatus.

(176) 23. A method of providing information to an occupant in a driver's seat of a vehicle, the method comprising:

(177) determining that the occupant is looking at a first location within the vehicle;

(178) determining a visual light pattern associated with information to be provided to the occupant, the visual light pattern being determined based on data related to the vehicle or the occupant; and

(179) outputting the visual light pattern on a pattern generator comprising a plurality of lighting diodes arranged in a peripheral view of the occupant when the occupant is looking at a first location within the vehicle, the visual light pattern to provide the information to the user.

(180) 24. The method of item 23, wherein, after outputting the visual light pattern, the method further comprises:

(181) determining that the occupant is looking at a second location within the vehicle, the second location being different than the first location;

(182) determining a second visual light pattern associated with information to be provided to the occupant, the second visual light pattern being determined based on data related to the vehicle or the occupant, the second visual light pattern being the same or different than the visual light pattern; and

(183) outputting the second visual light pattern on a second pattern generator comprising a different plurality of lighting diodes arranged in an updated peripheral view of the occupant when the occupant is looking at the second location within the vehicle, the second visual light pattern to provide the information to the user.

(184) Although the disclosure and examples have been fully described with reference to the accompanying drawings, it is to be noted that various changes and modifications will become apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of the disclosure and examples as defined by the claims.