Focused sound and infotainment system and method

Abstract

A focused sound and infotainment system is provided along a continuous path. A moving staircase, escalator or walkway, is also provided for transporting persons, living things and/or objects, with which said focused sound and infotainment system is provided. A method is also disclosed for providing audio-visual information along a continuous path, particularly intended for and directed to people, living things, and/or objects being on the path and possible moving there along.

Claims

1. An audio-visual system to be provided along a continuous path, the audio-visual system comprising: a directional sound system, a display system, and a sensor system, wherein said display system comprises a continuous LED display comprising a plurality of LED tiles, wherein said audio-visual system is configured to receive data detected by the sensor system for recognizing a person, living thing or object in an area surrounding part of the audio-visual system; generate a sound control signal for emitting sound by means of the directional sound system, which is connected with the sensor system, towards said person, living thing or object being recognized; generate an image control signal for displaying an image on part of the display system, which is connected with the sensor system, in the area of said person, living thing or object being recognized; and transmit said sound and image control signals to said sound and display system respectively; and display an image by the display system such that the image displayed is directed towards said person, living thing or object as said person, living thing or object, and the image displayed moves along said continuous path such that the image displayed moves across the plurality of LED tiles together with said person, living thing or object along the audio-visual system along said continuous path continuously and simultaneously at a pace of said person, living thing or object, and wherein said display system further comprises one or more filters for adapting a viewing angle of the image shown, and wherein said one or more filters are configured to adapt the viewing angle based on the amount of persons, living things or objects amongst said plurality thereof being recognized.

2. The audio-visual system of claim 1, wherein the audio-visual system is configured to receive data detected by the sensor system for recognizing a plurality of persons, living things or objects, in corresponding plurality of area surrounding parts of the audio-visual system; generate a plurality of sound control signals, for emitting sound by means of the directional sound system, connected with the sensor system, towards each of said persons, living things or objects being recognized; generate a plurality of image control signals, for displaying an image on part of the display system, connected with the sensor system, in the area of each of said persons, living things or objects being recognized; and transmit said plurality of sound and image control signals to said sound and display system respectively.

3. The audio-visual system of claim 2, wherein the plurality of area surrounding parts of the audio-visual system include a first area surrounding part for a first person, living thing or object and a second area surrounding part for a second person, living thing or object, and wherein the audio-visual system displays a first image on a first part of the display system for the first area surrounding part and a second image on a second part of the display system for the second area surrounding part, and wherein the audio-visual system is further configured to display a blended image in a blend region between the first part of the display system and the second part of the display system such that the blended image is simultaneously viewable by both the first person, living thing or object in the first area surrounding part and the second person, living thing or object in the second area surrounding part.

4. The audio-visual system of claim 2, wherein, upon receiving data detected by the sensor system for recognizing a plurality of persons, living things or objects, including a first person, living thing, or object and a second person, living thing, or object, the first person, living thing, or object being in a corresponding first area surrounding part and the second person, living thing, or object being in a corresponding second area surrounding part, the audio-visual system displays a first image on a first part of the display system for the first area surrounding part and a second image on a second part of the display system for the second area surrounding part, wherein the first image displayed on the first part of the display system includes content determined to be of interest to the first person, living thing, or object based on a determined profile of the first person, living thing, or object, wherein the second image displayed on the second part of the display system includes content determined to be of interest to the second person, living thing, or object based on a determined profile of the second person, living thing, or object, wherein the first image displayed on the first part of the display system is different than the second image displayed on the second part of the display system due to the determined profile of the first person, living thing, or object being different than the determined profile of the second person, living thing, or object.

5. The audio-visual system of claim 1, wherein said directional sound system comprises a piezo, an ultrasonic element, a horn system, and/or one or more amplifiers.

6. The audio-visual system of claim 1, wherein said directional sound system or said sensor system further comprises one or more directional microphones.

7. The audio-visual system of claim 1, wherein said display system comprises a plurality of LED display panels, projection displays, or LCD panels.

8. The audio-visual system of claim 1, wherein each of the LED tiles has a LED processor, being controlled by an image splitter and a graphical card or graphics engine.

9. The audio-visual system of claim 1, further comprising a storage system, comprising a sound storage part and an image storage part, each of the sound storage part and the image storage part having multiple playout capability.

10. The audio-visual system of claim 9, further comprising a selector system for selecting sound and/or one or more images from the storage system.

11. The audio-visual system of claim 1, wherein said sensor system comprises a camera, an IR sensor, and/or an acoustic sensor.

12. The audio-visual system of claim 11, wherein said camera, IR sensor, or acoustic sensor is configured to distinguish said person from another living thing, or from an object.

13. The audio-visual system of claim 11, wherein said camera, IR sensor, or acoustic sensor is configured to distinguish said person from another living thing, or from an object, and in a case a person is recognized, said camera, IR sensor, or acoustic sensor is configured to perform people scanning including face and/or gait recognition.

14. The audio-visual system of claim 13, wherein said camera, IR sensor, or acoustic sensor is configured to perform said people scanning including face and/or gait recognition based on AI techniques wherein the sensor system is equipped or trained with person-recognition methods.

15. A moving staircase, escalator or walkway, for transporting said person, living thing or object, comprising the audio-visual system of claim 1.

16. The audio-visual system of claim 1, wherein the audio-visual system is configured to emit sound by the directional sound system such that the emitted sound is directed towards said person, living thing or object being recognized as said person, living thing or object moves along said continuous path.

17. The audio-visual system of claim 1, wherein the one or more filters cause the image to be only visible in the area surrounding part of the audio-visual system.

18. The audio-visual system of claim 17, wherein the one or more filters cause the image to be only visible in the area surrounding part of the audio-visual system such that a first image is displayed on said LED that is viewable by a first person, living thing or object only in a first area surrounding part of the audio-visual system and a second image is displayed on said LED that is only viewable by a second person, living thing or object in a second area surrounding part of the audio-visual system, and the first person, living thing or object in the first area is at a distance of 1.5 meters or greater from the second person, living thing or object in the second area.

19. The audio-visual system of claim 1, wherein said audio-visual system is configured to display a video by the display system such that the video displayed is directed towards said person, living thing or object as said person, living thing or object, and the video displayed moves along said continuous path such that the video displayed moves across the plurality of LED tiles together with said person, living thing or object along the audio-visual system along said continuous path continuously and simultaneously at a pace of said person, living thing or object.

20. The audio-visual system of claim 1, wherein the one or more filters adapt the viewing angle by narrowing the viewing angle.

21. The audio-visual system of claim 1, wherein the one or more filters adapt the viewing angle such that the image shown is only viewable to said person just in front of a part of the continuous LED display displaying said image.

22. The audio-visual system of claim 1, wherein in a case that the sensor system recognizes a group including a plurality of persons, living things or objects, in area surrounding part of the audio-visual system, the audio-visual system is configured to determine a difference between one or more characteristics of a first subset of the plurality of persons, living things or objects and one or more corresponding characteristics of a second subset of the plurality of persons, living things or objects.

23. The audio-visual system of claim 22, wherein based on said determined difference, the audio-visual system is configured to generate a sound control signal for emitting the sound and/or generate an image control signal for displaying the image to prioritize entertain for the first subset of the plurality of persons, living things or objects of the group.

24. The audio-visual system of claim 22, wherein based on said determined difference, the audio-visual system is configured to generate a sound control signal for emitting the sound and generate an image control signal for displaying the image to prioritize entertain for the first subset of the plurality of persons, living things or objects of the group.

25. The audio-visual system of claim 1, wherein in a case that the sensor system recognizes a person wearing AR/VR glasses in the surrounding part of the audio-visual system, the audio-visual system is configured to provide content on said LED display and/or the sound system individualized to said person wearing AR/VR glasses.

26. A method for providing audio-visual information along a continuous path, said method comprising the steps of: providing an audio-visual system comprising a directional sound system, a display system and a sensor system, said display system comprising a continuous LED display comprising a plurality of LED tiles; receiving data detected by the sensor system for recognizing a person, living thing or object in an area surrounding part of the audio-visual system; generating a sound control signal for emitting sound by means of the directional sound system, which is connected with the sensor system, towards said person, living thing or object being recognized; generating an image control signal for displaying an image on part of the display system, which is connected with the sensor system, in the area of said person, living thing or object being recognized; and transmitting said sound and image control signals to said sound and display system respectively; displaying an image by the display system such that the image displayed is directed towards said person, living thing or object as said person, living thing or object, and the image displayed moves along said continuous path such that the image displayed moves across the plurality of LED tiles together with said person, living thing or object along the audio-visual system along said continuous path continuously and simultaneously at a pace of said person, living thing or object; and providing one or more filters, wherein the one or more filters adapt a viewing angle of the image shown, wherein said one or more filters are configured to adapt the viewing angle based on the amount of persons, living things or objects amongst said plurality thereof being recognized.

27. The method of claim 26, further comprising the step of receiving and interpreting sound emitted and/or gesture made by said person, living thing or object being recognized.

28. The method of claim 27, further comprising the step of interacting with said person, living thing or object being recognized by means of interrogating or responding, meaning directing questions or answers thereto.

29. A hardware storage device having stored thereon computer executable instructions which, when executed by one or more processors of a computer system of an audio-visual system that comprises a directional sound system, a display system, and a sensor system, said display system comprising a continuous LED display comprising a plurality of LED tiles, configure the audio-visual system to perform the following for providing audio-visual information along a continuous path: receive data detected by the sensor system for recognizing a person, living thing or object in an area surrounding part of the audio-visual system; generate a sound control signal for emitting sound by means of the directional sound system, connected with the sensor system, towards said person, living thing or object being recognized; generate an image control signal for displaying an image on part of the display system, connected with the sensor system, in the area of said person, living thing or object being recognized; and transmit said sound and image control signals to said sound and display system respectively; display an image by the display system such that the image displayed is directed towards said person, living thing or object as said person, living thing or object, and the image displayed moves along said continuous path such that the image displayed moves across the plurality of LED tiles together with said person, living thing or object along the audio-visual system along said continuous path continuously and simultaneously at a pace of said person, living thing or object, and wherein said display system further comprises one or more filters that adapt the viewing angle of the image shown, and wherein said one or more filters are configured to adapt the viewing angle based on the amount of persons, living things or objects amongst said plurality thereof being recognized.

30. A visual system to be provided along a continuous path, the visual system comprising: a display system, and a sensor system, wherein said display system comprises a continuous LED display comprising a plurality of LED tiles, wherein said visual system is configured to receive data detected by the sensor system for recognizing a person, living thing or object in an area surrounding part of the visual system; generate an image control signal for displaying an image on part of the display system, which is connected with the sensor system, in the area of said person, living thing or object being recognized; and transmit said image control signal to said display system; and display an image by the display system such that the image displayed is directed towards said person, living thing or object as said person, living thing or object, and the image displayed moves along said continuous path such that the image displayed moves across the plurality of LED tiles together with said person, living thing or object along the visual system along said continuous path continuously and simultaneously at a pace of said person, living thing or object, and wherein said display system further comprises one or more filters for adapting the viewing angle of the image shown, and wherein said one or more filters are configured to adapt the viewing angle based on the amount of persons, living things or objects amongst said plurality thereof being recognized.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) FIG. 1 illustrates an embodiment of the audio-visual system in accordance with the invention.

(2) FIG. 2 illustrates another embodiment of the audio-visual system in accordance with the invention.

(3) FIG. 3 illustrates further embodiment of the audio-visual system in accordance with the invention.

(4) FIG. 4 illustrates a principal embodiment of the directional sound system in accordance with the invention.

(5) FIG. 5 illustrates an embodiment of the system setup for the audio-visual system in accordance with the invention.

(6) FIG. 6 illustrates flow chart embodiment of the method for providing audio-visual information along a continuous path in accordance with the invention.

DETAILED DESCRIPTION OF THE INVENTION

(7) The invention relates to an environment, wherein focused sound and infotainment are provided for people or (other living) things passing by or staying/moving around in a nearby i.e. close thereto limited area, and wherein such people or things are detected by means of a detection system e.g. comprising cameras and sensors. Focused sound is understood as sound being directed to (or from) the people, while infotainment may be dedicatedly presented onto a screen, e.g. large continuous LED display with time and space varying content, providing a combination of information and entertainment. With the focused sound and infotainment system, images and sound may change depending on the position or location of the persons or objects passing by, and possibly also depending on their (visible, intrinsic) features such as for example a person's gender or age, or the type of object which can be e.g. a car or bicycle, or for example a mobile device such as a smartphone. In at least some examples, focused sound may be directed to a passerby in order to give him/her information or instructions when walking or passing by, and herewith for example suggesting or directing him/her to look at the display for further information or entertainment.

(8) The invention also relates to a moving staircase, escalator or walkway, for transporting or conveying persons, living things and/or objects, wherein such focused sound and infotainment system is provided.

(9) The invention further relates to a method for providing audio-visual information, in particular focused sound and infotainment, along an extended environment, in particular a continuous (seemingly endless) path, pathway or corridor. Such focused sound and infotainment being particularly intended for and hence directed to a person, living thing or object related to one of these, being on the path and possible moving there along. The continuous path can be a fixed static path, or either a moving (motorized) path such as a moving staircase, escalator or walkway onto which the person, living thing or object is transported or conveyed. In other words, either the person, living thing or object can be moving and thus change position within the environment, or either the path they are on, can be movable. Moving staircases or other conventional passenger conveyors, typically include a chain of steps that travel in a loop to provide a continuous movement along a specified path.

(10) A plurality of persons, living things and/or objects can also be considered for the system and method as mentioned above, in accordance with the invention. Such plurality being either located approximately in the same position or spot with regard to the audio-visual system, or clearly separated from each other and being at distant position e.g. 1.5 m away from each other.

(11) The invention is now further described by means of different embodiments, for which is also referred to FIG. 1 to 6.

(12) FIG. 1 illustrates an embodiment of the audio-visual system 100 in accordance with the invention. As depicted, the audio-visual system 100 is particularly intended to be provided in an extended area or environment, and hence the system 100 itself being quite large and extended. Here, the system 100 is elongated along a continuous path 101, which can be a static pathway or corridor, but a moving or motorized version is also possible, such as for example a moving staircase, escalator or walkway. The audio-visual system 100 comprises a directional sound system 102, a display system 103 and a sensor system 104. As shown, a person 105 is walking along the continuous path 101 close to the audio-visual system 100. The audio-visual system 100 is typically mounted and installed not too far away from the continuous path 101, such that the person 105 present or moving thereon can be detected by means of the sensor system 104, and hence sound and image can be provided for this person 105. The person 105 is carrying for example a mobile device 107 such as e.g. his smartphone. The object 107 he or she is carrying, is thus related to the person 105 and in the vicinity of that person 105. The audio-visual system 100 is configured for not only detecting the person 105 but also another living species, such as a pet, as well as an object related to the person 105 or e.g. pet, and in the vicinity thereof, for example carried by the person 150 or pet. One could also think of a car or bicycle as possible object, being controlled by a person. Moreover, the audio-visual system 100 is also capable of recognizing people amongst other living species or objects.

(13) Further depicted in FIG. 1, the detection by means of the sensor system 104 is compartmentalized in accordance with the person, living thing or object being close enough to the system, therefore within an area surrounding part 108 of the audio-visual system 100. The person 105 walking on the path 101, and positioned within the area surrounding part 108 is detected and recognized by means of the sensor system 104, which may comprise of a camera 115 and a sensor 116, preferably comprising of a plurality of cameras and sensors. Visible or IR (infrared) cameras could be used, whereas possible sensors are for example an IR sensor (e.g. proximity, presence or movement sensor), infrared LED with IR detection and reflector side, or an acoustic sensor (e.g. distance or position sensor). According to an embodiment, the sensor system 104 comprises multiple sensors 116 and/or cameras 115, possibly installed or mounted in an array, along the audio-visual system 100 following an elongated continuous path 101. The sensor system 104 is mainly used to detect and determine the position of the person 105 (or other (living) thing) on the path 101. This positional relationship may determine change of local content (e.g. change image, information) and directed sound (e.g. change music, audio). Based on the detection and recognition of the person 105 within the area surrounding part 108, the audio-visual system 100 will provide focused sound and content to that person 105 in this area surrounding part 108. The focused sound is emitted by the directional sound system 102, after having generated and transmitted a sound control signal to the sound system 102. Similarly, content or images are displayed after having generated and transmitted an image control signal to the display system 103. Such content or images, e.g. in the form of information or entertainment, being for example text, static pictures or video, are shown on part of the display system 103 where the person 105 is walking or passing by, i.e. the person 105 being positioned in the area surrounding part 108. In accordance with the invention, whenever the person 105 is now moving along the path 101, herewith entering a neighboring area surrounding part 108, the audio-visual system 100 will further provide focused sound and infotainment to the person 105 in the neighboring area surrounding part 108. Providing such focused sound and infotainment may be further continued (in further neighboring area surrounding parts) along the entire continuous path 101 where the audio-visual system 100 is present. Depending on the person 105 standing still for a moment or walking faster or slower, the focused sound and infotainment will move along. As a result, the focused sound and infotainment is not only provided to the person 105, but will move simultaneously at the person's pace. Along the path 101, it is of course possible that the sound and content for the person 105 changes (while moving), e.g. depending on his/her behavior (or e.g. requests, questions asked, see interactivity discussed in further paragraph) during passing by.

(14) According to an embodiment, the sensor system 104 may comprise of cameras 115 and sensors 116 not only configured to distinguish a person 105 from another living thing, or from an object 107, but also, in case for example a person 105 is recognized to do face and/or gait recognition of that person 105, possibly based on AI (artificial intelligence) techniques wherein the sensor system 104 is equipped or trained with person recognition methods. Such face and/or gait recognition may lead for instance to determining age and/or gender of the person 105 being recognized.

(15) According to an embodiment, as illustrated in FIG. 1, the directional sound system 102 comprises speakers 109, corresponding amplifiers 110, as well as directional microphones 111. For example, per area surrounding part 108, one speaker 109 plus amplifier 110, and a few microphones 111 may be provided. The speaker 109 may be based on piezo technique, making use of an ultrasonic element, or could be a horn system. Here, the microphones 111 appear as a (linear) array, although other models could also be thought of. Alternatively, for example one mechanical rotational (sound capturing) device could be provided as microphone per area surrounding part 108. The microphones 111 can capture sound or words that come from a person or people passing by. According to an embodiment, the microphones 111 send audio signals representing the sound captured to a computing device, which can perform natural language processing to determine what, if anything, the person said, or which can analyze the audio signals to determine an ambient noise level. With the microphones 111 installed with the directional sound system 102, or more generally with the audio-visual system 100, the audio-visual system 100 is not only capable of delivering sound and content, but enables the system 100 also to capture audio (e.g. people's voice, a dog barking). Having sufficient intelligence provided in the system 100, it could be even possible to create interactivity of the system 100 with people passing by. For example, based on questions asked by the system 100 and directed to someone passing by, responses could be given from that someone, to be captured by the system 100, and interpreted thereafter. As result from the interpretation by the system 100, someone could receive very specific and dedicated information he/she needs. According to an embodiment, speakers may also receive data e.g. sound signals such as voice of a person passing by, and in response thereto, output audio feedback to this person passing by.

(16) Further, according to the embodiment, the display system 103 comprises a plurality of display panels 112, e.g. LED display panels. Alternatively, projection displays, or LCD panels for instance could also be used for the display system 103. For example, per area surrounding 108, a sequence of two (LED) display panels 112 could be provided. Each of the (LED) display panels 112 may comprise of a plurality of (LED) tiles 113 having each a (LED) processor being controlled by an image splitter and a graphical card or graphics engine, as being further discussed with the description of FIG. 5. The display system 103, or each of its plurality of display panels 112, in turn each of its plurality of tiles 113, may further comprise a filter 114, for example for adapting (e.g. narrowing) the viewing angle of the image shown thereon. By narrowing the viewing angle for example, the image or content is only seen or viewable for the person 105 just in front of the display, or in its region e.g. within the area surrounding part 108. The display system 103 can present text, as well as pictures, videos or video clips, or graphical representations to people passing by.

(17) FIG. 2 illustrates another embodiment of the audio-visual system 200 in accordance with the invention. As shown, the audio-visual system 200 is again provided along a continuous path 201, onto which two persons 205, 205 and one dog 206 are walking. The persons 205, 205 are at a certain distance d1 from each other, e.g. d1 is about 1.5 m. They are positioned within respective area surrounding part 208, 208 wherein they can be detected and recognized by means of the sensor system 204, comprising of cameras 215 and sensors 216. The dog 206 is at a further distance d2, hence also at a separate location onto the path 201, and detectable and recognizable within its area surrounding part 208. Suppose that the first person 205 left on the path 201 is a man of approximately 40 years old. With the sensor system 204 including cameras 215 and sensors 216, the audio-visual system 200 may recognize the first person 205 on the path 201, and may be even capable of recognizing his gender and age using for example face and/or gait recognition. The audio-visual system 200 knowing now that the person 205 is a man of about 40, the directed sound and content provided could be particularly chosen as something statistically (or learned from AI experience) popular for the average man of 40, and thus showing e.g. a car advertisement on the part 212 of the display system 203 while emitting audio for corresponding car trailer from the speaker 209. A little further on the path 201, at a distance d1 from the first person 205, a second person 205 is present and passing by, e.g. alternately standing and walking, maybe also running. Suppose this second person 205 is a woman of approximately 20 years old. With the sensor system 204, the audio-visual system 200 can again recognize the second person 205 on the path 201, including her gender and age. Based on the second person's profile, i.e. female of about 20, the audio-visual system 200 can provide content and sound which could be of particular interest for her. For example, it may be popular for young women of that age to go shopping, buy new clothes, and hence on the part 212 of the display system 203 e.g. clothing advertisement is presented while emitting audio for corresponding clothing commercial from the speaker 209.

(18) According to an embodiment, as illustrated in FIG. 2, a blend region 217 is provided on the display system 203 in between the parts 212, 212 particularly intended for the first and second person 205, 205 respectively. In case for example the person's 205, 205 are far enough from each other but not too far, such blend region 217 could be useful, onto which other content is shown, and moreover, specifically now content can be shown that is interesting for both the first and the second person 205, 205 passing by. Hence, the name blend region 217 for the display part in between parts 212, 212. For the blend region 217, for instance could be advertised (by the audio-visual system 200) for a restaurant in the neighborhood.

(19) The content here discussed above, is now particularly advertising, however, the audio-visual system 200 may be programmed to show entirely different content as well. For example, the path 201 being a moving walkway for people arriving (just landed) in an airport building, the content shown and sound emitted for someone passing by with his/her luggage could be practical tourist information for a person visiting the city or country where the airport is located. Or, it could also be pure entertainment, to provide video or images of a popular band or music artist while playing their music through the speakers (e.g. one at the time, one by one while passing by) of the directional sound system. Suppose now that on the path 201, at a distance d2 from the second person 205, a dog 206 is all of a sudden appearing on the path 201, and the path 201 is e.g. a moving walkway. For safety reasons, it could be recommended to have the dog 206 removed from the moving walkway as soon as possible. Hence, an embodiment could be that, whenever an animal such as a pet (e.g. dog) is appearing on the path, then focused sound is emitted, possible also images can be shown in the area of the dog running on a moving walkway all of a sudden. The selected focused sound and images are then for example typically chosen to keep the dog away from the moving walkway, e.g. make the dog leave by emitting a sharp whistle signal.

(20) FIG. 3 illustrates further embodiment of the audio-visual system 300 in accordance with the invention. As depicted, the audio-visual system 300 is again provided along a continuous path 301, onto which persons 305, 305, 305 are walking or passing by. The persons 305, 305, 305 are at a certain distance x1, x2 from each other, for instance a few meters from each other. For this particular embodiment, the situation is shown of a group of persons 305, here three, being together and (standing or remaining) close to each other within an area surrounding part 308. According to the embodiment, the audio-visual system 300 is capable to detect someone or something on the path 301, and even it is feasible again to recognize whether a person, living thing or object is passing by. Hence, the group of persons 305 on the path 301 are recognized. Depending now on the configuration of the audio-visual system 300, meaning for example how it is programmed, the group of persons 305 could be interpreted as a whole for profiling and providing dedicated sound and content, or it could also be that the system 300 is programmed to further analyze the group of persons 305, and based on this analysis to provide particular directed audio and information. For instance, it could be that the group of persons 305 comprises mainly women at the age of 30, and hence the system 300 choses or decides to bring a perfume advertisement via focused sound and images. Another example could be, that there are children in the group of persons 305, and the system 300 therefore gives priority to them to provide entertainment and perhaps gaming for kids. With FIG. 3, a response is given to the question what happens in case of a plurality of persons, living things or objects within an area surrounding part?, and in line therewith for example which of these is recognized for generating controlled sound and image?.

(21) According to an embodiment, wherein persons are wearing AR/VR glasses as, for example, described in the particular gaming area setting in U.S. patent application Ser. No. 17/865,096, filed on Jul. 14, 2022, which is incorporated herein by reference, then the content could also be individualized per person, according to the glasses worn.

(22) FIG. 4 illustrates a principal embodiment of the directional sound system 402 in accordance with the invention. As mentioned earlier, the directional sound system may comprise of speakers, which could be based on piezo (i.e. transducers), making use of an ultrasonic element, or for which a horn system could also be a useful option. The sound system is possibly a linear array of speakers along the length of the audio-visual system following an elongated path. Alternatively, the sound system could be a gyroscopic movement system (or a plurality thereof) within an area surrounding part, and this for an audio-visual system comprising of multiple area surrounding parts, hence multiple gyroscopic movement systems are possibly installed within the entire system. Instead of fixed install array or gyroscope version of speakers, one could also think of a drone system being used, onto which (part of) the sound system could be provided or mounted. In combination (partly) with the sensor system, it would even be possible maybe to provide both (part of) the sound system and for example cameras and/or sensors, hence (part of) the sensor system on the drone system. A schematic representation and interference principle for a situation of two ultrasonic speakers 409, 409 comprising of ultrasonic transducers being illustrated in FIG. 4. Herewith is now shown how an ultrasonic wave can be converted into a sound wave that can be heard. In order to perceive an ultrasonic sound, an audible frequency can be generated from two supersonic sources with a small frequency difference. For example, a tone of 1 kHz can be obtained from two ultrasonic tones of 40 kHz and 41 kHz. As seen in FIG. 4, where two ultrasonic waves interfere, a sound (with frequency F3) is perceived in the audio region. In particular, at the points where ultrasonic waves with frequencies F1 and F2 interfere, sound with a frequency of F3 can be heard. According to an embodiment, active cancellation of waves is also a possibility to achieve directive sound.

(23) FIG. 5 illustrates an embodiment of the system setup for the audio-visual system 500 in accordance with the invention. As earlier discussed, the audio-visual system 500 comprises a display system 503. The display system 503 here is composed of a plurality of panels 512 comprising of tiles 513, 513. The display system 503 has for example a resolution of 50020.000 pixels along the entire length L of the audio-visual system 500. The array or sequence of LED tiles 513, 513 is 500 pixels high and 20.000 pixels long. Each LED tile 513, 513 has a corresponding LED processor 518, 518, wherein all LED processors 518, 518 are controlled by an image splitter 519 and a graphical card or graphics engine 520. In addition, the audio-visual system 500 also comprises a storage system 521, comprising of a sound storage part 522 for storing audio, and an image storage part 523 for storing video clips and other image data, having both multiple playout capability, to accommodate a plurality of persons, living things and/or objects. The audio-visual system 500 further comprises a selector system 524, for selecting sound and/or image from the storage system 521. This selection is for example depending on the position and/or type of person, living thing or object present in the area surrounding part 508 while passing by the audio-visual system 500. The selector system 524 may select for the required or appropriate image or video clip, including its relative position, or for local audio to be played. It is noted that some (location) calibration may be needed here. Whereas the image storage part 523 being connected with the display system 503, the sound storage part 522 is connected with the directional sound system 502. The directional sound system 502 is here represented, comprising an audio processor 525 with digital input and multiple output channels. As yet mentioned above, the directional sound system 502 may further comprise an array of amplifiers 510, 510 and corresponding speakers 509, 509 connected therewith. As shown in FIG. 5, the audio processor 525 is here connected with the array of amplifiers 510, 510 and speakers 509, 509.

(24) FIG. 6 illustrates flow chart embodiment of the method 600 for providing audio-visual information along a continuous path in accordance with the invention. The method comprises different steps as herewith described. In a first step 601, an audio-visual system is provided comprising of a directional sound system, a display system and a sensor system. Next, during a second step 602, data detected by the sensor system is received for recognizing a person, living thing or object (related to said person or living thing, and in the vicinity thereof) in an area surrounding part of the audio-visual system. In a third step 603, a sound control signal is generated for emitting sound by means of the directional sound system (in the area surrounding part), connected with the sensor system, towards (and in accordance with) the person, living thing or object being recognized. A fourth step 604 comprises, generating an image control signal for displaying an image on part of the display system (in the area surrounding part), connected with the sensor system, in the area of (and in accordance with) the person, living thing or object being recognized. In a fifth step 605, the sound and image control signals are transmitted to the sound and display system respectively, such that the sound emitted and/or the image displayed is directed towards the person, living thing or object being recognized (in the area surrounding part), even when the person, living thing or object is moving along the continuous path. The method 600 may also comprise additional step 606 of receiving and interpreting sound emitted and/or gesture made by the person, living thing or object being recognized (in the area surrounding part). The method 600 may further comprise step 607 of interacting with the person, living thing or object being recognized (in the area surrounding part) by means of interrogating or responding, meaning directing questions or answers thereto.

Combinability of Embodiments and Features

(25) This disclosure provides various examples, embodiments, and features which, unless expressly stated or which would be mutually exclusive, should be understood to be combinable with other examples, embodiments, or features described herein.

(26) In addition to the above, further embodiments and examples include the following:

(27) 1. An audio-visual system to be provided along a continuous path, the audio-visual system comprising: a directional sound system, a display system, and a sensor system, wherein said audio-visual system is configured to receive data detected by the sensor system for recognizing a person, living thing or object in an area surrounding part of the audio-visual system; generate a sound control signal for emitting sound by means of the directional sound system, which is connected with the sensor system, towards said person, living thing or object being recognized; generate an image control signal for displaying an image on part of the display system, which is connected with the sensor system, in the area of said person, living thing or object being recognized; and transmit said sound and image control signals to said sound and display system respectively; and emit sound by the directional sound system and/or display an image by the display system such that the emitted sound and/or the image displayed is directed towards said person, living thing or object being recognized as said person, living thing or object moves along said continuous path.

(28) 2. The audio-visual system according to any or a combination of 1 above or 3-14 below, wherein the audio-visual system is configured to receive data detected by the sensor system for recognizing a plurality of persons, living things or objects, in corresponding plurality of area surrounding parts of the audio-visual system; generate a plurality of sound control signals, for emitting sound by means of the directional sound system, connected with the sensor system, towards each of said persons, living things or objects being recognized; generate a plurality of image control signals, for displaying an image on part of the display system, connected with the sensor system, in the area of each of said persons, living things or objects being recognized; and transmit said plurality of sound and image control signals to said sound and display system respectively.

(29) 3. The audio-visual system according to any or a combination of 1-2 above or 4-14 below, wherein said directional sound system comprises a piezo, a ultrasonic element, a horn system, and/or one or more amplifiers.

(30) 4. The audio-visual system according to any or a combination of 1-3 above or 5-14 below, wherein said directional sound system or said sensor system further comprises one or more directional microphones.

(31) 5. The audio-visual system according to any or a combination of 1-4 above or 6-14 below, wherein said display system comprises a plurality of LED display panels, projection displays, or LCD panels.

(32) 6. The audio-visual system according to any or a combination of 1-5 above or 7-14 below, wherein said display system further comprises one or more filters for adapting the viewing angle of the image shown.

(33) 7. The audio-visual system according to any or a combination of 1-6 above or 8-14 below, wherein said display system further comprises one or more filters for adapting the viewing angle of the image shown, and said adapting is based on the amount of persons, living things or objects amongst said plurality thereof being recognized.

(34) 8. The audio-visual system according to any or a combination of 1-7 above or 9-14 below, wherein said display system comprises a continuous LED display comprising of a plurality of LED tiles, each of the LED tiles having a LED processor, being controlled by an image splitter and a graphical card or graphics engine.

(35) 9. The audio-visual system according to any or a combination of 1-8 above or 10-14 below, further comprising a storage system, comprising a sound storage part and an image storage part, each of the sound storage part and the image storage part having multiple playout capability.

(36) 10. The audio-visual system according to any or a combination of 1-9 above or 11-14 below, further comprising a selector system for selecting sound and/or one or more images from the storage system.

(37) 11. The audio-visual system according to any or a combination of 1-10 above or 12-14 below, wherein said sensor system comprises a camera, an IR sensor, and/or an acoustic sensor.

(38) 12. The audio-visual system of 11 above, wherein said camera, IR sensor, or acoustic sensor is configured to distinguish a person from another living thing, or from an object.

(39) 13. The audio-visual system of 11 above, wherein said camera, IR sensor, or acoustic sensor is configured to distinguish a person from another living thing, or from an object, and in a case a person is recognized, said camera, IR sensor, or acoustic sensor is configured to perform people scanning including face and/or gait recognition.

(40) 14. The audio-visual system according to any or a combination of 1-13 above, wherein said camera, IR sensor, or acoustic sensor is configured to perform said people scanning including face and/or gait recognition based on AI techniques wherein the sensor system is equipped or trained with person-recognition methods.

(41) 15. A moving staircase, escalator or walkway, for transporting a person, living thing or object, comprising the audio-visual system according to any or a combination of 1-14 above.

(42) 16. A method for providing audio-visual information along a continuous path, said method comprising the steps of: providing an audio-visual system comprising of a directional sound system, a display system and a sensor system; receiving data detected by the sensor system for recognizing a person, living thing or object in an area surrounding part of the audio-visual system; generating a sound control signal for emitting sound by means of the directional sound system, which is connected with the sensor system, towards said person, living thing or object being recognized; generating an image control signal for displaying an image on part of the display system, which is connected with the sensor system, in the area of said person, living thing or object being recognized; and transmitting said sound and image control signals to said sound and display system respectively; emitting sound by the directional sound system and/or displaying an image by the display system such that the emitted sound and/or the image displayed is directed towards said person, living thing or object being recognized as said person, living thing or object moves along said continuous path.

(43) 17. The method according to any or a combination of 16 above or 18 below, further comprising the step of receiving and interpreting sound emitted and/or gesture made by said person, living thing or object being recognized.

(44) 18. The method according to any or a combination of 16 or 17 above, further comprising the step of interacting with said person, living thing or object being recognized by means of interrogating or responding, meaning directing questions or answers thereto.

(45) 19. A hardware storage device having stored thereon computer executable instructions which, when executed by one or more processors of a computer system of an audio-visual system comprising of a directional sound system, a display system, and a sensor system, configure the audio-visual system to perform the following for providing audio-visual information along a continuous path: receive data detected by the sensor system for recognizing a person, living thing or object in an area surrounding part of the audio-visual system; generate a sound control signal for emitting sound by means of the directional sound system, connected with the sensor system, towards said person, living thing or object being recognized; generate an image control signal for displaying an image on part of the display system, connected with the sensor system, in the area of said person, living thing or object being recognized; and transmit said sound and image control signals to said sound and display system respectively; emit sound by the directional sound system and/or display an image by the display system such that the emitted sound and/or the image displayed is directed towards said person, living thing or object being recognized as said person, living thing or object moves along said continuous path.