WINDOW-DISPLAY

Abstract

The invention relates to a window that simultaneously is a display. The window-display comprising: a frame encasing a double-glazed window made of a transparent material, where the double-glazed window comprises a layer that is a transparent display connected to the module for displaying an image on the said display. According to the invention, the module for displaying an image on the display is connected to the module for determining the location of the user's eyes in the room and is configured to recalculate the image depending on the location of the user's eyes. The achieved technical result is the expansion of the functionality of the window, namely the ability to use it as an image display device in the form of augmented reality, which adjusts to the user's location.

Claims

1. A window-display comprising: a frame encasing a double-glazed window made of a transparent material, where the double-glazed window comprises a layer that is a transparent display connected to the module for displaying an image on the said display; wherein the module for outputting an image to the display is connected to the module for determining the location of parts of the user's body in the room and is configured to recalculate the image depending on the location of the user's body parts.

2. The window-display of claim 1, wherein it has the module for determining the location of the user's body parts in the room, and is configured with the ability to locate the user's eyes.

3. The window-display of claim 1, wherein it has the module for determining the location of the user's body parts in the room and is configured with the ability to determine the location of the user's hands.

4. The window-display of claim 1, wherein it has the module for determining the user's location in the room made in the form of at least one video camera.

5. The window-display of claim 1, wherein it has the module for determining the user's location in the room made in the form of a stereo pair of two video cameras.

6. The window-display of claim 1, wherein it has the module for determining the location of the user in the room can be configured to select from a plurality of specific body parts of a plurality of users to one.

7. The window-display of claim 2, wherein it has the module for displaying an image on the display is configured to recalculate the perspective of the image in virtual space depending on the coordinates and direction of inclination and/or rotation of the user's head in three-dimensional space to create the user's illusion of free movement in virtual space.

8. The window-display of claim 2, wherein it has the module for displaying the image on the display is connected to the module for determining the location of the touch of the double-glazed window by the user.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Other features and advantages of the invention will clearly appear from the description which follows, by way of illustration and without being restrictive, with reference to the accompanying drawings wherein:

[0029] FIG. 1 schematically depicts a functional diagram of a window-display according to the invention;

[0030] FIGS. 2 and 3 schematically depict different options for displaying images depending on the position of the user, according to the invention, front view;

[0031] FIG. 4 schematically depicts the stages of operation of the window-display according to the invention.

[0032] According to FIGS. 1-3, the window-display includes a frame 1 encasing a double-glazed window 2 made of a transparent material. Wherein, the double-glazed window 2 includes a layer that is a transparent display connected to module 3 for displaying an image on the specified display. Module 3 for outputting an image to the display is connected to module 4 for determining the location of the user's body parts in the room and is configured to recalculate the image depending on the location of the user's body.

[0033] Module 4 for determining the location of the user's body parts in the room can be configured to determine the location of the user's eyes 5 and/or the location of the user's hands 6. (Shown conditionally in FIG. 1).

[0034] Module 4 for determining the location of the user in the room can be made in the form of at least one video camera or a stereo pair of two video cameras. (See FIG. 1).

[0035] The indoor user location module 4 may be configured to select from a plurality of specific body parts of a plurality of users alone.

[0036] Different algorithms can be used for this: [0037] selection of the closest user, [0038] selection of an arbitrary specific user, [0039] the choice of the user who is located in the geometric center of the set of users, that is, who has the minimum total distance to all other users, [0040] alternate switching between users.

[0041] Neural network algorithms can be used, which remember the choice and then automatically selects the optimal mode of operation. To do this, the device can remember the rating of its work, which the user assigns to it. For example, when a bad match of the displayed image is detected, a voice command is made, which is entered into the device database.

[0042] The display module 3 can be configured to recalculate the perspective of the image in virtual space depending on the coordinates and direction of inclination and/or rotation of the user's head in three-dimensional space to create the user's illusion of free movement in virtual space.

[0043] Module 3 displaying the image on the display can be connected to the module for determining the location of the touch of the insulating glass unit by the user. Not shown in the figure. This is touch-screen technology—determining the location of the touch screen.

[0044] Module 4 for determining the location of the user in the room can be made in the form of a mono or stereo video camera operating in the visible or infrared range. An example of such an implementation is Kinect, see for example https://wikipedia.org/wiki/Kinect

[0045] Not only video cameras can be used to determine the location of the user's body parts, but also technologies such as: [0046] Infrared positioning. A mobile tag in an infrared positioning system emits infrared pulses that are received by system receivers that have fixed coordinates. The location of the tag is calculated by Time-of-flight (ToF)—the time of signal propagation from the source to the receiver. The disadvantage of the method is the sensitivity to interference from sunlight. The use of an IR laser increases the range and accuracy. The positioning accuracy of this method is 10-30 centimeters. [0047] Ultrasonic positioning. Ultrasonic positioning systems use frequencies from 40-130 kHz. To determine the coordinates of the tag, the ToF of up to four receivers is usually measured. The main disadvantage is the sensitivity to signal loss in the presence (appearance) of even “light” obstacles, to false echoes, and interference from ultrasound sources, for example, from ultrasonic flaw detectors, ultrasonic cleaners in production, and ultrasound in a hospital. To eliminate these shortcomings, it is required to carefully plan the system. The advantage of ultrasonic systems is the highest positioning accuracy, reaching three centimeters.

[0048] In addition, the device may be equipped with a speaker for transmitting sounds and a microphone for receiving voice commands.

IMPLEMENTATION OF THE INVENTION

[0049] The window-display works as follows, see FIG. 4.

[0050] Stage A1. The user falls into the zone of visibility of module 4 for determining the location of parts of the user's body in the room.

[0051] Stage A2. The display output module 3 outputs an image to an area conventionally shown as 22, such as mountains or flying birds. At the same time, in the zone conditionally shown as 22, the user usually sees an image of what is outside the window, for example, houses or trees.

[0052] Stage A3. When the user position changes or the position of the user's head is changing, module 4 for determining the location of parts of the user's body in the room determines the position of the user's head and eyes, including coordinates and angles of inclination, rotation along three mutually perpendicular axes, and module 3 for displaying the image on the display changes the image in field 22 depending on the above, creating the effect of presence. For example, the user can view virtual objects that are “nearby” from different sides. Alternatively, this can be used to display information (video, text, etc.) exactly in the area of the window where the contrast is highest.

[0053] FIGS. 2 and 3 show how the virtual image displayed varies depending on the position of the user. Where is, FIG. 2 shows schematically what image is displayed on the screen when the user comes to the left of the window, particularly the main virtual object 7 and the virtual object 8 located to its left. FIG. 3 shows schematically what image is displayed on the screen when the user comes to the right of the window and sees other virtual objects, particularly the main virtual object 7 and the virtual object 9 located to the right of it.

[0054] Stage A4. Optionally, the user can control the image output parameters: pause, video rewind, color, contrast, brightness, change any modes, and other functions—by hand remotely. The user can also control the functions and outputs by voice.

[0055] Stage A5. Optionally, the user can control the image output parameters: pause, video rewind, color, contrast, brightness, change of any modes, and other functions—with the user's hands by touching the display.

INDUSTRIAL APPLICABILITY

[0056] A three-dimensional display can be implemented by a specialist and such implementation provides the realization of the stated purpose, which allows us to conclude that the criterion of “industrial applicability” for the invention is met.

[0057] The proposed window-display brings forth the ability to use it as an image output device in the form of augmented reality, which adapts to the user's location.

[0058] This is due to the fact that the device will allow to produce: [0059] 1. automatic recognition of the user's position; [0060] 2. automatic recognition of the position of the head and, in particular, the eyes of the user; [0061] 3. automatic recognition of the position of the user's hands; [0062] 4. automatic recalculation of the image displayed on the screen, depending on the received user coordinates.

[0063] The present invention can be used as: [0064] 1. Devices for displaying any images of augmented reality to create user comfort. [0065] 2. Devices for displaying any information, the output of which adapts to the user's location, for example, is displayed in the most contrasting area in the field of view. [0066] 3. Devices for managing the displayed information are not distant. [0067] 4. Devices for indoor sports in conjunction with simulators, in which the image outside the window changes depending on the conditionally traveled distance. [0068] 5. Devices in which a virtual interlocutor can follow the user's eyes, tracking his location, creating a “real dialogue effect”.

[0069] Thus, it is possible to utilize a window-display that implements the full effect of presence by displaying augmented reality objects on it adapting to the user's location and also respond to user's actions. The window-display in the dimming mode completely replaces a conventional TV, in the display deactivation mode it becomes a simple window. In the operating mode, it can be a combined option that displays dark letters on a light background, for example, the sky, as it is visible to the user, or light letters on the dark background of real objects, as they are visible from the user's side. The same goes for the image.

[0070] This way you can achieve the effect of complete immersion of being in another climatic zone, another geographical location, and even another planet.