Presentation system and presentation method

Abstract

A presentation system and method for the joint display by a playback system of a monitor image and a camera image, recorded by a video camera, of a presenter, involves the monitor image and the camera image being superposed in a mixer for display by the playback system. A monitor with a display is provided in order to display the monitor image for a presenter situated in front of the monitor, a semi-transparent mirror being arranged in front of the display, and the video camera being positioned such that it detects the presenter mirrored via the semi-transparent mirror. The at least one video camera of the presentation system is an infrared camera.

Claims

1. A presentation system for the joint display of a monitor image and a camera image, the presentation system comprising: a playback system including at least one video camera that records the camera image of a presenter; a mixer that superimposes the monitor image and the camera image for display by the playback system; a monitor having a display screen that displays the monitor image for the presenter, who is located in front of the monitor; a further camera arranged to record a color image of the presenter, based on which coloring of the camera image is performed; and a partially-transmissive mirror arranged in front of the display screen, wherein the at least one video camera is positioned so that the at least one video camera captures the presenter reflected via the partially-transmissive mirror, and wherein the at least one video camera is an infrared camera.

2. The presentation system of claim 1, wherein the partially-transmissive mirror is placed flatly on the display screen in parallel to the display screen.

3. The presentation system of claim 1, wherein the partially-transmissive mirror is integrated into the monitor as a protective glass for the display screen.

4. The presentation system of claim 1, wherein the partially-transmissive mirror has a touch-sensitive sensor surface.

5. The presentation system of claim 1, further comprising: a polarizing filter arranged in front of the at least one video camera.

6. The presentation system of claim 5, further comprising: a polarizer arranged between the display screen of the monitor and the partially-transmissive mirror.

7. The presentation system of claim 6, wherein the polarizer is a polarizing filter film extending flatly over an entirety of the display screen.

8. The presentation system of claim 1, further comprising: a color filter or a viewing angle filter arranged between the display screen of the monitor and the partially-transmissive mirror.

9. The presentation system of claim 1, further comprising: a control computer having an image processing unit, which uses real-time image processing to equalize the camera image to produce a modified camera image, wherein the modified camera image is relayed to the mixer.

10. The presentation system of claim 1, further comprising: a control computer having an image processing unit, which uses real-time image processing to equalize the camera image to produce a modified camera image, wherein the modified camera image is relayed via a network to a remote mixer.

11. The presentation system of claim 10, wherein the remote mixer is connected to a remote monitor, which functions as a further playback system and is part of a further presentation system.

12. The presentation system of claim 1, further comprising: at least one further mirror arranged in a beam path between the at least one video camera and the partially-transmissive mirror, wherein the presenter is captured by the at least one video camera reflected via the at least one further mirror and via the partially-transmissive mirror.

13. A presentation method for the joint display of a monitor image and a camera image, which is recorded using at least one video camera of a playback system, the method comprising: displaying, on a monitor having a display screen, the monitor image for a presenter located in front of the monitor; capturing, by the at least one video camera, the presenter reflected via a partially-transmissive mirror arranged in front of the display screen of the monitor in a camera image in an infrared wavelength range; real-time processing, by an image processing unit, the camera image to generate a modified camera image or equalizing the monitor image before the monitor image is display on the monitor, wherein the real-time processing of the camera image comprises coloring the camera image using a color image of the presenter captured by a further camera; and superimposing, by a mixer for the playback system, the monitor image and the modified camera image for display by the playback system.

14. The presentation method of claim 13, wherein the real-time processing of the camera image involves using a distorted input image, edge trimming an input image, detail enlargement of the input image, position correction of the input image, rotation correction of the input image, or mirroring the input image.

15. The presentation method of claim 13, wherein the playback system comprises a monitor of a further presentation system.

16. A presentation system, comprising: a monitor having a display screen that displays a monitor image for a presenter located in front of the monitor; a partially-transmissive mirror arranged in front of the display screen, an infrared video camera that records an infrared camera image of the presenter, wherein the infrared video camera is positioned so that the infrared video camera captures the infrared image of the presenter reflected via the partially-transmissive mirror; a color camera arranged to record a color image of the presenter, based on which coloring of the infrared camera image is performed; and a mixer that superimposes the monitor image and the colored infrared camera image and outputs a video image of the monitor image superimposed on the colored infrared camera image.

17. The presentation system of claim 16, wherein the partially-transmissive mirror is placed flatly on the display screen in parallel to the display screen.

18. The presentation system of claim 16, wherein the partially-transmissive mirror is integrated into the monitor as a protective glass for the display screen.

19. The presentation system of claim 16, wherein the partially-transmissive mirror has a touch-sensitive sensor surface.

20. The presentation system of claim 16, further comprising: a polarizing filter arranged in front of the at least one video camera; and a polarizer arranged between the display screen of the monitor and the partially-transmissive mirror, wherein the polarizer is a polarizing filter film extending flatly over an entirety of the display screen.

Description

BRIEF DESCRIPTION OF THE DRAWING FIGURES

(1) The invention will be explained in greater detail in the following on the basis of exemplary embodiments with the aid of figures. In the figures:

(2) FIG. 1 shows a schematic illustration of a presentation system for carrying out a presentation method;

(3) FIG. 2 shows details of the arrangement of several components of the presentation system shown in FIG. 1:

(4) FIG. 3 shows a schematic illustration of the presentation method, which can be carried out, for example using the presentation system of FIG. 1; and

(5) FIG. 4 shows a schematic illustration of a presentation system designed to carry out video conferences.

DETAILED DESCRIPTION

(6) FIG. 1 shows an exemplary embodiment of a presentation system according to the application in the form of a schematic block diagram. FIG. 2 shows the geometrical arrangement of parts of the presentation system relative to one another and in relation to a presenter using the presentation system.

(7) The presentation system comprises a video camera 10 (also referred to hereinafter as a camera 10), in front of the optical unit of which a polarizing filter 11 is arranged. Furthermore, the presentation system comprises a monitor 20, on the display screen (i.e., display surface) of which a polarizing filter film 21 as a polarizer and a partially-transmissive mirror 22 are placed. The video camera 10 is an infrared camera in the illustrated exemplary embodiment, the sensitivity of which is greater at wavelengths in the infrared range than in the visible range.

(8) The polarizing filter film 21 and the partially transmissive mirror 22 are planar, as is the display surface of the monitor 20.

(9) As explained in greater detail hereinafter, the polarizing filter film 21 can be omitted if the monitor 20 as such emits polarized light. In general, backlit LCD (liquid crystal display) monitors emit polarized light. If the monitor 20 is constructed on the base of a self-illuminating technology, for example having (possibly organic) light-emitting diodes, in contrast, the polarizing filter film 21 is advantageously used.

(10) The partially-transmissive mirror 22 can be placed separately on the display screen of the monitor 20, but the partially-transmissive mirror 22 can also be an integral component of the monitor 20. It is crucial that light can both pass through the partially-transmissive mirror 22, and also a part of the light incident from the front on the partially-transmissive mirror 22 is reflected.

(11) FIG. 2 shows the arrangement of the camera 10 and the monitor 20 in relation to one another and relative to a presenter 1 who uses the presentation system. This presenter is advantageously located centrally in front of the monitor 20, so that he can observe an image output by the monitor 20. The camera 10 is arranged inclined above the presenter 1 in such a way that an image of the presenter 1, which is reflected from the partially-transmissive mirror 22, is captured by the camera 10. In the scope of the application, a “presenter” is to be understood as any user of a presentation system, no matter what purpose the presentation system is used for. In these terms, video conference participants or moderators are also to be considered “presenters”. The illustrated observation angle, at which the presenter 1 looks at the monitor 20, is variable here as long as the camera 10 can be arranged and aligned so that it can capture the image of the presenter 1 reflected from the partially-transmissive mirror 22. An optionally dark background behind the camera 10 reduces the reflections on the monitor 20 for the presenter 1 and thus facilitates the reading.

(12) As in turn can be seen in FIG. 1, both the camera 10 and also the monitor 20 are connected to a control computer 30. The control computer 30 comprises a monitor image generator 31, for example a presentation program which provides images (“slides”) for a presentation. These are relayed to a first graphics unit 32 (also called graphics card), which is connected to the monitor 20 and displays an image output by the monitor image generator 31 on the monitor 20. FIG. 3 schematically shows such a monitor image 200, which is output by the monitor 20. The monitor image 200 is symbolized in FIG. 1 in the form of data which are output by the monitor image generator 31.

(13) The presenter 1 sees the monitor image 200 on the monitor 20 in front of him and can point with fingers 2 at elements of the monitor image 200 or direct his eyes 3 to sections of the monitor image 200.

(14) During this, the presenter 1 is captured by the camera 10, which outputs a camera image 100 in real time. This is also shown in FIG. 3. In FIG. 1, the camera image 100 is again symbolized in the form of data, which are transmitted from the camera 10 to the control computer 30.

(15) Due to the arrangement of the camera 10 obliquely in relation to the monitor 20 and the partially-transmissive mirror 22, edges 23 of the monitor 20 reproduced in the camera image 100 are distorted, for example like a trapezoid. Parts of the camera image 100 reflected from the partially-transmissive mirror 22 are not distorted due to the physical nature of the reflection, however. Moreover, the camera image 100 can comprise a larger section than is reflected from the partially-transmissive mirror 22.

(16) Due to the use of an infrared camera as the video camera 10, the monitor image is hidden in the camera image 100. An optimum impression for the observer of the monitor 20—also in the dark—may be achieved by a combination of the infrared camera with infrared illumination of the scene and possibly in addition a display screen film on the monitor 20, which preferably reflects infrared radiation, but is transmissive to visible light.

(17) Due to the use of the infrared camera as the video camera 10, the presenter 1 and his surroundings can be sufficiently illuminated, without the presenter 1 being disturbed by the light sources themselves or by reflections of the light sources or the illuminated surroundings on the monitor. A color impression of the camera image 100 may then be achieved by using a further camera, which possibly creates a true color image at lower pixel resolution. This true color image can be used for simultaneous coloring of the monitor image 200, for example using artificial intelligence. A static color image of the presenter 1 can also be used as a color template for the coloring of the camera image 100.

(18) The camera is focused on the presenter 1. This has the result that elements in the plane of the partially-transmissive mirror 22 cannot be sharply captured by the camera 10, since the depth of field range of the camera 10 generally does not extend this far in normal ambient illumination. It is therefore advantageous if the camera 10 does not record the image of the monitor 20 as much as possible, since it would only be displayed fuzzily.

(19) So as not to have the monitor image 200 reach the camera 10, the polarizing filter 11 is additionally arranged in front of the camera 10 in the illustrated example. It is set so that light emitted by the monitor 20, which is polarized inherently or due to the polarizing filter film 21 placed in front, does not reach the camera 10, but rather is hidden by the polarizing filter 11. For this reason, the monitor image 200 which the presenter 1 sees is furthermore suppressed in the camera image 100. If the polarizing filter film 22 polarizes linearly, for example, the polarizing filter 11 is aligned so that the polarizing filter film 21 and the polarizing filter 11 have polarization planes crossed in relation to one another.

(20) In one refinement of this arrangement, a reflective polarization film can be used, which combines the properties of the polarizing filter film 21 and the partially-transmissive mirror 22 with minimal losses and accordingly forms both the polarizing filter film 21 and also the partially-transmissive mirror 22.

(21) Instead of a combination of polarizing filter 11 and polarizing filter film 21, an angle-dependent transmission filter attached to the display screen, also called a viewing angle filter, can be used to hide the monitor image 200 from the camera image 100.

(22) A monitor 20 can also additionally be used, which has narrowband color emitters, for the wavelength of which the camera 10 is as insensitive as possible or is made insensitive by corresponding upstream filters.

(23) An additional suppression of the monitor image 200 in a time domain is also possible, for example in that the displays on the monitor 20 take place stroboscopically, for example via a switchable mirror. During the times in which the monitor image 200 is visible, the camera 10 is electrically cycled off by an electronic camera shutter, or the monitor image 20 is optically hidden by a switchable transmission filter, which is arranged in front of the camera 10.

(24) The camera 10 is connected inside the control computer 30 to an image processing unit 33, which performs a transformation of the camera image 100 in real time, using which, for example, the trapezoidal distortion of the edge 23 of the monitor 20 resulting due to the arrangement of the camera 10 is compensated for (cf. FIG. 3). This is relevant in particular to superimpose the camera image 100 with the monitor image 200 so that the two images are congruent in the output image 400 and the observers of the output image 400 can comprehend which point in the monitor image 200 the presenter 1 is actually looking or pointing at.

(25) Alternatively or additionally to the modification of the camera image 100, the playback of the monitor image 200 on the monitor 20 for the presenter can be pre-distorted so that congruency of the two images on the output image 400 again results.

(26) It is to be noted that this modification of camera image 100 and/or playback of the monitor image 200 on the monitor 20 can also be used in presentation systems in which a separation of the image of the presenter in the camera image 100 is not carried out by using an infrared camera, but rather, for example by dark switching of the monitor 20 in the recording phases of the camera.

(27) Optionally, edge trimming or detail enlargement and/or a position correction and/or rotation correction and/or mirroring can additionally be performed. The image processing unit 33 correspondingly outputs a modified camera image 330, as can be seen in FIG. 3. The above-mentioned simultaneous coloring can also be performed in the image processing unit 33.

(28) The control computer 30 furthermore comprises a second graphics unit 35 (i.e. a further graphics card), to which both the monitor image 200 and also the modified camera image 330 are supplied via a mixer 34. The mixer 34 superimposes the two images, possibly with adjustable degree of brightness and/or transparency. A playback system 40, on which the superposition of the monitor image 200 and the modified camera image 330 is displayed as the output image 400, is connected to the second graphics unit 35.

(29) In the case of a lecture or a presentation, the playback system 40 can be, for example a projection system (projector), which displays the output image 400 on a projection surface behind the presenter 1. The second graphics unit 35 can additionally or alternatively also be designed to transmit (“stream”) or store the output image 400 in a data format.

(30) The presentation system shown or the presentation method explained in conjunction with FIG. 3 offers the advantage that the presenter 1 can observe the monitor image 200 and nonetheless a frontal recording of the presenter 1 can be presented for the audience in the output image 400. The output image 400 on the playback system 40 moreover shows the monitor image 200, so that the playback system 40 unifies both perspectives necessary or of interest for the presentation, the presenter who is frontally visible and the material to which the presenter 1 refers, in one image.

(31) When the presenter 1 fixes on specific points or regions of the monitor image 20 with his eyes 3 or points at them with his finger, the corresponding eye movement and alignment or pointing direction is also to be made out on the output image 400. The presenter 1 thus behaves completely naturally with respect to the monitor image 200, whereby it is easy for the audience to comprehend where the focus of the presenter 1 is presently directed.

(32) In one refinement of the described presentation system, the partially-transmissive mirror 22 can be provided with a touch-sensitive surface and can thus be used as an input element for the control computer 30. A capacitively operating touch-sensitive surface is preferably provided, which can be operated using the finger 2 or a digital input pencil (not shown here).

(33) In this design, the presenter 1 can operate the monitor 20 with the finger like a touchscreen or, if a corresponding interactive program is used, can influence the monitor image 200. The presentation system can be used like a tablet, in that the presenter 1 places markings or writes with the aid of the digital input pencil on the partially-transmissive mirror and thus on the monitor 20. The audience sees the resulting “tablet image” and simultaneously the presenter in a frontal view on the playback monitor 40.

(34) In a further modification of the presentation system shown in FIGS. 1 and 2, the camera 10 can be dynamically moved either directly or via mirrors, in order to obtain an optimum image impression, even if the person is not located centrally in front of the display screen.

(35) In a further modification of the presentation system, the camera 10 can also be implemented multiple times and can be laterally attached, for example, and in each case can observe the presenter 1 via reflection on the monitor 20. Images of the plurality of cameras 10 can then be assembled to form one image, which appears to originate from a “virtual” camera. Such a virtual camera can be moved to positions, for example by means of three-dimensional calculations, which would otherwise not be accessible. The option is also possible in conjunction with multiple, for example two cameras 10, which are designed as infrared cameras. Images of these cameras 10 are then preferably firstly combined to form an image of a virtual camera, which is then colored on the basis of items of color information of an additional true color camera.

(36) In a further modification of the presentation system shown in FIGS. 1 and 2, greater flexibility in the positioning of the camera 10 can be achieved by at least one additional mirror, which is arranged between the camera 10 and the partially-transmissive mirror 22. This mirror can in particular also be transparent to the visible light in order to be less interfering.

(37) For example, it is possible to use the monitor of a laptop computer as the monitor 20. Laptop computers frequently have a camera arranged centrally above the monitor 20, which is oriented toward the user of the laptop. Using an inclined additional mirror arranged in front of the plane of the monitor 20 and above the monitor 20 from the presenter, an image of the presenter can be recorded by the integrated camera of the laptop computer reflected on the partially-transmissive mirror 22 and then reflected on the additional mirror. The additional mirror can be placed, for example using a small telescopic or gooseneck mount having clamp fastening on the upper edge of the laptop, whereby the laptop computer represents camera, monitor, and control computer of a presentation system.

(38) In a further modification of the presentation system shown in FIGS. 1 and 2, a mobile variant can be implemented by using a possible small, for example wireless camera on the body of the presenter, which in turn records the observer via reflection on the monitor, for example of a mobile telephone or a tablet computer. In this case, the perspective correction is to be adapted in real time to the geometrical situation, which is variable under certain circumstances. Outlines of the monitor can be detected for this purpose, for example. A suitable angle between the monitor and the camera can be tracked manually or automatically by means of servomotors, for example.

(39) An arrangement of two interconnected presentation systems is shown in FIG. 4 in a schematic illustration similar to FIG. 1. Identical reference signs identify identical or identically-acting elements in this figure as in the preceding figures.

(40) The arrangement of FIG. 4 is designed as a video conference system for two participants by way of example here. Accordingly, components of the presentation system are provided twice and are each associated with a first or a second participant, respectively. The reference signs of components which are associated with the second participant are provided with an apostrophe for easier differentiability.

(41) The arrangement comprises a camera 10, 10′ having polarizing filter 11, 11′ in front of it for each participant. Furthermore, a monitor 20, 20′ having a polarizing filter film 21, 21′ and a partially-transmissive mirror 22, 22′ is provided for each participant. Each part of the arrangement furthermore has a control computer 30, 30′, in which the data supplied by the camera 10, 10′ are processed in an image processing unit 33, 33′ to form a modified camera image 330, 330′. Reference is made to the embodiment of FIGS. 1 and 2 with respect to the geometrical arrangement of camera 10, 10′ and monitor 20, 20′. In each of the two parts of the arrangement according to FIG. 4, the corresponding camera 10, 10′ records the image of a presenter—in this exemplary embodiment called a participant—reflected via the monitor 20, 20′ and in particular the partially-transmissive mirror 22, 22′.

(42) In contrast to the above-described exemplary embodiment, in the present case the modified camera image 330, 330′ is not transmitted via the mixer 34 to a second graphics unit 35, but rather via a network interface 36 to a mixer 34′ of the second part of the arrangement. The modified camera image is supplied there with a monitor image 200, which is provided by a monitor image generator 31′, to the first graphics unit 32′, which transmits the superposition of the monitor image 200 and the modified camera image 330 to the monitor 20′ for display for the second participant. The monitor 20′ of the second participant thus forms the playback system 40 (cf. FIG. 1) in this exemplary embodiment. The entire part of the monitor 20, 20′ or in each case a part thereof, for example in the form of a window, can be used as the playback system.

(43) Vice versa, the camera image 100′ of the second discipline is equalized by the image processing unit 33′ and transmitted via the network interface 36′ as the modified camera image 330′ of the second participant to the control computer 30 of the first participant. A superposition also takes place here in a mixer 34 with the monitor image 200, which is provided by a monitor image generator 31. The superimposed images are output via the first graphics unit 32 on the monitor 20 of the first participant. The monitor image generators 31, 31′ are preferably synchronized in both control computers 30, 30′, so that in both cases the same monitor image 200 is mixed with the respective modified camera image 330, 330′. Two interconnected presentation systems are formed in this way, wherein the monitor 20, 20′ of the one system also functions as the playback system of the other system.

(44) Due to the described method, each of the two participants sees the monitor image 200 and his interlocutor, i.e., the respective other participant, on the monitor 20. Both participants can thus look simultaneously at the monitor image 200 and possibly process it, upon use of a touch-sensitive monitor 20, 20′. With suitable alignment of camera 10, 10′ or monitor 20, 20′ moreover both participants see themselves with eye contact.

(45) A synchronization of the two monitor image generators 31, 31′ is represented in FIG. 4 by a dashed arrow. It is apparent that the total of three connections thus shown between the control computers 30, 30′ are formed by a single network connection. Of course, the modified camera images 330, 330′ and the items of synchronization information for the monitor image 200 can be transmitted at different data rates and latencies in this case, however, to take into consideration the more quickly changing camera images 100, 100′.

(46) In contrast to the illustration in FIG. 4, mixing of the modified camera image 330, 330′ with the monitor image 200 can also take place in the respective control computer 30, 30′ before a transmission takes place to the respective other control computer 30, 30′.

(47) Although the invention has been illustrated and described in detail by way of preferred embodiments, the invention is not limited by the examples disclosed, and other variations can be derived from these by the person skilled in the art without leaving the scope of the invention. It is therefore clear that there is a plurality of possible variations. It is also clear that embodiments stated by way of example are only really examples that are not to be seen as limiting the scope, application possibilities or configuration of the invention in any way. In fact, the preceding description and the description of the figures enable the person skilled in the art to implement the exemplary embodiments in concrete manner, wherein, with the knowledge of the disclosed inventive concept, the person skilled in the art is able to undertake various changes, for example, with regard to the functioning or arrangement of individual elements stated in an exemplary embodiment without leaving the scope of the invention, which is defined by the claims and their legal equivalents, such as further explanations in the description.

LIST OF REFERENCE NUMERALS

(48) 1 presenter 2 finger 3 eye 10, 10′ video camera 100 camera image 11, 11′ polarizing filter 20, 20′ monitor 200 monitor image 21, 21′ polarizing filter film 22, 22′ partially-transmissive mirror 23 edge 30, 30′ control computer 31, 31′ monitor image generator 32, 32′ first graphics unit 33, 33′ image processing unit 330 modified camera image 34, 34′ mixer 35 second graphics unit 36, 36′ network interface 40 playback system 400 output image