PRESENTATION SYSTEM AND PRESENTATION PROCEDURES
Patent Information
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- UNIVERSITY OF KASSEL
- Filing Date
- 2019-06-26
- Publication Date
- 2026-05-21
AI Technical Summary
Existing presentation systems fail to allow presenters to view a monitor image while being recorded by a camera without losing eye contact with the audience, especially when the monitor image is interactive, requiring hardware modifications or high camera sensitivity.
A presentation system using an infrared camera in combination with a semi-transparent mirror and polarizing filters to capture the presenter's image without the monitor image interference, allowing interactive use of the monitor and maintaining eye contact.
Enables presenters to interact with the monitor while being recorded, ensuring optimal viewing for the audience without monitor reflections, and can be retrofitted to existing monitors without hardware modifications.
Description
[0001] The invention relates to a presentation system for the simultaneous display of a monitor image and a camera image of a presenter recorded by a video camera using a playback system, wherein the monitor image and the camera image are superimposed in a mixer for display by the playback system. A monitor with a display is provided to show the monitor image to a presenter located in front of the monitor, wherein a semi-transparent mirror is arranged in front of the display, and wherein the at least one video camera is positioned such that it captures the presenter reflected via the semi-transparent mirror. The invention further relates to a method for displaying a camera image recorded by a video camera of a presenter together with a monitor image using a playback system.
[0002] In presentations to a large audience, the speaker is often recorded with a video camera, and the image captured by the video camera is displayed using a playback system, such as a projector with a screen. In a typical presentation or lecture situation, the speaker frequently refers to a monitor image, which may contain text or graphics. This monitor image is usually shown to the audience either via a separate playback system or as a background or foreground image on the aforementioned playback system, alongside the speaker.
[0003] When the presenter turns to the display system to refer to the monitor image, they turn their back to the audience and consequently lose contact with them. To prevent this, presenters often use a second monitor, such as a laptop, placed in front of them, allowing them to see the monitor image while still facing the audience. However, if the presenter is looking at this second monitor, they cannot simultaneously look into the camera, resulting in a distracting image of the presenter alongside the monitor image on the display system. This effect is particularly noticeable when the monitor image is not static but is being modified or developed during the presentation, for example, through touchscreen input or the use of a digital pen.
[0004] A similar situation arises in studio television broadcasts when a presenter is supposed to look into the camera on the one hand and point to something that is either physically arranged behind or in front of him or is only displayed for the viewer, such as a weather map.
[0005] A similar situation is that of a video conference where one participant looks at the image of a remote participant on a monitor and is being recorded by a camera positioned next to the monitor. When the participant looks at the monitor, they see their conversation partner – however, the latter does not feel that the participant is making eye contact with them. This feeling only occurs when the participant looks directly into the camera – in which case, they cannot see their conversation partner on the monitor.
[0006] Such a presentation system can also be used in a video conference to collaboratively work on a document interactively. In this case, the presentation system is present at least twice, with each conference participant assigned a camera and a monitor, and the monitor simultaneously serving as a display for the camera image of at least one other conference participant. Here, too, the problem of the lack of eye contact arises.
[0007] Document US 2004 / 0196359 A1 discloses an arrangement for conducting video conferences in which the participant in the video conference views the image of his conversation partner through a semi-transparent curved mirror, while the camera recording him is positioned behind the mirror and records at least the participant's face through the mirror.
[0008] The use of the curved mirror allows the monitor to be positioned to the side of the participant, so that it is not on the camera's optical axis and therefore does not obstruct the camera's view of the presenter's face. However, the image on the monitor appears to the participant to be coming from the direction of the camera, meaning that when looking at the monitor, they are also looking directly at the camera. With this setup, the monitor is not directed towards the participant, so they cannot interact with it, for example, by using a touchscreen or a digital pen.
[0009] The German patent application DE 11 2010 001 819 T5 describes a videoconferencing system in which a presenter stands in front of a semi-transparent display surface onto which the monitor image is projected and through which the presenter is recorded by the camera. A disadvantage of this system is its size, which is due to the rear projection of the monitor image onto the display surface.
[0010] From US patent 9,270,933 B1, a system of the type described above is known, which enables a video conference in which a participant is captured in such a way that, while looking at a monitor image, they are simultaneously looking into a camera. This is achieved by having a reflective surface on the monitor, and the participant is captured by the camera as a reflection off this surface. In order to separate the image of the participant from that of the monitor in the camera recording, the monitor is periodically switched off briefly, with only the camera recording being processed during this period of darkening. The duration of the darkening is chosen to be so short that it does not result in a flickering monitor image for the participant.A disadvantage of this system, however, is that the very short camera recording times necessitate high camera sensitivity, which can lead to a noisy image, or the participant must be illuminated with high light intensity, which can cause glare. Another drawback is that existing monitors, such as a laptop screen, cannot be easily dimmed in the required rapid sequence without hardware modification, meaning the procedure can only be performed with dedicated monitor systems.
[0011] From publication US 2016 / 0227164 A1, an electronic system is known which comprises a reflective film with a diffraction grating configured to reflect an image within a grating spectrum at a reflection angle, and which includes an image acquisition unit positioned in a device orientation to capture the image reflected by the reflective film.
[0012] From US patent application 2012 / 0224019 A1, a method for modifying an image in a video is known, comprising the step of capturing an image in the visible light spectrum of an area, wherein the visible light image is captured at a first frame rate. The method further comprises the step of capturing a corresponding infrared image of the area, wherein the infrared image is captured when the area is illuminated with an infrared light source, and the infrared image is captured at substantially the same frame rate as the visible light image. Based on the infrared image, at least a subset of the human-perceivable features of the captured visible light image is modified.
[0013] It is an object of the present invention to create a compact presentation system or presentation method of the type mentioned above, in which a presenter can view a monitor and also use the monitor surface interactively, e.g., with a digital pen, while simultaneously being captured by a camera in such a way that the presenter is looking into the camera while looking at the monitor. The system should be easily retrofittable to an existing monitor without requiring any modifications to its hardware. Of additional importance is that the viewer can see where the presenter is looking and pointing on the screen.
[0014] This task is solved by a presentation system and a presentation procedure with the features of the respective independent claim. Advantageous embodiments and further developments are the subject of the dependent claims.
[0015] A presentation system according to the invention of the type mentioned at the outset is characterized in that the at least one video camera is an infrared camera.
[0016] By using an infrared camera, preferably in combination with infrared illumination of the scene (i.e., the presenter), the monitor image does not appear in the camera image or only with negligible intensity. Simultaneously, this provides an optimal viewing experience for the monitor viewer, as they are not distracted by reflections of their own image. This effect can be further enhanced by additionally using a screen overlay or similar material on the monitor that preferentially reflects infrared radiation but is transparent to visible light. Otherwise, unlike the previously known method of temporarily darkening the monitor, no modification of the monitor is necessary.
[0017] By using an infrared camera, the presenter and his surroundings can be sufficiently illuminated without the presenter being disturbed by the light sources themselves or by reflections of the light sources or the illuminated surroundings on the monitor.
[0018] For the purposes of this application, an infrared camera is defined as a video camera whose intensity in the infrared wavelength range, i.e., at wavelengths greater than approximately 780 nanometers (nm), is significantly higher than in the visible light range, i.e., at wavelengths in the range of approximately 400-750 nm. This sensitivity distribution can be achieved, for example, through appropriate sensors in the video camera and / or the use of filters.
[0019] By mirroring the presenter's image on the monitor, the presenter looks both at the information displayed on the monitor and towards the camera. Since the presenter is not recorded by the video camera through the monitor, a standard monitor with a flat and compact design can be used.
[0020] In an advantageous embodiment of the presentation system, the semi-transparent mirror is mounted flat on the display, parallel to it. It can, for example, be integrated into the monitor as a protective glass for the display. Preferably, the semi-transparent mirror also has a touch-sensitive sensor surface, allowing the monitor to be used as a touchscreen, for example, for interactive drawing on the monitor. The presentation system can then be used as a blackboard or whiteboard.
[0021] In a further advantageous embodiment of the presentation system, a polarizing filter is arranged in front of the at least one video camera. Preferably, a polarizer, in particular a polarizing filter film extending across the entire display, is arranged between the monitor's display and the semi-transparent mirror. Alternatively, a monitor that emits polarized light due to its operating principle can be used. The polarizing filter in front of the video camera, which blocks the light that is inherently polarized or polarized due to the polarizer placed in front of the monitor, ensures that light emitted by the monitor does not reach the video camera. The monitor image seen by the presenter is therefore not visible in the camera image. The polarizing filter in front of the video camera and the polarizer can, for example, have crossed polarization planes if linear polarization of the light is used to block the monitor image.Alternatively, the monitor image can also be hidden via circular or elliptical polarization.
[0022] In an alternative configuration of the presentation system, a color filter or viewing angle filter is positioned between the monitor display and the semi-transparent mirror. This also allows the monitor image to be further suppressed within the camera image. Additional suppression of the monitor image is also possible in a specific time domain, for example, by using a stroboscopic display on the monitor, such as via a switchable mirror. During the times when the monitor image is visible, the video camera is electrically deactivated by an electronic shutter, or the monitor image is optically blocked by a switchable transmission filter positioned in front of the video camera.
[0023] In a further advantageous embodiment, the presentation system comprises a control computer with an image processing unit that enables real-time image processing for correcting the camera image, whereby a modified camera image is forwarded to the mixer. The image processing unit can correct in real time any distortion of the camera image caused by the angle of the camera to the monitor, so that both the monitor image and the presenter are correctly positioned relative to each other in the playback system. This is particularly relevant when the presenter is looking at or pointing to the monitor, so that the output image accurately reflects where the presenter is looking or pointing.Alternatively or additionally, the monitor image seen by the presenter can be pre-distorted, so that the two images (monitor image and camera image) are again identical in the output image.
[0024] In a further advantageous embodiment, the presentation system is configured such that the modified camera image is transmitted via a network to a remote mixer. The remote mixer is preferably connected to a remote monitor. This monitor, located away from the presenter, functions both as a playback system and as part of a further presentation system, thus enabling the presentation system to be used as a video conferencing system.
[0025] In a further advantageous embodiment of the presentation system, at least one additional mirror is arranged in a beam path between the at least one video camera and the semi-transparent mirror, whereby the presenter is captured by the at least one video camera via the reflection of the at least one additional mirror and the semi-transparent mirror. The at least one additional mirror allows for greater flexibility in positioning the video camera.
[0026] In the embodiment of the presentation system according to the claimed invention, a further camera is provided and arranged to capture a color image of the presenter, based on which the camera image and / or the monitor image can be colorized. In this way, the otherwise black and white or grayscale infrared image of the presenter can be colorized to enable natural color reproduction. According to the claimed invention, the further camera is directed at the presenter directly, i.e., not in a reflection geometry. The colorization can utilize artificial intelligence algorithms, in particular self-learning algorithms. In an alternative embodiment not covered by the claims, a static color image can be used instead of the further camera image, the colors of which are then transferred to the moving infrared image.
[0027] In a presentation method according to the invention, at least one video camera captures a presenter in an infrared wavelength range, reflected by a semi-transparent mirror arranged in front of a monitor displaying a monitor image. The camera image is then modified in real time by an image processing unit and / or the monitor image is distorted before being displayed on the monitor. The potentially distorted monitor image and the modified camera image are superimposed in a mixer for display by the playback system. This results in the advantages mentioned in connection with the presentation system.
[0028] In an advantageous further development of the presentation process, the camera image is distorted and / or edge cropping and / or section enlargement and / or position correction and / or rotation correction and / or mirroring is performed in the modification step.
[0029] In a further advantageous development of the presentation method, the playback system includes a monitor of another presentation system. The monitor image and the superimposed, modified camera image of the presenter (in this case referred to as a participant) are thus displayed as a monitor image on a monitor that is itself used by another participant as part of the further presentation system. The camera image of this second participant is then superimposed in a similar manner on the monitor image of the first participant, so that the arrangement of the two presentation systems enables the conduct of a video conference.
[0030] The invention is explained in more detail below using exemplary embodiments and the accompanying figures. The figures show: Fig. 1 a schematic representation of a presentation system for carrying out a presentation procedure; Fig. 2 details of the arrangement of some components of the Fig. 1 presentation system shown; Fig. 3 a schematic representation of the presentation method, which can be used, for example, with the presentation system of the Fig. 1 can be carried out; and Fig. 4 a schematic representation of a presentation system designed for conducting video conferences.
[0031] In Fig. 1 An exemplary embodiment of a presentation system in accordance with the application is shown in the form of a schematic block diagram. Fig. 2 shows the geometric arrangement of parts of the presentation system relative to each other and in relation to a presenter using the presentation system.
[0032] The presentation system comprises a video camera 10 (hereinafter also referred to as camera 10), in front of whose lens a polarizing filter 11 is arranged. The presentation system further comprises a monitor 20, on whose display (i.e., display surface) a polarizing filter film 21 as a polarizer and a partially transparent mirror 22 are mounted. In the illustrated embodiment, the video camera 10 is an infrared camera whose sensitivity at wavelengths in the infrared range is greater than in the visible range.
[0033] The polarizing filter film 21 and the semi-transparent mirror 22 are, like the display surface of the monitor 20, planar.
[0034] As will be explained in more detail below, the polarizing filter film 21 can be omitted if the monitor 20 emits polarized light itself. Backlit LCD (Liquid Crystal Display) monitors typically emit polarized light. However, if the monitor 20 is based on a self-illuminating technology, for example with (possibly organic) light-emitting diodes, the polarizing filter film 21 is advantageously used.
[0035] The semi-transparent mirror 22 can be mounted separately on the display of the monitor 20, or it can be an integral component of the monitor 20. The crucial factor is that light can pass through the semi-transparent mirror 22, and that some of the light incident on the semi-transparent mirror 22 from the front is reflected.
[0036] Fig. 2 Figure 1 shows the arrangement of camera 10 and monitor 20 relative to each other and to a presenter 1 using the presentation system. The presenter is advantageously positioned centrally in front of monitor 20 so that they can view an image displayed by monitor 20. Camera 10 is positioned at an angle above presenter 1 such that it captures an image of presenter 1 reflected by the semi-transparent mirror 22. For the purposes of this application, "presenter" refers to any user of a presentation system, regardless of the purpose for which the system is used. Therefore, video conference participants and moderators are also considered "presenters."The viewing angle shown, from which the presenter 1 looks at the monitor 20, is variable, as long as the camera 10 can be positioned and aligned so that it can capture the image of the presenter 1 reflected by the semi-transparent mirror 22. An optional dark background behind the camera 10 reduces reflections on the monitor 20 for the presenter 1 and thus makes it easier to read.
[0037] As again in Fig. 1 As can be seen, both the camera 10 and the monitor 20 are connected to a control computer 30. The control computer 30 includes a monitor image generator 31, for example, a presentation program that provides images ("slides") for a lecture. These are forwarded to a first graphics unit 32 (also called a graphics card), which is connected to the monitor 20 and displays an image output by the monitor image generator 31 on the monitor 20. Fig. 3 Figure 200 schematically shows such a monitor image as displayed by monitor 20. In the Fig. 1 The monitor image 200 is symbolized in the form of data output by the monitor image generator 31.
[0038] The presenter 1 sees the monitor image 200 on the monitor 20 in front of him and can point to elements of the monitor image 200 with his fingers 2 or focus his eyes 3 on sections of the monitor image 200.
[0039] Meanwhile, the presenter 1 is captured by camera 10, which outputs a camera image 100 in real time. This is also in Fig. 3 reproduced. In the Fig. 1 The camera image 100 is in turn symbolized in the form of data that is sent from the camera 10 to the control computer 30.
[0040] Due to the angled positioning of the camera 10 relative to the monitor 20 and the semi-transparent mirror 22, the edges 23 of the monitor 20, as displayed in the camera image 100, are distorted, for example, in a trapezoidal shape. However, the portions of the camera image 100 reflected by the semi-transparent mirror 22 are not distorted due to the physical nature of reflection. Furthermore, the camera image 100 can encompass a larger area than is reflected by the semi-transparent mirror 22.
[0041] By using an infrared camera as a video camera 10, the monitor image is hidden in the camera image 100. An optimal impression for the viewer of the monitor 20 – even in the dark – can be achieved by combining the infrared camera with infrared illumination of the scene and, if necessary, additionally with a screen film on the monitor 20 that preferentially reflects infrared radiation but is transparent to visible light.
[0042] By using the infrared camera as a video camera 10, the presenter 1 and their surroundings can be sufficiently illuminated without the presenter 1 being disturbed by the light sources themselves or by reflections of the light sources or the illuminated surroundings on the monitor. A color impression of the camera image 100 can then be achieved by using another camera, which may have a lower pixel resolution and produce a true-color image. This true-color image can be used for simultaneous colorization of the monitor image 200, for example, using artificial intelligence. A static color image of the presenter 1 can also serve as a color reference for colorizing the camera image 100.
[0043] The camera is focused on the presenter 1. As a result, elements in the plane of the semi-transparent mirror 22 cannot be sharply captured by the camera 10, since the depth of field of the camera 10 does not usually extend that far under normal ambient lighting conditions. It is therefore advantageous if the camera 10 does not capture the image of the monitor 20 as much as possible, since this would only be displayed blurry.
[0044] To prevent the monitor image 200 from reaching the camera 10, a polarizing filter 11 is additionally positioned in front of the camera 10 in the illustrated example. It is adjusted so that light emitted from the monitor 20, which is inherently polarized or polarized due to the polarizing filter film 22, does not reach the camera 10 but is blocked by the polarizing filter 11. For this reason, the monitor image 200, which the presenter 1 sees, is further suppressed in the camera image 100. If, for example, the polarizing filter film 22 is linearly polarized, the polarizing filter 11 is aligned so that the polarizing filter film 22 and the polarizing filter 11 have polarization planes that are crossed relative to each other.
[0045] In a further development of this arrangement, a reflective polarizing film can be used which combines the properties of the polarizing filter film 22 and the partially transparent mirror 22 with minimal losses and accordingly forms both the polarizing filter film 22 and the partially transparent mirror 22.
[0046] Instead of a combination of polarizing filter 11 and polarizing filter film 22, an angle-dependent transmission filter, also called a viewing angle filter, applied to the display can also be used to mask the monitor image 200 from the camera image 100.
[0047] Additionally, a monitor 20 can be used which has narrowband color emitters, for whose wavelength the camera 10 is as insensitive as possible or is made insensitive by appropriate pre-filters.
[0048] It is also possible to further suppress the monitor image 200 in a time domain, for example by making the displays on the monitor 20 stroboscopic, e.g., via a switchable mirror. During the times when the monitor image 200 is visible, the camera 10 is electrically deactivated by an electronic camera shutter, or the monitor image 200 is optically blocked by a switchable transmission filter located in front of the camera 10.
[0049] The camera 10 is connected within the control computer 30 to an image processing unit 33, which performs a real-time transformation of the camera image 100, with which, for example, the trapezoidal distortion of the edge 23 of the monitor 20 resulting from the arrangement of the camera 10 is compensated (cf. Fig. 3 ). This is particularly relevant in order to overlay the camera image 100 with the monitor image 200 in such a way that the two images are identical in the output image 400 and the viewers of the output image 400 can perceive which point in the monitor image 200 the presenter 1 is actually looking at or pointing to.
[0050] Alternatively or in addition to modifying the camera image 100, the reproduction of the monitor image 200 on the monitor 20 for the presenter 1 can also be pre-distorted so that the two images on the output image 400 are again identical.
[0051] It is noted that this modification of camera image 100 and / or playback of the monitor image 200 on the monitor 20 can also be used in presentation systems where the separation of the presenter's image in camera image 100 is not achieved by using an infrared camera, but e.g. by dark scanning the monitor 20 during the camera's recording phases.
[0052] Optionally, edge cropping or cropping and / or position correction and / or rotation correction and / or mirroring can also be performed. The image processing unit 33 outputs a modified camera image 330 accordingly, as shown in Fig. 3 This can be seen. The aforementioned simultaneous colorization can also be performed in image processing unit 33.
[0053] The control computer 30 further includes a second graphics unit 35 (i.e., another graphics card), to which both the monitor image 200 and the modified camera image 330 are fed via a mixer 34. The mixer 34 superimposes the two images, optionally with adjustable brightness and / or transparency levels. A display system 40 is connected to the second graphics unit 35, on which the superimposed monitor image 200 and the modified camera image 330 are displayed as an output image 400.
[0054] In the case of a lecture or presentation, the playback system 40 can, for example, be a projection system (beamer) that displays the output image 400 on a projection surface behind the presenter 1. The second graphics unit 35 can additionally or alternatively be configured to transmit ("stream") or store the output image 400 in a data format.
[0055] The presentation system shown, or rather the one associated with it Fig. 3 The described presentation method offers the advantage that the presenter 1 can view the monitor image 200, while a frontal view of the presenter 1 can still be presented to the audience in the output image 400. The output image 400 on the playback system 40 also displays the monitor image 200, so that the playback system 40 combines both perspectives necessary or interesting for the presentation—the presenter's frontal view and the material to which the presenter 1 refers—in a single image.
[0056] When the presenter 1 fixes his eyes 3 on certain points or areas of the monitor image 20 or points to them with his finger, the corresponding eye movement and orientation or pointing direction can also be discerned on the output image 400. The presenter 1 thus behaves completely naturally with regard to the monitor image 200, making it easy for the audience to understand where the presenter 1's focus is currently directed.
[0057] In a further development of the presentation system shown, the semi-transparent mirror 22 can be provided with a touch-sensitive surface and thus serve as an input element for the control computer 30. Preferably, a capacitive touch-sensitive surface is provided, which can be operated with the finger 2 or a digital stylus (not shown here).
[0058] In this configuration, the presenter 1 can operate the monitor 20 with their finger, similar to a touchscreen, or, using a suitable interactive program, influence the monitor image 200. The presentation system can then be used like a whiteboard, with the presenter 1 making marks or writing on the semi-transparent mirror and thus on the monitor 20 using the digital stylus. The audience sees the resulting "whiteboard image" on the display monitor 40 and simultaneously sees the presenter in a frontal view.
[0059] In a further modification of the one in the Fig. 1 and 2 In the presentation system shown, the camera 10 can be moved dynamically either directly or via mirrors to obtain an optimal image impression, even if the person is not in the center in front of the screen.
[0060] In a further modification of the presentation system, the camera 10 can also be implemented multiple times and, for example, mounted laterally, each viewing the presenter 1 via reflection on the monitor 20. Images from multiple cameras 10 can be combined into a single image that then appears to originate from a "virtual" camera. Such a virtual camera can be positioned, for example, using three-dimensional reconstructions, in locations that would otherwise be inaccessible. This option is also possible in conjunction with multiple cameras 10, for example, two cameras 10 configured as infrared cameras. Images from these cameras 10 are then preferably combined first into an image from a virtual camera, which is then colorized based on color information from an additional true-color camera.
[0061] In a further modification of the one in the Fig. 1 and 2In the presentation system shown, greater flexibility in the positioning of the camera 10 can be achieved by means of at least one additional mirror arranged between the camera 10 and the semi-transparent mirror 22. These mirrors can also be transparent to visible light to be less disruptive.
[0062] For example, it is possible to use the monitor of a laptop computer as monitor 20. Laptop computers often have a camera positioned centrally above monitor 20, facing the user. An additional mirror, angled and positioned in front of and above monitor 20 from the presenter's perspective, can capture an image of the presenter reflected by the semi-transparent mirror 22 and then reflected again by the laptop computer's integrated camera. The additional mirror can be attached to the top edge of the laptop, for example, using a small telescopic or gooseneck mount with a clamp, thus making the laptop computer function as the camera, monitor, and control computer of a presentation system.
[0063] In a further modification of the one in the Fig. 1 and 2The presentation system described can be adapted to a mobile version by using a small, e.g., wireless, camera worn by the presenter, which then captures the viewer's image via reflection on a monitor, such as a mobile phone or tablet. In this case, perspective correction must be adjusted in real time to the potentially changing geometric situation. For this purpose, the monitor's outline can be detected, for example. A suitable angle between the monitor and the camera can be maintained manually or automatically using, for example, servo motors.
[0064] In Fig. 4 is analogous to a schematic representation Fig. 1 This figure depicts an arrangement of two interlocking presentation systems. Identical reference symbols in this figure denote identical or equivalent elements as in the previous figures.
[0065] The arrangement of the Fig. 4 This is a video conferencing system designed, for example, for two participants. Accordingly, components of the presentation system are duplicated, one assigned to a first participant and the other to a second. For easier differentiation, the reference symbols of components assigned to the second participant are marked with an apostrophe.
[0066] The arrangement comprises a camera 10, 10' with a polarizing filter 11, 11' for each participant. Each participant also has a monitor 20, 20' with a polarizing filter film 21, 21' and a semi-transparent mirror 22, 22'. Each part of the arrangement further includes a control computer 30, 30' in which the data supplied by the camera 10, 10' is processed in an image processing unit 33, 33' to produce a modified camera image 330, 330'. Regarding the geometric arrangement of the camera 10, 10' and monitor 20, 20', reference is made to the design in the Fig. 1 and 2 referred. In each of the two parts of the arrangement according to Fig. 4 The corresponding camera 10, 10' captures the image of a presenter - in this embodiment called participant - reflected via the monitor 20, 20' and in particular the semi-transparent mirror 22, 22'.
[0067] Unlike the previously described embodiment, in this embodiment the modified camera image 330, 330' is not transmitted via the mixer 34 to a second graphics unit 35, but rather via a network interface 36 to a mixer 34' of the second part of the arrangement. There, the modified camera image, together with a monitor image 200 provided by a monitor image generator 31', is fed to the first graphics unit 32', which transmits the superposition of the monitor image 200 and the modified camera image 330 to the monitor 20' for display to the second user. The monitor 20' of the second user thus forms the playback system 40 in this embodiment (see Figure 3). Fig. 1 The entire 20-inch monitor or a portion thereof, e.g., in the form of a window, can be used as the playback system.
[0068] Conversely, the camera image 100' of the second participant is rectified by the image processing unit 33' and sent via the network interface 36' as a modified camera image 330' of the second participant to the control computer 30 of the first participant. Here, too, a superposition takes place in a mixer 34 with the monitor image 200, which is provided by a monitor image generator 31. The superimposed images are output via the first graphics unit 32 to the monitor 20 of the first participant. Preferably, the monitor image generators 31, 31' in both control computers 30, 30' are synchronized, so that in both cases the same monitor image 200 is mixed with the respective modified camera image 330, 330'. In this way, two interlocking presentation systems are formed, with the monitor 20, 20' of one system also functioning as the playback system of the other system.
[0069] Through the described procedure, each of the two participants sees the monitor image 200 and their conversation partner, i.e., the other participant, on monitor 20. Thus, both participants can simultaneously view the monitor image 200 and, if a touch-sensitive monitor 20, 20' is used, edit it. With appropriate positioning of camera 10, 10' and monitor 20, 20', both participants can also see each other and maintain eye contact.
[0070] Synchronization of the two monitor image generators 31, 31' is in the Fig. 4 This is represented by a dashed arrow. It is understood that the three connections between the control computers 30, 30' shown are formed by a single network connection. However, the modified camera images 330, 330' and the synchronization information for the monitor image 200 can, of course, be transmitted with different data rates and latencies to accommodate the more rapidly changing camera images 100, 100'.
[0071] Unlike in the Fig. 4 As shown, a mixture of the modified camera image 330, 330' with the monitor image 200 can also take place in the respective control computer 30, 30' before a transfer to the respective other control computer 30, 30' takes place. Bezugszeichen
[0072] 1. Speaker 2. Finger 3. Eye 10, 10' video camera 100 camera image 11, 11' polarizing filter 20, 20'Monitor 200Monitor image 21, 21'Polarizing filter film 22, 22'Partially transparent mirror 23Edge 30, 30'Control computer 31, 31'Monitor image generator 32, 32'First graphics unit 33, 33'Image processing unit 330Modified camera image 34, 34'Mixer 35Second graphics unit 36, 36'Network interface 40 playback system 400 output image
Claims
1. A presentation system for the joint display of a monitor image (200) and a camera image (100), which is recorded by at least one video camera (10), of a presenter (1) by a playback system (40), wherein the monitor image (200) and the camera image (100) are superimposed in a mixer (34) for display by the playback system (40), wherein a monitor (20) having a display screen is provided in order to display the monitor image (200) for a presenter (1) located in front of the monitor (20), wherein a partially-transmissive mirror (22) is arranged in front of the display screen, wherein the at least one video camera (10) is positioned to capture the presenter (1) reflected by the partially-transmissive mirror (22), and wherein the at least one video camera (10) is an infrared camera, characterized in that a further camera is provided which is directed directly at the presenter (1) to capture a color image of the presenter (1), the presentation system being configured to colorize the camera image (100) and / or the monitor image (200) using the color image.
2. The presentation system according to claim 1, in which the partially-transmissive mirror (22) is placed flatly on the display screen parallel thereto.
3. The presentation system according to claim 1 or 2, in which the partially-transmissive mirror (22) is integrated into the monitor (20) as a protective glass for the display screen.
4. The presentation system according to any one of claims 1 to 3, wherein the partially transmissive mirror (22) includes a touch-sensitive sensor surface.
5. The presentation system according to any one of claims 1 to 4, in which a polarizing filter is arranged in front of the at least one video camera (10).
6. The presentation system according to claim 5, in which a polarizer is arranged between the display screen of the monitor (20) and the partially-transmissive mirror (22).
7. The presentation system according to claim 6, in which the polarizer is a polarizing filter film (21) extending flatly over the entire display screen.
8. The presentation system according to any one of claims 1 to 4, in which a color filter or a viewing angle filter is arranged between the display screen of the monitor (20) and the partially-transmissive mirror (22).
9. The presentation system according to any one of claims 1 to 8, comprising a control computer (30) equipped with an image processing unit (33) that enables real-time processing of images to correct distortion in the camera image (100), wherein a modified camera image (330) is transmitted to the mixer (34).
10. The presentation system according to any one of claims 1 to 9, wherein the modified camera image (330) is relayed over a network to a remote mixer (34').
11. The presentation system according to claim 10, wherein the remote mixer (34') is connected to a remote monitor (20') that functions as a playback system (40) and is part of another presentation system.
12. The presentation system according to any one of claims 1 to 11, wherein at least one additional mirror is arranged in an optical path between the at least one video camera (10) and the partially-transmissive mirror (22), the presenter (1) being captured by the at least one video camera (10) reflected by the at least one additional mirror and by the partially-transmissive mirror (22).
13. A presentation method for the joint display of a monitor image (200) and a camera image of a presenter (1) recorded by at least one video camera (10) by a playback system (40), wherein - a monitor (20) having a display screen is provided, on which the monitor image (200) is displayed for a presenter (1) located in front of the monitor (20); - the at least one video camera (10) captures the presenter (1) reflected by a partially-transmissive mirror (22) arranged in front of a display screen of the monitor (20) in a camera image (100) in an infrared wavelength range; - the camera image (100) is processed in real time by an image processing unit (33) to create a modified camera image (330) and / or the monitor image (200) is distorted before being displayed on the monitor (20); - the monitor image (200) and the modified camera image (330) are superimposed in a mixer (34) for display by the playback system (40), - the camera image (100) being colorized in the processing step using a color image of the presenter (1) captured by another camera directed directly at the presenter (1).
14. The presentation method according to claim 13, wherein the camera image (100) is distorted during the processing step and / or cropping and / or enlargement of a portion and / or position correction and / or rotation correction and / or mirroring are performed.
15. The presentation method according to claim 13 or 14, wherein the display system (40) includes a monitor (20') from another presentation system.