BACKGROUND PLAYBACK SETUP

Description

[0001] The invention relates to a background display device for a virtual image recording studio, which is designed to display a representation of a virtual background for a camera recording behind a real subject.

[0002] Such background reproduction devices can be provided in particular for reproducing a landscape or an environment in an image recording studio in which a recording is to be made using an assigned camera and which forms a virtual background for a scene to be recorded. The image recording studio can be, for example, a film studio for recording moving image sequences or a photo studio in which individual images or still images are recorded. In general, such a recording can comprise local storage of image data or transmission to a remote location (e.g. broadcast, streaming). In the virtual image recording studio, a virtual background or a virtual environment can thus be created in which an actor can move during a moving image recording or which can form a background for a still image recording.The virtual background referred to in this context therefore comprises image information representing a background subject, the representation of which can be directly captured by an associated camera as a seemingly real environment of a (foreground) scene. The representation of the virtual background "behind" a real subject is to be understood comprehensively in this context, since the virtual environment can also be provided above or below the real subject.

[0003] For example, in moving image recordings, a background playback device can be used to play back a representation of a virtual background in order to be able to record a scene directly in the intended environment. In particular, this can make acting easier because any events taking place in the virtual background can be perceived by an actor and the actor can react to these events. Unlike, for example, when using a green screen, where the environment is not visible to the actor, the actor can thus adapt his acting to any background events and a director, a camera operator or other people involved in filming can gain an overall impression of the scene and assess it during filming.In addition, the entire scene or a corresponding section of a film can be viewed and reviewed immediately after recording, without having to overlay the background intended for the scene.

[0004] For still image photography, such a background display device can be used, for example, to capture photographs in a studio, thus allowing a controlled environment, in virtually any environment, while maintaining a complete view of the resulting image during the process. The background and the real subject, or a person being photographed, can thus be optimally coordinated and interact with each other. Furthermore, the captured photo can be viewed immediately to make any necessary adjustments.

[0005] A background display device for displaying a representation of a virtual background for a camera recording is described, for example, in WO 2020 / 097212 A1.

[0006] US20070176854A1 describes display panels for entertainment and architectural purposes with irregularly arranged pixels to reduce moiré effects.

[0007] To display the representation of the virtual background, background display devices can in particular form or comprise an electronic display with an active pixel matrix and, for example, comprise an active lighting device with a plurality of actively illuminated pixel elements (lighting elements). For example, to display a representation of a virtual background in a virtual image recording studio, an LED wall can be used, the light-emitting diodes of which can be controlled individually and / or in groups of adjacent light-emitting diodes or in arrays of light-emitting diodes. Light-emitting diodes of such an LED wall can be provided, for example, as LEDs (light-emitting diodes) or as OLEDs (organic light-emitting diodes). Furthermore, the light-emitting diodes can be part of a liquid crystal display.Such background playback devices may, for example, extend over a width of at least 5 m and a height of at least 2 m in order to be able to record several actors in front of a common (virtual) background.

[0008] In addition, background display devices can comprise a plurality of panels on which the pixel elements are arranged and which together form the LED wall. While the panels, for which the term panel is also commonly used, are essentially two-dimensional and the pixel elements arranged on a panel can extend in a flat arrangement, a suitable arrangement of a plurality of panels can, for example, result in the background display device being curved and / or arched in sections. This allows the background display device to be arranged, for example, both behind and above or below the real subject in the virtual image recording studio in order to also enable the direct recording of a representation of a virtual sky, a virtual ceiling of a room, or a virtual floor in the image recording studio.As an alternative to an LED wall, a virtual background can also be created using light points generated by reflection or transmission from a light source wall, such as a screen for rear projection. Active light generation can be achieved by a projector, with the light sources on the screen only being indirectly generated.

[0009] In particular, such a background display device can make it possible to visually display a virtual background, which can in particular represent a three-dimensional scene, by appropriately controlling the pixel elements and / or to adapt it by changing the control during a recording. A background display device thus offers a way to vividly and easily adaptably display a virtual background for a scene to be recorded, thereby facilitating, in particular, acting or gestures.

[0010] However, a problem when recording such a representation of a virtual background can arise from the fact that when the representation reproduced by an active pixel matrix is ​​projected onto an image sensor of a camera, which also has light-sensitive sensor elements arranged in a pixel matrix consisting of several rows and several perpendicular columns, large-scale interference and cancellation effects can arise in areas in which the grids of the pixel matrix of the background reproduction device and the image sensor overlap. These interference and cancellation effects can lead to recurring geometric patterns being recognizable in the reproduced images during a subsequent reproduction of the image created by the camera, which patterns do not appear in the actually recorded scene or image.are not present in the virtual image recording studio and represent unwanted artifacts from the superposition of the two regular grids of the background display device and the image sensor. However, such artifacts, known, for example, as moiré or aliasing effects, can render the recorded image material completely unusable and therefore potentially completely counteract the advantages achieved by using a background display device.

[0011] It is therefore an object of the invention to provide a background display device for a virtual image recording studio, which enables direct camera recording of a representation of a virtual background in a virtual image recording studio, without geometric patterns being created in an image of the representation of the virtual background due to interference between a pixel matrix of the background display device and an image sensor of the imaging camera.

[0012] This object is achieved by a background reproduction device having the features of claim 1.

[0013] The background display device comprises at least one panel with a plurality of actively luminous pixel elements. The pixel elements form (at least when viewed in projection) a two-dimensional arrangement extending along a first direction of extent and a second direction of extent oriented perpendicular thereto. A respective distance of the pixel elements, measured along the second direction of extent, from a first reference line, which runs rectilinearly along the first direction of extent, varies irregularly along the first direction of extent.

[0014] In conventional background display devices with actively luminous pixel elements, the actively luminous pixel elements typically form a pixel matrix and are arranged along the panel in a regular and strictly orthogonal grid. Therefore, in such background display devices, all pixel elements arranged one behind the other along the first extension direction or the second extension direction are arranged along a reference line that runs rectilinearly along the first extension direction or the second extension direction, respectively.In such background display devices, a first reference line can thus be laid through the arrangement of pixel elements, which intersects pixel elements arranged one behind the other along the first direction of extension, and to which pixel elements offset from the first reference line with respect to the second direction of extension have regular spacings corresponding to a grid pitch of the regular grid with respect to the second direction of extension. However, as explained in the introduction, this regular arrangement can lead to interference or cancellation effects when imaging the representation of the virtual background onto an image sensor of a camera whose light-sensitive sensor elements are also arranged in a regular orthogonal grid of several rows and columns.

[0015] To prevent the formation of patterns due to the superposition of such regular grids of pixel elements of the background display device and the sensor elements of the camera's image sensor, the actively luminous pixel elements in the background display device disclosed herein are not arranged strictly in an orthogonal grid, but rather have an irregularly varying distance along the first extension direction from a first reference line extending rectilinearly along the first extension direction. In particular, the pixel elements can be distributed irregularly around the first reference line. In this context, the first reference line can represent an imaginary line that runs rectilinearly along the first extension direction across the panel or within the two-dimensional arrangement of the actively luminous pixel elements.The pixel elements thus form only an irregular two-dimensional arrangement.

[0016] Since the distance between the pixel elements along the second extension direction and the first reference line varies irregularly, the pixel elements are, in particular, not arranged one behind the other in a straight line along the first extension direction. Instead, pixel elements arranged one behind the other with respect to the first extension direction can be arranged offset from one another with respect to the second extension direction. In particular, no imaginary first reference line can be passed through the two-dimensional arrangement of pixel elements that intersects all pixel elements arranged one behind the other along the first extension direction.In addition, it can be provided that the first reference line can be guided through the two-dimensional arrangement at any position with respect to the second direction of extension, wherein a respective distance of the pixel elements measured along the second direction of extension varies irregularly independently of the position of the first reference lines along the first direction of extension.

[0017] Due to the irregular variation in the distance of the pixel elements from the first reference line, this distance does not follow a pattern whose superimposition with a regular arrangement of light-sensitive sensor elements of an image sensor of a camera could lead to the creation of artifacts in an image generated by the camera. Rather, the pixel elements are distributed irregularly with respect to a rectilinear sequence along the first extension direction or statistically with respect to the second extension direction in order to avoid regular superimposition with the regular grid of the image sensor. In particular, no recurring pattern can be contained within the irregularly varying distances of the pixel elements from the first reference line.Not only can the pixel elements not be arranged in a straight line along the first extension direction, but values ​​of the measured distances can form a completely irregular sequence which cannot be divided into several recurring cycles.

[0018] In order to reliably prevent the creation of artifacts in an image produced by a camera, the distance between the pixel elements and the first reference line can vary irregularly, in particular at least across multiple pixel elements. It can also be provided that the distance to the first reference line varies irregularly across the entire panel, so that the distances to the first reference line cannot form a recurring pattern across the entire panel. In principle, however, it can be sufficient if the distances do not form a recurring pattern over a sufficiently long reference distance along the first extension direction, which could lead to the creation of a perceptible artifact in an image produced by the camera.

[0019] Pixel elements in the sense explained above do not necessarily refer to individual components of the background display device that may carry the light-emitting elements; such components can also be arranged in a regular matrix. Rather, pixel elements in the present context refer to the light-emitting surface areas of the background display device that are perceptible to a user or captured by the camera as image information.

[0020] To reproduce the representation of the virtual background, the background reproduction device can further comprise, for example, a single panel, which can be positioned, in particular, behind an actor or a person to be photographed to reproduce the representation of the virtual background. However, the background reproduction device can also comprise multiple panels, which can be arranged adjacent to one another, so that a respective section of the representation of the virtual background can be reproduced on each of the multiple panels. Such panels of a background reproduction device can also be referred to, in particular, as panels.

[0021] Further embodiments of the invention can be found in the dependent claims, the description and the drawings.

[0022] In some embodiments, a respective distance, measured along the second extension direction, between the first reference line and pixel elements adjacent to the first reference line may vary irregularly along the first extension direction. For example, pixel elements arranged one behind the other along the second extension direction may have an average distance from one another, wherein pixel elements adjacent to the first reference line may have a distance from the first reference line, measured along the second extension direction, which is smaller than the average distance between the pixel elements along the second extension direction.If an imaginary first reference line is thus drawn through the planar arrangement of the pixel elements, pixel elements adjacent to this reference line are not aligned along the reference line, but may have an irregularly varying distance from the reference line. Pixel elements that can be intersected by a first reference line when arranged in a regular grid may thus, in some embodiments, be statistically distributed around this first reference line.

[0023] In some embodiments, the background display device can be configured as an LED wall, and the actively luminous pixel elements can be configured as light-emitting diodes or light-emitting diode units. The light-emitting diodes of such an LED wall can be configured, for example, as LEDs (light-emitting diodes) or as organic light-emitting diodes (OLEDs).

[0024] In particular, in an LED wall it can be provided that the individual pixel elements, which together generate the representation of the virtual background, are formed by individual light-emitting diodes. In such embodiments, the individual light-emitting diodes can have an irregularly varying distance from a rectilinear reference line in order to form an irregular two-dimensional arrangement. In some embodiments, the individual light-emitting diodes can be assigned a plurality of different colors, ie several types (e.g. three, four, five or six) of individual light-emitting diodes can be provided which have different predetermined emission spectra, wherein the light-emitting diodes of each of the plurality of different colors form an irregular two-dimensional arrangement.For example, the background display device may comprise a plurality of red light-emitting light-emitting diodes which (at least relative to a panel of the background display device) have an irregularly varying distance from a rectilinear reference line; the background display device may comprise a plurality of green light-emitting light-emitting diodes which have an irregularly varying distance from a rectilinear reference line (the same or a different reference line); and the background display device may comprise a plurality of blue light-emitting light-emitting diodes which have an irregularly varying distance from a rectilinear reference line.In some embodiments, the individual light-emitting diodes can be arranged in groups, each group comprising one light-emitting diode of each of the multiple types (colors) in spatial proximity to one another, but the arrangement of the light-emitting diodes within the respective group is not uniform, i.e., individual light-emitting diodes of the same type have an irregularly varying distance from a rectilinear reference line from group to group. Thus, at least this forms the irregular two-dimensional arrangement of the pixel elements (= individual light-emitting diodes), even if the groups (as a whole) form a regular two-dimensional arrangement.

[0025] In other embodiments, the individual pixel elements can be formed by respective light-emitting diode units, wherein each light-emitting diode unit can in particular comprise a plurality of (e.g. two, three, four, five or six) light-emitting diodes. The plurality of light-emitting diodes of a light-emitting diode unit can in particular have different emission spectra and optionally be equipped with a color mixer. Furthermore, in such a light-emitting diode unit, it can be provided that the individual light-emitting diodes of the light-emitting diode unit can be selectively controlled in order to generate a desired color of the pixel element formed by the light-emitting diode unit. In particular, a light-emitting diode unit can comprise a red light-emitting light-emitting diode, a green light-emitting light-emitting diode and a blue light-emitting light-emitting diode.In such embodiments, the (complete) light-emitting diode units may have an irregularly varying distance from a rectilinearly extending reference line to form an irregular two-dimensional array.

[0026] In some embodiments, it may further be provided that the pixel elements can be individually controlled to generate the representation of the virtual background. In particular, by controlling the pixel elements, a respective color and / or brightness of the pixel element can be adjusted in order to be able to adjust a section or point of the representation of the virtual background represented by the respective pixel element to the intended color and / or brightness.

[0027] In some embodiments, the background display device can extend in a vertical and / or horizontal orientation, in particular with continuous or quasi-continuous transitions. For example, it can be provided that the background display device extends in a vertical orientation flat behind the real subject in order to display the representation of the virtual background behind the real subject. Alternatively or additionally, however, it can also be provided that the background display device extends at least partially in a horizontal orientation, so that the representation of the virtual background can also be displayed above the real subject, for example.In addition, the background reproduction device can be designed to surround and cover the real subject in order to enable the most complete reproduction of the virtual background over a large angular range. In a section in which the background reproduction device transitions from a vertical to a horizontal orientation, the background reproduction device can also be arched and / or curved. In particular, when the background reproduction device is composed of several panels, the panels can be combined to form different, for example, arch-like geometries in order to create a desired environment for a recording in the virtual image recording studio. Furthermore, in some embodiments, it can be provided that the background reproduction device is arranged in sections on a floor of the virtual image recording studio.Even in such sections, the background display device may extend, in particular, in a horizontal orientation.

[0028] In some embodiments, the background rendering device can further be configured to illuminate the real subject. In particular, this background rendering device can serve to illuminate the real subject in addition to other lighting in the virtual image recording studio. For example, this can ensure that the real subject casts an expected shadow if the virtual background contains lighting sources, such as a street lamp, by basing the illumination of the real subject expected from a real street lamp on the rendered representation of the street lamp in the virtual background.However, the background display device can also be designed to emit light in sections to illuminate a scene and to act as a spotlight, while the background display device can display the representation of the virtual background in other sections.

[0029] In some embodiments, the background playback device can be designed to vary the representation of the virtual background over time during recording. In particular, events occurring in the virtual background during a camera recording can be played back directly by means of the background playback device, so that an actor, unlike, for example, in a green screen recording, can react to these events and coordinate the acting accordingly. The background playback device can therefore be designed, in particular, to play back a film sequence during camera recording, which can be recorded directly by the camera. Subsequent overlaying of the camera recording with a provided background is therefore no longer necessary.

[0030] In some embodiments, the first direction of extension can be aligned horizontally, and the second direction of extension can be aligned vertically or inclined relative to the vertical in some embodiments. In particular, the second direction of extension can be aligned vertically when the background display device is vertically aligned, while an inclined alignment of the second direction of extension can be provided when the at least one panel is inclined, in order to be able to display the representation of the virtual background, for example, above the real subject or to illuminate the real subject from above.

[0031] In some embodiments, the respective distance of the pixel elements from the first reference line can vary irregularly along a reference distance that is at least 5 cm and / or comprises at least 20 pixel elements along the first extension direction. Furthermore, in some embodiments, the distance of the pixel elements from the first reference line can vary irregularly across the entire extent of the panel along the first extension direction.

[0032] By irregularly varying the distances of the pixel elements from the first reference line along a sufficiently long reference path, it is possible, at least under common camera settings and / or recording conditions, to ensure that no recurring and recognizable geometric patterns arise in the image generated by the camera due to an overlay of a regular pattern of the arrangement of the pixel elements with the arrangement of the light-sensitive sensor elements of an image sensor of the camera. For example, the variation of the distances of the pixel elements from the first reference line can be repeated along successive reference paths, or a pattern of distances formed along the reference path can be repeated along the following reference path, for example, rotated by 180 degrees.Such repetitions of irregular patterns over sufficiently long reference distances can facilitate the control of the panel, in particular, because information about the variation in the distances of the pixel elements from the first reference line along a reference distance can be sufficient to determine all distances of the pixel elements from the first reference line. Furthermore, the representation of the virtual background can thus be reproduced in a large-scale, regular arrangement of pixel elements.

[0033] Alternatively, the distance of the pixel elements from the first reference line can also vary irregularly across the entire extent of the panel, so that the distances of the pixel elements from the first reference line cannot form a recurring pattern across the entire extent of the panel. Such a large-scale or complete variation in the arrangement of the pixel elements relative to the first reference line can reliably prevent overlap with the arrangement of sensor elements of an image sensor and geometric patterns arising in an image of the representation of the virtual background.

[0034] Furthermore, in some embodiments, the distances of the pixel elements from the first reference line can be normally distributed. In particular, the distances of the pixel elements from the first reference line can be normally distributed relative to the aforementioned reference distance or relative to the entire extent of the panel along the first extension direction. The pixel elements can thus be statistically distributed relative to the first reference line, and in particular around the first reference line, without the distribution following a regular pattern.

[0035] In some embodiments, the distances of the pixel elements from the first reference line along the first extension direction may not form a repeating pattern. In particular, the distances of the pixel elements from the first reference line along the first extension direction relative to the reference distance or relative to the entire extent of the panel along the first extension direction may not form a repeating pattern. Furthermore, values ​​of distances of the pixel elements from the first reference line measured along the first reference line may not contain a recurring numerical sequence and / or a recurring pair of values. This may apply to absolute values ​​of the distances and / or to values ​​that are assigned a positive or negative sign depending on a position of the respective pixel element relative to the first reference line.

[0036] In some embodiments, a respective distance of the pixel elements measured along the first direction of extent from a second reference line that runs rectilinearly along the second direction of extent can vary irregularly along the second direction of extent. The second reference line can also correspond in particular to an imaginary line extending across the panel along the second direction of extent. The distances of the pixel elements relative to the first direction of extent from the second reference line can vary irregularly across a plurality of pixel elements, and / or a respective distance measured along the first direction of extent between the second reference line and pixel elements adjacent to the second reference line can vary irregularly along the second direction of extent.Furthermore, the respective distance of the pixel elements to the second reference line along a reference distance which is at least 5 cm and / or comprises at least 20 pixel elements can vary irregularly along the second extension direction and / or the respective distance can vary irregularly over the entire extent of the panel along the second extension direction.

[0037] Because a respective distance of the pixel elements from a first reference line and from a second reference line can vary irregularly, the arrangement of the pixel elements can ultimately be two-dimensionally irregular compared to an orthogonal grid that is regular with respect to the first extension direction and the second extension direction. In this respect, the pixel elements cannot form a regular pattern in any of the directions along which the light-sensitive sensor elements of an image sensor of a camera are conventionally regularly arranged, and / or can be arranged in a regular grid whose superposition with the grid of the image sensor can lead to undesired artifacts in an image of the background display device.In particular, the pixel elements can thus be statistically distributed in both dimensions compared to a conventional arrangement of pixel elements in a regular and strictly orthogonal grid.

[0038] In some embodiments, the distances of the pixel elements from the second reference line can be normally distributed. In particular, the pixel elements can thus be arranged statistically distributed relative to and / or around the second reference line, without the arrangement of the pixel elements following a regular pattern.

[0039] Furthermore, according to the invention, the panel comprises a number of separate pixel units corresponding to the plurality of pixel elements, which form a regular arrangement, wherein each pixel unit comprises an eccentric light-emitting surface region which corresponds to a respective pixel element and which, however, is arranged eccentrically with respect to a geometric center of the pixel unit. The orientation of the respective eccentric light-emitting surface region, in particular the angular orientation, varies along the regular arrangement of pixel units.

[0040] For example, such pixel units may have a square, hexagonal, or octagonal outline in order to be arranged in a checkerboard-like and / or honeycomb-like regular arrangement on the panel. The pixel units may, in particular, be arranged in a regular, for example, orthogonal, grid. However, by irregularly varying the alignment of the pixel units, which may, for example, be arranged rotated relative to one another, the respective light-emitting surface regions and, accordingly, the pixel elements may be arranged at an irregularly varying distance from a reference line extending along the first direction of extension and / or along the second direction of extension.For example, such a reference line can be arranged between two respective pixel units, so that inner edges of the pixel unit with respect to the reference line can lie on the reference line, wherein the respective light-emitting surface regions can be arranged at varying distances from the reference line due to the varying orientation of the pixel units. Alternatively or additionally, a distance of the respective eccentric light-emitting surfaces from the geometric center of the pixel unit can also vary in order to be able to arrange the pixel elements at an irregularly varying distance from the first reference line and / or a second reference line.

[0041] Such pixel units can also be mechanically connected to one another and / or to a support to form the panel of the background display device. Furthermore, a signal connection can exist between the plurality of pixel units in order to control the respective pixel elements of the pixel units and to be able to display the representation of the virtual background.

[0042] As already explained above, the pixel elements can be designed, in particular, as light-emitting diodes or as light-emitting diode units, so that the pixel units can, for example, each have an eccentrically arranged light-emitting diode. Furthermore, a plurality of light-emitting diodes forming a light-emitting diode unit can be arranged eccentrically on the pixel units, wherein the light-emitting diodes of a light-emitting diode unit can be arranged as a group of light-emitting diodes eccentrically on the pixel unit and, for example, together in a corner section of a square pixel unit.

[0043] In some embodiments, the two-dimensional arrangement can be subdivided by a plurality of first reference lines extending along the first extension direction and arranged at regular intervals from one another, wherein the regular interval can correspond to an average value of distances between adjacent pixel elements along the second extension direction. Furthermore, each of the plurality of pixel elements can be assigned to a respective first reference line to which the pixel element is adjacent with respect to the second extension direction, wherein a distance between each of the plurality of first reference lines and the respective assigned pixel elements can vary irregularly along the first extension direction.

[0044] Assuming a conventional regular grid at least along the first extension direction, the two-dimensional arrangement of the pixel elements can in principle be divided by a plurality of first reference lines with a regular spacing from one another, which—in the case of a regular grid—corresponds to the regular spacing between two pixel elements adjacent along the second extension direction. Accordingly, in the case of a regular grid, all pixel elements lie on such a first reference line if the first reference lines are spaced apart along the second extension direction by a distance that corresponds to the spacing between the pixel elements adjacent along the second extension direction.

[0045] However, in the aforementioned embodiments, such a grid of multiple parallel first reference lines cannot be formed such that all pixel elements lie on a first reference line or such that all pixel elements are intersected by the first reference lines. Rather, the pixel elements adjacent to a respective reference line, which lie on the first reference line in a regular arrangement, are arranged at a distance from the first reference lines with respect to the second extension direction, with the distance between the first reference lines and the assigned pixel elements varying irregularly along the first extension direction.Thus, at least along the first extension direction, the image point elements can be statically distributed relative to a regular grid in such embodiments, such that the image point elements do not form a regular pattern when considered along the first extension direction.

[0046] Furthermore, in some embodiments, a number of the plurality of first reference lines can correspond to a number of image point elements which are arranged one behind the other in the two-dimensional arrangement along the second extension direction. In principle, the image point elements arranged one behind the other along the second extension direction can be offset and / or arranged in a statistically distributed manner with respect to the first extension direction, such that the image point elements arranged one behind the other along the second extension direction do not necessarily have to be aligned along a straight line.

[0047] In particular, a number of first reference lines can be placed over the two-dimensional arrangement of pixel elements, which corresponds to the number of first reference lines of a regular grid in conventional background display devices. However, in such embodiments, no first reference lines of this number and the expected regular spacing can be found, so that all of the pixel elements lie on a respective reference line. Rather, the pixel elements can be statistically distributed relative to the expected regular grid, at least with respect to the second extension direction.

[0048] In some embodiments, it may be provided that an average distance between the pixel elements and the respective assigned first reference line of the plurality of first reference lines is less than one-third of the regular distance or less than one-tenth of the regular distance. While the distance between the pixel elements and the respective assigned first reference line may thus vary statistically and / or irregularly along the first extension direction, the pixel elements may be regularly distributed on average or, viewed over a large area, at least appear to be regularly distributed.This can in particular increase the compatibility of the background display device with existing systems for generating a virtual background, since in particular any calculations for transforming a representation to the irregular two-dimensional arrangement of pixel elements in the case of an arrangement that appears regular in the medium or over a large area can be carried out as simply as possible or can even be omitted without causing any noticeable distortions in the reproduced representation of the virtual background.

[0049] In some embodiments, a distribution of the varying distances between the plurality of first reference lines and the respective assigned pixel elements may correspond to a normal distribution. In particular, the distances between all pixel elements and the respective assigned reference line may be normally distributed, so that the pixel elements as a whole may be distributed statistically along the first extension direction compared to a regular grid. Furthermore, the pixel elements may be distributed purely statistically in the two-dimensional arrangement, without following a predetermined pattern.

[0050] In some embodiments, the normal distribution may be compatible with an expected value of zero. Furthermore, the normal distribution may in particular have an expected value of zero. For example, the normal distribution of the varying distances with a confidence level of 1 σ, 2 σ, or 3 σ may be compatible with an expected value of zero. The pixel elements may therefore be distributed around the first reference lines such that the pixel elements follow a regular grid along the first extension direction on average over a large area. This, in turn, allows the highest possible compatibility with existing systems to be achieved.

[0051] In some embodiments, the two-dimensional arrangement may further be subdivided by a plurality of second reference lines extending along the second extension direction and arranged at regular spacing from one another, wherein the regular spacing of the second reference lines may correspond to an average value of distances between adjacent pixel elements along the first extension direction. Furthermore, each of the plurality of pixel elements may be assignable to a respective second reference line to which the pixel element is adjacent with respect to the first extension direction, wherein a distance between each of the plurality of second reference lines and the respective assigned pixel elements may vary irregularly along the second extension direction.

[0052] As already explained above for first reference lines running parallel to one another and along the first direction of extension, the pixel elements can thus be arranged in a random and / or irregularly distributed manner, particularly along the second direction of extension, compared to a regular grid. In such embodiments, the pixel elements therefore cannot form a regular pattern, particularly along the first direction of extension.

[0053] Furthermore, in some embodiments, the adjacent pixel elements can be arranged with respect to the above-mentioned plurality of first reference lines and with respect to the plurality of second reference lines at respective irregularly varying distances, so that the pixel elements can be arranged statically distributed in two dimensions with respect to a regular grid, in particular an orthogonal grid.

[0054] In some embodiments, a number of the plurality of second reference lines can correspond to a number of pixel elements arranged one behind the other in the two-dimensional arrangement along the second extension direction. Thus, a number of mutually parallel second reference lines can be placed on the two-dimensional arrangement of pixel elements, so that, with a regular arrangement of the pixel elements, all pixel elements would lie on a respective second reference line. However, the distances of the respective adjacent pixel elements to all of these second reference lines can vary irregularly in order to prevent the overlap of a pattern of the two-dimensional arrangement and a pattern of light-sensitive sensor elements of an image sensor.

[0055] In some embodiments, an average distance between the pixel elements and the respective assigned second reference line of the plurality of second reference lines may be less than one-third of the regular distance of the second reference lines from one another or less than one-tenth of the regular distance of the second reference lines from one another.

[0056] Furthermore, in some embodiments, a distribution of the varying distances between the plurality of second reference lines and the respective assigned pixel elements may correspond to a second normal distribution.

[0057] In some embodiments, the second normal distribution may also be compatible with an expected value of zero. In particular, the second normal distribution may have an expected value of zero.

[0058] As already explained above for embodiments with varying distances between adjacent pixel elements and a plurality of first reference lines, the pixel elements can thus be distributed statistically, in particular relative to the plurality of second reference lines, without following a pattern. Furthermore, the distribution relative to the plurality of second reference lines can appear as a regular structure on average over a large area to facilitate control by conventional systems.

[0059] In some embodiments, the background rendering device may comprise a controller connected to a memory in which the virtual background is provided as a representation in a regular grid. The controller may be configured to transform the provided virtual background into coordinates of the pixel elements in the (irregular) two-dimensional arrangement.

[0060] Alternatively or additionally, the control device can also be configured to generate the virtual background and map it onto a regular grid. In particular, the control device can create a projection of a three-dimensional model of the virtual background onto two dimensions. The control device can then be configured to transform the mapped background, which is thus provided in a regular grid, into the coordinates of the pixel elements in the (irregular) two-dimensional arrangement.

[0061] For example, the virtual background can be provided in a regular pixel matrix, so that the virtual background can be directly reproduced on a conventional background display device, on which the pixel elements are arranged in a correspondingly regular grid. However, since the pixel elements in the background display device disclosed herein can be distributed irregularly with respect to such a grid, at least along the first extension direction, but in particular along both extension directions, a direct reproduction of the virtual background in the regular grid without taking into account the displacements of the pixel elements of the background display device can lead to a distorted representation of the virtual background.In particular, for example, in the case of a direct assignment of pixels of the virtual background provided in the regular grid to respective pixel elements, the pixels can be reproduced on the background reproduction device at a position offset from the regular grid, so that the representation of the virtual background by means of the background reproduction device can differ from the provided virtual background.By means of a corresponding transformation, in which, for example, it can be determined which pixel of the virtual background provided in the regular grid is closest to a respective pixel element in order to display this closest pixel on the respective pixel element, the virtual background provided in the regular grid can be displayed as detailed and undistorted as possible on the irregular two-dimensional arrangement of the pixel elements.

[0062] In some embodiments, the coordinates of the plurality of pixel elements can be stored in the memory and / or writable into the memory. For example, the memory can be part of the panel, so that information about the two-dimensional arrangement and in particular the coordinates of the pixel elements can be writable into the memory by the manufacturer and made available stored in the memory. This can be provided in particular for standardized panels, which can always have the same, albeit irregular, arrangement of pixel elements. However, it can also be provided that an irregular arrangement of pixel elements or their coordinates can be writable into the memory by a user.

[0063] In principle, the memory in which the coordinates are provided can be the same physical element in which the background is provided in a regular grid, or physically separate units can be provided to provide, on the one hand, the background in the regular grid and, on the other hand, the coordinates of the plurality of pixel elements, wherein the control device can access these separate units. In particular, the memory or memories can be designed as non-volatile memories and / or as semiconductor memories.

[0064] By storing the coordinates of the plurality of pixel elements in the memory, the control device can access both the coordinates of the pixel elements and the regular grid in which the virtual background is provided to perform the required transformation. For this purpose, the virtual background can also be provided in the memory with the respective coordinates of pixels of the regular grid.

[0065] In some embodiments, the control device can be designed to determine a respective color value and / or a respective brightness value for the pixel elements by means of the transformation based on the virtual background provided in the regular grid. For example, the control device can determine a position of a respective pixel element when projected onto the virtual background provided in the regular grid in order to assign the pixel element a color value and / or a brightness value of a pixel in the regular grid adjacent to this position. However, the control device can also be designed to determine the color values ​​and / or brightness values ​​for the pixel elements using interpolation methods in which the color values ​​and / or brightness values ​​of a plurality of pixels adjacent to the determined position are taken into account.The control device can also be designed to control the pixel elements to reproduce the determined color values ​​and / or brightness values.

[0066] In some embodiments, the controller may be configured to transform the provided virtual background to the two-dimensional arrangement of the pixel elements by a nearest neighbor method, a bilinear interpolation, and / or a bicubic interpolation.

[0067] For example, the control device can be configured to determine a position of a respective pixel element in the regular grid of the virtual background. By using a nearest neighborhood method, the control device can then determine which pixel in the regular grid of the virtual background the position of the pixel element is closest to, in order to be able to reproduce this nearest pixel, in particular its color and / or brightness, using the pixel element.

[0068] When using bilinear interpolation, however, the control device can be designed to linearly interpolate between four pixels adjacent to the determined position of a pixel element in the regular grid of the virtual background in order to be able to reproduce a color value and / or brightness value determined thereby using the pixel element. With bicubic interpolation, the values ​​of 4 x 4 neighboring pixels can be used to determine how the respective pixel element is to be controlled. In principle, the respective transformation method can also be selectable, so that the method can be selected, for example, depending on the available time and / or the available computing power and / or existing accuracy requirements for the representation of the virtual background.

[0069] Furthermore, in some embodiments, the virtual background can be provided as a model in the memory. As already explained, in this case, the control device can be configured, in particular, to create the virtual background based on the model and / or to map it onto a two-dimensional regular grid.

[0070] For example, the control device for generating the virtual background can comprise a game engine. For this purpose, the control device can be connected to a memory in which one or more databases can be stored, in which the virtual background can be stored as one or more models. The control device can further be configured to create the virtual background depending on a position and / or a viewing direction of the camera by using the game engine by reading different content from the databases depending on the camera position - similar to the position of the player in a PC game - and creating the virtual background.

[0071] In some embodiments, the control device can further be configured to display the pixel elements individually and / or in groups of adjacent pixel elements to reproduce the representation of the virtual background. The control device can thus, in particular, be configured to directly control the pixel elements to reproduce the transformed virtual background.

[0072] Furthermore, the control device can be embodied, for example, as a microprocessor and / or a CPU (central processing unit). Furthermore, the control device can comprise a plurality of intercommunicating microprocessors and / or CPUs, wherein, for example, one of the microprocessors can be used to transform the virtual background provided in the regular grid to the irregular arrangement of the pixel elements, while another microprocessor is provided to control the pixel elements.

[0073] In some embodiments, the background display device may also comprise a single, continuous panel that is relatively large, for example, with respect to an actor, and that may be flat or curved.

[0074] Alternatively, however, in some embodiments, the background display device may also comprise a plurality of adjacent panels. Each of the plurality of panels and / or the one panel may be rectangular and borderless. Furthermore, the plurality of panels may be arranged in a two-dimensional matrix. In such embodiments, the representation of the virtual background may be displayed using the plurality of panels, wherein each panel may display a respective section of the display. In particular, the panels may also be square.

[0075] In some embodiments, the (multiple) panels can be configured identically to one another with regard to their two-dimensional arrangement of actively luminous pixel elements. The actively luminous pixel elements can, in particular, be arranged irregularly or statistically distributed on each of the panels relative to a regular grid, although the panels can be configured identically to one another. In this respect, the panels can be manufactured in a standardized manner, so that, in particular, transformations from a regular grid to the irregular two-dimensional arrangement of the pixel elements can be carried out in a standardized manner and do not have to be determined individually for each panel.In particular, the panels may be provided with a control device that enables such a transformation, so that the panels can be easily connected to conventional devices that can, for example, provide a virtual background in a regular grid.

[0076] The invention also relates to a background display device for a virtual image recording studio, which is designed to display a representation of a virtual background for a camera recording behind a real subject, wherein the background display device comprises at least one panel with a plurality of actively luminous pixel elements that form a two-dimensional arrangement that extends generally along a first extension direction and a second extension direction oriented perpendicular thereto, wherein the two-dimensional arrangement of actively luminous pixel elements forms irregular deviations along the first extension direction and / or along the second extension direction relative to an orthogonal grid. In such a background display device, the features and embodiments explained above can be provided.

[0077] The invention further relates to a method for reproducing a representation of a virtual background by means of a background reproduction device according to one of the embodiments explained above for recording with a camera in a virtual image recording studio, wherein the background reproduction device comprises at least one panel with a plurality of actively luminous pixel elements forming an irregular two-dimensional arrangement, wherein the virtual background is provided as a representation in a regular grid, and wherein the virtual background is transformed for reproduction on the background reproduction device to coordinates of the pixel elements in the irregular two-dimensional arrangement. In such a method, the features and embodiments explained above can be provided.

[0078] The invention is explained below purely by way of example using embodiments with reference to the drawings.

[0079] They show: Fig. 1 is a schematic representation of a recording system for an image recording studio with a background display device for displaying a representation of a virtual background and with a camera, Fig. 2 is a schematic representation of an image sensor of the camera, Figs. 3A and 3B are respective schematic representations for illustrating patterns arising in an image of the background display device, Fig. 4 is a schematic representation of a panel of the background display device in which a plurality of pixel elements are arranged statistically distributed relative to a regular grid, Fig. 5 is a distribution of distances of the pixel elements to respective reference lines of the regular grid, Fig. 6 is a schematic representation of a panel of the background display device which has a plurality of pixel units with eccentric light-emitting surface areas whose orientation varies, Fig.Fig. 7 is a schematic representation illustrating a transformation of a virtual background provided in a regular grid to an irregular arrangement of pixel elements of the background display device, and Fig. 8 is a schematic representation of a pixel unit which has a light-emitting diode unit with a plurality of light-emitting diodes as an eccentric light-emitting surface area.

[0080] Fig. 1 schematically shows a virtual image recording studio 13 in which a scene, in particular in the form of a moving image recording and / or a photographic recording, can be recorded using an associated camera 23. The camera 23 can, for example, be designed as a moving image camera in order to be able to take moving image recordings that can be saved as a sequence of images generated by the camera 23. For this purpose, the camera 23 has a lens 59, which can in particular be designed as an interchangeable lens that can be optionally connected to a housing of the camera 23. This means that a respective lens 59 that is optimally adapted to the environment in the image recording studio 13 can always be used in order to be able to create the best possible recordings.In particular, an image sensor 53 with a plurality of light-sensitive sensor elements 55 can be arranged in the housing of the camera 23, onto which light penetrating through an aperture of an aperture can be directed by means of a lens system or at least one lens to produce an image (cf. . Fig. 2 ).

[0081] Furthermore, a background reproduction system 11 with a background reproduction device 15 is arranged in the image recording studio 13, which, together with the camera 23, forms a recording system 10. The background reproduction device 15 comprises an active illumination device 31 designed as an LED wall 33 and is designed to reproduce a representation 19 of a virtual background 21 for recording by the camera 23. For this purpose, the illumination device 31 or the LED wall 33 has a plurality of actively luminous pixel elements 35 arranged next to one another in a two-dimensional arrangement. For example, the pixel elements 35 can be designed as individually controllable light-emitting diodes 44 or as individually controllable light-emitting diode units 45, wherein each of such a light-emitting diode unit 45 can comprise several, in particular three, light-emitting diodes 44 (see also Fig. 8 ). In particular, it can be provided that the pixel elements 45 are designed as light-emitting diode units 45 with three respective light-emitting diodes 44, wherein one of the three light-emitting diodes 44 can emit red light, one light-emitting diode 44 can emit green light, and one light-emitting diode 44 can emit blue light. The light-emitting diode unit 45 can also comprise a color mixer in order to be able to adjust a respective color and / or brightness emitted by the pixel element 35 by individually controlling the light-emitting diodes 44 of a light-emitting diode unit 45. The light-emitting diodes 44 can be designed, for example, as LEDs or as organic light-emitting diodes 44 or OLEDs. In principle, background reproduction devices can also be used to reproduce a representation of a virtual background in the image recording studio 13, which generate the representation by means of rear projection.

[0082] Furthermore, the background display device 15 comprises a plurality of panels 41, which can also be referred to as panels. A respective plurality of actively illuminated pixel elements 35 are arranged on each panel 41 of the plurality of panels 41, so that a section of the representation 19 of the virtual background 21 can be displayed on each of the panels 41. The panels 41 are in particular rectangular and / or square and borderless, so that the representation 19 of the virtual background 21 can be displayed without visible interruptions, even at the transitions between panels 41. The panels 41 are further arranged in a two-dimensional matrix to form the background display device 15.

[0083] The representation 19 of the virtual background 21 here reflects, by way of example, a three-dimensional scene 43 with objects 91, 92, 93, and 94, three trees, and a path, which can be generated by appropriately controlling the pixel elements 35, in particular by appropriately adjusting their respective color and brightness. The three-dimensional scene 43 is projected onto the essentially two-dimensional arrangement of the pixel elements 35 of the illumination device 31, wherein, in particular, the objects 91, 92, and 93 appear at different distances from the illumination device 31 or the background display device 11 in order to simulate the three-dimensionality of a real background corresponding to the virtual background 21.

[0084] In particular, the representation 19 of the virtual background 21 by means of the background reproduction device 15 serves to generate a background for a recording of a real subject 17, for example, an actor, against which a recording can be made or a film scene can be played. This essentially allows any landscapes, rooms, or environments to be created in the image recording studio 13, against or in which a scene, for example, for a movie, is to be shot. Furthermore, by temporally varying control of the pixel elements 35, it is possible to represent movements in the virtual background 21, for example, a passing car, to which the actor 17 can react more easily and effectively than when acting in front of a green screen.

[0085] The background rendering device 15 extends essentially vertically here, so that the actor 17 can move in front of the virtual background 21. However, in order to be able to display the virtual background 21 more extensively, the background rendering device 15 can also extend around the actor 17 or above him, wherein the background rendering device 15 can in particular have a horizontal orientation above the actor 17. In order to be able to surround the actor 17 or to create a transition from the vertical orientation shown to a horizontal orientation, the background rendering device 15 or the lighting device 31 or the LED wall 33 can also be arched or curved, at least in sections.

[0086] In addition to displaying the virtual background 21, the background rendering device 15 can also serve to illuminate the real subject 17 and thereby, for example, support further studio lighting of the image recording studio 13. Furthermore, by illuminating the real subject 17 by means of the background rendering device 15, the interaction of the real subject 17 or the actor 17 with light sources present in the virtual background 21, for example lanterns or lamps, can be improved by the real subject 17 casting a shadow that corresponds to the lighting conditions visible in an image generated by the camera 23.

[0087] In order to generate the representation 19 of the virtual background 21 and to control the pixel elements 35 for reproducing the representation, the background rendering device 15 has a control device 37 connected to a memory 39. In particular, a model of the virtual background 21 can be stored in the memory 39, so that the control device can generate the virtual background 21 based on the model. Furthermore, the control device 37 can be configured to project the virtual background 21 onto the background rendering device 15, and in particular the two-dimensional arrangement of the pixel elements 35.

[0088] When using the Fig. 1 In the background display device 15 illustrated, the pixel elements 35 of each of the panels 41 and all pixel elements 35 of the background display device 15 form a regular, orthogonal grid 63, wherein the pixel elements 35 are arranged in a straight line one behind the other along a first extension direction E1 and along a second extension direction E2. As already explained, the camera 23 can in particular have an image sensor 53 whose light-sensitive sensor elements 55 are arranged in several rows 57 and in several columns 61, so that the light-sensitive sensor elements 55 are also arranged in a regular and orthogonal grid 65 (cf. Fig. 2 ).

[0089] Since both the pixel elements 35 of the background display device 15 are arranged in the regular grid 63 and the light-sensitive sensor elements 55 of the image sensor 53 are arranged in the regular grid 65, interference and cancellation effects can occur when the background display device 15 is recorded by the camera 23, which can result in geometric patterns in an image 69 of the background display device 15 generated by the camera 23, which geometric patterns are not contained in the representation 19 of the virtual background 21 or the virtual background 21. This can be seen from the Fig. 3A and 3Billustrated, showing a recording situation in which the camera 23 and thus the image sensor 53 is rotated relative to the background reproduction device 15. Due to the superimposition of the grids 63 and 65, recurring geometric patterns can appear in the image 69 generated by the camera 23 or when this image 69 is reproduced, which can make the image 69 completely unusable as a still image and / or sequence of a moving image. While equipping a virtual image recording studio 13 with such a background reproduction device 15 can thus facilitate acting and the recording of scenes in that the representation 19 of the virtual background 21 can be directly perceived and reproduced by the camera 23, these patterns forming in the image 69 can possibly conflict with the use of such a background reproduction device 15.

[0090] However, in order to be able to prevent the formation of such patterns in an image 69 by means of the camera 23 when using a background reproduction device 15, the background reproduction device can Fig. 4 schematically illustrated panel 41 or several such panels. This panel 41 also has a plurality of actively luminous pixel elements 35, which form a two-dimensional arrangement extending along a first extension direction E1 and a second extension direction E2 oriented perpendicular thereto. Unlike conventional background display devices 15 or conventional panels 41, however, these pixel elements 35 are not arranged in a regular and orthogonal grid 63, but rather the pixel elements 35 are statistically distributed relative to such a grid 63.

[0091] In Fig. 4 To illustrate this distribution of the pixel elements 35, a regular grid is shown which comprises a plurality of first reference lines R1 running rectilinearly along the first direction of extension E1 and a plurality of second reference lines R2 running rectilinearly along the second direction of extension E2. Both the first reference lines R1 and the second reference lines R2 have a regular spacing d from one another. The regular spacing d of the first reference lines R1 corresponds to an average value of spacings between adjacent pixel elements 35 along the second direction of extension E2, and the regular spacing d of the second reference lines R2 corresponds to an average value of spacings between adjacent pixel elements 35 along the first direction of extension E1.Furthermore, the number of first reference lines R1 corresponds to a number of pixel elements 35 arranged one behind the other along the second extension direction E2. A number of second reference lines R2 also corresponds to a number of pixel elements 35 arranged one behind the other along the first extension direction E1. In this respect, the first reference lines R1 and the second reference lines R2 form a regular grid, wherein the pixel elements 35 could be arranged at the respective intersection points of the first reference lines R1 and the second reference lines R2 in a conventional regular arrangement.

[0092] In the case of Fig. 4 In the illustrated panel 41, however, the pixel elements 35 are not - at least not all pixel elements 35 - arranged at such intersection points of the reference lines R1 and R2, but are statistically distributed relative to the reference lines R1 and R2. In particular, therefore, a respective distance b1, b2, b3, b4, b5 and b6 of the pixel elements 35 measured along the second extension direction E2 varies, which leads to the Fig. 4 adjacent to the first reference line R1* shown above, are irregularly arranged along the first extension direction E1. The pixel elements 35, which in a conventional arrangement would be intersected by the first reference line R1* in a regular grid, are thus statistically distributed around this first reference line R1*. In addition, Fig. 4 It can be seen that distances of respective adjacent pixel elements 35 to each first reference line R1 vary irregularly along the first extension direction E1.

[0093] Since the distance of the pixel elements 35 from the first reference line R1* varies irregularly along the first extension direction E1, the distances b1, b2, b3, b4, b5, and b6, in particular, do not form a repeating pattern. For example, it can be provided that the distances b1, b2, b3, b4, b5, and b6 of the pixel elements 35 from the first reference line R1* vary irregularly over the entire extent of the panel 41 and do not form a repeating pattern. However, it may be sufficient if the distances b1, b2, b3, b4, b5, and b6 of the pixel elements 35 from the first reference line R1* vary irregularly over a reference distance L, which may, for example, be 5 cm and / or comprise ten pixel elements 35, and do not form a repeating pattern.

[0094] Likewise, Fig. 4 shows that respective distances a1, a2, a3, a4, a5 and a6 from to a Fig. 4 the leftmost second reference line R2* shown, the distances between the pixel elements 35 adjacent to the second reference line R2* vary irregularly along the second extension direction E2. In particular, in the panel 41 shown, the distances between all first reference lines R1 and respective adjacent pixel elements 35, which can thus be assigned to a respective reference line R1, as well as the distances between all reference lines R2 and respective adjacent pixel elements 35, which can thus be assigned to a respective second reference line R2, vary statistically. Overall, the arrangement of the pixel elements 35 thus varies statistically in two dimensions compared to a regular grid.

[0095] By varying the pixel elements 35 statistically compared to a regular arrangement and in particular the conventional regular orthogonal grid 63, it can be prevented that when the background display device 35 or the panel 41 is imaged by the camera 23 in the generated image 69, geometric patterns similar to those in Fig. 3A and 3B illustrated patterns arise due to an overlay of the arrangement of the pixel elements 35 with the regular grid 65 of the image sensor 53. Rather, by avoiding recurring patterns, at least along a sufficiently long reference distance L, in the arrangement of the pixel elements 35, it is possible to avoid recognizable patterns arising in the image 69, so that the images of the background reproduction device 15 created by the camera 23 can be used reliably.

[0096] As in Fig. 5 As illustrated, a frequency H of the distances a of the pixel elements 35 to the first reference lines R1 and / or to the second reference lines R2 can in particular be normally distributed. The normal distribution 71 can also in particular be compatible with an expected value 73 of zero, wherein the Fig. 5 The normal distribution 71 illustrated in particular has an expected value 73 of zero. The pixel elements 35 can thus be distributed statistically around the first reference lines R1 and the second reference lines R2 in such a way that the arrangement of the pixel elements 35, on average over a large area, creates the appearance of a regular arrangement. Such a distribution can, in particular, simplify compatibility with conventional systems that use a strictly regular arrangement of pixel elements 35, in order to be able to retrofit existing systems, for example, with such panels 41.In addition, an average distance between the pixel elements 35 and the first reference lines R1 and / or the second reference lines R2 can be less than one-third and / or less than one-tenth of the regular distance d between the first reference lines R1 and the second reference lines R2, so that the pixel elements 35 can be distributed only slightly relative to a regular grid, but sufficiently to avoid patterns arising in Figure 69. The required distribution can be determined, for example, by simulations.

[0097] However, in order to further increase the compatibility of the panel 41 with existing systems, the panel 41 has a control device 37 which is connected to a memory 39. As already explained, in particular a model of the virtual background 21 can be stored in this memory 39, on the basis of which model the control device 37 can generate the virtual background 21 and control the pixel elements 35 accordingly to reproduce the representation 19 of the virtual background 21. In addition, the control device 37 of the Fig. 4 illustrated panel 41 is designed to transform a virtual background 21 provided in the memory 39 in a regular grid 67 to coordinates K1, K2 and K3 of the pixel elements 35 and / or the irregular two-dimensional arrangement of the pixel elements 35. In principle, the control device 37 can also be designed to first project a virtual background 21 stored in the memory 39, for example a three-dimensional one, onto the regular grid 67 in order to transform the virtual background 21 then provided in the regular grid 67 to the coordinates K1, K2 and K3 of the pixel elements 35 of the panel 41.

[0098] In order to carry out such a transformation T, the coordinates K1, K2 and K3 of the pixel elements 35 can also be stored in the memory 39. The control device 37 can be designed as Fig. 7 illustrates transferring the coordinates K1, K2 and K3 into respective positions P1, P2 and P3 in the regular grid 67 of the provided virtual background in order to then determine a respective color value and / or brightness value assigned to the positions P1, P2 and P3.

[0099] For example, the control device 37 can determine such color values ​​and / or brightness values ​​using a nearest neighborhood method, in which the control device 37 determines a respective pixel 51 of the regular grid 67 that is closest to the positions P1, P2, and P3 and assigns the color value and / or brightness value of the corresponding pixel 51 to the positions P1, P2, and P3. For this purpose, the memory 39 can also store, in particular, the coordinates of the pixels 51 of the virtual background 21 in the regular grid 67. However, the control device 37 can also be designed to determine the values ​​for the positions P1, P2, and P3 using bilinear interpolation, in which four respective pixels 51 of the regular grid 67 surrounding the positions P1, P2, and P3 are used and their color values ​​and / or brightness values ​​are averaging to determine values ​​assigned to the respective positions P1, P2, and P3.In addition, the control device 37 can also be designed to carry out a bicubic interpolation, wherein 4 x 4 adjacent pixels 51 are used for each of the positions P1, P2 and P3.

[0100] While the control device 37 can thus be designed to perform such a transformation T and to determine the color values ​​and / or brightness values ​​assigned to the positions P1, P2, and P3, the control device 37 can also be designed to control the pixel elements 35 with the coordinates K1, K2, and K3 to reproduce the color values ​​and / or brightness values ​​assigned to the positions P1, P2, and P3. This ensures that, despite the irregular arrangement of the pixel elements 35, no distortion of the representation 19 of the virtual background 21 occurs, and since the panel 41 can be directly equipped with such a control device 37, a connection to existing systems that provide the virtual background 21 in the regular grid 67 can be easily established.

[0101] Fig. 6 schematically shows a further embodiment of a panel 41, in which a plurality of pixel elements 35 are statistically distributed relative to a regular grid. The panel 41 has a plurality of pixel units 47, which here are exemplary square (see also Fig. 8 ). In principle, hexagonal or octagonal configurations of such pixel units 47 can also be provided. The pixel units 47 also form a regular structure or a regular grid.

[0102] Each of the pixel units 47 has an eccentric light-emitting surface area 49, which forms the pixel element 35 and is arranged eccentrically with respect to a geometric center 48 of the pixel unit 47 (cf. Fig. 8 ). The statistical distribution of the pixel elements 35 relative to the regular grid formed by the pixel units 47 can be achieved by varying the alignment of the pixel units 47 along the first extension direction E1 and the second extension direction E2, so that the eccentric light-emitting surface regions 49 can be arranged with irregularly varying spacing from connecting lines between the pixel units 47 or reference lines R1 and R2. For this purpose, the pixel units 47 can in particular be arranged rotated relative to one another. Furthermore, the pixel units 47 can be mechanically coupled to one another and / or to a carrier in order to form the panel 41, and there can be a signaling connection between the pixel units 47 in order to be able to reproduce the representation 19 of the virtual background 21. Bezugszeichenliste

[0103] 10Recording system 11Background reproduction system 13Image recording studio 15Background reproduction device 17Real subject, actor 19Representation 21Virtual background 23Camera 31Lighting device 33LED wall 35Pixel element 37Control device 39Memory 41Panel 43Three-dimensional scene 44Light-emitting diode 45Light-emitting diode unit 47Pixel unit 48Geometric center 49Eccentric light-emitting surface area 51Pixel 53Image sensor 55Light-sensitive sensor element 57Row 59Camera lens, interchangeable lens 61Column 63Regular grid 65Regular grid 67Regular grid 69Figure 71Normal distribution 73Expected value 91First object 92Second object 93Third object 94Fourth object E1First extension direction E2Second extension direction HFrequency K1, K2, K3Coordinate LReference distance P1, P2, P3Position R1, R1*First reference line R2, R2*Second reference line TTransformation aDistance a1 - a6Distance b1 - b6Distance dRegular distance

Claims

1. A background display device (15) for a virtual image recording studio (13) that is configured to display, behind a real subject (17), a representation (19) of a virtual background (21) for a camera recording, wherein the background display device (15) comprises at least one panel (41) having a plurality of actively illuminating picture elements (35) that form a two-dimensional arrangement which extends along a first direction of extent (E1) and a second direction of extent (E2) oriented perpendicular thereto, wherein a respective spacing (b1, b2, b3, b4, b5, b6), measured along the second direction of extent (E2), of the picture elements (35) from a first reference line (R1), which extends rectilinearly along the first direction of extent (E1), varies irregularly along the first direction of extent (E1), characterized in that the panel (41) has a number of separate picture element units (47) that corresponds to the plurality of picture elements (35), said separate picture element units (47) forming a regular arrangement, wherein each picture element unit (47) has an eccentric light-emitting areal region (49) which corresponds to a respective picture element (35), but which is eccentrically arranged with respect to a geometric center (48) of the picture element unit (47), wherein the orientation of the respective eccentric light-emitting areal region (49) varies along the regular arrangement of picture element units (47).

2. A background display device (15) according to claim 1, wherein the background display device (15) is configured as an LED wall (33) and the picture elements (35) are configured as light-emitting diodes; and / or wherein the background display device (15) extends in a vertical and / or horizontal orientation; and / or wherein the first direction of extent (E1) is oriented along the horizontal and the second direction of extent (E2) is oriented along the vertical or inclined to the vertical; and / or wherein the background playback device (15) is configured to vary the representation (19) of the virtual background (21) in time during the camera recording; and / or wherein the background display device (15) comprises a plurality of mutually adjoining panels (41), wherein each panel (41) is formed as rectangular and without edges, and wherein the panels are arranged in a two-dimensional matrix, wherein the panels (41) are in particular formed identically to one another with respect to their two-dimensional arrangement of actively illuminating picture elements (35).

3. A background display device (15) according to claim 1 or 2, wherein the respective spacing (b1, b2, b3, b4, b5, b6) of the picture elements (35) from the first reference line (R1) varies irregularly along a reference path (L), which amounts to at least 5 cm and / or comprises at least 20 picture elements (35), along the first direction of extent (E1); or wherein the respective spacing (b1, b2, b3, b4, b5, b6) of the picture elements (35) from the first reference line (R1) varies irregularly over the total extent of the panel (41) along the first direction of extent (E1).

4. A background display device (15) according to any one of the preceding claims, wherein the spacings (b1, b2, b3, b4, b5, b6) of the picture elements (35) from the first reference line (R1) do not form a repeating pattern along the first direction of extent (E1); and / or wherein the spacings (b1, b2, b3, b4, b5, b6) of the picture elements (35) from the first reference line (R1) are normally distributed.

5. A background display device (15) according to any one of the preceding claims, wherein a respective spacing (a1, a2, a3, a4, a5, a6), measured along the first direction of extent (E1), of the picture elements (35) from a second reference line (R2), which extends rectilinearly along the second direction of extent (E2), varies irregularly along the second direction of extent (E2), wherein the spacings (a1, a2, a3, a4, a5, a6) of the picture elements (35) from the second reference line (R2) are in particular normally distributed.

6. A background display device (15) according to any one of the preceding claims, wherein the two-dimensional arrangement can be divided by a plurality of first reference lines (R1) extending along the first direction of extent (E1) and arranged at a regular spacing (d) from one another, wherein the regular spacing (d) corresponds to a mean value of spacings which picture elements (35) adjacent along the second direction of extent (E2) have from one another, wherein each of the plurality of picture elements (35) can be assigned to a respective first reference line (R1) to which the picture element (35) is adjacent with respect to the second direction of extent (E2), wherein a spacing (b1, b2, b3, b4, b5, b6) between each of the plurality of first reference lines (R1) and the respective assigned picture elements (35) varies irregularly along the first direction of extent (E1), wherein a number of the plurality of first reference lines (R1) in particular corresponds to a number of picture elements (35) which are arranged behind one another along the second direction of extent (E2) in the two-dimensional arrangement.

7. A background display device (15) according to claim 6, wherein a mean spacing between the picture elements (35) and the respective assigned first reference line (R1) of the plurality of first reference lines (R1) is less than one third of the regular spacing (d) or less than one tenth of the regular spacing (d).

8. A background display device (15) according to claim 6 or 7, wherein a distribution of the varying spacings (b1, b2, b3, b4, b5, b6) between the plurality of first reference lines (R1) and the respective assigned picture elements (35) corresponds to a normal distribution (71), wherein the normal distribution (71) is in particular compatible with an expected value (73) of zero and / or in particular has an expected value (73) of zero.

9. A background display device (15) according to any one of the preceding claims, wherein the two-dimensional arrangement can be divided by a plurality of second reference lines (R2) extending along the second direction of extent (E2) and arranged at a regular spacing (d) from one another, wherein the regular spacing (d) of the second reference lines (R2) corresponds to a mean value of spacings which picture elements (35) adjacent along the first direction of extent (E1) have from one another, wherein each of the plurality of picture elements (35) can be assigned to a respective second reference line (R2) to which the picture element (35) is adjacent with respect to the first direction of extent (E1), wherein a spacing (a1, a2, a3, a4, a5, a6) between each of the plurality of second reference lines (R2) and the respective assigned picture elements (35) varies irregularly along the second direction of extent (E2), wherein a number of the plurality of second reference lines (R2) in particular corresponds to a number of picture elements (35) which are arranged behind one another along the second direction of extent (E2) in the two-dimensional arrangement, and / or wherein a mean spacing between the picture elements (35) and the respective assigned second reference line (R2) of the plurality of second reference lines (R2) is in particular less than one third of the regular spacing (d) of the second reference lines (R2) from one another or less than one tenth of the regular spacing (d), and / or wherein a distribution of the picture elements (35) in particular appears as a regular structure with respect to the plurality of second reference lines (R2) on a large-area average, and / or wherein a distribution of the varying spacings (a1, a2, a3, a4, a5, a6) between the plurality of second reference lines (R2) and the respective assigned picture elements (35) in particular corresponds to a second normal distribution (71), wherein the second normal distribution (71) is in particular compatible with an expected value (73) of zero and / or in particular has an expected value (73) of zero.

10. A background display device (15) according to any one of the preceding claims, wherein the background display device (15) has a control device (37), wherein the control device (37) is connected to a memory (39) in which the virtual background (21) is stored as a representation in a regular grid (67), wherein the control device (37) is configured to transform the provided virtual background (21) into coordinates (K1, K2, K3) of the picture elements (35) in the two-dimensional arrangement, wherein the coordinates (K1, K2, K3) of the plurality of picture elements (35) are in particular stored in the memory (39) and / or can in particular be written into the memory (39), and / or wherein the virtual background (21) is in particular provided as a model in the memory (39), and / or wherein the control device (37) is in particular configured to control the picture elements (35) of the panel (41) individually and / or in groups of adjacent picture elements (35) to display the representation (19) of the virtual background (21).

11. A background display device (15) according to claim 10, wherein the control device (37) is configured to determine a respective color value and / or a respective brightness value for the picture elements (35) via the transformation (T) based on the virtual background (21) provided in the regular grid (67).

12. A background display device (15) according to claim 10 or 11, wherein the control device (37) is configured to transform the provided virtual background (21) into the coordinates (K1, K2, K3) of the picture elements (35) by a next neighbor method, a bilinear interpolation and / or a bicubic interpolation.

13. A method of displaying a representation (19) of a virtual background (21) by a background display device (15) according to any one of the preceding claims for a recording by a camera (23) in a virtual image recording studio (13), wherein the background display device (15) comprises at least one panel (41) having a plurality of actively illuminating picture elements (35) which form an irregular two-dimensional arrangement, wherein the virtual background (21) is provided as a representation in a regular grid (67) and is transformed into coordinates (K1, K2, K3) of the picture elements (35) in the irregular two-dimensional arrangement for the display on the background display device (15).