Multi-view display system and method using adaptive background

Abstract

An adaptive background multi-view image display system and method provide improved multi-view image quality. The system and method may involve generating crosstalk data that reduces crosstalk between a first view of a subject image and a second view of the subject image. The subject image may be a multi-view image to be overlaid on a background image. Crosstalk violations may be detected in the subject image based on the crosstalk data. At least one of a color value or a brightness value of the background image is determined based on the degree of the crosstalk violation to generate the background image. The subject image may then be overlaid on the generated background image.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority to U.S. Provisional Patent Application Serial No. 63 / 081274, filed on September 21, 2020, which is incorporated herein by reference in its entirety.

[0003] STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

[0004] none Background Art

[0005] Objects in three-dimensional (3D) space can be observed from multiple perspectives, depending on the viewing angle. In addition, when viewed by a user with stereoscopic vision, multiple views representing different perspectives of an object can be perceived simultaneously, effectively creating a sense of depth that can be perceived by the user. A multi-view display presents an image with multiple views to represent how an object is perceived in a 3D world. A multi-view display presents different views simultaneously to provide a realistic experience to the user. However, by presenting different views simultaneously, it is possible that at certain points along the display, parts of two or more views may interfere with each other, resulting in a less than ideal viewing experience. Specifically, part of one view may leak onto a second view. This phenomenon is known as 'crosstalk' and represents a potentially undesirable consequence of attempting to present multiple views of an object or 3D space using a multi-view display. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] The various features of examples and embodiments according to the principles described herein may be more readily understood by reference to the following detailed description taken in conjunction with the accompanying drawings, in which like reference numerals represent like structural elements, and in which:

[0007] Figure 1 Multi-view images are shown in an example according to an embodiment consistent with the principles described herein.

[0008] Figure 2 An example of crosstalk consistent with the principles described herein is shown.

[0009] Figure 3 An example of a crosstalk cancellation process consistent with the principles described herein is shown.

[0010] Figure 4 Shown are examples of visual artifacts produced by crosstalk cancellation operations consistent with the principles described herein.

[0011] Figure 5 An example of analyzing crosstalk violations is shown, according to an embodiment consistent with the principles described herein.

[0012] Figure 6An example of adapting the background of a multi-view image is shown, according to an embodiment consistent with the principles described herein.

[0013] Figure 7A and Figure 7B An adaptive background with a halo effect is shown in an example, according to an embodiment consistent with the principles described herein.

[0014] Figure 8A and Figure 8B An adaptive background with a color gradient effect is shown in an example, according to an embodiment consistent with the principles described herein.

[0015] Figure 9 A flow chart illustrating a system and method for adapting context to mitigate view crosstalk in multi-view images, according to an embodiment consistent with the principles described herein.

[0016] Figure 10 A schematic block diagram is shown depicting one example illustration of a computing device providing multi-view display according to various embodiments of the present disclosure.

[0017] Certain examples and embodiments have other features in addition to or in lieu of the features shown in the above drawings. These and other features are described in detail below with reference to the above drawings. DETAILED DESCRIPTION

[0018] Examples and embodiments according to the principles described herein provide improved user-perceived quality of multi-view images by adapting the background to mask or hide visual artifacts that may be present in the multi-view images. Specifically, according to some embodiments, the multi-view images may be processed by a crosstalk cancellation operation that reduces unwanted crosstalk but may introduce visual artifacts, such as ghosting along the edges of objects in the multi-view images. By tracking crosstalk violations caused by performing the crosstalk cancellation operation, the background image may have visual parameters (e.g., color, brightness) modified based on the presence, extent, or location of the crosstalk violations. As a result, the overall color, hue, brightness, or intensity of the background image may be modified to mask or hide any ghosting effects caused by the crosstalk cancellation operation. In other embodiments, the background image may be modified at specific locations based on which portions of the multi-view image correspond to crosstalk violations. Visual effects such as halos, color gradients, or other color / brightness effects may be applied to the background image to improve the perceived image quality of the multi-view image after it is overlaid on the background image. Thus, the background image is 'adaptive' such that its visual properties are modified to improve the viewing experience of the foreground of the multi-view image.

[0019] Figure 1A multi-view image 103 is shown in an example according to an embodiment consistent with the principles described herein. Multi-view image 103 has multiple views, such as a first view 106a, a second view 106b, a third view 106c, and a fourth view 106d. Each of views 106a to 106d corresponds to a different view direction. Figure 1 The multi-view image 103 is shown as a polygon with a specific depth. In the first view 106a, the multi-view image 103 is shown so that most of its depth is hidden. However, as the user changes the viewing angle from the second view 106b to the third view 106c and on to the fourth view 106d, the depth of the multi-view image becomes increasingly perceptible. Although four views 106a to 106d are shown, the present disclosure is directed to any number of multiple views. Additionally, Figure 1 The multi-view image 103 is visualized as a perceptible image having different views 106a to 106d, however, when processed for display, the multi-view image 103 is stored as data in a format that records the different viewing angles of the image.

[0020] The multi-view image 103 may be referred to as a subject image representing an item of interest to the user. The subject image may be an item for sale, an artifact, a model, or any other item representing a physical object. The subject image may be overlaid on a background image 109, where the background is intended not to distract the user from the subject image. In this regard, the background image 109 is an image intended to direct the user's attention to the subject image.

[0021] The multi-view image 103 overlaid on the background forms the final image presented by the multi-view display 112. A user can perceive different views of the multi-view image 103 by physically moving his or her eyes at different angles relative to the multi-view display. In other examples, the user can perceive different views of the multi-view image 103 by touching, sliding, or moving a cursor or controller to instruct the multi-view display 112 to rotate the multi-view image 103. Different views 106a to 106d of the multi-view image 103 can be simultaneously presented by the multi-view display 112. Each view 106a to 106d is presented by the multi-view display 112 in a different, corresponding principal orientation. When the multi-view image 103 is presented for display, the views 106a to 106d actually appear on or near the multi-view display 112. A 2D display can be substantially similar to the multi-view display 112, except that a 2D display is typically configured to provide a single view (e.g., only one of the views 106a to 106d) as opposed to the different views 106a to 106d of the multi-view image 103.

[0022] Herein, a 'two-dimensional display' or '2D display' is defined as a display configured to provide substantially the same view of an image regardless of the direction from which the image is viewed (i.e., within a predefined viewing angle or range of the 2D display). Conventional liquid crystal displays (LCDs) found in many smartphones and computer monitors are examples of 2D displays. In contrast, a 'multi-view display' is defined as an electronic display or display system configured to provide different views of a multi-view image in different viewing directions or simultaneously from a user's perspective. Specifically, the different views 106a to 106d may represent different perspective views of the multi-view image 103.

[0023] The multi-view display 112 can be implemented using various technologies that adapt the presentation of different image views so that they are perceived simultaneously. One example of a multi-view display is a display that employs a diffraction grating to control the principal direction of the different views 106a to 106d. In this document, a 'diffraction grating' is generally defined as a plurality of features (i.e., diffraction features) that are arranged to provide diffraction of light incident on the diffraction grating. In some examples, the plurality of features can be arranged in a periodic or quasi-periodic manner. For example, the diffraction grating can include a plurality of features arranged in a one-dimensional (1D) array (e.g., a plurality of grooves or ridges in the surface of a material). In other examples, the diffraction grating can be a two-dimensional (2D) array of features. For example, the diffraction grating can be a 2D array of protrusions or holes on the surface of a material. It should be understood that the multi-view display 112 can be implemented using structures other than diffraction gratings.

[0024] According to some embodiments, multi-view display 112 may be a light field display, which is a display that presents multiple light beams of different colors and different directions corresponding to different views. In some examples, a light field display is a so-called 'glasses-free' three-dimensional (3-D) display that can use a diffraction grating to provide an autostereoscopic representation of multi-view images without requiring special glasses to perceive depth.

[0025] like Figure 1 As shown, the multi-view display 112 includes a screen for displaying the multi-view image 103 overlaid on a background image 109. For example, the screen can be the display screen of a phone (e.g., a mobile phone, a smart phone, etc.), a tablet computer, a laptop computer, a computer monitor of a desktop computer, a camera display, or essentially any other electronic display of a device.

[0026] Figure 2An example of crosstalk according to an embodiment consistent with the principles described herein is shown. Here, 'crosstalk' is defined as the mixing of at least two views of a multi-view image. For example, at a particular viewing angle intended to display first view 106a, crosstalk may occur where a blurred representation of second view 106b is presented. As such, crosstalk may be an undesirable effect when displaying multi-view image 103.

[0027] Figure 2 The presentation of a multi-view image 103 at a particular viewing angle (e.g., viewing angle) is depicted. In this example, a first view 106a of the multi-view image is intended for presentation to a user. Similarly, the other views 106b through 106d are not intended for presentation to the user at this particular viewing angle. A portion 204 of the multi-view image 103 is also shown. The portion 204 includes a region consisting of one or more pixels of the multi-view image 103. Figure 2 The example of φ shows a portion 204 along an edge of the multi-view image 103 . The visual content contained within the portion 204 may be represented graphically in a color space 207 . Figure 2 The illustrated color space 207 graphically represents the brightness or intensity of a particular color(s) within a physical range defined by the boundaries of the portion 204 of the multi-view image 103. The brightness of the colors of each view 106a through 106d is graphically illustrated in the color space 207. Specifically, with respect to viewing the portion 204 at a particular viewing angle, the first view 106a has a first brightness level 210a (shown as a solid line), the second view 106b has a second brightness level 210b (shown as a thin dashed line), the third view 106c has a third brightness level 210c (shown as a dashed line), and the fourth view 106d has a fourth brightness level 210d (shown as a thick dashed line).

[0028] If there is no crosstalk, only the brightness of a single view will exist, and the brightness of other views can be ignored. Figure 2 In the example of FIG, when portion 204 is viewed at a particular angle, first view 106a is perceived as the brightest level, while the other views 106b to 106d leak into first view 106a. Figure 3 Reducing this crosstalk is discussed in further detail. In this example, the first view 106a is the intended view, having a first brightness level 210a relative to the highest brightness level. The other views 106b to 106d are considered unintended views and may have corresponding brightness levels 210b to 210d that leak into the first view 106a.

[0029] Figure 3An example of crosstalk cancellation according to an embodiment consistent with the principles described herein is shown. Here, crosstalk cancellation can be referred to as an anti-crosstalk (ACT) operation. Crosstalk cancellation begins by receiving a multi-view image and converting it into main image data 302. Main image data 302 can be a matrix of pixel values ​​for each view 106a to 106d of the multi-view image. A pixel value can be a numerical value representing the color of a pixel of a given color channel. For example, the multi-view image 103 can be formatted into an RGB type format so that it is represented as a red pixel value in the red (R) channel, a green pixel value in the green (G) channel, and a blue pixel value in the blue (B) channel. The RGB type format is an example of an image format defined by multiple color channels including but not limited to red, green, and blue. For illustration, a pure red image can have a large red pixel value while having a negligible green pixel value and a negligible blue pixel value. In some image formats, the range of pixel values ​​is from zero to two hundred and fifty-five (0-255). A pixel value of zero for a particular color means that the color is completely absent from the pixel (e.g., the particular color has zero intensity or brightness), while a pixel value of two hundred and fifty-five represents the maximum intensity or brightness of the particular color. In some embodiments, the subject image data 302 may represent the multi-view image 103 overlaid on a default background. The default background may be a solid black background in which the pixel values ​​for each color channel are zero. Figure 3 As shown, when in a specific part (e.g. Figure 2 When the subject image data 302 is graphically represented at a particular view of the portion 204 of the image data, the first brightness level 210a of the first view 106a is dominant, while other brightness levels 210b to 210d of different views 106b to 106d may leak into and interfere with the first view 106a.

[0030] A crosstalk cancellation operation 305 is performed on the subject image data 302. The crosstalk cancellation operation 305 may include implementing an algorithm that performs matrix arithmetic operations. For example, the crosstalk cancellation operation 305 may include performing a matrix subtraction operation, wherein the pixel values ​​of the unintended views (e.g., the second view 106b, the third view 106c, and the fourth view 106d) are subtracted from the total corresponding pixel values. To illustrate, a first pixel may have a specific pixel value for a specific color channel. The pixel may be directed to produce a light beam for the first view 106a. The pixel values ​​of the color channel associated with views other than the first view 106a may be subtracted from the specific pixel value. In other words, the specific pixel value is the sum of the component pixel values ​​of the different views 106a to 106d. By removing all component pixel values ​​corresponding to the unintended views (e.g., by performing a subtraction operation), the result is the pixel value of the intended view.

[0031] Applying the crosstalk cancellation operation 305 to the subject image data 302 results in processed subject image data 308. The processed subject image data 308 represents the multi-view image 103 with reduced crosstalk. When represented graphically in a color space, the first brightness level 210a of the first view 106a (e.g., the intended view for a particular viewing angle) may be slightly modified, while the brightness levels 210b-210d of the other views 106b-106d (e.g., unintended views for a particular viewing angle) are suppressed or otherwise attenuated to reduce crosstalk. Figure 3 3. The crosstalk cancellation operation 305 is performed to isolate the first brightness level 210a. It should be noted that the crosstalk cancellation operation 305 modifies the multi-view image 103 to reduce crosstalk by isolating the different views 106a to 106d. After performing the crosstalk cancellation operation 305, the processed subject image data 308 can be formatted into one or more matrices representing pixel values ​​at different color channels of the multi-view image 103.

[0032] Figure 4 An example of visual artifacts generated by a crosstalk cancellation operation 305 is shown, according to an embodiment consistent with the principles described herein. The crosstalk cancellation operation 305 may include a matrix operation that subtracts pixel values ​​of unintended views (views 106b through 106d) to isolate pixel values ​​of the intended view (e.g., first view 106a). The crosstalk cancellation operation 305 may introduce unintentional visual artifacts that degrade the quality of the multi-view image 103. Figure 4 4. It shows how a particular portion 401 of the multi-view image 103 may have a 'ghosting' effect 415 after the crosstalk cancellation operation 305. This portion 401 can be identified based on coordinates along the display (shown as X[i], Y[i]). These coordinates allow the location of the portion 401 to be identified and referenced.

[0033] The ghosting effect 415 may appear visually as blurriness or sharpness along the boundaries or edges of the multi-view image 103. The ghosting effect 415 may degrade the image quality and hinder the user's viewing experience from perceiving the clear, sharp multi-view images 103 presented on the multi-view display 112.

[0034] As defined herein, a 'ghosting effect' (e.g., ghosting effect 415) is a visual artifact that may be caused by performing a matrix subtraction operation that results in a 'negative pixel'. A 'negative pixel' is defined as a pixel having a negative pixel value in response to performing a pixel operation (e.g., crosstalk cancellation operation 305). Negative pixels are physically impossible and therefore can be treated as pixels having a pixel value of zero when rendering the pixel for display. In other words, an image format (such as an RGB type format) has a predefined range of pixel values ​​within each color channel. A pixel value is calculated to be negative (or below the range) and is automatically rendered as being at the minimum end of the range (e.g., zero).

[0035] When the multi-view image 103 is overlaid on a black background, a ghosting effect 415 may occur at or near the edges of the multi-view image 103. The operation of subtracting color from black or dark pixels may result in negative pixels. This may result in the ghosting effect 415. As discussed herein, generating an adaptive background may reduce the appearance of the ghosting effect 415. An embodiment is directed to improving the visual quality of a subject image on a multi-view display 112 by generating an adaptive background for the subject image. By tracking the negative pixels in response to a crosstalk cancellation operation 305, a background may be generated by modifying different visual parameters (e.g., color, hue, brightness) without changing the subject image. As a result, a visually pleasing, crosstalk-free multi-view image 103 may be presented on the multi-view display 112. As defined herein, 'crosstalk-free' refers to a multi-view image from which crosstalk has been removed by a crosstalk cancellation operation.

[0036] Furthermore, as used herein, the article 'a' is intended to have its ordinary meaning in the patent arts, i.e., 'one or more.' For example, 'processor' means one or more processors, and thus, 'memory' herein means 'one or more memory components.'

[0037] According to some embodiments of the principles described herein, a context for adapting multi-view images 103 is provided. Figure 5 An example of analyzing crosstalk violations in an example according to an embodiment consistent with the principles described herein is shown. Crosstalk violations are tracked in response to performing crosstalk cancellation operations 305. Crosstalk violations can be tracked with respect to their location in a coordinate system, the degree of violation, or both. According to various embodiments, the crosstalk violations are then used to generate a background image 109 that masks potential ghosting effects 415 resulting from performing crosstalk cancellation operations 305.

[0038] Figure 5 An example is provided in which a subject image has been received. Figure 5As shown, the subject image is a multi-view image 103. In some embodiments, the subject image is generated as the multi-view image 103 by segmenting the foreground image (e.g., the subject) from its original background before generating the adaptive background. For example, a disparity-based segmentation process can extract the subject from the image to generate the subject image. Different views of the subject image are maintained to ensure that it continues to be processed as the multi-view image 103.

[0039] According to the crosstalk cancellation operation 305, the Figure 5 , to generate processed subject image data 308. As described above, the crosstalk cancellation operation 305 takes into account the different views 106a to 106d of the subject image and minimizes leakage between these different views 106a to 106d. The processed subject image data 308 can be represented as a matrix of pixel values ​​for each color channel of the subject image. In this regard, the crosstalk cancellation operation 305 is performed for each color channel of the subject image. At least two pieces of information are contained in the crosstalk cancellation operation 305. First, new pixel values ​​for the subject image are generated to reduce crosstalk in the subject image. This is used to ultimately present the subject image on the multi-view display 112 in a manner that minimizes crosstalk. Second, there are crosstalk violations, for example, Figure 5 Crosstalk violation 507 is shown. After performing the crosstalk cancellation operation 305 on the subject image, crosstalk violation is determined based on negative pixel values ​​in the subject image. In other words, the presence of negative pixels can indicate a crosstalk violation.

[0040] Figure 5 Crosstalk data 509a to 509n generated for each color channel is shown. There may be a range from red channel crosstalk data 509a to blue channel crosstalk data 509n. The crosstalk data 509a to 509n for each color channel constitutes the processed subject image data 308 used to generate a crosstalk-free, multi-view subject image. Figure 5 Also shown are the pixel values ​​for each color channel at a particular portion 401 of the subject image. For example, the pixel values ​​are arranged into a two-dimensional matrix, where each pixel value corresponds to a pixel within the particular portion 401. Each pixel can have corresponding coordinates that locate the pixel relative to the image as a whole. In this example, the particular portion 401 contains an area spanning six pixels and giving pixels downward, thereby forming a matrix of thirty pixels, each pixel having a pixel value for each color channel. The pixel in the upper right corner has a red pixel value of one hundred and one (101) and a blue pixel value of twenty-one (21). For example, these pixel values ​​for the upper right corner pixel may have been modified in response to performing the crosstalk cancellation operation 305 using the original subject image. Although Figure 5 The specific portion 401 is shown to include a plurality of pixels, but it should be understood that in some embodiments, the specific portion 401 may include a single pixel.

[0041] like Figure 5 As shown, the crosstalk cancellation operation 305 may have generated a crosstalk violation for a particular pixel at a particular color channel. A crosstalk violation may be determined by comparing the pixel value at the particular color channel to a threshold pixel value (e.g., zero). In this example, all pixels with a pixel value below zero are considered to be pixels corresponding to crosstalk violations. This is shown in FIG. Figure 5 Pixels are shown as having thicker boxes around their pixel values. It should be noted that some pixels correspond to crosstalk violations for specific color channels. For example, as shown, the bottom left-most pixel in portion 401 has a crosstalk violation in the red channel (e.g., a pixel value of negative seventy-seven (-77)), while it does not correspond to a crosstalk violation in the blue channel (e.g., a pixel value of three (3)).

[0042] According to various embodiments, crosstalk violations (e.g., crosstalk violation 507) can be tracked. Tracking crosstalk violations can involve identifying and recording the location of the crosstalk violation, analyzing the extent of the crosstalk violation, or otherwise quantifying the extent of the crosstalk violation. This will be discussed in further detail below. When a crosstalk violation is tracked, the processed subject image data 308 can cause the pixel values ​​corresponding to the crosstalk violation to be set to zero to allow the subject image to be presented without negative pixels. However, by tracking the crosstalk violation, an adaptive background is generated to mitigate or even blur the ghosting effect 415 that may be perceived by the user after the crosstalk cancellation operation 305 is performed.

[0043] Figure 6 An example of adapting the background of a multi-view image 103 according to an embodiment consistent with the principles described herein is shown. Crosstalk violations (e.g., Figure 5 Crosstalk violation 507 shown in FIG. Figure 6 An example of a portion 401 of a subject image (referenced as multi-view image 103) containing at least one pixel corresponding to a crosstalk violation is shown. It will be appreciated that there may be several pixels or portions of pixels scattered around the subject image that may correspond to crosstalk violations.

[0044] Based on the tracking of one or more crosstalk violations, an adaptive background image 109 (i.e., an adaptive background image) can be generated. The background image 109 can be generated from a default background that is modified to mask or otherwise visually hide the ghosting effect 415 caused by the crosstalk cancellation operation 305. For example, a portion 401 containing one or more pixels of the subject image can be mapped to a corresponding location on the background image 109. For example, the coordinates of the portion 401 of the subject image can be mapped to a corresponding portion 605 of the background image 109.

[0045] When identifying the position of the corresponding portion 605 of the background image 109, one or more visual parameters 609 can be determined and then applied to modify the background image 109. The visual parameters 609 can correspond to the hue, brightness, intensity, or pixel value of a specific color channel. In one embodiment, the pixel value of the background image 109 is set for each pixel corresponding to a crosstalk violation (e.g., crosstalk violation 507) based on the position and degree of the crosstalk violation. For example, suppose that after performing the crosstalk cancellation operation 305 on the subject image, a specific pixel has a red channel pixel value of negative seventy (-70) within the subject image. This means that the specific pixel is darker than black, which is physically impossible and is therefore a crosstalk violation. When the subject image undergoing crosstalk cancellation is displayed, the specific pixel can have a red pixel value of zero to indicate that there is no red in the specific pixel. In this regard, setting the negative pixel value to zero effectively introduces color into the subject image without crosstalk. When generating the background image 109, the position of the specific pixel can be mapped to the background image 109 to identify the corresponding background image pixel. The corresponding background image pixels may have their red pixel values ​​increased to mitigate or compensate for the removal of the crosstalk violations. For example, the particular pixel above may have its red pixel value increased by seventy (70) to effectively reintroduce the red color that was introduced as a result of the crosstalk cancellation operation 305. By selectively increasing the color or brightness values ​​of the background image, the increased color or brightness of the background compensates for and matches the increased color or brightness caused by the removal of the crosstalk violations of the subject image.

[0046] According to some embodiments, for each pixel corresponding to a crosstalk violation, an increase in pixel value may be applied pixel by pixel.As a result, individual pixels of background image 109 may have their pixel values ​​of different color channels modified based on the location or extent of the crosstalk violation of the subject image.

[0047] In other embodiments, portion 401 may include multiple pixels. An average pixel value for portion 401 may be calculated for each color channel. If portion 401 contains a high crosstalk violation, the average pixel value may be negative. Portion 401 may be mapped to a corresponding portion 605 of background image 109. Visual parameters 609 may be applied to the corresponding portion 605 of background image 109 based on the average pixel value. According to some embodiments, applying visual parameters 609 may include increasing the pixel values ​​of background image 109 by the average pixel value of portion 401. Furthermore, visual parameters 609 may be applied to background image 109 for each color channel.

[0048] In some embodiments, the degree of crosstalk violation is quantified, and visual parameters 609 can be applied globally to background image 109 without considering the specific location(s) of the crosstalk violation(s). For example, for a given color channel, the average pixel value of all negative pixels can be calculated. The color channel of background image 109 can increase its pixel value by this average pixel value on a global level. Therefore, visual parameters 609 can be applied globally by adjusting the color, hue or brightness of background image 109 as a whole.

[0049] Figure 7A and Figure 7B An adaptive background with a halo effect 703 is shown in an example according to an embodiment consistent with the principles described herein. Halo effect 703 is generated by modifying visual parameters 609 from a point radially outward. The result of modifying visual parameters 609 outward is a circular or circular-like pattern with varying colors, hues, brightness, or intensities. For example, the center of halo effect 703 can start at a green hue and extend radially, creating a gradient toward a dark green hue. Halo effect 703 can be completely circular, semi-circular, or otherwise partially circular. Halo effect 703 can be defined by inner visual parameters 609 and outer visual parameters 609, where visual parameters 609 increase or decrease at values ​​between the inner and outer visual parameters 609. According to various embodiments, the rate of increase or decrease of visual parameters 609 can be linear or exponential.

[0050] In order to generate the halo effect 703, the portion of the subject image that contains the crosstalk violation can be identified. This portion of the subject image can be mapped to the corresponding portion 605 of the background image 109. Once the position of the corresponding portion 605 is identified, the halo effect 703 is generated so that the position of the corresponding portion 605 forms the center or outer edge of the halo. Based on the position of the corresponding portion 605, the visual parameters 609 of the background image 109 are adjusted to create the halo effect 703. The color, brightness, hue or intensity of the halo effect 703 can be determined for each color channel. In addition, the color, brightness, hue or intensity of the halo effect 703 can be based on the negative pixel value of the pixel corresponding to the crosstalk violation. The pixel values ​​of different pixels can be modified radially to form the halo effect.

[0051] Figure 7B The subject image without crosstalk (e.g., processed according to the crosstalk cancellation operation 305) as the multi-view image 103 is shown superimposed on the background image 109, which is adapted to blur any ghosting effects (e.g., ghosting effects 415) caused by the crosstalk cancellation operation 305. Figure 7BAs shown, the background image 109 is adapted with a halo effect 703 that is selectively positioned to mask, hide, or blur potential ghosting effects that appear at the edges of the subject image. As a result, the blurriness caused by the ghosting effect is visually matched with the halo effect 703 to provide overall sharpness to the crosstalk-free subject image without modifying the subject image.

[0052] Figure 8A and Figure 8B An adaptive background with a color gradient effect 808 is shown in an example according to an embodiment consistent with the principles described herein. The color gradient effect 808 is similar to Figure 7A , but may extend the gradient in a single direction rather than radially. The color gradient effect 808 may have a starting visual parameter that changes (e.g., increases, decreases) toward an end point. The color gradient effect 808 may begin at a position based on the position of the corresponding portion 605 of the background image 109 that is mapped to the portion 401 of the subject image containing the crosstalk violation. The pixel values ​​of different pixels may be modified along a particular direction to form a gradient effect.

[0053] In some embodiments, the location of the portion 401 of the subject image containing the crosstalk violation is identified by detecting an edge formed by a set of pixels corresponding to pixel values ​​associated with the crosstalk violation. An edge can be detected by determining whether there is a series of pixels corresponding to the crosstalk violation that are aligned or arranged in a particular direction (e.g., horizontally, vertically, diagonally, curved, etc.). An edge can be detected based on whether the number of pixels corresponding to a threshold violation along the particular direction exceeds a threshold number. For example, assuming the threshold is twenty pixels, if there are at least twenty consecutive pixels corresponding to the threshold violation along the particular direction, this may constitute an edge.

[0054] Once an edge corresponding to a pixel that violates a threshold is detected, the location of the edge can be recorded. The location can be stored as pixel coordinates. Figure 8A In the example shown in FIG. 1 , corresponding portion 605 is determined so that it includes the edge of the subject image's crosstalk violation. When generating background image 109, the position and orientation of corresponding portion 605 can be used to create color gradient effect 808. For example, color gradient effect 808 can be generated so that it begins along the edge and progresses away from the position of the subject image corresponding to the boundary of background image 109.

[0055] Figure 8B The subject image without crosstalk (e.g., processed according to the crosstalk cancellation operation 305) is shown as a multi-view image 103 superimposed on the background image 109, which is adapted to blur any ghosting effects caused by the crosstalk cancellation operation. Figure 8BAs shown, the background image 109 is adapted with a color gradient effect 808 that is selectively positioned to mask, hide, or blur potential ghosting effects 415 that appear at the edge of the subject image. The blurriness caused by the ghosting effect can be visually matched with the color gradient effect 808 to provide overall sharpness to the crosstalk-free subject image without modifying the subject image.

[0056] Figure 9 is a flowchart illustrating an example of a function of adapting a background of a multi-view image according to various embodiments. Figure 9 The flowchart of provides an example of different types of functions implemented by an application or other set of instructions executable by a computing device. Figure 9 The flowcharts of FIG. 1 may be viewed as depicting examples of elements of a method implemented in a computing device according to one or more embodiments.

[0057] At item 904, the computing device receives a subject image, wherein the subject image is configured to be overlaid on a background image (e.g., background image 109). The subject image can be a multi-view image 103 composed of two or more views. The subject image can be formatted in an image format defined by multiple color channels. For example, the image format can be an RGB format (red, green, and blue format) similar to a format that records pixel values ​​of different color channels.

[0058] The subject image can be generated by extracting the content of the subject from the initial image. In this regard, the resulting subject image can be without a background or otherwise a default background (e.g., a solid black background). For example, the subject image can be extracted from the initial image and overlaid on a default background, where the default background sets pixel values ​​to zero for each color channel.

[0059] At item 907, the computing device performs a crosstalk cancellation operation to generate crosstalk data. For example, the crosstalk cancellation operation 305 described above can be used to generate crosstalk data 509a to 509n. According to various embodiments, a crosstalk cancellation operation can be performed on each color channel of the subject image, thereby obtaining crosstalk data generated separately for each color channel. For example, if the subject image formatted in RGB format has three color channels, the computing device can generate red channel crosstalk data, green channel crosstalk data, and blue channel crosstalk data. The crosstalk data is used to minimize crosstalk in the subject image. As described above, the crosstalk cancellation operation 305 can include a matrix subtraction operation to remove unexpected views that leak into the expected view. For example, the pixel values ​​of the first view (e.g., the first view 106a) can be subtracted from the pixel values ​​of the subject image at a specific position to emphasize the second view (e.g., the second view 106b). Therefore, the crosstalk cancellation operation can remove red, green, and blue pixel values ​​from the subject image to isolate a single view of a specific perspective.

[0060] At item 910, the computing device identifies a crosstalk violation. The crosstalk data may include one or more crosstalk violations. A crosstalk violation may be determined based on negative pixel values ​​in the subject image. This will apply a threshold of zero pixel value. In some embodiments, when determining whether a pixel corresponds to a crosstalk violation, the degree of negativity of the pixel value may be considered. For example, if the pixel value is more negative than negative ten (-10), a crosstalk violation 507 may be detected.

[0061] In some embodiments, crosstalk violation 507 is determined based on an average value (e.g., mean, median, modulus) of pixel values ​​over a portion of a plurality of pixels (e.g., portion 401). If the average pixel value is below a threshold value (e.g., zero), the portion of pixels may be considered to contain a crosstalk violation. The portion of the subject image containing the crosstalk violation may be located, referenced, and identified based on a pixel-based coordinate system.

[0062] Crosstalk violations can be quantified to determine the extent of the crosstalk violations. For example, an average pixel value can be determined for all pixels corresponding to negative pixels. If crosstalk violations are defined as negative pixels, the average extent of the crosstalk violations can be determined by averaging only the pixel values ​​of the negative pixels.

[0063] Thus, embodiments are directed to identifying crosstalk violations within crosstalk data. The location of the crosstalk violation may be recorded (e.g., storing pixel coordinates of the pixel corresponding to the crosstalk violation), the extent of the crosstalk violation may be recorded (e.g., storing pixel values ​​or other statistics based on the pixel values ​​of the pixel corresponding to the crosstalk violation), or a combination thereof.

[0064] Because crosstalk violations (e.g., the presence of negative pixels) can be introduced by the crosstalk cancellation process, crosstalk violations can be removed by setting negative pixel values ​​to zero or some other minimum value defined by the image format. For example, the image format may define pixel values ​​to be between 0 and 255. If the crosstalk cancellation operation results in a pixel value below this range (e.g., a negative pixel value), this results in a crosstalk violation. Such crosstalk violations can be removed by setting the pixel value to a minimum value (e.g., 0) while also tracking the crosstalk violations to generate an adaptive background.

[0065] At item 913, the computing device modifies a visual parameter (e.g., visual parameter 609) of a background image (e.g., background image 109). The visual parameter can be a color value or a brightness value. The visual parameter can affect the color, hue, brightness, or intensity of the background image. The visual parameter can be a pixel value of a particular color channel (e.g., a red channel, a green channel, a blue channel, etc.). According to various embodiments, the visual parameter can be determined based on the detection of a crosstalk violation. If removing the crosstalk violation results in adding a certain amount of red and green from the subject image, a similar amount of red and green can be added to the background image to match the color caused by removing the crosstalk violation. For example, a crosstalk cancellation operation may result in a pixel having a red channel pixel value of negative seventy (-70), a green channel pixel value of negative one hundred (-100), and a blue channel pixel value of positive eighty (80). Due to the presence of the negative pixel, the particular pixel can be identified as a pixel having a crosstalk violation with respect to the red and green channels, but not the blue channel. When crosstalk is removed from the subject image, the crosstalk violation can be removed by setting the negative pixel value to zero, thereby increasing the color value. In this example, a pixel may have its red and green channel pixel values ​​set to zero, while its blue channel pixel value remains at eighty (80). By converting negative pixel values ​​to zero, the removal of the crosstalk violation results in an increase in the red and green pixel values ​​of the pixel in the subject image.

[0066] In order to create an adaptive background that mitigates the ghosting effect, the visual parameters of the background image are modified to compensate for or match the removal of the crosstalk violations. This creates a visual effect that adapts the background to blend with the ghosting effect by increasing the color and / or brightness values ​​of the background image. Using the example above, the pixel values ​​of the background image can be increased by seventy (70) for the red channel and one hundred (100) for the green channel. These increases in value can be at or near the location of the crosstalk violations in the subject image, or can be applied globally. If the background image starts with a default black image, at least some of the pixels can be set to a value of seventy (70) for the red channel and one hundred (100) for the green channel.

[0067] According to various embodiments, crosstalk violations may be quantified for a specific pixel, a portion containing multiple pixels, or for the entire subject image. In some embodiments, when covering multiple pixels, crosstalk violations may be quantified as an average pixel value for each color channel.

[0068] After determining the visual parameters, the visual parameters are applied to the background image to adapt the background image to mask or hide unintentional visual artifacts produced by the crosstalk cancellation operation. The background image can begin with a default image, such as a background with a uniform color. In some embodiments, the background image begins with a default black image in which all color values ​​are set to zero. The visual parameters are then applied to the default background image. In some embodiments, the color values ​​of the default background image are uniformly increased based on the degree of crosstalk violations. Increasing the color values ​​of the default background image can include adding a specific color or hue to the default background image, wherein the color value of the color hue is determined by tracking the degree of crosstalk violations.

[0069] In some embodiments, the position of a portion associated with a crosstalk violation is used to adjust the visual attributes of a corresponding portion having a corresponding position in the background image. For example, if the upper left portion of the subject image contains a large degree of crosstalk violation in the blue channel, a similar degree of blue (e.g., blue pixel values) can be added to the upper left portion of the background image.

[0070] In some embodiments, the location of the portion associated with the crosstalk violation is identified and mapped to a corresponding portion of the background image. A halo effect (e.g., halo effect 703), a gradient effect (e.g., color gradient effect 808), or other visual effects can be applied based on the corresponding portion of the background image. Visual parameters can be changed to achieve the visual effect by adding color or brightness that reflects the color lost due to the crosstalk cancellation operation.

[0071] At item 917, the computing device overlays the subject image on the generated background image. The subject image is a multi-view image that may have been modified by a crosstalk cancellation operation. In this regard, the subject image is considered to be 'crosstalk-free' so that crosstalk is reduced or minimized. In addition, an adaptive background is generated by performing a crosstalk cancellation operation, tracking crosstalk violations, removing crosstalk violations, and modifying the visual parameters of the background image to compensate for the color increase caused by removing the crosstalk violations. This results in the background image being adaptive so that it blends with the visual artifacts introduced by the crosstalk cancellation operation.

[0072] At item 917, the crosstalk-free subject image is overlaid on the background image. Overlaying the crosstalk-free subject image may include adding pixel values ​​from the background image to corresponding pixel values ​​of the subject image. A final image may then be rendered for display on a multi-view display (e.g., multi-view display 112), where the subject image (without crosstalk) is overlaid on the background image (adaptive based on intelligently applying visual parameters).

[0073] While embodiments are directed to a subject image to be overlaid on a background image that has been adapted to compensate for visual artifacts introduced by crosstalk cancellation, other embodiments are directed to operations on a multi-view image starting with a combination of both the subject image and the background image. The subject image can be identified from the multi-view image. For example, a user can select an area of ​​the multi-view image to designate as the subject image. In other embodiments, computer image recognition techniques can automatically identify the subject image in the multi-view image. Edge detection operations can automatically identify the subject image within the multi-view image. After identifying the subject image, the remaining portion of the multi-view image can be designated as the background image. Crosstalk cancellation operations can be performed on the subject image. Crosstalk violations can be identified, tracked, and removed. Based on the location, extent, or both of the crosstalk violations, the visual parameters of the background image can be modified to compensate for the color increase caused by removing the crosstalk violations. The resulting image is a multi-view image in which the identified subject is crosstalk-free and in which the background is adapted to blur any ghosting effects caused by crosstalk cancellation.

[0074] Discussed above Figure 9 A flowchart may illustrate a system or method adapted to a background image with functions and operations implemented by an instruction set. If embodied in software, each box may represent a module, segment, or portion of code that includes instructions for implementing a specified logical function. The instructions may be embodied in the form of source code including human-readable statements written in a programming language, object code compiled from the source code, or machine code including digital instructions that can be recognized by an appropriate execution system (such as a processor of a computing device). Machine code may be converted from source code, etc. If embodied in hardware, each block may represent a circuit or multiple interconnected circuits to implement the specified logical function.

[0075] although Figure 9 The flowcharts of the present invention illustrate a particular order of execution, but it should be understood that the order of execution may differ from that depicted. For example, the order of execution of two or more blocks may be disrupted relative to the order shown. Moreover, two or more blocks shown may be executed concurrently or partially concurrently. Furthermore, in some embodiments, one or more blocks may be skipped or omitted.

[0076] Figure 101 is a schematic block diagram illustrating an example of a computing device 1000 providing a multi-view display according to various embodiments of the present disclosure. The computing device 1000 may include a system of components that perform various computing operations for a user of the computing device 1000. The computing device 1000 may be a laptop computer, a tablet computer, a smartphone, a touch screen system, an intelligent display system, or other client device. The computing device 1000 may include various components, such as a processor 1003, a memory 1006, an input / output (I / O) component 1009, a display 1012, and potentially other components. These components may be coupled to a bus 1015 that serves as a local interface to allow the components of the computing device 1000 to communicate with each other. Although the components of the computing device 1000 are shown as being contained within the computing device 1000, it should be understood that at least some of the components may be coupled to the computing device 1000 via external connections. For example, the components may be externally plugged into the computing device 1000 or otherwise connected to the computing device 1000 via an external port, socket, plug, or connector.

[0077] The processor 1003 may be a central processing unit (CPU), a graphics processing unit (GPU), or any other integrated circuit that performs computational processing operations. The processor 1003 may include one or more processing cores. The processor 1003 includes circuitry for executing instructions. The instructions include, for example, computer code, programs, logic, or other machine-readable instructions received and executed by the processor 1003 to perform the computational functions embodied in the instructions. The processor 1003 may execute instructions to operate on data. For example, the processor 1003 may receive input data (e.g., an image), process the input data according to an instruction set, and generate output data (e.g., a processed image). As another example, the processor 1003 may receive instructions and generate new instructions for subsequent execution.

[0078] Memory 1006 may include one or more memory components. In this document, memory 1006 is defined as including one or both of volatile memory and non-volatile memory. Volatile memory components are those that do not retain information when power is removed. Volatile memory may include, for example, random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), magnetic random access memory (MRAM), or other volatile memory structures. System memory (e.g., main memory, cache, etc.) can be implemented using volatile memory. System memory refers to fast memory that can temporarily store data or instructions for fast read and write access to assist processor 1003.

[0079] Non-volatile memory components are those that retain information when power is removed. Non-volatile memory includes read-only memory (ROM), hard drives, solid-state drives, USB flash drives, memory cards accessed via a memory card reader, floppy disks accessed via an associated floppy disk drive, optical disks accessed via an optical drive, and magnetic tapes accessed via an appropriate magnetic tape drive. ROM may include, for example, programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or other similar memory devices. Storage memory may be implemented using non-volatile memory to provide long-term retention of data and instructions.

[0080] Memory 1006 may refer to a combination of volatile and non-volatile memory for storing instructions and data. For example, data and instructions may be stored in non-volatile memory and loaded into volatile memory for processing by processor 1003. The execution of instructions may include, for example, a compiler that is translated into machine code and then run by processor 1003, a format that can be loaded from non-volatile memory into volatile memory, source code that is converted into a suitable format, such as object code that can be loaded into volatile memory for execution by processor 1003, or source code that is interpreted by another executable program to generate instructions in volatile memory and executed by processor 1003, etc. Instructions may be stored or loaded in any part or component of memory 1006, including, for example, RAM, ROM, system memory, storage, or any combination thereof.

[0081] Although memory 1006 is shown as separate from other components of computing device 1000, it should be understood that memory 1006 may be at least partially embedded or otherwise integrated into one or more components. For example, processor 1003 may include onboard memory registers or cache to perform processing operations.

[0082] The I / O component 1009 includes, for example, a touch screen, a speaker, a microphone, buttons, switches, a dial, a camera, a sensor, an accelerometer, or other components that receive user input or generate output directed to the user. The I / O component 1009 can receive user input and convert it into data to be stored in the memory 1006 or processed by the processor 1003. The I / O component 1009 can receive data output by the memory 1006 or the processor 1003 and convert them into a format that the user can perceive (e.g., sound, tactile response, visual information, etc.).

[0083] A specific type of I / O component 1009 is a display 1012. Display 1012 can include a multi-view display, a multi-view display combined with a 2D display, or any other display that presents images. A capacitive touch screen layer serving as I / O component 1009 can be layered within the display to allow a user to provide input while simultaneously perceiving visual output. Processor 1003 can generate data formatted as an image for presentation on display 1012. Processor 1003 can execute instructions to present an image on the display for perception by the user.

[0084] The bus 1015 facilitates the communication of instructions and data between the processor 1003, memory 1006, I / O components 1009, the display 1012, and any other components of the computing device 1000. The bus 1015 may include address translators, address decoders, fabrics, conductive traces, wires, ports, plugs, sockets, and other connectors to enable the communication of data and instructions.

[0085] The instructions within memory 1006 may be implemented in various forms to implement at least a portion of a software stack. For example, the instructions may be embodied as an operating system 1031, an application 1034, a device driver (e.g., a display driver 1037), firmware (e.g., display firmware 1040), or other software components. The operating system 1031 is a software platform that supports the basic functions of the computing device 1000, such as scheduling tasks, controlling the I / O components 1009, providing access to hardware resources, managing power, and supporting applications 1034.

[0086] The application 1034 executes on the operating system 1031 and can obtain access to the hardware resources of the computing device 1000 via the operating system 1031. In this regard, the execution of the application 1034 is at least partially controlled by the operating system 1031. The application 1034 can be a user-level software program that provides advanced functions, services, and other functions to the user. In some embodiments, the application 1034 can be a dedicated 'app' that the user can download or otherwise access on the computing device 1000. The user can launch the application 1034 via the user interface provided by the operating system 1031. The application 1034 can be developed by a developer and defined in various source code formats. The application 1034 can be developed using many programming or scripting languages, such as C, C++, C#, Objective C, Swift, Perl, PHP, Visual The application 1034 may be compiled into target code by a compiler or interpreted by an interpreter for execution by the processor 1003 .

[0087] Device drivers, such as display driver 1037, include instructions that allow operating system 1031 to communicate with various I / O components 1009. Each I / O component 1009 may have its own device driver. Device drivers may be installed so that they are stored in memory and loaded into system memory. For example, upon installation, display driver 1037 translates high-level display instructions received from operating system 1031 into low-level instructions implemented by display 1012 to display an image.

[0088] Firmware, such as display firmware 1040, for example, may include machine code or assembly code that allows the I / O component 1009 or the display 1012 to perform low-level operations. The firmware may convert component-specific electrical signals into higher-level instructions or data. For example, the display firmware 1040 may control how the display 1012 activates individual pixels at a low level by adjusting voltage or current signals. The firmware may be stored in non-volatile memory and executed directly from the non-volatile memory. For example, the display firmware 1040 may be embodied in a ROM chip coupled to the display 1012, such that the ROM chip is separate from other memory and system memory of the computing device 1000. The display 1012 may include processing circuitry for executing the display firmware 1040.

[0089] The operating system 1031, application programs 1034, drivers (e.g., display driver 1037), firmware (e.g., display firmware 1040), and potentially other instruction sets may each include instructions that can be executed by the processor 1003 or other processing circuitry of the computing device 1000 to perform the functions and operations described above. Although the instructions described herein may be embodied in software or code executed by the processor 1003 as described above, the instructions may alternatively be embodied in dedicated hardware or a combination of software and dedicated hardware. For example, the functions and operations performed by the instructions discussed above may be implemented as circuits or state machines that employ any one or more combinations of a variety of technologies. These technologies may include, but are not limited to, discrete logic circuits having logic gates for implementing various logic functions when one or more data signals are applied, application-specific integrated circuits (ASICs) having appropriate logic gates, field-programmable gate arrays (FPGAs), or other components.

[0090] In some embodiments, instructions for performing the functions and operations described above may be embodied in a non-transitory computer-readable storage medium. The computer-readable storage medium may or may not be part of the computing device 1000. Instructions may include, for example, statements, codes, or declarations that can be retrieved from the computer-readable medium and executed by a processing circuit (e.g., one or more processors 1003). In the context of the present disclosure, a 'computer-readable medium' may be any medium that can contain, store, or maintain the instructions described herein for use by or in conjunction with an instruction execution system (e.g., the computing device 1000).

[0091] Computer readable media can include any of a number of physical media such as magnetic, optical, or semiconductor media. More specific examples of suitable computer readable media can include, but are not limited to, magnetic tape, magnetic floppy disks, magnetic hard drives, memory cards, solid-state drives, USB flash drives, or optical disks. Furthermore, the computer readable medium can be a random access memory (RAM), including, for example, static random access memory (SRAM) and dynamic random access memory (DRAM), or a magnetic random access memory (MRAM). Additionally, the computer readable medium can be a read-only memory (ROM).

[0092] (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or other types of memory devices.

[0093] The computing device 1000 may perform any of the operations described above or implement the functionality described above. For example, the flowcharts and process flows discussed above may be performed by a computing device 1000 that executes instructions and processes data. Although the computing device 1000 is shown as a single device, the present disclosure is not limited thereto. In some embodiments, the computing device 1000 may offload processing of instructions in a distributed manner, such that multiple computing devices 1000 operate together to execute instructions that may be stored or loaded in a distributed arrangement. For example, at least some instructions or data may be stored, loaded, or executed in a cloud-based system that operates in conjunction with the computing device 1000.

[0094] Thus, examples and embodiments have been described for adapting to the background of a multi-view image, tracking crosstalk violations, and adjusting visual parameters of the background image 109 to mask or hide ghosting effects and other undesirable visual artifacts produced by the crosstalk cancellation operation. It should be understood that the above examples are merely some of the many specific examples that illustrate the principles described herein. Clearly, those skilled in the art can readily devise numerous other arrangements without departing from the scope of the invention as defined by the appended claims.

Claims

1. A computer-implemented method for adapting a background image of a multi-view image, the method comprising: generating crosstalk data to reduce crosstalk between a first view of a subject image and a second view of the subject image, the subject image comprising a multi-view image to be overlaid on the background image, wherein a portion of the crosstalk data comprises a crosstalk violation, wherein the crosstalk violation is determined based on a pixel value of the subject image being below a threshold pixel value; modifying a visual parameter of the background image based on at least one of a location or an extent of the crosstalk violation to compensate for removing the crosstalk violation in the subject image, the visual parameter comprising at least one of a color pixel value or a brightness pixel value; and The subject image is overlaid on the background image, and the subject image and the background image are presented on a multi-view display.

2. The computer-implemented method of claim 1 , wherein: Generating the crosstalk data includes generating the crosstalk data separately for each color channel of the first view of the subject image and the second view of the subject image.

3. The computer-implemented method of adapting a background image of a multi-view image according to claim 1 , wherein: Modifying the visual parameter includes increasing at least one of a color pixel value or a brightness pixel value of the background image based on the location of the crosstalk violation.

4. The computer-implemented method of adapting a background image of a multi-view image according to claim 1 , wherein: The background image includes at least one of a halo or a color gradient positioned according to the location of the crosstalk violation.

5. The computer-implemented method of adapting a background image of a multi-view image according to claim 1 , wherein: The crosstalk violations are removed from the subject image by setting pixel values ​​corresponding to the crosstalk violations to zero.

6. The computer-implemented method of adapting a background image for a multi-view image of claim 1 , further comprising identifying the location of the crosstalk violation by detecting an edge formed by a set of pixels corresponding to pixel values ​​associated with the crosstalk violation.

7. A multi-view image display system using an adaptive background image, the system comprising: processor; as well as A memory storing a plurality of instructions, which, when executed, cause the processor to: receiving a subject image configured to be overlaid on a background image, the subject image being a multi-view image; performing a crosstalk cancellation operation to generate crosstalk data based on the first view of the subject image and the second view of the subject image; identifying a portion of the subject image associated with a crosstalk violation based on the crosstalk data, wherein the crosstalk violation is determined based on a pixel value of the subject image being below a threshold pixel value; as well as A visual parameter of the background image is modified at a location corresponding to the identified portion of the subject image, the visual parameter comprising at least one of a color pixel value or a brightness pixel value, the subject image and background image being configured for presentation on a multi-view display.

8. The multi-view image display system using an adaptive background image according to claim 7, wherein: The crosstalk violation is determined based on negative pixel values ​​in the subject image.

9. The multi-view image display system using an adaptive background image according to claim 7, wherein: The subject image can be formatted in a format defined by a plurality of color channels.

10. The multi-view image display system using an adaptive background image according to claim 9, wherein: The crosstalk data is generated separately for each color channel of the plurality of color channels.

11. The multi-view image display system using an adaptive background image according to claim 7, wherein: The plurality of instructions, when executed, further cause the processor to determine the visual parameters to generate at least one of a halo effect or a color gradient based on identifying a location of the portion of the subject image and mapping the location to the location on the background image.

12. The multi-view image display system using an adaptive background image according to claim 7, wherein: The crosstalk violations are removed from the subject image by setting pixel values ​​corresponding to the crosstalk violations to zero, and the visual parameters are modified to compensate for the removal of the crosstalk violations.

13. The multi-view image display system using an adaptive background image according to claim 7, wherein: The plurality of instructions, when executed, further cause the processor to: identify the location of the portion by identifying a group of pixels having an average pixel value below a threshold pixel value.

14. A non-transitory computer-readable storage medium storing executable instructions, wherein the instructions, when executed by a processor of a computer system, implement adaptation of a background image, comprising: generating crosstalk data to reduce crosstalk between a first view of a subject image and a second view of the subject image, the subject image comprising a multi-view image; detecting a crosstalk violation in the subject image based on the crosstalk data, wherein the crosstalk violation is determined based on a pixel value of the subject image being below a threshold pixel value; Modifying pixel values ​​of the background image according to the degree of the crosstalk violation; and The subject image is overlaid on the background image, the subject image and background image being configured to be presented on a multi-view display.

15. The non-transitory computer-readable storage medium of claim 14, wherein: When the executable instructions are executed by the processor of the computer system, the executable instructions further implement adaptation of the background image, including: determining a location of a portion of the subject image corresponding to the crosstalk violation; and The pixel value of the background image is set according to the determined position.

16. The non-transitory computer-readable storage medium of claim 15, wherein: The pixel values ​​of the background image include pixel values ​​of different pixels set to form a halo positioned according to the position of the portion.

17. The non-transitory computer-readable storage medium of claim 15, wherein: The pixel values ​​of the background image include a plurality of different pixel values ​​arranged to form a color gradient based on the position of the portion.

18. The non-transitory computer-readable storage medium of claim 14, wherein: Generating the crosstalk data includes generating crosstalk data for each color channel of the first view of the subject image and the second view of the subject image, respectively.

Images