Display data generation method and display data generation system

Abstract

This disclosure provides a method and system for generating display data. The method includes the following steps: storing a plurality of acquired images, wherein the plurality of acquired images have different light intensity distributions; selecting at least two acquired images from the plurality of acquired images; and generating the display data based on the at least two acquired images. Therefore, the method and system disclosed herein can effectively generate display data.

Description

Technical Field

[0001] This disclosure relates to a data generation technology, and more particularly to a display data generation method and a display data generation system. Background Technology

[0002] Traditional 3D display effects can only present a sense of depth from images viewed from different angles. However, because objects appear to shift geometrically from different perspectives, traditional image acquisition methods cannot accurately represent realistic material characteristics when applied to 3D displays. Summary of the Invention

[0003] This disclosure relates to a method and system for generating display data, which can effectively generate display data.

[0004] According to embodiments disclosed herein, a display data generation method includes the following steps: storing a plurality of acquired images, wherein the plurality of acquired images have different light intensity distributions; selecting at least two acquired images from the plurality of acquired images; and generating display data based on the at least two acquired images.

[0005] According to an embodiment of this disclosure, the display system includes a display device, a storage device, and a processing device. The storage device stores multiple acquired images. The multiple acquired images are generated by capturing images of an acquisition target illuminated by a first light source device at different light source positions using the image acquisition device. The processing device is coupled to the display device and the storage device, and is used to select at least two acquired images from the multiple acquired images. The processing device generates display data based on the at least two acquired images, and drives the display device based on the display data.

[0006] Based on the above, the display data generation method and display data generation system disclosed herein can generate display data using at least two acquired images with different light intensity distributions.

[0007] To make the foregoing more understandable, several embodiments with accompanying drawings are described in detail below. Attached Figure Description

[0008] Figure 1 This is a schematic diagram of a display system according to an embodiment of the present disclosure;

[0009] Figure 2 This is a flowchart of a display data generation method according to an embodiment of the present disclosure;

[0010] Figure 3 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure;

[0011] Figure 4 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure;

[0012] Figure 5 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure;

[0013] Figure 6 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure;

[0014] Figure 7 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure;

[0015] Figure 8 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure;

[0016] Figure 9 This is a schematic diagram of multiple acquired images according to an embodiment of the present disclosure;

[0017] Figure 10 This is a schematic diagram of multiple acquired images according to an embodiment of the present disclosure;

[0018] Figure 11 This is a schematic diagram of multiple acquired images according to an embodiment of the present disclosure;

[0019] Figure 12 This is a schematic diagram illustrating the generation of display data according to an embodiment of this disclosure;

[0020] Figure 13 This is a schematic diagram illustrating the generation of display data according to an embodiment of this disclosure;

[0021] Figure 14 This is a schematic diagram of generating a composite image according to an embodiment of the present disclosure.

[0022] Explanation of icon numbers

[0023] 100: Display system;

[0024] 110: Processing device;

[0025] 120: Display device;

[0026] 130: Storage device;

[0027] 140: Image acquisition device;

[0028] 150, 160: Light source device;

[0029] 301~303, 910: Obtain the target;

[0030] 304: Background;

[0031] 901~903, 1210_1~1210_N, 1310_1~1310_M, 1410, 1420, 1430: Acquire images;

[0032] 911, 911', 911”, 912, 912', 912”: light spots;

[0033] 1221: Image displayed in the left eye;

[0034] 1222: Image displayed in the right eye;

[0035] 1320, 1440: Composite image;

[0036] 1411, 1421, 1431: Partial images;

[0037] S210~S230: Steps;

[0038] P1~P3, P1'~P3', Pa~Pc: Position. Detailed Implementation

[0039] Reference will now be made in detail to the exemplary embodiments disclosed herein, examples of which are illustrated in the accompanying drawings. Wherever possible, the same element symbols are used in the drawings and description to denote the same or similar parts.

[0040] Throughout this disclosure and the appended claims, certain terms are used to refer to specific components. Those skilled in the art will understand that electronic device manufacturers may use different names to refer to the same component. This document is not intended to distinguish between components that have the same function but different names. In the following description and claims, the terms (e.g., “comprise” and “include”) are open-ended and should be interpreted as “including, but not limited to…”.

[0041] The term "coupled (or connected)" as used throughout this disclosure (including the appended claims) may refer to any direct or indirect connection. For example, if the context states that a first device is coupled (or connected) to a second device, it should be interpreted as the first device being directly connected to the second device, or the first device being indirectly connected to the second device via other devices or certain connecting members. The terms "first," "second," and similar terms used throughout this disclosure (including the appended claims) are used only to name discrete elements or to distinguish them in different embodiments or scopes. Therefore, these terms should not be considered as upper or lower limits on the number of elements or as limiting the order of elements. Furthermore, elements / components / steps using the same reference numerals in the drawings and embodiments denote the same or similar parts wherever possible. The same reference numerals or the same terms may be used in different embodiments to cross-reference related descriptions of elements / components / steps.

[0042] Figure 1This is a schematic diagram of a display system according to an embodiment of this disclosure. (See reference...) Figure 1 The display system 100 includes a processing device 110, a display device 120, and a storage device 130. The processing device 110 is coupled to the display device 120 and the storage device 130. In this embodiment, the storage device 130 is used to store multiple acquired images. The processing device 110 can read at least a portion of the multiple acquired images stored in the storage device 130 and generate display data based on at least a portion of the multiple acquired images. The processing device 110 can output the display data to the display device 120 to drive the display device 120 according to the display data.

[0043] In this embodiment, the processing device 110 may include, for example, a central processing unit (CPU), a graphics processing unit (GPU) or other programmable general-purpose or special-purpose microprocessors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), programmable logic devices (PLDs), other similar processing circuits, or combinations of these devices.

[0044] In this embodiment, the display device 120 may be, for example, a 3D display, a glasses-free 3D display, an augmented reality (AR) display, a virtual reality (VR) display, a mixed reality (MR) display, a multi-view 3D display, or a light field display. In one embodiment, the processing device 110 may output display data to the light field display device, so that the light field display device can display images with enhanced material gloss (light field gloss) display effects to observers viewing from different viewing angles based on the display data. When the display device displays light field gloss content, the display device is a light field gloss display.

[0045] In this embodiment, the storage device 130 may include, for example, a memory. The memory may be, for example, non-volatile memory (NVM). The storage device 130 can be used to store related programs, modules, data, or algorithms for implementing various embodiments of this disclosure. The related programs, modules, data, or algorithms are accessible and executed by the processing device 110 to implement the related functions and operations in various embodiments of this disclosure.

[0046] Figure 2This is a flowchart of a display data generation method according to an embodiment of this disclosure. (See also...) Figure 1 as well as Figure 2 The display system 100 is used to perform the following steps S210-S230. In step S210, the storage device 130 can store multiple acquired images. In step S220, the processing device 110 can select at least two acquired images from the multiple acquired images. In step S230, the processing device 110 can generate display data based on the at least two acquired images. The processing device 110 can drive the display device 120 based on the display data. In this embodiment, the multiple acquired images have different light intensity distributions. The light intensity distribution can be measured using a "beam analyzer" or using a "photometric curve meter" and a "distribution photometer" to measure the luminous intensity distribution of the acquired images in space. Furthermore, the specific methods of acquiring the multiple acquired images disclosed herein will be described in detail by the following embodiments.

[0047] Figure 3 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure. (See reference) Figure 3 In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 capturing images of multiple acquisition targets 301-303 and the background 304 illuminated by the light source device 150, and the image acquisition device 140 outputs the multiple acquired images to... Figure 1 Storage device 130. It should be noted that the number of image acquisition devices, light source devices, and acquisition targets disclosed herein are not limited to... Figure 3 In one embodiment, Figure 1 The display system 100 may also include a display data generation system, and the display data generation system includes an image acquisition device 140 and a light source device 150.

[0048] In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 capturing images of the acquisition targets 301-303 illuminated by the light source device 150 sequentially switching between different light source positions P1-P3 from a fixed viewing angle. For example, when the light source device 150 is positioned at light source position P1 to illuminate the acquisition targets 301-303, the image acquisition device 140 can capture images from a fixed viewing angle to obtain the first acquired image. When the light source device 150 is positioned at light source position P2 to illuminate the acquisition targets 301-303, the image acquisition device 140 can capture images from a fixed viewing angle to obtain the second acquired image. When the light source device 150 is positioned at light source position P3 to illuminate the acquisition targets 301-303, the image acquisition device 140 can capture images from a fixed viewing angle to obtain the third acquired image. Therefore, due to the change in the position of the light source device 150, its illumination effect on the acquisition targets 301-303 will also change accordingly. In this way, the first to third acquired images can each have different light intensity distributions. In particular, since the acquired targets 301-303 are illuminated by the light source device 150 at different illumination angles, the acquired target images in the first to third acquired images may have different gloss effects, which can effectively enhance the display effect when the display device 120 displays the light field gloss image. The light field gloss display effect can be, for example, that the observer's left and right eyes can see different brightness changes when viewing a stereoscopic image, and that the observer can see continuously changing light and shadow misalignment when the observer's viewing angle changes.

[0049] Figure 4 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure. (See reference) Figure 4 In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 capturing images of multiple acquisition targets 301-303 and the background 304 illuminated by the light source devices 150 and 160, and the image acquisition device 140 outputs the multiple acquired images to... Figure 1 Storage device 130. It should be noted that the number of image acquisition devices, light source devices, and acquisition targets disclosed herein are not limited to... Figure 4 In one embodiment, Figure 1 The display system 100 may also include a display data generation system, and the display data generation system includes an image acquisition device 140 and a light source device 150, 160.

[0050] In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 capturing images of the acquisition targets 301-303 illuminated by the light source device 150 sequentially switching between different light source positions P1-P3 at a fixed viewing angle, and also by the light source device 160 illuminating the acquisition targets 301-303 at a fixed light source position P1'. The viewing angle is the angular range within which the image acquisition device 140 can receive images. A fixed viewing angle position is information about receiving images at the same position within a fixed angular range. For example, when the light source device 150 is positioned at light source position P1 and the light source device 160 is positioned at light source position P1' to illuminate the acquisition targets 301-303, the image acquisition device 140 can capture images at a fixed viewing angle to obtain the first acquired image. When the light source device 150 is positioned at light source position P2 and the light source device 160 is positioned at light source position P1' to illuminate the acquisition targets 301-303, the image acquisition device 140 can capture images at a fixed viewing angle to obtain the second acquired image. When the light source device 150 is positioned at light source position P3 and the light source device 160 is positioned at light source position P1' to illuminate the target 301-303, the image acquisition device 140 can capture a third image from a fixed viewing angle. Therefore, due to the change in the position of the light source device 150, its illumination effect on the target 301-303 also changes accordingly. As a result, the first to third acquired images can each have different light intensity distributions. In particular, because the target 301-303 is affected by the illumination from the light source device 150 at different illumination angles, the target images in the first to third acquired images can have different gloss effects, and this effectively enhances the gloss display effect when the display device 120 is a gloss display.

[0051] Figure 5 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure. (See reference) Figure 5 In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 capturing images of multiple acquisition targets 301-303 and the background 304 illuminated by the light source devices 150 and 160, and the image acquisition device 140 outputs the multiple acquired images to... Figure 1 Storage device 130. It should be noted that the number of image acquisition devices, light source devices, and acquisition targets disclosed herein are not limited to... Figure 5 In one embodiment, Figure 1 The display system 100 may also include a display data generation system, and the display data generation system includes an image acquisition device 140 and a light source device 150, 160.

[0052] In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 capturing images of the acquisition targets 301-303 at a fixed viewing angle, illuminated by the light source device 150 sequentially switching between different light source positions P1-P3, and by the light source device 160 sequentially switching between different light source positions P1'-P3' to illuminate the acquisition targets 301-303. For example, when the light source device 150 is positioned at light source position P1 and the light source device 160 is positioned at light source position P1' to illuminate the acquisition targets 301-303, the image acquisition device 140 can capture images at a fixed viewing angle to obtain the first acquired image. When the light source device 150 is positioned at light source position P2 and the light source device 160 is positioned at light source position P2' to illuminate the acquisition targets 301-303, the image acquisition device 140 can capture images at a fixed viewing angle to obtain the second acquired image. When the light source device 150 is positioned at light source position P3 and the light source device 160 is positioned at light source position P3' to illuminate the target 301-303, the image acquisition device 140 can capture a third image from a fixed viewing angle. Therefore, due to the change in the position of the light source device 150, its illumination effect on the target 301-303 will also change accordingly. In this way, the first to third acquired images can each have different light intensity distributions. In particular, since the target 301-303 is affected by the illumination from the light source devices 150 and 160 at different illumination angles, the target images in the first to third acquired images can have different gloss effects, and this can effectively enhance the gloss display effect when the display device 120 is a gloss display.

[0053] In addition, from another perspective, the multiple images disclosed herein can be generated by the image acquisition device 140 capturing images of an acquisition target illuminated by at least one light source device at different light source positions.

[0054] Figure 6 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure. (See reference) Figure 6 In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 capturing images of multiple acquisition targets 301-303 and the background 304 illuminated by the light source device 150, and the image acquisition device 140 outputs the multiple acquired images to... Figure 1 Storage device 130. It should be noted that the number of image acquisition devices, light source devices, and acquisition targets disclosed herein are not limited to... Figure 6 In one embodiment, Figure 1 The display system 100 may also include a display data generation system, and the display data generation system includes an image acquisition device 140 and a light source device 150.

[0055] In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 sequentially switching between different viewing positions Pa~Pc and the light source device 150 sequentially switching between different light source positions P1~P3 to illuminate the acquisition targets 301~303. For example, when the light source device 150 is set at light source position P1 to illuminate the acquisition targets 301~303, the image acquisition device 140 can take a picture at viewing position Pa to obtain the first acquired image. When the light source device 150 is set at light source position P2 to illuminate the acquisition targets 301~303, the image acquisition device 140 can take a picture at viewing position Pb to obtain the second acquired image. When the light source device 150 is set at light source position P3 to illuminate the acquisition targets 301~303, the image acquisition device 140 can take a picture at viewing position Pc to obtain the third acquired image. Therefore, as the position of the light source device 150 changes, its illumination effect on the acquisition targets 301~303 will also change accordingly. Furthermore, due to the change in position of the image acquisition device 140, the image acquisition results for the acquisition targets 301-303 can have a deeper object contour effect or a stereoscopic parallax effect (stereoscopic vision result). In this way, the first to third acquired images can each have different light intensity distributions. In particular, since the acquisition targets 301-303 are affected by the illumination from the light source device 150 at different illumination angles, the acquisition target images in the first to third acquired images can have different gloss effects, and this can effectively enhance the gloss display effect when the display device 120 is a gloss display.

[0056] Figure 7 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure. (See reference) Figure 7 In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 capturing images of multiple acquisition targets 301-303 and the background 304 illuminated by the light source devices 150 and 160, and the image acquisition device 140 outputs the multiple acquired images to... Figure 1 Storage device 130. It should be noted that the number of image acquisition devices, light source devices, and acquisition targets disclosed herein are not limited to... Figure 7 In one embodiment, Figure 1 The display system 100 may also include a display data generation system, and the display data generation system includes an image acquisition device 140 and a light source device 150, 160.

[0057] In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 sequentially switching between different viewing positions Pa~Pc to capture images of the acquisition targets 301~303 illuminated by the light source device 150 sequentially switching between different light source positions P1~P3, and also by the light source device 160 illuminating the acquisition targets 301~303 at a fixed light source position P1'. For example, when the light source device 150 is set at light source position P1 and the light source device 160 is set at light source position P1' to illuminate the acquisition targets 301~303, the image acquisition device 140 can capture an image at viewing position Pa to obtain the first acquired image. When the light source device 150 is set at light source position P2 and the light source device 160 is set at light source position P1' to illuminate the acquisition targets 301~303, the image acquisition device 140 can capture an image at viewing position Pb to obtain the second acquired image. When the light source device 150 is positioned at light source position P3 and the light source device 160 is positioned at light source position P1' to illuminate the target 301-303, the image acquisition device 140 can capture an image at viewing angle position Pc to obtain a third image. Therefore, due to the change in the position of the light source device 150, its illumination effect on the target 301-303 will change accordingly. Furthermore, due to the change in the position of the image acquisition device 140, the image acquisition result for the target 301-303 may have a deeper object contour effect or a stereoscopic parallax effect (stereoscopic vision result). In this way, the first to third acquired images can each have different light intensity distributions. In particular, because the target 301-303 is affected by the illumination from the light source device 150 at different illumination angles, the target images in the first to third acquired images can have different gloss effects, and this can effectively enhance the gloss display effect when the display device 120 is a gloss display.

[0058] Figure 8 This is a schematic diagram illustrating the generation and acquisition of images according to an embodiment of this disclosure. (See reference) Figure 8 In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 capturing images of multiple acquisition targets 301-303 and the background 304 illuminated by the light source devices 150 and 160, and the image acquisition device 140 outputs the multiple acquired images to... Figure 1 Storage device 130. It should be noted that the number of image acquisition devices, light source devices, and acquisition targets disclosed herein are not limited to... Figure 8 In one embodiment, Figure 1 The display system 100 may also include a display data generation system, and the display data generation system includes an image acquisition device 140 and a light source device 150, 160.

[0059] In one embodiment, the multiple acquired images disclosed herein can be generated by the image acquisition device 140 sequentially switching between different viewing positions Pa~Pc to capture images of the acquisition targets 301~303 illuminated by the light source device 150 sequentially switching between different light source positions P1~P3, and also by the light source device 160 sequentially switching between different light source positions P1'~P3' to illuminate the acquisition targets 301~303. For example, when the light source device 150 is set at light source position P1 and the light source device 160 is set at light source position P1' to illuminate the acquisition targets 301~303, the image acquisition device 140 can capture images at viewing position Pa to obtain the first acquired image. When the light source device 150 is set at light source position P2 and the light source device 160 is set at light source position P2' to illuminate the acquisition targets 301~303, the image acquisition device 140 can capture images at viewing position Pb to obtain the second acquired image. When the light source device 150 is positioned at light source position P3 and the light source device 160 is positioned at light source position P3' to illuminate the target 301-303, the image acquisition device 140 can capture an image at viewing angle Pc to obtain a third image. Therefore, due to the change in the positions of the light source devices 150 and 160, the illumination effect on the target 301-303 will change accordingly. Furthermore, due to the change in the position of the image acquisition device 140, the image acquisition result for the target 301-303 may have a deeper object contour effect or a stereoscopic parallax effect (stereoscopic vision result). In this way, the first to third acquired images can each have different light intensity distributions. In particular, because the target 301-303 is affected by the illumination from the light source devices 150 and 160 at different illumination angles, the target images in the first to third acquired images can have different gloss effects, and this can effectively enhance the gloss display effect when the display device 120 is a gloss display.

[0060] In addition, regarding the above Figures 3 to 8 The positions and quantities of the image acquisition device, light source device, acquisition target, and background in the embodiments are not limited to those described in the above embodiments. Furthermore, the background is only used to indicate the scene background in which the acquisition target is located.

[0061] Figure 9 This is a schematic diagram of multiple acquired images according to an embodiment of this disclosure. (See reference) Figure 9Taking the acquisition of images 901-903 as an example, the acquisition of images 901-903 includes the acquisition target 910. In one embodiment, the acquisition of images 901-903 may also be post-processed by the processing device 110 or other image processor to make the acquisition of images 901-903 have first high intensity spots 911, 911', and 911" at different positions on the acquisition target 910, so as to simulate different gloss effects and effectively enhance the gloss display effect when the display device 120 is a gloss display. Here, a spot refers to any point in the shadow that is brighter than the surrounding area. In addition, the first high intensity spots 911, 911', and 911" may have the same or different light intensities.

[0062] Figure 10 This is a schematic diagram of multiple acquired images according to an embodiment of this disclosure. (See reference) Figure 10 Taking the acquisition of images 901-903 as an example, the acquisition of images 901-903 includes the acquisition target 910. In one embodiment, the acquisition of images 901-903 may also be post-processed by the processing device 110 or other image processor so that the acquisition of images 901-903 respectively have first high intensity spots 911, 911', 911" at different positions on the acquisition target 910, and have second high intensity spots 912 at the same position, so as to simulate different gloss effects and effectively enhance the light field gloss display effect when the display device 120 is a light field gloss display. In addition, the first high intensity spots 911, 911', 911" and the second high intensity spot 912 may have the same or different light intensities.

[0063] Figure 11 This is a schematic diagram of multiple acquired images according to an embodiment of this disclosure. (See reference) Figure 11 Taking the acquisition of images 901-903 as an example, the acquisition of images 901-903 includes the acquisition target 910. In one embodiment, the acquisition of images 901-903 may also be post-processed by the processing device 110 or other image processor so that the acquisition of images 901-903 respectively have first high intensity spots 911, 911', 911" at different positions on the acquisition target 910, and second high intensity spots 912, 912', 912" at different positions, to simulate different gloss effects, and can effectively enhance the light field gloss display effect when the display device 120 is a light field gloss display. In addition, the first high intensity spots 911, 911', 911" and the second high intensity spot 912 may have the same or different light intensities.

[0064] Figure 12This is a schematic diagram illustrating the generation of display data according to an embodiment of this disclosure. (See reference...) Figure 1 as well as Figure 12 In one embodiment, the storage device 130 may store, for example, Figure 12 The multiple acquired images 1210_1 to 1210_N shown are used, where N is a positive integer. When the display device 120 is, for example, a single-view 3D display, a naked-eye 3D display, an augmented reality display, a virtual reality display, a mixed reality display, a multi-view 3D display, or a light field display, the processing device 110 can select at least one first image from the acquired images 1210_1 to 1210_N to generate left-eye display data, and select at least one second image from the acquired images 1210_1 to 1210_N to generate right-eye display data. For example, the processing device 110 can determine to select acquired image 1210_2 from the acquired images 1210_1 to 1210_N as the left-eye display image 1221 based on the observer's current viewing angle, viewing direction, or eye position detected by the detector, and generate the corresponding left-eye display data. The processing device 110 can select image 1210_(N-1) from images 1210_1 to 1210_N as the right-eye display image 1222 based on the observer's current viewing angle, viewing direction, or eye position detected by the detector, and generate corresponding right-eye display data. Alternatively, the processing device 110 can select images 1210_1 and 1210_3 from images 1210_1 to 1210_N and perform image synthesis to generate the left-eye display image 1221, and generate corresponding left-eye display data. The processing device 110 can select images 1210_(N-2) and 1210_N from images 1210_1 to 1210_N and perform image synthesis to generate the right-eye display image 1222, and generate corresponding right-eye display data.

[0065] Figure 13 This is a schematic diagram illustrating the generation of display data according to an embodiment of this disclosure. (See reference...) Figure 1 as well as Figure 13 In one embodiment, the storage device 130 may store, for example, Figure 13The diagram shows multiple acquired images 1310_1 to 1310_M, where M is a positive integer. When the display device 120 is, for example, a multi-view 3D display, a naked-eye 3D display, a multi-view 3D display, or a light field type display, the processing device 110 can select at least two acquired images from the acquired images 1310_1 to 1310_M and synthesize at least two acquired images into a composite image 1320 to generate display data. For example, the processing device 110 can select acquired images 1310_1, 1310_3, 1310_(M-2), and 1310_M from the acquired images 1310_1 to 1310_M to synthesize a composite image 1320 and generate corresponding display data. Alternatively, the processing device 110 can also select all of the acquired images 1310_1 to 1310_M to synthesize a composite image 1320.

[0066] Figure 14 This is a schematic diagram illustrating the generation of a composite image according to an embodiment of this disclosure. (See reference) Figure 1 as well as Figure 14 In one embodiment, when the display device 120 is, for example, a light field gloss display, the processing device 110 can be as follows: Figure 14 The composite image 1440 is generated using a composite image method, but this disclosure is not limited thereto. In other embodiments, the light field gloss display may also utilize other image processing methods to display image content with light field gloss display effects using different image acquisition methods.

[0067] In one embodiment, the processing device 110 may generate a composite image 1440 and output it to the display device 120 so that the display device 120 may display, based on the composite image 1440, an acquired target image (i.e., a light field gloss display effect) that can present a display effect with gloss variation (such as a realistic gloss effect) to observers viewing from different viewing angles.

[0068] Specifically, taking the acquisition of images 1410, 1420, and 1430 as examples, image 1410 may correspond to an image from a right-side perspective, for example. Image 1420 may correspond to an image from a central perspective, for example. Image 1430 may correspond to an image from a left-side perspective, for example. The right-side perspective, central perspective, and left-side perspective refer to the angle between the observer's line of sight to the display device 120 from the right-side, front-view, and left-side positions of the display device 120 and the display plane of the display device 120. The processing device 110 can acquire a portion of image 1411 in image 1410 corresponding to the right-view orientation (e.g., image blocks in columns 1, 4, 7 to (1+3k), where k is a positive integer), a portion of image 1421 in image 1420 corresponding to the central-view orientation (e.g., image blocks in columns 2, 5, 8 to (2+3k), and a portion of image 1431 in image 1430 corresponding to the left-view orientation (e.g., image blocks in columns 3, 6, 9 to (3+3k)). Then, the processing device 110 can merge the portions of images 1411, 1421, and 1431 to generate a composite image 1440.

[0069] To this end, the multiple pixels of the display device 120 (i.e., the light field gloss display) can be directional, so that the observer can observe the display results of different pixels from different viewing angles. Therefore, when the display device 120 displays the composite image 1440, the observer can view the light field gloss display effects of the acquired images 1410, 1420, and 1430 with different gloss changes from, for example, a right-side viewing angle, a central viewing angle, and a left-side viewing angle. The observer can view the image content of, for example, the image blocks in columns 1, 4, 7 to (1+3k) of a portion of image 1411 from a right-side viewing angle. The observer can view the image content of, for example, the image blocks in columns 2, 5, 8 to (2+3k) of a portion of image 1421 from a central viewing angle. The observer can view the image content of, for example, the image blocks in columns 3, 6, 9 to (3+3k) of a portion of image 1431 from a left-side viewing angle.

[0070] In summary, the display data generation method and system disclosed herein can illuminate the target at different illumination angles using at least one light source device to generate multiple acquired images with different gloss effects. Furthermore, the display data generation method and system disclosed herein can use multiple acquired images with different gloss effects to generate corresponding display data, so that the target displayed by the display device can have a display effect similar to real gloss changes (i.e., exhibiting material characteristics close to reality), or even an enhanced gloss display effect (strengthening the material's gloss characteristics, not just realistic gloss changes).

[0071] In another embodiment, this disclosure provides a display system including a display and a tracking element, and a method for using tracking technology to detect the user's position and adjust the displayed image content to improve the continuity of the display's viewing angle. In this embodiment, the display system can actively adjust the input image content to ensure that the user can view a continuous and better image from different viewing angles.

[0072] Specifically, the tracking elements may include eye trackers or head trackers. The display system uses eye trackers or head trackers to detect the user's eye position (e.g., including three-dimensional coordinates (x, y, z)), and based on this position information, dynamically selects multiple original image contents from the original image set that best suit the current viewing angle and performs calculations to generate the displayed image content. The displayed image content can be achieved in a variety of ways.

[0073] In one embodiment, the displayed image content can be generated by averaging the pixel values ​​(such as grayscale or brightness) of multiple original image contents (e.g., 2, 3, 5 or 7 images).

[0074] In another embodiment, the displayed image content can be generated by mixing multiple original image contents in different proportions using gradient ratios (e.g., Imagenew = Image0). 20% + Image1 80%.

[0075] In another embodiment, the displayed image content can be interpolated (e.g., by interpolation) to interpolate multiple original image contents to generate more angles of displayed image content, thereby filling the gaps between viewing angles.

[0076] In another embodiment, the display image content can be generated by first interpolating the original image content to expand the angular information, and then combining it with an average or gradient scaling method.

[0077] The “selective multi-image method” used in this disclosure will vary depending on the 3D algorithm and is applicable to two-view VR / 3D displays, as well as multi-view 3D displays and even light field displays.

[0078] By detecting the user's current location and using the aforementioned image processing techniques, this disclosure can provide a smoother, more continuous, and better visual experience, improving the ability for users to see better images regardless of their movement.

[0079] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions disclosed herein, and are not intended to limit them. Although the present disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments disclosed herein.

Claims

1. A method for generating display data, characterized in that, include: Store multiple acquired images, wherein the multiple acquired images have different light intensity distributions; Select at least two images from the plurality of acquired images; as well as The display data is generated based on the at least two acquired images.

2. The display data generation method according to claim 1, characterized in that, The multiple acquired images are generated by capturing images of the target illuminated by at least one light source device at different light source positions using an image acquisition device.

3. The method for generating display data according to claim 1, characterized in that, The multiple acquired images are generated by capturing images of the target illuminated by a first light source device at different light source positions and by a second light source device at a fixed light source position using an image acquisition device.

4. The display data generation method according to claim 1, characterized in that, The multiple acquired images are generated by capturing the target at a fixed viewing angle using an image acquisition device.

5. The display data generation method according to claim 1, characterized in that, The multiple acquired images are generated by capturing the target from different angles and positions using an image acquisition device.

6. The method for generating display data according to claim 5, characterized in that, The multiple acquired images each have a first high-intensity light spot at a different position on the acquired target.

7. The method for generating display data according to claim 6, characterized in that, The multiple acquired images each have a second high-intensity light spot at the same or different positions on the acquired target.

8. The method for generating display data according to claim 1, characterized in that, The steps for generating the display data include: At least one first image is selected from the plurality of acquired images to generate left-eye display data, and at least one second image different from the first image is selected from the plurality of acquired images to generate right-eye display data.

9. The method for generating display data according to claim 1, characterized in that, The steps for generating the display data include: The at least two acquired images are combined into a composite image to generate the display data.

10. A display system, characterized in that, include: Display device; A storage device for storing multiple acquired images, wherein the multiple acquired images are generated by the image acquisition device capturing an acquisition target illuminated by a first light source device at different light source positions; as well as A processing device, coupled to the display device and the storage device, is configured to select at least two acquired images from the plurality of acquired images. The processing device generates display data based on the at least two acquired images and drives the display device based on the display data.

Images