Stereoscopic image generating device and stereoscopic image generating method

Abstract

A stereoscopic image generation device is provided, which processes: obtaining a first depth information map of a first image, each pixel of the first depth information map having corresponding depth information; performing uniform processing on a plurality of edge pixels within a predetermined width from the plurality of edges based on a plurality of edges of the first depth information map, so that the processed plurality of edge pixels have the same depth information, thereby establishing a second depth information map; setting a pixel offset corresponding to each pixel of the first image based on the depth information corresponding to each pixel of the second depth information map; performing pixel offset processing on the first image to generate a second image; and displaying the first and second images of the stereoscopic image. The present disclosure also relates to a method for generating a stereoscopic image.

Description

Technical Field

[0001] The present disclosure relates to an image processing device and an image processing method, and more particularly to a stereoscopic image generating device and a stereoscopic image generating method. Background Art

[0002] Among existing methods for generating stereoscopic images, there is a method that uses monocular depth estimation technology.

[0003] Figure 1 The above-mentioned existing stereoscopic image generation method is illustrated. First, the method uses a convolutional neural network model to estimate the depth information of each pixel of the first image 21 (i.e., the original image used as the first perspective) to obtain a first depth information map 22. Then, the method sets the pixel offset 23 of each pixel in the first image 21 according to the depth information corresponding to each pixel of the first depth information map 22. Finally, the method uses the pixel offset 23 to perform pixel offset processing on the first image 21 to generate a second image (i.e., used as a reference image for the second perspective, not shown in the figure). In addition, for the sake of simplicity, Figure 1 The first image 21, the first depth information map 22, and the pixel offset 23 are based on an example in which the image width is 5 pixels. In addition, for simplicity, Figure 1 Only the depth information and pixel offset of 2 rows of pixels are shown.

[0004] In the above method, if the pixel shifting process is performed on the first image 21 to the right, then in the generated second image, the edge pixels in one or more rows of pixels on the left edge must be filled with black dots to replace the non-existent pixel values. Similarly, if the pixel shifting process is performed on the first image 21 to the left, the same situation will occur on the right edge of the second image.

[0005] Because the left or right pixel offset is determined by depth information, the effectiveness of generating the second image using conventional techniques is affected by the depth information of the first depth information map 22. For example, if the depth information corresponding to the edge pixels on the left and right sides of the first depth information map 22 is non-uniform, the corresponding pixel offset 23 is also non-uniform, resulting in uneven black image blocks on the left or right edges of the second image. Consequently, the 3D image generated by the first and second images may affect the user's viewing experience. Summary of the Invention

[0006] In view of the above problems of the prior art, the present disclosure provides a 3D image generating method and a 3D image generating device to solve the problem of uneven black image blocks appearing on the left or right edge when generating the second image in the prior art.

[0007] The present disclosure provides a 3D image generating device comprising: a storage unit; a display unit comprising a display screen; and a processing unit connected to the storage unit and the display unit, the processing unit obtaining a first image from the storage unit; the processing unit processing the first image to obtain depth data of each pixel of the first image and configuring a first depth information map, the first depth information map having depth information corresponding to each pixel; the processing unit using a plurality of edges of the first depth information map as a reference and a distance from the plurality of edges as a reference. A plurality of edge pixels within a predetermined width are subjected to uniformization processing so that the processed edge pixels have the same corresponding depth information to establish a second depth information map; a processing unit sets a pixel offset corresponding to each pixel of the first image based on the depth information corresponding to each pixel of the second depth information map; the processing unit performs pixel offset processing on the first image to generate a second image; and the processing unit outputs the first image and the second image to the display unit to display a stereoscopic image.

[0008] In one embodiment, the plurality of edges are an upper edge and a lower edge of the first depth information map.

[0009] In one embodiment, the plurality of edges are a left edge and a right edge of the first depth information map.

[0010] In one embodiment, the predetermined width is 1 pixel.

[0011] In one embodiment, the depth information corresponding to each of the plurality of edge pixels in the second depth information map is the maximum depth of field in the first depth information map.

[0012] In one embodiment, the depth information corresponding to each of the plurality of edge pixels in the second depth information map is the minimum depth of field in the first depth information map.

[0013] In one embodiment, the depth information corresponding to each of the plurality of edge pixels in the second depth information map is a constant.

[0014] In one embodiment, the depth information corresponding to the plurality of edge pixels in the second depth information map is an arithmetic mean of the depth information corresponding to the plurality of edge pixels in the first depth information map.

[0015] In one embodiment, if the value of the depth information is larger, the corresponding pixel offset is smaller; if the value of the depth information is smaller, the corresponding pixel offset is larger.

[0016] The present disclosure provides a method for generating a 3D image, comprising: obtaining a first image and processing the first image to obtain depth data for each pixel of the first image, and configuring the obtained depth data into a first depth information map, wherein the first depth information map has depth information corresponding to each pixel; performing a uniform process based on a plurality of edges of the first depth information map and a plurality of edge pixels within a predetermined width from the plurality of edges, so that the processed edge pixels have the same corresponding depth information, thereby establishing a second depth information map; setting a pixel offset corresponding to each pixel of the first image based on the depth information corresponding to each pixel of the second depth information map; performing pixel offset processing on the first image to generate a second image; and outputting the first image and the second image to display a 3D image.

[0017] According to the present disclosure, since the pixel offset of the first image is set according to the second depth information map, the second image generated by the present disclosure does not have uneven black image blocks on the left or right edge. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 The following illustrates a conventional method for generating a 3D image.

[0019] Figure 2A A schematic functional block diagram of the 3D image generating device disclosed herein is shown. Figure 2B A diagram illustrating the hardware architecture of the 3D image generating device disclosed herein.

[0020] Figure 3 An embodiment of the stereoscopic image generating method disclosed in the present invention is illustrated.

[0021] Figure 4 An embodiment of the stereoscopic image generating method disclosed in the present invention is illustrated.

[0022] Description of reference numerals:

[0023] 1: 3D image generating device

[0024] 11: Storage unit

[0025] 12: Display unit

[0026] 13: Processing unit

[0027] 21: Image 1

[0028] 22: First Depth Infographic

[0029] 23: Pixel offset

[0030] 31: Image 1

[0031] 32: 1st Depth Infographic

[0032] 321A-321D: Second depth information map

[0033] 322A~322D: Pixel offset

[0034] 41: Image 1

[0035] 42: 1st Depth Infographic

[0036] 421A-421D: Second depth information diagram

[0037] 422A~422D: Pixel offset DETAILED DESCRIPTION

[0038] The above and other objects and advantages of the present disclosure will become more apparent after referring to the detailed description described below in conjunction with the accompanying drawings.

[0039] Figure 2A A schematic functional block diagram of the 3D image generating device disclosed herein is shown. Figure 2B A diagram illustrating the hardware architecture of the 3D image generating device disclosed herein.

[0040] Figure 2A The 3D image generating device 1 at least includes a storage unit 11 , a display unit 12 , and a processing unit 13 . Figure 2B In the example shown, the 3D image generating device 1 is a laptop computer. However, the laptop computer is only one exemplary example. The 3D image generating device 1 may also be a desktop computer, tablet computer, smartphone, head-mounted display, server, portable electronic device, or other electronic device with similar computing capabilities.

[0041] The storage unit 11 can be, for example, a random access memory (RAM), a read-only memory (ROM), a flash memory, an erasable programmable random access memory (EPROM), an electrically erasable programmable random access memory (EEPROM), or other non-volatile memory or volatile semiconductor memory.

[0042] In addition, the storage unit 11 may also be a magnetic disk, a floppy disk, an optical disk, a CD, a mini disk, or a digital versatile disc (DVD).

[0043] In other words, the storage unit 11 can store any one or a combination of the "first image", "second image", "first depth information map", "second depth information map", and "pixel offset" mentioned in this specification, as well as all parameters, formulas, algorithms, program codes, etc. used by the processing unit 13 described later when performing processing.

[0044] For example, the display unit 12 can be an output device with a display screen, such as a stereoscopic imaging display, a system-integrated panel, an LED display, or a touch screen. In other words, the display unit 12 can display any one or a combination of the "first image," "second image," "first depth information map," "second depth information map," and "pixel offset" mentioned in this specification on the display screen, as needed by the user. In some embodiments, the stereoscopic image generating device 1 may not include a display unit; it may instead output the generated stereoscopic image to an external display unit.

[0045] The processing unit 13 is connected to the storage unit 11 and the display unit 12, interacting with them in a one-way or two-way manner. The processing unit 13 uses the parameters, formulas, algorithms, program codes, etc. stored in the storage unit 11 to perform the various processes described below. Furthermore, the processing unit 13 can be implemented by hardware, software, or a combination of hardware and software.

[0046] The processing unit 13 can be a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, a graphics processor, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or a combination thereof to implement the specific functions and processes mentioned in this specification.

[0047] In addition, the processing unit 13 can also implement the specific functions and processes mentioned in this specification by reading and executing the program code stored in the storage unit 11. In other words, the processing unit 13 can be used to implement the "3D image generation method" mentioned in this specification.

[0048] Figure 3 An embodiment of the operation of the 3D image generating device 1 of the present disclosure is illustrated.

[0049] like Figure 3 As shown, the processing unit 13 obtains the first image 31 from the storage unit 11. The processing unit 13 also uses an existing depth estimation model such as a convolutional neural network model (but not limited to this) stored in the storage unit 11 to obtain the depth data of each pixel of the first image 31 to generate a first depth information map 32. The first image 31 can be Figure 1 The first image 21 shown may be the same as or different from the first image 21. If the first image 31 is the same as the first image 21, then after the same depth estimation process, the first depth information map 32 (corresponding to the first image 31) will be the same as or similar to the first depth information map 22 (corresponding to the first image 21) shown in FIG2. For simplicity, it is assumed that the first image 31 is the same as the first image 21, and the first depth information map 32 is also the same as the first depth information map 22.

[0050] In addition, for the sake of simplicity, Figure 3 The first image 31, the first depth information map 32, the second depth information maps 321A-321D, and the pixel offsets 322A-322D are exemplified by an image width of 5 pixels. However, in one embodiment, the first image 31 may also be an image of 256x256 pixels, 1920x1080 pixels, 1024x768 pixels, or any other size.

[0051] Each pixel in the first depth information map 32 has corresponding depth information. In this specification, depth information is a quantifiable value, defined as the relative distance between a pixel's position in three-dimensional space and the camera. A larger depth information value indicates that the pixel's position is farther from the camera; conversely, a smaller depth information value indicates that the pixel's position is closer to the camera.

[0052] In practice, the depth information can have varying numerical ranges depending on the specifications. For simplicity, this specification defines the depth information range as 0 to 10. 0 represents the minimum depth of field detectable by the first depth information map 32 (i.e., closest to the camera), and 10 represents the maximum depth of field detectable by the first depth information map 32 (i.e., farthest from the camera).

[0053] There is a certain correspondence between the "depth information" and the "pixel offset" described later. Specifically, in the process of generating stereoscopic images, for pixels with larger depth information, smaller pixel offsets will be set; for pixels with smaller depth information, larger pixel offsets will be set. The principle of such setting is: when we place an object in front of both eyes and perform a lateral translation with the same displacement, if the object is farther away from the eyes, the lateral displacement change felt by the eyes will be smaller; if the object is closer to the eyes, the lateral displacement change felt by the eyes will be larger. Therefore, by utilizing the "negative correlation" characteristic of "depth information and pixel offset", the generated stereoscopic image can reflect the real feeling of the human eye when watching the stereoscopic image. And this can also be explained in retrospect. Figure 1 Among them, the first depth information map 22 shows the correlation between the depth information of each edge pixel and the corresponding pixel offset.

[0054] In addition, Figure 1 The relationship between depth information and pixel offset can be expressed by the mathematical formula "pixel offset = 21 - depth information x2" (depth information: 0 to 10). Figure 3 、 Figure 4 It will continue to be used to help readers understand the technical content of this specification, but it is not limited to this mathematical formula.

[0055] Next, the processing unit 13 processes the depth information of the first depth information map 32. The processing unit 13 uses the plurality of edges of the first depth information map 32 as a reference and performs a uniform process on a plurality of edge pixels within a predetermined width from the plurality of edges. This uniform process ensures that the processed plurality of edge pixels have the same depth information, thereby creating a second depth information map.

[0056] The multiple edges mentioned here can be the top and bottom edges of the image, or the left and right edges of the image. The top and bottom edges refer to the pixel shifting process mentioned later, which is to shift the pixels of the first image upward or downward; while the left and right edges refer to the pixel shifting process mentioned later, which is to shift the pixels of the first image leftward or rightward. Since shifting pixels leftward or rightward is more common in the prior art, the following description focuses on the multiple edge pixels of the left and right edges.

[0057] In addition, from an algorithmic perspective, we can use two-dimensional coordinates to strictly define the "edge" referred to in this specification. Taking an image of size 256x256 as an example, if the pixel at the lower left corner of the image is the origin O(0,0), the right direction is the +x direction, and the upward direction is the +y direction, then the line segment formed by all pixels with an x ​​coordinate of 0, the side of which is not adjacent to other pixels, can be defined as the "left edge"; the line segment formed by all pixels with an x ​​coordinate of 255, the side of which is not adjacent to other pixels, can be defined as the "right edge"; the line segment formed by all pixels with a y coordinate of 255, the side of which is not adjacent to other pixels, can be defined as the "upper edge"; and the line segment formed by all pixels with a y coordinate of 0, the side of which is not adjacent to other pixels, can be defined as the "lower edge".

[0058] The "predetermined width" from any edge is measured in pixels. For example, if the predetermined width from the left and right edges is 2, then according to the above definition, the pixels at the edges with x-coordinates of 0, 1, 254, and 255 will be normalized. If the predetermined width from the left and right edges is 1, then the pixels at x-coordinates of 0 and 255 will be normalized, and so on.

[0059] In other words, the predetermined width can be any natural number. However, in order to avoid excessive information loss in the generated stereo image, the predetermined width is generally set to 1 pixel. Figure 3 The example of "predetermined width = 1" is shown. Figure 4 This illustrates an example of "predetermined width = 2".

[0060] The “uniformization process” performed by the processing unit 13 here is to adjust the depth information corresponding to the plurality of edge pixels in the first depth information map 32 to the same value. Figure 3 In the illustrated embodiment, the processing unit 13 can select any of four implementations (A) to (D) to adjust the depth information corresponding to the plurality of edge pixels in the first depth information map 32. The depth information corresponding to pixels other than the plurality of edge pixels in the first depth information map 32 remains unchanged without adjustment. This allows the use of a portion of the adjusted depth information and a portion of the unadjusted depth information to create the four second depth information maps 321A to 321D described below.

[0061] Implementation method (A)

[0062] In embodiment (A) (refer to Figure 3(A)), the processing unit 13 may set the depth information corresponding to the 10 edge pixels in the first depth information map 32 to the maximum depth of field in the first depth information map 32, that is, the previously preset depth of 10. As a result, the depth information corresponding to the 10 edge pixels in the second depth information map 321A is all 10.

[0063] Implementation method (B)

[0064] In embodiment (B) (refer to Figure 3 (B)), the processing unit 13 may set the depth information corresponding to the 10 edge pixels in the first depth information map 32 to the minimum depth of field in the first depth information map 32, that is, the previously preset depth of 0. As a result, the depth information corresponding to the 10 edge pixels in the second depth information map 321B is all 0.

[0065] Implementation Method (C)

[0066] In embodiment (C) (refer to Figure 3 (C)), the processing unit 13 may set the depth information corresponding to the 10 edge pixels in the first depth information map 321 to any constant between 0 and 10, for example, to 9. As a result, the depth information corresponding to the 10 edge pixels in the second depth information map 321C is all 9.

[0067] Implementation method (D)

[0068] In embodiment (D) (refer to Figure 3 (D)), the processing unit 13 may calculate an arithmetic mean of the depth information corresponding to the 10 edge pixels in the first depth information map 32 and set the arithmetic mean as the arithmetic mean. Figure 3 Since the two sets of edge depth information corresponding to the 10 edge pixels in the first depth information map 32 are 7, 6, 5, 4, 3 and 9, 8, 7, 6, 5, respectively, the calculated arithmetic mean is 6. Therefore, the depth information corresponding to the 10 edge pixels in the second depth information map 321D is all 6.

[0069] The second depth information maps 321A-321D generated by the processing unit 13 according to any one of the above-mentioned embodiments (A)-(D) have the depth information corresponding to the 10 edge pixels already unified. Therefore, when the processing unit 13 sets the pixel offset 322A-322D corresponding to each pixel of the first image 31 based on the depth information corresponding to each pixel of the second depth information maps 321A-321D, it can be ensured that the pixel offsets corresponding to the 10 (2 groups) edge pixels of the first image 31 are all the same.

[0070] For example, if according to implementation (A), the depth information corresponding to the 10 edge pixels of the second depth information map 321A is all 10 (maximum depth of field), then according to the mathematical formula "pixel offset = 21-depth information x2" (depth information: 0~10), the corresponding pixel offset 322A is all 1.

[0071] For example, if according to implementation (B), the depth information corresponding to the 10 edge pixels of the second depth information map 321B is all 0 (minimum depth of field), then according to the mathematical formula "pixel offset = 21-depth information x2" (depth information: 0~10), the corresponding pixel offset 322B is all 21.

[0072] For example, if according to implementation (C), the depth information corresponding to the 10 edge pixels of the second depth information map 321C is all 9 (any constant between 0 and 10), then according to the mathematical formula "pixel offset = 21-depth information x2" (depth information: 0 to 10), the corresponding pixel offset 322C is all 3.

[0073] For example, if according to implementation method (D), the depth information corresponding to the 10 edge pixels of the second depth information map 321D is the arithmetic mean of the depth information corresponding to the 10 edge pixels of the first depth information map 32 (6 in this case), then according to the mathematical formula "pixel offset = 21-depth information x2" (depth information: 0~10), the corresponding pixel offset 322D is all 9.

[0074] Based on the above embodiments (A) to (D), in order to simplify the algorithm of the processing unit 13 as much as possible and save program resources, we can consider directly setting the depth information corresponding to the 10 edge pixels to a constant (9). In this way, when the processing unit 13 processes the consecutive frames of the first image 31, it can ensure that the pixel offsets set successively remain constant and do not fluctuate over time.

[0075] Furthermore, in order to avoid excessive distortion in the second image generated by pixel shifting processing of the first image 31 (i.e., the uniform black image block is too large), the processing unit 13 can also directly set the depth information corresponding to the 10 edge pixels to the maximum depth of field (10). In this way, the corresponding pixel shift amount can be ensured to be the minimum value (1), so that the uniform black image block in the second image is minimized.

[0076] Therefore, according to the embodiment of the present disclosure, the processing unit 13 performs pixel offset processing on the first image 31 to generate the second image based on the pixel offsets 322A-322D corresponding to the second depth information map 321A-321D, which has been subjected to uniform processing for a plurality of edge pixels, rather than the pixel offsets (23) corresponding to the first depth information map 32 (22). Thus, when the processing unit 13 displays the first image 31 and the second image of the stereoscopic image on the display unit 12, uneven black image blocks will not appear at the edges of the stereoscopic image, and the viewing user can maintain a good experience, thereby achieving the desired effect of the present invention.

[0077] The above instructions are for use Figure 3 , to illustrate the case where the "predetermined width" is set to 1. Figure 4 The following describes the case where the "default width" is set to 2. Figure 4 Another embodiment of the operation of the 3D image generating device disclosed in the present invention is illustrated.

[0078] This embodiment and Figure 3 The difference between the two is that the processing unit 13 must also include the 5 edge pixels with a width of 2 from the left edge and the 5 edge pixels with a width of 2 from the right edge in the first depth information map 42 into the processing objects. Figure 4 In the uniformization process shown, the depth information corresponding to 20 edge pixels needs to be adjusted.

[0079] Implementation method (A)

[0080] In embodiment (A) (refer to Figure 4 (A)), the processing unit 13 may set the depth information corresponding to the 20 edge pixels in the first depth information map 42 to the maximum depth of field in the first depth information map 42, that is, the previously preset depth of 10. As a result, the depth information corresponding to the 20 edge pixels in the second depth information map 421A is all 10.

[0081] Implementation method (B)

[0082] In embodiment (B) (refer to Figure 4 (B)), the processing unit 13 may set the depth information corresponding to the 20 edge pixels in the first depth information map 42 to the minimum depth of field in the first depth information map 42, that is, the previously preset depth of 0. As a result, the depth information corresponding to the 20 edge pixels in the second depth information map 421B is all 0.

[0083] Implementation Method (C)

[0084] In embodiment (C) (refer to Figure 4(C)), the processing unit 13 may set the depth information corresponding to the 20 edge pixels in the first depth information map 42 to any constant between 0 and 10, for example, to 8. As a result, the depth information corresponding to the 20 edge pixels in the second depth information map 421C is all 8.

[0085] Implementation method (D)

[0086] In embodiment (D) (refer to Figure 4 (D)), the processing unit 13 may calculate an arithmetic mean of the depth information corresponding to the 20 edge pixels in the first depth information map 42 and set the arithmetic mean as the arithmetic mean. Figure 4 Among them, since the four sets of edge depth information corresponding to the 20 edge pixels in the first depth information map 42 are "5, 4, 3, 2, 1", "6, 5, 4, 3, 2", "8, 7, 6, 5, 4", and "9, 8, 7, 6, 5", the calculated arithmetic mean is 5. Therefore, the depth information corresponding to the 20 edge pixels in the second depth information map 421D is all 5.

[0087] In accordance with any one of the above-mentioned embodiments (A) to (D), the second depth information maps 421A to 421D generated have the depth information corresponding to the 20 (4 groups) edge pixels being unified. Therefore, when the processing unit 13 sets the pixel offset 422A to 422D corresponding to each pixel of the first image 41 based on the depth information corresponding to each pixel of the second depth information maps 421A to 421D, it can also be ensured that the pixel offsets corresponding to the 20 edge pixels of the first image 41 are all the same.

[0088] For example, if according to implementation (A), the depth information corresponding to the 20 edge pixels of the second depth information map 421A is all 10 (maximum depth of field), then according to the mathematical formula "pixel offset = 21-depth information x2" (depth information: 0~10), the corresponding pixel offset 422A is all 1.

[0089] For example, if according to implementation (B), the depth information corresponding to the 20 edge pixels of the second depth information map 421B is all 0 (minimum depth of field), then according to the mathematical formula "pixel offset = 21-depth information x2" (depth information: 0~10), the corresponding pixel offset 422B is all 21.

[0090] For example, if according to implementation (C), the depth information corresponding to the 20 edge pixels of the second depth information map 421C is all 8 (any constant between 0 and 10), then according to the mathematical formula "pixel offset = 21-depth information x2" (depth information: 0 to 10), the corresponding pixel offset 422C is all 5.

[0091] For example, if according to implementation method (D), the depth information corresponding to the 20 edge pixels of the second depth information map 421D is the arithmetic mean of the depth information corresponding to the 20 edge pixels of the first depth information map 32 (5 in this case), then according to the mathematical formula "pixel offset = 21-depth information x2" (depth information: 0~10), the corresponding pixel offset 422D is all 11.

[0092] Therefore, the processing unit 13 provided in this application performs pixel offset processing on the first image 41 to generate the second image, not based on the pixel offset corresponding to the first depth information map 42, but rather based on the pixel offsets 422A-422D corresponding to the second depth information map 421A-421D, which has been subjected to uniform processing for a plurality of edge pixels. Consequently, when the processing unit 13 displays the first and second 3D images 41 on the display unit 12, the user does not see uneven black image blocks at the edges of the 3D image, maintaining a good viewing experience, thereby achieving the intended effect of this application.

[0093] In addition, with Figure 3 The same as the embodiment (given width is 1), Figure 4 In the embodiment (predetermined width is 2), the depth information can also be directly set to a constant, or set to the maximum depth of field to achieve Figure 3 The additional effects mentioned in the embodiments.

[0094] It should be noted that, in the second depth information maps 321A~321D, 421A~421D, the pixel points other than the plurality of edge pixel points also have their own corresponding depth information, and the pixel offset converted by the mathematical formula "pixel offset = 21-depth information x2" (depth information: 0~10). However, as described earlier in this specification, since this case only needs to make the depth information corresponding to the edge pixel points of the second depth information map consistent, whether the corresponding depth information of other pixel points other than the edge pixel points of the second depth information map is consistent or not is not within the scope of consideration of this case (conversely, inconsistent depth information is the norm). Therefore, Figures 3 and 4 It is not specially drawn and the related description is omitted.

[0095] Furthermore, while this application uses the mathematical formula "Pixel offset = 21 - depth information x2" (depth information: 0-10) to express the negative correlation between depth information and pixel offset, pixel offset does not necessarily mean an equal number of pixels have been shifted. It is merely a numerical method to convey the degree of offset. Whether the relationship is linear or nonlinear, the parameters involved can be adjusted by referring to other existing technologies.

[0096] In summary, whether the processing unit 13 adopts Figures 3 and 4 In any of the eight described embodiments, when the processing unit 13 displays the first and second images of the stereoscopic image on the display unit 12, the user will not see uneven black image blocks at the edges of the stereoscopic image, and the user can maintain a good viewing experience, thereby achieving the desired effect of this solution.

[0097] The above details the stereoscopic image generating device and its operating methods. It should be noted that the aforementioned embodiments are merely illustrative of the principles and effectiveness of the present disclosure and are not intended to limit the scope of the present disclosure. Those skilled in the art may modify and make appropriate changes to the embodiments without violating the technical principles and spirit of the present disclosure. Therefore, the scope of protection of the present disclosure shall be subject to the scope of the subsequent patent applications.

Claims

1. A 3D image generating device, comprising: a storage unit; a display unit comprising a display screen; and a processing unit connected to the storage unit and the display unit, the processing unit obtaining a first image from the storage unit; The processing unit processes the first image to obtain depth data of each pixel of the first image and configures the depth data into a first depth information map, wherein the first depth information map has depth information corresponding to each pixel; The processing unit performs a uniformization process based on a plurality of edges of the first depth information map and a plurality of edge pixels within a predetermined width from the plurality of edges, maintaining depth information of pixels other than the plurality of edge pixels as is, so that the plurality of edge pixels have the same corresponding depth information after processing, thereby establishing a second depth information map; The processing unit sets a pixel offset corresponding to each pixel of the first image based on the depth information corresponding to each pixel of the second depth information map; The processing unit performs pixel shift processing on the first image to generate a second image; and The processing unit outputs the first image and the second image to the display unit to display a 3D image.

2. The 3D image generating device according to claim 1, in, The plurality of edges are an upper edge and a lower edge of the first depth information map.

3. The 3D image generating device according to claim 1, in, The plurality of edges are a left edge and a right edge of the first depth information map.

4. The 3D image generating device according to claim 3, in, The preset width is 1 pixel.

5. The 3D image generating device according to claim 4, in, The depth information corresponding to each of the plurality of edge pixels in the second depth information map is the maximum depth of field in the first depth information map.

6. The 3D image generating device according to claim 4, in, The depth information corresponding to each of the plurality of edge pixels in the second depth information map is the minimum depth of field in the first depth information map.

7. The 3D image generating device according to claim 4, in, The depth information corresponding to each of the plurality of edge pixels in the second depth information map is a constant.

8. The 3D image generating device according to claim 4, in, The depth information corresponding to the plurality of edge pixels of the second depth information map is an arithmetic mean of the depth information corresponding to the plurality of edge pixels of the first depth information map.

9. The 3D image generating device according to any one of claims 1 to 8, in, The larger the depth information value, the smaller the corresponding pixel offset; The smaller the depth information value is, the larger the corresponding pixel offset is.

10. A method for generating a 3D image, comprising: Obtaining a first image and processing the first image to obtain depth data of each pixel of the first image and configuring the depth data into a first depth information map, wherein the first depth information map has depth information corresponding to each pixel; Performing a uniformization process based on a plurality of edges of the first depth information map and a plurality of edge pixels within a predetermined width from the plurality of edges, maintaining the depth information of pixels other than the plurality of edge pixels original so that the plurality of edge pixels have the same corresponding depth information after the processing, thereby establishing a second depth information map; Setting a pixel offset corresponding to each pixel of the first image based on the depth information corresponding to each pixel of the second depth information map; performing pixel shift processing on the first image to generate a second image; and The first image and the second image are output to display a 3D image.

Images