3D image generation method, device, computer equipment and storage medium

Abstract

The present invention provides a 3D image generation method, device, and storage medium. By adapting to each user's 3D fusion range, a 3D image can be generated that better matches the user's visual experience, while reducing viewing discomfort and increasing comfort. The method includes: determining a left image and a right image corresponding to a target image; determining a horizontal offset corresponding to the target image based on the target user's visual data; adjusting the left image and the right image based on the horizontal offset corresponding to the target image to obtain a target left image and a target right image; and interleaving the target left image and the target right image to generate a target 3D image corresponding to the target image.

Description

Technical Field

[0001] The present invention relates to the field of image processing, and in particular to a method, apparatus, computer equipment and storage medium for generating a 3D image. Background Art

[0002] With the development of science and technology, products with 3D display technology have been widely used in people's daily lives. The 3D videos displayed by 3D display technology have a stronger visual impact and can give consumers an immersive feeling.

[0003] Currently, products with 3D display technology generally convert 2D videos into 3D videos through a view conversion method for stereoscopic display. However, the 3D videos obtained by converting 2D videos into 3D videos through a view conversion method are often universal solutions and are not adaptively adjusted for different users. Summary of the Invention

[0004] The present invention provides a 3D image generation method, device and storage medium, which can obtain a 3D image that is more in line with the user's vision by adapting to and matching the 3D fusion range of each user, while reducing viewing discomfort and increasing comfort.

[0005] A first aspect of the present invention provides a method for generating a 3D image, comprising:

[0006] Determine the left and right images corresponding to the target image;

[0007] Determining a horizontal offset corresponding to the target image according to visual data of the target user;

[0008] Adjusting the left picture and the right picture according to the horizontal offset corresponding to the target image to obtain a target left picture and a target right picture;

[0009] The target left picture and the target right picture are interleaved to generate a target 3D image corresponding to the target image.

[0010] A second aspect of the present invention provides a terminal device, including:

[0011] A first determining unit, configured to determine a left picture and a right picture corresponding to a target image;

[0012] A second determining unit, configured to determine a horizontal offset corresponding to the target image according to visual data of the target user;

[0013] an adjusting unit, configured to adjust the left picture and the right picture according to a horizontal offset corresponding to the target image, so as to obtain a target left picture and a target right picture;

[0014] An interleaving unit is configured to interleave the target left picture and the target right picture to generate a target 3D image corresponding to the target image.

[0015] A third aspect of the present invention provides a computer device comprising at least one connected processor, memory, and transceiver, wherein the memory is used to store program code, and the processor is used to call the program code in the memory to execute the steps of the 3D image generation method described in the first aspect above.

[0016] A fourth aspect of the present invention provides a computer storage medium comprising instructions, which, when executed on a computer, enables the computer to execute the steps of the method for generating a 3D image as described in any one of the above aspects.

[0017] Compared to related technologies, the embodiments provided by this invention determine the horizontal offset of the target image based on the target user's visual data. The left and right frames corresponding to the target image are then adjusted based on the horizontal offset, and the adjusted images are interleaved to generate a 3D image corresponding to the target image. Thus, by adapting to each user's 3D fusion range, a 3D image can be obtained that better suits the user's vision, while reducing viewing discomfort and increasing comfort. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A schematic diagram of a flow chart of a method for generating a 3D image provided by an embodiment of the present invention;

[0019] Figure 2 A schematic diagram of a virtual structure of a terminal device provided in an embodiment of the present invention;

[0020] Figure 3 A schematic diagram of the hardware structure of a terminal device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0021] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments.

[0022] The terms "first," "second," and the like in the specification and claims of the present invention and the accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including" and "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device comprising a series of steps or modules is not necessarily limited to those steps or modules clearly listed, but may include other steps or modules that are not clearly listed or that are inherent to these processes, methods, products, or devices. The division of modules that appears in the present invention is merely a logical division. In actual applications, there may be other divisions. For example, multiple modules may be combined or integrated into another system, or some feature vectors may be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection between modules may be electrical or other similar forms, which are not limited in the present invention. Moreover, the modules or sub-modules described as separate components may or may not be physically separated, may or may not be physical modules, or may be distributed into multiple circuit modules, and some or all of the modules may be selected according to actual needs to achieve the purpose of the present invention.

[0023] The following describes the method for adjusting the 3D image offset provided by the embodiment of the present invention from the perspective of a terminal device.

[0024] See also Figure 1 , Figure 1 A schematic flow chart of a method for generating a 3D image provided in an embodiment of the present invention includes:

[0025] 101. Determine the left image and the right image corresponding to the target image.

[0026] In this embodiment, the terminal device can obtain the target image currently being displayed from the display screen in real time, and then split or copy the target image to obtain the left image and the right image corresponding to the target image. Of course, other methods can also be used, such as the terminal device sending a request in advance to obtain the target image. The target image can be a separate image or each frame of the video. The target image is the image to be displayed in the future, and the target image can be a 3D image or a 2D image.

[0027] 102. Determine a horizontal offset corresponding to the target image according to the visual data of the target user.

[0028] In this embodiment, the terminal device may first obtain the visual data of the target user, which includes the target user's subjective squint angle and the target user's interpupillary distance. Then, the terminal device determines the horizontal offset corresponding to the target image based on the target user's subjective squint angle and the target user's interpupillary distance. Specifically, the terminal device may determine the horizontal offset corresponding to the target image using the following formula:

[0029] ScreenOffsetX=(TargetDistance-ScreenDistance)*tan(thetaInArc+theta0);

[0030] Where ScreenOffsetX is the horizontal offset corresponding to the target image, TargetDistance is the distance between the virtual image corresponding to the target image and the target user's binocular eyes, ScreenDistance is the vertical distance between the target user and the display screen, thetaInArc is the horizontal angle between the target user's monocular line of sight and the target user's binocular eyes directly in front of the target user, and theta0 is the subjective squint angle. ThetaInArc is determined by the following formula:

[0031] thetaInArc=arctan(PD*0.5 / TargetDistance);

[0032] Wherein, PD is the pupil distance of the target user.

[0033] It should be noted that when the virtual image's distance (TargetDistance) changes, the horizontal offset (ScreenOffsetX) between the left and right images projected on the display screen also changes accordingly. Virtual image distance refers to the desired distance between the two eyes for visual training or for normal viewing, i.e., the closest fusion distance to infinity. Furthermore, if the target user is a normal user, the target user's subjective squint angle is 0.

[0034] The embodiment of the present invention further provides another method for determining the horizontal offset corresponding to the target image, which is as follows:

[0035] The terminal device can also determine the horizontal offset corresponding to the target image using the following formula:

[0036] ScreenOffsetX=PD*0.5*(TargetDistance-TargetDistance) / TargetDistance;

[0037] Among them, ScreenOffsetX is the horizontal offset corresponding to the target image, PD is the pupil distance of the target user, TargetDistance is the distance between the virtual image corresponding to the target image and the binocular eyes of the target user, and ScreenDistance is the vertical distance between the target user and the display screen.

[0038] It should be noted that the terminal device can determine the left and right images corresponding to the target image through step 101, and can determine the horizontal offset corresponding to the target image based on the visual data of the target user through step 102. However, there is no restriction on the order of execution between these two steps. Step 101 can be executed first, or step 102 can be executed first, or they can be executed at the same time. There is no specific limitation.

[0039] 103. Adjust the left image and the right image according to the horizontal offset corresponding to the target image to obtain a target left image and a target right image.

[0040] In this embodiment, after determining the horizontal offset corresponding to the target image, the terminal device may adjust the left picture and the right picture according to the horizontal offset corresponding to the target image to obtain the target left picture and the target right picture.

[0041] It should be noted that binocular vision refers to the simultaneous observation of an object with both eyes. Although each eye forms separate retinal images, normal binocular vision fuses the two images into a single visual object. If the two eyes are observing a two-dimensional object, the two retinal images fall on corresponding points on the retinas of each eye, and the corresponding points are located in the same position. If the two eyes are observing a three-dimensional object, the retinal images of the two eyes are not exactly the same, forming binocular parallax and producing stereoscopic perception. In a 3D display, the left and right images that are fused into a 3D image are observed by the left and right eyes, respectively. The virtual images of the left and right images on the retina are transmitted to the same area of the visual center in the cortex via the optic nerves on both sides, and are fused into the perceptual experience of a complete, single object. Therefore, when the terminal device adjusts the left and right pictures through the horizontal offset, the left picture can be kept fixed and the right picture can be moved away from the left picture or closer to the right picture according to the horizontal offset, or the right picture can be kept fixed and the left picture can be moved away from the right picture or closer to the right picture according to the horizontal offset, or the left and right pictures can be moved at the same time, moving away from or approaching each other according to the horizontal offset. When the left picture is fixed, the original left picture is the target left picture, and the right picture is adjusted based on the horizontal offset, and the adjusted right picture is the target right picture, and vice versa.

[0042] 104. Interweave the target left picture and the target right picture to generate a target 3D image corresponding to the target image.

[0043] In this embodiment, after determining the target left picture and the target right picture, the terminal device may interleave the target left picture and the target right picture to generate a target 3D image corresponding to the target image.

[0044] In summary, it can be seen that in the embodiments provided by the present invention, the horizontal offset of the target image is determined based on the visual data of the target user. The left and right images corresponding to the target image are then adjusted based on the horizontal offset, and the adjusted images are interleaved to generate a 3D image corresponding to the target image. Thus, by adapting to each user's 3D fusion range, a 3D image that better suits the user's vision can be obtained, while reducing viewing discomfort and increasing comfort.

[0045] The above describes the embodiment of the present invention from the perspective of a method for generating a 3D image. The following describes the embodiment of the present invention from the perspective of a terminal device.

[0046] See also Figure 2 , Figure 2 A schematic diagram of a virtual structure of a terminal device provided in an embodiment of the present invention, wherein the terminal device 200 includes:

[0047] A first determining unit 201 is configured to determine a left image and a right image corresponding to a target image;

[0048] A second determining unit 202 is configured to determine a horizontal offset corresponding to the target image according to visual data of the target user;

[0049] an adjusting unit 203, configured to adjust the left picture and the right picture according to a horizontal offset corresponding to the target image, so as to obtain a target left picture and a target right picture;

[0050] The interleaving unit 204 is configured to interleave the target left picture and the target right picture to generate a target 3D image corresponding to the target image.

[0051] In one possible design, the second determining unit 202 is specifically configured to:

[0052] Obtaining the subjective squint angle of the target user and the pupil distance of the target user;

[0053] The horizontal offset corresponding to the target image is determined according to the subjective squint angle of the target user and the pupil distance of the target user.

[0054] In one possible design, the second determining unit 202 is further specifically configured to:

[0055] The horizontal offset corresponding to the target image is determined by the following formula:

[0056] ScreenOffsetX=(TargetDistance-ScreenDistance)*tan(thetaInArc+

[0057] theta0);

[0058] Wherein, ScreenOffsetX is the horizontal offset corresponding to the target image, TargetDistance is the distance between the virtual image corresponding to the target image and the binocular eyes of the target user, ScreenDistance is the vertical distance between the target user and the display screen, thetaInArc is the horizontal angle between the monocular line of sight of the target user and the front of the binocular eyes of the target user, and theta0 is the subjective squint angle. ThetaInArc is determined by the following formula:

[0059] thetaInArc=arctan(PD*0.5 / TargetDistance);

[0060] Wherein, PD is the pupil distance of the target user.

[0061] In one possible design, the second determining unit 202 is further specifically configured to:

[0062] The horizontal offset corresponding to the target image is determined by the following formula:

[0063] ScreenOffsetX=PD*0.5*(TargetDistance-TargetDistance) / TargetDistance;

[0064] Among them, ScreenOffsetX is the horizontal offset corresponding to the target image, PD is the pupil distance of the target user, TargetDistance is the distance between the virtual image corresponding to the target image and the binoculars of the target user, and ScreenDistance is the vertical distance between the target user and the display screen.

[0065] In one possible design, the first determining unit 201 is further specifically configured to:

[0066] Acquiring the target image displayed on the display screen in real time;

[0067] The target image is divided or copied to obtain the left picture and the right picture.

[0068] In summary, it can be seen that in the embodiments provided by the present invention, the horizontal offset of the target image is determined based on the visual data of the target user. The left and right images corresponding to the target image are then adjusted based on the horizontal offset, and the adjusted images are interleaved to generate a 3D image corresponding to the target image. Thus, by adapting to each user's 3D fusion range, a 3D image that better suits the user's vision can be obtained, while reducing viewing discomfort and increasing comfort.

[0069] Next, another terminal device provided by an embodiment of the present invention is introduced. Figure 3 As shown, Figure 3 This is a schematic diagram of the hardware structure of a terminal device provided in an embodiment of the present invention. The terminal device 300 includes:

[0070] Receiver 301, transmitter 302, processor 303 and memory 304 (wherein the number of processor 303 in terminal device 300 can be one or more, Figure 3 In some embodiments of the present invention, the receiver 301, the transmitter 302, the processor 303 and the memory 304 may be connected via a bus or other means, wherein: Figure 3 The bus connection is taken as an example.

[0071] Memory 304 may include read-only memory and random access memory, and provides instructions and data to processor 303. A portion of memory 304 may also include NVRAM. Memory 304 stores an operating system and operating instructions, executable modules, or data structures, or subsets or extensions thereof. The operating instructions may include various operating instructions for implementing various operations. The operating system may include various system programs for implementing various basic services and processing hardware-based tasks.

[0072] Processor 303 controls the operation of the terminal device and may also be referred to as a CPU. In specific applications, the various components of the terminal device are coupled together via a bus system. In addition to a data bus, the bus system may also include a power bus, a control bus, and a status signal bus. However, for clarity, all bus systems are referred to as a bus system in the figure.

[0073] The 3D image generation method disclosed in the above embodiment of the present invention can be applied to the processor 303, or implemented by the processor 303. The processor 303 can be an integrated circuit chip with signal processing capabilities. In the implementation process, the above Figure 1Each step of the method shown can be accomplished by hardware integrated logic circuits or software instructions within processor 303. The processor 303 can be a general-purpose processor, DSP, ASIC, FPGA, or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in conjunction with the embodiments of the present invention can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules within the decoding processor. The software modules can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory 304. Processor 303 reads information from memory 304 and, in conjunction with its hardware, completes the steps of the method described above.

[0074] An embodiment of the present invention further provides a computer-readable medium comprising computer-executable instructions, which enable a server to execute the 3D image generation method described in the above embodiment. The implementation principle and technical effects thereof are similar and will not be described in detail here.

[0075] It should also be noted that the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment. In addition, in the drawings of the device embodiments provided by the present invention, the connection relationship between modules indicates that they have a communication connection, which can be specifically implemented as one or more communication buses or signal lines.

[0076] Through the description of the above embodiments, those skilled in the art can clearly understand that the present invention can be implemented by means of software plus necessary general-purpose hardware, and of course can also be implemented by means of dedicated hardware including application-specific integrated circuits, dedicated CPUs, dedicated memories, dedicated components, etc. In general, all functions performed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structures used to implement the same function can also be diverse, such as analog circuits, digital circuits, or dedicated circuits. However, for the present invention, software program implementation is a better implementation method in most cases. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, USB flash drive, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, etc., and includes a number of instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0077] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0078] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0079] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not deviate from the essence of the corresponding technical solutions.

Claims

1. A method for generating a 3D image, characterized in that: include: Determine the left and right images corresponding to the target image; Determining a horizontal offset corresponding to the target image according to a subjective squint angle of a target user and an interpupillary distance of the target user; Adjusting the left picture and the right picture according to the horizontal offset corresponding to the target image to obtain a target left picture and a target right picture; interweave the target left picture with the target right picture to generate a target 3D image corresponding to the target image, The horizontal offset corresponding to the target image is determined by the following formula: ScreenOffsetX=(TargetDistance-ScreenDistance)*tan(thetaInArc+theta0); Wherein, ScreenOffsetX is the horizontal offset corresponding to the target image, TargetDistance is the distance between the virtual image corresponding to the target image and the binocular eyes of the target user, ScreenDistance is the vertical distance between the target user and the display screen, thetaInArc is the horizontal angle between the monocular line of sight of the target user and the front of the binocular eyes of the target user, and theta0 is the subjective squint angle. ThetaInArc is determined by the following formula: thetaInArc=arctan(PD*0.5 / TargetDistance); Wherein, PD is the pupil distance of the target user.

2. The method according to claim 1, characterized in that Determining the left picture and the right picture corresponding to the target image includes: Acquiring the target image displayed on the display screen in real time; The target image is divided or copied to obtain the left picture and the right picture.

3. A terminal device, characterized in that: include: A first determining unit, configured to determine a left picture and a right picture corresponding to a target image; a second determining unit, configured to determine a horizontal offset corresponding to the target image according to a subjective squint angle of a target user and an interpupillary distance of the target user; an adjusting unit, configured to adjust the left picture and the right picture according to a horizontal offset corresponding to the target image, so as to obtain a target left picture and a target right picture; an interleaving unit, configured to interleave the target left picture with the target right picture to generate a target 3D image corresponding to the target image, The second determining unit is further specifically configured to: The horizontal offset corresponding to the target image is determined by the following formula: ScreenOffsetX=(TargetDistance-ScreenDistance)*tan(thetaInArc+theta0); Wherein, ScreenOffsetX is the horizontal offset corresponding to the target image, TargetDistance is the distance between the virtual image corresponding to the target image and the binocular eyes of the target user, ScreenDistance is the vertical distance between the target user and the display screen, thetaInArc is the horizontal angle between the monocular line of sight of the target user and the front of the binocular eyes of the target user, and theta0 is the subjective squint angle. ThetaInArc is determined by the following formula: thetaInArc=arctan(PD*0.5 / TargetDistance); Wherein, PD is the pupil distance of the target user.

4. A computer storage medium, characterized in that include: The instructions, when executed on a computer, cause the computer to execute the method for generating a 3D image according to any one of claims 1 to 2.

Images