Variable depth-of-field photography learning method based on light field technology

Abstract

The invention discloses a variable depth-of-field photography learning method based on a light field technology, and aims to help a photography enthusiast to solve the problems of depth-of-field understanding, shooting angle selection and the like in photography learning. According to the method, the unique imaging principle of a light field technology is utilized, so that a reconstructed scene can show a dynamic visual effect, including dynamic focusing depth and parallax change. The method comprises the following steps: firstly, establishing a virtual reality interaction scene in a game development engine, and importing a light field image into the scene; then, rendering is carried out through a specific toolkit, and the user can realize dynamic interaction of the light field image, including adjustment of the depth of field and change of the viewing angle. According to the invention, through a virtual reality interaction means, flexible visual operation experience is provided for photography learning, and the learning efficiency and photography skills of photography enthusiasts can be improved.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality (VR), specifically using the variable depth of field induced by light field technology and eye tracking technology to control the depth of focus to assist photography enthusiasts in learning photography techniques. Background Art

[0002] Light Field Technology (LFT) is an innovative imaging method that allows for post - processing adjustment of depth and perspective of a scene by capturing all directions and angles of light rays reaching the sensor. This technology can achieve the effect of Variable Depth of Field (VDoF), that is, adjusting the sharpness of an image by changing optical parameters rather than through digital processing. In the field of education, especially in photography learning, LFT provides a new way to simulate the dynamic depth of field and parallax effects during actual shooting, thus helping learners better understand and master photography skills.

[0003] Extended Reality (XR) technology, including Virtual Reality (VR) and Augmented Reality (AR), is being increasingly widely used in the field of education. These technologies enhance the learning experience by providing immersive learning environments and new interaction methods. In photography learning, XR technology can simulate actual shooting scenarios, enabling learners to practice and experiment with different photography techniques in a safe and controllable environment. Combined with eye tracking technology to assist learners in adjusting the depth of field, a virtual photography learning environment has been developed where learners can control the depth of field and parallax effects through gestures, thus simulating the actual shooting process in a virtual space. Summary of the Invention

[0004] Based on light field technology and light field datasets, the present invention provides a variable depth of field photography learning method based on light field technology, with eye movement - controlled zoom, which makes novice learners have a stronger sense of immersion in the VR environment and generally improves learning efficiency.

[0005] The technical solution provided by the present invention is as follows:

[0006] A variable depth of field photography learning method based on light field technology, comprising the following steps:

[0007] 1) Display a light field image containing the object to be photographed (such as the "amethyst" dataset of the Stanford dataset, etc.) to learners in a VR environment to simulate their photography process.

[0008] 2) In order to enable learners to experience variable depth of field and the effect of selecting shooting angles in the VR learning environment, "Variable Depth of Field (VDoF)" and "parallax" etc. are selected as LFI effects. These effects can provide distinct experiences, and the required interaction skills are directly related to the key skills required for photography simulation.

[0009] 3) In terms of interaction design, in cooperation with head-mounted devices (such as HTC VIVE pro, etc.), by integrating eye-tracking technology, learners will be able to experience an unprecedented interaction method, in which the adjustment of depth of field will be synchronized with the subtle movement of the line of sight. The eye tracker can automatically adjust the depth of field according to the line of sight direction. For example, when the user gazes at a certain area, the system can automatically focus on that area and adjust the image of that area to the focus. This innovative interaction method liberates the user's hands and enables intuitive communication with the virtual environment without any physical operation.

[0010] 5) The present invention uses a variety of packages and external tools (such as COLIBRI VR, COLMAP, Blender, etc.) to create a light field image viewer environment. All these tools are integrated with virtual environment development software (such as Unity, etc.).

[0011] Through the described light field viewer environment, the VDoF effect is achieved. Photography enthusiasts can adjust the dynamic parallax by gently turning the helmet to simulate different shooting angles.

[0012] The technical effects of the present invention are:

[0013] The above steps proposed by the present invention jointly construct a complete VR scene blueprint, aiming to utilize light field technology and advanced real-time eye-tracking functions to greatly enhance the immersion and teaching efficiency of photography learning. Through this innovative combination, photography enthusiasts can master photography skills in the most intuitive way in a highly simulated virtual environment, thereby deepening their understanding and mastery of the art of photography. This not only provides a platform for photography enthusiasts to practice and explore, but also brings a brand-new teaching tool for photography enthusiasts, making photography learning more vivid and efficient. Brief Description of the Drawings

[0014] Figure 1 is a flowchart of the present invention. Detailed Embodiments

[0015] The present invention will be further described below with reference to the accompanying drawings through embodiments, but the scope of the present invention is not limited in any way.

[0016] The present invention provides a method for learning depth-of-field photography based on light field technology. Through the method of the present invention, photography enthusiasts, wearing a head-mounted device (such as HTC VIVE, etc.), can adjust the depth of field by means of eye movement and can change the angle by slightly rotating the helmet. This immersive learning method can significantly enhance the learning efficiency of learners.

[0017] First, as Figure 1As shown, it is the helmet used in the present invention. The present invention constructs a virtual learning environment based on light field technology (LFT) to enhance the experience and efficiency of photography learning. This environment utilizes the dynamic visual effects provided by LFT, such as dynamic focus and parallax, to simulate key photography actions such as adjusting variable depth of field (VDoF) and previewing different shooting angles. The core of the research lies in using virtual reality (VR) technology, combined with integrated eye tracking technology, to enable users to experience and control VDoF and parallax effects in a virtual environment.

[0018] The first step of the present invention is to create a light field image (LFI) environment in VR. A light field image is selected (such as the "amethyst" dataset in the Stanford Light Field Archive, as Figure 1 shown).

[0019] Next, the present invention renders the LFI in the VR environment to achieve VDoF and parallax effects. These effects provide distinct experiences, and the required interaction skills are directly related to the key skills required for photography simulation. In particular, VDoF directly maps to focal length, aperture, and distance.

[0020] To enable user interaction, the present invention integrates eye tracking technology, and learners can automatically adjust the depth of field according to the line of sight direction. For example, when a learner gazes at a certain area, the system can automatically focus on that area, simulating a real visual focusing experience.

[0021] In the implementation stage, the present invention uses a variety of software packages and external tools (such as COLIBRI VR, COLMAP, Blender, etc.) to create an LF viewer environment and integrate it with virtual environment development software (such as Unity, etc.).

[0022] It should be noted that the purpose of disclosing the embodiments is to help further understand the present invention. However, those skilled in the art can understand that various substitutions and modifications are possible without departing from the spirit and scope of the present invention and the appended claims. Therefore, the present invention should not be limited to the content disclosed in the embodiments, and the scope of protection claimed by the present invention shall be defined by the scope defined in the claims.

Claims

1. A variable depth of field photography learning method based on light field technology, characterized in that: The following steps are involved: (1) Building a virtual reality interactive scene in a game development engine and importing the light field image into the virtual reality interactive scene; (2) Reconstructing scenes using the imaging principle of light field technology to display dynamic visual effects, including dynamic focus depth and parallax changes; (3) Use a specific toolkit to render light field images and provide a user interface to support users to dynamically interact with light field images; (4) The user adjusts the depth of field of the light field image and changes the viewing angle through the user interface, thereby achieving training in depth of field understanding and shooting angle selection in photography learning.

2. The variable depth of field photography learning method based on light field technology according to claim 1, characterized in that: The virtual reality interaction scene supports control through virtual reality devices (such as HTC VIVE, etc.).

3. The variable depth of field photography learning method based on light field technology according to claim 1, characterized in that: The step of importing the light field image includes selecting a light field image from a preset light field image database for import.

4. The variable depth of field photography learning method based on light field technology according to claim 1, characterized in that: The dynamic visual effect includes the user dynamically adjusting different focus planes through operation control to observe scene effects at different depths of field.

5. The variable depth of field photography learning method based on light field technology according to claim 1, characterized in that: An image-based rendering algorithm is applied to accurately map each independent image to the corresponding focal plane in the three-dimensional space, and perform image fusion based on the user's current perspective, so that users can clearly observe the detailed changes of the reconstructed scene from different perspectives.

6. The variable depth of field photography learning method based on light field technology according to claim 1, characterized in that: The method is suitable for training on depth of field understanding and shooting angle selection in photography learning, and helps users improve their photography skills.

Images