Image processing method, device and terminal

By acquiring and utilizing the motion and positional data of the shooting device and viewing device, the images corresponding to the user's line of sight are intercepted from the captured image for processing, and the problem of poor synchronous display and transformation of VR devices is solved, and the image processing performance is improved. Speed ​​improves user experience.

CN111949114BActive Publication Date: 2024-11-08CHINA MOBILE COMM LTD RES INST +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201910402507.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-05-15
Publication Date
2024-11-08
Estimated Expiration
2039-05-15

AI Technical Summary

Technical Problem

When existing VR devices synchronize display and transform images, they cannot achieve the effect of being completely synchronized with the wearer's body movement, head rotation and eye movement, resulting in poor user experience.

Method used

By acquiring the motion and positional attitude data of the shooting device and the viewing device, the target processing image corresponding to the user's line of sight is intercepted from the captured image, and processed and displayed it. The impact of the picture motion is removed and the image processing algorithm is reduced. Search space.

Benefits of technology

It improves the performance and speed of image processing, ensures the synchronization and clarity of image display, and improves the user experience of VR devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111949114B_ABST
    Figure CN111949114B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention provides an image processing method, device and terminal, the image processing method comprising: obtaining first motion and position posture data of a shooting device, and obtaining second motion and position posture data of a viewing device; intercepting a target processing image corresponding to the user's line of sight from a shot image according to the first motion and position posture data and the second motion and position posture data, the shot image being obtained by the shooting device, processing the target processing image to obtain a target display image; and displaying the target display image. The embodiment of the present invention can reduce the search space of related image processing algorithms while ensuring the image display effect, thereby effectively improving the performance and speed of image processing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to an image processing method, device and terminal. Background Art

[0002] Since the "scene" in the real world is relatively static, during human activities, through the movement of the head, eyes, body movement and shaking, etc., the "scene" in front of the eyes forms a relatively stable and coherent picture, without any dizziness or discomfort. However, in virtual reality (VR) devices, the picture displayed by the VR device must be completely synchronized with the wearer's body movement, head rotation, and even eye movement, line of sight direction and focus point, and at the same time meet sufficiently high picture clarity and frame rate, so that the wearer can have a good user experience and realistic feeling. But so far, the picture display of VR devices is far from achieving the above-mentioned synchronous display and transformation effects, which brings many challenges and problems to the actual use of the wearer. Summary of the invention

[0003] The embodiments of the present invention provide an image processing method, an apparatus and a terminal, so as to effectively improve the performance and speed of image processing while ensuring the image display effect.

[0004] In a first aspect, an embodiment of the present invention provides an image processing method, including:

[0005] Acquire first motion and position posture data of the shooting device, and acquire second motion and position posture data of the viewing device;

[0006] According to the first motion and position posture data and the second motion and position posture data, intercepting a target processing image corresponding to the user's sight line from the captured image, wherein the captured image is captured by the capturing device;

[0007] Processing the target processed image to obtain a target displayed image;

[0008] The target display image is displayed.

[0009] In a second aspect, an embodiment of the present invention provides an image processing device, including:

[0010] An acquisition module, used to acquire first motion and position posture data of a shooting device, and to acquire second motion and position posture data of a viewing device;

[0011] An interception module, configured to intercept a target processing image corresponding to the user's sight line from a captured image according to the first motion and position posture data and the second motion and position posture data, wherein the captured image is captured by the capturing device;

[0012] A processing module, used for processing the target processing image to obtain a target display image;

[0013] The display module is used to display the target display image.

[0014] In a third aspect, an embodiment of the present invention provides a terminal, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program can implement the steps of the above-mentioned image processing method when executed by the processor.

[0015] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program can implement the steps of the above-mentioned image processing method when executed by a processor.

[0016] In an embodiment of the present invention, by intercepting a target processing image corresponding to the user's line of sight from a captured image, and processing and displaying the target processing image, not only can the motion and position posture data of related equipment be used to remove the influence of picture motion and ensure the image display effect, but also the search space of related image processing algorithms can be reduced, thereby effectively improving the performance and speed of image processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments of the present invention will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 is a flowchart of an image processing method according to an embodiment of the present invention;

[0019] Figure 2 is a schematic structural diagram of an image processing device according to an embodiment of the present invention;

[0020] Figure 3 Schematic diagram of the structure of a terminal according to an embodiment of the present invention. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0022] In order to ensure the image display effect, the following image processing methods can be used at present: using image de-shaking, de-blurring and other algorithms to process the captured images in real time to improve the display effect. However, the algorithms involved in this image processing method are complex and the amount of real-time processing calculations is large, resulting in poor image processing performance and slow image processing speed.

[0023] The purpose of the embodiments of the present invention is to provide an image processing method, device and terminal, which captures a target processing image corresponding to the user's line of sight from a captured image, and processes and displays the target processing image. Since the content that the user is concerned about during the image display process is usually the image corresponding to the user's line of sight, and the image corresponding to the user's line of sight may be only a small part of the captured image, the image processing method of the embodiments of the present invention can not only use the motion and position posture data of the relevant equipment to remove the impact of the picture motion and ensure the image display effect, but also reduce the search space of the relevant image processing algorithm, thereby effectively improving the performance and speed of image processing.

[0024] See also Figure 1 , Figure 1 is a flowchart of an image processing method provided by an embodiment of the present invention, the method is applied to a terminal, such as Figure 1 As shown, the method comprises the following steps:

[0025] Step 101: Acquire first motion and position posture data of a photographing device, and acquire second motion and position posture data of a viewing device.

[0026] In at least one embodiment of the present invention, the shooting device is, for example, a VR shooting device, and the viewing device is, for example, a VR viewing device.

[0027] Optionally, the first motion and position posture data at least include motion data of the shooting device and position posture data of the shooting device. The motion data includes, for example, motion direction, motion speed, rotational angular velocity, etc. The position posture data includes, for example, position information, deflection angle, etc. The first motion and position posture data can be detected by a sensor component corresponding to the shooting device. The sensor component corresponding to the shooting device can be a high-performance and high-precision inertial sensor device or module installed on the shooting device, or installed on a device connected and fixed to the shooting device. The inertial sensor device or module can use a 9-axis inertial sensor to simultaneously collect data such as acceleration, gyroscope and magnetometer.

[0028] Optionally, the second motion and position posture data at least includes motion data of the viewing device and position posture data of the viewing device. The motion data includes, for example, motion direction, motion speed, rotational angular velocity, etc. The position posture data includes, for example, position information, deflection angle, etc. The second motion and position posture data can be detected by a sensor component corresponding to the viewing device. The sensor component corresponding to the viewing device can be a high-performance and high-precision inertial sensor device or module installed on the viewing device, or installed on a device connected and fixed to the viewing device. The inertial sensor device or module can use a 9-axis inertial sensor to simultaneously collect data such as acceleration, gyroscope and magnetometer.

[0029] In an optional embodiment, the first motion and position posture data, and / or the second motion and position posture data can be collected in real time and obtained by a corresponding image processing device, or can be recorded in each frame of the video, i.e., an image, in a tagged manner and obtained by a corresponding image processing device. The first motion and position posture data, and / or the second motion and position posture data can be selected as a set of 6-tuple sequences expressed in a time series, corresponding to the motion and position posture data at the sampling moment, that is, it can include 6 parameters, namely, the spatial position (x, y, z) corresponding to the reference coordinate system, and the spatial posture angle (α, β, γ).

[0030] Step 102: According to the first motion and position posture data and the second motion and position posture data, a target processing image corresponding to the user's line of sight is intercepted from the captured image.

[0031] The captured image is captured by the capturing device.

[0032] Step 103: Process the target processed image to obtain a target displayed image.

[0033] In at least one embodiment of the present invention, when processing the target processing image, the first motion and position posture data and the second motion and position posture data can be used for processing. When processing the target processing image using the first motion and position posture data and the second motion and position posture data, the following processing method can be adopted: with the help of existing image processing algorithms (such as de-motion, de-jitter, de-blurring and other related algorithms), the first motion and position posture data and the second motion and position posture data are used to process the target processing image, so as to at least achieve correction, de-blurring and fine-tuning of the target processing image, and at least solve the problem of picture motion and jitter caused by the movement of the picture viewpoint and the optical axis in the image shooting and viewing links.

[0034] Step 104: Display the target display image.

[0035] Optionally, after obtaining the target display image, the target display image may be directly displayed.

[0036] The image processing method of the embodiment of the present invention can remove the influence of picture motion by at least utilizing the motion and position posture data of related equipment, thereby ensuring the image display effect, and can also reduce the search space of related image processing algorithms, thereby effectively improving the performance and speed of image processing.

[0037] In at least one embodiment of the present invention, optionally, the above step 102 may include:

[0038] Transforming the first motion and position posture data and the second motion and position posture data to obtain third motion and position posture data corresponding to the first motion and position posture data, and fourth motion and position posture data corresponding to the second motion and position posture data, wherein the third motion and position posture data and the fourth motion and position posture data are data in the same target coordinate system;

[0039] Determining a sight focus point in a display area of ​​the captured image according to the third motion and position posture data and the fourth motion and position posture data;

[0040] Determine a target local area corresponding to the sight focus point in the display area of ​​the captured image;

[0041] intercepting an image corresponding to the target local area from the captured image;

[0042] Among them, the image corresponding to the target local area is the target processed image.

[0043] In this way, with the help of determining the sight focus point, the target processing image can be accurately determined.

[0044] It should be noted that the above-mentioned transformation processing may include at least one of the following: spatial coordinate transformation, affine transformation, perspective transformation and other related transformations. In order to accurately realize the transformation processing of the first motion and position posture data and the second motion and position posture data, when the shooting device and the viewing device are turned on, a one-click calibration operation can be performed on the sensor components corresponding to the shooting device and the sensor components corresponding to the viewing device to bind the spatial conversion relationship between the spatial coordinate system corresponding to the shooting device and the spatial coordinate system corresponding to the viewing device. When the first motion and position posture data and the second motion and position posture data are subsequently transformed, the transformation processing can be performed based on the bound spatial conversion relationship, so as to obtain the third motion and position posture data and the fourth motion and position posture data in the same target coordinate system. This target coordinate system can be set based on actual needs.

[0045] It is understandable that, considering the imaging principle of the shooting device, the shot image is equivalent to a display imaging plane parallel to the focal plane of the shooting device, and the first motion and position posture data of the shooting device controls and determines the position and spatial posture of the corresponding display imaging plane in the target coordinate system. The second motion and position posture data of the viewing device determines its spatial posture and orientation and determines the viewing plane. The line of sight optical axis direction is perpendicular to the viewing plane, and the intersection of the line of sight optical axis direction and the display imaging plane is the line of sight focus point, that is, the user's line of sight focus point.

[0046] Optionally, the process of determining the sight focus point in the display area of ​​the captured image according to the third motion and position posture data and the fourth motion and position posture data may be:

[0047] Determine the image display plane in the target coordinate system according to the third motion and position posture data, and determine the sight line optical axis direction in the target coordinate system according to the fourth motion and position posture data;

[0048] The intersection point of the sight line optical axis direction and the image display plane is determined as the sight line focus point.

[0049] In this way, the sight focus point in the display area of ​​the captured image can be accurately determined.

[0050] In at least one embodiment of the present invention, after the line of sight focus point is determined, a preset area centered on the line of sight focus point can be directly determined as the target local area based on preset conditions. The preset area can be understood as the user's optimal viewing area, which can be pre-set based on the viewing device situation, and is usually related to the distance from the user to the displayed image, etc.

[0051] Furthermore, due to the movement of the shooting device and the viewing device and the changes in position and posture, the displayed image will experience jitter, movement, etc. Therefore, in order to ensure the image processing effect, when determining the target processing image, the image corresponding to the user's optimal viewing area and a certain neighborhood can be determined as the target processing image.

[0052] Optionally, the process of determining the target local area corresponding to the sight focus point in the display area of ​​the captured image may include:

[0053] Determining a preset area centered on the sight focus point in the display area of ​​the captured image as an initial local area;

[0054] Determining a target neighboring area of ​​the initial local area according to the third motion and position posture data and the fourth motion and position posture data;

[0055] An area including the initial local area and the target neighboring area is determined as the target local area.

[0056] Among them, when determining the target adjacent area according to the third motion and position posture data and the fourth motion and position posture data, the third motion and position posture data and the fourth motion and position posture data can be used to first locate the orientation of the viewpoint and the optical axis in the display image, and then based on the change in the orientation of the viewpoint and the optical axis in the image within a preset time (such as the time interval for taking images), the target adjacent area is determined to ensure that the content that the user is concerned about is within the target processed image.

[0057] In this way, since the initial local area and its target neighboring area are taken into consideration when determining the target processing image, it is possible to reduce the impact of motion on the required image content while reducing the search space of the relevant image processing algorithm, thereby ensuring the integrity of the required image content and achieving stable imaging and display.

[0058] See also Figure 2 , Figure 2 is a schematic diagram of the structure of an image processing device provided by an embodiment of the present invention. Figure 2 As shown, the image processing device comprises:

[0059] An acquisition module 21, used to acquire first motion and position posture data of a shooting device, and to acquire second motion and position posture data of a viewing device;

[0060] An interception module 22, configured to intercept a target processing image corresponding to the user's sight line from a captured image according to the first motion and position posture data and the second motion and position posture data, wherein the captured image is captured by the capturing device;

[0061] The processing module 23 is used to process the target processing image to obtain a target display image;

[0062] The display module 24 is used to display the target display image.

[0063] The image processing device of the embodiment of the present invention can not only remove the influence of picture motion by utilizing the motion and position posture data of related equipment to ensure the image display effect, but also reduce the search space of related image processing algorithms, thereby effectively improving the performance and speed of image processing.

[0064] Optionally, the interception module 23 includes:

[0065] a first processing unit, configured to transform the first motion and position posture data and the second motion and position posture data to obtain third motion and position posture data corresponding to the first motion and position posture data, and fourth motion and position posture data corresponding to the second motion and position posture data, wherein the third motion and position posture data and the fourth motion and position posture data are data in the same target coordinate system;

[0066] A first determining unit, configured to determine a sight focus point in a display area of ​​the captured image according to the third motion and position posture data and the fourth motion and position posture data;

[0067] A second determining unit, configured to determine a target local area corresponding to the sight focus point in a display area of ​​the captured image;

[0068] A capture unit, used to capture an image corresponding to the target local area from the captured image;

[0069] Among them, the image corresponding to the target local area is the target processed image.

[0070] Optionally, the second determining unit includes:

[0071] A first determining subunit, configured to determine a preset area centered on the sight focus point in the display area of ​​the captured image as an initial local area;

[0072] A second determining subunit is used to determine a target adjacent area of ​​the initial local area according to the third motion and position posture data and the fourth motion and position posture data;

[0073] The third determining subunit is configured to determine an area including the initial local area and the target adjacent area as the target local area.

[0074] Optionally, the first determining unit includes:

[0075] a fourth determining subunit, configured to determine the image display plane in the target coordinate system according to the third motion and position posture data, and to determine the direction of the sight line optical axis in the target coordinate system according to the fourth motion and position posture data;

[0076] The fifth determining subunit is used to determine the intersection point of the sight line optical axis direction and the image display plane as the sight line focus point.

[0077] Optionally, the first motion and position posture data is detected by a sensor component corresponding to the shooting device;

[0078] The second motion and position posture data is detected by a sensor component corresponding to the viewing device.

[0079] In addition, an embodiment of the present invention further provides a terminal, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the various processes of the above-mentioned image processing method embodiment can be implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0080] For details, see Figure 3 As shown, an embodiment of the present invention further provides a terminal, including a bus 31, a transceiver 32, an antenna 33, a bus interface 34, a processor 35 and a memory 36.

[0081] In the embodiment of the present invention, the terminal further includes: a computer program stored in the memory 36 and executable on the processor 35 .

[0082] Specifically, when the computer program is executed by the processor 35, the following steps can be implemented:

[0083] Acquire first motion and position posture data of the shooting device, and acquire second motion and position posture data of the viewing device;

[0084] According to the first motion and position posture data and the second motion and position posture data, intercepting a target processing image corresponding to the user's sight line from the captured image, wherein the captured image is captured by the capturing device;

[0085] Processing the target processed image to obtain a target displayed image;

[0086] The target display image is displayed.

[0087] exist Figure 3In the embodiment, the bus architecture (represented by bus 31) is shown, and bus 31 may include any number of interconnected buses and bridges, and bus 31 links various circuits including one or more processors represented by processor 35 and memory represented by memory 36. Bus 31 may also link various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. Bus interface 34 provides an interface between bus 31 and transceiver 32. Transceiver 32 may be one element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on a transmission medium. Data processed by processor 35 is transmitted on a wireless medium via antenna 33, and further, antenna 33 also receives data and transmits the data to processor 35.

[0088] The processor 35 is responsible for managing the bus 31 and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management and other control functions. The memory 36 can be used to store data used by the processor 35 when performing operations.

[0089] Optionally, the processor 35 may be a CPU, an ASIC, an FPGA or a CPLD.

[0090] An embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned image processing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0091] Computer readable media include permanent and non-permanent, removable and non-removable media, and can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0092] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0093] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0094] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0095] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. An image processing method, characterized in that: include: Acquire first motion and position posture data of the shooting device, and acquire second motion and position posture data of the viewing device; According to the first motion and position posture data and the second motion and position posture data, intercepting a target processing image corresponding to the user's sight line from the captured image, wherein the captured image is captured by the capturing device; Processing the target processed image to obtain a target displayed image; Displaying the target display image; The method of intercepting a target processing image corresponding to the user's line of sight from the captured image according to the first motion and position posture data and the second motion and position posture data includes: Transforming the first motion and position posture data and the second motion and position posture data to obtain third motion and position posture data corresponding to the first motion and position posture data, and fourth motion and position posture data corresponding to the second motion and position posture data, wherein the third motion and position posture data and the fourth motion and position posture data are data in the same target coordinate system; Determining a sight focus point in a display area of ​​the captured image according to the third motion and position posture data and the fourth motion and position posture data; Determine a target local area corresponding to the sight focus point in the display area of ​​the captured image; intercepting an image corresponding to the target local area from the captured image; Among them, the image corresponding to the target local area is the target processed image.

2. The method according to claim 1, characterized in that: The determining of a target local area corresponding to the sight focus point in the display area of ​​the captured image includes: Determining a preset area centered on the sight focus point in the display area of ​​the captured image as an initial local area; Determining a target neighboring area of ​​the initial local area according to the third motion and position posture data and the fourth motion and position posture data; An area including the initial local area and the target neighboring area is determined as the target local area.

3. The method according to claim 1, characterized in that Determining a sightline focus point in a display area of ​​the captured image according to the third motion and position posture data and the fourth motion and position posture data, comprising: Determine the image display plane in the target coordinate system according to the third motion and position posture data, and determine the sight line optical axis direction in the target coordinate system according to the fourth motion and position posture data; The intersection point of the sight line optical axis direction and the image display plane is determined as the sight line focus point.

4. The method according to any one of claims 1 to 3, characterized in that The first motion and position posture data is detected by a sensor component corresponding to the shooting device; The second motion and position posture data is detected by a sensor component corresponding to the viewing device.

5. An image processing device, characterized in that: include: An acquisition module, used to acquire first motion and position posture data of a shooting device, and to acquire second motion and position posture data of a viewing device; An interception module, configured to intercept a target processing image corresponding to the user's sight line from a captured image according to the first motion and position posture data and the second motion and position posture data, wherein the captured image is captured by the capturing device; A processing module, used for processing the target processing image to obtain a target display image; A display module, used for displaying the target display image; Wherein, the interception module includes: a first processing unit, configured to transform the first motion and position posture data and the second motion and position posture data to obtain third motion and position posture data corresponding to the first motion and position posture data, and fourth motion and position posture data corresponding to the second motion and position posture data, wherein the third motion and position posture data and the fourth motion and position posture data are data in the same target coordinate system; A first determining unit, configured to determine a sight focus point in a display area of ​​the captured image according to the third motion and position posture data and the fourth motion and position posture data; A second determining unit, configured to determine a target local area corresponding to the sight focus point in a display area of ​​the captured image; A capture unit, used to capture an image corresponding to the target local area from the captured image; Among them, the image corresponding to the target local area is the target processed image.

6. The device according to claim 5, characterized in that The second determining unit includes: A first determining subunit, configured to determine a preset area centered on the sight focus point in the display area of ​​the captured image as an initial local area; A second determining subunit is used to determine a target adjacent area of ​​the initial local area according to the third motion and position posture data and the fourth motion and position posture data; The third determining subunit is configured to determine an area including the initial local area and the target adjacent area as the target local area.

7. The device according to claim 5, characterized in that The first determining unit includes: a fourth determining subunit, configured to determine the image display plane in the target coordinate system according to the third motion and position posture data, and to determine the direction of the sight line optical axis in the target coordinate system according to the fourth motion and position posture data; The fifth determining subunit is used to determine the intersection point of the sight line optical axis direction and the image display plane as the sight line focus point.

8. A terminal comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the computer program is executed by the processor, the steps of the image processing method according to any one of claims 1 to 4 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the image processing method according to any one of claims 1 to 4 are implemented.