Shooting module control method, head-mounted display device and storage medium

Abstract

Disclosed in the present invention are a shooting module control method, a head-mounted display device and a storage medium. The method comprises: acquiring a first time when a display module of a head-mounted display device refreshes an image frame and a second time when a shooting module thereof outputs an image frame; on the basis of the first time and the second time, determining a frame rate adjustment parameter; and, on the basis of the frame rate adjustment parameter, controlling the shooting module to adjust the frame rate. The present invention aims to shorten the time required by the head-mounted display device for the process from image collection to image display, thereby reducing the display delay.

Description

Control method of shooting module, head-mounted display device and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on August 23, 2023, with application number 202311068078.2 and invention name “Control method of shooting module, head-mounted display device and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present invention relates to the technical field of head-mounted display devices, and in particular to a control method for a shooting module, a head-mounted display device, and a storage medium. Background Art

[0003] Head-mounted display devices generally use a shooting module to replace the human eye to observe the real scene. After the shooting module captures the real scene, the image is displayed on the display module for the user to watch.

[0004] Among them, the shooting module captures images at a certain frame rate, and the display module refreshes and displays images at a certain frame rate. However, these two frame rates are set independently before the two modules leave the factory, and will be affected by signal transmission and other factors during the operation of the device. This will make the process from image capture to image display of the head-mounted display device longer, and there will be a problem of serious display delay.

[0005] Summary of the Invention

[0006] The main purpose of the present invention is to provide a control method for a shooting module, a head-mounted display device, and a storage medium, aiming to shorten the time required for the head-mounted display device to go from image acquisition to image display and reduce display delay.

[0007] To achieve the above object, the present invention provides a method for controlling a camera module, which is applied to a head-mounted display device. The method for controlling the camera module comprises the following steps:

[0008] Obtaining a first time when a display module of the head mounted display device refreshes an image frame and a second time when the shooting module outputs an image frame;

[0009] determining a frame rate adjustment parameter according to the first time and the second time;

[0010] The shooting module is controlled to adjust the frame rate according to the frame rate adjustment parameter.

[0011] Optionally, the step of determining a frame rate adjustment parameter according to the first time and the second time includes:

[0012] When the second time is later than the first time, determining the frame rate adjustment parameter includes increasing the frame rate;

[0013] When the second time is earlier than the first time, determining the frame rate adjustment parameter includes reducing the frame rate.

[0014] Optionally, the step of determining a frame rate adjustment parameter according to the first time and the second time includes:

[0015] determining a time difference between the second time and the first time;

[0016] determining a frame rate adjustment amplitude according to the time difference;

[0017] When the second time is later than the first time, determining the frame rate adjustment parameter includes increasing the frame rate by the frame rate adjustment amplitude;

[0018] When the second time is earlier than the first time, determining the frame rate adjustment parameter includes reducing the frame rate by the frame rate adjustment magnitude.

[0019] Optionally, the shooting module includes a first camera and a second camera, and the step of determining the frame rate adjustment amplitude according to the time difference includes:

[0020] Obtaining a display mode of the head mounted display device;

[0021] Acquire a target corresponding relationship between the time difference and the frame rate adjustment amplitude according to the display mode;

[0022] The frame rate adjustment amplitude corresponding to the time difference is determined according to the target corresponding relationship.

[0023] Optionally, the shooting module includes a first camera and a second camera, and the step of controlling the shooting module to adjust the frame rate according to the frame rate adjustment parameter includes:

[0024] The first camera and the second camera are controlled to adjust the frame rates according to the frame rate adjustment parameter.

[0025] Optionally, the step of controlling the first camera and the second camera to adjust the frame rate using the frame rate adjustment parameter includes:

[0026] Controlling the first camera to adjust the frame rate according to the frame rate adjustment parameter;

[0027] controlling the second camera to adjust the frame rate according to the frame rate adjustment parameter and a hardware synchronization signal between the first camera and the second camera;

[0028] The hardware synchronization signal is sent from the first camera to the second camera.

[0029] Optionally, the step of obtaining a first time when a display module of the head mounted display device refreshes an image frame includes:

[0030] Obtaining a vertical synchronization signal of the display module;

[0031] The first time is determined according to the vertical synchronization signal.

[0032] Optionally, the step of controlling the shooting module to adjust the frame rate according to the frame rate adjustment parameter includes:

[0033] The working timing of the shooting module is adjusted according to the frame rate adjustment parameter through the I2C interface of the shooting module.

[0034] In addition, in order to achieve the above-mentioned object, the present invention further provides a head-mounted display device, the head-mounted display device comprising:

[0035] Shooting module;

[0036] A control device, the shooting module is connected to the control device, and the control device includes: a memory, a processor, and a control program for the shooting module stored in the memory and executable on the processor, wherein the control program for the shooting module, when executed by the processor, implements the steps of the control method for the shooting module as described in any one of the above items.

[0037] In addition, in order to achieve the above-mentioned purpose, the present invention also proposes a storage medium, on which a control program of the shooting module is stored. When the control program of the shooting module is executed by a processor, the steps of the control method of the shooting module as described in any one of the above items are implemented.

[0038] The present invention proposes a control method for a camera module applied to a head-mounted display device. The method determines a frame rate adjustment parameter based on a first time when the display module refreshes an image frame and / or a second time when the camera module outputs an image frame, and adjusts the frame rate of the camera module, thereby ensuring coordination between the display frame rate and the image acquisition frame rate, thereby effectively shortening the time required for the head-mounted display device to go from image acquisition to image display and reducing display delay. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying any creative work.

[0040] FIG1 is a schematic diagram of the hardware structure involved in the operation of a head-mounted display device according to an embodiment of the present invention;

[0041] FIG2 is a flow chart of an embodiment of a method for controlling a camera module according to the present invention;

[0042] FIG3 is a flow chart of another embodiment of a method for controlling a camera module according to the present invention;

[0043] FIG4 is a flow chart of another embodiment of a method for controlling a camera module according to the present invention.

[0044] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0045] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0046] It should be noted that if the embodiments of the present invention involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the various components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indications will also change accordingly.

[0047] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present invention, the descriptions of "first", "second", etc. are only for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of such features. In addition, the meaning of "and / or" appearing throughout the text includes three parallel schemes. Taking "A and / or B" as an example, it includes scheme A, or scheme B, or a scheme in which A and B are satisfied at the same time. In addition, the technical solutions between the various embodiments can be combined with each other, but it must be based on the ability of ordinary technicians in this field to implement. When the combination of technical solutions is mutually contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0048] An embodiment of the present invention provides a head-mounted display device. The head-mounted display device may include, but is not limited to, a head-mounted display device based on virtual reality technology, a head-mounted display device based on augmented reality technology, and / or a device based on mixed reality technology.

[0049] In one implementation of this embodiment, the head-mounted display device may be display glasses. In another implementation of this embodiment, the head-mounted display device may be a display helmet.

[0050] 1 , the head mounted display device includes a control device 100 , a camera module 200 , and a display module 300 . The camera module 200 and the display module 300 are both connected to the control device 100 .

[0051] The shooting module 200 is used to shoot images in real scenes. The display module 300 is used to display images.

[0052] In this embodiment, the camera module 200 includes a first camera and a second camera, and the display module 300 includes a first display screen and a second display screen. The first camera and the second camera are spaced apart in a horizontal direction, and the first display screen and the second display screen are arranged in sequence in a horizontal direction. The first camera and the first display screen are configured to correspond to the user's left eye, while the second camera and the second display screen correspond to the user's right eye. The image displayed on the first display screen is generated based on the image captured by the first camera, and the image displayed on the second display screen is generated based on the image captured by the second camera.

[0053] In other embodiments, the camera module 200 may also be an integral display module 300. The display module 300 may also be a display screen.

[0054] In an embodiment of the present invention, referring to FIG1 , a control device 100 includes a processor, such as a CPU, a memory, and a timer. These components communicate with each other via a communication bus. The memory can be a high-speed RAM or a non-volatile memory, such as a disk drive. The memory 1002 can optionally be a storage device independent of the processor.

[0055] Further, referring to Figure 1, the control device 100 includes a camera service framework 1001, a task execution unit 1002 (GPU Warp) and a graphics processor 1003 (GPU). The camera service framework 1001, the task execution unit 1002 and the graphics processor 1003 are connected in sequence, the camera service framework 1001 is connected to the shooting module 200, and the GPU is communicatively connected to the display module 300.

[0056] Those skilled in the art will understand that the device structure shown in FIG1 does not constitute a limitation on the device, and may include more or fewer components than shown, or a combination of certain components, or a different arrangement of components.

[0057] The memory as a computer storage medium may include a camera module adjustment program. In the device shown in FIG1 , the processor may be used to call the camera module adjustment program stored in the memory and execute the relevant steps of the camera module adjustment method in the following embodiments.

[0058] An embodiment of the present invention further provides a method for controlling a shooting module, which is applied to the above-mentioned head-mounted display device.

[0059] 2 , an embodiment of a control method for a camera module of the present invention is provided. In this embodiment, the control method for the camera module includes:

[0060] Step S10, obtaining a first time when the display module of the head mounted display device refreshes an image frame and a second time when the shooting module outputs an image frame;

[0061] The first time may be the time when the display module most recently refreshed an image frame, and the corresponding second time may be the time when the capture module most recently output an image frame. Alternatively, the time when the display module most recently refreshed an image frame may be obtained to obtain more than one first time, and the time when the capture module most recently output an image frame may be obtained to obtain more than one second time.

[0062] The first time may be determined according to a signal output by the display module, and the second time may be determined according to a time of receiving the image data.

[0063] Refreshing an image frame may refer to refreshing a complete image frame, or may refer to refreshing a portion of a complete image frame.

[0064] Outputting an image frame may refer to outputting a complete image frame, or may refer to outputting a portion of a complete image frame.

[0065] Step S20, determining a frame rate adjustment parameter according to the first time and the second time;

[0066] The frame rate adjustment parameters include but are not limited to at least one of the following: frame rate adjustment direction (increase frame rate, decrease frame rate, or maintain frame rate unchanged), frame rate adjustment amplitude, frame rate adjustment rate, and the like.

[0067] Different first times and different second times correspond to different frame rate adjustment parameters. In one implementation, the relationship between the first time and the second time can be determined, and the frame rate adjustment parameter is determined based on the relationship. In another implementation, the relationship value between the first time and the second time can be determined, and the frame rate adjustment parameter is determined based on the relationship value.

[0068] Step S30: Controlling the shooting module to adjust the frame rate according to the frame rate adjustment parameter.

[0069] When the frame rate adjustment parameter includes a frame rate adjustment direction, the shooting module is controlled to adjust the frame rate according to the frame rate adjustment direction.

[0070] When the frame rate adjustment parameter includes a frame rate adjustment amplitude, the shooting module is controlled to adjust the frame rate according to the frame rate adjustment amplitude.

[0071] When the frame rate adjustment parameter includes a frame rate adjustment rate, the shooting module is controlled to adjust the frame rate according to the frame rate adjustment rate.

[0072] An embodiment of the present invention proposes a method for controlling a camera module. The method determines a frame rate adjustment parameter based on a first time when the display module refreshes an image frame and / or a second time when the camera module outputs an image frame, and adjusts the frame rate of the camera module, thereby ensuring coordination between the display frame rate and the image acquisition frame rate, thereby effectively shortening the time required for a head-mounted display device to go from image acquisition to image display, and reducing display delay.

[0073] Furthermore, based on the above embodiment, another embodiment of the control method of the camera module of the present invention is proposed. In this embodiment, referring to FIG3 , the step S20 includes:

[0074] Step S21, when the second time is later than the first time, determining that the frame rate adjustment parameter includes increasing the frame rate;

[0075] When the frame rate adjustment parameter includes increasing the frame rate, during the execution of step S30, the shooting module can be controlled to increase the frame rate according to a preset fixed frame rate adjustment value, or the shooting module can be controlled to increase the frame rate according to a target frame rate adjustment value determined according to the actual operation of the head-mounted display device.

[0076] Step S22: When the second time is earlier than the first time, determining the frame rate adjustment parameter includes reducing the frame rate.

[0077] When the frame rate adjustment parameter includes lowering the frame rate, during the execution of step S30, the shooting module can be controlled to lower the frame rate according to a preset fixed frame rate adjustment value, or the shooting module can be controlled to lower the frame rate according to a target frame rate adjustment value determined according to the actual operation of the head-mounted display device.

[0078] It should be noted that the order in which step S21 and step S22 are executed is not specifically limited.

[0079] In this embodiment, when the capture module outputs an image frame later than the display module requires it, the frame rate of the camera module outputs the image frame, increasing the camera module's output frame rate. This allows the camera module to output the next image frame earlier, closer to the next time the display module requires it to refresh the image frame. When the capture module outputs an image frame earlier than the display module requires it, the frame rate of the camera module outputs the image frame, decreasing the camera module's output frame rate. This allows the camera module to output the next image frame later, closer to the next time the display module requires it to refresh the image frame. This effectively shortens the time required for the head-mounted display device to go from image acquisition to image display, reducing display latency.

[0080] Further, in this embodiment, the step of determining the frame rate adjustment parameter based on the first time and the second time includes: determining the time difference between the second time and the first time; determining the frame rate adjustment amplitude based on the time difference; when the second time is later than the first time, determining the frame rate adjustment parameter includes increasing the frame rate by the frame rate adjustment amplitude; when the second time is earlier than the first time, determining the frame rate adjustment parameter includes reducing the frame rate by the frame rate adjustment amplitude.

[0081] The time difference here is the absolute value of the difference between the second time and the first time. The frame rate adjustment amplitude is positively correlated with the time difference. The larger the time difference, the larger the frame rate adjustment amplitude, and the smaller the time difference, the smaller the frame rate adjustment amplitude.

[0082] In this embodiment, the frame rate adjustment amplitude is determined based on the time difference between the first time and the second time, which is beneficial to improving the accuracy of the frame rate adjustment of the shooting module, thereby ensuring that the time interval between the time when the shooting module outputs the image frame after the frame rate adjustment and the time when the display module refreshes the image frame is as short as possible, further effectively shortening the time required for the head-mounted display device to go from image acquisition to image display, and reducing display delay.

[0083] Furthermore, in this embodiment, the shooting module includes a first camera and a second camera, and the step of determining the frame rate adjustment amplitude based on the time difference includes: obtaining a display mode of the head-mounted display device; obtaining a target correspondence between the time difference and the frame rate adjustment amplitude based on the display mode; and determining the frame rate adjustment amplitude corresponding to the time difference according to the target correspondence.

[0084] Different display modes correspond to different target correspondences, which may include calculation formulas, mapping relationships, or algorithm models.

[0085] The display mode can be specifically divided based on the rendering time of the real scene in the display interface in the display module, and different display modes correspond to different rendering times. For example, the display mode includes a first mode or a second mode, and the rendering time corresponding to the first mode is longer than the rendering time corresponding to the second mode. When the display mode is the first mode, the first corresponding relationship is determined to be the target corresponding relationship, and when the display mode is the second mode, the second corresponding relationship is determined to be the target corresponding relationship. When the second time is later than the first time, the frame rate adjustment amplitude corresponding to the same time difference in the first corresponding relationship is smaller than the frame rate adjustment amplitude corresponding to the second corresponding relationship; when the second time is earlier than the first time, the frame rate adjustment amplitude corresponding to the same time difference in the first corresponding relationship is larger than the frame rate adjustment amplitude corresponding to the second corresponding relationship.

[0086] In this embodiment, different display modes result in different time lengths for rendering the required image frames to the display module. Therefore, adapting to the display mode to obtain the target correspondence between the time difference and the frame rate adjustment value is beneficial to improving the accuracy of the frame rate adjustment of the shooting module, thereby ensuring the display effect while reducing display delay.

[0087] Furthermore, based on any of the above embodiments, another embodiment of the control method of the camera module of the present invention is proposed. In this embodiment, the camera module includes a first camera and a second camera. Referring to FIG. 4 , step S30 includes:

[0088] Step S31 : controlling the first camera and the second camera to adjust the frame rates according to the frame rate adjustment parameter.

[0089] The first camera and the second camera capture image frames at the same frame rate. The image frames output by the first camera and the second camera can be displayed separately as image frames in different display areas on the display module, or they can be combined and subsequently used as image frames for display on the display module. In this embodiment, the image frames captured by the first camera are displayed on the first display screen, and the image frames captured by the second camera are displayed on the second display screen.

[0090] The frame rates of the first camera and the second camera are both adjusted synchronously according to the frame rate adjustment parameter.

[0091] In this embodiment, the first camera is controlled to adjust its frame rate based on the frame rate adjustment parameter, and the second camera is controlled to adjust its frame rate based on the frame rate adjustment parameter and a hardware synchronization signal between the first and second cameras; the hardware synchronization signal is sent from the first camera to the second camera. This helps ensure synchronization between the frame rates of the first and second cameras after adjustment, thereby improving the display quality of the image frames output after the frame rate adjustment.

[0092] In this embodiment, the frame rates of the first camera and the second camera are adjusted according to the frame rate adjustment parameters, which is beneficial to ensuring the quality of real images captured by the head-mounted display device equipped with dual cameras while effectively reducing display delay.

[0093] Furthermore, based on any of the above embodiments, another embodiment of the control method for a camera module of the present invention is provided. In this embodiment, the step of obtaining a first time when the display module of the head-mounted display device refreshes an image frame includes obtaining a vertical synchronization signal from the display module and determining the first time based on the vertical synchronization signal.

[0094] The vertical synchronization signal indicates the end of the previous image frame and the beginning of a new image frame.

[0095] Specifically, a time interval with a preset time interval from the time when the vertical synchronization signal occurs may be used as the first time.

[0096] In this embodiment, the generation time of the vertical synchronization signal is used as the first time for the display module to refresh the image frame, which is conducive to ensuring accurate acquisition of the refresh timing of the image frame of the display module, thereby effectively reducing the display delay.

[0097] Furthermore, based on any of the above embodiments, another optional embodiment of the method for controlling a camera module of the present invention is provided. In this embodiment, the step of controlling the camera module to adjust the frame rate according to the frame rate adjustment parameter includes adjusting the operating timing of the camera module according to the frame rate adjustment parameter via an I2C interface of the camera module.

[0098] Among them, when the shooting module includes a first camera and a second camera, the working timing of the first camera can be adjusted according to the frame rate adjustment parameters based on the I2C interface of the first camera to achieve adjustment of the frame rate of the first camera, and the working timing of the second camera can be adjusted according to the frame rate adjustment parameters based on the I2C interface of the second camera to achieve adjustment of the frame rate of the second camera.

[0099] Furthermore, based on any of the above embodiments, another optional embodiment of the control method for the shooting module of the present invention is proposed. In this embodiment, the control device includes a camera service framework, a task execution unit (GPU Warp), and a graphics processing unit (GPU). The GPU is connected to the display module. Based on this, the display module can send a vertical synchronization signal to the GPU, and the GPU sends the vertical synchronization signal to the task execution unit. The task execution unit infers the starting time of the display module refreshing the image frame as the above-mentioned first time based on the vertical synchronization signal, and the task execution unit sends the first time to the camera server framework. The shooting module sends the captured image frame to the camera service framework, and the camera service framework uses the time of the received image frame as the second time, and then determines the frame rate adjustment parameter based on the first time and the second time, and adjusts the frame rate of the first camera and the second camera according to the frame rate adjustment parameter.

[0100] In addition, an embodiment of the present invention further provides a storage medium storing a control program for a shooting module. When the control program for the shooting module is executed by a processor, the relevant steps of any embodiment of the above-mentioned method for controlling a shooting module are implemented.

[0101] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0102] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.

[0103] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, or optical disk) as described above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, television, or network device, etc.) to execute the methods of various embodiments of the present invention.

[0104] The above description is only a preferred embodiment of the present invention and does not limit the patent scope of the present invention. All equivalent structural transformations made by using the contents of the present invention description and drawings under the inventive concept of the present invention, or direct / indirect application in other related technical fields are included in the patent protection scope of the present invention.

Claims

1. A method for controlling a shooting module, characterized in that: Applied to a head mounted display device, the control method of the shooting module comprises the following steps: Acquire a first time when a display module of the head mounted display device refreshes an image frame and a second time when the shooting module outputs an image frame; determining a frame rate adjustment parameter according to the first time and the second time; The shooting module is controlled to adjust the frame rate according to the frame rate adjustment parameter.

2. The control method of the camera module according to claim 1, characterized in that: The step of determining the frame rate adjustment parameter according to the first time and the second time comprises: When the second time is later than the first time, determining the frame rate adjustment parameter includes increasing the frame rate; When the second time is earlier than the first time, determining the frame rate adjustment parameter includes reducing the frame rate.

3. The control method of the camera module according to claim 2, characterized in that: The step of determining the frame rate adjustment parameter according to the first time and the second time comprises: determining a time difference between the second time and the first time; Determining a frame rate adjustment amplitude according to the time difference; When the second time is later than the first time, determining the frame rate adjustment parameter includes increasing the frame rate by the frame rate adjustment amplitude; When the second time is earlier than the first time, determining the frame rate adjustment parameter includes reducing the frame rate by the frame rate adjustment magnitude.

4. The control method of the camera module according to claim 3, characterized in that: The shooting module includes a first camera and a second camera, and the step of determining the frame rate adjustment amplitude according to the time difference includes: Obtaining a display mode of the head mounted display device; Acquire a target corresponding relationship between the time difference and the frame rate adjustment amplitude according to the display mode; The frame rate adjustment amplitude corresponding to the time difference is determined according to the target corresponding relationship.

5. The control method of the camera module according to claim 1, characterized in that: The shooting module includes a first camera and a second camera, and the step of controlling the shooting module to adjust the frame rate according to the frame rate adjustment parameter includes: The first camera and the second camera are controlled to adjust the frame rates according to the frame rate adjustment parameter.

6. The control method of the camera module according to claim 5, characterized in that: The step of controlling the first camera and the second camera to adjust the frame rate using the frame rate adjustment parameter comprises: Controlling the first camera to adjust the frame rate according to the frame rate adjustment parameter; Controlling the second camera to adjust the frame rate according to the frame rate adjustment parameter and a hardware synchronization signal between the first camera and the second camera; The hardware synchronization signal is sent from the first camera to the second camera.

7. The control method of the shooting module according to any one of claims 1 to 6, characterized in that: The step of obtaining the first time when the display module of the head mounted display device refreshes the image frame comprises: Acquire a vertical synchronization signal of the display module; The first time is determined according to the vertical synchronization signal.

8. The control method of the shooting module according to any one of claims 1 to 6, characterized in that: The step of controlling the shooting module to adjust the frame rate according to the frame rate adjustment parameter comprises: The working timing of the shooting module is adjusted according to the frame rate adjustment parameter through the I2C interface of the shooting module.

9. A head mounted display device, characterized in that: The head mounted display device comprises: Shooting module; A control device, the shooting module is connected to the control device, the control device comprises: a memory, a processor and a control program of the shooting module stored in the memory and executable on the processor, the control program of the shooting module, when executed by the processor, implements the steps of the control method of the shooting module as described in any one of claims 1 to 8.

10. A storage medium, characterized in that: The storage medium stores a control program of the shooting module, and when the control program of the shooting module is executed by the processor, the steps of the control method of the shooting module according to any one of claims 1 to 8 are implemented.

Images