Head-mounted device and image display method and device thereof

Abstract

The invention discloses an image display method of a head-mounted device, which is applied to the head-mounted device provided with an auxiliary camera, and comprises the following steps: acquiring position information and distance information of a user concern point; determining a current focal length based on the distance information; controlling the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length; displaying the image information at the focus point; therefore, objects with different distances can be clearly displayed through the auxiliary camera with the corresponding focal length according to the focus point change of the user, and the use experience of the user is improved. The embodiment of the invention also provides a head-mounted device and an image display device thereof, which have the same beneficial effects.

Description

Technical Field

[0001] The embodiments of the present invention relate to the technical field of head-mounted devices, and in particular to a head-mounted device and an image display method and device thereof. Background Art

[0002] At present, VR or MR devices on the market are equipped with RGB cameras for displaying the external environment, but they are limited to single-focus display, that is, the focal length of the RGB camera is fixed, and objects at different distances cannot be displayed clearly, resulting in unclear or unrealistic display of the external environment, affecting the user experience.

[0003] In view of this, how to provide a head mounted device and an image display method and apparatus thereof that can clearly display objects at different distances. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide a head mounted device and an image display method and device thereof, which can clearly display objects at different distances during use, thereby improving the user experience.

[0005] In order to solve the above technical problems, an embodiment of the present invention provides an image display method of a head mounted device, which is applied to a head mounted device provided with an auxiliary camera, comprising:

[0006] Get the location information and distance information of the user's focus point;

[0007] Determine a current focal length based on the distance information;

[0008] Controlling the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length;

[0009] The image information at the focus point is displayed.

[0010] Optionally, before obtaining the location information of the user's focus point, the method further includes:

[0011] Tracking the left eye and the right eye of the user by an eye tracking camera to obtain the focus point information of the left eye and the focus point information of the right eye;

[0012] Based on the focus point information of the left eyeball and the focus point information of the right eyeball, determine whether the focus points of the left eyeball and the right eyeball are consistent. If they are consistent, execute the step of obtaining the position information of the focus point.

[0013] Optionally, the auxiliary camera is a plurality of auxiliary cameras with different focal lengths;

[0014] The controlling the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length includes:

[0015] Selecting a target auxiliary camera with a focal length of the current focal length from a plurality of auxiliary cameras with different focal lengths;

[0016] The target auxiliary camera is controlled to face the focus point based on the position information, and image information at the focus point is collected.

[0017] Optionally, the auxiliary camera is a focus-adjustable camera;

[0018] The controlling the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length includes:

[0019] Adjusting the focal length of the adjustable focus camera to the current focal length;

[0020] The direction of the adjustable-focus camera toward the point of interest is controlled based on the position information, and image information at the point of interest is collected.

[0021] Optionally, also include:

[0022] Using the wide-angle camera in the head-mounted device to acquire an image of the external environment within the field of view;

[0023] Replacing the image at the corresponding position in the external environment image with the image information at the focus point to obtain a superimposed image;

[0024] The superimposed image is displayed.

[0025] Optionally, displaying the superimposed image includes:

[0026] Amplifying the superimposed image based on a preset amplification factor;

[0027] The enlarged superimposed image is displayed.

[0028] An embodiment of the present invention further provides an image display device for a head mounted device, which is applied to a head mounted device provided with an auxiliary camera, comprising:

[0029] An acquisition module is used to obtain the location information and distance information of the user's focus point;

[0030] A calculation module, used to determine the current focal length based on the distance information;

[0031] A control module, configured to control the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length;

[0032] The display module is used to display the image information at the focus point.

[0033] An embodiment of the present invention further provides a head mounted device, comprising: a controller, a processor, an auxiliary camera, a tracking camera, a rangefinder and a display, wherein:

[0034] The tracking camera is used to obtain the focus point information of the user's eyes;

[0035] The processor is used to obtain the position information of the focus point based on the focus point information; and is used to determine the current focal length based on the distance information obtained by the rangefinder;

[0036] The rangefinder is used to obtain the distance information of the point of interest based on the position information;

[0037] The controller is used to control the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length;

[0038] The display is used to display the image information at the focus point.

[0039] Optionally, the tracking camera includes a left eye tracking camera and a right eye tracking camera;

[0040] The left eye tracking camera is used to track the user's left eye and obtain the focus point information of the left eye;

[0041] The right eye tracking camera is used to track the user's right eye to obtain the focus point information in front of the user;

[0042] The processor is used to obtain the position information of the corresponding focus point when the focus point information of the left eyeball and the focus point information of the right eyeball are consistent.

[0043] Optionally, the auxiliary camera is a plurality of auxiliary cameras with different focal lengths;

[0044] The controller is used to select a target auxiliary camera with a focal length of the current focal length from a plurality of auxiliary cameras with different focal lengths, control the direction of the target auxiliary camera toward the focus point based on the position information, and collect image information at the focus point.

[0045] Optionally, the auxiliary camera is a focus-adjustable camera;

[0046] The controller is used to adjust the focal length of the adjustable-focus camera to the current focal length, control the direction of the adjustable-focus camera toward the focus point based on the position information, and collect image information at the focus point.

[0047] Optionally, the processor is also used to replace the image at the corresponding position in the external environment image with the image information at the focus point, obtain a superimposed image, and send the superimposed image to the display for display; wherein, the external environment image is obtained through the wide-angle camera in the head-mounted device.

[0048] Optionally, a movable platform is further included, and the auxiliary camera and the rangefinder are both arranged on the movable platform.

[0049] An embodiment of the present invention also provides an image display method for a head-mounted device, which is applied to a head-mounted device equipped with an auxiliary camera, including: obtaining position information and distance information of a user's focus point; determining a current focal length based on the distance information; controlling the auxiliary camera to collect image information at the focus point corresponding to the position information with the current focal length; and displaying the image information at the focus point.

[0050] It can be seen that the head-mounted device in the embodiment of the present invention is provided with an auxiliary camera, and the focal length of the auxiliary camera is optional. When the user uses the head-mounted device, the position information and distance information of the user's focus point can be obtained, and then the current focal length is further determined according to the distance information, and the auxiliary camera is controlled to collect image information at the focus point corresponding to the position information with the current focal length, and the image information at the focus point is displayed, so that objects at different distances can be clearly displayed through the auxiliary camera with the corresponding focal length according to the change of the user's focus point, thereby improving the user experience.

[0051] The embodiment of the present invention also provides a head mounted device and an image display device thereof, which have the same beneficial effects as above. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the prior art and the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0053] Figure 1 A schematic diagram of a flow chart of an image display method for a head mounted device provided by an embodiment of the present invention;

[0054] Figure 2 A schematic diagram of a superimposed image provided by an embodiment of the present invention;

[0055] Figure 3 A schematic structural diagram of an image display device for a head mounted device provided by an embodiment of the present invention;

[0056] Figure 4 A schematic diagram of the structure of a head mounted device provided by an embodiment of the present invention;

[0057] Figure 5 A schematic diagram of the structure of another head-mounted device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0058] The embodiments of the present invention provide a head mounted device and an image display method and device thereof, which can clearly display objects at different distances during use, thereby improving the user experience.

[0059] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0060] Please refer to Figure 1 , Figure 1 A flowchart of an image display method for a head-mounted device provided in an embodiment of the present invention. The image display method for a head-mounted device is applied to a head-mounted device provided with an auxiliary camera, and includes:

[0061] S110: Obtaining location information and distance information of the user's focus point;

[0062] It should be noted that the head-mounted device in the embodiment of the present invention is provided with an auxiliary camera, the focal length of the auxiliary camera is optional, and when the user uses the head-mounted device, the position information and distance information of the user's focus point can be obtained, wherein the user's focus point refers to the focus point of the user's eyes, that is, the position information and distance information of the user's eye focus point are obtained, wherein the distance information can be obtained by a rangefinder set on the head-mounted device, such as a laser rangefinder.

[0063] S120: Determine the current focal length based on the distance information;

[0064] Specifically, the current focal length corresponding to the distance information can be calculated based on the distance information, that is, the auxiliary camera is required to obtain image information at the focus point with a focal length corresponding to the current focal length in order to obtain a cleaned image.

[0065] S130: Control the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length;

[0066] It can be understood that after determining the current focal length, the auxiliary camera is controlled according to the current focal length to capture the image at the focus point with the corresponding focal length to obtain the corresponding image information. Of course, before image capture, it is necessary to adjust the auxiliary camera to the direction corresponding to the position information according to the position information of the focus point, and then capture the image information at the focus point.

[0067] S140: Displaying image information at the focus point.

[0068] Specifically, after the image information at the focus point is obtained, the image information is displayed so that the user can clearly see the picture at the focus point that the user pays attention to.

[0069] Furthermore, before obtaining the location information of the user's focus point in S110, the method may further include:

[0070] Track the user's left eye and right eye through an eye tracking camera to obtain the focus point information of the left eye and the right eye;

[0071] Based on the focus point information of the left eyeball and the focus point information of the right eyeball, determine whether the focus points of the left eyeball and the right eyeball are consistent. If they are consistent, execute the step of obtaining the position information of the focus point.

[0072] It should be noted that the head-mounted device in the embodiment of the present invention is provided with an eye tracking camera, and the eye tracking camera can be used to track the left eye and the right eye of the user. Specifically, the left eye of the user can be tracked by the left eye tracking camera to obtain the left eye's focus information, and the right eye of the user can be tracked by the right eye tracking camera to obtain the right eye's focus information. Then, in order to determine whether the user is paying attention to or looking at a certain direction, the left eye's focus information and the right eye's focus information can be compared to further determine whether the left eye's focus and the right eye's focus are consistent. If the left eye's focus and the right eye's focus are consistent, it means that the user is paying attention to or looking at a certain direction. At this time, the position information of the user's eye's focus can be further obtained based on the left eye's focus information and the right eye's focus information.

[0073] Furthermore, the auxiliary camera in the embodiment of the present invention is a plurality of auxiliary cameras with different focal lengths;

[0074] Then, the process of controlling the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length in the above S130 may specifically include:

[0075] Selecting an auxiliary camera with a focal length of a current focal length target from a plurality of auxiliary cameras with different focal lengths;

[0076] The target auxiliary camera is controlled to face the focus point based on the position information, and the image information at the focus point is collected.

[0077] It should be noted that, a plurality of auxiliary cameras with different focal lengths can be pre-set on the head-mounted device in the embodiment of the present invention. Then, after determining the current focal length, the corresponding target auxiliary camera can be matched from each auxiliary camera according to the focal length of each auxiliary camera. Specifically, when the focal lengths of each auxiliary camera are inconsistent with the current focal length, the auxiliary camera with a focal length closest to the current focal length can be selected from each auxiliary camera as the target camera. Then, the target auxiliary camera can be controlled to face the focus point according to the position information of the focus point, and the image information at the focus point can be collected with the corresponding focal length to obtain a clear image.

[0078] Furthermore, the auxiliary camera in the embodiment of the present invention is a focus-adjustable camera;

[0079] Then, the process of controlling the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length in the above S130 may specifically include:

[0080] Adjust the focus of the adjustable focus camera to the current focus;

[0081] The focusable camera is controlled to face the focus point based on the position information, and image information at the focus point is collected.

[0082] It should be noted that an adjustable-focus camera can be preset on the head-mounted device in the embodiment of the present invention, that is, the focal length of the camera is adjustable. After determining the current focal length, the focal length of the adjustable-focus camera can be adjusted according to the current focal length, so that the focal length of the adjusted camera is consistent with the current focal length, and then the direction of the adjustable-focus camera toward the focus point is controlled according to the position information of the focus point, and the image information at the focus point is collected with the corresponding focal length to obtain a clear image.

[0083] Furthermore, the method may also include:

[0084] Use the wide-angle camera in the head-mounted device to obtain images of the external environment within the field of view;

[0085] The image at the corresponding position in the external environment image is replaced with the image information at the focus point to obtain a superimposed image;

[0086] The overlay image is displayed.

[0087] It should be noted that in actual applications, in order to improve the user experience, the image at the focus point position can be clearly displayed on the background image within the user's field of view. In the embodiment of the present invention, a basic external environment image is obtained through a wide-angle camera in the head-mounted device, and the external environment image is used as the background. The image at the position corresponding to the focus point in the external environment image is replaced with the above-mentioned clear image information collected (which can also be called the focus image), thereby obtaining a superimposed image, and then displaying the superimposed image, so that the user can clearly see the picture at the focus point on the basis of seeing the entire background image, and the head-mounted device provided by the embodiment of the present invention can clearly display the picture at the focus point in real time according to the change of the user's focus point, wherein the superimposed image after superposition is as follows: Figure 2 As shown, the light gray area is the image taken by the wide-angle camera (background image), the dark gray area is the image taken by the auxiliary camera (focus image), and the dark gray area is the gaze direction of the human eye.

[0088] The field of view of the wide-angle camera in the embodiment of the present invention can be greater than or equal to the field of view of the human eye (for example, 124 degrees) to achieve the purpose of eliminating blind spots in the field of view.

[0089] Of course, the magnification factor may be predetermined according to actual needs, and when the superimposed image is displayed, the superimposed image is magnified by the preset magnification factor, and then the magnified superimposed image is displayed to better meet user needs.

[0090] It can be seen that the head-mounted device in the embodiment of the present invention is provided with an auxiliary camera, and the focal length of the auxiliary camera is optional. When the user uses the head-mounted device, the position information and distance information of the user's focus point can be obtained, and then the current focal length is further determined according to the distance information, and the auxiliary camera is controlled to collect image information at the focus point corresponding to the position information with the current focal length, and the image information at the focus point is displayed, so that objects at different distances can be clearly displayed through the auxiliary camera with the corresponding focal length according to the change of the user's focus point, thereby improving the user experience.

[0091] Based on the above embodiments, the present invention also provides an image display device for a head-mounted device, which is applied to a head-mounted device with an auxiliary camera. Figure 3 , the device comprises:

[0092] An acquisition module 11 is used to acquire the location information and distance information of the user's focus point;

[0093] A calculation module 12, used to determine the current focal length based on the distance information;

[0094] A control module 13, used to control the auxiliary camera to collect image information at a focus point corresponding to the position information at a current focal length;

[0095] The display module 14 is used to display the image information at the focus point.

[0096] It should be noted that the image display device of the head-mounted device provided in the embodiment of the present invention has the same beneficial effects as the image display method of the head-mounted device provided in the above embodiment, and for the specific introduction of the image display method of the head-mounted device involved in the embodiment of the present invention, please refer to the above embodiment, and the present invention will not be repeated here.

[0097] Based on the above embodiments, the present invention further provides a head mounted device. Figure 4 The head mounted device includes: a controller 1, a processor 2, an auxiliary camera 3, a tracking camera 4, a rangefinder 5 and a display 6, wherein:

[0098] Tracking camera 4, used to obtain the focus point information of the user's eyes;

[0099] Processor 2, used for obtaining the position information of the focus point based on the focus point information; used for determining the current focal length based on the distance information obtained by the rangefinder 5;

[0100] A rangefinder 5, used to obtain distance information of a point of interest based on the position information;

[0101] Controller 1, used to control the auxiliary camera to collect image information at a focus point corresponding to the position information at a current focal length;

[0102] The display 6 is used to display the image information at the focus point.

[0103] It should be noted that in actual applications, the head-mounted device is provided with a controller 1, a processor 2, an auxiliary camera 3, a tracking camera 4, a rangefinder 5 and a display 6, as well as a wide-angle camera 7. The tracking camera 4 can obtain the focus point information of the user's eyeball, and send the focus point information to the processor 2. The processor 2 obtains the position information of the focus point based on the focus point information, and sends the position information to the rangefinder 5. The rangefinder 5 obtains the distance information from itself to the focus point based on the position information, and then sends the distance information to the processor 2. The processor 2 calculates the corresponding current focal length based on the distance information. The controller 1 adjusts the auxiliary camera to the corresponding direction according to the position information of the focus point, and controls the auxiliary camera to capture images at the focus point with the corresponding focal length according to the current focal length, obtains the corresponding image information, and sends the image information to the display 6 for display.

[0104] For further information, please refer to Figure 5 , the real-time tracking camera 4 of the present invention includes a left eye tracking camera 41 and a right eye tracking camera 42;

[0105] The left eye tracking camera 41 is used to track the left eye of the user and obtain the focus point information of the left eye;

[0106] The right eye tracking camera 42 is used to track the user's right eye and obtain information about the focus point in front of the user;

[0107] Processor 2 is used to obtain the position information of the corresponding focus point when the focus point information of the left eyeball and the focus point information of the right eyeball are consistent.

[0108] It should be noted that, in the embodiment of the present invention, the left eye of the user can be tracked by the left eye tracking camera 41 to obtain the focus point information of the left eye, and the right eye of the user can be tracked by the right eye tracking camera 42 to obtain the focus point information of the right eye, and then the focus point information of the left eye and the focus point information of the right eye are sent to the processor 2, specifically, they can be sent to the eye information processing unit 21 in the processor 2, and the eye information processing unit 21 compares the focus point information of the left eye with the focus point information of the right eye to further determine whether the focus point of the left eye is consistent with the focus point of the right eye, and when the focus point of the left eye is consistent with the focus point of the right eye, it means that the user is paying attention to or looking at a certain direction, and at this time, the position information of the focus point of the user's eye can be further obtained based on the focus point information of the left eye and the focus point information of the right eye.

[0109] Furthermore, the auxiliary camera 3 may be a plurality of auxiliary cameras with different focal lengths;

[0110] The controller 1 is used to select a target auxiliary camera with a current focal length from a plurality of auxiliary cameras with different focal lengths, control the direction of the target auxiliary camera toward a focus point based on position information, and collect image information at the focus point.

[0111] It should be noted that the head mounted device in the embodiment of the present invention may be pre-set with multiple auxiliary cameras with different focal lengths (such as Figure 5 Then, after determining the current focal length, the controller 1 (e.g. Figure 5The selection control unit in the control unit can match the corresponding target auxiliary camera from each auxiliary camera according to the focal length of each auxiliary camera. Specifically, when the focal length of each auxiliary camera is inconsistent with the current focal length, the auxiliary camera with a focal length closest to the current focal length can be selected from the auxiliary cameras as the target camera, and then the target auxiliary camera is controlled to face the focus point according to the position information of the focus point, and the image information at the focus point is collected with the corresponding focal length to obtain a clear image.

[0112] Furthermore, the auxiliary camera 3 may be a focus-adjustable camera;

[0113] The controller 1 is used to adjust the focal length of the adjustable-focus camera to the current focal length, control the direction of the adjustable-focus camera toward the focus point based on the position information, and collect image information at the focus point.

[0114] It should be noted that an adjustable-focus camera can be preset on the head-mounted device in the embodiment of the present invention, that is, the focal length of the camera is adjustable. After determining the current focal length, the focal length of the adjustable-focus camera can be adjusted according to the current focal length, so that the focal length of the adjusted camera is consistent with the current focal length, and then the direction of the adjustable-focus camera toward the focus point is controlled according to the position information of the focus point, and the image information at the focus point is collected with the corresponding focal length to obtain a clear image.

[0115] Furthermore, processor 2 is also used to replace the image at the corresponding position in the external environment image with the image information at the focus point, obtain a superimposed image, and send the superimposed image to the display for display; wherein, the external environment image is obtained through the wide-angle camera in the head-mounted device.

[0116] It can be understood that in actual applications, in order to improve the user experience, the image at the focus point position can be clearly displayed on the background image within the user's field of view. In the embodiment of the present invention, the wide-angle camera 7 in the head-mounted device obtains a basic external environment image, and the external environment image is used as the background. The wide-angle camera 7 sends the external environment image to the processor 2, specifically to the image processing unit 32 in the processor 2. The auxiliary camera 3 can also send the acquired image information at the focus point to the image processing unit 32. The image processing unit 32 replaces the image at the position corresponding to the focus point in the external environment image with the above-mentioned clear image information collected, thereby obtaining a superimposed image, and then sends the superimposed image to the display unit 61 in the display 6 for display, so that the user can clearly see the picture at the focus point on the basis of seeing the entire background image, and the head-mounted device provided by the embodiment of the present invention can clearly display the picture at the focus point in real time according to the change of the user's focus point, so as to better meet the user's needs.

[0117] It should also be noted that, in actual applications, the head mounted device in the embodiment of the present invention may further include a movable platform 8, and the auxiliary camera and the rangefinder are both arranged on the movable platform.

[0118] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0119] It should also be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0120] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for displaying an image of a head mounted device, characterized in that: Applicable to head-mounted devices with auxiliary cameras, including: Get the location information and distance information of the user's focus point; Determine a current focal length based on the distance information; Controlling the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length; The image information at the focus point is displayed.

2. The image display method of the head mounted device according to claim 1, characterized in that: Before obtaining the location information of the user's focus point, the method further includes: Tracking the left eye and the right eye of the user by an eye tracking camera to obtain the focus point information of the left eye and the focus point information of the right eye; Based on the focus point information of the left eyeball and the focus point information of the right eyeball, determine whether the focus points of the left eyeball and the right eyeball are consistent. If they are consistent, execute the step of obtaining the position information of the focus point.

3. The image display method of the head mounted device according to claim 1, characterized in that: The auxiliary cameras are multiple auxiliary cameras with different focal lengths; The controlling the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length includes: Based on the current focal length, selecting a target auxiliary camera with a focal length of the current focal length from a plurality of auxiliary cameras with different focal lengths; The target auxiliary camera is controlled to face the focus point based on the position information, and image information at the focus point is collected.

4. The image display method of the head mounted device according to claim 1, characterized in that: The auxiliary camera is a focus-adjustable camera; The controlling the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length includes: Adjusting the focal length of the adjustable focus camera to the current focal length; The direction of the adjustable-focus camera toward the point of interest is controlled based on the position information, and image information at the point of interest is collected.

5. The image display method of the head mounted device according to claim 1, characterized in that: Also includes: Using the wide-angle camera in the head-mounted device to acquire an image of the external environment within the field of view; Replacing the image at the corresponding position in the external environment image with the image information at the focus point to obtain a superimposed image; The superimposed image is displayed.

6. The image display method of the head mounted device according to claim 5, characterized in that: The displaying of the superimposed image comprises: Amplifying the superimposed image based on a preset amplification factor; The enlarged superimposed image is displayed.

7. An image display device for a head mounted device, characterized in that: Applicable to head-mounted devices with auxiliary cameras, including: An acquisition module is used to obtain the location information and distance information of the user's focus point; A calculation module, used to determine the current focal length based on the distance information; A control module, configured to control the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length; The display module is used to display the image information at the focus point.

8. A head mounted device, characterized in that: include: A controller, a processor, an auxiliary camera, a tracking camera, a rangefinder, and a display, wherein: The tracking camera is used to obtain the focus point information of the user's eyes; The processor is used to obtain the position information of the focus point based on the focus point information; and is used to determine the current focal length based on the distance information obtained by the rangefinder; The rangefinder is used to obtain the distance information of the point of interest based on the position information; The controller is used to control the auxiliary camera to collect image information at the focus point corresponding to the position information at the current focal length; The display is used to display the image information at the focus point.

9. The head mounted device according to claim 8, characterized in that: The tracking camera includes a left eye tracking camera and a right eye tracking camera; The left eye tracking camera is used to track the left eye of the user and obtain the focus point information of the left eye; The right eye tracking camera is used to track the user's right eye to obtain the focus point information in front of the user; The processor is used to obtain the position information of the corresponding focus point when the focus point information of the left eyeball and the focus point information of the right eyeball are consistent.

10. The head mounted device according to claim 8, characterized in that: The auxiliary camera is a plurality of auxiliary cameras with different focal lengths; The controller is used to select a target auxiliary camera with a focal length of the current focal length from a plurality of auxiliary cameras with different focal lengths, control the direction of the target auxiliary camera toward the focus point based on the position information, and collect image information at the focus point.

11. The head mounted device according to claim 8, characterized in that: The auxiliary camera is a focus-adjustable camera; The controller is used to adjust the focal length of the adjustable-focus camera to the current focal length, control the direction of the adjustable-focus camera toward the focus point based on the position information, and collect image information at the focus point.

12. The head mounted device according to any one of claims 8 to 11, characterized in that: The processor is also used to replace the image at the corresponding position in the external environment image with the image information at the focus point to obtain a superimposed image, and send the superimposed image to the display for display; wherein, the external environment image is obtained through the wide-angle camera in the head-mounted device.

13. The head mounted device according to claim 12, characterized in that: It also includes a movable platform, and the auxiliary camera and the rangefinder are both arranged on the movable platform.

Images