Augmented reality device picture display method, device, and computer readable storage medium

Abstract

The application discloses an augmented reality device picture display method, device and computer readable storage medium, and belongs to the technical field of optical testing. The method comprises the following steps: acquiring at least two to-be-displayed pictures corresponding to a target picture frame, wherein the focal lengths of the to-be-displayed pictures are different; and in a display period of the target picture frame, the to-be-displayed pictures are displayed in turn and circularly. By means of flexibly adjusting the focal length, it is ensured that the target picture frame and a real scene are always in the same focal plane, and the comfort degree of wearing the augmented reality device is improved.

Description

Technical Field

[0001] The present invention relates to the field of optical testing technology, and in particular to an augmented reality device screen display method, device, and computer-readable storage medium. Background Art

[0002] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. It uses technical means to simulate computer-generated virtual information such as text, images, and videos, and then applies them to the real world. The two types of information complement each other, thereby achieving "enhancement" of the real world.

[0003] In related technologies, the image capture device of an augmented reality device is fixed in position, so the distance between the lens in the image capture device and the display chip is fixed, that is, the focal length is fixed. However, objects in the real world are arranged from far to near. When a person observes a nearby object, the augmented reality device displays a virtual image of something far away. The superposition of the near and far objects requires the human eye to constantly adjust its focus, which can easily cause dizziness.

[0004] The above content is only used to assist in understanding the technical solution of the present invention and does not constitute an admission that the above content is prior art. Summary of the Invention

[0005] The main purpose of the present invention is to provide an augmented reality device screen display method, device and computer-readable storage medium, aiming to solve the technical problem that existing augmented reality devices easily cause people to feel dizzy.

[0006] To achieve the above object, the present invention provides a method for displaying an augmented reality device screen, the method comprising the following steps:

[0007] Obtaining a target picture frame corresponding to at least two to-be-displayed pictures, wherein the to-be-displayed pictures have different focal lengths when captured;

[0008] During the display period of the target picture frame, the pictures to be displayed are displayed in sequence and in a cycle.

[0009] Optionally, the to-be-displayed pictures include a distant picture, a mid-range picture, and a close-up picture, and the step of acquiring target picture frames corresponding to at least two to-be-displayed pictures includes:

[0010] Determining focal lengths corresponding to the distant view, the mid-range view, and the near view, wherein the focal lengths corresponding to the distant view, the mid-range view, and the near view increase in sequence;

[0011] The back focus of the image acquisition device is adjusted according to the focal length, so as to sequentially acquire the distant view, the mid-range view, and the near view based on different focal lengths.

[0012] Optionally, the step of cyclically displaying the to-be-displayed pictures in sequence within the display period of the target picture frame includes:

[0013] During the display period of the target frame, the distant view, the middle view and the near view are displayed in sequence according to their acquisition order.

[0014] Optionally, the step of determining the focal lengths corresponding to the distant view, the medium view, and the close view, wherein the focal lengths corresponding to the distant view, the medium view, and the close view are increased in sequence, comprises:

[0015] Obtaining an image acquisition device type of the augmented reality device, and virtual image distances corresponding to the distant view, the middle view, and the near view, wherein the virtual image distances corresponding to the distant view, the middle view, and the near view decrease in sequence;

[0016] The focal lengths corresponding to the distant view, the middle view, and the near view are determined according to the type of the image acquisition device and the virtual image distance, wherein the focal lengths corresponding to the distant view, the middle view, and the near view increase in sequence.

[0017] Optionally, the step of acquiring at least two to-be-displayed images corresponding to the target image frame is performed synchronously with the step of cyclically displaying the to-be-displayed images in sequence within a display period of the target image frame.

[0018] Optionally, after the step of cyclically displaying the to-be-displayed pictures in sequence within the display period of the target picture frame, the method further comprises:

[0019] If it is detected that the picture to be displayed does not match the real scene, the step of obtaining the target picture frame corresponding to at least two pictures to be displayed is repeated, wherein the focal lengths of the pictures to be displayed are different when they are captured, and the pictures to be displayed are displayed in sequence in a cyclic manner within the display period of the target picture frame.

[0020] Optionally, the step of acquiring at least two to-be-displayed pictures corresponding to the target picture frame includes:

[0021] The position of the display chip is cyclically adjusted through a high-frequency vibration motor, with each position having a different focal length;

[0022] When the display chip is in at least two different positions, the to-be-displayed pictures corresponding to the target picture frame are respectively captured.

[0023] Optionally, the vibration frequency of the high-frequency vibration motor is greater than a frequency perceptible to a user.

[0024] In addition, to achieve the above-mentioned purpose, the present invention also provides an augmented reality device, which includes: a memory, a processor, and a screen display program stored in the memory and runnable on the processor, and the screen display program is configured to implement the steps of the augmented reality device screen display method.

[0025] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, on which a screen display program is stored. When the screen display program is executed by a processor, the steps of the augmented reality device screen display method are implemented.

[0026] In a technical solution provided by the present invention, the process of capturing a target image frame is subdivided into obtaining at least two to-be-displayed images corresponding to the target image frame, wherein the to-be-displayed images have different focal lengths when captured, and then projecting the corresponding to-be-displayed images at each focal length during the display period of the target image frame, repeating the process to achieve cyclic display of multiple to-be-displayed images. From the user's perspective, since the human eye cannot perceive the frequency of image switching, the overall perception is that the target image frame is fully displayed. Moreover, regardless of whether the user is looking far or near, the image projected by the augmented reality device clearly matches the real scene in front of them. Therefore, the human eye does not need to continuously adjust the focus, and thus does not experience any dizziness, thereby improving the wearing comfort of the augmented reality device. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 This is a flow chart of a first embodiment of a method for displaying an image on an augmented reality device according to the present invention;

[0028] Figure 2 This is a flow chart of a second embodiment of the method for displaying an image on an augmented reality device according to the present invention;

[0029] Figure 3 This is a flowchart of a third embodiment of the method for displaying an image on an augmented reality device according to the present invention;

[0030] Figure 4 Schematic diagram of the first lens assembly in the third embodiment of the method for displaying images on an augmented reality device according to the present invention;

[0031] Figure 5 This is a mapping relationship diagram of the virtual image distance and focal length corresponding to the first lens group in the third embodiment of the method for displaying an image of an augmented reality device according to the present invention;

[0032] Figure 6 Schematic diagram of the second lens assembly in the third embodiment of the method for displaying images on an augmented reality device according to the present invention;

[0033] Figure 7This is a mapping relationship diagram of the virtual image distance and focal length corresponding to the second lens group in the third embodiment of the method for displaying an image of an augmented reality device according to the present invention;

[0034] Figure 8 Schematic diagram of the third lens assembly in the third embodiment of the method for displaying images on an augmented reality device according to the present invention;

[0035] Figure 9 This is a mapping relationship diagram of the virtual image distance and focal length corresponding to the third lens group in the third embodiment of the method for displaying an image of an augmented reality device according to the present invention;

[0036] Figure 10 This is a flowchart of a fifth embodiment of the method for displaying an image on an augmented reality device according to the present invention;

[0037] Figure 11 This is a flow chart of a sixth embodiment of the method for displaying an image on an augmented reality device according to the present invention;

[0038] Figure 12 This is a schematic diagram of the structure of an augmented reality device in the hardware operating environment involved in an embodiment of the present invention.

[0039] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0040] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0041] In the prior art, the image acquisition device of the augmented reality device is fixed in position, so its back focus is fixed. Correspondingly, the focal length and virtual image distance of the virtual image generated based on the back focus are also fixed, that is, the picture displayed by the augmented reality device can only be at a certain fixed distance.

[0042] In real-world scenarios, people, trees, and mountains are scattered at all distances. Assuming the focal length of AR glasses is fixed at 15 meters, when the user observes a tree 15 meters away, the virtual image of the tree and the virtual image projected by the AR glasses are both clear because the virtual image and the real object are in the same focal plane. However, when the user observes a person 3 meters away, although the real object is clear, the virtual image projected by the AR glasses is blurry. In this case, the human eye needs to constantly adjust the focal length so that both the observed real object and the projected virtual image are clear. This cycle repeats, which can easily cause dizziness.

[0043] In response to the defect of the above-mentioned existing devices that easily cause people to feel dizzy, the present invention collects at least two to-be-displayed images corresponding to the target image frame based on different focal lengths, and then cyclically displays the corresponding to-be-displayed images in sequence during the display period of the target image frame. The present invention flexibly adjusts the focal length to ensure that the real object and the virtual image always remain clear and effectively matched regardless of whether the user is looking far or close, so as to achieve the effect of combining the real and the virtual, and improve the wearing comfort of the augmented reality device.

[0044] To better understand the above technical solutions, exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments described herein. Instead, these embodiments are provided to enable a more thorough understanding of the present application and to fully convey the scope of the present application to those skilled in the art.

[0045] The embodiment of the present invention provides a method for displaying an augmented reality device screen, referring to Figure 1 , Figure 1 This is a flow chart of a first embodiment of a method for displaying an image on an augmented reality device according to the present invention.

[0046] In this embodiment, the augmented reality device screen display method includes:

[0047] Step S11: acquiring a target image frame corresponding to at least two to-be-displayed images, wherein the to-be-displayed images have different focal lengths when captured;

[0048] It is understandable that the working principle of augmented reality devices is to first collect data of the real scene through cameras and sensors, and transmit it to the processor for analysis and reconstruction. Then, the data from the tracking device is combined to analyze the relative position of the virtual image and the real scene, realize the alignment of the coordinate system and perform fusion calculations of the virtual scene.

[0049] Specifically for this solution, there are two approaches:

[0050] In the first method, after the image acquisition device captures a frame to be displayed, the image display device immediately displays the frame to be displayed. For example, at a first focal length, after the image acquisition device captures the first frame to be displayed, the image display device displays the first frame to be displayed; then, at a second focal length, after the image acquisition device captures the second frame to be displayed, the image display device displays the second frame to be displayed; and finally, at a third focal length, after the image acquisition device captures the third frame to be displayed, the image display device displays the third frame to be displayed. In this case, the image formed by integrating the first, second, and third frames to be displayed is defined as the target video frame.

[0051] The second method is that after the image acquisition device acquires several images to be displayed, the image display device displays them in the acquisition order. For example, at the first focal length, the image acquisition device acquires the first image to be displayed, then at the second focal length, the image acquisition device acquires the second image to be displayed, and finally at the third focal length, the image acquisition device acquires the third image to be displayed. After completing the aforementioned image acquisition work, the image display stage is entered. It can be understood that the time axis of the image display is divided into multiple time sequences, and each time sequence plays a picture to be displayed. Specifically, in the first time sequence, the image display device displays the first picture to be displayed at the first focal length, the second time sequence, the image display device displays the second picture to be displayed at the second focal length, and the third time sequence, the image display device displays the third picture to be displayed at the third focal length. After completing one round of display, the display can be restarted from the first focal length, that is, the fourth time sequence, the image display device displays the first picture to be displayed at the first focal length. And so on, to achieve loop playback. The specific number of rounds is not specifically limited in this embodiment. In this case, a first timing, a second timing, and a third timing are defined, and the picture displayed by the image display device is the target video frame.

[0052] Optionally, in order to ensure that any picture in the generated target picture frame can be clearly matched with the real scene in front of the eyes, based on focal length considerations, acquisition rules are pre-set to classify and acquire picture contents with different focal lengths in the target picture frame, and the classified and acquired pictures are determined as different pictures to be displayed. The type of picture to be displayed can be set by technical personnel based on factors such as device model, user group, display scene, etc., such as long-range picture, medium-range picture, close-up picture, close-up picture, panoramic picture, etc.

[0053] Exemplarily, since the depth information of each element in the picture to be displayed is closely related to the focal length, a correspondence between the focal length and the depth information is set, and the local pictures in the target picture frame are collected in sequence according to the above correspondence. For example, when the focal length of the augmented reality device is 1.2mm, the part of the picture with a distance of 1m-10m corresponding to the collected depth information is a near-view picture; when the focal length of the augmented reality device is 1.1mm, the part of the picture with a distance of 10m-20m corresponding to the collected depth information is a medium-view picture; when the focal length of the augmented reality device is 1.0mm, the part of the picture with a distance of 20m-30m corresponding to the collected depth information is a long-view picture. In this way, the near-view picture, the medium-view picture and the long-view picture are collected in sequence, and the near-view picture, the medium-view picture and the long-view picture constitute the target picture frame.

[0054] For example, for a specific type of target picture frame, a correspondence between focal length and area ratio is established, and local pictures in the target picture frame are collected in sequence according to the above correspondence. For example, when the focal length of the augmented reality device is 1.2mm, elements with an area ratio of 30% are collected as close-up pictures, and when the focal length of the augmented reality device is 1.1mm, elements with an area ratio of 15% are collected as close-up pictures. Similarly, distant elements and near elements, such as near people and distant people, can be distinguished.

[0055] In addition, other acquisition rules may also be used, such as comparing elements in the target frame with a preset element library to determine a close-up picture, a panoramic picture, etc., which is not specifically limited in this embodiment.

[0056] Step S12: within the display period of the target frame, the frames to be displayed are displayed in sequence and in a circular manner.

[0057] It is understandable that a plurality of to-be-displayed images are combined into a target image frame. In order to ensure that any image in the target image frame can clearly match the real scene in front of the eyes, the target image frame cannot be displayed as a whole. Instead, it is necessary to display the target image frame partially in sequence based on different focal lengths.

[0058] Optionally, the relative position of the target picture frame and the real scene in front of the user needs to be aligned. Therefore, once the data of the tracking device is detected to have changed, the target picture frame needs to be regenerated. Therefore, the time period from when the tracking device starts to capture the user posture data to when new user posture data is captured again is set as the display period of the current target video frame.

[0059] Furthermore, since the focal lengths of the images to be displayed are different when they are captured, the focal length of the augmented reality device can be cyclically adjusted using a high-frequency vibration motor, and the corresponding image to be displayed can be projected at each focal length, thereby achieving a cyclic display of the images to be displayed. For example, at a first focal length, the first image to be displayed is displayed, at a second focal length, the second image to be displayed is displayed, and at a third focal length, the third image to be displayed is displayed, and so on, to achieve a cyclic display of three types of images. Specifically, the focal length can be adjusted by fixing the lens and moving the display chip with the high-frequency vibration motor, or by fixing the display chip and moving the lens with the high-frequency vibration motor, which is not specifically limited in this embodiment.

[0060] In a technical solution provided in this embodiment, the process of capturing a target image frame is subdivided into obtaining at least two to-be-displayed images corresponding to the target image frame, wherein the to-be-displayed images have different focal lengths when captured, and then projecting the corresponding to-be-displayed images at each focal length during the display period of the target image frame, repeating the process to achieve cyclic display of multiple to-be-displayed images. From the user's perspective, since the human eye cannot perceive the frequency of image switching, the overall perception is that of a complete display of the target image frame. Moreover, regardless of whether the user is looking far or near, the image projected by the augmented reality device clearly matches the real scene in front of them. Therefore, the human eye does not need to continuously adjust the focus, and thus does not experience any dizziness, thereby improving the wearing comfort of the augmented reality device.

[0061] Further, refer to Figure 2 , proposes a second embodiment of the method for displaying an augmented reality device screen of the present invention. Based on the above Figure 1 In the embodiment shown, the to-be-displayed pictures include a distant picture, a mid-range picture, and a close-up picture, and the step of acquiring a target picture frame corresponding to at least two to-be-displayed pictures includes:

[0062] Step S21: determining the focal lengths corresponding to the distant view, the mid-range view, and the close-up view, wherein the focal lengths corresponding to the distant view, the mid-range view, and the close-up view increase in sequence;

[0063] Step S22: adjusting the back focus of the image acquisition device according to the focal length, so as to sequentially acquire the distant view, the mid-range view, and the near view based on different focal lengths.

[0064] The step of sequentially and cyclically displaying the to-be-displayed pictures within the display period of the target picture frame comprises:

[0065] Step S23: within the display period of the target frame, the distant view, the mid-view and the near view are displayed in sequence according to the acquisition order of the distant view, the mid-view and the near view.

[0066] It can be understood that a complete target picture frame can be specifically divided into a distant picture, a medium picture and a close-up picture, wherein the distant picture only includes the distant elements in the target picture frame, such as the distant mountains, the medium picture only includes the medium elements in the target picture frame, such as the trees in front, and the close-up picture only includes the close-up elements in the target picture frame, such as the book in the user's hand.

[0067] Optionally, the first focal length, second focal length and third focal length corresponding to the distant view, the mid-range view and the near view are determined respectively, wherein, since the virtual image distance is inversely proportional to the back focal length, the first focal length, the second focal length and the third focal length increase in sequence.

[0068] In the process of specifically determining the focal length, the virtual image distance can be combined for analysis. For example, the picture at a real-world distance within a first distance threshold (such as 30m-50m) is determined as a distant picture, and a uniform virtual image distance (such as 40m) is set for the distant picture as the first virtual image distance. Then, based on the pre-set correspondence between the virtual image distance and the focal length, the first focal length corresponding to the first virtual image distance is determined. In this way, the focal length corresponding to the distant picture can be determined as the first focal length.

[0069] Furthermore, the back focus of the image acquisition device is adjusted according to the focal length. When the back focus is the first focal length, the distant view is captured; when the back focus is the second focal length, the mid-range view is captured; and when the back focus is the third focal length, the close-up view is captured.

[0070] Furthermore, during the display period of the target picture frame, in order to avoid the situation where part of the picture is missing, the long shot picture, the medium shot picture, and the close shot picture are directly displayed in a cyclic manner in the order of acquisition, that is, the long shot picture-medium shot picture-close shot picture-long shot picture-medium shot picture-close shot picture, and so on.

[0071] In one technical solution provided by this embodiment, target image frames are divided into three categories: distant, mid-range, and close-up. During the acquisition process, the focal lengths corresponding to these three categories are first determined. The back focus of the image acquisition device is then adjusted accordingly, sequentially capturing distant, mid-range, and close-up images at different focal lengths. During the display process, the distant, mid-range, and close-up images are displayed in a cyclical manner, following the acquisition sequence described above. This arrangement achieves a reasonable division of the virtual image, ignoring insignificant detail deviations in the image to be displayed. While ensuring harmony and self-consistency between the displayed scene and the virtual image, the back focus adjustment frequency of the image acquisition device is rationally adjusted, thereby improving image display efficiency.

[0072] Further, refer to Figure 3 , a third embodiment of the method for displaying an image of an augmented reality device according to the present invention is proposed. Based on the above embodiment, the step of determining the focal lengths corresponding to the distant image, the mid-range image, and the near-range image, wherein the focal lengths corresponding to the distant image, the mid-range image, and the near-range image increase in sequence, comprises:

[0073] Step S31: obtaining an image acquisition device type of the augmented reality device, and virtual image distances corresponding to the distant view, the middle view, and the near view, wherein the virtual image distances corresponding to the distant view, the middle view, and the near view decrease in sequence;

[0074] Step S32: determining the focal lengths corresponding to the distant view, the mid-range view, and the near view according to the type of the image acquisition device and the virtual image distance, wherein the focal lengths corresponding to the distant view, the mid-range view, and the near view increase in sequence.

[0075] It is understandable that augmented reality devices may use different image acquisition devices, and the parameters such as lens curvature, lens thickness, lens material, and lens position of each image acquisition device are different. Therefore, there are large differences in the focal length settings of different image acquisition devices. The specific image acquisition device type is set by technical personnel based on factors such as device model, user group, and display scenario.

[0076] Optionally, the image acquisition device type of the current augmented reality device is obtained, and then the mapping relationship between the virtual image distance and the focal length corresponding to the current image acquisition device type is determined. For example, when the image acquisition device type is Figure 4 When the first lens group is shown, the relationship between virtual image distance and focal length is as follows Figure 5 As shown, when the image acquisition device type is Figure 6 When the second lens group is shown, the relationship between virtual image distance and focal length is as follows Figure 7 As shown, when the image acquisition device type is Figure 8 When the third lens group is shown, the relationship between virtual image distance and focal length is as follows Figure 9 shown.

[0077] Furthermore, the first virtual image distance, the second virtual image distance and the third virtual image distance corresponding to the distant view, the middle view and the near view are obtained respectively, wherein, since the distant view of the picture is proportional to the virtual image distance, the first focal length, the second focal length and the third focal length increase in sequence.

[0078] Furthermore, after determining the mapping relationship between the virtual image distance and the focal length according to the type of image acquisition device, the first focal length corresponding to the first virtual image distance, the first focal length corresponding to the second virtual image distance, and the first focal length corresponding to the third virtual image distance are determined respectively. At this point, it can be determined that the distant view corresponds to the first focal length, the mid-view corresponds to the second focal length, and the close-up view corresponds to the third focal length.

[0079] In one technical solution provided in this embodiment, the image capture device type of the augmented reality device is obtained, and then the mapping relationship between the virtual image distance and focal length corresponding to the current image capture device type is determined. Based on this, as long as the virtual image distances corresponding to the distant, mid-range, and near-range images are known, the focal lengths corresponding to the distant, mid-range, and near-range images can be accurately determined based on the aforementioned mapping relationship. This configuration takes into account the differences in image capture devices of different augmented reality devices, avoids inappropriate images captured with inappropriate focal lengths, and prevents the virtual image and the real object from being at different focal planes during subsequent display, thereby ensuring the accuracy of image display.

[0080] Furthermore, a fourth embodiment of the method for displaying an image of an augmented reality device is proposed. Based on the above embodiment, the step of obtaining at least two images to be displayed corresponding to the target image frame is performed simultaneously with the step of cyclically displaying the images to be displayed in sequence during the display period of the target image frame.

[0081] Optionally, when the augmented reality device is in working state, at least two to-be-displayed images corresponding to the target image frame can be acquired in real time, and at the same time, the to-be-displayed images are displayed in sequence and in a cycle during the display period of the target image frame.

[0082] For example, after the tracking device begins capturing user gesture data, if the image capture device's focal length is at a first focal length, the distant view in the target frame is captured. If no new user gesture data is captured at this time, i.e., the target frame is within the display period, the corresponding distant view may be displayed. Furthermore, if the image capture device's focal length changes to a second focal length, the mid-view in the target frame is captured. If the target frame is still within the display period, the corresponding mid-view may be displayed.

[0083] In a technical solution provided in this embodiment, the steps of acquiring the picture to be displayed corresponding to the target picture frame and the step of cyclically displaying the picture to be displayed in sequence during the display period of the target picture frame are executed synchronously, that is, the steps of acquisition and display are performed at the same time. Compared with displaying after all pictures are acquired, the response time of this solution is shorter and the picture display is faster.

[0084] Further, refer to Figure 10 , a fifth embodiment of the method for displaying an image of an augmented reality device of the present invention is proposed. Based on the above embodiment, after the step of sequentially displaying the image to be displayed in a circular manner during the display period of the target image frame, the method includes:

[0085] Step S51: If it is detected that the picture to be displayed does not match the real scene, the step of obtaining the target picture frame corresponding to at least two pictures to be displayed is repeated, wherein the focal lengths of the pictures to be displayed are different when they are captured, and the pictures to be displayed are displayed in sequence in a cyclic manner within the display period of the target picture frame.

[0086] Optionally, during the process of sequentially looping through the images to be displayed, if it is detected that the image to be displayed and the real scene do not match, such as the image to be displayed and the real scene cannot be superimposed, or the focal planes of the image to be displayed and the real scene are inconsistent, it indicates that the user's posture has changed or the image acquisition is incorrect. Therefore, the step of acquiring target image frames corresponding to at least two images to be displayed, wherein the focal lengths of the images to be displayed when acquired are different, is repeated until the images to be displayed are sequentially looped through during the display period of the target image frames. This arrangement enables timely adjustment of the image to be displayed, so that the target display image quickly matches the real scene observed by the user, and better achieves the effect of combining virtual and real.

[0087] Further, refer to Figure 11 , a sixth embodiment of the method for displaying an image of an augmented reality device of the present invention is proposed. Based on the above embodiment, the step of obtaining at least two images to be displayed corresponding to the target image frame includes:

[0088] Step S61: cyclically adjusting the position of the display chip through a high-frequency vibration motor, wherein the focal length of each position is different;

[0089] Step S62: When the display chip is in at least two different positions, the to-be-displayed images corresponding to the target image frame are respectively captured.

[0090] Optionally, the image acquisition device of the augmented reality device is composed of a lens and a display chip, but since the lens is inconvenient to move, a high-frequency vibration motor is directly added to the display chip. The high-frequency vibration motor drives the display chip to vibrate in the direction of the optical axis, so as to adjust the distance between the display chip and the lens, that is, the back focus.

[0091] Optionally, the position of the display chip is cyclically adjusted by a high-frequency vibration motor, wherein the focal length of each position is different, so that images with different focal lengths can be captured at each position.

[0092] Exemplarily, since the lens position is fixed, three positions are set based on different focal lengths. The display chip is first moved to the first position to capture the first image to be displayed, then moved to the second position to capture the second image to be displayed, and finally moved to the third position to capture the third image to be displayed.

[0093] It should be noted that in order to avoid discomfort caused by screen switching to the user, the vibration frequency needs to be set to be greater than the user's perceptible frequency. It is known that the image switching frequency that a general user can perceive is 10 Hz, so the frequency of the high-frequency vibration motor can be set to 60 Hz.

[0094] In a technical solution provided in this embodiment, a high-frequency vibration motor is added to the display chip, which drives the display chip to positions with different focal lengths and collects the images to be displayed corresponding to the target image frames. Compared with changing the focal length by adjusting the position of the lens, this solution is easier to implement and can avoid image display errors caused by lens angle offset during vibration.

[0095] Reference Figure 12 , Figure 12 This is a schematic diagram of the structure of an augmented reality device in the hardware operating environment involved in the embodiment of the present invention.

[0096] like Figure 12 As shown, the augmented reality device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the user interface 1003 may optionally include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may optionally be a storage device independent of the aforementioned processor 1001.

[0097] Those skilled in the art will understand that Figure 12 The structure shown in the figure does not constitute a limitation to the augmented reality device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0098] like Figure 12 As shown, the memory 1005 as a storage medium may include an operating system, a data storage module, a network communication module, a user interface module and a screen display program.

[0099] exist Figure 12In the augmented reality device shown, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the augmented reality device of the present invention can be set in the augmented reality device, and the augmented reality device calls the screen display program stored in the memory 1005 through the processor 1001, and executes the augmented reality device screen display method provided by the embodiment of the present invention.

[0100] An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps in any embodiment of the above-mentioned augmented reality device screen display method are implemented.

[0101] Since the embodiments of the computer-readable storage medium part correspond to the embodiments of the method part, the embodiments of the computer-readable storage medium part refer to the description of the embodiments of the method part and are not repeated here.

[0102] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0103] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.

[0104] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0105] The above are only preferred embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention description and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for displaying an augmented reality device screen, characterized in that: The augmented reality device screen display method comprises the following steps: Obtaining an image acquisition device type of the augmented reality device, and virtual image distances corresponding to a distant view, a mid-range view, and a near view, wherein the virtual image distances corresponding to the distant view, the mid-range view, and the near view decrease in sequence; Determining the focal lengths corresponding to the distant view, the mid-range view, and the near view according to the type of the image acquisition device and the virtual image distance, wherein the focal lengths corresponding to the distant view, the mid-range view, and the near view increase in sequence; The position of the display chip is cyclically adjusted through a high-frequency vibration motor, with each position having a different focal length; When the display chip is in at least two different positions, respectively capturing the distant view, the mid-range view, and the near view corresponding to the target frame; During the display period of the target frame, the distant view, the middle view and the near view are displayed in sequence according to their acquisition order.

2. The method for displaying an augmented reality device image according to claim 1, wherein: The step of respectively capturing the distant view, the mid-view, and the close-up view corresponding to the target frame when the display chip is in at least two different positions is synchronously executed with the step of cyclically displaying the distant view, the mid-view, and the close-up view in sequence according to the capture order of the distant view, the mid-view, and the close-up view during the display period of the target frame.

3. The method for displaying an augmented reality device image according to claim 1, wherein: After the step of cyclically displaying the distant view, the mid-view, and the near view in sequence according to the acquisition order of the distant view, the mid-view, and the near view during the display period of the target image frame, the method further comprises: If it is detected that the picture to be displayed does not match the real scene, the steps of displaying the distant picture, the medium picture and the close-up picture in sequence according to the acquisition order of the distant picture, the medium picture and the close-up picture are repeated within the display period of the target picture frame.

4. The method for displaying an augmented reality device image according to any one of claims 1 to 3, wherein: The vibration frequency of the high-frequency vibration motor is greater than a frequency perceivable by a user.

5. An augmented reality device, characterized in that: The device includes: a memory, a processor, and a screen display program stored in the memory and executable on the processor, wherein the screen display program is configured to implement the steps of the augmented reality device screen display method according to any one of claims 1 to 4.

6. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a screen display program, and when the screen display program is executed by the processor, the steps of the augmented reality device screen display method according to any one of claims 1 to 4 are implemented.

Images