Portable AR display equipment focus content moving method and device and storage medium

Abstract

The invention relates to the technical field of AR / VR, and discloses a portable AR display equipment focus content moving method and device and a storage medium, and the method comprises the following steps: obtaining a first monocular image; identifying a first pupil center from the first monocular image; establishing a coordinate relationship between the first monocular image and the first imaging interface to obtain a coordinate of a first pupil center and a coordinate of a first picture center of the first imaging interface; calculating a first coordinate difference between the first pupil center and the first picture center; and moving the focus content of the imaging content in the first imaging interface according to the first coordinate difference. The strabismus treatment device is helpful for improving the vision condition of strabismus patients.

Description

Technical Field

[0001] The present application relates to the AR / VR field, and in particular to a method, device and storage medium for moving focus content of a portable AR display device. Background Art

[0002] Strabismus refers to the inability of both eyes to focus on the same object at the same time due to abnormal coordination of extraocular muscles. It is caused by congenital or acquired factors. It manifests as an abnormal eye position in which the visual axis of one eye deviates from the parallel position of the other eye when focusing.

[0003] Under normal circumstances, binocular movements are coordinated and both eyes can focus on the same target at the same time, and the target is imaged in the macula of both eyes, transmitted to the visual center of the brain, and overlapped into a complete and three-dimensional single image. When binocular movements are not coordinated due to various neuromuscular diseases, strabismus will occur, and one object may be seen as two images.

[0004] Currently, there are many ways to correct strabismus, such as surgery, glasses correction, drug therapy, and visual function training. Among them, glasses correction or visual function training is generally done by wearing corrective glasses. Corrective glasses usually correct the prism of the eye through a prism, so that external light can be normally focused on the macula of the retina, thereby improving vision. The corrective glasses required by each person are different, and as vision improves, the corrective glasses need to be reconfigured. Summary of the invention

[0005] In order to provide a method that helps improve the vision of patients with strabismus, the present application provides a method, device and storage medium for moving the focus content of a portable AR display device.

[0006] On the one hand, the present application provides a method for moving the focus content of a portable AR display device, which adopts the following technical solution:

[0007] A method for moving focus content of a portable AR display device comprises the following steps:

[0008] Acquire a first monocular image;

[0009] identifying a first pupil center from the first monocular image;

[0010] Establishing a coordinate relationship between the first monocular image and the first imaging interface to obtain the coordinates of the first pupil center and the coordinates of the first screen center of the first imaging interface;

[0011] Calculating a first coordinate difference between the first pupil center and the first picture center;

[0012] The focus content of the imaging content in the first imaging interface is moved according to the first coordinate difference.

[0013] By adopting the above technical solution, the position of the pupil is identified through image recognition technology, and a coordinate relationship between the first monocular image and the first imaging interface is established. According to the relative position of the coordinates, the position of the focus content in the imaging content in the first imaging interface is adjusted, which helps to attract the user's line of sight to align with it, thereby playing a training and adjustment role for strabismus.

[0014] Optionally, the method further comprises the following steps:

[0015] acquiring a second monocular image;

[0016] identifying a second pupil center from the second monocular image;

[0017] Establishing a coordinate relationship between the second monocular image and the second imaging interface to obtain the coordinates of the second pupil center and the coordinates of the second screen center of the second imaging interface;

[0018] Calculating a second coordinate difference between the second pupil center and the second picture center;

[0019] Calculating a relative coordinate difference between the first coordinate difference and the second coordinate difference;

[0020] If the first coordinate difference is greater than the second coordinate difference, the relative coordinate difference moves the focus content of the imaging content in the first imaging interface;

[0021] If the first coordinate difference is smaller than the second coordinate difference, the relative coordinate difference moves the focus content of the imaging content in the second imaging interface.

[0022] By adopting the above technical solution, due to the difference between the two eyes, which can be understood as different degrees of strabismus, images of the two eyes are acquired separately, and the degrees of strabismus are compared, and the focus content of the imaging content in the imaging interface corresponding to the eye with the larger coordinate difference is moved, and the eye with the larger degree of strabismus is adjusted preferentially, thereby achieving a more reasonable adjustment, which helps to reduce the difference in visual axis deviation between the two eyes.

[0023] Optionally, the method further comprises the following steps:

[0024] moving the focus content when the first imaging content and the second imaging content are played;

[0025] The moving speed of the focus content is positively correlated with the playing speed of the imaging content and the changing speed of the imaging content.

[0026] By adopting the above technical solution, through the combination of software and hardware, the dynamic displacement of the focus content is increased, so that the movement of the focus content is associated with the playback speed and change speed of the imaging content; therefore, the movement of the focus content is adjusted according to the playback speed and change speed of the imaging content, so that the user can be better immersed in the display content and achieve a more natural and smooth visual effect, thereby being guided to train strabismus.

[0027] Optionally, the step of moving the focus content of the imaging content further includes the following sub-steps:

[0028] Get the moving path;

[0029] generating a plurality of focus content moving phantoms according to the moving path;

[0030] The spacing values ​​of a plurality of moving ghost images of the focus content on the moving path are set in anti-correlation according to the average grayscale value of the imaging content.

[0031] By adopting the above technical solution, the moving effect of the focus content can be flexibly adjusted according to different imaging contents. By obtaining the moving path and generating multiple focus content moving phantoms according to the path, a continuous focus content moving effect can be formed, which increases the layering and three-dimensional sense of dynamic vision. According to the anti-correlation of the average gray value of the imaging content, the spacing value of multiple focus content moving phantoms on the moving path is set, which can better adapt to different imaging contents, provide a more natural and comfortable visual experience, and thus be more helpful for strabismus training.

[0032] Optionally, the step of moving the focus content of the imaging content further includes the following sub-steps:

[0033] Get the moving path;

[0034] generating a plurality of focus content moving phantoms according to the moving path;

[0035] The interval variation amplitude values ​​of the plurality of moving virtual images of the focus content on the moving path are set in anti-correlation according to the color saturation value of the imaging content.

[0036] By adopting the above technical solution, the moving effect of the focus content can be flexibly adjusted according to different imaging contents. By obtaining the moving path and generating multiple focus content moving phantoms according to the path, a continuous focus content moving effect can be formed, which increases the layering and three-dimensional sense of dynamic vision. The spacing values ​​of multiple focus content moving phantoms on the moving path are set inversely according to the color saturation value of the imaging content, which can better adapt to different imaging contents and provide a more natural and comfortable visual experience, thereby being more helpful in the treatment of strabismus.

[0037] Optionally, the step of moving the focus content of the imaging content further includes the following sub-steps:

[0038] adjusting the color component of the imaging interface according to the remaining displacement distance of the focus content on the moving path;

[0039] The shorter the remaining moving distance is, the less the blue component of the imaging interface is;

[0040] The faster the remaining moving speed on the remaining path of the moving path is, the less the blue component of the imaging interface is.

[0041] By adopting the above technical solution, the blue component of the imaging interface is adjusted according to the remaining displacement distance and the moving speed of the focus content on the moving path.

[0042] Optionally, the step of moving the focus content of the imaging content further includes the following sub-steps:

[0043] adjusting the color component of the focus content according to the remaining displacement distance of the focus content on the moving path;

[0044] The shorter the remaining moving distance is, the more blue components the focus content has;

[0045] The faster the remaining portion moves on the remaining path of the moving path, the more blue components the focus content has.

[0046] By adopting the above technical solution, the method of adjusting the color component of the focus content according to the remaining displacement distance and the moving speed of the focus content on the moving path is the same as adjusting the color component of the imaging interface.

[0047] Optionally, the step of moving the focus content of the imaging content further includes the following sub-steps:

[0048] adjusting the frame rate of the focus content according to the remaining displacement distance of the focus content on the moving path;

[0049] The shorter the remaining moving distance is, the higher the frame rate of the focus content is; conversely, the longer the remaining moving distance is, the lower the frame rate of the focus content is.

[0050] By adopting the above technical solution, combined with a combination of software and hardware, the frame rate of the focus content can be adjusted according to the remaining displacement distance of the focus content on the moving path, thereby helping to adjust the changes in the focus content image to better meet the needs of strabismus training.

[0051] On the other hand, the present application provides a focus content moving device of a portable AR display device, which adopts the following technical solution:

[0052] A device for moving focus content of a portable AR display device comprises a processor, wherein a program of the method for moving focus content of the portable AR display device is executed in the processor.

[0053] On the other hand, the present application provides a storage medium, which adopts the following technical solution:

[0054] A storage medium stores a program for the method for moving focus content of the portable AR display device.

[0055] In summary, the present application includes at least one of the following beneficial technical effects: identifying the position of the pupil through image recognition technology, and establishing a coordinate relationship between the first monocular image and the first imaging interface, and adjusting the position of the focus content in the imaging content in the first imaging interface according to the relative position of the coordinates; and performing image recognition on both eyes separately to rationally adjust the focus content according to the strabismus situation corresponding to each eye; and flexibly adjusting the movement effect of the focus content according to different imaging contents, so as to better help attract the user's line of sight to align with it, thereby playing a training and treatment role for strabismus. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 This is a flowchart of the steps of a method for moving focus content of a portable AR display device in the present application.

[0057] Figure 2 The present application discloses a method for moving the focus content of a portable AR display device, and a relative position relationship between a first monocular image and the focus content in a first imaging interface.

[0058] Figure 3 This is a method for moving the focus content of a portable AR display device in the present application, combined with a method step diagram for processing a second monocular image.

[0059] Figure 4 The present application discloses a method for moving the focus content of a portable AR display device, wherein the first monocular image and the second monocular image are respectively related to the relative positions of the focus content in the corresponding imaging interface.

[0060] Figure 5 This is a method for moving the focus content of a portable AR display device of the present application, and a sub-step diagram for setting the moving speed of the focus content.

[0061] Figure 6 This application discloses a method for moving focus content of a portable AR display device and a schematic diagram of movement of focus content.

[0062] Figure 7 This application discloses a method for moving the focus content of a portable AR display device, and a sub-step diagram for generating multiple focus content moving phantoms.

[0063] Figure 8 This application discloses a method for moving focus content of a portable AR display device, which generates a schematic diagram of multiple focus content moving phantoms.

[0064] Fig. 9 This is a schematic diagram of a method for moving the focus content of a portable AR display device in the present application, with a high grayscale value, generating multiple focus content moving phantoms with small spacing.

[0065] Fig.10 This is a method for moving the focus content of a portable AR display device of the present application, and a sub-step diagram of the focus content of the moving imaging content.

[0066] Fig.11 This is a schematic diagram of a method for moving the focus content of a portable AR display device in the present application, which has a high color saturation value and generates multiple focus content moving phantoms with small spacing.

[0067] Fig.12 This is a method for moving the focus content of a portable AR display device of the present application, a step diagram of the relationship between the remaining moving distance, the faster the moving speed and the blue component of the imaging interface.

[0068] Fig.13 This is a method for moving the focus content of a portable AR display device of the present application, a step diagram of the relationship between the remaining moving distance, the focus content blue component of the focus content and the moving speed.

[0069] Fig.14 This is a step diagram of a method for moving focus content of a portable AR display device of the present application, and the relationship between the remaining moving distance and the frame rate of the focus content. DETAILED DESCRIPTION

[0070] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0071] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0072] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0073] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0074] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0075] The present application embodiment discloses a method for moving the focus content of a portable AR display device, referring to Figure 1 and Figure 2 , including the following steps:

[0076] Acquire a first monocular image; capture and acquire the first monocular image through a portable AR display device.

[0077] A first pupil center is identified from the first monocular image; and a position of the pupil, namely, the first pupil center, is identified by using image recognition technology, such as feature recognition and image processing algorithms.

[0078] Establish a coordinate relationship between the first monocular image and the first imaging interface to obtain the coordinates of the first pupil center and the coordinates of the first screen center of the first imaging interface; establish the coordinate relationship between the above two to facilitate subsequent image calculation and processing. The first imaging interface is an image projected onto the user's retina. It is usually composed of a miniature display, such as a miniature OLED panel, which can project the image directly onto the user's retina to provide the user with a virtual, enhanced visual experience.

[0079] Calculate a first coordinate difference between the first pupil center and the first screen center; and calculate the coordinate difference through a calculation algorithm.

[0080] The focus content of the imaging content in the first imaging interface is moved according to the first coordinate difference. According to the first coordinate difference, the focus content of the imaging content in the first imaging interface is moved, so that the focus content position can be adjusted.

[0081] The position of the pupil is identified through image recognition technology, and a coordinate relationship between the first monocular image and the first imaging interface is established. According to the relative position of the coordinates, the position of the focus content of the imaging content in the first imaging interface is adjusted, which helps to align the user's line of sight with it, thereby playing a training and adjustment role for strabismus.

[0082] Reference Figure 3 and Figure 4 , the method further comprises the following steps:

[0083] Acquire a second monocular image; similar to acquiring the first monocular image, the second monocular image is captured and acquired through the portable AR display device.

[0084] A second pupil center is identified from the second monocular image; similarly, in the second monocular image, a second pupil center of the user, ie, the second pupil center, is identified.

[0085] A coordinate relationship between the second monocular image and the second imaging interface is established to obtain the coordinates of the second pupil center and the coordinates of the second screen center of the second imaging interface; similar to the processing of the first monocular image, a coordinate relationship between the above two is established to facilitate subsequent calculations.

[0086] Calculate the second coordinate difference between the second pupil center and the second picture center; and calculate the second coordinate difference between the second pupil center and the second picture center based on the established coordinate relationship.

[0087] The relative coordinate difference between the first coordinate difference and the second coordinate difference is calculated; the relative coordinate difference is obtained by calculating the difference between the first coordinate difference and the second coordinate difference, and the focus content is moved according to the coordinate difference.

[0088] If the first coordinate difference is greater than the second coordinate difference, the focus content of the imaging content in the first imaging interface is moved relative to the coordinate difference;

[0089] If the first coordinate difference is smaller than the second coordinate difference, the focus content of the imaging content in the second imaging interface is moved relative to the coordinate difference.

[0090] Since there are differences between the two eyes, which can be understood as different degrees of strabismus, images of the two eyes are acquired separately, and the degrees of strabismus are compared. The focus content of the imaging content in the imaging interface corresponding to the eye with the larger coordinate difference is moved, and the eye with the larger degree of strabismus is adjusted preferentially, thereby achieving a more reasonable adjustment and helping to reduce the difference in visual axis deviation between the two eyes.

[0091] Reference Figure 5 and Figure 6 , the method further comprises the following steps:

[0092] Moving the focus content when the first imaging content and the second imaging content are played;

[0093] The moving speed of the focus content is positively correlated with the playback speed of the imaging content and the changing speed of the imaging content. The displacement of the focus content in the imaging content is achieved by combining software with hardware, that is, the playback content and the focus content are not completely synchronized. For example, if the imaging content is played faster or changes more dramatically, the moving speed of the focus content will increase accordingly.

[0094] Through the combination of software and hardware, the dynamic displacement of the focus content is increased, so that the movement of the focus content is associated with the playback speed and change speed of the imaging content; therefore, the movement of the focus content is adjusted according to the playback speed and change speed of the imaging content, so that users can be better immersed in the display content and achieve a more natural and smooth visual effect, thereby being guided to train strabismus.

[0095] Reference Figure 7 and Figure 8 , the step of moving the focus content of the imaging content further includes the following sub-steps:

[0096] Obtain the moving path; the moving path can be obtained through the coordinate difference to determine the direction and distance the focus content needs to move.

[0097] Generate multiple focus content moving phantoms according to the moving path; combine with software to generate multiple focus content moving phantoms in the imaging content corresponding to the moving path. The focus content moving phantoms can be blurred, semi-transparent images to produce a continuous movement effect of the focus content.

[0098] Reference Figure 8 and Fig. 9 , the spacing values ​​of multiple focus content moving ghosts on the moving path are set in anti-correlation according to the average gray value of the imaging content. The spacing value is set in anti-correlation according to the average gray value. The larger the average gray value, the higher the grayscale of the overall image. Therefore, the smaller the spacing, the denser the focus content moving ghosts, and the higher the dynamic visual delicacy; conversely, the focus content moving ghosts are sparser, avoiding the overly dense focus content moving effect.

[0099] The moving effect of the focus content can be flexibly adjusted according to different imaging contents. By obtaining the moving path and generating multiple focus content moving phantoms according to the path, a continuous focus content moving effect can be formed, which increases the layering and three-dimensional sense of dynamic vision. The spacing values ​​of multiple focus content moving phantoms on the moving path are set inversely according to the average grayscale value of the imaging content, which can better adapt to different imaging contents, provide a more natural and comfortable visual experience, and thus be more helpful for strabismus training.

[0100] Reference Fig.10 and Fig.11 , the step of moving the focus content of the imaging content further includes the following sub-steps:

[0101] Obtain the moving path; the moving path can be obtained through the coordinate difference to determine the direction and distance the focus content needs to move.

[0102] Generate multiple focus content moving phantoms according to the moving path; combine with software to generate multiple focus content moving phantoms in the imaging content corresponding to the moving path. The focus content moving phantoms can be blurred, semi-transparent images to produce a continuous movement effect of the focus content.

[0103] The spacing variation amplitude values ​​of the moving virtual images of the multiple focus contents on the moving path are set inversely according to the color saturation value of the imaging content. If the color saturation of the imaging content is high, the spacing variation amplitude can be set to be smaller to increase the fineness of the dynamic vision. Conversely, if the color saturation is low, the spacing variation amplitude can be appropriately increased to avoid an overly dense focus content movement effect.

[0104] The moving effect of the focus content can be flexibly adjusted according to different imaging contents. By obtaining the moving path and generating multiple focus content moving phantoms according to the path, a continuous focus content moving effect can be formed, which increases the layering and three-dimensional sense of dynamic vision. According to the anti-correlation setting of the spacing values ​​of multiple focus content moving phantoms on the moving path according to the color saturation value of the imaging content, it can better adapt to different imaging contents, provide a more natural and comfortable visual experience, and thus be more helpful for strabismus training.

[0105] Reference Fig.12 , the step of moving the focus content of the imaging content further includes the following sub-steps:

[0106] Adjust the color component of the imaging interface according to the remaining displacement distance of the focus content on the moving path;

[0107] The shorter the remaining moving distance is, the less blue component of the imaging interface is; the closer the focus content is to the target on the moving path, the less blue component of the imaging interface is, so that the focus content is more prominent in the imaging interface, which helps to play a better guiding role.

[0108] The faster the remaining moving speed on the remaining path of the moving path, the less blue component of the imaging interface. The faster the focus content moves on the moving path, the less blue component of the color of the imaging interface, which is suitable for situations where the focus content needs to be moved quickly.

[0109] The blue component of the imaging interface is adjusted according to the remaining displacement distance and moving speed of the focus content on the moving path. The less the blue component, the more helpful it is to protect eye vision.

[0110] Reference Fig.13, the step of moving the focus content of the imaging content further includes the following sub-steps:

[0111] Adjusting the color component of the focus content according to the remaining displacement distance of the focus content on the moving path;

[0112] The shorter the remaining moving distance is, the more blue components the focus content has; when the focus content is close to the target, the color of the focus content will tend to increase the blue component, which is conducive to highlighting the focus content from other parts of the image.

[0113] The faster the remaining moving speed on the remaining path of the moving path, the more blue component the focus content has. When the focus content moves quickly, the color of the focus content will tend to increase the blue component to facilitate fast tracking of the moving target.

[0114] The method of adjusting the color component of the focus content according to the remaining displacement distance and moving speed of the focus content on the moving path is the same as adjusting the color component of the imaging interface. The less the blue component, the more helpful it is to protect eye vision.

[0115] Reference Fig.14 , the step of moving the focus content of the imaging content further includes the following sub-steps:

[0116] adjusting the frame rate of the focus content according to the remaining displacement distance of the focus content on the moving path;

[0117] The shorter the remaining moving distance, the higher the frame rate of the focus content; conversely, the longer the remaining moving distance, the lower the frame rate of the focus content. If the shorter the remaining moving distance, the higher the frame rate of the focus content. Then, when the focus content is close to the displacement target position, the frame rate of the focus content will increase to provide clearer and more detailed imaging. Conversely, if the longer the remaining moving distance, the lower the frame rate of the focus content. Then, when the focus content is far away from the target, the frame rate of the focus content will decrease, thereby reducing the clarity and detail of the image or video.

[0118] By combining software and hardware, the frame rate of the focus content can be adjusted according to the remaining displacement distance of the focus content on the moving path, which helps to adjust the change of the focus content image to better meet the needs of strabismus training.

[0119] An embodiment of the present application discloses a device for moving focus content of a portable AR display device, including a processor, in which a program of the method for moving focus content of the portable AR display device is executed.

[0120] An embodiment of the present application discloses a computer-readable storage medium storing a program of the above-mentioned method for moving focus content of the portable AR display device.

[0121] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0122] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0123] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0124] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0125] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0126] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, a technical solution formed by replacing the above-mentioned features with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to)

[0127] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A method for moving focus content of a portable AR display device, characterized in that: The steps include: Acquire a first monocular image; identifying a first pupil center from the first monocular image; Establishing a coordinate relationship between the first monocular image and the first imaging interface to obtain the coordinates of the first pupil center and the coordinates of the first screen center of the first imaging interface; Calculating a first coordinate difference between the first pupil center and the first picture center; The focus content of the imaging content in the first imaging interface is moved according to the first coordinate difference.

2. The method for moving the focus content of a portable AR display device according to claim 1, characterized in that: The method further comprises the steps of: acquiring a second monocular image; identifying a second pupil center from the second monocular image; Establishing a coordinate relationship between the second monocular image and the second imaging interface to obtain the coordinates of the second pupil center and the coordinates of the second screen center of the second imaging interface; Calculating a second coordinate difference between the second pupil center and the second picture center; Calculating a relative coordinate difference between the first coordinate difference and the second coordinate difference; If the first coordinate difference is greater than the second coordinate difference, the relative coordinate difference moves the focus content of the imaging content in the first imaging interface; If the first coordinate difference is smaller than the second coordinate difference, the relative coordinate difference moves the focus content of the imaging content in the second imaging interface.

3. The method for moving the focus content of a portable AR display device according to claim 2, characterized in that: The method further comprises the steps of: moving the focus content when the first imaging content and the second imaging content are played; The moving speed of the focus content is positively correlated with the playing speed of the imaging content and the changing speed of the imaging content.

4. The method for moving the focus content of a portable AR display device according to claim 3, characterized in that: The step of moving the focus content of the imaging content also includes the following sub-steps: Get the moving path; generating a plurality of focus content moving phantoms according to the moving path; The spacing values ​​of a plurality of moving ghost images of the focus content on the moving path are set in anti-correlation according to the average grayscale value of the imaging content.

5. The method for moving the focus content of a portable AR display device according to claim 3, characterized in that: The step of moving the focus content of the imaging content also includes the following sub-steps: Get the moving path; generating a plurality of focus content moving phantoms according to the moving path; The interval variation amplitude values ​​of the plurality of moving virtual images of the focus content on the moving path are set in anti-correlation according to the color saturation value of the imaging content.

6. The method for moving the focus content of a portable AR display device according to claim 4 or 5, characterized in that: The step of moving the focus content of the imaging content also includes the following sub-steps: adjusting the color component of the imaging interface according to the remaining displacement distance of the focus content on the moving path; The shorter the remaining moving distance is, the less the blue component of the imaging interface is; The faster the remaining moving speed on the remaining path of the moving path is, the less the blue component of the imaging interface is.

7. The method for moving the focus content of a portable AR display device according to claim 4 or 5, characterized in that: The step of moving the focus content of the imaging content also includes the following sub-steps: adjusting the color component of the focus content according to the remaining displacement distance of the focus content on the moving path; The shorter the remaining moving distance is, the more blue components the focus content has; The faster the remaining portion moves on the remaining path of the moving path, the more blue components the focus content has.

8. The method for moving the focus content of a portable AR display device according to claim 4 or 5, characterized in that: The step of moving the focus content of the imaging content also includes the following sub-steps: adjusting the frame rate of the focus content according to the remaining displacement distance of the focus content on the moving path; The shorter the remaining moving distance is, the higher the frame rate of the focus content is; conversely, the longer the remaining moving distance is, the lower the frame rate of the focus content is.

9. A focus content moving device for a portable AR display device, characterized in that: The device comprises a processor, wherein a program of the method for moving focus content of a portable AR display device as claimed in any one of claims 1 to 8 is run in the processor.

10. A storage medium, characterized in that: A program storing the method for moving the focus content of the portable AR display device as claimed in any one of claims 1 to 8.

Images