Air imaging control method, system, device and readable storage medium

Abstract

The present application is applicable to the field of air imaging technology and provides an air imaging control method, system, device, and readable storage medium. The method includes: obtaining position information of a user's eyes; determining a first offset angle and a second offset angle based on the position information of the eyes; adjusting the imaging angle of a first projection device based on the first offset angle, and adjusting the imaging angle of a second projection device based on the second offset angle; obtaining a first target image using the first projection device after adjusting the imaging angle, and obtaining a second target image using the second projection device after adjusting the imaging angle; projecting the first target image into one of the user's eyes, and projecting the second target image into the other of the user's eyes. Thus, the first target image and the second target image, each having the same image content but different imaging angles, can be projected into the user's eyes, forming stereoscopic three-dimensional visual information.

Description

Technical Field

[0001] The present application belongs to the field of air imaging technology, and in particular relates to an air imaging control method, system, device and readable storage medium. Background Art

[0002] With the continuous updating and development of display technology, more and more fields (such as advertising display, film and television broadcasting, education and teaching, and family entertainment) use air imaging technology to display the content of the picture to be displayed.

[0003] Currently, the air imaging control method can project the image content to be displayed into the air, allowing users to directly watch the image content to be displayed without wearing other auxiliary equipment (such as VR glasses, helmets, etc.).

[0004] However, the image content to be displayed projected by the above control method is two-dimensional visual information on a plane, which has no three-dimensional sense and poor display effect. Summary of the Invention

[0005] The embodiments of the present application provide an air imaging control method, system, device and readable storage medium, which can form three-dimensional visual information and improve the display effect.

[0006] In a first aspect, an embodiment of the present application provides an air imaging control method, which is applied to an air imaging device, wherein the air imaging device includes a first projection device and a second projection device, and the size of the second projection device is smaller than or equal to the size of the first projection device. The method includes:

[0007] Obtaining the position information of the user's eyes, where the position information of the eyes is used to represent the coordinates of the user's eyes in real space;

[0008] Determining a first offset angle and a second offset angle according to position information of both eyes, wherein the first offset angle and the second offset angle are not equal;

[0009] Adjusting an imaging angle of the first projection device based on the first offset angle, and adjusting an imaging angle of the second projection device based on the second offset angle;

[0010] Obtaining a first target image using the first projection device after adjusting the imaging angle, and obtaining a second target image using the second projection device after adjusting the imaging angle, wherein the screen content of the first target image and the screen content of the second target image are the same, and the imaging angle of the first target image and the imaging angle of the second target image are different;

[0011] A first target image is projected to one of the user's eyes, and a second target image is projected to the other of the user's eyes.

[0012] In one possible implementation, determining the offset angle according to the position information of both eyes includes:

[0013] Based on the position information of the eyes, the first offset angle and the second offset angle are determined using an imaging algorithm based on geometric optics. This allows the first offset angle and the second offset angle to be adjusted in a timely manner when the position information of the user's eyes changes, ensuring that the user's eyes can always observe a stereoscopic three-dimensional image.

[0014] In a possible implementation, the method further includes:

[0015] Acquiring an environmental image, where the environmental image is used to represent an image within an imaging range of the air imaging device;

[0016] Get the user's eye position information, including:

[0017] In response to the presence of a user in the environment image, position information of both eyes of the user is determined based on the environment image.

[0018] In a possible implementation, the method further includes:

[0019] In response to the absence of a user in the ambient image, the first projection device and the second projection device are determined to be in an initial state, where the initial state represents a state before the first projection device and the second projection device have adjusted their imaging angles. This can reduce power consumption of the air imaging device.

[0020] In a possible implementation, the air imaging device further includes: a first angle adjustment device and a second angle adjustment device, the first angle adjustment device being connected to the first projection device, and the second angle adjustment device being connected to the second projection device;

[0021] Adjusting the imaging angle of the first projection device based on the first offset angle includes:

[0022] Based on the first offset angle, adjusting the imaging angle of the first projection device using the first angle adjustment device;

[0023] Adjusting the imaging angle of the second projection device based on the second offset angle includes:

[0024] Based on the second offset angle, the imaging angle of the second projection device is adjusted using the second angle adjustment device.

[0025] In a possible implementation, the air imaging device further includes a refraction device, and the method further includes:

[0026] A first target image is projected to one of the user's eyes using a refraction device, and a second target image is projected to the other of the user's eyes using a refraction device.

[0027] Compared to the prior art, the embodiment of the present application can determine the coordinates of the user's eyes in real space by obtaining the position information of the user's eyes, and then determine the first offset angle and the second offset angle based on the coordinates of the eyes in real space. On this basis, the imaging angle of the first projection device can be adjusted based on the first offset angle, and the imaging angle of the second projection device can be adjusted based on the second offset angle. Then, by adjusting the imaging angles of the first projection device and the second projection device, the first target image and the second target image can be obtained respectively, and the first target image can be projected to one eye of the user, and the second target image can be projected to the other eye of the user. As a result, the user's two eyes can respectively observe the first target image and the second target image with the same screen content but different imaging angles. After superimposing the first target image and the second target image, a stereoscopic three-dimensional visual effect can be formed.

[0028] In a second aspect, an embodiment of the present application provides an air imaging device, the device comprising: a control device, a first projection device, and a second projection device, wherein the first projection device and the second projection device are both communicatively connected to the control device, and the size of the second projection device is smaller than or equal to the size of the first projection device;

[0029] A control device, configured to obtain position information of the user's eyes, wherein the position information of the eyes is used to represent the coordinates of the user's eyes in real space;

[0030] The control device is further configured to determine an offset angle based on the position information of the two eyes, where the offset angle includes a first offset angle and a second offset angle, and the first offset angle and the second offset angle are not equal;

[0031] The control device is further configured to adjust the imaging angle of the first projection device based on the first offset angle, and to adjust the imaging angle of the second projection device based on the second offset angle;

[0032] The control device is further configured to obtain a first target image using the first projection device after adjusting the imaging angle, and obtain a second target image using the second projection device after adjusting the imaging angle, wherein the image content of the first target image and the image content of the second target image are the same, and the imaging angle of the first target image and the imaging angle of the second target image are different;

[0033] The control device is further configured to project the first target image into one of the user's eyes and the second target image into the other of the user's eyes;

[0034] A first projection device, configured to display a first target image;

[0035] The second projection device is used to display a second target image.

[0036] In one possible implementation, the air imaging device further includes: a first angle adjustment device and a second angle adjustment device, both of which are communicatively connected to the control device, the first projection device is connected to the first angle adjustment device, and the second projection device is connected to the second angle adjustment device;

[0037] A first angle adjustment device, configured to adjust an imaging angle of the first projection device based on a first offset angle;

[0038] The second angle adjustment device is used to adjust the imaging angle of the second projection device based on the second offset angle.

[0039] In a third aspect, an embodiment of the present application provides an air imaging control system, the system comprising: an image acquisition device and an air imaging device, the image acquisition device and the air imaging device being communicatively connected;

[0040] An image acquisition device is used to acquire an environmental image, and the environmental image is used to represent an image within the imaging range of the air imaging device;

[0041] The air imaging device is also used to determine the position information of the user's eyes based on the environmental image captured by the image acquisition device.

[0042] In a fourth aspect, a readable storage medium is provided, in which instructions are stored. When the instructions are executed on a computer, the computer executes the air imaging control method in the first aspect or any possible implementation of the first aspect.

[0043] In a fifth aspect, a computer program product comprising instructions is provided, which, when executed on an air imaging device, enables the device to execute the air imaging control method in the first aspect or any possible implementation of the first aspect.

[0044] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0046] Figure 1 This is a schematic block diagram of the structure of an air imaging control system provided by an embodiment of the present application;

[0047] Figure 2 This is a schematic block diagram of the structure of an air imaging device provided in an embodiment of the present application;

[0048] Figure 3 This is an imaging principle diagram of an air imaging device provided in an embodiment of the present application;

[0049] Figure 4 This is a flow chart of an air imaging control method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0050] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0051] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0052] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0053] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0054] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0055] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0056] See also Figure 1 , Figure 1 FIG. 1 shows a schematic structural diagram of an air imaging control system provided by an embodiment of the present application. Figure 1 As shown, the air imaging control system 100 of the embodiment of the present application may include: an image acquisition device 101 and an air imaging device 102 .

[0057] The image acquisition device 101 is communicatively connected to the air imaging device 102 .

[0058] The image acquisition device 101 is used to acquire environmental images.

[0059] The environmental image is used to represent the image within the imaging range of the air imaging device 102. The environmental image is usually acquired when the air imaging device 102 is in the on state. This avoids the image acquisition device 101 from continuously operating when the air imaging device 102 is in the off state, thereby reducing the resource consumption of the image acquisition device 101.

[0060] Image acquisition device 101 may be an image sensor for collecting or capturing images, and may be in the form of a camera or a camera. For example, image acquisition device 101 may be a depth camera. Depth cameras are capable of achieving higher modulation frequencies and depth accuracy, resulting in higher clarity in the environmental images captured by the depth camera. This, in turn, better assists the air imaging device 102 in determining the position of the user's eyes, thereby more accurately calculating the offset angle.

[0061] The offset angle is the angle at which the air imaging device 102 needs to be deflected.

[0062] The air imaging device 102 is used to obtain an environmental image from the image acquisition device 101 .

[0063] In some embodiments, the air imaging device 102 may actively acquire the environment image from the image acquisition device 101. Alternatively, the air imaging device 102 may receive the environment image sent by the image acquisition device 101.

[0064] The air imaging device 102 is used to display the target image.

[0065] The target image is the image content to be displayed in the air imaging device 102. The target image may include a first target image and a second target image. The image content of the first target image and the second target image are the same, and the imaging angle of the first target image and the imaging angle of the second target image are different.

[0066] The air imaging device 102 is further used to perform image analysis on the environment image and determine the imaging angle of the target image.

[0067] In some embodiments, the air imaging device 102 is further configured to convert the environment image into a depth map and determine the imaging angle of the target image based on the depth map, thereby enabling the air imaging device 102 to more accurately determine the position information of the user's eyes.

[0068] The depth map is an image used to reflect the distance between the user and the image acquisition device 101 in a real space.

[0069] The air imaging device 102 is also used to project a target image at a certain imaging angle to the user's eyes.

[0070] In some embodiments, the air imaging device 102 may be integrated with the image acquisition device 101. Based on this, the air imaging device 102 can realize the function of acquiring environmental images. Exemplarily, the air imaging device 102 is integrated with a camera, which is used to acquire environmental images.

[0071] In some embodiments, as Figure 2 As shown, the air imaging device 102 may include: a control device 1020 , a first projection device 1021 and a second projection device 1022 .

[0072] The control device 1020 may include a central processing unit (CPU), a microcontroller unit (MCU), or a single-chip microcomputer control system, etc. The control device 1020 may receive or send instructions, and control different hardware devices to perform corresponding operations through different instructions.

[0073] The control device 1020 is used to obtain an environment image from the image acquisition device 101.

[0074] In some embodiments, the control device 1020 may actively acquire the environment image from the image acquisition device 101. Alternatively, the control device 1020 may receive the environment image sent by the image acquisition device 101.

[0075] The control device 1020 is further configured to determine an imaging angle of the first target image and an imaging angle of the second target image according to the environment image.

[0076] In some embodiments, the control device 1020 is further configured to convert the environment image into a depth map, and determine an imaging angle of the first target image and an imaging angle of the second target image according to the depth map.

[0077] The control device 1020 is further configured to control the first projection device 1021 to project a first target image at a certain imaging angle toward one of the user's eyes.

[0078] The control device 1020 is further configured to control the second projection device 1022 to project a second target image at a certain imaging angle to the other eye of the user.

[0079] The control device 1020 is communicatively connected to the first projection device 1021 and the second projection device 1022 , respectively. The size of the second projection device 1022 is smaller than or equal to the size of the first projection device 1021 .

[0080] The first projection device 1021 is used to display a first target image.

[0081] The second projection device 1022 is used to display a second target image.

[0082] like Figure 3 As shown, the first projection device 1021 may be disposed above the second projection device 1022 , and the size of the second projection device 1022 is generally smaller than that of the first projection device 1021 .

[0083] In some embodiments, both the first projection device 1021 and the second projection device 1022 may utilize a directional light source LCD screen operating at a frequency of 120 Hz. This allows both the first projection device 1021 and the second projection device 1022 to have a higher refresh rate and a faster response speed, ensuring that both the first projection device 1021 and the second projection device 1022 can display the target image more smoothly, avoiding flickering and image retention in the target image, and thus reducing damage to the user's eyes.

[0084] The directional light source liquid crystal screen is a transparent screen composed of a plurality of lattice arrangements and combinations. The material of the transparent screen can be transparent materials such as glass, tempered glass or acrylic.

[0085] In some embodiments, the air imaging device 102 may further include: a first angle adjustment device 1023 and a second angle adjustment device 1024 .

[0086] The first angle adjustment device 1023 and the second angle adjustment device 1024 are both in communication connection with the control device 1020 .

[0087] The control device 1020 is further used to control the first angle adjustment device 1023 and the second angle adjustment device 1024 to adjust the imaging angle.

[0088] The first projection device 1021 is connected to the first angle adjustment device 1023. The first angle adjustment device 1023 can be set around the first projection device 1021. Alternatively, the first angle adjustment device 1023 can be set in the center of the first projection device 1021, which is not specifically limited in this application.

[0089] The first angle adjustment device 1023 is used to adjust the imaging angle of the first projection device 1021 .

[0090] The second projection device 1022 is connected to the second angle adjustment device 1024. The second angle adjustment device 1024 can be arranged around the second projection device 1022. Alternatively, the second angle adjustment device 1024 can be arranged in the center of the second projection device 1022, which is not specifically limited in this application.

[0091] The second angle adjustment device 1024 is used to adjust the imaging angle of the second projection device 1022 .

[0092] In some embodiments, as Figure 2 As shown, the air imaging device 102 may further include a refraction device 1025 . The refraction device 1025 is in communication with the control device 1020 .

[0093] like Figure 3 As shown, the refraction device 1025 is disposed between the first projection device 1021, the second projection device 1022 and the user's eyes. For example, the refraction device 1025 may be a negative refraction plate.

[0094] The refraction device 1025 is configured to project the first target image into one eye of the user and project the second target image into the other eye of the user.

[0095] When the air imaging device 102 is turned on, both the first projection device 1021 and the second projection device 1022 are illuminated. At this point, the first projection device 1021 displays the first target image, and the second projection device 1022 displays the second target image. The light emitted by the first projection device 1021 and the light emitted by the second projection device 1022 can be considered LED light sources in directional light source technology.

[0096] Directional light technology projects different images displayed on a directional light LCD screen at different times to the user's left or right eye, utilizing the parallax between the left and right eyes to create stereoscopic vision. This means that users can observe three-dimensional visual information without the need for auxiliary equipment (such as VR glasses).

[0097] like Figure 3 As shown, light emitted by the first projection device 1021, after adjusting its imaging angle, passes through the refraction device 1025, displaying a first target image at a predetermined imaging angle and projecting it into the user's left eye. Light emitted by the second projection device 1022, after adjusting its imaging angle, passes through the refraction device 1025, displaying a second target image at a predetermined imaging angle and projecting it into the user's right eye. Thus, by leveraging the parallax between the left and right eyes, the user's brain superimposes the first and second target images, each with a different imaging angle, to create a three-dimensional image with a stereoscopic effect.

[0098] In some embodiments, as Figure 1 As shown, optionally, the air imaging control system 100 of the embodiment of the present application may further include: a server 103 , which is communicatively connected to both the air imaging device 102 and the image acquisition device 101 .

[0099] The server 103 is configured to obtain an environment image from the image acquisition device 101 .

[0100] The server 103 is further configured to perform image analysis on the environment image and determine the imaging angle.

[0101] The server 103 is further configured to send the imaging angle to the air imaging device 102 , so that the air imaging device 102 adjusts the imaging angle.

[0102] Specifically, the server 103 is further configured to send the imaging angle to the control device 1020 , so that the control device 1020 adjusts the imaging angle of the first projection device 1021 and / or the imaging angle of the second projection device.

[0103] Based on the above description, the following Figure 4 , which details the specific implementation process of an air imaging control method in an embodiment of the present application.

[0104] See also Figure 4 , Figure 4 FIG. 1 shows a flow chart of an air imaging control method provided by an embodiment of the present application. Figure 4 As shown, the air imaging control method of the embodiment of the present application may include:

[0105] S101: Obtain position information of the user's eyes.

[0106] The binocular position information is used to represent the coordinates of the user's binoculars in real space. The binocular position information includes the position information of the user's left eye and the position information of the user's right eye.

[0107] The air imaging device 102 may actively obtain the position information of the user's eyes from other electronic devices. Alternatively, the air imaging device 102 may receive the position information of the user's eyes from other electronic devices.

[0108] Other electronic devices may be laptop computers, desktop computers, tablet computers, etc., and this application does not impose any specific restrictions on them.

[0109] In some embodiments, an image capture device 101 can capture an environmental image. Image capture device 101 can transmit the environmental image to another electronic device. The other electronic device can then perform image analysis on the environmental image to obtain information about the position of the user's eyes. This allows the air imaging device 102 to obtain information about the position of the user's eyes from the other electronic device. S102: Determine a first offset angle and a second offset angle based on the eye position information.

[0110] The first offset angle is the angle at which the first projection device 1021 needs to be deflected. The second offset angle is the angle at which the second projection device 1022 needs to be deflected, and the first offset angle and the second offset angle are not equal.

[0111] After obtaining the position information of the user's eyes, the air imaging device 102 may determine an offset angle of the air imaging device 102 based on the position information of the eyes. Specifically, the air imaging device 102 may determine a first offset angle based on the position information of one eye of the user. The air imaging device 102 may also determine a second offset angle based on the position information of the other eye of the user. It is understood that when one eye is the right eye, the other eye is the left eye; and when one eye is the left eye, the other eye is the right eye.

[0112] S103 : Adjusting the imaging angle of the first projection device based on the first offset angle, and adjusting the imaging angle of the second projection device based on the second offset angle.

[0113] After determining the offset angle, the air imaging device 102 may adjust the imaging angle of the first projection device 1021 based on the first offset angle. The air imaging device 102 may adjust the imaging angle of the second projection device 1022 based on the second offset angle.

[0114] In some embodiments, after determining the offset angle, the air imaging device 102 may adjust the imaging angle of the first projection device 1021 using a first angle adjustment device based on the first offset angle. The air imaging device 102 may adjust the imaging angle of the second projection device 1022 using a second angle adjustment device based on the second offset angle.

[0115] When the air imaging device 102 adjusts the offset angle for the first time, the air imaging device 102 may adjust the imaging angle of the first projection device 1021 and / or the imaging angle of the second projection device 1022. After the initial adjustment of the imaging angle, if the position information of the user's left eye or right eye changes, the air imaging device 102 may continue to adjust the imaging angle of the first projection device 1021 and / or the imaging angle of the second projection device 1022 based on the previous adjustment of the imaging angle.

[0116] Thus, the air imaging device 102 can obtain the first projection device 1021 and the second projection device 1022 after adjusting the imaging angle.

[0117] S104 , obtaining a first target image by using the first projection device after adjusting the imaging angle, and obtaining a second target image by using the second projection device after adjusting the imaging angle.

[0118] The screen content of the first target image is the same as the screen content of the second target image, and the imaging angle of the first target image is different from the imaging angle of the second target image.

[0119] The air imaging device 102 can project a first target image using the first projection device 1021 after adjusting the imaging angle. The air imaging device 102 can also project a second target image using the second projection device 1022 after adjusting the imaging angle. Thus, the air imaging device 102 can obtain the first target image and the second target image.

[0120] S105 : Projecting the first target image to one eye of the user, and projecting the second target image to the other eye of the user.

[0121] After obtaining the first target image and the second target image, the air imaging device 102 may project the first target image to one eye of the user and the second target image to the other eye of the user.

[0122] In some embodiments, as Figure 3 As shown, after obtaining the first target image and the second target image, the air imaging device 102 may project the first target image to one of the user's eyes using the refraction device 1025. The air imaging device 102 may project the second target image to the other of the user's eyes using the refraction device 1025.

[0123] The air imaging control method of an embodiment of the present application can determine the coordinates of the user's eyes in real space by obtaining the position information of the user's eyes. Based on the position information of the eyes, a first offset angle and a second offset angle can be determined. The first offset angle and the second offset angle can then be determined based on the coordinates of the eyes in real space. Subsequently, the imaging angle of the first projection device can be adjusted based on the first offset angle, and the imaging angle of the second projection device can be adjusted based on the second offset angle. The first projection device, after adjusting the imaging angle, can obtain a first target image, and the second projection device, after adjusting the imaging angle, can obtain a second target image. This allows the display of first and second target images with identical content but different imaging angles. The first target image can then be projected into one of the user's eyes, and the second target image can be projected into the other eye, allowing the first and second target images, as seen by both eyes, to be superimposed into a three-dimensional image. This allows two two-dimensional images projected by the air imaging device at different imaging angles to be projected into a specific eye, where they are then superimposed into a three-dimensional image in the user's brain, creating a stereoscopic three-dimensional visual effect and enhancing the presentation quality.

[0124] In the embodiment of the present application, the air imaging device 102 may determine the offset angle in a variety of implementations.

[0125] Based on the description of S102 , a feasible implementation manner in which the air imaging device 102 determines the first offset angle and the second offset angle is described below by way of example.

[0126] In some embodiments, the air imaging device 102 may determine the first offset angle and the second offset angle using an imaging algorithm of geometric optics according to the position information of both eyes.

[0127] Specifically, the air imaging device 102 may determine the focal point of the first projection device 1021, the focal point of the second projection device 1022, the distance between the user's left eye and the first projection device 1021, and the distance between the user's right eye and the second projection device 1022. The air imaging device 102 may then substitute the focal point of the first projection device 1021 and the distance between the user's left eye and the first projection device 1021 into the calculation formula of the geometric optics imaging algorithm to obtain a first offset angle. The air imaging device 102 may also substitute the focal point of the second projection device 1022 and the distance between the user's right eye and the second projection device 1022 into the calculation formula of the geometric optics imaging algorithm to obtain a second offset angle.

[0128] The distance between the user's left eye and the first projection device 1021 can be calculated by the air imaging device 102 according to the coordinates of the user's left eye and the coordinates of the first projection device 1021 .

[0129] The distance between the user's right eye and the second projection device 1022 can be calculated by the air imaging device 102 according to the coordinates of the user's left eye and the coordinates of the first projection device 1021 .

[0130] In addition, the air imaging device 102 may record the angle formed between the user's eyes and the plane where the first projection device 1021 is located, or the angle formed between the user's eyes and the plane where the second projection device 1022 is located as the first angle. The first angle is greater than or equal to 0° and less than or equal to 90°.

[0131] The change in the first angle is used to represent the change in position information of the user's eyes.

[0132] The ratio between the first angle and the first offset angle or the second offset angle is a first ratio. The first ratio is used to reflect the changing relationship between the position information of the user's eyes and the first offset angle or the second offset angle. For example, the first ratio is 15:1. That is, if the first angle is adjusted by 15°, then the offset angle is adjusted by 1° according to the first ratio. Here, "adjust" can be understood as increasing or decreasing.

[0133] As can be seen, the air imaging device 102 can promptly adjust the imaging angles of the first projection device 1021 and the second projection device 1022 when the position information of the user's eyes changes. This ensures that when the user is in different positions, the user's eyes can always observe the first target image and the second target image with the same content but different imaging angles, thus realizing the three-dimensional visual display of the air imaging device 102.

[0134] In some embodiments, before executing S101 , the air imaging device 102 may further acquire an environment image.

[0135] The environment image may be an image captured in real time by the image capture device 101. Alternatively, the environment image may be an image pre-stored in other electronic devices.

[0136] The environment image is used to represent the image within the imaging range of the air imaging device 102 .

[0137] Based on the above description, after acquiring the environment image, the air imaging device 102 can determine the position information of the user's eyes.

[0138] A feasible implementation manner in which the air imaging device 102 determines the position information of the user's eyes based on the environment image is described in detail below.

[0139] Considering that the user may or may not be present in the environmental image, if the user is present in the environmental image, the air imaging device 102 may continue to determine the position information of the user's eyes. If the user is not present in the environmental image, the air imaging device 102 cannot determine the position information of the user's eyes and cannot continue to perform S102-S105.

[0140] Therefore, the air imaging device 102 can determine whether there is a user in the environment image. If there is a user in the environment image, the air imaging device 102 can determine the position information of the user's eyes based on the environment image in response to the presence of the user in the environment image.

[0141] Specifically, the air imaging device 102 may employ a target detection algorithm to determine whether a user is present in the ambient image. If a user is present in the ambient image, the air imaging device 102 may employ a histogram-based positioning method, a near-infrared eye positioning algorithm, or a binarization-based eye positioning method to determine the position information of the user's eyes. It should be understood that the aforementioned target detection algorithm, histogram-based positioning method, near-infrared eye positioning algorithm, or binarization-based eye positioning method are merely examples of image recognition algorithms. For specific implementations, please refer to related technologies.

[0142] If there is no user in the environment image, the air imaging device 102 may determine that the first projection device 1021 and the second projection device 1022 are in the initial state in response to the absence of the user in the environment image, thereby reducing resource consumption of the air imaging device 102.

[0143] The initial state is used to represent the state before the imaging angles of the first projection device 1021 and the second projection device 1022 are adjusted. In other words, the initial state is used to represent the state where the first offset angle and the second offset angle are both zero.

[0144] Before the imaging angle is adjusted, if there is no user in the environment image, the air imaging device 102 may determine that the first projection device 1021 and the second projection device 1022 remain in their initial states.

[0145] After any imaging angle adjustment, if no user is present in the ambient image, the air imaging device 102 may adjust the imaging angle of the first projection device 1021 to 0 based on the first offset angle, and adjust the imaging angle of the second projection device 1022 to 0 based on the second offset angle, based on any previous imaging angle adjustment. This allows the first projection device 1021 and the second projection device 1022 to be adjusted from their current offset states to their initial states, thereby increasing the service life of the first projection device 1021 and the service life of the second projection device 1022 and reducing the power consumption of the air imaging device 102.

[0146] An embodiment of the present application further provides a readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0147] An embodiment of the present application provides a computer program product. When the computer program product is run on a mobile terminal, the mobile device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0148] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0149] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0150] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the above-mentioned device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0151] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0152] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0153] In the embodiments provided in this application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely illustrative. For example, the division of the above modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0154] The units described above as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0155] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. An air imaging control method, characterized in that: The method is applied to an air imaging device, the air imaging device comprising a first projection device and a second projection device, wherein the size of the second projection device is smaller than or equal to the size of the first projection device, and the method comprises: Acquire position information of the user's eyes, where the position information of the eyes is used to represent the coordinates of the user's eyes in real space; Determining a first offset angle and a second offset angle according to the position information of the two eyes, wherein the first offset angle and the second offset angle are not equal; adjusting an imaging angle of the first projection device based on the first offset angle, and adjusting an imaging angle of the second projection device based on the second offset angle; Obtaining a first target image using the first projection device after adjusting the imaging angle, and obtaining a second target image using the second projection device after adjusting the imaging angle, wherein the first target image and the second target image have the same screen content, and the imaging angles of the first target image and the second target image are different; The first target image is projected to one eye of the user, and the second target image is projected to the other eye of the user.

2. The method according to claim 1, wherein The determining of the offset angle according to the position information of the two eyes includes: The first offset angle and the second offset angle are determined according to the position information of the two eyes using an imaging algorithm of geometric optics.

3. The method according to claim 1, wherein The method further comprises: Acquire an environmental image, wherein the environmental image is used to represent an image within an imaging range of the air imaging device; The obtaining of the position information of the user's eyes includes: In response to the user being present in the environment image, position information of both eyes of the user is determined according to the environment image.

4. The method according to claim 3, wherein The method further comprises: In response to the absence of the user in the environment image, the first projection device and the second projection device are determined to be in an initial state, where the initial state is used to represent a state before the first projection device and the second projection device have not adjusted their imaging angles.

5. The method according to any one of claims 1 to 4, characterized in that The air imaging device further comprises: a first angle adjustment device and a second angle adjustment device, the first angle adjustment device being connected to the first projection device, and the second angle adjustment device being connected to the second projection device; The adjusting the imaging angle of the first projection device based on the first offset angle includes: Based on the first offset angle, adjusting the imaging angle of the first projection device using the first angle adjustment device; The adjusting the imaging angle of the second projection device based on the second offset angle includes: Based on the second offset angle, the imaging angle of the second projection device is adjusted using the second angle adjustment device.

6. The method according to any one of claims 1 to 4, characterized in that The air imaging device further includes a refraction device, and the method further includes: The first object image is projected to one of the user's eyes using the refraction device, and the second object image is projected to the other of the user's eyes using the refraction device.

7. An air imaging device, characterized in that: The device comprises a control device, a first projection device, and a second projection device, wherein the first projection device and the second projection device are both communicatively connected to the control device, and the size of the second projection device is smaller than or equal to the size of the first projection device; The control device is used to obtain position information of the user's eyes, where the position information of the eyes is used to represent the coordinates of the user's eyes in real space; The control device is further configured to determine an offset angle based on the position information of the two eyes, wherein the offset angle includes a first offset angle and a second offset angle, and the first offset angle and the second offset angle are not equal; The control device is further configured to adjust the imaging angle of the first projection device based on the first offset angle, and to adjust the imaging angle of the second projection device based on the second offset angle; The control device is further configured to obtain a first target image using the first projection device after adjusting the imaging angle, and obtain a second target image using the second projection device after adjusting the imaging angle, wherein the first target image and the second target image have the same screen content, and the imaging angles of the first target image and the second target image are different; The control device is further configured to project the first target image into one of the user's eyes, and project the second target image into the other of the user's eyes; The first projection device is used to display the first target image; The second projection device is used to display the second target image.

8. The air imaging device according to claim 7, wherein The air imaging device further includes: a first angle adjustment device and a second angle adjustment device, both of which are communicatively connected to the control device, the first projection device is connected to the first angle adjustment device, and the second projection device is connected to the second angle adjustment device; The first angle adjustment device is used to adjust the imaging angle of the first projection device based on the first offset angle; The second angle adjustment device is used to adjust the imaging angle of the second projection device based on the second offset angle.

9. An air imaging control system, characterized in that: The system comprises: an image acquisition device and the air imaging device according to claim 7 or 8, wherein the image acquisition device and the air imaging device are communicatively connected; The image acquisition device is used to acquire an environmental image, and the environmental image is used to represent an image within the imaging range of the air imaging device; The air imaging device is further used to determine the position information of the user's eyes based on the environment image captured by the image capture device.

10. A readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images