Optical system and electronic equipment

By designing optical systems with opposite and similar sizes of cameras and imaging lenses in VR devices, combined with reflection components, the complex problem of software algorithm paths in the imaging processing of VR devices is solved, reducing delay, load and power consumption, and improving VR experience.

CN118897401AActive Publication Date: 2024-11-05HUAWEI TECH CO LTD

Patent Information

Application Number
CN202310498410.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-05
Publication Date
2024-11-05
Estimated Expiration
2043-05-05

AI Technical Summary

Technical Problem

The existing VR devices have complex software algorithm paths during imaging processing, resulting in high delay, load and power consumption, affecting the user's virtual reality experience.

Method used

By designing the optical distortion symbols of the camera and the imaging lens to cancel each other out of the same size, thereby reducing or eliminating the anti-distortion processing algorithm, the real-life image captured by the camera is directly transmitted to the display screen, and combining the reflection component to ensure the accuracy of the image depth information. Simplify the software algorithm path.

Benefits of technology

It reduces the delay, load and power consumption from the user's head to the viewing of the picture, improves the user's virtual reality experience, and simplifies the structure and cost of the optical system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118897401A_ABST
    Figure CN118897401A_ABST
Patent Text Reader

Abstract

The invention discloses an optical system and electronic equipment, which are used for reducing the complexity of a software algorithm path of the electronic equipment in an imaging process. Wherein the optical system comprises a camera, a display screen and an imaging lens, the camera has first optical distortion, the imaging lens has second optical distortion, the sign of the first optical distortion is opposite to that of the second optical distortion, and the absolute value of the sum value of the first optical distortion and the second optical distortion is smaller than a distortion threshold value. The distortion symbols of the camera and the imaging lens are configured to be opposite and similar, so that the distortion generated after the light passes through the camera and the imaging lens can be mutually counteracted, an anti-distortion processing algorithm is not introduced any more, and the complexity of a software algorithm path can be simplified.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of optical technology, and in particular to an optical system and an electronic device. Background Art

[0002] Virtual reality (VR), augmented reality (AR), mixed reality (MR), extended reality (XR) and other technologies are commonly used to present the virtual world to users. They have developed rapidly in recent years. AR, MR and XR are all based on VR. Currently, technologies such as VR are often combined with video see through technology (VST). For example, in MR scenarios, VR devices can capture real scene information in real time through cameras, allowing users to still have the ability to perceive the real world around them while wearing VR devices, giving users a feeling of being able to interact with the real world through the screen, improving users' virtual reality experience.

[0003] However, after obtaining the real-life image captured by the camera, existing VR devices usually need to send it to the upper-level algorithm module for a series of processing including anti-distortion and reprojection, and then present the processed image to the user. However, this method involves a long software algorithm path, resulting in a relatively high delay, power consumption and load from motion to photon (MTP) (i.e., from the user turning his head to the user seeing the image after turning his head), which is not conducive to improving the user's VST experience.

[0004] Therefore, there is still room for further research on imaging processing of electronic devices (such as VR devices). Summary of the invention

[0005] The present application provides an optical system and an electronic device for simplifying the complexity of the software algorithm path of the electronic device during the imaging process, reducing the delay, load and power consumption of MTP, and improving the user's VST experience.

[0006] In a first aspect, the present application provides an optical system, which includes a camera, a display screen, and an imaging lens, wherein the camera has a first optical distortion, the imaging lens has a second optical distortion, the first optical distortion and the second optical distortion have opposite signs, and the absolute value of the sum of the first optical distortion and the second optical distortion is less than a distortion threshold. The camera is used to photograph a target object to obtain a first image; the display screen is used to display the first image; and the imaging lens is used to magnify the first image displayed on the display screen.

[0007] In the above scheme, by configuring the distortion of the camera and the imaging lens to have opposite signs and similar sizes, the distortion generated after the light passes through the camera and the imaging lens can cancel each other out. In this way, there is no need to introduce an anti-distortion processing algorithm, thereby streamlining the complexity of the software algorithm path. The software algorithm path can even be deleted, and the real-life image captured by the camera can be directly transmitted to the display screen for display, so as to effectively reduce the MTP delay, load and power consumption, and improve the user's VST experience.

[0008] In a possible design, the first optical distortion is negative distortion, and the second optical distortion is positive distortion. For example, when designing an optical system, the lens of the camera can be configured as a concave lens, and the lens of the imaging lens can be configured as a convex lens, and the distortion size of the two lenses under the same field of view can be similar. In this way, the positive distortion of the original convex lens of the imaging lens can be directly used to configure the lens of the camera as an opposite concave lens, so as to introduce as few lenses as possible and reduce the cost and structural complexity of the optical system.

[0009] In a possible design, the distortion threshold may be a value less than 15%. For example, when the distortion threshold is configured to be 10%, the sum of the first optical distortion and the second optical distortion is in the range of [-10%, 10%], thus taking both cost and imaging effect into consideration.

[0010] In one possible design, the optical system may further include a reflective component, which is used to reflect the emitted light from the camera to the target object, and to reflect the reflected light from the target object back to the camera, wherein the distance from the camera's emitted light to the target object after reflection by the reflective component is equal to the distance of the user's eyes looking at the target object.

[0011] In this design, by adding a reflective component to the optical system, the distance from the camera to the object after reflection by the reflective component can be made the same as the distance from the human eye to the object, thereby eliminating the axial distance between the camera and the human eye in the existing optical system, so that the viewing angle range of the camera to shoot the object is consistent with the viewing angle range of the human eye to see the object, ensuring the accuracy of the depth information of the image obtained by the camera shooting the object. In addition, since the depth information of the image directly shot by the camera itself is accurate, the re-projection algorithm can be omitted before the image shot by the camera is transmitted to the display screen, thereby further simplifying the complexity of the software algorithm path.

[0012] In a possible design, the reflective component may include one or more reflective elements. For example, in a scenario where system cost and structural complexity need to be saved, the reflective component may be configured to include only one reflective element. In a scenario where the overall size of the electronic device needs to be reduced, the reflective component may be configured to include at least two reflective elements, so as to utilize the reflection between at least two reflective elements to reduce the size of the optical system in one or more directions, thereby realizing a miniaturized design of the electronic device.

[0013] In a possible design, the reflective element may be an optical element having at least one reflective surface, such as a reflective mirror or a reflective prism. By using a relatively common and low-cost reflective mirror or a reflective prism as the reflective element, the cost and complexity of the optical system can be reduced.

[0014] In a second aspect, the present application provides an optical system, which includes a camera, a reflective component, a display screen and an imaging lens, wherein the camera is used to emit a first light, receive a second light reflected from the reflective component, and obtain a first image after processing the second light; the reflective component is used to reflect the first light from the camera to a target object, and reflect the second light from the target object back to the camera, wherein the distance from the first light from the camera to the target object after being reflected by the reflective component is equal to the distance of the user's eyes looking at the target object; the display screen is used to display the first image; and the imaging lens is used to magnify the first image displayed on the display screen to obtain a second image.

[0015] In the above scheme, by adding a reflective component to the optical system, the distance from the camera to the object after reflection by the reflective component can be made the same as the distance from the human eye to the object, thereby eliminating the axial distance between the camera and the human eye in the existing optical system, so that the viewing angle range of the camera to shoot the object is consistent with the viewing angle range of the human eye to see the object, ensuring the accuracy of the depth information of the image obtained by the camera shooting the object. In addition, since the depth information of the image directly shot by the camera itself is accurate, before the image shot by the camera is transmitted to the display screen, the re-projection algorithm can no longer be introduced, thereby simplifying the complexity of the software algorithm path, and even the software algorithm path can be deleted, and the real-scene image shot by the camera can be directly transmitted to the display screen for display, so as to effectively reduce the delay, load and power consumption of MTP and improve the user's VST experience.

[0016] In one possible design, the camera may have a first optical distortion, and the imaging lens may have a second optical distortion, the first optical distortion and the second optical distortion have opposite signs, and the absolute value of the sum of the first optical distortion and the second optical distortion is less than a distortion threshold.

[0017] In a possible design, the first optical distortion may be negative distortion, and the second optical distortion may be positive distortion.

[0018] In one possible design, the distortion threshold may be less than 15%.

[0019] In one possible design, the reflective component may include one or more reflective elements.

[0020] In a possible design, the reflective element may be a mirror or a prism.

[0021] In a third aspect, the present application provides an electronic device comprising the optical system described in any one of the designs of the first aspect or the second aspect.

[0022] In one possible design, the electronic device can be a near-field display device, such as VR glasses or a VR helmet, or it can be a terminal device with a display screen, such as a mobile phone, monitor, television, HUD, etc., without specific limitation.

[0023] For the beneficial effects of the second to third aspects, please refer to the technical effects that can be achieved by the corresponding design in the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 An exemplary diagram of field of view distortion curves at different wavelengths provided in an embodiment of the present application is shown;

[0025] Figure 2 A schematic diagram of image distortion forms of negative distortion and positive distortion provided by an embodiment of the present application is exemplarily shown;

[0026] Figure 3 A schematic diagram showing the structure of an electronic device provided by an embodiment of the present application is exemplified;

[0027] Figure 4 An exemplary system architecture diagram of an electronic device provided in an embodiment of the present application is shown;

[0028] Figure 5 A schematic diagram of an imaging scheme of an optical system provided by the industry is exemplified;

[0029] Figure 6 A schematic diagram of an imaging scheme of an optical system provided in an embodiment of the present application is exemplarily shown;

[0030] Figure 7 A schematic diagram showing the structure of another optical system provided by an embodiment of the present application is exemplified;

[0031] Figure 8 The structural schematic diagram of another optical system provided in an embodiment of the present application is exemplarily shown. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical scheme and advantages of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings. However, the example implementation can be implemented in various forms and should not be construed as being limited to the implementations set forth herein. The same reference numerals in the figures represent the same or similar structures, and thus their repeated description will be omitted. The words expressing position and direction described in the embodiments of the present application are all illustrated by taking the accompanying drawings as examples, but changes may be made as needed, and the changes made are all included in the scope of protection of the present application. The drawings of the embodiments of the present application are only used to illustrate the relative position relationship and do not represent the true proportion.

[0033] It should be noted that specific details are described in the following description to facilitate understanding of the present application. However, the embodiments of the present application can be implemented in a variety of other ways different from those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the embodiments of the present application. Therefore, the present application is not limited to the specific implementation methods disclosed below.

[0034] Below, some terms in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

[0035] 1. Near to eye display (NED).

[0036] NED, also known as head-mounted display or wearable display, is a display mode of augmented reality (AR), virtual reality (VR), mixed reality (MR) or extended reality (XR). NED displays close to the eyes and can create virtual images in the monocular or binocular field of view. It renders light field information to the human eye through a display device placed within the non-clear vision distance of the human eye (usually less than 25 cm), thereby reconstructing the virtual scene in front of the eyes.

[0037] 2. Field of view (FOV).

[0038] In optical instruments, the angle formed by the two edges of the maximum range of the image of the object to be measured that can pass through the lens is called FOV, with the lens of the optical instrument as the vertex. Simply put, FOV can also be understood as the angle between the edge of the display screen and the line connecting the observation point (eye). The larger the display screen, the higher the FOV requirement.

[0039] 3. Video see-through (VST).

[0040] VST technology is a perspective technology applicable to AR scenes, VR scenes, MR scenes or XR scenes. VST technology can collect real-time views of the surrounding environment through the camera and display them through the display screen, giving users a feeling that the human eye can directly see the real world around them through the display device, thereby providing users with virtual imaging while improving the ability of users to interact with the real world around them. In recent years, it has gradually become the mainstream research direction in the NED field.

[0041] 4. Dispersion.

[0042] Dispersion refers to the phenomenon of decomposing complex light into monochromatic light to form a spectrum. For example, complex light is decomposed into three different colors of light: red (red, R), green (green, G), and blue (blue, B). R, G, and B have different wavelengths.

[0043] 5. Distortion.

[0044] Distortion, also known as distortion, is a monochromatic optical aberration that describes how the magnification of an image changes across the field of view at a fixed working distance. Distortion is determined by the optical design of the lens and usually exists in parallel with dispersion. For example, see Figure 1 As shown, it shows a field of view distortion curve diagram of different wavelengths, wherein the curve L R is the distortion curve corresponding to red (R) light, curve L G is the distortion curve corresponding to green (G) light, curve L B is the distortion curve corresponding to blue (B) light. Figure 1 It can be seen that the distortion curves of the three colors of R, G, and B do not overlap with each other; and for any monochromatic light, the distortion will increase with the increase of the field of view, that is, a larger field of view is more prone to distortion than a smaller field of view.

[0045] Distortion can usually be divided into negative distortion and positive distortion. Figure 2 As shown, it shows a schematic diagram of image distortion forms of negative distortion and positive distortion. Among them, Figure 2 (A) shows the image distortion form of negative distortion, where the points in the field of view are closer to the center and the shape is like a barrel, so it can also be called barrel distortion. Figure 2 The image distortion form of positive distortion is shown in (B), where the points in the field of view are farther away from the center and the shape is like a pillow, so it can also be called pillow distortion.

[0046] The degree of distortion can be measured by relative distortion, which is calculated using the following formula (1):

[0047]

[0048] Where Dist is the relative distortion; y′ is the actual image height, which is defined as the height of the actual light on the image plane; y0′ is the ideal image height, which is defined as the height of the reference light on the image plane after scaling by the field of view ratio.

[0049] In the above formula (1), the ideal image height y0′ is related to the optical design of the lens. Usually, once the lens is manufactured, its ideal image height is fixed. The real image height y′ is related to the FOV of the lens, the optical design of the lens, and the manufacturing deviation. The smaller the FOV, the smaller the real image height, and the slighter the relative distortion. Conversely, the larger the FOV, the larger the real image height, and the more serious the relative distortion.

[0050] The following introduces some technical features involved in the embodiments of the present application.

[0051] Figure 3 The following is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device may be a NED device, such as VR glasses, VR helmets, or AR glasses, AR helmets, or MR glasses, MR helmets, or XR glasses, XR helmets, etc. Users can wear NED devices to play games, read, watch movies (or TV series), participate in virtual meetings, participate in video education, or video shopping, etc. In some embodiments, the electronic device may also be a terminal device with a display screen, such as a mobile phone, a monitor, a television, a head-up display (HUD) system in a vehicle, etc. Figure 1 The electronic device of the illustrated embodiment is described by taking VR glasses as an example.

[0052] refer to Figure 3 As shown, the electronic device may include a display module 100 and a fixed component 200, wherein the display module 100 is used to display an image, and the fixed component 200 can be used to support the display module 100, and when the user wears the electronic device, the display module 100 is fixed in front of the user's eyes. For example, when the electronic device is AR glasses or VR glasses, the fixed component 200 can be a temple and a frame, wherein the frame can be connected between two temples, and the display module 100 is fixed on the frame. For another example, when the electronic device is an AR helmet or a VR helmet, the fixed component 200 can be a helmet shell. The fixed component 200 can be a metal material or a plastic material, etc., which is not limited in this application. In addition, the image displayed by the display module 100 can be an image projected onto the display module 100 by a terminal device (such as a mobile phone, a tablet computer, etc.), or it can be an image formed by the display module 100 itself, which is not limited in this application.

[0053] Of course, in some other embodiments, when the electronic device is a mobile phone, the fixing component 200 can also be a shell of the mobile phone, and the shell can include a middle frame and a back cover, wherein the back cover can be fixed to one side of the middle frame, and the display module 100 is fixed to the other side of the middle frame opposite to the back cover. Exemplarily, the display module 100 can adopt a curved surface design, that is, the display module 100 is a curved screen. In this case, the edge areas on the two opposite sides of the display module 100 can be bent toward the back cover.

[0054] For reference Figure 4 As shown, Figure 4 A system architecture diagram of an electronic device provided in an embodiment of the present application.

[0055] It should be understood that the illustrated electronic device is only an example, and the electronic device may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.

[0056] like Figure 4 As shown, the electronic device may include a processor, a memory, a battery, a sensor module, a communication module, a camera, an eye tracking module, a microphone, a button, etc. Figure 4 Provide a detailed introduction to each component in an electronic device.

[0057] The processor is usually used to control the overall operation of the electronic device. The processor may include one or more processing units. For example, the processor may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. Among them, the controller can be the nerve center and command center of the electronic device. The controller can generate an operation control signal based on the instruction opcode and the timing signal to complete the control of fetching and executing instructions.

[0058] The memory is used to store instructions and data. The memory can exist independently of the processor or can be configured in the processor. In some embodiments, the memory in the electronic device can be a cache memory. The memory can save instructions or data that the processor has just used or circulated. If the processor needs to use the instruction or data again, it can be directly called from the memory to avoid repeated access, reduce the waiting time of the processor, and improve processing efficiency.

[0059] In some embodiments, the processor may include one or more input / output interfaces. For example, the input / output interface may include an integrated circuit (IC). 2 C) interface, universal asynchronous receiver / transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input / output (GPIO) interface, subscriber identity module (SIM) interface and / or universal serial bus (USB) interface, serial peripheral interface (SPI) interface, etc.

[0060] I 2 The I C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor may include multiple groups of I 2 C bus.

[0061] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor to the communication module. For example, the processor communicates with the Bluetooth module in the communication module through the UART interface to implement the Bluetooth function.

[0062] The MIPI interface can be used to connect the processor to peripheral devices such as display modules or cameras.

[0063] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor to a camera, a display module, a communication module, a sensor module, a microphone, etc. The GPIO interface can also be configured as I 2 C interface, I2S interface, UART interface, MIPI interface, etc.

[0064] The USB interface is an interface that complies with the USB standard specification, and can be specifically a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface can be used to connect a charger to charge the battery in an electronic device, and can also be used to transfer data between an electronic device and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as mobile phones. The USB interface can be USB3.0, which is used to be compatible with high-speed display port (DP) signal transmission, and can transmit high-speed video and audio data.

[0065] It is understandable that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0066] The communication module can provide wireless communication solutions for electronic devices, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC) or infrared (IR). The communication module can be one or more devices that integrate at least one communication processing module. The communication module can receive electromagnetic waves via an antenna, frequency modulate and filter the electromagnetic wave signals, and send the processed signals to the processor. The communication module can also receive the signal to be sent from the processor, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0067] In some embodiments, the electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0068] The camera is used to capture still images or videos. The object generates an optical image through the lens of the camera and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device may include one or more cameras.

[0069] In some embodiments, the camera captures images including real objects, and the processor may fuse the images captured by the camera with the virtual objects, and display the fused images through the display module.

[0070] In some embodiments, the camera may be further arranged on the lens to collect images including human eyes to form an eye tracking module, and the processor performs eye tracking through the images.

[0071] The optical display module is used to display the image captured by the camera. The optical display module includes a display screen, and the display screen includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed or a quantum dot light-emitting diode (QLED), etc. The display screen can be a rigid display screen, a flexible display screen, or a spliced ​​display screen composed of a rigid screen and a flexible screen, and is not specifically limited.

[0072] In some embodiments, the optical display module may further include an imaging lens, which is disposed outside the display screen. After the user wears the electronic device, the imaging lens is located between the display screen and the user's eyes, and is used to amplify the image displayed on the display screen so that the user can view a larger and clearer image, thereby improving the user's viewing experience.

[0073] A microphone, also called a "microphone" or "microphone", is used to convert sound signals into electrical signals. A user can make a sound by putting their mouth close to the microphone to input the sound signal into the microphone. An electronic device can be provided with at least one microphone. For example, in some embodiments, an electronic device can be provided with two microphones, which can not only collect sound signals but also realize a noise reduction function. Alternatively, in some embodiments, an electronic device can also be provided with three, four or more microphones, which can not only collect sound signals and realize the functions of noise reduction, but also identify the source of sound and realize a directional recording function, etc.

[0074] Keys are used by users to input instructions or information. Keys may include power keys and volume keys. Keys may be mechanical keys or touch keys. Electronic devices may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device.

[0075] The sensor module may include one or more of a pressure sensor, a gyroscope sensor, an acceleration sensor, a distance sensor, a temperature sensor, a touch sensor, and a bone conduction sensor. Each sensor is described in detail below.

[0076] The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor can be set on the display screen. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors or capacitive pressure sensors. A capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor, the capacitance between the electrodes changes. The electronic device determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen, the electronic device detects the intensity of the touch operation based on the pressure sensor. The electronic device can also calculate the touch position based on the detection signal of the pressure sensor. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions.

[0077] The gyroscope sensor can be used to determine the motion posture of the electronic device. In some embodiments, the angular velocity of the electronic device around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor. The gyroscope sensor can be used for anti-shake shooting. The gyroscope sensor can also be used in somatosensory game scenes, etc.

[0078] The accelerometer can detect the magnitude of the acceleration of the electronic device in all directions (usually three axes). When the electronic device is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of the electronic device.

[0079] A distance sensor is used to measure distance. The electronic device can measure distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device can use a distance sensor to measure distance to achieve fast focusing.

[0080] The temperature sensor is used to detect temperature. In some embodiments, the electronic device uses the temperature detected by the temperature sensor to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor exceeds a threshold, the electronic device reduces the performance of a processor located near the temperature sensor to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device heats the battery to avoid abnormal shutdown of the electronic device due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device boosts the output voltage of the battery to avoid abnormal shutdown due to low temperature.

[0081] A touch sensor is also called a "touch panel". The touch sensor can be set on a display screen. The touch sensor and the display screen form a touch screen, also called a "touch screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to an application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen. In other embodiments, the touch sensor can also be set on the surface of the electronic device, which is different from the position of the display screen.

[0082] The bone conduction sensor can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can also be set in the earphones to form bone conduction earphones. The audio module 170 can parse out the voice signal based on the vibration signal of the vocal bone block obtained by the bone conduction sensor 180M to realize the voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize the heart rate detection function.

[0083] although Figure 4 Not shown, the electronic device may further include other devices, such as a speaker, a Bluetooth device, a positioning device, a flashlight, a micro-projection device, a near field communication (NFC) device, etc., which are not described in detail here.

[0084] In electronic devices, the optical display module and the camera together constitute the optical system of the electronic device. In the optical system, the camera is also called a camera. Please refer to Figure 5 As shown, it shows a schematic diagram of an imaging scheme of an optical system provided by the industry. Among them:

[0085] Figure 5 (A) shows the layout and position relationship of each component in the optical system. Please refer to Figure 5 As described in (A), the optical system includes a camera 501, a display screen 502, and an imaging lens 503, and the optical axes of the camera 501, the display screen 502, and the imaging lens 503 coincide. The camera 501 is arranged in front of the human eye, the display screen 502 and the imaging lens 503 are arranged between the camera 501 and the human eye, and the imaging lens 503 is closer to the human eye than the display screen 502;

[0086] Figure 5 (B) shows the imaging process of the optical system. Please refer to Figure 5As shown in (B), the process includes: the camera 501 obtains a real scene image after shooting the target object, and sends the real scene image to the upper processor 510; the upper processor 510 uses a preset image processing algorithm to process the real scene image, and transmits the processed image to the display screen 502 for display; thereafter, the image displayed on the display screen 502 is magnified by the imaging lens 503, and the magnified image is presented to the user.

[0087] In the above imaging process, the image processing algorithm is pre-configured in the upper processor 510. In the VST scenario, it usually includes an anti-distortion processing algorithm and a reprojection algorithm. Alternatively, it may also include a fusion algorithm, such as fusing a real scene image with a virtual image to obtain a mixed virtual reality image. Alternatively, it may also include a pre-processing algorithm, such as blurring a real scene image. Alternatively, it may also include other algorithms. The following mainly introduces the anti-distortion dispersion processing algorithm and the reprojection algorithm.

[0088] Anti-distortion processing algorithm

[0089] In the design of the optical system, due to the limitation of product size and cost, the display screen 502 is usually not made very large. Therefore, in order to provide a larger FOV to enhance the user's immersion, an imaging lens 503 can be placed in front of the small display screen 502 to achieve the effect of a large FOV by magnifying the image displayed on the display screen 502. However, this also causes the image to be distorted after passing through the lens of the imaging lens 503, because the lens of the imaging lens 503 uses a convex lens design to magnify the image, but the convex lens itself has a pincushion distortion. Therefore, the real-scene image captured by the camera 501 needs to be subjected to an anti-distortion process before being transmitted to the display screen 502.

[0090] The specific process of anti-distortion processing can be found in Figure 5 As shown in (B), after the real scene image captured by the camera 501 is transmitted to the processor 510, it will undergo two processing operations: in the first processing, the processor 510 will perform distortion compensation on the real scene image, and obtain a distortion-free image by eliminating the distortion introduced by the camera 501 in the real scene image; in the second processing, the processor 510 will add a barrel distortion opposite to the pincushion distortion of the imaging lens 503 to the distortion-free image. In this way, the image to be processed after the two processing operations of the processor 510 is displayed on the display screen 502, and it also appears as an image with barrel distortion. The barrel distortion of the image is "offset" by the pincushion distortion generated by the imaging lens 503, so that the human eye sees a normal image from the electronic device.

[0091] In addition, it should be noted that distortion is a monochromatic optical aberration, that is, each monochromatic light corresponds to a distortion. Therefore, when adding reverse distortion to the real scene image, it is also necessary to add reverse distortion to each monochromatic light (such as R light, G light, B light) separately, so that the distortion and dispersion added to the real scene image are "offset" with the distortion and dispersion of the imaging lens 503 itself, and the distortion and dispersion problems are solved at the same time. Since distortion and dispersion exist at the same time, in some scenes, the anti-distortion processing algorithm is also called the anti-distortion dispersion processing algorithm.

[0092] Reprojection algorithm

[0093] In the optical system design, the camera 501 is set in front of the human eye, so there is an axial distance between the camera 501 and the human eye, such as Figure 5 Due to the existence of the axial distance Δh, the viewing angle depth (i.e. Figure 5 h1) shown in (A) is smaller than the visual depth seen by the human eye (i.e. Figure 5 h2) as shown in (A), thereby making the FOV (i.e. Figure 5 The V1 shown in (A) is smaller than the FOV seen by the human eye (i.e. Figure 5 In V2) shown in (A), the object captured by camera 501 in the real scene image is larger than the object seen by human eyes in the viewing image. Therefore, when the user turns his head, the above-mentioned depth difference will cause the rotation speed of the real scene captured by camera 501 to be faster than the user's head turning speed, which will cause the user to experience dizziness and incorrect depth perception. Therefore, the real scene image captured by camera 501 needs to be reprojected before being transmitted to display screen 502. For details, see Figure 5 As shown in (B), the real scene image captured by the camera 501 is first transmitted to the processor 510. Under the action of the reprojection algorithm of the processor 510, other cameras or sensors are used to project the external physical world to the position of the human eye to reconstruct the depth of the physical world and obtain a depth map. Then, the depth information of the real scene image is adjusted in combination with the depth map and displayed on the display screen 502, and then magnified by the imaging lens 503 and presented to the user. In this way, by compensating for the depth difference between the real scene image captured by the camera 501 and the real image seen by the user's eyes, it is helpful for the human eye to see a normal image with the same depth as the image it sees from the electronic device.

[0094] By adopting the above optical system design, the real scene image captured by the camera is first transmitted to the processor for anti-distortion processing and re-projection processing, which can compensate for the distortion problem and depth difference problem existing in the optical system design, and help users see normal images. However, the software algorithm path involved in this solution is relatively long, and the real scene image captured by the camera needs to go through a long algorithm processing process before it can be displayed to the user, resulting in a relatively high delay, power consumption and load from the time the user turns his head to the time the user sees the changed picture (also known as from motion to photon (MTP)), which is not conducive to improving the user's VST experience.

[0095] In addition, the commonly used reprojection algorithms currently require the depth reconstruction of the real physical world, but the reconstruction accuracy at this stage is limited. Generally, in order to improve the reconstruction efficiency, all depths are simply identified as a single depth or represented by a small number of depths. But in fact, the photographed objects are three-dimensional, and the objects may have unique depths at various positions. This depth reconstruction method using a single depth or a small number of depths to represent depth is likely to make the reconstructed depth differ greatly from the real depth, which in turn leads to a certain local distortion of the image after reprojection, which is further not conducive to improving the user's VST experience.

[0096] In view of this, an embodiment of the present application provides an optical system. By designing the devices included in the optical system, the image taken by the camera can be directly sent to the display screen for display, without the need for anti-distortion algorithm and / or re-projection algorithm for advance processing, so as to simplify the complexity of the software algorithm path, reduce the delay, load and power consumption of MTP, and improve the user's VST experience.

[0097] In view of the above-mentioned technical problems, the technical solutions provided by the embodiments of the present application are described below in conjunction with the accompanying drawings.

[0098] In the following description of the present application, "multiple" can be understood as "at least two". "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. "The following one or more items" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, one or more items of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or plural.

[0099] Furthermore, unless otherwise specified, the ordinal numbers such as "first" and "second" mentioned in the embodiments of the present application are only used for the purpose of distinguishing descriptions, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order. For example, the "first image" mentioned below is an image obtained by a camera taking a real scene, and the "second image" is an image magnified by an imaging lens, which does not mean that the two images have a different order, priority or importance.

[0100] Implementation Plan 1

[0101] Please refer to Figure 6 As shown, it shows a schematic diagram of an imaging scheme of an optical system provided by an embodiment of the present application. The layout position relationship of each component in the optical system can be the same as the above Figure 5 The optical system shown in (A) is the same, except that: in the optical system, the camera 501 has a first optical distortion, the imaging lens 503 has a second optical distortion, the signs of the first optical distortion and the second optical distortion are opposite, and the absolute value of the sum of the first optical distortion and the second optical distortion is less than the distortion threshold. In this way, after the camera 501 photographs the target object, a first image with the first optical distortion is obtained, and the first image can be directly transmitted to the display screen 502 for display; thereafter, the first image displayed on the display screen 502 is magnified by the imaging lens 503, and under the action of the second optical distortion of the imaging lens 503, the first optical distortion in the first image is compensated to obtain the second image.

[0102] Among them, when the signs of the first optical distortion and the second optical distortion are opposite and the sum is 0, the second image has no optical distortion, that is, the user sees a normal undistorted image. On the contrary, when the signs of the first optical distortion and the second optical distortion are opposite but the sum is not 0, the second image has a third optical distortion, and the absolute value of the third optical distortion is smaller than the absolute value of the second optical distortion. That is, although the user sees an image with distortion, the degree of distortion of the image is smaller than the degree of distortion introduced by the imaging lens 503 itself.

[0103] For example, the optical distortion can be characterized by the relative distortion Dist (see the above formula (1)). The absolute value of the optical distortion is also the absolute value of the relative distortion Dist, that is,

[0104] Exemplarily, the distortion threshold may be a threshold configured by a person skilled in the art based on experience, or may be a threshold obtained through experimental verification that enables the presentation effect of the second image to meet the requirements. For example, in one example, when the optical distortion is characterized by the relative distortion Dist, the distortion threshold may be configured to a value less than 15%. For example, it is found through experimental verification that when the distortion threshold is configured to 10%, the difference between the absolute value of the first optical distortion and the absolute value of the second optical distortion is within the range of [-10%, 10%], which can take into account both cost and imaging effect.

[0105] For example, taking the optical distortion as represented by the relative distortion Dist and the distortion threshold as 10%, the correlation between the first optical distortion and the second optical distortion can be shown in the following Table 1:

[0106] Table 1

[0107] <![CDATA[First optical distortion Dist1]]> <![CDATA[Second optical distortion Dist2]]> [-a-10%, -a+10%] a [a-10%, a+10%] -a

[0108] Where a is a non-negative real number.

[0109] As shown in Table 1, when designing an optical system:

[0110] If the second optical distortion Dist2 introduced by the imaging lens 503 is a positive distortion a, the camera 501 can be configured to have negative distortion, and the value of the negative distortion is maintained within the range of 10% before and after the positive distortion a. For example, if the imaging lens 503 introduces a 30% second optical distortion Dist2, then the first optical distortion Dist1 introduced by the camera 501 can be configured to be any negative distortion within the range of [-40%, -20%], for example, it can be configured to be -25%. In this way, after the camera 501 and the imaging lens 503 compensate for each other, the second image finally presented to the user has only a relative distortion of 5%;

[0111] On the contrary, if the second optical distortion Dist2 introduced by the imaging lens 503 is a certain negative distortion -a, the camera 501 can be configured to have positive distortion, and the values ​​of positive and negative distortion are kept within the range of 10% before and after the negative distortion -a. For example, if the imaging lens 503 introduces a second optical distortion Dist2 of -30%, then the first optical distortion Dist1 introduced by the camera 501 can be configured as any positive distortion within the range of [20%, 40%], for example, it can be configured as 30%. In this way, after the camera 501 and the imaging lens 503 compensate for each other, the second image finally presented to the user does not have relative distortion.

[0112] It should be noted that the distortion values ​​involved here are introduced based on ideal conditions, and some process errors may exist in actual operations. However, it should be understood that any solution whose distortion value is within a certain error range with the distortion value given here is within the protection scope of the embodiments of the present application, and the embodiments of the present application do not make specific limitations on this.

[0113] For example, considering that the imaging lens 503 uses a convex lens to realize the image magnification function, and the convex lens has a pincushion distortion (i.e., positive distortion), therefore, when designing the optical system, the first optical distortion can be configured as a barrel distortion (i.e., negative distortion), and the second optical distortion can be configured as a pincushion distortion. For example, the lens of the camera 501 can be configured as a concave lens, and the lens of the imaging lens 503 can be configured as a convex lens, and the relative distortion of the two lenses in the same field of view can be similar (the absolute value difference is controlled within a range of 10%). In this way, the first image captured by the camera 501 itself will have a barrel distortion. After being displayed on the display screen 502, the first image is transmitted to the imaging lens 503, and is magnified by the concave lens in the imaging lens 503. At the same time, the barrel distortion introduced by the camera 501 is offset by the pincushion distortion of the concave lens. In this way, when the magnified image reaches the human eye, it can be restored to a picture without distortion or with less distortion.

[0114] It should be noted that the above example directly utilizes the positive distortion of the convex lens of the imaging lens 503 to configure the lens of the camera 501 as an opposite concave lens, so as to introduce as few lenses as possible into the optical system. However, in other embodiments, more lenses may be additionally introduced, such as setting other lenses in addition to the convex lens in the imaging lens 503, so that the multiple lenses in the imaging lens 503 present negative distortion after the combined effect, and the lens of the camera 501 is configured as positive distortion, or by configuring multiple lenses in the camera 501 so that the combined effect of the multiple lenses is positive distortion. There are many feasible implementation methods, but as long as the camera 501 can directly offset the distortion introduced by the imaging lens 503 through the lens settings in the imaging lens 503 and the camera 501, they are all within the protection scope of the embodiments of the present application.

[0115] In addition, since distortion is a monochromatic optical aberration, when configuring the camera 501 and the imaging lens 503, it is also necessary to configure each monochromatic light separately. For example, the relative distortion corresponding to the R light of the lens of the camera 501 and the relative distortion corresponding to the R light of the lens of the imaging lens 503 have opposite signs and are similar in size, the relative distortion corresponding to the G light of the lens of the camera 501 and the relative distortion corresponding to the G light of the lens of the imaging lens 503 have opposite signs and are similar in size, and the relative distortion corresponding to the B light of the lens of the camera 501 and the relative distortion corresponding to the B light of the lens of the imaging lens 503 have opposite signs and are similar in size, so that the relative distortions of the camera 501 and the imaging lens 503 can cancel each other out, and their dispersions can also cancel each other out.

[0116] In the above-mentioned implementation scheme one, by configuring the camera and the imaging lens to have distortions with opposite signs and similar sizes in the same field of view, the distortions generated after the light passes through the camera and the imaging lens can basically cancel each other out. In this way, before the image taken by the camera is transmitted to the display screen, the anti-distortion processing algorithm is no longer required, thereby streamlining the complexity of the software algorithm path, and even deleting the software algorithm path, and directly transmitting the real-scene image taken by the camera to the display screen for display, so as to effectively reduce the MTP delay, load and power consumption, and improve the user's VST experience.

[0117] Implementation Plan 2

[0118] Please refer to Figure 7 As shown, it shows a schematic diagram of the structure of another optical system provided by an embodiment of the present application. Figure 7 (A) shows a top view of the optical system. Figure 7 (B) shows the right side view of the optical system. Please refer to Figure 7 Middle (A) and Figure 7 As shown in (B), the optical system may include a camera 501, a display screen 502, and an imaging lens 503, and may also include a reflection component 504. When photographing a target object, the camera 501 emits a first light, which is reflected by the reflection component 504 and transmitted to the target object, and then reflected by the target object to form a second light, which is reflected by the reflection component 504 and returns to the camera 501. The camera 501 generates a first image based on the received second light, and sends the first image to the display screen 502 for display. The image displayed on the display screen 502 is magnified by the imaging lens 503 to obtain a second image, which is then presented to the user.

[0119] The distance from the light emitted by the camera 501 to the target object after being reflected by the reflective component 504 is equal to the distance from the user's eyes to the target object. It can be understood that the sum of the distance from any light emitted by the camera to the reflective component 504 and the distance from any light emitted by the camera to the target object after being reflected by the reflective component 504 is equal to the distance from the user's eyes to the target object. Figure 7 Taking the bottom edge light shown in (A) as an example, the distance from the bottom edge light emitted by the camera 501 to the reflective component 504 is L1, and the distance from the reflective component 504 to the target object after being reflected by the reflective component 504 is L2. The distance from the bottom edge line of sight of the human eye to the target object is L3. Then, L1, L2 and L3 satisfy the following formula (2):

[0120] L3=L1+L2……(2)

[0121] Please continue to refer to Figure 7 As shown in (A), since the distance from the light emitted by the camera 501 to the target object after being reflected by the reflective component 504 is equal to the distance of the user's eyes looking at the target object, the depth of the target object photographed by the camera 501 is consistent with the depth of the user's eyes looking at the target object, and thus the FOV of the target object photographed by the camera 501 is consistent with the FOV of the user's eyes looking at the target object, for example, both are Figure 7 In this way, the image obtained by the camera 501 when photographing the target object is the same as the image seen by the user when viewing the target object, and the image photographed by the camera 501 can be directly transmitted to the display screen 503 for display without the need for re-projection processing by the processor.

[0122] Exemplarily, the reflective component 504 may include one or more reflective elements. For example:

[0123] In some embodiments, Figure 7 As shown in (A), the reflective component 504 may include only one reflective element, the center point of which is located on the optical axis of the display screen 502 and the imaging lens 503, and the camera 501 is arranged on the inner side of the device housing shown below. In this way, the light emitted by the camera 501 is directly reflected by the reflective element to the target object, and the reflection direction coincides with the line of sight of the human eye to the target object. By using a reflective element to achieve consistency between the shooting depth of the camera 501 and the viewing depth of the human eye, it is possible to introduce as few additional components as possible, reduce the complexity of the optical system, and save costs;

[0124] In some embodiments, the reflective assembly 504 may include at least two reflective elements, such as Figure 8An optical system is shown in the figure, the reflective component 504 includes two reflective elements, namely, reflective element 5041 and reflective element 5042, the center point of reflective element 5042 is located on the optical axis of display screen 502 and imaging lens 503, and camera 501 is arranged on the inner side of the device housing at the lower right of the figure, and the center point of reflective element 5041 is located on the optical axis of camera 501. In this way, the light emitted by camera 501 is first reflected by reflective element 5041 to reflective element 5042, and then reflected by reflective element 5042 to the target object, and the reflection direction of reflective element 5042 coincides with the line of sight of human eyes looking at the target object. Compared with Figure 7 For the optical system shown in (A), Figure 8 The optical system in the figure has a smaller length in the vertical direction, that is, by using at least two reflective elements to achieve consistency between the camera's shooting depth and the human eye's viewing depth, it also helps to reduce the overall size of the electronic device and compact the arrangement of its internal components, which is conducive to the miniaturization design of the electronic device.

[0125] Exemplarily, the above-mentioned reflective element can be any component that can reflect the input light, for example, it can be an optical element having at least one reflective surface, such as a reflector or a reflective prism. The reflector can be a plane reflector, a spherical reflector, or an aspherical reflector. A prism is also called a polygonal mirror, for example, it can be a triangular prism, a right-angle prism, or a pentagonal prism.

[0126] In the above-mentioned second implementation scheme, by adding a reflective component to the optical system, the distance from the camera to the object after reflection by the reflective component can be made the same as the distance from the human eye to the object, thereby eliminating the axial distance between the camera and the human eye in the existing optical system, so that the viewing angle range of the camera shooting the object is consistent with the viewing angle range of the human eye to see the object, ensuring the accuracy of the depth information of the image obtained by the camera shooting the object. Furthermore, since the depth information of the image directly shot by the camera itself is accurate, before the image shot by the camera is transmitted to the display screen, the re-projection algorithm can no longer be introduced, thereby simplifying the complexity of the software algorithm path, and even deleting the software algorithm path, directly transmitting the real-scene image shot by the camera to the display screen for display, so as to effectively reduce the delay, load and power consumption of MTP, and improve the user's VST experience.

[0127] It should be noted that the above-mentioned implementation scheme 1 can simplify the anti-distortion processing algorithm in the original algorithm path, while the implementation scheme 2 can simplify the reprojection algorithm in the original algorithm path. The above-mentioned implementation schemes 1 and 2 are only introduced separately from the perspective of how to simplify one of the algorithms, but in actual operation, these two implementation schemes can also be combined with each other. For example, in a possible combination scheme, not only is the first optical distortion opposite to the second optical distortion of the imaging lens configured for the camera in the optical system, but a reflective component is also added to the optical system. In this way, the anti-distortion processing algorithm in the original algorithm path can be simplified, and the reprojection algorithm in the original algorithm path can be simplified, further reducing the complexity of the software algorithm path, or even if the software algorithm path is deleted, it can rely on the design of the optical system itself to ensure the accuracy of the depth information of the displayed image while displaying the image without distortion or with little distortion.

[0128] In addition, the present application also provides an electronic device, including the aforementioned imaging system, for example, may include the aforementioned imaging system and a housing, wherein the imaging system is encapsulated in the housing.

[0129] Exemplarily, the electronic device may be a NED device, such as VR glasses or a VR helmet, or a terminal device with a display screen, such as a mobile phone, a monitor, a television, a HUD, etc., without specific limitation.

[0130] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An optical system, characterized in that: The device comprises a camera, a display screen and an imaging lens, wherein the camera has a first optical distortion, the imaging lens has a second optical distortion, the first optical distortion and the second optical distortion have opposite signs, and the absolute value of the sum of the first optical distortion and the second optical distortion is less than a distortion threshold; The camera is used to photograph the target object to obtain a first image; The display screen is used to display the first image; The imaging lens is used to magnify the first image displayed on the display screen.

2. The optical system according to claim 1, wherein: Also included is a reflective component; The reflection component is used to reflect the emitted light from the camera to the target object, and reflect the reflected light from the target object back to the camera; The distance between the light emitted by the camera and the target object after being reflected by the reflective component is equal to the distance between the light emitted by the camera and the target object from the user's eyes.

3. An optical system, characterized in that: Includes camera, reflective assembly, display screen and imaging lens; The camera is used to emit a first light, receive a second light reflected from the reflective component, and obtain a first image after processing the second light; The reflection component is used to reflect the first light from the camera to the target object, and reflect the second light from the target object back to the camera, and the distance from the first light from the camera to the target object after being reflected by the reflection component is equal to the distance of the user's eyes looking at the target object; The display screen is used to display the first image; The imaging lens is used to magnify the first image displayed on the display screen to obtain a second image.

4. The optical system according to claim 3, characterized in that The camera has a first optical distortion, and the imaging lens has a second optical distortion; The signs of the first optical distortion and the second optical distortion are opposite, and the absolute value of the sum of the first optical distortion and the second optical distortion is less than a distortion threshold.

5. An optical system according to claim 1, 2 or 4, characterized in that The first optical distortion is negative distortion, and the second optical distortion is positive distortion.

6. An optical system according to claim 1, 2, 4 or 5, characterized in that The distortion threshold is less than 15%.

7. An optical system according to claim 2, 3 or 4, characterized in that The reflective assembly includes one or more reflective elements.

8. The optical system according to claim 7, characterized in that The reflective element is a reflector or a prism.

9. An electronic device, characterized in that: Comprising the optical system as claimed in any one of claims 1 to 8.

Citation Information

Patent Citations

  • Device and method for measuring and correcting distortion of virtual reality displayer

    CN103792674A

  • Image processing method and device

    CN104363986A

  • Virtual reality anti-distortion method and device and related equipment

    CN110335200A

  • Image processing method and device, electronic device and storage medium

    CN110490820A

  • Method for correcting VR large field angle distortion

    CN113160067A

Cited By

  • Virtual reality equipment

    CN117608093A

  • A virtual reality device

    CN117608093B