Calibration device for augmented reality (AR) glasses
The calibration case for AR devices addresses mechanical distortions by measuring and correcting alignment, brightness, and color accuracy issues, enhancing user comfort and device performance.
Patent Information
- Application Number
- PCT/US2025/032551
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-05
- Filing Date
- 2025-06-05
- Publication Date
- 2025-12-11
AI Technical Summary
Augmented reality (AR) devices, such as AR glasses, suffer from mechanical distortions leading to misalignment between displays, causing user discomfort and performance degradation due to factors like impacts, pressure, and aging, which affect parameters like brightness, color accuracy, and interocular symmetry.
A calibration case and digital adjustments are used to measure and correct deviations in AR devices, including alignment, brightness, color accuracy, and dimming, by integrating sensors and emitters within the case to assess and recalibrate these parameters.
The calibration case effectively maintains the performance and visual fidelity of AR devices by correcting mechanical distortions and ensuring consistent display parameters, reducing user discomfort and extending device lifespan.
Smart Images

Figure US2025032551_11122025_PF_FP_ABST
Abstract
Description
CALIBRATION DEVICE FOR AUGMENTED REALITY (AR) GLASSESCROSS-REFERENCE TO RELATED APPLICATION
[0001] This application claims priority to U.S. application number 63 / 656,566, filed June 5, 2024 and titled “CALIBRATION DEVICE FOR AUGMENTED REALITY (AR) GLASSES,” the contents of which are incorporated by reference herein in their entirety.FIELD
[0002] The present disclosure generally relates to augmented reality, and more specifically to systems, devices, and methods for calibration of augmented reality glasses.BACKGROUND
[0003] Augmented reality (AR) devices can include glasses or other types of head-worn displays, which can augment or add information to a real-world scene. Oftentimes, these devices include two displays that are positioned in front of the eyes of a user. AR devices such as AR glasses, however, can encounter performance issues and challenges that result from potential mechanical distortions of the devices. These mechanical distortions can lead to misalignment between pointing vectors and orientations of the two displays of the AR device. When left unresolved, this misalignment can induce discomfort among users, including, for example, systems such as eye strain, headaches, and nausea. Furthermore, as AR devices age, parameters such as brightness, color accuracy, and interocular symmetry may degrade. The accuracy of other components such as the dimming panel can also be impacted.
[0004] Thus, a need exists to monitor and track these parameters in AR devices, and to implement corrective measures, e.g., to provide digital corrections for image alignment, brightness, color accuracy, interocular symmetry, and dimming.SUMMARY
[0005] The present disclosure relates to systems, devices, and methods for addressing potential deviations in structural integrity, shape, orientation, and / or other parameters of AR devices, such as, for example, AR glasses. Such deviations may be caused by external factors, such as, for example, impacts, pressure, and aging. These deviations may disrupt the performance of the AR devices from their original factor calibration. Therefore,systems, devices, and methods described herein are designed to re-calibrate AR devices, e.g., to compensate for such deviations.[0006J In one or more embodiments, systems, devices, and methods described herein can adjust for potential mechanical distortions that leads to misalignment between two displays of an AR device using a calibration case and subsequent digital adjustments of image alignment.
[0007] In one or more embodiments, systems, devices, and methods described herein can systematically evaluate parameters such as alignment, brightness, color accuracy, interocular symmetry, and / or dimming, and implement corrective measures to sustain the performance and visual fidelity of an AR device’s lifespan. For example, degradation in optical and physical components of an AR device, or any parts that impact the performance of the device, can be measured, corrected, and / or reported for debugging and / or corrective measures.
[0008] In an embodiment, a signal is sent to an augmented reality (AR) device to display a first set of images on a first display to produce a first optical output, and to display the first set of images on a second display of the AR device to produce a second optical output. A first set of signals is received based on the first optical output from a set of sensors of a calibration device, and a second set of signals is received based on the second optical output from the set of sensors of the calibration device. A determination is made of a first pointing vector of the first display based on the first set of signals and a second pointing vector of the second display based on the second set of signals. A misalignment between the first display and the second display is identified based on the first pointing vector and the second pointing vector. One or more alignment adjustment values are calculated based on the misalignment. The one or more alignment adjustment values are associated with a digital correction of the misalignment. A signal is sent to the AR device to overwrite a calibration file of the AR device with the one or more alignment adjustment values.
[0009] In an embodiment, an apparatus includes a calibration case. The calibration case includes a housing configured to store an AR device that has a first display and a second display. The calibration case further includes a re-chargeable power supply configured to charge at least one of a power supply of the AR device or the calibration case. The calibration case further includes a set of sensors, an optical component, a processor, and a non-transitory, processor-readable medium. The non-transitory, processor-readable medium stores instructions that, when executed by the processor, cause the processor tosend a signal to the AR device to display a first plural ity of images on the first display and on the second display of the AR device, to produce an optical output. The non-transitory, processor-readable medium further stores instructions that, when executed by the processor, cause the processor to receive a plurality of signals based on the optical output from the set of sensors to produce a second plurality of images. The optical output are relayed to the set of sensors by the optical component. The non-transitory, processor- readable medium further stores instructions that, when executed by the processor, cause the processor to measure a first set of parameters of the second plurality' of images. The non- transitory, processor-readable medium further stores instructions that, when executed by the processor, cause the processor to determine a deviation between the first set of parameters and a second set of parameters of the first plurality of images. The non- transitory, processor-readable medium further stores instructions that, when executed by the processor, cause the processor to calculate a third set of parameters based on the deviation. The third set of parameters are associated with a digital correction of the deviation. The non-transitory, processor-readable medium further stores instructions that, when executed by the processor, cause the processor to send a signal to the AR device to overwrite a calibration file of the AR device with the third set of parameters. The non- transitory, processor-readable medium further stores instructions that, when executed by the processor, cause the processor to send a signal to a compute device communicatively coupled to the processor to alert a user of the deviation.
[0010] In an embodiment, at a first time, a first light emitter of a calibration device is activated. The first light emitter is configured to send a first optical output to a first display of an augmented reality (AR) device to produce a second optical output. A second light emitter of the calibration device is activated. The second light emitter is configured to send a third optical output to a second display of the AR device to produce a fourth optical output. A first plurality of signals associated with the second optical output is received from a first sensor of the calibration device. A second plurality of signals associated wdth the fourth optical output is received from a second sensor of the calibration device. A first dimming level of the AR device is measured based on at least one of the first plurality of signals or the second plurality of signals. A deviation between the first dimming level and a second dimming level of the AR device is determined. The second dimming level is defined at a second time prior to the first time. A correction factor is calculated based on the deviation.The correction factor is associated with a digital correction the deviation. A signal is sent to the AR device to overwrite a calibration file of the AR device with the correction factor.BRIEF DESCRIPTION OF THE DRAWINGS
[0011] FIG. 1 is a block diagram of a system including an AR device and a calibration device, according to some embodiments.
[0012] FIG. 2 schematically depicts elements of an AR device and a cal ibration device, according to some embodiments.
[0013] FIG. 3 is a flow chart showing a method of calibrating an AR device using a calibration device, according to embodiments.
[0014] FIGS. 4A and 4B illustrate perspective views of a calibration case, according to an embodiment.
[0015] FIG. 5 illustrates an example of a misalignment, according to an embodiment.
[0016] FIG. 6 illustrates a top internal view of a calibration case containing AR glasses, according to an embodiment.
[0017] FIG. 7 illustrates a flowchart of a method to calculate an alignment adjustment valued based on an identified misalignment, according to an embodiment.
[0018] FIG. 8 illustrates a flowchart of a method to determine a deviation, according to an embodiment.
[0019] FIG. 9 illustrates a flowchart of a method to determine a deviation between dimming levels, according to an embodiment.DETAILED DESCRIPTION
[0020] As described herein, this disclosure relates to devices for calibrating AR devices, e.g., to address potential deviations in structural integrity, shape, and / or orientation of AR devices, such as AR glasses, caused by external factors such as impacts, pressure, and aging. These deviations may disrupt the parameters and operation of the AR devices, e.g., from their original factory calibration or an earlier post-factory calibration. Therefore, devices are described herein that aim to compensate for such deviations. In some embodiments, calibration functions and / or elements for calibrating an AR device can be integrated into a case or storage device for holding an AR device, such as, for example, a glasses case. The case can be configured to protect the device from external factors, while also providing calibration functions.
[0021] Some implementations relate to a calibration device that calibrates AR devices for parameters like brightness, color, accuracy, interocular symmetry, dimming, and / or the like. For example, AR glasses can include faults from manufacturing processes and / or after wear and tear. As a result, despite receiving instructions to display, for example, images having a certain color or brightness, the AR glasses can deviate and display images having a different color or brightness. To correct for such faults, a calibration process can be performed using a calibration case that can identify and fix the faults.
[0022] As AR devices age, the performance of the AR devices can degrade as represented by parameters like brightness, color, interocular symmetry, and / or the like . The performance (e.g., accuracy) of other AR device components, such as the dimming panel, can also degrade. The AR device can also form scratches, cracks, optical aberrations, and / or the like. Some implementations described herein use a calibration device (e.g., calibration case) to evaluate the AR devices for brightness, color, interocular symmetry, scratches, cracks, optical aberrations, and / or the like, and perform corrective measures when faults are identified, thereby improving / sustaining performance and visual fidelity of the AR devices. Said similarly, degradations in the AR device can be identified, and remedial actions can follow.
[0023] Some known AR headsets, like HoloLens® 2 and Magic Leap® 2, use prisms and cameras permanently positioned on the display waveguides to detect and rectify display misalignments between the two sides. These known AR headsets, however, have drawbacks in terms of increased size and added weight, which can negatively impact user comfort and wearability. Additionally, during operation, these known AR headsets sometimes generate patterns that are intended for camera tracking and noticeable to both users and cameras, disrupting the user experience.
[0024] Some implementations described herein relate to a calibration case that can protect AR devices, charge AR glasses, and calibrate AR glasses. The calibration case can include, for example, an optical component, camera, light emitting diode (LED), photodiode, processing unit, Bluetooth® module, charging circuit, and / or the like. In an example, when AR glasses are placed inside the calibration case, the values of various parameters can be analyzed, such as the alignment between the two displays (a left display in the field of view the user’s left eye and a right display in the field of view' the user’s right eye), brightness, color accuracy, dimming levels, optical component quality (e.g., scratches, cracks, optical aberrations, etc.), and / or the like. In some implementations, the calibration case and / or ARdevice can further indicate, to a user or separate compute device, real-time status updates and / or store data for diagnostic or debugging purposes.[0025} FIG. 1 is a block diagram of a system of devices for calibrating an AR device, according to an embodiment. As shown in FIG. 1 , the system includes an AR device 110 and a calibration device 120, which are connected to one another. In some implementations, the AR device 1 10 can be part of or integrated into a head mounted display (HMD), such as the HMD disclosed in U.S. Patent Application No. 19 / 049,754, filed February 10, 2025 and titled “Apparatus and Method to Determine a Pose of a Head Mounted Display,” the contents of which are incorporated by reference herein in their entirety. In some implementations, the calibration device 120 can be part of or integrated into a case or storage device for storing the AR device. Optionally, the system can also include one or more other devices, such as one or more compute devices 130, which can be coupled with the AR device 1 10 and the calibration device 120 via a communications network 140.
[0026] The AR device 110 can be, for example, glasses, goggles, or another head-worn device, such as, for example, an HMD, which includes one or more display(s) 116 and / or sensor) s) 11 1. In some embodiments, the AR device 1 10 can include a one or more displays 116, such as a display configured to be positioned in front of each eye of a user. The displays 1 16 can be configured to allow' transmission of light therethrough, e.g., to allow a user to view a scene or environment around the user through the displays 1 16. In other w'ords, the displays 1 16 can include portions that are transparent or translucent, to allow' a user to view through those portions of the displays 1 16. In some embodiments, the displays 1 16 can be part of or be integrated into lenses of a pair of glasses. In some implementations, the AR device 110 has a display(s) 1 16 that allows both digital content and the real world to be seen simultaneously by a user. This semi-transparent display(s) 1 16 — for example a waveguide or diffractive optic — can be embedded within the lenses of the AR device 100 (e.g., instead of existing as separate external screens).
[0027] The AR device 1 10 can also include sensor(s) 1 1 1 , e.g., for tracking information regarding the user, the AR device 1 10, and / or an environment surrounding the user. The sensor(s) 1 11 can include, for example, an inertial measurement unit (IMU), an accelerometer, a gyroscope, a camera, a red-green-blue (RGB) camera, a low' light camera, a thermal imager, a WiFi® sensor (e.g., a WiFi® receiver or a WiFi® transceiver), a radar sensor, a magnetometer, etc. In some embodiments, the sensor(s) 1 1 1 can include imaging devices, such as, for example, an optical or infrared camera. In some embodiments, theimaging device can be a low light imaging camera. In some embodiments, data captured by the sensor(s) 1 1 1 can be used by a processor (e.g., processor 1 12 and / or processor 123) to assess one or more parameters of the AR device 110, such as, for example, alignment between multiple displays, display brightness, display color accuracy, dimming levels, optical component quality, and / or integrity, shape, or orientation of the AR device 1 10. In some embodiments, data captured by the sensor(s) 1 1 1 can be analyzed together with other information (e.g., data captured by other sensors, such as, for example, sensor(s) 121 of calibration device 120) to assess one or more parameters of the AR device 1 10.
[0028] The AR device 110 can also include a processor 112, a memory 1 13, and a communications interface (not shown). Processor 112 can be coupled to sensor(s) 111, memory 113, display(s) 116, and the communications interface. The processor 112 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), and / or the like) can be, for example, a hardware-based integrated circuit (IC) or any other suitable processing device configured to run or execute a set of instructions or codes. In some embodiments, the processor 1 12 can execute instructions stored in memory 1 13 to perform one or more processes and / or functions, including processing sensor data, tracking one or more parameters of the AR device 1 10, analyzing one or more parameters of the AR device 110, implementing adjustments to the AR device, etc. In some embodiments, the processor 1 12 can be disposed in a frame or a temple / arm of a pair of AR device 110. The memory 1 13 (e.g., a random-access memory (RAM), a hard drive, a flash drive, and / or the like) of AR device 110 can store data, and / or code that includes instructions to cause the processor 112 to perform one or more processes or functions. The communication interface (e.g., a network interface card (NIC), a Wi-Fi® transceiver, a Bluetooth® transceiver, and''or the like) can be a hardware component that facilitates data communication between AR device 1 10 and other devices (e.g., the calibration device 120, the compute device 130, compute devices coupled to communications network 140 but not shown in FIG. 1 , and / or the like).
[0029] The calibration device 120 can be, for example, a compute device configured to implement a calibration of the AR device 110. In some embodiments, the calibration device 120 can be part of or integrated into a case or storage device for the AR device 110. For example, the cal ibration device 120 can be a case for storage of AR glasses or goggles. The case can include a rigid or semi-rigid housing that defines an interior for storing the AR device 1 10. When the AR device 1 10 is placed within the interior of the housing, the housing can protect the AR device 1 10 from external elements.
[0030] In some implementations, the calibration device 120 includes a housing configured to store the AR device 110, a re-chargeable power supply configured to charge a power supply of the AR device 1 10 and / or the calibration device 120 itself, sensor(s) 121, an optical component, the processor 123, and / or a non-transitory processor readable medium storing instructions executable by the processor, one or more of which can be located within an interior of the housing and / or within a wall of the housing.
[0031] In some implementations, the calibration device 120 has a size that can receive / hold / calibrate one AR device (e.g., AR device 110). In some implementations, the calibration device 120 has a size that can simultaneously receive / hold I calibrate multiple AR devices (e.g., in a row and / or column within the calibration device 120) In some implementations, an interior of the calibration device 120 is sized and configured to receive and store the AR device 110 such that the AR device 1 10 does not move around (or has reduced or minimal movement) within the calibration device 120 while the calibration device 120 is moved around. In some implementations, to achieve accurate calibration, the calibration device 120 can include a predetermined positioning system, such as custom- molded compartments, alignment guides, or adjustable brackets that securely hold the AR device 1 10 in place. In some implementations, the calibration device 120 can include cushioning materials or locking mechanisms to prevent shifts that might disrupt the calibration process. In some implementations, the calibration device 120 include environmental controls, such as light shielding or temperature stabilization, to maintain consistent conditions during calibration procedures.
[0032] The calibration device 120 can also include elements for performing calibration of the AR device 1 10. For example, the calibration device 120 can include light emitter(s) 124 configured to emit light or other electromagnetic waves, which can be captured by sensor(s) 121. In some embodiments, each light emitter 124 can be paired with a sensor 121 , such that light emitted by the light emitter 124 can be captured or detected by the respective sensor 121 . In an example use case, the light emilter(s) 124 can be configured to emit light at one or more display(s) 1 16 or lenses of the AR device 1 10, and the sensor(s) 121 can be configured to capture light that passes through the display(s) 116 or lenses. A processor (e.g., processor 123 and / or another processor) can be configured to analyze signals output from sensor(s) 121 and based on the light that is detected at the sensor(s) 121 to assess one or more parameters of the AR device 110, such as, for example, a dimming level of a dimming panel of the AR glasses, and / or a quality or condition of the display orlenses of the AR device 1 10 (e.g., whether the lenses have scratches, cracks, dirt, etc.). In some embodiments, the light emitter(s) 124 can include light emitting diodes (LEDs). In some embodiments, the sensor(s) can include photodiodes or cameras (e.g., RGB camera and / or grayscale camera).
[0033] The calibration device 120 can also include sensor(s) 121 configured to capture images or patterns (or portions thereof) that are displayed at the display(s) 116 of the AR device 1 10. For example, the sensor(s) 121 can include one or more cameras that can be configured to capture images or patterns at the display(s) 116, such as a red-green-blue (RBG) camera and / or grayscale camera. In some embodiments, the images or patterns can be captured by an optics component, such as, for example, one or more light guides, lenses, mirrors, prisms, or periscopes, that can relay the images or patterns to a sensor(s) 121 . In some embodiments, only a portion of the images and / or patterns may be captured, such as, for example, a subset of the pixels of the display(s) 1 16 may be captured. In such embodiments, however, it may be assumed that the remaining portion of the display(s) 116 of the AR device 110 function si milarly to the portion that is captured by the sensor(s) 121 . A processor (e.g., processor 123 and / or another processor) can be configured to analyze the images or patterns captured by the sensor(s) 121 to assess one or more parameters of the AR device 1 10, such as, for example, an alignment between two displays 1 16 of the AR device, a brightness of the display(s) 116, a color accuracy of the display(s) 1 16, dimming levels, and / or optical component quality. In some embodiments, the processor can be configured to input the sensor data from the sensor(s) 121 into one or more algorithms, and to relay the output of the algorithms to the AR device 110. The AR device 110 can then make adjustments to one or more operational parameters of the display(s) 1 16 based on the outputs from the algorithms (e.g., without human intervention).
[0034] The calibration device 120 can also include a memory 122, a processor 123 and a communications interface (not shown). Memory 122, processor 123 and the communications interface of the calibration device 120 can be similar to the memory 1 13, processor 112 and the communications interface of the AR device 1 10. In some implementations, the processor 123 is operably coupled to the calibration device 120 when disposed within the calibration device 120.
[0035] In some implementations, the calibration device 120 includes a power supply. The power supply can be, for example, a re-chargeable power supply configured to charge a power supply of the AR device 110 and / or the calibration device 120. In someimplementations, the AR device 1 10 includes a power supply, such as a re-chargeable power supply configured to charge the power supply of the AR device 1 10 and / or the calibration device 120.
[0036] In some embodiments described herein, it can be desirable to incorporate calibration elements, such as sensors and emitters, into a device that is separate from the AR device 110, such that these elements do not add to the weight of the AR device 1 10. For example, while cameras can be added to an AR device 1 10 to track one or more parameters of the AR device 1 10 (e.g., an alignment, brightness, color accuracy, etc.), the addition of cameras would add to the weight of the AR device 1 10. To avoid adding this weight, it may be desirable to incorporate such elements into a separate device, such as, for example, the calibration device 120 as described herein. The calibration device 120 can also be the case for storage of the AR device 1 10, such that a user does not need to cany an additional device on his or her person for calibration purposes. In other words, the calibration device 120 can serve the dual purpose of storing and / or protecting the AR device 110, while also enable calibration of the AR device 1 10.
[0037] Optionally, the calibration device 120 and / or AR device 1 10 can be coupled one or more additional compute devices 130, e.g., directly or via network 140. The compute device(s) 130 can include, for example, a memory 134, a processor 132 and a communications interface (not shown). Memory 134, processor 132 and the communications interface of compute device 130 can be similar to the memory 1 13, processor 112 and the communications interface of AR device 1 10.
[0038] The communications network 140 can be any suitable communications network for transferring data, operating over public and / or private communications networks. For example, the communications network 140 can include a private network, a Virtual Private Network (VPN), a Multiprotocol Label Switching (MPLS) circuit, the Internet, an intranet, a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), a worldwide interoperability for microwave access network (WiMAX®), an optical fiber (or fiber optic)-based network, a Bluetooth® network, a virtual network, and / or any combination thereof. In some instances, the communications network 140 can be a wireless network such as, for example, a Wi-Fi or wireless local area network (“WLAN”), a wireless wide area network (“WWAN”), and / or a cellular network. In other instances, the communications network 140 can be a wired network such as, for example, an Ethernet network, a digital subscription line (“DSL”) network, a broadband network,and / or a fiber-optic network. The communications sent via the communications network 140 can be encrypted or unencrypted. In some instances, the communications network 140 can include multiple networks or subnetworks operatively coupled to one another by, for example, network bridges, routers, switches, gateways and / or the like.
[0039] In some implementations, processor 112 and / or 123 sends a signal to display(s) 1 16 representing instructions to sequentially display a specific set of multiple different brightnesses at display(s) 1 16. For each specified brightness, sensor(s) 121 can measure the actual brightness at d isplay(s) 1 16, and processor 123 can determine if the actual brightness measured at display(s) 1 16 matches (or is within a predetermined threshold of) the brightness processor 1 12 and / or 123 instructed display(s) 1 16 to display. To provide an example, during a calibration process, display(s) 1 16 receives instructions to display at display(s) 1 16 at a first brightness at a first time, then a second brightness (different than the first brightness) at a second time. When the first brightness is displayed, sensor(s) 121 can measure the actual brightness at display(s) 116 and processor 123 can determine if the actual brightness measured by sensor(s) 121 matches the first brightness. When the second brightness is displayed, sensor(s) 121 can measure the actual brightness at display(s) 1 16 and processor 123 can determine if the actual brightness measured by sensor(s) 121 matches the second brightness. By measuring and comparing multiple different brightness levels instead of just a single brightness, the processor 123 can determine trends in how the display(s) 1 16 deviates from expected values, allowing it to calculate a correction parameter such as a brightness adjustment factor. For instance, analyzing the relationship between instructed and measured brightness across multiple points enables the processor 123 to derive (or estimate) a slope or calibration curve. Further, a similar process can occur for other parameters, such as color. For example, processor 123 or 1 12 can send a signal to display(s) 1 16 with instructions to sequentially display different colors, and sensor(s) 121 can determine if the actual color display matches or deviates from the color display(s) 1 16 was instructed to display (e.g., to determine a color adjustment factor).
[0040] Although FIG. 1 illustrates a single AR device, in some implementations, the calibration device 120 can protect, charge, and / or calibrate any numbers of AR devices (at the same time or at separate times). For example, calibration device 120 can be configured to perform calibrations for different types of AR devices, such as an HM D, AR sunglasses, monocular AR glasses, binocular AR glasses, and / or the like. In some implementations, the calibration device 120 is sized such that multiple AR glasses can be stored in calibrationdevice 120 at the same time (e.g., a first pair of AR glasses are stored near the front of the calibration device 120 and a second pair of AR glasses are stored near the back of the calibration device 120).
[0041] In some implementations, calibration device 120 enforces a security' protocol such that only a predetermined (or preselected or previously identified) set of one or more AR devices can be calibrated at the calibration device 120. The security protocol can be implemented using, for example, unique hardware identifiers (e.g., the calibration device 120 verifies an ID of the AR device 1 10 before allowing calibration), secure cryptographic handshakes (e.g., calibration device 120 and AR device 1 10 can communicate though a private encryption key to ensure only authorized devices can initiate calibration), firmware or software checks (e.g., calibration device 120 confirms AR device 110 runs a predetermined specific firmware version before calibrating), physical docking or sensor alignment (e.g., calibration device 120 designed to accommodate / calibrate only a specific model of properly docked / aligned AR glasses at calibration device 120), and / or the like.
[0042] In implementations where display(s) 1 16 includes multiple displays, some calibrations can include determining a deviation for each display. For example, a deviation between an actual luminance (e.g., brightness) and expected luminance can be detected (and corrected for) for each display from display(s) 116. As another example, a deviation between an actual chroma (e.g., color) and expected chroma can be detected (and corrected for) for each display from display(s) 116.
[0043] In some implementations, results of calibrations can be made known (e.g., to users and / or other compute devices). For example, in response to detecting a deviation (or lack of a deviation), calibration device 120 can send a signal to compute device 130 and / or AR device 110 indicating the deviation (or lack thereof).
[0044] In some implementations, AR device 1 10 stores (e.g., in memory 1 13) a calibration file, The calibration file can store indications of current calibration values for various calibration parameters (e.g., color, brightness, dimming, misalignment, etc.). Based on determining a deviation for a given calibration parameter, the value for that calibration parameter can be updated based on (e.g., to mitigate) the deviation so that the calibration file maintains a current list of calibration values.
[0045] In some implementations, AR device 1 10 and / or calibration device 120 can generate and maintain a log. The log can include an indication of, for example, calibrations that were run, when the calibrations were run, results of the calibrations, remedial actionstaken in response to the calibrations, and / or the like. In some implementations, the log is sent to compute device 130. Compute device 130 can receive logs from other calibration devices and / or AR devices not shown in FIG. 1 . Based on the logs, the compute device 130 can identify trends, such as recurring calibration issues or patterns in device degradation over time for a set(s) of common devices.
[0046] FIG. 2 schematically depicts an example of a system for calibrating an AR device, according to embodiments. The AR device can be structurally and / or functionally similar to the AR device 1 10 described with reference to FIG. 1. The AR device can be a pair of AR glasses, including two displays 216a, 216b (e.g., similar to display(s) 1 16). While not depicted, the AR glasses can also include a processor (e.g., structurally and / or functionally similar to processor 1 12) and / or a memory (e.g., structurally and / or functionally similar to memory 1 13), which can be located in a temple or arm of the glasses.
[0047] The AR glasses can be calibrated via a case. The case can be an example of a calibration device, e.g., structurally and / or functionally similar to the calibration device 120 described with reference to FIG. 1. The case can include a housing 226, which can be configured to define an interior sized and configured to receive the AR glasses. The case can be configured to store and protect the AR glasses from external elements. When the AR glasses are stored in the case, the case can be configured to perform calibration of the AR glasses. In particular, the case can include sensors, emitters, and / or optical elements for generating and capturing patterns and / or images, which can be used to assess one or more parameters of the AR glasses. While not depicted, the case can also include a processor (e.g., structurally and / or functionally similar to the processor 123), which can be configured to receive data from the sensors of the case and to assess the parameters of the AR glasses. While also not depicted, the case can also include a battery or other onboard power source to power components of the case (e.g., processor, sensors, etc.) while also being a power source for recharging the AR glasses when they are placed in the case. The battery can be rechargeable via an electronic connector (e.g., a USB connector).
[0048] The case can include a first emitter 224a configured to emit light (or other electromagnetic radiation) at the first display 216a, and light that passes through the first display 216a can be captured or detected by a first sensor 221 a of the case. The case can also include a second emitter 224b configured to emit light (or other electromagnetic radiation) at the second display 216b, and light that passes through the second display 216b can be captured or detected by a second sensor 221 b of the case. The processor of the case(or another processor) can then analyze signals received from the first and second sensors 221 a, 221 b and based on the amount of light detected by the first and second sensors 221a, 221b to assess a dimming level of a dimming panel of the AR glasses. For example, the dimming panel may be set to a dimming level (e.g., 50%), such that the processor expects to detect a corresponding reduction in light passing through the AR glasses. If, however, the light detected at sensor 221 a or 221b deviates from the amplitude of light expected to be detected based on the preset dimming level, then the processor may determine that an adjustment needs to be made to the AR glasses to account for the deviation in the dimming level. Such deviations may be undesirable, as it can affect the level of contrast between a displayed virtual object or image and a background scene visible to a user. When this contrast is too low, e.g., due to unaccounted deviations in the dimming level, a user may have difficulty making out the displayed virtual objects or images and / or difficulty viewing the real-world scene behind a display. Additionally, or alternatively, the processor of the case (or another processor) can analyze signals received from the first and second sensors 221 a, 221 b and based on the light that is detected by the first and second sensors 221 a, 221 b to assess an optical component quality of the displays 216a, 216b. For example, the processor can be configured to determine whether the displays 216a, 216b are clean, free from scratches and / or cracks, and / or include other imperfections. In some implementations, sensor 221a captures an image(s) of display 216a, sensor 221b captures an image(s) of display 216b, and the processor is configured to analyze the images to determine if display 216a and / or 216b includes a scratch, crack, aberration, or any other imperfection (e.g., using an artificial intelligence model configured to receive an image of a display and analyze the display for scratches, cracks, aberrations, and / or the like). In some implementations, the detection of a scratch, crack, and / or the like includes display(s) 216a, 216b remaining off, light emitter(s) 224a, 224b illuminating display(s) 216a, 216b, and sensor(s) 221a, 221b capturing an image of display(s) 216a, 216b while display(s) 216a. 216b is off and illuminated by light emitter(s) 224a, 224b.
[0049] While FIG. 2 depicts the light as being emitted from a front side of the displays toward sensors that are disposed behind a backside of the displays, it can be appreciated that the position of the sensor(s) 221 a, 221 b and the emitters 224a, 224b can be reversed.
[0050] Optionally, the case can also include a third sensor 221c (or any number of additional sensors), which can be configured to capture or detect images or patterns (or a portion thereof) on the displays 216a, 216b. The third sensor 221 c can be, for example, acamera. The third sensor 221c can be configured to receive the images or patterns from one or more optical components 225. As described above, such optical components 225 can include one or more light guides, lenses, mirrors, prisms, or periscopes, that can relay the images or patterns to the sensor 221c. The processor of the case (or another processor) can be configured to analyze the images or patterns captured by the sensor 221 c to assess one or more parameters of the AR glasses, including, for example, an alignment between the two displays 216a, 216b, a brightness of display 216a or 216b, a color accuracy of display 216a or 216b, etc. The processor can then calibrate the AR glasses by sending information regarding the one or more parameters to the AR glasses, which can then adjust the operation of the dimming panels, the displays 216a, 216b, and / or other aspects of the AR glasses to account for deviations in any measured parameters. As an example, when assessing color, the AR glasses may display one or more colors, and the processor would expect to detect a certain amount of each color or a certain ratio between colors. When that expected amount or ratio is not detected by the processor due to a deviation, then the processor may send information to the AR glasses, such that the AR glasses adjusts the color parameters of the display(s) 216a, 216b to account for the deviation. Said differently, if the AR glasses are instructed to display a first color, but the case determines that the AR glasses are actually displaying a second color different than the first color, a color parameter of the display(s) 216a, 216b can be updated such that the AR glasses display the first color.
[0051] FIG. 3 is a flow chart showing a method 300 of calibrating an AR device using a calibration device as described herein, according to an embodiment. The AR device and the calibration device, as referenced in the method, can be structurally and / or functionally similar to other AR devices and calibration devices described herein, including those described with reference to FIGS. 1 and 2.
[0052] As shown in FIG. 3, at 301 , the AR device (e.g., AR device 1 10) can display one or more predetermined images or patterns. In some embodiments, the AR device can be instructed (e.g., by a processor, such as the processor 123 of the calibration device 120) to display one or more predetermined images or patterns. In some embodiments, the AR device can be instructed to display a plurality of images or patterns according to a predefined sequence. The predefined sequence can be selected to cycle through images and / or patterns that can provide feedback to the calibration device of one or more parameters of the AR device, including, for example, alignment, color quality, brightness levels, dimming levels, and / or other parameters. The AR device can display the images orpatterns on one or more displays (e.g., displays 116) of the device. The predefined sequence can include, for example, sequencing through different colors, sequencing through different brightnesses, and / or the like.
[0053] At 302, the sensor(s) (e.g., sensors 121 of the calibration device and / or other sensors) can capture or detect the images or patterns that are displayed at 301. In some embodiments, a single sensor can be configured to capture images or patterns that are displayed by the AR device. Alternatively, a plurality of sensors, such as a sensor for each display of the AR device, can be configured to capture images or patterns that are d isplayed by the AR device. The calibration device can include one or more periscopes (e.g., including lenses, prisms, etc.) that can capture the displayed images or patterns from one or more vantage points, and relay this to the sensor(s). The sensors can provide this information to a processor (e.g., the processor 123 of the calibration device 120), which can then analyze the information to assess one or more parameters of the AR device, at 304.
[0054] In some implementations, the processor can assess an alignment between multiple displays of the AR device. For example, the AR device can include two displays, with one display positioned in front of each eye of a user. Over time, the pointing vector (i.e., vector normal to the display surface) may shift, e.g., due to deformation of the AR device caused by external forces and / or wear or tear of the AR device. Therefore, the processor can analyze the images or patterns being displayed to assess the pointing vector of the displays, and to evaluate the alignment between the displays.
[0055] In some implementations, the processor can assess a brightness of the display. For example, the AR device can be configured to display an image or pattern given a preset brightness, and the processor can assess the images or patterns captured by the sensor(s) to determine whether the captured images or patterns align or deviate in brightness from the preset brightness. In cases involving two separate displays, the processor can assess the brightness of each display, and determine whether to adjust the operating parameters of one or both displays to ensure conformity across the two displays and consistency with the preset brightness.
[0056] In some implementations, the processor can assess a color accuracy of the displays. For example, the AR device can be configured to display one or more images or patterns having preset colors, and the processor can assess the images or patterns captured by the sensor(s) to determine whether the captured images or patterns align with or deviate from the preset colors. The processor can be configured to send signals to the AR device tocause it to display the one or more images or patterns. In other words, the processor may determine whether an expected level of each color (e.g., blue, red, yellow) is present in the images or patterns captured by the sensor(s) to determine whether the captured images or patterns have the same color as what was expected. In cases involving two separate displays, the processor can assess the color of each display, and determine whether to adj ust the operating parameters of one or both displays to ensure conformity across the two displays and consistency with preset colors.
[0057] Other parameters, including dimming levels and optical component quality, as described above, can also be assessed.
[0058] At 306, one or more light emitters external to the AR glasses can be activated. As described above, the light emitters can be disposed in the calibration device, such as, for example, light emitters 124. The light emitters can be configured to emit light toward the displays or lenses of the AR device, and light that passes through the displays can be captured or detected by a sensor (e.g., sensor 121 ), at 308. The sensor can provide this information to a processor (e.g., the processor 123 of the calibration device 120), which can then analyze the information to assess one or more parameters of the AR device, at 310.
[0059] In particular, at 310, the processor may analyze the sensor data to assess a dimming level of the AR device or an optical component quality of the AR device (e.g., whether the lenses of the AR device are clean, have scratches, and / or other imperfections). As described above, it may be desirable to assess the dimming level to ensure that sufficient contrast is provided to a user for viewing one or more virtual objects that are displayed on the AR device. The processor may assess whether the amount or percentage of light that has passed through the display or lens of the AR device is consistent with or deviates from that expected based on the preset dimming level of the AR device.
[0060] If there is a deviation or disparity between the sensed images, patterns, or light (312: YES), then the processor, at 314, can transmit updated parameters or other information to the AR device, to allow the AR device to adjust its operation to account for such disparity. In some implementations, the AR device, upon receiving the updated parameters from the processor, can be configured to overwrite the values in one or more calibration file(s) (e.g., a file for storing the parameters for operating the AR device). Then when the AR device operates, the AR device can access the new values in the calibration file(s). Additionally, or alternatively, the processor can alert a user to the disparities or other information regarding the parameters, at 316. For example, the processor can sendinformation to an external compute device (e.g., compute device 130), which can alert a user as to the disparity in the AR device. The processor can also send information to the compute device that alerts the user that there is an issue with a component of the AR device, e.g., a dirty or scratched up lens.
[0061] While the method depicted in FIG. 3 is described as being initiated and / or controlled by the processor of the calibration case, it can be appreciated that the processor of the AR device (e.g., processor 1 12) can be configured to initiate and / or control one or more steps of the method. For example, instead of the processor of the calibration case sending signals to the AR device to cause the AR device to display images and / or patterns, the processor of the AR device can initiate the calibration by displaying one or more images or patterns on the displays of the AR device and / or send signals to the processor of the calibration case to cause the calibration case to activate sensor(s), process signals from the sensors, etc.
[0062] FIGS. 4A and 4B illustrate perspective views of a case, according to an embodiment. FIG. 4A illustrates a case 402 that is closed. An exterior of the case 402 can be made, for example, of a rigid or semi-rigid material (e.g., a plastic such as high density polyethylene (HDPE), fiberglass reinforced polyester (FRP), carbon fiber, etc.). FIG. 4B illustrates the AR glasses 404 inside of the case 402 when the case 402 is open. Although not shown in FIG. 4 A, in some implementations, the case 402 can include a button (or other trigger) that, if selected, can be selected by a user to begin calibrating the AR glasses 404 and / or stop calibrating the AR glasses 404. Additionally or alternatively, the case 402 can begin calibrating the AR glasses 404 in response to (1) inserting the AR glasses in the case 402 and (2) closing the case 402.
[0063] FIG. 5 illustrates an example of a misalignment, according to an embodiment. As shown in FIG. 5, AR glasses includes the displays 502 and 504, which are not entirely coplanar. Instead, display 502 is slanted slightly relative to display 504 such that the pointing vector (vector that is normal to display 502) of display 502 is not parallel to the pointing vector (vector that is normal to display 504) of display 504. The misalignment can be caused by, for example, an external force causing display 502 and / or 504 to bend. Despite this misalignment, however, techniques described herein can detect the misalignment and perform remedial actions to account for the misalignment.
[0064] FIG. 6 illustrates a top internal view of a calibration case containing AR glasses, according to an embodiment. FIG. 6 illustrates LEDs 61 and 62, photodiodes or cameras63 and 64, camera 65, optics 66, AR glasses 67, and case 68. LEDs 61 and 62 are configured to emit light. In some implementations, LEDs 61 and 62 produce the same light (e.g., same intensity, same wavelength, etc.). In some implementations, LEDs 61 and 62 do not produce the same light.
[0065] In some implementations, the AR glasses 67 display predetermined patterns, which are captured by the optics 66 and relayed to the camera 65. These patterns, along with images captured by the camera 65, are then processed by a processor housed within or external to the calibration case (e.g., processor 123 of FIG. 1). The processor can detect misalignment between the displays of the AR glasses 67, and transmit updated parameters that account for the misalignment to the AR glasses 67 (e.g., via Bluetooth®, Wi-Fi®, USB, and / or the like).
[0066] In some implementations, camera 65 and / or photodiodes or cameras 63 and 64 captures images I light at one or more different colors and brightness levels at the displays of the AR glasses 67 to calibrate luminance (e.g., brightness) and chroma (e.g., color) values for the displays of the AR glasses 67. In some implementations, any deviation in the luminance or chroma values between previously calculated values can trigger the updated luminance and / or chroma values to be sent to the AR glasses 76 so that the AR glasses 67 can update the luminance and / or chroma values, ensuring repeated (e.g., continuous, periodic, sporadic) monitoring and performance.
[0067] In some implementations, LEDs 61 and 62 activate, and photodiodes or camera 63 and 64 measure transmission levels of the dimming panels across one or more LED settings (e.g., colors, light intensities, etc,). In some implementations, any deviation at the dimming panels from previously calculated values can trigger the updated dimming parameters to be sent to the AR glasses 76 so that the AR glasses 67 can update the dimming, ensuring repeated (e.g., continuous, periodic, sporadic) monitoring and performance.
[0068] In some implementations, photodiodes or cameras 63 or 64 can analyze the displays of the AR glasses 67 for any defects within the optic stack (e.g., scratches, cracks, etc.). For example, images of the displays of the AR glasses 67 can be taken and analyzed for defects.
[0069] Although FIG. 6 illustrates camera 65 and photodiode or camera 63 and 64, in some implementations, the calibration case does not include camera 65 and instead photodiode or camera 63 and 64 perform the functionalities of camera 65
[0070] In some implementations, misalignment can be performed using camera 65 and not photodiodes or cameras 63 or 64. In some implementations, misalignment is performed using camera 65 and photodiodes or cameras 63 or 64. In some implementations, luminance and chroma measured using camera 65 and not. photodiodes or cameras 63 or 64. Tn some implementations, dimming and scratches / cracks are analyzed using photodiodes or cameras 63 or 64 and not camera 65.
[0071] FIG. 7 illustrates a flowchart of a method 700 to calculate an alignment adjustment valued based on an identified misalignment, according to an embodiment. In some implementation, method 700 is performed by a processor (e.g., processor 123 of FIG. I)-
[0072] At 702, a signal is sent to an augmented reality (AR) device (e.g., AR device 1 10 of FIG. 1 ) to display a first set of images on a first display (e.g., display(s) 1 16 of FIG. 1 ) to produce a first optical output, and to display the first set of images on a second display (e.g., display(s) 1 16) of the AR device to produce a second optical output. The first set of images can include one or more images.
[0073] At 704, a first set of signals are received based on the first optical output from a set of sensors (e.g., sensor(s) 121 of FIG. 1) of a calibration device (e.g., calibration device 120 of FIG. 1) and a second set of signals based on the second optical output from the set of sensors of the calibration device.
[0074] At 706, a determination is made of a first pointing vector of the first display based on the first set of signals and a second pointing vector of the second display based on the second set of signals. The first pointing vector can be, for example, a normal vector extending from the surface of the first display, and the second pointing vector can be, for example, a normal vector extending from the surface of the second display.
[0075] At 708, a misalignment between the first display and the second display is identified based on the first pointing vector and the second pointing vector. For example, the first pointing vector not being parallel to the second pointing vector can indicate that the first display and the second display are misaligned. Further, the magnitude that the first and second pointing vectors deviate from parallel and indicate the magnitude of misalignment.
[0076] At 710, one or more alignment adjustment values are calculated based on the misalignment. The one or more alignment adjustment values are associated with a digitalcorrection of the misalignment (e.g., make software-based adjustments to compensate for the physical deviation between the first display and the second display).[0077} At 712, a signal is sent to the AR device to overwrite a calibration file of the AR device with the one or more alignment adjustment values. The calibration fde can be, for example, a list of one or more values or parameters that the AR device can use to correct / compensate for, for example, the misalignment or some other parameter of the AR device.
[0078] In some implementations of method 700, method 700 is performed by a processor that is (1 ) operably coupled to the calibration device and (2) disposed within the calibration device. In some implementations of method 700, the calibration device is a calibration case including a housing configured to store and protect the AR device. In some implementations of method 700, the set of sensors includes at least one of an RGB camera or a grayscale camera. In some implementations of method 700, the calibration device includes a re-chargeable power supply configured to charge at least one of a power supply of the AR device or the calibration device.
[0079] Some implementations of method 700 further include measuring (1) a first luminance of the first display based on the first set of signals and (2) a second luminance of the second display based on the second set of signals. A first deviation between the first luminance and a third luminance (e.g., expected or computer-instructed luminance) of the first set of images is determined. A second deviation between the second l uminance and the third luminance is determined. A first correction factor is calculated based on the first deviation. The first correction factor is associated with a digital correction of the first deviation. A second correction factor is calculated based on the second deviation. The second correction factor is associated with a digital correction of the second deviation. A signal is sent to the AR device to overwrite a calibration file of the AR device with at least one of the first correction factor or the second correction factor.
[0080] Some implementations of method 700 further include measuring (1) a first chroma of the first display based on the first set of signals and (2) a second chroma of the second display based on the second set of signals. A first deviation between the first chroma and a third chroma (e.g., expected of computer-instructed chroma) of the first set of images is determined. A second deviation between the second chroma and the third chroma is determined. A first correction factor is calculated based on the first deviation. The first correction factor is associated with a digital correction of the first deviation. A second correction factor is calculated based on the second deviation. The second correction factoris associated with a digital correction of the second deviation. A signal is sent to the AR device to overwrite a calibration file of the AR device with at least one of the first correction factor or the second correction factor.
[0081] FIG. 8 illustrates a flowchart of a method 800 to determine a deviation, according to an embodiment. In some implementation, method 800 is performed by a processor (e.g., processor 123 of FIG. 1 ).
[0082] At 802, a signal is sent to an AR device (e.g., AR device 1 10 of FIG. 1) to display a first plurality of images on a first display (e.g., display(s) 1 16 of FIG. 1) and on a second display (e.g., display(s) 1 16) to produce an optical output. At 804, a plurality of signals is received based on the optical output from a set of sensors (e.g., sensor(s) 121 of FIG. 1 ) to produce a second plurality of images. The optical output is relayed to the set of sensors by an optical component. At 806, a first set of parameters of the second plurality of images are measured. At 808, a deviation between the first set of parameters and a second set of parameters of the first plurality of images is determined. At 810, a third set of parameters are calculated based on the deviation . The third set of parameters are associated with a digital correction of the deviation. At 812, a signal is sent to the AR device to overwrite a calibration file of the AR device with the third set of parameters. At 814, a signal is sent to a compute device (e.g., compute device 130) to alert a user of the deviation. For example, the signal can be sent to compute device 130 of FIG. 1 , and in response to receiving the signal, compute device 130 can generate the alert (e.g., a visual alert, a haptic alert, etc.).
[0083] In some implementations of method 800, the set of sensors includes at least one of an RGB camera or a grayscale camera. In some implementations of method 800, the first set of parameters includes a first chroma, the second set of parameters includes a second chroma, the deviation includes a deviation in a color accuracy of the AR device, and the third set of parameters includes a correction factor based on the deviation in the color accuracy of the AR device.
[0084] In some implementations of method 800, the first set of parameters includes a first luminance, the second set of parameters includes a second luminance, the deviation includes a deviation in a brightness of the AR device, and the third set of parameters includes a correction factor based on the deviation in the brightness of the AR device.
[0085] In some implementations of method 800, the optical output is a first optical output and the plurality of signals is a first plurality of signals. Some implementations ofmethod 800 further include sending a signal to the AR device to display the first plurality of images on the first display and on the second display of the AR device, to produce a second optical output. A second plurality of signals are received based on the second optical output from the set of sensors to produce a third plurality of images. The second optical output is relayed to the set of sensors by the optical component. A fourth set of parameters of the third plurality of images is measured. An absence of a disparity between the fourth set of parameters and the second set of parameters is determined to produce an accuracy of the calibration file of the AR device. A signal is sent to a compute device communicatively coupled to the processor to alert a user of the accuracy of the calibration file of the AR device.
[0086] FIG. 9 illustrates a flowchart of a method 900 to determine a deviation between dimming levels, according to an embodiment. In some implementation, method 900 is performed by a processor (e.g., processor 123 of FIG. 1 ).
[0087] At 902, at a first time, a first light emitter (e.g., light emitter(s) 124 of FIG. 1) of a calibration device (e.g., calibration device 120 of FIG. 1) is activated. The first light emitter is configured to send a first optical output to a first display (e.g., display(s) 116 of FIG. 1) of an AR device (e.g., AR device 1 10 of FIG. 1) to produce a second optical output. At 904, a second light emitter (e.g., light emitter(s) 124) of the calibration device is activated. The second light emitter is configured to send a third optical output to a second display (e.g., display(s) 1 16) of the AR device to produce a fourth optical output. At 906, a first plurality of signals associated with the second optical output is received from a first sensor (e.g., sensor(s) 121) of the calibration device. At 908, a second plurality of signals associated with the fourth optical output is received from a second sensor (e.g., sensor(s) 121) of the calibration device. At 910, a first dimming level of the AR device is measured based on at least one of the first plurality of signals or the second plurality of signals. At 912, a deviation between the first dimming level and a second dimming level of the AR device is determined. The second dimming level is defined at a second time prior to the first time. At 914, a correction factor is calculated based on the deviation. The correction factor is associated with a digital correction for the deviation. At 916, a signal is sent to the AR device to overwrite a calibration file of the AR device with the correction factor.
[0088] In some implementations of method 900, the first sensor includes at least one of a first photodiode or a first camera, the second sensor includes at least one of a secondphotodiode or a second camera, the first light emitter includes a first light emitting diode, and the second light emitter includes a second light emitting diode.[0089J In some implementations of method 900, the calibration device is a calibration case including a housing. The housing is configured to store and protect the AR device.
[0090] Some implementations of method 900 further include sending a signal to the AR device to display a first plurality of images on the first display and on the second display of the AR device to produce a fifth optical output. A third plurality of signals is received from a third sensor (e.g., sensor(s) 121) of the calibration device to produce a second plurality of images. The third plurality of images are associated with the first optical output. The fifth optical output is relayed to the third sensor by an optical component of the calibration device. A first set of parameters of the second plurality of images is measured. A disparity between the first set of parameters and a second set of parameters of the first plurality of images is determined. A third set of parameters is calculated based on the disparity. The third set of parameters is associated with a digital correction of the disparity. A signal is sent to the AR device to overwrite a calibration file of the AR device with the third set of parameters. A signal is sent to a compute device configured to be communicatively coupled to a processor (e.g., processor 132 or a processor not shown in FIG. 1 ) to alert a user of the disparity.
[0091] In some implementations of method 900, the defect is at least one of a scratch, a crack or an optical aberration.
[0092] Some implementations of method 900 further include receiving a log from the AR device. The log includes an indication of at least one operating parameter of the AR device. The log is sent to a remote compute device that is configured to store the log.
[0093] AU combinations of the foregoing concepts and additional concepts discussed herewithin (provided such concepts are not mutually inconsistent) are contemplated as being part of the subject matter disclosed herein. The terminology explicitly employed herein that also may appear in any disclosure incorporated by reference should be accorded a meaning most consistent with the particular concepts disclosed herein.
[0094] The drawings are primarily for illustrative purposes, and are not intended to limit the scope of the subject matter described herein. The drawings are not necessarily to scale; in some instances, various aspects of the subject matter disclosed herein may be shown exaggerated or enlarged in the drawings to facilitate an understanding of differentfeatures. In the drawings, like reference characters generally refer to like features (e.g., functionally similar and / or structurally' similar elements).[0095} The entirety of this application (including the Cover Page, Title, Headings, Background, Summaiy, Brief Description of the Drawings, Detailed Description, Embodiments, Abstract, Figures, Appendices, and otherwise) shows, byway of illustration, various embodiments in which the embodiments may be practiced. The advantages and features of the application are of a representative sample of embodiments only, and are not exhaustive and / or exclusive. Rather, they are presented to assist in understanding and teach the embodiments, and are not representative of all embodiments. As such, certain aspects of the disclosure have not been discussed herein. That alternate embodiments may not have been presented for a specific portion of the innovations or that further undescribed alternate embodiments may be available for a portion is not to be considered to exclude such alternate embodiments from the scope of the disclosure. It will be appreciated that many of those undescribed embodiments incorporate the same principles of the innovations and others are equivalent. Thus, it is to be understood that other embodiments may be utilized and functional, logical, operational, organizational, structural and / or topological modifications may be made without departing from the scope and / or spirit of the disclosure. As such, all examples and / or embodiments are deemed to be non-limiting throughout this disclosure.
[0096] Also, no inference should be drawn regarding those embodiments discussed herein relative to those not discussed herein other than it is as such for purposes of reducing space and repetition. For instance, it is to be understood that the logical and / or topological structure of any combination of any program components (a component collection), other components and / or any present feature sets as described in the figures and / or throughout are not limited to a fixed operating order and / or arrangement, but rather, any disclosed order is exemplary and all equivalents, regardless of order, are contemplated by the disclosure.
[0097] The term “automatically” is used herein to modify actions that occur without direct input or prompting by an external source such as a user. Automatically occurring actions can occur periodically, sporadically, in response to a detected event (e.g., a user logging in), or according to a predetermined schedule.
[0098] The term “determining” encompasses a wide variety' of actions and, therefore, “determining” can include calculating, computing, processing, deriving, investigating, looking up (e.g., looking up in a table, a database or another data structure), ascertaining and the like. Also, “determining” can include receiving (e.g., receiving information),accessing (e.g., accessing data in a memory) and the like. Also, “determining” can include resolving, selecting, choosing, establishing and the like.[0099J The phrase “based on” does not mean “based only on,” unless expressly specified otherwise. In other words, the phrase “based on” describes both “based only on” and “based at least on.”
[0100] The term “processor” should be interpreted broadly to encompass a general purpose processor, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a controller, a microcontroller, a state machine and so forth. Under some circumstances, a “processor” may refer to an application specific integrated circuit (ASIC), a programmable logic device (PUD), a field programmable gate array (FPGA), etc. The term “processor” may refer to a combination of processing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core or any other such configuration.
[0101] The term “memory” should be interpreted broadly to encompass any electronic component capable of storing electronic information. The term memory may refer to various types of processor-readable media such as random access memory (RAM), readonly memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, magnetic or optical data storage, registers, etc. Memory is said to be in electronic communication with a processor if the processor can read information from and / or write information to the memory. Memory that is integral to a processor is in electronic communication with the processor.
[0102] The terms “instructions” and “code” should be interpreted broadly to include any type of computer-readable statement(s). For example, the terms “instructions” and “code” may refer to one or more programs, routines, sub-routines, functions, procedures, etc. “Instructions” and “code” may comprise a single computer-readable statement or many computer-readabl e statements .
[0103] Some embodiments described herein relate to a computer storage product W'ith a non-transitory computer-readable medium (also can be referred to as a non-transitory processor-readable medium) having instructions or computer code thereon for performing various computer-implemented operations. The computer-readable medium (or processor- readable medium) is non-transitory in the sense that it does not include transitory propagating signals per se (e.g., a propagating electromagnetic wave carrying informationon a transmission medium such as space or a cable). The media and computer code (also can be referred to as code) may be those designed and constructed for the specific purpose or purposes. Examples of non-transitory computer-readable media include, but are not limited to, magnetic storage media such as hard disks, floppy disks, and magnetic tape; optical storage media such as Compact Disc / Digital Video Discs (CD / DVDs), Compact Disc-Read Only Memories (CD-ROMs), and holographic devices; magneto-optical storage media such as optical disks; carrier wave signal processing modules; and hardware devices that are specially configured to store and execute program code, such as Application- Specific Integrated Circuits (ASICs), Programmable Logic Devices (PLDs), Read-Only Memory (ROM) and Random-Access Memory (RAM) devices. Other embodiments described herein relate to a computer program product, which can include, for example, the instructions and / or computer code discussed herein.
[0104] Some embodiments and / or methods described herein can be performed by software (executed on hardware), hardware, or a combination thereof. Hardware modules may include, for example, a general-purpose processor, a field programmable gate array (FPGA), and / or an application specific integrated circuit (ASIC). Software modules (executed on hardware) can be expressed in a variety of software languages (e.g., computer code), including C, C++, Java™, Ruby, Visual Basic™, and / or other object-oriented, procedural, or other programming language and development tools. Examples of computer code include, but are not limited to, micro-code or micro-instructions, machine instructions, such as produced by a compiler, code used to produce a web service, and files containing higher-level instructions that are executed by a computer using an interpreter. For example, embodiments may be implemented using imperative programming languages (e.g., C, Fortran, etc.), functional programming languages (Haskell, Erlang, etc.), logical programming languages (e.g., Prolog), object-oriented programming languages (e.g., Java, C++, etc.) or other suitable programming languages and / or development tools. Additional examples of computer code include, but are not limited to, control signals, encrypted code, and compressed code.
[0105] Various concepts may be embodied as one or more methods, of which at least one example has been provided. The acts performed as part of the method may be ordered in any suitable way. Accordingly, embodiments may be constructed in which acts are performed in an order different than illustrated, which may include performing some acts simultaneously, even though shown as sequential acts in illustrative embodiments. Putdifferently, it is to be understood that such features may not necessarily be limited to a particular order of execution, but rather, any number of threads, processes, services, servers, and / or the like that may execute serially, asynchronously, concurrently, in parallel, simultaneously, synchronously, and / or the like in a manner consistent with the disclosure. As such, some of these features may be mutually contradictory, in that they cannot be simultaneously present in a single embodiment. Similarly, some features are applicable to one aspect of the innovations, and inapplicable to others.
[0106] In addition, the disclosure may include other innovations not presently described. Applicant reserves all rights in such innovations, including the right to embodiment such innovations, file additional applications, continuations, continuations-in- part, divisionals, and / or the like thereof. As such, it should be understood that advantages, embodiments, examples, functional, features, logical, operational, organizational, structural, topological, and / or other aspects of the disclosure are not to be considered limitations on the disclosure as defined by the embodiments or limitations on equivalents to the embodiments. Depending on the particular desires and / or characteristics of an individual and / or enterprise user, database configuration and / or relational model, data type, data transmission and / or network framework, syntax structure, and / or the like, various embodiments of the technology disclosed herein may be implemented in a manner that enables a great deal of flexibility and customization as described herein.
[0107] All definitions, as defined and used herein, should be understood to control over dictionary definitions, definitions in documents incorporated by reference, and / or ordinary meanings of the defined terms.
[0108] As used herein, in particular embodiments, the terms “about” or “approximately” when preceding a numerical value indicates the value plus or minus a range of 10%. Where a range of values is provided, it is understood that each intervening value, to the tenth of the unit of the lower limit unless the context clearly dictates otherwise, between the upper and lower limit of that range and any other stated or intervening value in that stated range is encompassed within the disclosure. That the upper and lower limits of these smaller ranges can independently be included in the smaller ranges is also encompassed within the disclosure, subject to any specifically excluded limit in the stated range. Where the stated range includes one or both of the limits, ranges excluding either or both of those included limits are also included in the disclosure.
[0109] The indefinite articles “a” and “an,” as used herein in the specification and in the embodiments, unless clearly indicated to the contrary, should be understood to mean “at least one.”[OHO] The phrase “and / or,” as used herein in the specification and in the embodiments, should be understood to mean “either or both” of the elements so conjoined, i.e., elements that are conjunctively present in some cases and disjunctively present in other cases. Multiple elements listed with “and / or” should be construed in the same fashion, i.e., “one or more” of the elements so conjoined. Other elements may optionally be present other than the elements specifically identified by the “and / or” clause, whether related or unrelated to those elements specifically identified. Thus, as a non-limiting example, a reference to “A and / or B”, when used in conjunction with open-ended language such as “comprising” can refer, in one embodiment, to A only (optionally including elements other than B); in another embodiment, to B only (optionally including elements other than A); in yet another embodiment, to both A and B (optionally including other elements); etc.
[0111] As used herein in the specification and in the embodiments, “or” should be understood to have the same meaning as “and / or” as defined above. For example, when separating items in a list, “or” or “and / or” shall be interpreted as being inclusive, i.e., the inclusion of at least one, but also including more than one, of a number or list of elements, and, optionally, additional unlisted items. Only terms clearly indicated to the contrary, such as “only one of’ or “exactly one of,” or, when used in the embodiments, “consisting of,” will refer to the inclusion of exactly one element of a number or list of elements. In general, the term “or” as used herein shall only be interpreted as indicating exclusive alternatives (i.e. “one or the other but not both”) when preceded by terms of exclusivity, such as “either,” “one of,” “only one of,” or “exactly one of.” “Consisting essentially of,” when used in the embodiments, shall have its ordinary meaning as used in the field of patent law.
[0112] As used herein in the specification and in the embodiments, the phrase “at least one,” in reference to a list of one or more elements, should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each and every element specifically listed within the list of elements and not excluding any combinations of elements in the list of elements. This definition also allows that elements may optionally be present other than the elements specifically identified within the list of elements to which the phrase “at least one” refers, whether related or unrelated to those elements specifically identified. Thus, as a non-limiting example, “at least one of A and B” (or, equivalently, “at least one of A or B,” or, equivalently “at least one of A and / or B”) can refer, in one embodiment, to at least one, optionally including more than one, A, with no B present (and optionally including elements other than B); in another embodiment, to at least one, optionally including more than one, B, with no A present (and optionally including elements other than A); in yet another embodiment, to at least one, optionally including more than one, A, and at least one, optionally including more than one, B (and optionally including other elements); etc.
[0113] In the embodiments, as well as in the specification above, all transitional phrases such as “comprising,” “including,” “carrying,” “having,” “containing,” “involving,” “holding,” “composed of,” and the like are to be understood to be open-ended, i.e., to mean including but not limited to. Only the transitional phrases “consisting of” and “consisting essentially of’ shall be closed or semi-closed transitional phrases, respectively, as set forth in the United States Patent Office Manual of Patent Examining Procedures, Section 21 1 1.03.
Claims
CLAIMS1 . A method, comprising: sending, from a processor, a signal to an augmented reality (AR) device to display a first set of images on a first display to produce a first optical output, and to display the first set of images on a second display of the AR device to produce a second optical output; receiving, at the processor, a first set of signals based on the first optical output from a set of sensors of a calibration device and a second set of signals based on the second optical output from the set of sensors of the calibration device; determining, using the processor, a first pointing vector of the first display based on the first set of signals and a second pointing vector of the second display based on the second set of signals; identifying, using the processor, a misalignment between the first display and the second display based on the first pointing vector and the second pointing vector; calculating, using the processor, one or more alignment adjustment values based on the misalignment, the one or more alignment adjustment values associated with a digital correction of the misalignment; and sending, from the processor, a signal to the AR device to overwrite a calibration file of the AR device with the one or more alignment adjustment values.
2. The method of claim 1 , wherein the processor is (1) operably coupled to the calibration device and (2) disposed within the calibration device.
3. The method of claim 1 , wherein the calibration device is a calibration case including a housing configured to store and protect the AR device.
4. The method of claim 1 , wherein the set of sensors include at least one of a red-green- blue (RGB) camera or a grayscale camera.
5. The method of claim 1 , wherein the calibration device includes a re-chargeable power supply configured to charge at least one of a pow er supply of the AR device or the calibration device.
6. The method of claim 1 , further comprising: measuring, using the processor, ( 1 ) a first luminance of the first display based on the first set of signals and (2) a second luminance of the second display based on the second set of signals; determining, using the processor, a first deviation between the first luminance and a third luminance of the first set of images; determining, using the processor, a second deviation between the second luminance and the third luminance; calculating, using the processor, a first correction factor based on the first deviation, the first correction factor being associated with a digital correction of the first deviation; calculating, using the processor, a second correction factor based on the second deviation, the second correction factor being associated with a digital correction of the second deviation; and sending, from the processor, a signal to the AR device to overwrite a calibration file of the AR device with at least one of the first correction factor or the second correction factor.
7. The method of claim 1, further comprising: measuring, using the processor, (1 ) a first chroma of the first display based on the first set of signals and (2) a second chroma of the second display based on the second set of signals; determining, using the processor, a first deviation between the first chroma and a third chroma of the first set of images;determining, using the processor, a second deviation between the second chroma and the third chroma; calculating, using the processor, a first correction factor based on the first deviation, the first correction factor being associated with a digital correction of the first deviation; calculating, using the processor, a second correction factor based on the second deviation, the second correction factor being associated with a digital correction of the second deviation; and sending, from the processor, a signal to the AR device to overwrite a calibration file of the AR device with at least one of the first correction factor or the second correction factor.
8. An apparatus, comprising: a calibration case, including: a housing configured to store an augmented-reality (AR) device that has a first display and a second display, a re-chargeable power supply configured to charge at least one of a power supply of the AR device or the calibration case, a set of sensors, an optical component, a processor, and a non-transitory, processor-readable medium storing instructions that when executed by the processor cause the processor to: send a signal to the AR device to display a first plurality of images on the first display and on the second display of the AR device, to produce an optical output; receive a plurality of signals based on the optical output from the set of sensors to produce a second plurality of images, the optical output being relayed to the set of sensors by the optical component;measure a first set of parameters of the second plurality of images; determine a deviation between the first set of parameters and a second set of parameters of the first plurality of images; calculate a third set of parameters based on the deviation, the third set of parameters being associated with a digital correction of the deviation; send a signal to the AR device to overwrite a calibration file of the AR device with the third set of parameters; and send a signal to a compute device communicatively coupled to the processor to alert a user of the deviation.
9. The apparatus of claim 8, wherein the set of sensors include at least one of an RGB camera or a grayscale camera.
10. The apparatus of claim 8, wherein the first set of parameters includes a first chroma, the second set of parameters includes a second chroma, the deviation includes a deviation in a color accuracy of the AR device, and the third set of parameters includes a correction factor based on the deviation in the color accuracy of the AR device.1 1 . The apparatus of claim 8, wherein the first set of parameters includes a first luminance, the second set of parameters includes a second luminance, the deviation includes a deviation in a brightness of the AR device, and the third set of parameters includes a correction factor based on the deviation in the brightness of the AR device.
12. The apparatus of claim 8, wherein the optical output is a first optical output, the plurality of signals is a first plurality of signals, and the non-transitory processor-readable medium stores further instructions that cause the processor further to; send a signal to the AR device to display the first plurality of images on the first display and on the second display of the AR device, to produce a second optical output;receive a second plurality of signals based on the second optical output from the set of sensors to produce a third plurality of images, the second optical output being relayed to the set of sensors by the optical component; measure a fourth set of parameters of the third plurality of images; determine an absence of a disparity between the fourth set of parameters and the second set of parameters to produce an accuracy of the calibration file of the AR device; and send a signal to a compute device communicatively coupled to the processor to alert a user of the accuracy of the calibration file of the AR device.
13. The apparatus of claim 8, wherein the optical output is a first optical output, the plurality of signals is a first plurality of signals, and the calibration case further includes: a first light-emitting diode (LED) operably coupled to the processor and configured to send a second optical output to the first display, to produce a third optical output; a second LED operably coupled to the processor and configured to send a fourth optical output to the second display, to produce a fifth optical output; at least one of a first photodiode or a first camera configured to receive the third optical output and to send a second plurality of signals based on the third optical output to the processor; and at least one of a second photodiode or a second camera configured to receive the fifth optical output and to send a third plurality of signals based on the fifth optical output to the processor.
14. A non-transitory, processor-readable medium storing instructions that when executed by a processor cause the processor to: activate, at a first time, a first light emitter of a calibration device operably coupled to the processor, the first light emitter being configured to send a first optical output to a first display of an augmented reality (AR) device to produce a second optical output;activate a second light emitter of the calibration device, the second light emitter being configured to send a third optical output to a second display of the AR device to produce a fourth optical output; receive a first plurality of signals associated with the second optical output from a first sensor of the calibration device; receive a second plurality of signals associated with the fourth optical output from a second sensor of the calibration device; measure a first dimming level of the AR device based on at least one of the first plurality of signals or the second plurality of signals; determine a deviation between the first dimming level and a second dimming level of the AR device, the second dimming level being defined at a second time prior to the first time; calculate a correction factor based on the deviation, the correction factor being associated with a digital correction for the deviation; and send a signal to the AR device to overwrite a calibration file of the AR device with the correction factor.
15. The non-transitory, processor-readable medium of claim 14, w'herein the first sensor includes at least one of a first photodiode or a first camera, the second sensor includes at least one of a second photodiode or a second camera, the first light emitter includes a first light emitting diode (LED), and the second light emitter includes a second LED.
16. The non-transitory, processor-readable medium of claim 14, wherein the calibration device is a calibration case including a housing, the housing being configured to store and protect the AR device.
17. The non-transitory, processor-readable medium of claim 14, storing further instructions that cause the processor further to:identify a defect of at least one of an optical stack of the first display or an optical stack of the second display of the AR device based on the deviation; and send a signal to a compute device communicatively coupled to the processor to alert a user of the defect.
18. The non-transitory, processor-readable medium of claim 14, wherein the calibration device includes a re-chargeable power supply configured to charge at least one of a power supply of the AR device or the calibration device.
19. The non-transitory, processor-readable medium of claim 14, storing further instructions that cause the processor further to: send a signal to the AR device to display a first plurality of images on the first display and on the second display of the AR device to produce a fifth optical output; receive a third plurality of signals from a third sensor of the calibration device to produce a second plurality of images, the third plurality of signals being associated with the fifth optical output, the fifth optical output being relayed to the third sensor by an optical component of the calibration device; measure a first set of parameters of the second plurality of images; determine a disparity between the first set of parameters and a second set of parameters of the first plurality of images; calculate a third set of parameters based on the disparity, the third set of parameters being associated with a digital correction of the disparity; send a signal to the AR device to overwrite a calibration file of the AR device with the third set of parameters; and send a signal to a compute device configured to be communicatively coupled to the processor to alert a user of the disparity.
20. The non-transitory, processor-readable medium of claim 17, wherein the defect is at least one of a scratch, a crack, or an optical aberration.21 . The non-transitory, processor-readable medium of claim 14, storing further instructions that cause the processor further to: receive a log from the AR device, the log including an indication of at least one operating parameter of the A R device; and send the log to a remote compute device that is configured to store the log.
Citation Information
Patent Citations
Apparatus and method to determine a pose of a head mounted display
US20250348133A1
Light field display metrology
US20170122725A1
Head mounted display calibration using portable docking station with calibration target
US20200209628A1
End-to-end artificial reality calibration testing
US20210215940A1