Spot reduction of digital content based on voltage adjustment

Abstract

The invention relates to speckle reduction of digital content based on voltage adjustment. Systems and methods for adjusting the brightness of content output onto one or more displays are provided. One such method includes determining a brightness difference between a plurality of peripheral regions of a display and a gaze point region of the display, and in response to the determination, determining a gaze point of the display, the brightness difference is adjusted by applying a set of peripheral region gamma voltages to the plurality of peripheral regions and another set of gaze point region gamma voltages to the gaze point region, and setting a peripheral region common voltage for the plurality of peripheral regions and a gaze point region common voltage for the gaze point region.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority to U.S. Provisional Application No. 63 / 665,037, filed June 27, 2024, and U.S. Non-Provisional Application No. 19 / 244,880, filed June 20, 2025, the disclosures of which are incorporated herein by reference in their entirety. Technical Field

[0003] This disclosure generally relates to the reduction of spot size in digital content based on voltage regulation. Background Technology

[0004] Rendering and displaying digital content on electronic devices operating in various environments—such as televisions, smartphones, and devices supporting artificial reality and virtual reality features and functions—is a crucial part of providing consumers with a superior visual experience. However, traditional technologies for displaying digital content often suffer from various defects that affect image fidelity and user satisfaction. One persistent problem is that these technologies cannot achieve uniform brightness and color across the entire display surface, resulting in visual inconsistencies that detract from the intended visual presentation. These inconsistencies are exacerbated by limitations in display hardware, manufacturing variations, and suboptimal rendering algorithms, leading to artifacts such as banding, color shifts, and uneven brightness. This inconsistency results in a poor user visual experience. Summary of the Invention

[0005] According to one aspect of this disclosure, a computer-implemented method is provided, the method comprising: determining a brightness difference between a plurality of peripheral regions of a display and a foveation point region of the display; and, in response to the determination, adjusting the brightness difference by: applying a set of peripheral region gamma voltages to the plurality of peripheral regions and applying another set of foveation point region gamma voltages to the foveation point region, and setting a peripheral region common voltage for the plurality of peripheral regions and a foveation point region common voltage for the foveation point region.

[0006] According to another aspect of this disclosure, a system is provided, comprising at least one physical processor; a display; and physical memory including computer-executable instructions that, when executed by the physical processor, cause the physical processor to: determine a brightness difference between a plurality of peripheral regions of the display and a fixation point region of the display; and, in response to the determination, adjust the brightness difference by: applying a set of peripheral region gamma voltages to the plurality of peripheral regions and applying another set of fixation point region gamma voltages to the fixation point region, and setting a peripheral region common voltage for the plurality of peripheral regions and setting a fixation point region common voltage for the fixation point region.

[0007] According to yet another aspect of the disclosure, there is provided a non-transitory computer-readable medium comprising one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to: determine a luminance difference between a plurality of peripheral regions of a display and a foveal region of the display; in response to the determination, adjust the luminance difference by: applying a set of peripheral region gamma voltages to the plurality of peripheral regions and applying another set of foveal region gamma voltages to the foveal region, and setting a peripheral region common voltage for the plurality of peripheral regions and setting a foveal region common voltage for the foveal region. BRIEF DESCRIPTION OF DRAWINGS

[0008] The accompanying drawings illustrate a number of example embodiments and are a part of the detailed description. Together with the following description, the drawings serve to explain various principles of the disclosure.

[0009] Figure 1 is a flowchart of an example computer-implemented method for adjusting a luminance difference between a plurality of regions of a display including foveal digital content.

[0010] Figure 2 is an illustration of an example augmented reality system in accordance with some embodiments of the disclosure.

[0011] Figure 3 is an illustration of an example artificial reality system with a handheld device in accordance with some embodiments of the disclosure.

[0012] Figure 4A is an illustration of an example user interaction within an artificial reality system in accordance with some embodiments of the disclosure.

[0013] Figure 4B is an illustration of an example user interaction within an artificial reality system in accordance with some embodiments of the disclosure.

[0014] Figure 5A is an illustration of an example user interaction within an artificial reality system in accordance with some embodiments of the disclosure.

[0015] Figure 5B is an illustration of an example user interaction within an artificial reality system in accordance with some embodiments of the disclosure.

[0016] Figure 6 is an illustration of an example wrist-worn device of an artificial reality system in accordance with some embodiments of the disclosure.

[0017] Figure 7 is an illustration of an example wearable artificial reality system in accordance with some embodiments of the disclosure.

[0018] Figure 8 is an illustration of an example augmented reality system in accordance with some embodiments of the disclosure.

[0019] Figure 9A is an illustration of an example virtual reality system in accordance with some embodiments of the disclosure.

[0020] Figure 9B is Figure 9A is an illustration of another perspective of the virtual reality system shown in

[0021] Figure 10 is a block diagram showing system components of example artificial reality and virtual reality systems.

[0022] Figure 11 is shown a processor that facilitates outputting digital content with inconsistent resolution characteristics on a display.

[0023] Figure 12 is shown a timing diagram of a display configured to output foveated digital content.

[0024] Figure 13 is an expanded diagram of the timing diagram with additional graphical representations describing pixel timing adjustments for multiple pixels.

[0025] Figure 14 is shown two gate signals applied to two rows of pixels.

[0026] Figure 15 depicts reduced voltage kickback as a result of delayed application of example gate signals.

[0027] Figure 16 is shown a graphical representation of outputting digital content according to different gamma-based source voltages on different areas of a display.

[0028] Figure 17 is shown a blending partition at two boundaries of outputting digital content on a display.

[0029] In all of the drawings, like reference numerals and descriptions represent similar, though not necessarily identical, elements. Although various exemplary embodiments described herein are easily susceptible to various modifications and alternative forms, specific embodiments have been illustrated by way of example in the drawings and will be described in detail herein. However, the exemplary embodiments described herein are not intended to be limited to the particular forms disclosed. Rather, the disclosure is to cover all modifications, equivalents, and alternatives falling within the scope of the appended claims. DETAILED DESCRIPTION

[0030] Rendering and displaying digital content on electronic devices (e.g., televisions, smartphones, devices that support artificial reality and virtual reality-based features and functions) operating in various environments is a key part of providing consumers with superior visual experiences. However, conventional techniques for displaying digital content often suffer from various deficiencies that impact image fidelity and user satisfaction. One persistent issue is that these techniques fail to achieve uniform brightness and color across the entire display surface, resulting in visual inconsistencies that detract from the intended visual presentation. These inconsistencies can be exacerbated by limitations of the display hardware, manufacturing variances, and suboptimal rendering algorithms, resulting in artifacts such as banding, color shifts, and brightness non-uniformities. Such inconsistencies can result in a poor user visual experience.

[0031] One particularly notable manifestation of these deficiencies is a phenomenon known as “mura,” a Japanese term meaning “unevenness” or “stains.” Mura refers to unevenness in a display, such as spots, banding, or hazy areas, which becomes especially apparent in low gray levels or uniform color fields. Mura can be caused by variations in panel materials, backlight inconsistencies, or pixel-level defects, and is often difficult to correct through conventional calibration or compensation techniques. The presence of mura not only degrades the aesthetic quality of digital content, but also impairs the readability and usability of the information displayed, making it a significant challenge for both manufacturers and consumers. Addressing these deficiencies requires advanced solutions to compensate for unevenness and enhance the overall rendering and display quality of digital content.

[0032] The systems and methods described herein address and overcome the aforementioned deficiencies by dynamically adjusting various parameters that control the ability of pixels to output digital content with different levels of fidelity on a display. In this manner, the systems and methods detailed herein correct for instances of mura, enhance the overall rendering and display quality of digital content, and improve the user’s visual experience. In aspects, these systems and methods produce a combination of different voltages and apply them to different pixel rows in order to reduce the luminance or brightness difference between a peripheral region of the display and multiple regions of a foveal region. In other aspects, these methods and systems incorporate a delay or pause period of a predefined timeframe and a combination of different voltages to different pixel rows that ensures that each of the multiple voltages has had time to stabilize—complete the transition from an initial value to a final value (e.g., from 0V to 1V).

[0033] The brightness difference between the foveation region and multiple peripheral regions can be further adjusted by controlling pixel timing, namely (1) precisely managing the order, duration, and delivery of electrical signals (e.g., gate voltage and source voltage) associated with the peripheral and foveation regions, (2) incorporating pauses of appropriate length at the boundaries between the peripheral and foveation regions, and (3) setting specific values ​​for various pixel timing parameters, such as demultiplexer on-time parameters, demultiplexer dead time parameters, pixel charging time, etc. In all respects, another effective technique for improving the uniformity of visual digital content involves introducing periodic offsets or timing delays in the delivery of electrical signals (e.g., gate voltages to multiple pixels in a particular row). Conventional systems and methods deliver gate voltages to all pixels in a particular row essentially simultaneously, which results in voltage backlash—the accumulation of voltage spikes at each pixel receiving the gate voltage. Voltage backlash causes digital content distortion and increases content non-uniformity. As described herein, introducing periodic offsets or timing delays prevents this accumulation of voltage spikes and thus significantly reduces content distortion.

[0034] Based on the general principles described herein, features from any of the embodiments described herein can be combined with each other. These and other embodiments, features, and advantages will be more fully understood upon reading the following detailed description in conjunction with the accompanying drawings and claims.

[0035] The following will refer to Figures 1 to 17 Provides a detailed description of methods and systems for adjusting the brightness differences between foveated digital content output to a display.

[0036] Figure 1 This is a flowchart of an exemplary computer-implemented method 100 for adjusting brightness differences between multiple areas of a display that includes foveated digital content. Figure 1 The steps shown can be performed by any suitable computer-executable code and / or computing system (including...). Figure 10 (as shown in one or more systems) to execute. In one example, Figure 1 Each of the multiple steps shown can represent an algorithm whose structure includes and / or is represented by multiple sub-steps, examples of which will be provided in more detail below.

[0037] like Figure 1As shown, in step 110, one or more systems described herein can determine the brightness differences between multiple peripheral regions of the display and the foveation point region of the display. In various aspects, the peripheral regions may include low-resolution digital content, while the foveation point region may include high-resolution digital content. The foveation point region may include content with higher brightness or appearing brighter to the viewer compared to the peripheral regions, while the peripheral regions may include digital content with lower resolution or lower brightness compared to the foveation point region. Furthermore, in various aspects, the top boundary of the foveation point region may be adjacent to the boundary of one of the multiple peripheral regions, and the bottom boundary of the foveation point region may be adjacent to the boundary of another of the multiple peripheral regions.

[0038] In step 120, one or more of the systems described herein can adjust the brightness difference between the foveation region and multiple peripheral regions. For example, one or more of the systems described herein can apply a set of peripheral gamma-based voltages to multiple pixels associated with the peripheral regions and a foveation gamma-based voltage to multiple pixels associated with the foveation region. In various respects, one or more of the systems described herein can utilize these varying gamma-based voltages across the peripheral and foveation regions to control the brightness difference between these regions, i.e., adjust the brightness difference to improve the uniformity of the digital content.

[0039] In all respects, each of the peripheral gamma-based source voltage and the fixation-point gamma-based source voltage corresponds to a series of reference voltages. Each of these voltages is determined using a gamma curve. For example, the fixation-point gamma-based source voltage is determined using a gamma curve that includes the digital input value and the corresponding luminance value. Similarly, the peripheral region-based source voltage is determined using another gamma curve—one that is less steep than the gamma curve used to determine the fixation-point gamma-based source voltage. Furthermore, in all respects, the system described herein sets a peripheral common voltage for the peripheral region and a fixation-point common voltage for the fixation region. Moreover, the system described herein utilizes the gamma-based voltages (e.g., the gamma-based source voltages) and the common voltage to control the difference in luminance levels between the digital content output to the peripheral region and the fixation-point region.

[0040] Example Implementation

[0041] Example 1: A computer-implemented method may include: determining a brightness difference between a plurality of peripheral regions of a display and a foveation region of the display; and, in response to the determination, adjusting the brightness difference by: applying a set of peripheral region gamma voltages to the plurality of peripheral regions and applying another set of foveation region gamma voltages to the foveation region, and setting a peripheral region common voltage for the plurality of peripheral regions and a foveation region common voltage for the foveation region.

[0042] Example 2: The computer-implemented method according to Example 1, wherein the top boundary of the fixation point region is adjacent to the boundary of one of the plurality of peripheral regions, and the bottom boundary of the fixation point region is adjacent to the boundary of another of the plurality of peripheral regions.

[0043] Example 3: A computer-implemented method according to either Example 1 or Example 2, wherein the set of peripheral region gamma voltages corresponds to a series of reference voltages, each of which corresponds to a corresponding digital input value, and the other set of fixation point region gamma voltages corresponds to another series of reference voltages, each of which corresponds to a corresponding additional digital input value.

[0044] Example 4: A computer-implemented method according to any of Examples 1 to 3, wherein each corresponding digital input value corresponds to a corresponding luminance value of at least one pixel in at least one of a plurality of peripheral regions, and each corresponding additional digital input value corresponds to a corresponding additional luminance value of at least one additional pixel in at least one foveation region.

[0045] Example 5: The computer-implemented method according to any of Examples 1 to 4 further includes: a pause period of a predefined time frame after setting the set of peripheral region gamma voltages.

[0046] Example 6: The computer-implemented method according to any one of Examples 1 to 5 further includes: applying a peripheral region gate signal to a group of pixels in at least one of a plurality of peripheral regions, and applying a foveation region gate signal to a group of pixels in a foveation region.

[0047] Example 7: A computer-implemented method according to any one of Examples 1 to 6, wherein each of the peripheral region gate signal and the gaze point region gate signal is a pulse voltage.

[0048] Example 8: The computer-implemented method according to any one of Examples 1 to 7 further includes: applying peripheral region pixel timing parameters to a set of pixels in at least one of a plurality of peripheral regions, and applying foveation region pixel timing parameters to a set of pixels in a foveation region.

[0049] Example 9: A computer-implemented method according to any of Examples 1 to 8, wherein the peripheral region pixel timing parameters and the gaze point region pixel timing parameters correspond to the demultiplexer start time parameters, the demultiplexer stop time parameters, or the source drive signal.

[0050] Example 10: A system includes: at least one physical processor; a display; and physical memory including computer-executable instructions that, when executed by the physical processor, cause the physical processor to: determine a brightness difference between a plurality of peripheral regions of the display and a foveation region of the display; and, in response to the determination, adjust the brightness difference by: applying a set of peripheral region gamma voltages to the plurality of peripheral regions and applying another set of foveation region gamma voltages to the foveation region, and setting a peripheral region common voltage for the plurality of peripheral regions and setting a foveation region common voltage for the foveation region.

[0051] Example 11: According to the system described in Example 10, the top boundary of the fixation point region is adjacent to the boundary of one of the plurality of peripheral regions, and the bottom boundary of the fixation point region is adjacent to the boundary of another of the plurality of peripheral regions.

[0052] Example 12: The system according to Example 10 or Example 11, wherein the set of peripheral region gamma voltages corresponds to a series of reference voltages, each of which corresponds to a corresponding digital input value, and the other set of fixation point region gamma voltages corresponds to another series of reference voltages, each of which corresponds to a corresponding additional digital input value.

[0053] Example 13: A system according to any of Examples 10 to 12, wherein the other set of gaze point region gamma voltages corresponds to another series of reference voltages, each of which corresponds to a corresponding additional digital input value.

[0054] Example 14: A system according to any one of Examples 10 to 13, wherein each corresponding digital input value corresponds to a corresponding luminance value of at least one pixel in at least one of a plurality of peripheral regions, and each corresponding additional digital input value corresponds to a corresponding additional luminance value of at least one additional pixel in at least one foveation region.

[0055] Example 15: A system according to any of Examples 12 to 14, wherein, when executed by a physical processor, these computer-executable instructions also cause the physical processor to include a pause period of a predefined time frame after setting the gamma voltage of the set of peripheral regions.

[0056] Example 16: A system according to any one of Examples 12 to 15, wherein, when executed by a physical processor, the computer-executable instructions further cause the physical processor to: apply a peripheral region gate signal to a group of pixels in at least one of a plurality of peripheral regions, and apply a foveation region gate signal to a group of pixels in a foveation region.

[0057] Example 17: A system according to any one of Examples 12 to 16, wherein each of the peripheral region gate signal and the gaze point region gate signal is a pulse voltage.

[0058] Example 18: A system according to any one of Examples 12 to 17, wherein, when executed by a physical processor, the computer-executable instructions further cause the physical processor to: apply peripheral region pixel timing parameters to a set of pixels in at least one of a plurality of peripheral regions.

[0059] Example 19: A system according to any of Examples 12 to 18, wherein, when executed by a physical processor, the computer-executable instructions also cause the physical processor to: apply a foveation region pixel timing parameter to a set of pixels in the foveation region.

[0060] Example 20: A non-transitory computer-readable medium includes one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to: determine a brightness difference between a plurality of peripheral regions of a display and a foveation region of the display; and, in response to the determination, adjust the brightness difference by: applying a set of peripheral region gamma voltages to the plurality of peripheral regions and applying another set of foveation region gamma voltages to the foveation region, and setting a peripheral region common voltage for the plurality of peripheral regions and setting a foveation region common voltage for the foveation region.

[0061] The embodiments of this disclosure may include various types of artificial-reality (AR) systems, or may be implemented by combining various types of AR systems. AR can be any overlay functionality and / or sensorily detectable content presented by an AR system in a user's physical environment. In other words, AR is a form of reality that has been adjusted in some way before being presented to the user. AR may include and / or represent virtual reality (VR), augmented reality, mixed AR (MAR), or some combination and / or variation of these types of reality. Similarly, AR environments may include VR environments (including non-immersive, semi-immersive, and fully immersive VR environments), augmented reality environments (including marker-based augmented reality environments, markerless augmented reality environments, location-based augmented reality environments, and projection-based augmented reality environments), mixed reality environments, and / or any other type or form of mixed reality or alternative reality environment.

[0062] AR content can include entirely computer-generated content or computer-generated content combined with acquired (e.g., real-world) content. Such AR content can include video, audio, haptic feedback, or some combination thereof, any of which can be presented in a single channel or multiple channels (e.g., stereoscopic video providing a three-dimensional (3D) effect to the viewer). Additionally, in some embodiments, AR can also be associated with applications, products, accessories, services, or some combination thereof, which are used, for example, to create content in artificial reality and / or otherwise for use in artificial reality (e.g., to perform activities in artificial reality).

[0063] AR systems can be implemented in a variety of different shape elements and configurations. Some AR systems can be designed to operate without using a near-eye display (NED). Other AR systems may include NEDs that also provide visibility into the real world (e.g., Figure 8 Augmented reality (AR) systems (e.g., AR systems) or NEDs that allow users to visually immerse themselves in artificial reality. Figure 9A and Figure 9B The virtual reality system (VR system) in the context of AR (900) may be a standalone system, while other AR devices may communicate with and / or cooperate with external devices to provide an AR experience to the user. Examples of such external devices include handheld controllers, mobile devices, desktop computers, devices worn by the user, devices worn by one or more other users, and / or any other suitable external system.

[0064] Figures 2 to 5B An example artificial reality (AR) system according to some embodiments is shown. Figure 2 The first example user interaction is shown with the first AR system 200 and using a wrist wearable device 202, a head wearable device (e.g., AR glasses) and / or a handheld intermediate processing device (HIPD) 206. Figure 3 The second AR system 300 and a second example user interaction using a wrist wearable device 302, AR glasses 304 and / or HIPD 306 are shown. Figure 4A and Figure 4B The third AR system 400 is shown interacting with a third example user 408 using a wrist wearable device 402, a head wearable device (e.g., a VR headset 450), and / or a HIPD 406. Figure 5A and Figure 5B The fourth AR system 500 is shown interacting with a fourth example user 508 using a wrist-worn wearable device 530, a VR head-mounted viewer 520, and / or a haptic device 560 (e.g., wearable gloves).

[0065] The following is for reference. Figure 6 and Figure 7 This describes a wrist-worn wearable device 600 and one or more components thereof that can be used in wrist-worn wearable devices 202, 302, 402, and 530; references are provided below. Figures 8 to 10 This describes head-worn wearable devices (e.g., AR system 800 and VR system 900) that can be used in AR glasses 204, 304 or VR head-mounted viewers 450, 520, respectively, and one or more of their components.

[0066] refer to Figure 2 The wrist-worn wearable device 202, AR glasses 204, and / or HIPD 206 can be communicatively coupled via network 225 (e.g., cellular, near-field, Wi-Fi, personal area network, wireless local area network (LAN), etc.). Additionally, the wrist-worn wearable device 202, AR glasses 204, and / or HIPD 206 can also be communicatively coupled with one or more servers 230, one or more computers 240 (e.g., laptops, computers, etc.), mobile devices 250 (e.g., smartphones, tablets, etc.) and / or other electronic devices via network 225 (e.g., cellular, near-field, Wi-Fi, personal area network, wireless LAN, etc.).

[0067] exist Figure 2The image shows a user 208 wearing a wrist-worn wearable device 202 and AR glasses 204, with a HIPD 206 placed on their table. The wrist-worn wearable device 202, AR glasses 204, and HIPD 206 facilitate user interaction with the AR environment. Specifically, as shown in the first AR system 200, the wrist-worn wearable device 202, AR glasses 204, and / or HIPD 206 enable the presentation of one or more avatars 210, digital representations 212 of one or more contacts, and one or more virtual objects 214. As described below, the user 208 can interact with one or more avatars 210, digital representations 212 of one or more contacts, and one or more virtual objects 214 through the wrist-worn wearable device 202, AR glasses 204, and / or HIPD 206.

[0068] User 208 may use any of the wrist wearable device 202, AR glasses 204, and / or HIPD 206 to provide user input. For example, user 208 may perform actions by the wrist wearable device 202 (e.g., using the reference below). Figure 6 and Figure 7 One or more EMG sensors and / or IMUs described) and / or AR glasses 204 (e.g., using the reference below) Figures 8 to 10 One or more gestures detected by one or more image sensors or cameras (described below) can be used to provide user input. Alternatively or additionally, user 208 may provide user input via one or more touch surfaces of the wrist wearable device 202, AR glasses 204, HIPD 206, and / or voice commands acquired by the microphones of the wrist wearable device 202, AR glasses 204, and / or HIPD 206. In some embodiments, the wrist wearable device 202, AR glasses 204, and / or HIPD 206 includes a digital assistant to assist user 208 in providing user input (e.g., performing a series of actions, suggesting different actions or commands, providing reminders, confirming commands, etc.). In some embodiments, user 208 may provide user input via one or more facial gestures and / or facial expressions. For example, the cameras of the wrist wearable device 202, AR glasses 204, and / or HIPD 206 may track user 208's eyes for navigating the user interface.

[0069] The wrist-worn wearable device 202, AR glasses 204, and / or HIPD 206 can operate individually or in combination to allow user 208 to interact with the AR environment. In some embodiments, HIPD 206 is configured to operate as a central hub or control center for the wrist-worn wearable device 202, AR glasses 204, and / or another communication-coupled device. For example, user 208 can provide input to interact with the AR environment at any of the wrist-worn wearable device 202, AR glasses 204, and / or HIPD 206, and HIPD 206 can identify one or more backend and frontend tasks to cause the requested interaction to be performed, and distribute instructions to cause one or more backend and frontend tasks to be performed at the wrist-worn wearable device 202, AR glasses 204, and / or HIPD 206. In some embodiments, backend tasks are user-insensible background processing tasks (e.g., rendering content, decompressing, compressing, etc.), and frontend tasks are user-insensible user-facing tasks (e.g., presenting information to the user, providing feedback to the user, etc.). HIPD 206 can perform backend tasks and provide operational data for the wrist wearable device 202 and / or AR glasses 204 corresponding to the performed backend tasks, enabling the wrist wearable device 202 and / or AR glasses 204 to perform frontend tasks. In this way, HIPD 206, which has more computing resources and a larger thermal clearance than the wrist wearable device 202 and / or AR glasses 204, performs computationally intensive tasks and reduces the computing resource utilization and / or power consumption of the wrist wearable device 202 and / or AR glasses 204.

[0070] In the example shown in the first AR system 200, HIPD 206 identifies one or more backend and frontend tasks associated with a user request to initiate an AR video call with one or more other users (represented by avatar 210 and contact digital representation 212); and HIPD 206 issues instructions to execute the one or more backend and frontend tasks. Specifically, HIPD 206 performs backend tasks for processing and / or rendering image data (and other data) associated with the AR video call and provides operational data associated with the performed backend tasks to AR glasses 204, causing AR glasses 204 to perform frontend tasks for presenting the AR video call (e.g., presenting avatar 210 and contact digital representation 212).

[0071] In some embodiments, HIPD 206 can be used as a focal point or anchor point for information presentation. This allows user 208 to generally know where the information is presented. For example, as shown in the first AR system 200, avatar 210 and contact digital representations 212 are presented on HIPD 206. Specifically, HIPD 206 and AR glasses 204 operate in conjunction to determine the location for presenting avatar 210 and contact digital representations 212. In some embodiments, information can be presented within a predetermined distance from HIPD 206 (e.g., within 5 meters). For example, as shown in the first AR system 200, virtual object 214 is presented on a table at a distance from HIPD 206. Similar to the above examples, HIPD 206 and AR glasses 204 can operate in conjunction to determine the location for presenting virtual object 214. Alternatively, in some embodiments, information presentation is not constrained by HIPD 206. More specifically, avatar 210, contact digital representations 212, and virtual object 214 do not necessarily need to be presented within a predetermined distance of HIPD 206.

[0072] The user input provided at the wrist wearable device 202, AR glasses 204, and / or HIPD 206 is coordinated to enable the user to initiate, continue, and / or complete an operation using any device. For example, user 208 can provide user input to AR glasses 204 to cause AR glasses 204 to present virtual object 214, and while AR glasses 204 presents virtual object 214, user 208 can provide one or more gestures via wrist wearable device 202 to interact with and / or manipulate virtual object 214.

[0073] Figure 3 The image shows a user 308 wearing a wrist-worn wearable device 302 and AR glasses 304 while holding a HIPD 306. In the second AR system 300, the wrist-worn wearable device 302, AR glasses 304, and / or HIPD 306 are used to receive one or more messages and / or provide one or more messages to the user 308's contacts. Specifically, the wrist-worn wearable device 302, AR glasses 304, and / or HIPD 306 detect and coordinate one or more user inputs to initiate a messaging application and prepare responses to messages received through the messaging application.

[0074] In some embodiments, user 308 launches an application via user input on at least one device: a wrist-worn wearable device 302; AR glasses 304; and / or HIPD 306. For example, in a second AR system 300, user 308 makes a gesture associated with a command to launch a messaging application (represented by a messaging user interface 316); the wrist-worn wearable device 302 detects the gesture; and based on the determination that user 308 is wearing AR glasses 304, causes AR glasses 304 to present the messaging user interface 316 of the messaging application. AR glasses 304 may present the messaging user interface 316 to user 308 via its display (e.g., as shown in user 308's field of view 318). In some embodiments, the application is launched and may run on a device (e.g., the wrist-worn wearable device 302, AR glasses 304, and / or HIPD 306) that detects the user input that launched the application, and that device provides operational data to another device to present the messaging application. For example, the wrist-worn wearable device 302 can detect user input to launch a messaging application, launch and run the messaging application, and provide operational data to the AR glasses 304 and / or HIPD 306 to render the messaging application. Alternatively, the application can be launched and run on a device other than the one that detected the user input. For example, the wrist-worn wearable device 302 can detect gestures associated with launching the messaging application and can enable the HIPD 306 to run the messaging application and coordinate its rendering.

[0075] Furthermore, user 308 can provide user input at the wrist wearable device 302, AR glasses 304, and / or HIPD 306 to continue and / or complete an operation initiated on another device. For example, after launching a messaging application via the wrist wearable device 302, and while the messaging user interface 316 is displayed on the AR glasses 304, user 308 can provide input at the HIPD 306 to prepare a response (e.g., indicated by a swipe gesture made on the HIPD 306). The gesture made by user 308 on the HIPD 306 can be provided and / or displayed on another device. For example, a swipe gesture made on the HIPD 306 is displayed on the virtual keyboard of the messaging user interface 316 displayed by the AR glasses 304.

[0076] In some embodiments, the wrist wearable device 302, AR glasses 304, HIPD 306, and / or other communication-coupled devices may present one or more notifications to the user 308. The notification may be an indication of a new message, an incoming call, an application update, or a status update, etc. The user 308 may select the notification via the wrist wearable device 302, AR glasses 304, and / or HIPD 306, and may cause an application or action associated with the notification to be presented on at least one device. For example, the user 308 may receive a notification that a message has been received at the wrist wearable device 302, AR glasses 304, HIPD 306, and / or other communication-coupled devices, and the user 308 may provide user input at the wrist wearable device 302, AR glasses 304, and / or HIPD 306 to review the notification, and the device that detects the user input may cause an application associated with the notification to be launched and / or presented at the wrist wearable device 302, AR glasses 304, and / or HIPD 306.

[0077] While the examples above describe coordinated input for interacting with messaging applications, user input can be coordinated to interact with any number of applications, including but not limited to gaming applications, social media applications, camera applications, web-based applications, and financial applications. For example, AR glasses 304 can present game application data to user 308, and HIPD 306 can be used as a controller to provide input to the game. Similarly, user 308 can use wrist wearable device 302 to activate the camera of AR glasses 304, and user 308 can use wrist wearable device 302, AR glasses 304, and / or HIPD 306 to manipulate image acquisition (e.g., zoom in or out, apply filters, etc.) and acquire image data.

[0078] Users can interact with the devices disclosed in this article in a variety of ways. For example, such as Figure 4A and Figure 4B As shown, user 408 can interact with AR system 400 by wearing VR headset 450, holding HIPD 406, and wearing wrist wearable device 402. In this example, AR system 400 allows the user to interact with game 410 by waving their arm. One or more of VR headset 450, HIPD 406, and wrist wearable device 402 can detect the gesture and, in response, can display sword strikes in game 410. Similarly, in Figure 5A and Figure 5BIn this example, user 508 can interact with AR system 500 by wearing VR headset 520, haptic device 560, and wrist wearable device 530. In this example, AR system 500 allows the user to interact with game 510 by waving their arm. One or more of the VR headset 520, haptic device 560, and wrist wearable device 530 can detect the gesture and, in response, display the incantation being cast in game 410.

[0079] Having discussed example AR systems, this paper will now discuss in more detail devices for interacting more generally with such AR systems and other computing systems. For ease of reference, this paper explains some of the devices and components that may be included in some or all of the example devices discussed below. Certain types of components described below may be more suitable for a particular set of devices and less suitable for different sets. However, subsequent references to the components explained herein should be considered as included in the provided description.

[0080] In some embodiments discussed below, example devices and systems, including electronic devices and systems, will be described. These example devices and systems are not intended to be limiting, and those skilled in the art will understand that alternative devices and systems to the example devices and systems described herein can be used to perform operations and construct the systems and devices described herein.

[0081] An electronic device can be a device that uses electrical energy to perform a specific function. An electronic device can be any physical object that contains electronic components (e.g., transistors, resistors, capacitors, diodes, and integrated circuits). Examples of electronic devices include smartphones, laptops, digital cameras, televisions, game consoles, and music players, as well as the example electronic devices discussed herein. As described herein, an intermediate electronic device can be a device located between two other electronic devices and / or subsets of components of one or more electronic devices, and facilitates communication, data processing, and / or data transmission between the various electronic devices and / or electronic components.

[0082] An integrated circuit (IC) can be an electronic device composed of multiple interconnected electronic components, such as transistors, resistors, and capacitors. These components can be etched onto a small piece of semiconductor material, such as silicon. ICs can include analog ICs, digital ICs, mixed-signal ICs, and / or any other suitable type or form of IC. Examples of ICs include application-specific integrated circuits (ASICs), processing units, central processing units (CPUs), coprocessors, and accelerators.

[0083] Analog integrated circuits (e.g., sensors, power management circuits, and operational amplifiers) can process continuous signals and perform analog functions such as amplification, active filtering, demodulation, and mixing. Examples of analog integrated circuits include linear integrated circuits and radio frequency circuits.

[0084] Digital integrated circuits, which may be referred to as logic integrated circuits, can include microprocessors, microcontrollers, memory chips, interfaces, power management circuits, programmable devices, and / or any other suitable type or form of integrated circuit. In some embodiments, examples of integrated circuits include central processing units (CPUs).

[0085] A processing unit (e.g., a CPU) can be an electronic component responsible for executing instructions and controlling the operation of an electronic device (e.g., a computer). Various types of processors exist, which can be used interchangeably or may be specifically required for the embodiments described herein. For example, a processor can be: (i) a general-purpose processor designed to perform a variety of tasks, such as running software applications, managing operating systems, and performing arithmetic and logical operations; (ii) a microcontroller designed for specific tasks, such as controlling electronic devices, sensors, and motors; (iii) an accelerator such as a graphics processing unit (GPU) for accelerating the creation and rendering of images, videos, and animations (e.g., virtual reality animation, such as 3D modeling); (iv) a field-programmable gate array (FPGA) that can be programmed and reconfigured post-manufacturing and / or can be customized to perform specific tasks, such as signal processing, encryption, and machine learning; and / or (v) a digital signal processor (DSP) designed to perform mathematical operations on signals such as audio, video, and radio waves. One or more processors of one or more electronic devices can be used in the various embodiments described herein.

[0086] Memory generally refers to electronic components in a computer or electronic device that store data and instructions for access and operation by a processor. Examples of memory may include: (i) random access memory (RAM) configured to temporarily store data and instructions; (ii) read-only memory (ROM) configured to permanently store data and instructions (e.g., one or more portions of system firmware and / or a bootloader) and / or semi-permanently store data and instructions; (iii) flash memory, which may be configured to store data in an electronic device (e.g., a USB drive, a memory card, and / or a solid-state drive (SSD)); and / or (iv) cache memory configured to temporarily store frequently accessed data and instructions. As described herein, memory may store structured data (e.g., SQL databases, MongoDB databases, GraphQL data, JSON data, etc.). Other examples of data stored in memory may include: (i) data data, including user account data, user settings and / or other user data stored by the user; (ii) sensor data detected by one or more sensors and / or otherwise acquired; (iii) media content data, including stored image data, audio data, and documents; (iv) application data, which may include data collected and / or otherwise acquired and stored during the use of the application; and / or any other types of data described herein.

[0087] A controller can be an electronic component that manages and coordinates the operation of other components within an electronic device (e.g., controlling inputs, processing data, and / or generating outputs). Examples of controllers may include: (i) microcontrollers, including small, low-power controllers commonly used in embedded systems and Internet of Things (IoT) devices; (ii) programmable logic controllers (PLCs) that can be configured for use in industrial automation systems to control and monitor manufacturing processes; (iii) system-on-a-chip (SoC) controllers that integrate multiple components such as processors, memory, I / O interfaces, and other peripherals onto a single chip; and / or (iv) DSPs.

[0088] The power system of an electronic device can be configured to convert input electrical energy into a form that can be used to operate the device. The power system may include various components, such as (i) a power supply, which may be an alternating current (AC) adapter or a direct current (DC) adapter power supply; (ii) a charger input, which may be configured to use wired and / or wireless connections (which may be part of a peripheral interface, such as USB, micro USB interface, near-field magnetic coupling, magnetic induction and magnetic resonance charging, and / or radio frequency (RF) charging); (iii) a power management integrated circuit, which is configured to distribute power to the various components of the device and ensure that the device operates within safe limits (e.g., regulating voltage, controlling current, and / or managing heat dissipation); and / or (iv) a battery, which is configured to store power to provide usable power to the components of one or more electronic devices.

[0089] Peripheral interfaces can be electronic components (e.g., electronic components of an electronic device) that allow electronic devices to communicate with other devices or peripheral devices and provide input and output data and signals. Examples of peripheral interfaces may include: (i) Universal Serial Bus (USB) and / or Micro USB interfaces configured to connect devices to electronic devices; (ii) Bluetooth interfaces, including Bluetooth Low Energy (BLE), configured to allow multiple devices to communicate with each other; (iii) Near Field Communication (NFC) interfaces configured for short-range wireless interfaces such as access control; (iv) spring-loaded pins, which may be small spring-loaded pins configured to provide a charging interface; (v) wireless charging interfaces; (vi) GPS interfaces; (vii) WiFi interfaces for providing connectivity between devices and wireless networks; and / or (viii) sensor interfaces.

[0090] Sensors can be electronic components configured to detect physical and environmental changes and generate electrical signals (e.g., electronic components that communicate electronically with and / or otherwise with electronic devices, such as wearable devices). Examples of sensors may include: (i) imaging sensors for collecting imaging data (e.g., including one or more cameras mounted on a corresponding electronic device); (ii) biopotential signal sensors; (iii) inertial measurement units (e.g., IMUs) for detecting changes in, for example, angular rate, force, magnetic field, and / or acceleration; (iv) heart rate sensors for measuring a user's heart rate; (v) SpO2 sensors for measuring a user's blood oxygen saturation and / or other biometric data; (vi) capacitive sensors (e.g., sensor-skin interfaces) for detecting potential changes in a part of a user's body; and / or (vii) light sensors (e.g., time-of-flight sensors, infrared sensors, visible light sensors, etc.).

[0091] Biopotential signal sensing components can be devices used to measure electrical activity within the body (e.g., biopotential signal sensors). Some types of biopotential signal sensors include: (i) electroencephalography (EEG) sensors configured to measure electrical activity in the brain to diagnose neurological disorders; (ii) electrocardiography (ECG or EKG) sensors configured to measure electrical activity in the heart to diagnose heart problems; (iii) electromyography (EMG) sensors configured to measure electrical activity in muscles and diagnose neuromuscular diseases; and (iv) electrooculography (EOG) sensors configured to measure electrical activity in eye muscles to detect eye movements and diagnose eye diseases.

[0092] Applications stored in the memory of an electronic device (e.g., software) may include instructions stored in the memory. Examples of such applications include (i) games, (ii) word processors, (iii) messaging applications, (iv) media streaming applications, (v) financial applications, (vi) calendars, (vii) clocks, and (viii) communication interface modules for enabling wired and / or wireless connections between different corresponding electronic devices (e.g., IEEE 802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.11a, WirelessHART, or MiWi), custom or standard wired protocols (e.g., Ethernet or HomePlug) and / or any other suitable communication protocols).

[0093] A communication interface is a mechanism that enables different systems or devices to exchange information and data, including hardware, software, or a combination of both. For example, a communication interface can refer to a physical connector and / or port on a device that enables communication with other devices (e.g., USB, Ethernet, High Definition Multimedia Interface (HDMI), Bluetooth). In some embodiments, a communication interface can refer to a software layer that enables different software programs to communicate with each other (e.g., application programming interface (API), protocols such as Hypertext Transfer Protocol (HTTP) and Transmission Control Protocol / Internet Protocol (TCP / IP)).

[0094] A graphics module can be a component or software module designed to handle graphics operations and / or processes and may include hardware modules and / or software modules.

[0095] Non-transitory computer-readable storage media can be physical devices or storage media that can be used to store electronic data in a non-transitory form (e.g., to make the data permanently stored until it is intentionally deleted or modified).

[0096] Figure 6 and Figure 7 An example wrist-worn wearable device 600 and an example computer system 700 are illustrated according to some embodiments. The wrist-worn wearable device 600 is described herein. Figure 2 The wearable device 202 described herein is an example of the wearable device 600, and therefore the wearable device 202 should be understood as having the characteristics of the wrist wearable device 600, and vice versa. Figure 7 Several components of a wrist-worn wearable device 600 are shown, which can be used individually or in combination, including combinations containing other electronic devices and / or electronic components.

[0097] Figure 6 A wearable strap 610 and a watch body 620 (or capsule) are coupled to form a wrist-worn wearable device 600, as described below. The wrist-worn wearable device 600 can perform various functions and / or operations associated with navigating the user interface and selectively opening applications, as well as providing references. Figures 2 to 5B The described functions and / or operations.

[0098] As will be described in more detail below, the operations performed by the wrist-worn wearable device 600 may include: (i) presenting content to a user (e.g., displaying visual content via a display 605); (ii) detecting (e.g., sensing) user input (e.g., sensing touches on peripheral buttons 623 and / or touches on the touchscreen of the display 605, sensing gestures detected by sensors (e.g., biopotential sensors); (iii) sensing biometric data (e.g., neuromuscular signals, heart rate, temperature, sleep, etc.) via one or more sensors 613; sending and receiving messages (e.g., text, voice, video, etc.); image acquisition via one or more imaging devices or cameras 625; wireless communication (e.g., cellular, near-field, Wi-Fi, or personal area network); location determination; financial transactions; providing haptic feedback; providing alarms; providing notifications; providing biometric authentication; providing health monitoring; and / or providing sleep monitoring, etc.

[0099] These functions can be performed independently in the watch body 620, independently in the wearable band 610, and / or via electronic communication between the watch body 620 and the wearable band 610. In some embodiments, when an AR environment is presented (e.g., via one of AR systems 200 to 500), the functions can be performed on the wrist wearable device 600. The wearable device described herein can be used with other types of AR environments.

[0100] The wearable band 610 can be configured to be worn by a user such that the inner surface of the wearable structure 611 of the wearable band 610 contacts the user's skin. In this example, the sensor 613 can contact the user's skin when worn by the user. In some examples, one or more sensors 613 can sense biometric data, such as the user's heart rate, saturated oxygen level, temperature, sweat level, neuromuscular signals, or combinations thereof. One or more sensors 613 can also sense data about the user's environment, including the user's motion, altitude, location, orientation, gait, acceleration, position, or combinations thereof. In some embodiments, one or more sensors 613 can be configured to track the position and / or motion of the wearable band 610. One or more sensors 613 may include the features defined above and / or the following regarding... Figure 6 Any of the multiple sensors discussed.

[0101] One or more sensors 613 may be distributed on the inner and / or outer surface of the wearable band 610. In some embodiments, the one or more sensors 613 are evenly spaced along the wearable band 610. Alternatively, in some embodiments, the one or more sensors 613 are located at different points along the wearable band 610. Figure 6As shown, one or more sensors 613 may be the same or different. For example, in some embodiments, one or more sensors 613 may be shaped as a pill (e.g., sensor 613a), oval, circular, square, oblong (e.g., sensor 613c), and / or any other shape that maintains contact with the user's skin (e.g., so that neuromuscular signals and / or other biometric data can be accurately measured at the user's skin). In some embodiments, one or more sensors 613 are aligned to form sensor pairs (e.g., for sensing neuromuscular signals based on differential sensing within each respective sensor). For example, sensor 613b may be aligned with an adjacent sensor to form sensor pair 614a, and sensor 613d may be aligned with an adjacent sensor to form sensor pair 614b. In some embodiments, the wearable band 610 does not have sensor pairs. Alternatively, in some embodiments, the wearable band 610 has a predetermined number of sensor pairs (one sensor pair, three sensor pairs, four sensor pairs, six sensor pairs, or sixteen sensor pairs).

[0102] The wearable band 610 may include any suitable number of sensors 613. In some embodiments, the number and arrangement of the sensors 613 depend on the specific application using the wearable band 610. For example, the wearable band 610 may be configured as an armband, wristband, or chest band, which includes multiple sensors 613 with different numbers of sensors 613, various types of individual sensors with multiple sensors 613, and different arrangements for each use case, such as a different arrangement for a medical use case compared to a gaming or general everyday use case.

[0103] According to some embodiments, the wearable band 610 also includes an electrically grounding electrode and a shielding electrode. Similar to sensor 613, the electrically grounding electrode and shielding electrode may be distributed on the inner surface of the wearable band 610 such that they contact a portion of the user's skin. For example, the electrically grounding electrode and shielding electrode may be located on the inner surface of coupling mechanism 616 or on the inner surface of wearable structure 611. The electrically grounding electrode and shielding electrode may be formed as in sensor 613 and / or use the same components as sensor 613. In some embodiments, the wearable band 610 includes more than one electrically grounding electrode and more than one shielding electrode.

[0104] Sensor 613 may be formed as part of the wearable structure 611 of the wearable band 610. In some embodiments, sensor 613 is flush or substantially flush with the wearable structure 611, such that these sensors do not extend beyond the surface of the wearable structure 611. Although flush with the wearable structure 611, sensor 613 is still configured to contact the user's skin (e.g., through a skin-contact surface). Alternatively, in some embodiments, sensor 613 extends beyond the wearable structure 611 by a predetermined distance (e.g., 0.1 mm to 2 mm) to contact and press against the user's skin. In some embodiments, sensor 613 is coupled to an actuator (not shown) configured to adjust the extension height of sensor 613 (e.g., distance from the surface of the wearable structure 611) such that sensor 613 contacts and presses against the user's skin. In some embodiments, the actuator adjusts the extension height between 0.01 mm and 1.2 mm. This allows the user to customize the position of sensor 613 to improve the overall comfort of the wearable band 610 when worn, while still allowing sensor 613 to contact the user's skin. In some embodiments, the sensor 613 is not distinguishable from the wearable structure 611 when worn by a user.

[0105] The wearable structure 611 may be formed of an elastic material, elastomer, or the like, which is configured to be stretched and adapted for wear by a user. In some embodiments, the wearable structure 611 is a textile or woven fabric. As described above, the sensor 613 may be formed as part of the wearable structure 611. For example, the sensor 613 may be molded into the wearable structure 611 or integrated into the woven fabric (e.g., the sensor 613 may be sewn into the fabric and mimic the flexibility of the fabric, and may and / or may consist of a series of woven fabric threads).

[0106] Wearable structure 611 may include sensors 613, electronic circuitry and / or other electronic components (hereinafter referred to as...) included in wearable band 610. Figure 7 (As described above) Flexible electronic connectors for interconnection. In some embodiments, the flexible electronic connectors are configured to interconnect sensors 613, electronic circuitry, and / or other electronic components of the wearable band 610 with corresponding sensors and / or other electronic components of another electronic device (e.g., watch body 620). The flexible electronic connectors are configured to move with the wearable structure 611 such that adjustments made by the user to the wearable structure 611 (e.g., resizing, pulling, or folding, etc.) do not stress or strain the electrical couplings of the components of the wearable band 610.

[0107] As described above, the wearable band 610 is configured to be worn by a user. Specifically, the wearable band 610 may be shaped or otherwise operated for wear by a user. For example, the wearable band 610 may be shaped to have a generally circular shape, such that the wearable band may be configured to be worn on the user's forearm or wrist. Alternatively, the wearable band 610 may be shaped to be worn on another part of the user's body (e.g., the user's upper arm (e.g., around the biceps), forearm, chest, leg, etc.). The wearable band 610 may include a retaining mechanism 612 (e.g., a hook and loop fastener, etc.) for securing the wearable band 610 to the user's wrist or other body part. When the wearable band 610 is worn by the user, the sensor 613 senses data from the user's skin (referred to as sensor data). In some examples, the sensor 613 of the wearable band 610 acquires (e.g., senses and records) neuromuscular signals.

[0108] Sensed data (e.g., sensed neuromuscular signals) can be used to detect and / or determine a user's intention to perform certain motor actions. In some examples, sensor 613 can sense and record neuromuscular signals from the user when the user performs muscle activation (e.g., movement, gestures, etc.). Detected and / or determined motor actions (e.g., phalanx (or finger) movement, wrist movement, hand movement, and / or other muscle intentions) can be used to determine control commands or control information (instructions to execute certain commands after the data is sensed) for causing the computing device to execute one or more input commands. For example, sensed neuromuscular signals can be used to control certain user interfaces displayed on display 605 of the wrist-worn wearable device 600, and / or can be sent to a device responsible for rendering an artificial reality environment (e.g., a head-mounted display) to perform actions in the associated artificial reality environment (e.g., to control the movement of a virtual device displayed to the user). User-performed muscle activation can include: static gestures, such as placing a user's palm down on a table; dynamic gestures, such as grasping a physical or virtual object; and covert gestures imperceptible to another person, such as slightly tensing a joint by coordinating the contraction of opposing muscles or using submuscular activation. User-performed muscle activation can also include symbolic gestures (e.g., gestures that map to other gestures, interactions, or commands based on a gesture vocabulary that maps specified gestures to commands).

[0109] Sensor data sensed by sensor 613 can be used to provide users with enhanced interaction with physical objects (e.g., devices communicatively coupled to wearable band 610) and / or virtual objects generated by artificial reality systems in artificial reality applications (e.g., user interface objects presented on display 605 or another computing device (e.g., smartphone)).

[0110] In some embodiments, the wearable band 610 includes one or more tactile devices 746 (e.g., vibratory tactile actuators) configured to provide tactile feedback (e.g., skin sensation and / or kinesthetic perception) to the user's skin. Sensors 613 and / or ( Figure 7 The haptic device 746 shown can be configured to operate in conjunction with multiple applications, including but not limited to health monitoring, social media, games, and artificial reality (e.g., applications associated with artificial reality).

[0111] The wearable strap 610 may also include a coupling mechanism 616 for detachably coupling a capsule (e.g., a computing unit) or the watch body 620 to the wearable strap 610 (via a coupling surface of the watch body 620). For example, the shape of the bracket or coupling mechanism 616 may correspond to the shape of the watch body 620 of the wrist wearable device 600. In particular, the coupling mechanism 616 may be configured to receive the coupling surface of the watch body 620 near the bottom (e.g., the side opposite the front side where the display 605 of the watch body 620 is located), allowing a user to push the watch body 620 downward into the coupling mechanism 616 to attach the watch body 620 to the coupling mechanism 616. In some embodiments, the coupling mechanism 616 may be configured to receive the top side of the watch body 620 (e.g., the side near the front side where the display 605 of the watch body 620 is located), which is pushed upward into the bracket rather than downward into the coupling mechanism 616. In some embodiments, the coupling mechanism 616 is an integrated component of the wearable strap 610, such that the wearable strap 610 and the coupling mechanism 616 are a single unified structure. In some embodiments, the coupling mechanism 616 is a frame or housing that allows the coupling surface of the watch body 620 to be held within or on the coupling mechanism 616 of the wearable strap 610 (e.g., a bracket, tracker strap, support base, or buckle).

[0112] The coupling mechanism 616 allows the watch body 620 to be detachably coupled to the wearable strap 610 via: friction engagement; magnetic coupling; a rotation-based connector; a shear pin coupling; a retaining spring; one or more magnets; a clip; a pin; a hook-and-loop fastener; or a combination thereof. A user can perform any type of action to couple the watch body 620 to and from the wearable strap 610. For example, a user can twist, slide, turn, push, pull, or rotate the watch body 620 relative to the wearable strap 610, or combinations thereof, to attach the watch body 620 to and detach it from the wearable strap 610. Alternatively, as described below, in some embodiments, the watch body 620 can be separated from the wearable strap 610 by actuation of the release mechanism 629.

[0113] The wearable strap 610 can be coupled to the watch body 620 to enhance its functionality (e.g., converting the wearable strap 610 into a wrist-worn wearable device 600, adding additional computing units and / or batteries to increase the wearable strap 610's computing resources and / or battery life, adding additional sensors to improve sensed data, etc.). As described above, the wearable strap 610 and coupling mechanism 616 are configured to operate independently of the watch body 620 (e.g., perform functions independently of the watch body). For example, the coupling mechanism 616 may include one or more sensors 613 that, when the user wears the wearable strap 610, contact the user's skin regardless of the presence or absence of the watch body 620, and provide sensor data for determining control commands.

[0114] Users can detach the watch body 620 from the wearable strap 610 to reduce the burden of the wrist wearable device 600 on the user. In embodiments where the watch body 620 is detachable, the watch body 620 may be referred to as a detachable structure, such that in these embodiments, the wrist wearable device 600 includes a wearable portion (e.g., the wearable strap 610) and a detachable structure (e.g., the watch body 620).

[0115] Turning to the watch body 620, in some examples, the watch body 620 may have a generally rectangular or circular shape. The watch body 620 is configured to be worn by a user on their wrist or another part of their body. More specifically, the watch body 620 is sized for easy carrying by the user, easy attachment to a part of the user's clothing, and / or easy coupling to a wearable strap 610 (thus forming a wrist wearable device 600). As described above, the watch body 620 may have a shape corresponding to the coupling mechanism 616 of the wearable strap 610. In some embodiments, the watch body 620 includes a single release mechanism 629 or multiple release mechanisms (e.g., two release mechanisms 629 positioned on opposite sides of the watch body 620, such as spring-loaded buttons) to detach the watch body 620 from the wearable strap 610. The release mechanism 629 may include, but is not limited to, buttons, knobs, plugs, handles, levers, fasteners, buckles, dials, latches, or combinations thereof.

[0116] A user can actuate the release mechanism 629 by pushing, rotating, lifting, pressing, moving, or performing other actions on it. Actuation of the release mechanism 629 can release (e.g., detach) the watch body 620 from the coupling mechanism 616 of the wearable strap 610, allowing the user to use the watch body 620 independently of the wearable strap 610, and vice versa. For example, detaching the watch body 620 from the wearable strap 610 allows the user to use the rear camera 625b to capture images. Although the release mechanism 629 is shown positioned at one corner of the watch body 620, it can be positioned anywhere on the watch body 620 that is convenient for user actuation. Additionally, in some embodiments, the wearable strap 610 may also include a corresponding release mechanism for detaching the watch body 620 from the coupling mechanism 616. In some embodiments, the release mechanism 629 is optional, and as described above, the watch body 620 can detach from the coupling mechanism 616 (e.g., by twisting, rotating, etc.).

[0117] The watch body 620 may include one or more peripheral buttons 623 and 627 for performing various operations on the watch body 620. For example, peripheral buttons 623 and 627 may be used to turn on or wake the display 605 (e.g., to bring the display 605 from sleep to active state), unlock the watch body 620, increase or decrease the volume, increase or decrease the brightness, interact with one or more applications, interact with one or more user interfaces, etc. Additionally or alternatively, in some embodiments, the display 605 acts as a touchscreen and allows the user to provide one or more inputs for interacting with the watch body 620.

[0118] In some embodiments, the watch body 620 includes one or more sensors 621. The sensors 621 of the watch body 620 may be the same as or different from the sensors 613 of the wearable strap 610. The sensors 621 of the watch body 620 may be distributed on the inner and / or outer surfaces of the watch body 620. In some embodiments, the sensors 621 are configured to contact the user's skin when the user wears the watch body 620. For example, the sensors 621 may be placed on the underside of the watch body 620, and the coupling mechanism 616 may be a bracket with an opening that allows the underside of the watch body 620 to directly contact the user's skin. Alternatively, in some embodiments, the watch body 620 does not include sensors configured to contact the user's skin (e.g., sensors including those inside and / or outside the watch body 620, configured to sense data from the watch body 620 and data from the surrounding environment of the watch body 620). In some embodiments, the sensors 621 are configured to track the position and / or movement of the watch body 620.

[0119] The watch body 620 and the wearable band 610 can share data using wired communication methods (e.g., Universal Asynchronous Receiver / Transmitter (UART), USB transceiver, etc.) and / or wireless communication methods (e.g., Near Field Communication, Bluetooth, etc.). For example, the watch body 620 and the wearable band 610 can share data sensed by sensors 613 and 621, as well as application-specific and device-specific information (e.g., active and / or available applications), output devices (e.g., display, speaker, etc.), and input devices (e.g., touchscreen, microphone, imaging sensor, etc.).

[0120] In some embodiments, the watch body 620 may include, but is not limited to, a front-facing camera 625a and / or a rear-facing camera 625b, and sensors 621 (e.g., biometric sensors, IMUs, heart rate sensors, oxygen saturation sensors, neuromuscular signal sensors, altimeter sensors, temperature sensors, bioimpedance sensors, pedometer sensors, optical sensors (e.g., imaging sensors 763), touch sensors, sweat sensors, etc.). In some embodiments, the watch body 620 may include one or more haptic devices 776 (e.g., vibratory haptic actuators) configured to provide haptic feedback to the user (e.g., skin sensation and / or kinesthetic perception, etc.). Sensors 721 and / or haptic devices 776 may also be configured to operate in conjunction with multiple applications, including but not limited to health monitoring applications, social media applications, gaming applications, and artificial reality applications (e.g., applications associated with artificial reality).

[0121] As described above, the watch body 620 and the wearable strap 610, when coupled, can form a wrist wearable device 600. The watch body 620 and the wearable strap 610, when coupled, can function as a single device to perform the functions described herein (e.g., operation, detection, communication, etc.). In some embodiments, each device is provided with specific instructions for performing one or more operations of the wrist wearable device 600. For example, if it is determined that the watch body 620 does not include a neuromuscular signal sensor, the wearable strap 610 may include alternative instructions for performing associated instructions (e.g., providing sensed neuromuscular signal data to the watch body 620 via different electronic devices). The operations of the wrist wearable device 600 can be performed by the watch body 620 alone or by the watch body in conjunction with the wearable strap 610 (e.g., via a corresponding processor and / or hardware component), or vice versa. In some embodiments, the operations of the wrist wearable device 600, the watch body 620, and / or the wearable strap 610 can be performed in conjunction with one or more processors and / or hardware components.

[0122] For reference below Figure 7 As described in the block diagram, the wearable band 610 and / or the watch body 620 may each include independent resources required to perform functions independently. For example, the wearable band 610 and / or the watch body 620 may each include a power source (e.g., a battery), memory, data storage device, processor (e.g., a central processing unit (CPU)), communication, light source, and / or input / output devices.

[0123] Figure 7 Block diagrams are shown of a computing system 730 corresponding to a wearable strap 610 and a computing system 760 corresponding to a watch body 620, according to some embodiments. According to some embodiments, the computing system 700 of the wrist wearable device 600 may include a combination of components of the computing system 730 of the wearable strap and components of the computing system 760 of the watch body.

[0124] The watch body 620 and / or wearable strap 610 may include one or more components shown in the watch body's computing system 760. In some embodiments, a single integrated circuit may include all or most of the components of the watch body's computing system 760, which are included in a single integrated circuit. Alternatively, in some embodiments, the components of the watch body's computing system 760 may be included in multiple communication-coupled integrated circuits. In some embodiments, the watch body's computing system 760 may be configured (e.g., via a wired or wireless connection) to couple with the wearable strap's computing system 730, which may allow the two computing systems to share components, distribute tasks, and / or (individually or as a single device) perform other operations described herein.

[0125] The watch body's computing system 760 may include one or more processors 779, controllers 777, peripheral interfaces 761, power systems 795, and memory (e.g., memory 780).

[0126] The power system 795 may include a charger input 796, a power-management integrated circuit (PMIC) 797, and a battery 798. In some embodiments, the watch body 620 and the wearable strap 610 may have their own batteries (e.g., batteries 798 and 759) and may share power with each other. The watch body 620 and the wearable strap 610 may use various technologies to receive charge. In some embodiments, the watch body 620 and the wearable strap 610 may use wired charging components (e.g., a power cord) to receive charge. Alternatively or additionally, the watch body 620 and / or the wearable strap 610 may be configured for wireless charging. For example, a portable charging device may be designed to mate with a portion of the watch body 620 and / or a portion of the wearable strap 610 and wirelessly deliver available power to the battery 798 of the watch body 620 and / or the battery 759 of the wearable strap 610. The watch body 620 and the wearable band 610 may have independent power systems (e.g., power systems 795 and 756, respectively) to enable each to operate independently. The watch body 620 and the wearable band 610 may also share power via their respective PMICs (e.g., PMICs 797 and 758) (e.g., one can charge the other), which can share power via a power and ground conductor and / or via a wireless charging antenna.

[0127] In some embodiments, the peripheral interface 761 may include one or more sensors 721. Sensor 721 may include one or more coupling sensors 762 for detecting when the watch body 620 is coupled to another electronic device (e.g., the wearable band 610). Sensor 721 may include one or more imaging sensors 763 (e.g., a camera 725 and / or individual imaging sensors 763 (e.g., thermal imaging sensors)). In some embodiments, sensor 721 may include one or more SpO2 sensors 764. In some embodiments, sensor 721 may include one or more bioelectric potential signal sensors (e.g., an EMG sensor 765, which may be disposed on the user-facing portion of the watch body 620 and / or the wearable band 610). In some embodiments, sensor 721 may include one or more capacitive sensors 766. In some embodiments, sensor 721 may include one or more heart rate sensors 767. In some embodiments, sensor 721 may include one or more IMU sensors 768. In some embodiments, one or more IMU sensors 768 may be configured to detect movement of the user's hand, or movement of the watch body 620 in other positions where it is placed or held.

[0128] In some embodiments, one or more sensors 721 may provide an example human-machine interface. For example, a set of neuromuscular sensors (e.g., EMG sensors 765) may be arranged circumferentially along the wearable band 610, and the inner surface of the EMG sensors 765 may be configured to contact the user's skin. Any suitable number of neuromuscular sensors may be used (e.g., 2 to 20 sensors). The number and arrangement of the neuromuscular sensors may depend on the specific application of the wearable device used. For example, the wearable armband 610 may be used to generate control information for controlling augmented reality systems, controlling robots, controlling vehicles, scrolling text, controlling avatars, or controlling any other suitable control tasks.

[0129] In some embodiments, multiple neuromuscular sensors may be coupled together using flexible electronics integrated into a wireless device, and hardware signal processing circuitry may optionally be used to process the outputs of one or more of the sensing elements (e.g., to perform amplification, filtering, and / or rectification). In other embodiments, at least some of the signal processing of the outputs of the sensing elements may be performed in software (e.g., processor 779). Therefore, signal processing of the signals sampled by the sensors may be performed in hardware, in software, or by any suitable combination of hardware and software, as the aspects of the techniques described herein are not limited in this respect.

[0130] Neuromuscular signals can be realized in various ways. For example, the output of the EMG sensor 765 can be provided to an analog front end, which can be configured to perform analog processing (e.g., amplification, noise reduction, filtering, etc.) on the recorded signal. The processed analog signal can then be provided to an analog-to-digital converter (ADC), which can convert the analog signal into a digital signal that can be processed by one or more computer processors. Furthermore, although this example is discussed in the context of an interface with an EMG sensor, the embodiments described herein can also be implemented in wearable interfaces with other types of sensors, including but not limited to mechanomyography (MMG) sensors, sonomyography (SMG) sensors, and electrical impedance tomography (EIT) sensors.

[0131] In some embodiments, the peripheral interface 761 includes a near-field communication (NFC) component 769, a global-position system (GPS) component 770, a long-term evolution (LTE) component 771, and / or a Wi-Fi and / or Bluetooth communication component 772. In some embodiments, the peripheral interface 761 includes one or more buttons 773 (e.g., Figure 6 The peripheral interface 761 includes peripheral buttons 623 and 627, which, when selected by the user, cause an operation to be performed at the watch body 620. In some embodiments, the peripheral interface 761 includes one or more indicators (e.g., light-emitting diodes, LEDs) to provide the user with visual indicators (e.g., received message, low battery, active microphone and / or camera, etc.).

[0132] The watch body 620 may include at least one display 605 for displaying a visual representation of information or data to a user, including user interface elements and / or three-dimensional virtual objects. The display may also include a touchscreen for inputting user input (e.g., touch gestures and swipe gestures). The watch body 620 may include at least one speaker 774 and at least one microphone 775 for providing audio signals to the user and receiving audio input from the user. The user can provide user input through the microphone 775 and can also receive audio output from the speaker 774 as part of a haptic event provided by a haptic controller 778. The watch body 620 may include at least one camera 725, including a front-facing camera 725a and a rear-facing camera 725b. The camera 725 may include an ultra-wide-angle camera, a wide-angle camera, a fisheye camera, a spherical camera, a telephoto camera, a depth-sensing camera, or other types of cameras.

[0133] The computing system 760 of the watch body may include one or more haptic controllers 778 and associated components (e.g., haptic devices 776) for providing haptic events (e.g., a vibrational sensation or audio output responding to an event at the watch body 620) at the watch body 620. The haptic controllers 778 may communicate with one or more haptic devices 776 (e.g., electroacoustic devices), including: speakers in one or more speakers 774; and / or other audio components; and / or electromechanical devices that convert energy into linear motion (e.g., motors, electromagnetic coils, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components that convert electrical signals into haptic outputs on the device)). The haptic controllers 778 can provide haptic events that a user of the watch body 620 can feel. In some embodiments, the one or more haptic controllers 778 may receive input signals from an application in application 782.

[0134] In some embodiments, the computing system 730 of the wearable strap and / or the computing system 760 of the watch body may include a memory 780, which may be controlled by one or more memory controllers of the controller 777. In some embodiments, software components stored in the memory 780 include one or more applications 782 configured to perform operations at the watch body 620. In some embodiments, the one or more applications 782 may include games, word processors, messaging applications, calling applications, web browsers, social media applications, media streaming applications, financial applications, calendars, clocks, etc. In some embodiments, the software components stored in the memory 780 include one or more communication interface modules 783 as defined above. In some embodiments, the software components stored in the memory 780 include: one or more graphics modules 784 for rendering, encoding, and / or decoding audio data and / or video data; and one or more data management modules 785 for collecting and organizing data 787 stored in the memory 780 and / or providing access to the data 787 stored in the memory 780. In some embodiments, one or more applications and / or one or more modules in application 782 may work together to perform various tasks at the watch body 620.

[0135] In some embodiments, the software components stored in the memory 780 may include one or more operating systems 781 (e.g., a Linux-based operating system, an Android operating system, etc.). The memory 780 may also include data 787. The data 787 may include data 788A, sensor data 789A, media content data 790, and application data 791.

[0136] It should be recognized that the computing system 760 of the watch body is an example of a computing system within the watch body 620, and the watch body 620 may have more or fewer components than those shown in the computing system 760 of the watch body, may combine two or more components, and / or may have different configurations and / or arrangements of these components. The various components shown in the computing system 760 of the watch body are implemented in hardware, software, firmware, or combinations thereof (including one or more signal processing circuits and / or application-specific integrated circuits).

[0137] Turning to the computing system 730 of the wearable strap, one or more components that may be included in the wearable strap 610 are shown. The computing system 730 of the wearable strap may include more or fewer components than those shown in the computing system 760 of the watch body, may combine two or more components, and / or may have different configurations and / or arrangements of some or all of these components. In some embodiments, all or most of the components of the multiple components of the computing system 730 of the wearable strap are included in a single integrated circuit. Alternatively, in some embodiments, the multiple components of the computing system 730 of the wearable strap are included in multiple communication-coupled integrated circuits. As described above, in some embodiments, the computing system 730 of the wearable strap is configured to be coupled (e.g., via a wired or wireless connection) to the computing system 760 of the watch body, which allows the two computing systems to share components, assign tasks, and / or (individually or as a single device) perform other operations described herein.

[0138] Similar to the main body of a watch, the computing system 760 of the wearable strap may include: one or more processors 749; one or more controllers 747 (including one or more haptic controllers 748); a peripheral interface 731, which may include one or more sensors 713 and other peripheral devices; a power supply (e.g., a power system 756); and a memory (e.g., a memory 750), which includes an operating system (e.g., an operating system 751), data (e.g., data 754, which includes data 788B, sensor data 789B, etc.) and one or more modules (e.g., a communication interface module 752, a data management module 753, etc.).

[0139] One or more sensors 713 may be similar to sensor 721 of the computing system 760 of the watch body. For example, sensor 713 may include one or more coupling sensors 732, one or more SpO2 sensors 734, one or more EMG sensors 735, one or more capacitive sensors 736, one or more heart rate sensors 737, and one or more IMU sensors 738.

[0140] The peripheral interface 731 may also include other components similar to those included in the peripheral interface 761 of the computing system 760 of the watch body, as described above with reference to the peripheral interface 761. These other components include an NFC component 739, a GPS component 740, an LTE component 741, a Wi-Fi and / or Bluetooth communication component 742, and / or one or more haptic devices 746. In some embodiments, the peripheral interface 731 includes one or more buttons 743, a display 733, a speaker 744, a microphone 745, and a camera 755. In some embodiments, the peripheral interface 731 includes one or more indicators, such as LEDs.

[0141] It should be recognized that the computing system 730 of the wearable band is an example of a computing system within the wearable band 610, and the wearable band 610 may have more or fewer components than those shown in the computing system 730 of the wearable band, may combine two or more components, and / or may have different configurations and / or arrangements of these components. The various components shown in the computing system 730 of the wearable band may be implemented as one of hardware, software, and firmware, or a combination of hardware, software, and firmware (including one or more signal processing circuits and / or application-specific integrated circuits).

[0142] refer to Figure 6 The wrist wearable device 600 is an example of a wearable strap 610 and a watch body 620 coupled together, and therefore the wrist wearable device 600 will be understood to include the components shown and described for the computing system 730 for the wearable strap and the computing system 760 for the watch body. In some embodiments, the wrist wearable device 600 has a split architecture (e.g., a split mechanical architecture, a split electronic architecture, etc.) between the watch body 620 and the wearable strap 610. In other words, all the components shown in the computing system 730 for the wearable strap and the computing system 760 for the watch body can be accommodated or otherwise disposed in the combined wrist wearable device 600, or can be accommodated or otherwise disposed in separate components in the watch body 620, the wearable strap 610 and / or portions thereof (e.g., the coupling mechanism 616 of the wearable strap 610).

[0143] The above technology can be used with any device for sensing neuromuscular signals, but it can also be used with other types of wearable devices for sensing neuromuscular signals (e.g., body wearables or head wearables that may have neuromuscular sensors closer to the brain or spine).

[0144] In some embodiments, the wrist wearable device 600 may be used in conjunction with a head wearable device (e.g., an AR system 800 (e.g., AR glasses) and a VR system 910) and / or a HIPD, and the wrist wearable device 600 may also be configured to allow a user to control any aspect of the artificial reality (e.g., by controlling user interface objects in the artificial reality using EMG-based gestures, and / or by allowing a user to interact with a touchscreen on the wrist wearable device to also control aspects of the artificial reality). Having described example wrist wearable devices in this manner, attention now turns to example head wearable devices, such as the AR system 800 (e.g., AR glasses) and the VR system 910 (e.g., a VR head-mounted viewer).

[0145] Figures 8 to 10 An example artificial reality system is shown, which can be used as or in conjunction with a wrist-worn wearable device 600. In some embodiments, the AR system 800 includes an eye-worn device 802, such as... Figure 8 As shown. In some embodiments, the VR system 910 includes a head-mounted display (HMD) 912, such as... Figure 9A and Figure 9B As shown. In some embodiments, the AR system 800 and VR system 910 may include one or more similar components (e.g., components for presenting an interactive artificial reality environment, such as a processor, memory, and / or a presentation device including one or more displays and / or one or more waveguides), see reference. Figure 10 Some of these components are described in more detail. As described herein, a head-mounted wearable device may include components of an eye-worn device 802 and / or a head-mounted display 912. Some embodiments of the head-mounted device do not include any display, including any display described with reference to AR system 800 and / or VR system 910. Although several example artificial reality systems are described herein as AR system 800 and VR system 910 respectively, any one or both of the several example AR systems described herein may be configured to present a fully immersive virtual reality scene within substantially the entire field of view of the user, or a smaller augmented reality scene within a portion of the user's field of view (less than the entire field of view).

[0146] Figure 8 An example visual description of an AR system 800 is shown, which includes an eye-worn device 802 (which may also be described herein as augmented reality glasses and / or smart glasses). The AR system 800 may include... Figure 8Additional electronic components (e.g., wearable accessory devices and / or intermediate processing devices, not shown) that communicate electronically with or are otherwise configured to be used in conjunction with the eyewear device 802. In some embodiments, the wearable accessory device and / or intermediate processing device may be configured to communicate with the coupling sensor 1024 ( Figure 10 The electronic communication coupling mechanism is coupled to the eye-wearing device 802, wherein the coupling sensor 1024 can detect when the electronic device is physically or electronically coupled to the eye-wearing device 802. In some embodiments, the eye-wearing device 802 can be configured to couple to the housing 1090 ( Figure 10 The housing may include one or more additional coupling mechanisms configured to couple with additional accessory devices. Figure 8 The components shown can be implemented in hardware, software, firmware, or a combination thereof (including one or more signal processing components and / or application-specific integrated circuits (ASICs)).

[0147] The eyewear device 802 includes a mechanical eyeglass component comprising a frame 804 configured to hold one or more lenses (e.g., one or both of lenses 806-1 and 806-2). Those skilled in the art will recognize that the eyewear device 802 may include additional mechanical components, such as hinges configured to allow partial folding and unfolding of the frame 804 of the eyewear device 802, a bridge configured to span the gap between lenses 806-1 and 806-2 and rest on the user's nose, nose pads configured to rest on the bridge of the nose and provide support for the eyewear device 802, earpieces configured to rest on the user's ears and provide additional support for the eyewear device 802, and temples configured to extend from the hinges to the earpieces of the eyewear device 802. Those skilled in the art will also recognize that some examples of AR systems 800 may not include the mechanical components described herein. For example, smart contact lenses configured to present artificial reality to users may not include any components of the eyewear device 802.

[0148] The eye-worn device 802 includes multiple electronic components, many of which will be described in the following reference. Figure 10 To provide a more detailed description. Figure 8The diagram illustrates some example electronic components, including acoustic sensors 825-1, 825-2, 825-3, 825-4, 825-5, and 825-6, which may be distributed along a large portion of the frame 804 of the eye-wear device 802. The eye-wear device 802 also includes a left camera 839A and a right camera 839B located on different sides of the frame 804. The eye-wear device 802 also includes a processor 848 (or any suitable type or form of integrated circuit) embedded in a portion of the frame 804.

[0149] Figure 9A and Figure 9B A VR system 910, comprising a head-mounted display (HMD) 912 (e.g., also referred to herein as an artificial reality head-mounted viewer, head-worn device, VR head-mounted viewer, etc.), is implemented according to some embodiments. As noted, some artificial reality systems (e.g., AR system 800) can substantially replace one or more of a user's visual and / or other sensory perceptions of the real world with virtual experiences (e.g., AR systems 400 and 500), rather than blending artificial reality with real reality.

[0150] The HMD 912 includes a front body 914 and a frame 916 (e.g., a strip or band) shaped to fit the user's head. In some embodiments, the front body 914 and / or frame 916 include one or more electronic components (e.g., a display, IMU, tracking transmitter, or detector) for facilitating the presentation and / or interaction with AR and / or VR systems. In some embodiments, such as... Figure 9B As shown, the HMD 912 includes an output audio transducer (e.g., audio transducer 918). In some embodiments, such as Figure 9B As shown, one or more components (e.g., one or more output audio transducers 918 and frame 916) can be configured to be attached to and detached from the HMD 912 (e.g., part or all of frame 916 and / or audio transducers 918) (e.g., detachably attached to the HMD 912). In some embodiments, coupling a detachable component to the HMD 912 enables the detachable component to enter into electronic communication with the HMD 912.

[0151] Figure 9A and Figure 9BThe VR system 910 is also shown to include one or more cameras, such as a left camera 939A and a right camera 939B, which may resemble the left and right cameras 839A and 839B on the frame 804 of the eyewear device 802. In some embodiments, the VR system 910 includes one or more additional cameras (e.g., cameras 939C and 939D) that may be configured to enhance the image data acquired by cameras 939A and 939B by providing more information. For example, camera 939C may be used to provide color information not identified by cameras 939A and 939B. In some embodiments, one or more of cameras 939A to 939D may include an optional IR cutoff filter configured to remove IR light from the light received at the respective camera sensor.

[0152] Figure 10 A computing system 1020 and an optional housing 1090 are shown, each illustrating components that can be included in the AR system 800 and / or the VR system 910. In some embodiments, depending on the actual constraints of the respective AR system described, more or fewer components may be included in the optional housing 1090.

[0153] In some embodiments, the computing system 1020 may include one or more peripheral interfaces 1022A and / or an optional housing 1090 may include one or more peripheral interfaces 1022B. The computing system 1020 and / or the optional housing 1090 may also include one or more power systems 1042A and 1042B, one or more controllers 1046 (including one or more haptic controllers 1047), one or more processors 1048A and 1048B (as defined above, including any of the provided examples), and memories 1050A and 1050B, all of which are capable of electronic communication with each other. For example, one or more processors 1048A and 1048B may be configured to execute instructions stored in memories 1050A and 1050B, which may cause one of the one or more controllers 1046 to perform multiple operations at one or more peripheral devices connected to peripheral interfaces 1022A and / or 1022B. In some embodiments, each described operation may be performed by power supplied by power systems 1042A and / or 1042B.

[0154] In some embodiments, peripheral interface 1022A may include one or more devices configured as part of computing system 1020, some of which have been defined and / or referenced above. Figure 6 and Figure 7The wrist-worn wearable device shown is described. For example, peripheral interface 1022A may include one or more sensors 1023A. Some example sensors 1023A include one or more coupling sensors 1024, one or more acoustic sensors 1025, one or more imaging sensors 1026, one or more EMG sensors 1027, one or more capacitive sensors 1028, one or more IMU sensors 829, and / or any other type of sensor explained above or described with reference to any other embodiments discussed herein.

[0155] In some embodiments, peripheral interfaces 1022A and 1022B may include one or more additional peripheral devices, including: one or more NFC devices 1030; one or more GPS devices 1031; one or more LTE devices 1032; one or more Wi-Fi and / or Bluetooth devices 1033; one or more buttons 1034 (e.g., including slideable or otherwise adjustable buttons); one or more displays 1035A and 1035B; one or more speakers 1036A and 1036B; one or more microphones 1037A; one or more cameras 1038A and 1038B (e.g., including a left camera 1039A and / or a right camera 1039B); one or more haptic devices 1040; and / or any other type of peripheral device as defined above or described with reference to any other embodiments discussed herein. In various aspects, each of one or more displays 1035A and 1035B may include a display driver integrated circuit (DDIC 1049) operable to control the manner in which digital content is output on each display. Specifically, the DDIC 1049 controls the manner in which voltages are generated and delivered to the individual pixels of the one or more displays 1035A and 1035B, such that the brightness of the digital content presented on these displays can be controlled and modified. In operation, the DDIC 1049 receives digital image data signals and converts these signals into voltages and various types of additional signals. These voltages and additional signals are used to select and activate specific combinations of pixels at specific times. Furthermore, these voltages and signals facilitate the specific combination of pixels to output content on the display corresponding to a specific brightness level perceived by the user when viewing.

[0156] AR systems can include various types of visual feedback mechanisms (e.g., demonstration devices). For example, the display device in AR system 800 and / or VR system 910 can include one or more liquid-crystal displays (LCDs), one or more light-emitting diode (LED) displays, one or more organic LED (OLED) displays, and / or any other suitable type of display. Artificial reality systems can include a single display (e.g., configured to be viewed by both eyes), and / or can provide a separate display for each eye, which can allow for additional flexibility for zoom adjustment and / or for correcting refractive errors associated with the user's vision. Some embodiments of AR systems also include an optical subsystem with one or more lenses (e.g., conventional concave or convex lenses, Fresnel lenses, or adjustable liquid lenses) through which the user views the display.

[0157] For example, corresponding displays 1035A and 1035B may be coupled to each of lenses 806-1 and 806-2 of the AR system 800. Each display 1035A and 1035B coupled to each of lenses 806-1 and 806-2 may work collaboratively or independently to present an image or series of images to a user. In some embodiments, the AR system 800 includes a single display 1035A or 1035B (e.g., a near-eye display) or more than two displays 1035A and 1035B. In some embodiments, one or more displays 1035A and 1035B from a first group may be used to present an augmented reality environment, and one or more display devices 1035A and 1035B from a second group may be used to present a virtual reality environment. In some embodiments, one or more waveguides are used in conjunction with presenting artificial reality content to a user of the AR system 800 (e.g., as a means of delivering light from one or more displays 1035A and 1035B to the user's eyes). In some embodiments, one or more waveguides are wholly or partially integrated into the eye-worn device 802. As a complement or alternative to the display, some artificial reality systems include one or more projection systems. For example, the display device in AR system 800 and / or VR system 910 may include (e.g., using waveguides) a miniature LED projector that projects light onto the display device, such as a transparent combination lens that allows ambient light to pass through. The display device can refract the projected light into the user's pupil, allowing the user to simultaneously view both artificial reality content and the real world. Artificial reality systems may also be configured with any other suitable type or form of image projection system. In some embodiments, one or more waveguides are provided as a complement or alternative to one or more displays 1035A and 1035B.

[0158] The computing system 1020 of the AR system 800 or the optional housing 1090 of the VR system 910 may include some or all of the components of the power systems 1042A and 1042B. The power systems 1042A and 1042B may include one or more charger inputs 1043, one or more PMICs 1044, and / or one or more batteries 1045A and 1044B.

[0159] Memory 1050A and 1050B may include instructions and data, some or all of which may be stored in memory 1050A and 1050B as a non-transitory computer-readable storage medium. For example, memory 1050A and 1050B may include one or more operating systems 1051, one or more applications 1052, one or more communication interface applications 1053A and 1053B, one or more graphics applications 1054A and 1054B, one or more AR processing applications 1055A and 1055B, and / or any other type of data as defined above or described with reference to any other embodiments discussed herein.

[0160] Memory 1050A and 1050B also include data 1060A and 1060B, which can be used in conjunction with one or more of the applications discussed above. Data 1060A and 1060B may include data 1061, sensor data 1062A and 1062B, media content data 1063A, AR application data 1064A and 1064B, and / or any other type of data as defined above or described with reference to any other embodiments discussed herein.

[0161] In some embodiments, the controller 1046 of the eye-worn device 802 may process information generated by sensors 1023A and / or 1023B on the eye-worn device 802 and / or another electronic device within the AR system 800. For example, the controller 1046 may process information from acoustic sensors 825-1 and 825-2. For each detected sound, the controller 1046 may perform direction-of-arrival (DOA) estimation to estimate the direction from which the detected sound arrives at the eye-worn device 802 of the AR system 800. When sound is detected by one or more of the multiple acoustic sensors 1025 (e.g., acoustic sensors 825-1, 825-2), the controller 1046 may populate the audio dataset with information (e.g., represented by sensor data 1062A and 1062B).

[0162] In some embodiments, physical electronic connectors can transmit information between the eye-worn device 802 and another electronic device, and / or between one or more processors 848, 1048A, 1048B of the AR system 800 or VR system 910 and the controller 1046. This information can be in the form of optical data, electronic data, wireless data, or any other transmissible data format. Moving the processing of information generated by the eye-worn device 802 to an intermediate processing device can reduce the weight and heat of the eye-worn device, making it more comfortable and safer for the user. In some embodiments, an optional wearable accessory device (e.g., an electronic neckband) is coupled to the eye-worn device 802 via one or more connectors. The connectors can be wired or wireless, and can include electronic and / or non-electronic components (e.g., structural components). In some embodiments, the eye-worn device 802 and the wearable accessory device can operate independently without any wired or wireless connection between them.

[0163] In some cases, pairing an external device (e.g., a mid-processing device (e.g., HIPD 206, 306, 406)) with an eye-worn device 802 (e.g., as part of an AR system 800) enables the eye-worn device 802 to achieve a form factor similar to that of a pair of glasses, while still providing sufficient battery power and computing power for the extended capabilities. Some or all of the battery power, computing resources, and / or additional features of the AR system 800 may be provided by the paired device, or shared between the paired device and the eye-worn device 802, thereby reducing the overall weight, heat profile, and form factor of the eye-worn device 802, while allowing the eye-worn device 802 to maintain its desired functionality. For example, wearable accessory devices may allow components otherwise included in the eye-worn device 802 to be included in the wearable accessory device and / or mid-processing device, thereby transferring the weight load from the user's head and neck to one or more other parts of the user's body. In some embodiments, the mid-processing device has a large surface area to diffuse and disperse heat into the surrounding environment. Therefore, the intermediate processing device allows for greater battery capacity and computing power compared to the battery capacity and computing power otherwise feasible on a standalone eye-worn device 802. Since the weight carried in the wearable accessory device can be less invasive to the user than the weight carried in the eye-worn device 802, users can tolerate wearing a lighter eye-worn device and carrying or wearing a paired device for longer periods compared to the user tolerating wearing a heavier standalone eye-worn device, thus allowing the artificial reality environment to be more fully integrated into the user's daily activities.

[0164] AR systems can include various types of computer vision components and subsystems. For example, AR system 800 and / or VR system 910 can include one or more optical sensors, such as two-dimensional (2D) or three-dimensional (3D) cameras, time-of-flight depth sensors, structured light emitters and detectors, single-beam or scanning laser rangefinders, 3D LiDAR sensors, and / or any other suitable type or form of optical sensor. AR systems can process data from one or more of these sensors to identify the user's location and / or multiple aspects of the user's real-world physical environment (including the location of real-world objects within the real-world physical environment). In some embodiments, the methods described herein are used to map the real world, provide the user with context about the real-world environment, and / or generate digital twins (e.g., interactive virtual objects), and various other functions. For example, Figure 9A and Figure 9B A VR system 910 with cameras 939A to 939D is shown. These cameras can be used to provide depth information for creating voxel fields and two-dimensional meshes to provide object information to the user and thus avoid collisions.

[0165] In some embodiments, AR system 800 and / or VR system 910 may include a haptic (or tactile) feedback system that can be integrated into headwear, gloves, bodysuits, handheld controllers, environmental devices (e.g., chairs or carpets), and / or any other type of device or system, such as wearable devices discussed herein. The haptic feedback system can provide various types of skin feedback, including vibration, force, tension, shear stress, texture, and / or temperature. The haptic feedback system can also provide various types of kinematic feedback, such as motion and compliance. Haptic feedback can be implemented using motors, piezoelectric actuators, fluid systems, and / or various other types of feedback mechanisms. The haptic feedback system can be implemented independently of other artificial reality systems, within other artificial reality systems, and / or in conjunction with other artificial reality systems.

[0166] In some embodiments of artificial reality systems (e.g., AR system 800 and / or VR system 910), ambient light (e.g., a real-time feed of the user's surroundings as they would normally see) can penetrate the display elements of the corresponding head-mounted wearable device that presents aspects of the AR system. In some embodiments, ambient light can penetrate a portion (less than the entire AR environment) of the AR environment presented within the user's field of view (e.g., a portion of the AR environment where physical objects are located within a designated boundary (e.g., a guard boundary) in the user's real-world environment, and which are configured to be used by the user while they are interacting with the AR environment). For example, visual user interface elements (e.g., notification user interface elements) can be presented on the head-mounted wearable device, and a certain amount of ambient light (e.g., 15% to 50% of ambient light) can penetrate the user interface element, allowing the user to distinguish at least a portion of the physical environment on which the user interface element is displayed.

[0167] Figure 11 One or more processors 1048A (referred to herein as “processor 1048A”) are shown that facilitate the output of digital content with non-uniform resolution characteristics on a display 1035A. The one or more processors 1048A will be referred to herein as processor 1048A. In various respects, processor 1048A can render foveated digital content on the display 1035A. Foveated digital content corresponds to images, videos, 3D scenes, and other similar content presented on the display that makes the content appear to have non-uniform resolution. For example, processor 1048A can: (1) output high-resolution digital content on the display 1035A in an area directly aligned with the user's gaze, and (2) output low-resolution content on an area of ​​the display outside the user's gaze. The area outside the user's gaze is the peripheral area, while the area aligned with the user's gaze is the foveated area. For example, as Figure 11 As shown, peripheral regions 1104 and 1108 can be located at the top and bottom of display 1035A, such that each of peripheral regions 1104 and 1108 can occupy, for example, 20% of the surface area of ​​display 1035A.

[0168] In all respects, the area occupied by peripheral regions 1104 and 1108 can range from 20% to 35%, while the foveated region 1106 can occupy any portion of the display 1035A not occupied by peripheral regions 1104 and 1108. For example, the foveated region 1106 can occupy 65% ​​to 80% of the surface area of ​​the display 1035A. The surface area percentages discussed herein are not exhaustive, and other percentages besides those discussed herein may also apply. In all respects, the computing system 1020 can output digital content with a resolution of, for example, (1000×1000) pixels to (1920×1920) pixels in the foveated region 1106. In contrast, in the peripheral regions 1104 and 1108, the computing system 1020 can output digital content with a resolution of approximately half or a quarter of the resolution of the content in the foveated region. Other resolution ranges may also be considered for the peripheral regions 1104 and 1108.

[0169] The positions of the gaze point region and the peripheral region can dynamically change based on the area of ​​the display 1035A that is being gazed at by the user. For example, if the computing system 1020 detects that the user is gazing at the top of the display 1035A for a predetermined time frame (e.g., a threshold time of 1 second or a tenth of a second (or another fraction of a second), the processor 1048A can designate the area being gazed at as the current gaze point region (e.g., gaze point region 1106) and facilitate the output of high-resolution digital content in that region. Outside of this newly designated gaze point region, the processor 1048A can display low-resolution content. In this way, at any given time, the processor 1048A can conveniently display high-resolution digital content on the area of ​​the display 1035A that is being gazed at by the user and low-resolution digital content in areas outside the user's gaze.

[0170] Figure 12 A timing diagram 1200 is shown for a display (e.g., display 1035A) configured to output foveated digital content. The timing diagram 1200 may be generated by a processor 1048A and rendered on the display 1035A, or as part of one or more displays communicatively coupled to and external to an AR system 800, a VR system 910, or other similar systems. In general, the timing diagram depicts the sequence and duration of electrical signals applied to various components within a predetermined time frame. The content of the timing diagram can be interpreted to determine, for example, how different electrical signals interact with each other, the specific time of an event, and the duration of a particular signal or event.

[0171] Furthermore, such timing diagrams can be analyzed to identify or describe various elements related to the display rendering foveated content, such as gate scan timing, source voltage output timing, common voltage (“VCom”) waveform, gamma curve application, duty cycle division, frame period division, and other such elements. Here, timing diagram 1200 illustrates a multi-region gate scan scheme implemented for rendering or outputting foveated digital content on display 1035A. Specifically, timing diagram 1200 depicts time values ​​on x-axis 1202 and gate line indices 1204 on y-axis 1206. The time values ​​on x-axis 1202 can range from 0 microseconds (μs) to 50 μs, 0 μs to 100 μs, or 0 μs to 200 μs. Other ranges can also be considered. Furthermore, this time range can be periodically increased in increments (intervals 1207) of, for example, 15 μs to 20 μs.

[0172] Gate line index 1204 (referred to herein as a “gate line”) indicates a reference gate line—a conductive line disposed on various parts of the AR system 800 and VR system 900. These lines are operable to transmit various types of electrical signals from components of the computing system 1020 to one or more additional components of the system 1020. Each gate line index 1204 corresponds to a specific gate line (a particular conductive line) operable to transmit electrical signals to multiple thin-film transistors (TFTs) in a specific row, thereby controlling these TFTs. Furthermore, each TFT is connected to a corresponding different pixel. In other words, each gate line controls the operation of multiple pixels connected to these TFTs by routing electrical signals to the multiple TFTs in a specific row. In various respects, the electrical signals correspond to various voltages, such as gate voltage and source voltage.

[0173] A brief description of the notation representing gate line index 1204 is helpful. In the expression “G[4n+1]”, the letter “G” represents a specific gate line, and “4n+1” represents a specific row, i.e., a row comprising multiple pixels. These pixels accumulate to facilitate the horizontal display of digital content on a specific horizontal portion or row of the display 1035A. Gate line index 1204 represents 13 different gate lines, each operable to deliver the gate voltage and source voltage generated by the DDIC 1049 to 13 different pixel rows. These 13 pixel rows accumulate to facilitate the display of digital content across the entire surface area of ​​the display 1035A.

[0174] During operation, gate lines transmit gate voltage pulses to multiple thin-film transistors (TFTs), each of which (1) is connected to a corresponding different pixel in a given pixel row and (2) transmits different electrical signals (e.g., gate voltage and source voltage) to the different pixels to which it is connected. The gate lines provide gate voltages to the TFTs, facilitating their operation in an active mode (i.e., conductive mode). In other words, the gate voltage has a voltage value that satisfies or falls within a threshold voltage range to ensure that the TFT creates a conductive path between the source and drain of the TFT. Once a conductive path is established (i.e., the TFT is in active mode), the TFT can route additional electrical signals (i.e., source voltages) to the corresponding different pixels connected to these TFTs. These source voltages correspond to analog values ​​representing the grayscale and / or color values ​​of the digital content to be output on the display 1035A. Specifically, each TFT in a particular row routes a specific source voltage to the pixel to which it is connected. The pixel then uses the received source voltage to control the brightness of the content output to the display 1035A.

[0175] Each pixel can control the brightness of the content displayed on a specific rectangular portion of the display 1035A based on the amplitude of the received source voltage. For example, a power supply voltage ranging from 4 volts (V) to 7V is designated as a high voltage, while a power supply voltage ranging from 0.2V to 3V is designated as a low voltage. When output on the display 1035A, voltages within the high voltage range may appear bright to the viewer's eyes, while voltages within the low voltage range may appear dim to the viewer's eyes. As described herein, a pixel corresponds to a physical component that may include, for example, a liquid crystal cell, a color filter, a storage capacitor, and a backlight unit, or some arrangement or combination of these components.

[0176] Return to Figure 12Timing diagram 1200 shows a total of three sets of gate voltages—voltage group 1208, voltage group 1210, and voltage group 1212. As described above, these groups include gate voltages that activate 12 different pixel rows. In each respect, processor 1048A, together with a digital-to-analog (D / A) converter (not shown) and one or more additional components, generates these gate voltages. The gate voltages in voltage groups 1208 and 1212 correspond to peripheral regions 1104 and 1108, respectively, while the gate voltage in voltage group 1210 corresponds to the gaze point region 1106. Thus, voltage groups 1208 and 1212 activate multiple TFTs in rows corresponding to gate line indices G[4n+1] to G[4n+4] and G[4n+10] to G[4n+13], and voltage group 1210 activates multiple TFTs in rows corresponding to gate line indices G[4n+5] to G[4n+9]. As noted, activating multiple TFTs enables each TFT to route an additional voltage (e.g., a source voltage representing image data) to each of the multiple pixels in all rows.

[0177] In all respects, the gate voltages in voltage groups 1208 and 1212 generated by the computing system 1020 are routed with small time differences (i.e., time differences 1214, 1216, 1218, and 1220 (as indicated by the circular dashed lines in voltage groups 1208 and 1212)) to multiple corresponding TFTs in each of multiple rows corresponding to gate line indices G[4n+1] to G[4n+4] and G[4n+10] to G[4n+13]. Furthermore, the gate voltages in voltage group 1210 are also routed with small time differences (i.e., time differences 1222 and 1224) to multiple TFTs corresponding to gate line indices G[4n+5] to G[4n+9]. The computing system 1020 provides several advantages by generating and implementing the routing of gate voltages in this manner. By routing the gate voltage with a smaller time difference, power spikes and voltage common voltage backlash are reduced, improving image quality and temporal uniformity, and a smooth and almost seamless transition is achieved from the peripheral regions 1104 and 1108 to the fixation point region 1106.

[0178] Figure 12This also includes a graphical representation of gamma voltage and common voltage. In various aspects, the computing system 1020 can implement various steps to control the brightness or luminance level of the digital content output to peripheral regions 1104 and 1108 and the foveation point region 1106, thereby reducing the difference in luminance level between these regions. Specifically, the processor 1048A of the computing system 1020, operating in conjunction with the TFTs and the pixels connected to these TFTs, can apply a first set of gamma-based voltages (e.g., a set of peripheral region gamma voltages) to the peripheral regions 1104 and 1108 and a second set of gamma-based voltages (e.g., a set of foveation point region gamma voltages) to the foveation point region 1106. Similarly, the computing system 1020, operating in conjunction with the TFTs and the pixels connected to these TFTs, can apply a specific common voltage (e.g., a peripheral common voltage) to the peripheral regions 1104 and 1108 and a specific common voltage (e.g., a foveation point common voltage) to the foveation point region 1106.

[0179] In all respects, the computing system 1020 (i.e., the processor 1048A) can generate a peripheral gamma-based source voltage 1226 and a fixation-based gamma-based source voltage 1228 from two independent and distinct gamma curves stored in the memory 1050A—a peripheral region gamma curve and a fixation-based gamma curve. Each gamma curve includes multiple grayscale input values ​​on the x-axis—digital values ​​from 0 to 255—and corresponding normalized luminance values ​​on the y-axis. The peripheral region gamma curve differs from the fixation-based gamma curve in that the fixation-based gamma curve is steeper than the peripheral region gamma curve. Therefore, for a given grayscale input value, the luminance value on the fixation-based gamma curve is greater than the luminance value on the peripheral region gamma curve for the same grayscale input value. All source voltages—the peripheral gamma-based source voltage 1226 and the fixation-based gamma-based source voltage 1228—are based on or can correspond to a series of reference voltages.

[0180] During operation, processor 1048A can access grayscale input values ​​from two gamma curves, for example, from memory 1050A of computing system 1020, and identify the corresponding normalized luminance output value corresponding to each of the plurality of grayscale input values. Processor 1048A can then identify the gamma source voltage value corresponding to the normalized luminance output value. For example, processor 1048A can access a lookup table (LUT) that includes a list of normalized luminance output values ​​and their corresponding source voltage values. These lookup tables can also be stored in memory 1050A. In various respects, the peripheral region gamma curve can have a dedicated lookup table (LUT1), and the fixational region gamma curve can have another dedicated lookup table (LUT2). Processor 1048A can utilize LUT1 to identify and generate a source voltage 1226 based on the peripheral region gamma, and utilize LUT2 to identify and generate a source voltage 1228 based on the fixational region gamma.

[0181] Simultaneously or sequentially, processor 1048A can generate two independent and distinct common voltages—a peripheral region common voltage 1230 and a fixation region common voltage 1232. Each of these voltages can be generated and stored in memory 1050A based on user preferences, or stored in memory 1050A as part of factory default settings. Processor 1048A can apply the peripheral region common voltage relative to peripheral regions 1104 and 1108, and apply the fixation region common voltage relative to fixation region 1106. In various aspects, processor 1048A can determine the peripheral region pixel voltage and the fixation region pixel voltage using the peripheral region gamma-based source voltage 1226, the fixation region gamma-based source voltage 1228, the peripheral region common voltage 1230, and the fixation region common voltage 1232. Specifically, the peripheral region pixel voltage and the fixation region pixel voltage can be generated according to the following algorithm:

[0182] V 像素 =V 源极 –V 公共

[0183] During operation, processor 1048 can: (1) determine the difference between the source voltage 1226 based on the peripheral region gamma and the peripheral region common voltage 1230 to determine the pixel voltage (V) specific to peripheral regions 1104 and 1108. 像素(2) Determine the difference between the source voltage 1228 based on the gamma of the foveation region and the common voltage 1232 of the foveation region to determine the pixel voltage specific to the foveation region 1106. Finally, in order to control the brightness of the digital content output to the display 1035A, the processor 1048A may apply an electro-optical transfer function (EOFT) to the determined pixel voltage to determine an output brightness value that can be used by the pixel row to output digital content on the display 1035A.

[0184] In short, the processor 1048A operates in conjunction with the TFT and the pixels connected thereto: (1) applying a set of source voltages 1226 based on peripheral region gamma and a peripheral region common voltage 1230 to peripheral regions 1104 and 1108, and (2) applying a set of source voltages based on foveation region gamma and a foveation region common voltage 1230 to foveation region 1106. In this way, the processor 1048A helps to reduce the brightness difference between the foveation region and the peripheral region, thereby improving the visual quality of the digital content output to the display 1035A and reducing visual discomfort caused by the gaze transition between the peripheral region and the foveation region.

[0185] Processor 1048A further reduces the adverse effects of brightness differences between the fixation area and the peripheral area by incorporating delays or scan pause periods in predefined time frames (i.e., a first scan pause period 1234 and a second scan pause period 1236). In all respects, including such pause periods provides a smooth and near-seamless transition from the peripheral area 1104 to the fixation area 1106 and from the fixation area 1106 to the peripheral area 1108. These pause periods also help maintain uniform brightness and contrast levels during the transition between the peripheral and fixation areas.

[0186] Figure 13 This is an extended illustration of timing diagram 1200, where additional graphics depict adjustments to the pixel timing of multiple pixels. Specifically, Figure 13 An extended view is shown illustrating the behavior of various pixel-related parameters during the transition from peripheral region 1104 to foveation region 1106. In summary, adjusting pixel timing involves controlling multiple pixel timing parameters, such as gate voltage signals, demultiplexer control signals, source driver signals, common voltage signals, peripheral gamma voltage signals, etc. At least some of these pixel parameters... Figure 13 As shown in the figure. As stated, Figure 13 This includes a region transition window 1302 representing the transition from the peripheral region 1104 to the foveation region 1106, and the behavior of various pixel parameters during this transition.

[0187] Gate line 1304 corresponds to the fourth gate voltage in voltage group 1208. The value of the gate voltage remains high for multiple time intervals (e.g., multiple iterations of time interval 1207) and then decreases at the end of one of these time intervals. A high demultiplexer signal 1306 enables processor 1048A to route source voltages based on peripheral regions to each pixel in a specific row. For example, when demultiplexer signal 1306 is high, multiple TFTs in a row corresponding to one of the gate line indices 1204 (i.e., G[4n+4]) will route source voltages based on peripheral regions to each pixel in the row represented by G[4n+4]. In contrast, when gate line 1304 decreases from high to low, processor 1048A selects demultiplexer signal 1308 to begin routing source voltages based on the gaze region to pixels in rows represented by gate line indices 1204 G[4n+5] to G[4n+9]. In various aspects, such as Figure 12 and Figure 13 As shown, after a pause period, source voltages based on the fixation region can be routed to these rows. Source drive signal 1310 indicates the operation of a source driver (e.g., a component included as part of processor 1048A), i.e., routing source voltages based on the fixation region to pixels in the rows represented by G[4n+5] to G[4n+9]. Next, data signal 1312 represents an identifier of the source voltage based on the peripheral region, and data signal 1314 represents an identifier of the source voltage based on the fixation region. Processor 1048A uses these identifiers to route these voltages to pixels in each row in a specific manner. Finally, common voltage signal 1316 illustrates how the voltage changes from the peripheral region 1104 to the fixation region 1106. As shown, common voltage signal 1316 is high in the peripheral region 1104 and low in the fixation region 1106.

[0188] Figure 14Two gate signals applied to two pixel rows are illustrated. Specifically, as shown, processor 1048A applies an example gate signal 1402 (e.g., a specific gate voltage) to all TFTs in a specific row, which in turn apply the gate voltage to example pixel 1404 in that row. Similarly, processor 1048A applies an example gate signal 1406 to a plurality of example pixels 1408, which in turn apply the gate signal 1406 to all TFTs in a specific row, which in turn apply the gate voltage to the plurality of example pixels 1408 in that row. In various respects, processor 1048A can apply example gate signals 1402 and 1406 substantially simultaneously to example pixels 1404 and example pixels 1408. In this case, when gate signals 1402 and 1406 drop from, for example, 1V to 0V, the falling edge of these signals generates a capacitive coupling spike (or a combination of a voltage spike associated with a common voltage signal corresponding to gate signals 1402 and 1406). The combined voltage spikes cause various types of unintended effects in the digital content output to the display 1035A, such as digital content distortion, content flickering on the display 1035A, and uneven content display in different parts of the display 1035A. To address and overcome these distortions, the processor 1048A can apply an example gate signal 1402 to an example pixel 1404 to achieve a delay of a predetermined time frame (e.g., a few seconds, a fraction of a second, etc.), and then apply an example gate signal 1406 to an example pixel 1408.

[0189] Figure 15 The reduced voltage bounce as a result of the delayed application of example gate signals 1402 and 1406 is depicted. As shown, processor 1048A applies example signal 1402 to example pixel 1404 at a specific time, implementing example delay 1502, and then applies example gate signal 1406 to example pixel 1408. Therefore, the voltage spikes caused by the application of example signals 1402 and 1406 are decomposed. As shown, example common voltage signal 1504 has two separate and decomposed voltage spikes—voltage spike 1506 and voltage spike 1508. Voltage spike 1506 is generated by the application of example signal 1402, and voltage spike 1508 is generated by the delayed application of example signal 1406. This decomposition resolves and overcomes the adverse effects of voltage bounce (i.e., digital content distortion, content unevenness, and content flicker).

[0190] Figure 16A graphical representation of digital content output based on different gamma-based source voltages in different areas of the display 1035A is shown. For example, example area 1602 is a full-resolution high-fidelity area, where digital content can be output based on a gamma-based source voltage that is higher than the gamma voltages associated with areas 1604 and 1606, respectively. In various respects, the gamma source voltage of example area 1602 can correspond to a full-resolution high-fidelity area, such as the fixation point area 1106. In contrast, digital content in example area 1604 can be output based on a gamma-based source voltage that is lower than the voltage associated with example area 1602, and therefore, example area 1604 can correspond to peripheral areas 1104 and 1108. In this case, using different gamma voltages to output digital content in different areas has the advantages of reducing the brightness level difference between peripheral areas 1104 and 1108 and the fixation point area 1106, reducing mura, and thereby improving brightness uniformity in these areas.

[0191] Figure 17 The diagram illustrates blending regions at two distinct boundaries: peripheral region 1104 and foveal region 1106, and foveal region 1106 and peripheral region 1108. Blending regions 1702 and 1704 are used to simplify the visual transitions from peripheral region 1104 to foveal region 1106 and from foveal region 1106 to peripheral region 1108. Because processor 1048A routes source voltages based on peripheral region gamma and foveal region gamma to each of blending regions 1702 and 1704, such that each of these regions simultaneously includes digital content with pixel brightness characteristics from both peripheral regions 1104 and 1108 and foveal region 1106, blending regions 1702 and 1704 mitigate the visual transitions. For example, pixels activated based on source voltages based on peripheral region gamma and source voltages based on fixation region gamma can be configured such that a first pixel in the blending region is activated by one of a plurality of source voltages based on peripheral region gamma (as shown in mode 1706), and a second pixel adjacent to the first pixel can be activated by a source voltage based on fixation region gamma (as shown in mode 1708). This blending of high-fidelity and low-fidelity pixels allows the user's eye to perceive a smooth and almost seamless transition from peripheral region 1104 to fixation region 1106 and from fixation region 1106 to peripheral region 1108.

[0192] The process parameters and order of steps described and / or illustrated herein are given by way of example only and may be changed as needed. For example, although the steps shown and / or described herein may be shown or discussed in a particular order, these steps do not necessarily need to be performed in the shown or discussed order. The various exemplary methods described and / or illustrated herein may omit one or more of the steps described or illustrated herein, or may include additional steps in addition to those disclosed.

[0193] The preceding description has been provided to enable others skilled in the art to best utilize various aspects of the exemplary embodiments disclosed herein. This exemplary description is not intended to be exhaustive or to be limited to any precise form disclosed. Many modifications and variations are possible without departing from the spirit and scope of this disclosure. The embodiments disclosed herein should be considered illustrative rather than restrictive in all respects. Reference should be made to the appended claims and their equivalents in determining the scope of this disclosure.

[0194] Unless otherwise stated, the terms “connected to” and “coupled to” (and their derivatives) as used in this specification and claims shall be construed as allowing both direct and indirect connections (i.e., connections via other elements or components). Furthermore, the terms “a” or “an” as used in this specification and claims shall be construed as meaning “at least one of”. Finally, for ease of use, the terms “comprising” and “having” (and their derivatives) as used in this specification and claims are interchangeable with the word “including” and have the same meaning as the word “comprising”.

Claims

1. A computer-implemented method comprising: determining a luminance difference between a plurality of peripheral regions of a display and a gaze point region of the display; in response to the determining, adjusting the luminance difference by: applying a set of peripheral region gamma voltages to the plurality of peripheral regions and applying another set of gaze point region gamma voltages to the gaze point region; and setting a peripheral region common voltage for the plurality of peripheral regions and setting a gaze point region common voltage for the gaze point region. a top boundary of the gaze point region is contiguous with a boundary of one of the plurality of peripheral regions and a bottom boundary of the gaze point region is contiguous with a boundary of another of the plurality of peripheral regions.

2. The computer-implemented method of claim 1, wherein, 3. The computer-implemented method of claim 1, wherein: the set of peripheral region gamma voltages corresponds to a series of reference voltages, each reference voltage of the series of reference voltages corresponding to a respective digital input value; and the other set of gaze point region gamma voltages corresponds to another series of reference voltages, each reference voltage of the other series of reference voltages corresponding to a respective additional digital input value.

4. The computer-implemented method of claim 3, wherein: each respective digital input value corresponds to a respective luminance value specific to at least one pixel in at least one of the plurality of peripheral regions; and each additional respective digital input value corresponds to a respective additional luminance value specific to at least one additional pixel in the gaze point region.

5. The computer-implemented method of claim 1, further comprising: including a pause period comprising a predefined timeframe after setting the set of peripheral region gamma voltages.

6. The computer-implemented method of claim 1, further comprising: applying a peripheral region gate signal to a set of pixels in at least one of the plurality of peripheral regions; and applying a gaze point region gate signal to a set of pixels in the gaze point region. each of the peripheral region gate signal and the gaze point region gate signal is a pulsed voltage.

8. The computer-implemented method of claim 1, further comprising:

7. The computer-implemented method of claim 6, wherein, applying a peripheral region pixel timing parameter to a set of pixels in at least one of the plurality of peripheral regions; and applying a gaze point region pixel timing parameter to a set of pixels in the gaze point region. the peripheral region pixel timing parameter and the gaze point region pixel timing parameter correspond to a de-multiplexer on-time parameter, a de-multiplexer stall-time parameter, or a source drive signal.

10. A system comprising: at least one physical processor; 9. The computer-implemented method of claim 8, wherein, a display; a physical memory comprising computer-executable instructions that, when executed by the physical processor, cause the physical processor to: determine a luminance difference between a plurality of peripheral regions of the display and a gaze point region of the display; and in response to the determining, adjust the luminance difference by: applying a set of peripheral region gamma voltages to the plurality of peripheral regions and applying another set of gaze point region gamma voltages to the gaze point region, and ​ ​ ​ a peripheral region common voltage is set for the plurality of peripheral regions and a foveal region common voltage is set for the foveal region.

11. The system of claim 10, wherein, a top boundary of the foveal region is contiguous with a boundary of one of the plurality of peripheral regions and a bottom boundary of the foveal region is contiguous with a boundary of another of the plurality of peripheral regions.

12. The system of claim 11, wherein, the set of peripheral region gamma voltages corresponds to a series of reference voltages, each reference voltage of the series of reference voltages corresponding to a respective digital input value, and the other set of foveal region gamma voltages corresponds to another series of reference voltages, each reference voltage of the other series of reference voltages corresponding to a respective additional digital input value.

13. The system of claim 12, wherein, the other set of foveal region gamma voltages corresponds to another series of reference voltages, each reference voltage of the other series of reference voltages corresponding to a respective additional digital input value.

14. The system of claim 13, wherein, each respective digital input value corresponds to a respective luminance value specific to at least one pixel in at least one of the plurality of peripheral regions; and each additional respective digital input value corresponds to a respective additional luminance value specific to at least one additional pixel in the foveal region.

15. The system of claim 10, wherein, the computer-executable instructions, when executed by the physical processor, further cause the physical processor to: include a pause period comprising a predefined timeframe after setting the set of peripheral region gamma voltages.

16. The system of claim 10, wherein, the computer-executable instructions, when executed by the physical processor, further cause the physical processor to: apply a peripheral region gate signal to a set of pixels in at least one of the plurality of peripheral regions, and apply a foveal region gate signal to a set of pixels in the foveal region.

17. The system of claim 16, wherein, each of the peripheral region gate signal and the foveal region gate signal is a pulsed voltage.

18. The system of claim 10, wherein, the computer-executable instructions, when executed by the physical processor, further cause the physical processor to: apply a peripheral region pixel timing parameter to a set of pixels in at least one of the plurality of peripheral regions.

19. The system of claim 10, wherein, the computer-executable instructions, when executed by the physical processor, further cause the physical processor to: apply a foveal region pixel timing parameter to a set of pixels in the foveal region.

20. A non-transitory computer-readable medium comprising one or more computer- executable instructions that, when executed by at least one processor of a computing device, cause the computing device to: determine a luminance disparity between a plurality of peripheral regions of a display and a foveal region of the display; in response to the determining, adjust the luminance disparity by: applying a set of peripheral region gamma voltages to the plurality of peripheral regions and another set of foveal region gamma voltages to the foveal region, and setting a peripheral region common voltage for the plurality of peripheral regions and a foveal region common voltage for the foveal region.

Images