Power management for global mode display panel lighting
Through the adaptive power management circuit, the power voltage waveform is adjusted according to the configuration parameters and display data of the display device, which solves the problem of power fluctuations and visual artifacts in different brightness images, and achieves more efficient power management.
Patent Information
- Application Number
- CN202380038682.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-05-06
- Filing Date
- 2023-05-07
- Publication Date
- 2024-12-13
AI Technical Summary
The power consumption fluctuates greatly when displaying images of different brightness, especially in global lighting mode, which may cause power consumption spikes, resulting in visual artifacts.
An adaptive power management circuit is designed to generate power control signals based on image brightness level and turn on pixel ratio by receiving configuration parameters and display data of the display device, and adjust the power supply voltage waveform to optimize power distribution.
It effectively reduces power consumption spikes, reduces visual artifacts, and improves the power management efficiency of display devices.
Smart Images

Figure CN119137647A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates generally to power supply circuits, and more particularly to adaptive power supply circuits based on an image to be displayed on a display panel. Background Art
[0002] The amount of power consumed by a display device can depend on the average brightness of the image being displayed. Therefore, as the average brightness of each display frame changes, the power consumption of the display device fluctuates accordingly. In addition, when a display device operates in a global illumination mode (in which all pixels are illuminated simultaneously), large spikes in power consumption may occur when pixels are activated, particularly when the display device is displaying a luminance image or an image containing a large number of white pixels. These spikes in power consumption may cause visual artifacts in the display device. Summary of the Invention
[0003] Various embodiments relate to a power management circuit that receives an input supply voltage (e.g., from a power outlet or a battery) and generates an output supply voltage to power a display device, wherein the operation of the power management circuit is controlled based on display data of an image to be displayed by the display device.
[0004] In one or more embodiments, the power supply unit is adjusted based on the image to be displayed by the display panel. The power supply unit includes a controller circuit for generating a power control signal and a power supply circuit for generating one or more power supply voltages having a waveform based on the power control signal. The controller circuit receives a set of configuration parameters from the display device and generates the power control signal based on the set of configuration parameters. These configuration parameters are stored in a lookup table of the display device. Alternatively, these configuration parameters are stored as equations (or coefficients of predefined equations) in a non-volatile memory of the display device.
[0005] According to a first aspect of the present disclosure, a power management circuit is provided, which includes: a controller circuit, which is used to generate a power control signal, and the controller circuit is configured to receive a set of configuration parameters from a display device and generate the power control signal based on the set of configuration parameters, wherein the configuration parameters are determined based on at least one of the values stored in a lookup table of the display device or the equations stored in a non-volatile memory of the display device; and a power circuit, which is coupled to the output end of the controller circuit, and is configured to receive the power control signal from the controller circuit and generate one or more power voltages, and the one or more power voltages have a waveform based on the power control signal.
[0006] In some embodiments, the controller circuit is further configured to receive display data and identify the lookup table entry based on the received display data.
[0007] In some embodiments, the display data is received from one of a display device or an application processor.
[0008] In some embodiments, the display data is one of: video data of a video frame to be displayed by a display device; a brightness level of an image to be displayed by a display device; a frame rate of a display device; a panel temperature of a display panel of a display device; or an on-pixel-ratio (OPR) of an image to be displayed by a display device.
[0009] In some embodiments, the OPR is determined by adding the gray levels of each pixel of the image to be displayed by the display panel.
[0010] In some embodiments, the OPR indicates a ratio between an expected brightness of the display panel during a current frame and a maximum brightness of the display panel.
[0011] In some embodiments, the power supply circuit includes a plurality of voltage regulators, each voltage regulator being configured to generate a power supply voltage having a corresponding nominal value.
[0012] In some embodiments, the controller circuit is further configured to receive one or more display control signals, and wherein the controller circuit is configured to generate the power control signal based on the received one or more display control signals.
[0013] In some embodiments, the one or more display control signals include at least one of: a vertical synchronization signal; and a frame rate of the display device.
[0014] In some embodiments, the one or more display control signals are received from one of a display device or an application processor.
[0015] According to a second aspect of the present disclosure, a method is provided, comprising: receiving, by a controller circuit, a set of configuration parameters from a display device, wherein the configuration parameters are determined based on at least one of values stored in a lookup table of the display device or equations stored in a non-volatile memory of the display device; generating a power control signal based at least in part on the received configuration parameters; and generating, by a power circuit, one or more power supply voltages having a waveform based on the power control signal.
[0016] In some embodiments, the method further comprises: receiving display data; and identifying a lookup table entry based on the received display data.
[0017] In some embodiments, the display data is received from one of a display device or an application processor.
[0018] In some embodiments, the display data is one of: video data of a video frame to be displayed by a display device; a brightness level of an image to be displayed by a display device; a frame rate of a display device; a panel temperature of a display panel of a display device; or an on-pixel ratio (OPR) of an image to be displayed by a display device.
[0019] In some embodiments, the OPR is determined by adding the gray levels of each pixel of the image to be displayed by the display panel.
[0020] In some embodiments, the OPR indicates a ratio between an expected brightness of the display panel during a current frame and a maximum brightness of the display panel.
[0021] In some embodiments, the method further includes: receiving one or more display control signals by the controller circuit, wherein the one or more display control signals include at least one of the following: a vertical synchronization signal; a horizontal synchronization signal; and a frame rate of the display device, and wherein the power control signal is also generated based on the received one or more display control signals.
[0022] According to a third aspect of the present disclosure, a method is provided, comprising: providing a test image for display to a display device; providing a set of power supply voltages having a waveform generated based on a power profile to the display device; acquiring the output of a display panel of the display device; and in response to determining that the output of the display panel meets a predetermined threshold, storing the power profile in a lookup table of the display device.
[0023] In some embodiments, the method further includes: modifying the power distribution in response to determining that the output of the display panel does not meet a predetermined threshold; providing a set of power supply voltages having a second waveform generated based on the modified power distribution to the display device; collecting the output of the display panel of the display device; and storing the modified power distribution in a lookup table of the display device in response to determining that the output of the display panel meets the predetermined threshold.
[0024] In some embodiments, the output of the display panel is one of: an image of the display panel captured using a camera; voltage waveforms at multiple detection points of the display panel; and current waveforms at multiple detection points of the display panel.
[0025] It will be appreciated that any feature described herein as suitable for incorporation into one or more aspects or embodiments of the present disclosure is intended to be general in nature in any and all aspects and embodiments of the present disclosure. Other aspects of the present disclosure will be apparent to those skilled in the art from the specification, claims, and drawings of the present disclosure. The foregoing general description and the following detailed description are intended to be exemplary and illustrative only and are not intended to limit the scope of the claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Figure 1A is a perspective view of a headset implemented as an eyewear device according to one or more embodiments.
[0027] Figure 1B is a perspective view of a head-mounted device implemented as a head-mounted display according to one or more embodiments.
[0028] Figure 1C for Figure 1B A cross section of the front rigid body of the head-mounted display shown in FIG.
[0029] Figure 2A A block diagram of an electronic display environment is shown in accordance with one or more embodiments.
[0030] Figure 2B An example OLED pixel structure is shown for a pixel in a display area according to one or more embodiments.
[0031] Figure 2C A circuit diagram is shown for modeling power distribution on a display panel according to one or more embodiments.
[0032] Figure 3 A structure of a video frame for transmitting video data for displaying the video on a display device according to one or more embodiments is shown.
[0033] Figure 4A A timing diagram illustrating operation of a display device in a scrolling lighting mode according to one or more embodiments is shown.
[0034] Figure 4B A timing diagram illustrating operation of a display device in a global illumination mode according to one or more embodiments is shown.
[0035] Figure 5 A block diagram of a power management circuit is shown in accordance with one or more embodiments.
[0036] Figure 6 A flow chart illustrating a process of generating a power supply voltage for operating a display device according to one or more embodiments is shown.
[0037] Figure 7A flow chart illustrating a process of calibrating display device 220 in accordance with one or more embodiments is shown.
[0038] Figure 8 An example lookup table (LUT) entry 810 and an example supply voltage waveform generated based on configuration parameters stored in the LUT entry are shown in accordance with one or more embodiments.
[0039] Figure 9 A system including a head mounted device according to one or more embodiments is provided.
[0040] The accompanying drawings depict various embodiments for purposes of illustration only. Those skilled in the art will readily recognize from the following discussion that alternative embodiments of the structures and methods shown herein may be employed without departing from the principles described herein. DETAILED DESCRIPTION
[0041] Embodiments of the present invention may include an artificial reality system, or be implemented in conjunction with an artificial reality system. Artificial reality is a form of reality that has been adjusted in some way before being presented to a user, and may include, for example, virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and / or derivative thereof. Artificial reality content may include fully generated content or generated content combined with collected (e.g., real-world) content. Artificial reality content may include video, audio, tactile feedback, or some combination thereof, any of which may be presented in a single channel or multiple channels (e.g., stereoscopic video that gives the viewer a three-dimensional effect). In addition, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, which are used to create content in artificial reality and / or be used in artificial reality in other ways. Artificial reality systems that provide artificial reality content can be implemented on a variety of platforms, including wearable devices (e.g., head-mounted devices) connected to a host computer system, standalone wearable devices (e.g., head-mounted devices), mobile devices or computing systems, or any other hardware platform capable of providing artificial reality content to one or more viewers.
[0042] Figure 1Ais a stereoscopic view of a head mounted device 100 implemented as an eyeglass device according to one or more embodiments. In some embodiments, the eyeglass device is a near eye display (NED). Generally speaking, the head mounted device 100 can be worn on the face of a user so that content (e.g., media content) is presented using a display assembly and / or an audio system. However, the head mounted device 100 can also be used to present media content to the user in a different manner. Examples of media content presented by the head mounted device 100 include one or more images, videos, audio, or some combination thereof. The head mounted device 100 includes a frame and may include other components such as a display assembly, a depth camera assembly (DCA), an audio system, and a position sensor 185, wherein the display assembly includes one or more display elements 120. Although Figure 1A The components of the head mounted device 100 are shown as being located at various example locations on the head mounted device 100, but these components may be located elsewhere on the head mounted device 100, on a peripheral device that is paired with the head mounted device 100, or some combination thereof. Similarly, the head mounted device 100 may have more than one component. Figure 1A More components or fewer components than shown.
[0043] The frame 110 holds the other components of the head-mounted device 100. The frame 110 includes a front member that holds one or more display elements 120 and end members (e.g., temples) that attach to the user's head. The front member of the frame 110 spans the top of the user's nose. The length of the end members can be adjustable (e.g., adjustable temple length) to accommodate different users. The end members can also include portions that bend behind the user's ears (e.g., temple tips, earpieces).
[0044] One or more display elements 120 provide light to a user wearing the head-mounted device 100. As shown, the head-mounted device includes a display element 120 for each eye of the user. In some embodiments, the display element 120 generates image light, which is provided to the eyebox of the head-mounted device 100. The eyebox is the location in space occupied by the user's eyes when the user is wearing the head-mounted device 100. For example, the display element 120 can be a waveguide display. A waveguide display includes a light source (e.g., a two-dimensional source, one or more line sources, one or more point sources, etc.) and one or more waveguides. Light from the light source is coupled into the one or more waveguides, which output light in a manner that creates a pupil replica in the eyebox of the head-mounted device 100. The coupling of light into and / or the decoupling of light from the one or more waveguides can be accomplished using one or more diffraction gratings. In some embodiments, the waveguide display includes a scanning element (e.g., a waveguide, a mirror, etc.) that scans the light from the light source as it is coupled into the one or more waveguides. Note that in some embodiments, one or both of the two display elements 120 are opaque and do not transmit light from a local area around the head-mounted device 100. The local area is the area around the head-mounted device 100. For example, the local area may be a room where a user wearing the head-mounted device 100 is located, or the user wearing the head-mounted device 100 may be outdoors and the local area is an outdoor area. In this context, the head-mounted device 100 generates VR content. Alternatively, in some embodiments, one or both of the two display elements 120 are at least partially transparent so that light from the local area can be combined with light from one or more display elements to generate AR content and / or MR content.
[0045] In some embodiments, display element 120 does not generate image light; instead, it is a lens that transmits light from a localized area to the eye area. For example, one or both of the two display elements 120 can be an uncorrected (non-prescription) lens or a prescription lens that helps correct defects in the user's vision (e.g., a single vision lens, a bifocal lens, a trifocal lens, or a progressive lens). In some embodiments, display element 120 can be polarized and / or tinted to protect the user's eyes from the sun.
[0046] In some embodiments, the display element 120 may include an additional optical block (not shown). The optical block may include one or more optical elements (e.g., lenses, Fresnel lenses, etc.) that direct light from the display element 120 to the eye zone. The optical block may, for example, correct for aberrations in part or all of the image content, magnify part or all of the image content, or some combination thereof.
[0047] The DCA determines depth information of a portion of a local area around the head mounted device 100. The DCA includes one or more imaging devices 130 and a DCA controller ( Figure 1A (not shown), and the DCA may further include an illuminator 140. In some embodiments, the illuminator 140 illuminates a portion of the local area with light. The light may be, for example, structured light in infrared (IR) (e.g., dot pattern structured light, strip structured light, etc.), IR flash for time of flight, etc. In some embodiments, one or more imaging devices 130 capture an image of a portion of the local area that includes light from the illuminator 140. As shown, Figure 1A Shown is a single illuminator 140 and two imaging devices 130. In an alternative embodiment, the illuminator 140 is absent and at least two imaging devices 130 are present.
[0048] The DCA controller calculates depth information for the portion of the local area using the acquired images and one or more depth determination techniques, such as direct time-of-flight (ToF) depth sensing, indirect ToF depth sensing, structured light, passive stereo analysis, active stereo analysis (using texture added to the scene by light from illuminator 140), some other technique for determining the depth of the scene, or some combination thereof.
[0049] The DCA may include an eye tracking unit that determines eye tracking information. The eye tracking information may include information about the position and orientation of a single eye or two eyes (within their respective eye-adaptive zones). The eye tracking unit may include one or more cameras. The eye tracking unit estimates the angular orientation of a single eye or two eyes based on image capture of the single eye or two eyes by one or more cameras. In some embodiments, the eye tracking unit may also include one or more illuminators that use lighting patterns (e.g., structured light, flashes, etc.) to illuminate a single eye or two eyes. The eye tracking unit may use the lighting patterns in the captured images to determine the eye tracking information. The head-mounted device 100 may prompt the user to opt-in to allow the eye tracking unit to operate. For example, by opting-in, the head-mounted device 100 may detect and store any image of the user or the user's eye tracking information.
[0050] The audio system provides audio content. The audio system includes a transducer array, a sensor array, and an audio controller 150. However, in other embodiments, the audio system may include different components and / or additional components. Similarly, in some cases, the functions described with respect to these components of the audio system may be distributed among the components in a manner different from that described herein. For example, some or all of the various functions of the controller may be performed by a remote server.
[0051] The transducer array presents sound to the user. The transducer array includes a plurality of transducers. The transducer can be a speaker 160 or a tissue transducer 170 (e.g., a bone conduction transducer or a cartilage conduction transducer). Although the speaker 160 is shown as being located outside the frame 110, the speaker 160 can be enclosed in the frame 110. In some embodiments, rather than including a separate speaker for each ear, the head mounted device 100 includes a speaker array that includes multiple speakers integrated into the frame 110 to improve the directionality of the presented audio content. The tissue transducer 170 is attached to the user's head and directly vibrates the user's tissue (e.g., bone or cartilage) to produce sound. The number and / or position of the transducers can vary depending on the user's ear location. Figure 1A The number and / or location of the transducers shown in FIG. 5 are different.
[0052] The sensor array detects sounds within the local area of the head mounted device 100. The sensor array includes a plurality of acoustic sensors 180. The acoustic sensors 180 collect sounds emitted from one or more sound sources in the local area (e.g., a room). Each acoustic sensor is configured to detect sounds and convert the detected sounds into an electronic format (analog or digital). The acoustic sensors 180 may be sound wave sensors, microphones, sound transducers, or similar sensors suitable for detecting sounds.
[0053] In some embodiments, one or more acoustic sensors 180 can be placed in the ear canal of each ear (e.g., as binaural microphones). In some embodiments, the acoustic sensors 180 can be placed on an exterior surface of the head mounted device 100, on an interior surface of the head mounted device 100, separate from the head mounted device 100 (e.g., as part of some other device), or some combination thereof. The number and / or location of the acoustic sensors 180 can vary depending on the device. Figure 1A The number and / or location of the acoustic sensors shown in FIG. 1 may be different. For example, the number of acoustic detection locations may be increased to increase the amount of audio information collected and improve the sensitivity and / or accuracy of the information. The acoustic detection locations may be oriented so that the microphones can detect sounds in a wide range of directions around the user wearing the head mounted device 100.
[0054] The audio controller 150 processes information from the sensor array describing the sounds detected by the sensor array. The audio controller 150 may include a processor and a computer-readable storage medium. The audio controller 150 may be configured to generate a direction of arrival (DOA) estimate, generate an acoustic transfer function (e.g., an array transfer function and / or a head-related transfer function), track the location of a sound source, form a beam in the direction of a sound source, classify the sound source, generate an acoustic filter for the speaker 160, or some combination thereof.
[0055] The position sensor 185 generates one or more measurement signals in response to the movement of the head-mounted device 100. The position sensor 185 can be located on a portion of the frame 110 of the head-mounted device 100. The position sensor 185 can include an inertial measurement unit (IMU). Examples of the position sensor 185 include: one or more accelerometers; one or more gyroscopes; one or more magnetometers; another suitable type of sensor that detects movement; a type of sensor used for error correction of the IMU; or some combination thereof. The position sensor 185 can be located external to the IMU, internal to the IMU, or some combination thereof.
[0056] In some embodiments, the head mounted device 100 can provide simultaneous localization and mapping (SLAM) for the position of the head mounted device 100, and provide updates to the model of the local area. For example, the head mounted device 100 may include a passive camera assembly (PCA) that generates color image data. The PCA may include one or more RGB cameras that capture images of part or all of the local area. In some embodiments, some or all of the imaging devices 130 of the DCA may also be used as PCA. The images captured by the PCA and the depth information determined by the DCA can be used to determine parameters of the local area, generate a model of the local area, update the model of the local area, or some combination thereof. In addition, the position sensor 185 tracks the positioning (e.g., position and posture) of the head mounted device 100 in the room. The following is combined with Figure 9 Additional details regarding various components of the head mounted device 100 are discussed.
[0057] Figure 1B1 is a perspective view of a head mounted device 105 implemented as an HMD according to one or more embodiments. In embodiments describing an AR system and / or an MR system, portions of the front face of the HMD are at least partially transparent in the visible light band (approximately 380 nanometers (nm) to 750 nm), and portions of the HMD located between the front face of the HMD and the user's eyes are at least partially transparent (e.g., a partially transparent electronic display). The HMD includes a front rigid body 115 and a strap 175. The head mounted device 105 includes the aforementioned Figure 1A The same components described above are modified to be incorporated into an HMD form factor. For example, the HMD includes a display assembly, a DCA, an audio system, and a position sensor 185. Figure 1B Shown are an illuminator 140, a plurality of speakers 160, a plurality of imaging devices 130, a plurality of acoustic sensors 180, and a position sensor 185. The speakers 160 can be located in various locations, for example, coupled to the band 175 (as shown), coupled to the front rigid body 115, or can be configured to be inserted into the ear canal of the user.
[0058] Figure 1C for Figure 1B A cross section of the front rigid body 115 of the head mounted display is shown in FIG. Figure 1C As shown, the front rigid body 115 includes an optical block 118 that provides altered image light to an exit pupil 190. The exit pupil 190 is the location in the front rigid body 115 where the user's eye 195 is located. For illustration purposes, Figure 1C A cross section associated with a single eye 195 is shown, but another optical block separate from the optical block 118 provides altered image light to the user's other eye.
[0059] Optics block 118 includes a display element 120 and an optics block 125. Display element 120 emits image light toward optics block 125. Optics block 125 amplifies the image light and, in some embodiments, also corrects for one or more additional optical errors (e.g., distortion, astigmatism, etc.). Optics block 125 directs the image light to an exit pupil 190 for presentation to a user.
[0060] System Architecture
[0061] Figure 2AA block diagram of an electronic display environment 200 is shown in accordance with one or more embodiments. The electronic display environment 200 includes an application processor 210 and a display device 220. In some embodiments, the electronic display environment 200 further includes a power management circuit 270 (e.g., a power management integrated circuit (PMIC)) for providing power to the application processor 210 and the display device 220. In some embodiments, the power management circuit 270 receives power from a power source 290 (e.g., a battery or an electrical outlet).
[0062] The application processor 210 generates display data for controlling a display device to display a desired image. The display data includes a plurality of pixel data, each of which is used to control a pixel of the display device to emit light having a corresponding intensity. In some embodiments, each pixel data includes sub-pixel data corresponding to a different color (e.g., red, green, and blue). In addition, in some embodiments, the application processor 210 generates display data for a plurality of display frames to display a video.
[0063] The display device 220 includes a display driver integrated circuit (DDIC) 230 and a display panel 240. In some embodiments, the display device 220 includes additional components, such as one or more sensors (e.g., light sensor, proximity sensor, temperature sensor, etc.). The display device 220 may be Figure 1A HMD 100 or Figure 1B That is, the display device 220 may be a part of the HMD 100. Figure 1A or Figure 1C An embodiment of the display element 120 in FIG.
[0064] In one embodiment, the display device 220 may display multiple frames of video content based on global illumination, in which all pixels 245 are illuminated with image light for each frame simultaneously. In an alternative embodiment, the display device 220 may display video content based on segmented illumination, in which all pixels 245 in each segment of the display device 220 are illuminated with image light for each frame of the video content simultaneously. For example, each segment of the display device 220 may include at least one row of pixels 245 in the display device 220. In the illustrative case where each segment for illumination in the display device 220 includes a row of pixels 245, the segmented illumination may be referred to as scrolling illumination. In yet another embodiment, the display device 220 may display video content based on controllable illumination, in which a controllable-sized portion ( Figure 2AAll pixels 245 in the display device 220 (not shown) simultaneously illuminate image light for each frame of the video content. The controllable portion of the display device 220 can be rectangular, square, or have some other suitable shape. In some embodiments, the size of the controllable portion of the display device 220 can be a dynamic function of the number of frames.
[0065] The display area 240 includes a set of pixels 245 organized into multiple rows and columns. For example, the display area 240 includes N pixels (P 11 To P 1N ), N pixels in the second row (P 21 To P 2N ), N pixels in the third row (P 31 To P 3N ) etc. Each pixel 245 is controlled to provide a light output corresponding to a display signal received from the application processor 210. For example, in the case of an OLED panel, the display area 240 includes an array of pixels, each pixel having an OLED capable of emitting light at a controllable intensity.
[0066] Figure 2B An example OLED pixel structure of a pixel 245 in a display area 240 according to one or more embodiments is shown. The pixel structure includes a drive transistor M D , driving transistor M D It is configured to generate a current proportional to the voltage stored in the energy storage capacitor Cst for driving the OLED. Then, the OLED generates a current proportional to the voltage stored in the drive transistor M D Because the brightness of a pixel is proportional to the current supplied to the OLED, the amount of power consumed by the OLED is also proportional to the desired brightness of the OLED. In other words, the display device 220 implemented using an OLED consumes more power when displaying a brighter image than when displaying a relatively darker image.
[0067] Gate transistor M G Control driving transistor M D When the gate line is set to be valid, the gate transistor M G Turn on, driving transistor M D The gate of the transistor M is connected to the data line and charges the energy storage capacitor Cst based on the voltage value provided at the data line. G Cut off, driving transistor M G The gate of the emission transistor M is disconnected from the data line. EM Control driving transistor M D When the emission signal EM is set to be valid, the emission transistor M EMTurn on, driving transistor M D Connected to OLED. When the driving transistor M D When connected to OLED, the driving transistor M D In some embodiments, a group of pixels arranged in the same column of the display area 240 share a data line. In addition, a group of pixels arranged in the same row of the display area share a gate line.
[0068] Refer again Figure 2A DDIC 230 receives display signals from application processor 210 and generates control signals for controlling each pixel 245 in display area 240. For example, DDIC 230 generates signals for programming each of multiple pixels 245 in display area 240 based on the image signals received from application processor 210. In addition, DDIC 230 generates signals for turning on the drive transistors of one or more pixels 245 for a predetermined period of time.
[0069] Figure 2CA circuit diagram is shown modeling a power delivery network in display device 220 according to one or more implementations. In some embodiments, display panel 240 is connected to a chip-on-film (CoF) having DDIC 230. Furthermore, the CoF is connected to a flexible cable 250, which is used to allow external components (e.g., application processor 210 and / or power management circuit 270) to interact with display 220. Power (e.g., from power management circuit 270) can be received via connector 255 of flexible cable 250. The power can then be routed through power rails and distributed across display panel 240. For example, display device 220 can receive multiple supply voltages (e.g., ELVDD, ELVSS, AVDD) and can provide each supply voltage to each of a plurality of pixels 245. Conductors used to distribute each of the multiple supply voltages have a resistance (e.g., based on the conductor's resistivity, length, and cross-sectional area). For example, conductors in flex 250 used to route the supply voltages to the CoF can have a first resistivity R1. Similarly, the conductors in CoF 235 used to route the power supply voltage received from flex 250 to display panel 240 can have a second resistivity R2. Furthermore, the conductors in display panel 240 used to route the power supply voltage received from the CoF to each of the plurality of pixels can have a third resistivity R3. When current flows through a conductor of one or more power rails, a voltage drop is generated across the conductor, thereby reducing the voltage reaching the pixel (compared to the nominal value of the power supply voltage). When the pixel is activated to emit light, variations in the power supply voltage level reaching each pixel can cause optical artifacts. For example, depending on the topology used to route the power supply voltage, pixels in one area of the display panel (e.g., pixels near the top of the display panel) may experience a higher resistance than pixels in another area of the display panel (e.g., pixels near the bottom of the display panel). Consequently, due to the increased voltage drop across the conductors used to distribute the power supply voltage, pixels experiencing a higher resistance may receive a lower power supply voltage than pixels experiencing a lower resistance.
[0070] Frame structure and timing
[0071] Figure 3 1 shows a structure of a video frame for transmitting video data for displaying video on the display device 220 according to one or more embodiments. In particular, Figure 3Two frames 300 are shown. Each frame 300 includes a vertical synchronization (VSync) 340 signal, a vertical back port (VBP) 320, a vertical front porch (VFP) 325, a horizontal back porch (HBP) 330, a horizontal front port (HFP) 335, active video data 310, and a horizontal synchronization (HSync) signal 345A. Each frame 300 is separated by a vertical synchronization (VSync) 340 signal.
[0072] Active video area 310 contains the video data to be displayed during the current frame. The video data includes pixel data for each pixel of display device 220. The video data is divided into multiple lines. For example, for 1080p video, active video data 310 includes 1080 lines, and each line includes 1920 pixels. Similarly, for 4K video, active video data 310 is divided into 2160 lines, each line has 3840 pixels.
[0073] The VSync signal 340 signals the start of a new frame 300 to the display device 220. The VSync signal 340 has a predefined pattern or format (e.g., a predefined duration). The VSync signal 340 enables the display device 220 to receive video data at irregular frame rates. In other words, the VSync signal 340 allows the display device 220 to synchronize the display frame rate with the frame rate of the video data being received.
[0074] The VBP 320 is a portion of the frame 300 that occurs after the VSync signal 340 and before the active video data 310. The VBP 320 can be used to provide metadata to the display device 220. Additionally, the VFP 325 is a portion of the frame 300 that occurs after the active video data 310. In some embodiments, the VFP 325, VSync 320, and VBP 320 are referred to as a vertical blanking interval (VBlank or VBI).
[0075] The HSync signal 345 signals the start of a new line within the current frame 300 to the display device 320. Thus, the HSync signal 345 is provided to the display device 220 multiple times (at least once per line) within a single frame 300. The HSync signal 345 has a predefined pattern or format. The HBP 330 is the portion of the frame 300 that follows the HSync signal 345 and precedes the active video data 310. The HFP 335 is the portion of the frame 300 that follows the active video data 310 and precedes the HSync signal 345. In some embodiments, the HFP 335, HSync 325, and HBP 330 are referred to as the horizontal blanking interval (HBlank or HBI).
[0076] Display Sequence
[0077] Figure 4A A timing diagram illustrating operation of the display device 220 in a scrolling lighting mode according to one or more embodiments is shown. When the display device 220 receives the VSync signal 440A, the first frame 400A begins. After receiving the VSync signal 440A, the display device 220 begins receiving data included in the VBP 420A. After receiving the VBP 420A, the display device 220 begins receiving valid video data 310A (e.g., during a data transmission period 420). Based on the valid video data 410A, the display device programs each pixel. In some embodiments, the display device programs each pixel upon receiving the corresponding video data. Alternatively, the display device programs each pixel during a separate data scan period. In some embodiments, the data scan period is performed during the VFP period 425. In other embodiments, the data scan period may begin upon receiving the valid video data 410 and may overlap with the data transmission period 420.
[0078] In the rolling illumination mode, after a group of pixels (e.g., pixels in a given pixel row) have been programmed, the pixels are activated to cause the pixels to emit light. Specifically, in the rolling illumination mode, the illumination period (when at least a subset of the pixels are illuminated) begins before the end of the data transmission period (and / or data scanning period) and overlaps with the data transmission period (and / or data scanning period).
[0079] In some embodiments, a first subset of pixels of a display device (e.g., a first row of pixels) is illuminated for a predetermined amount of time during a first portion of an illumination cycle. After the first subset of pixels is illuminated, a second subset of pixels of the display device (e.g., a second row of pixels) is illuminated during a second portion of the illumination cycle. This process continues until each subset of pixels (e.g., each row of pixels) is illuminated.
[0080] When the display device 220 receives the VSync signal 440B, the first frame 400A ends and the second frame 400B begins. In some embodiments, the duration of a frame is the time from receiving the VSync signal 440 indicating the start of a frame to receiving the VSync signal 440 indicating the start of the next frame.
[0081] Figure 4B A timing diagram illustrating operation of the display device 220 in global illumination mode according to one or more embodiments is shown. When the display device 220 receives the VSync signal 440A, the first frame 400A begins. After receiving the VSync signal 440A, the display device 220 begins receiving data included in the VBP 420A. After receiving the VBP 420A, the display device 220 begins receiving valid video data 410A (e.g., during a data transmission period 420). Based on the valid video data 410A, the display device programs each pixel. In some embodiments, the display device programs each pixel upon receiving the corresponding video data. Alternatively, the display device programs each pixel during a separate data scan period. In some embodiments, the data scan period is performed during the VFP period 425. In other embodiments, the data scan period may begin while the valid video data 410 is being received and may overlap with the data transmission period 420.
[0082] Unlike the scrolling illumination mode, in the global illumination model, all pixels of the display device 220 are illuminated simultaneously (or substantially simultaneously) during the illumination period. In addition, in the global illumination mode, the illumination period 435 does not overlap with the data transmission period 420 (and / or the data scanning period) and follows the data transmission period 420.
[0083] In some applications (for example, in virtual reality headsets), global illumination mode can provide a better visual experience. However, because all pixels are illuminated simultaneously, the display device consumes more current to activate the pixels than in scrolling illumination mode. As a result, optical artifacts appear in the display panel due to the higher voltage drop across the conductors that distribute power to the display panel.
[0084] Adaptive power supply circuit
[0085] Figure 51 shows a block diagram of a power management circuit 270 according to one or more embodiments. The power management circuit 270 includes a controller circuit 510, a power supply circuit 520, and other components. In some embodiments, the power management circuit is connected to the display device 220 (e.g., via connector 255). The power management circuit 270 is configured to provide one or more power supply voltages (e.g., ELVDD, ELVSS, AVDD, etc.) to the display device 220. In addition, in some embodiments, the power management circuit 270 is configured to receive one or more data or control signals from the display device 220. Alternatively or additionally, the power management circuit 270 is configured to receive one or more data or control signals from the application processor 210.
[0086] The controller circuit 510 receives one or more data signals (e.g., video data, brightness level, frame rate, panel temperature, or on-pixel ratio (OPR)) from the display device 220 (or optionally from the application processor 210) and a power control signal Ctrl for controlling the power circuit 520. In some embodiments, the power control signal Ctrl is a pulse-width-modulation (PWM) control signal, a pulse-frequency-modulation (PFM) control signal, a digital control signal, an analog control signal, or the like.
[0087] As used herein, OPR is a ratio between the grayscale level of each of a plurality of pixels in an image to be displayed by a display panel and the maximum grayscale level of the plurality of pixels. In some embodiments, the OPR may be determined based on the digital value of each of the plurality of pixels in the image to be displayed. For example, the OPR may be determined as:
[0088]
[0089] For example, if the display device is rectangular, the OPR may be determined as:
[0090]
[0091] Where N is the number of pixels in a column, R is the number of rows, grayscale_levelij is the grayscale value of the pixel (or sub-pixel) located at the i-th column and j-th row, and max_grayscale_level is the maximum grayscale value of the pixel (e.g., 255).
[0092] In other embodiments, the OPR value is determined using the following predefined function f(x):
[0093]
[0094] For example, the predefined function f(x) may be the gamma function:
[0095] f(x)=A·x γ (4)
[0096] where A and γ are constant values (eg, 1 and 2.2, respectively).
[0097] Because the OPR is based on the image to be displayed rather than on the characteristics of the power circuitry or display device, the OPR can be determined by the application processor 210, reducing the amount of data transmitted to the power management circuitry 270. That is, the application processor 210 may include custom circuitry or run custom firmware to implement the calculation of the OPR. Alternatively, to enable the power management circuitry 270 to be used with an unmodified application processor, the power management circuitry 270 may receive display data from the application processor 210 or the DDIC 230, and the controller circuitry 510 of the power management circuitry 270 may determine the OPR of the image to be displayed internally. For example, the same video data provided to the DDIC 230 may be provided to the power management circuitry 270, enabling the controller circuitry 510 of the power management circuitry 270 to calculate the OPR. In other embodiments, the power circuitry receives the OPR from the display device 220. For example, the DDIC 230 of the display device 220 determines the OPR based on the video data received by the DDIC from the application processor 210, and the DDIC 230 then provides the OPR to the power management circuitry 270.
[0098] Additionally or alternatively, the controller circuit 510 receives one or more configuration parameters from the display device 220. For example, based on the received one or more data signals, the control circuit 510 identifies an entry in a lookup table (LUT) of the display device 220. The control circuit 510 then sends a request for information stored in the identified entry to the display device and receives the configuration parameters stored in the identified entry of the LUT. In another example, the configuration parameters are determined based on one or more equations or formulas stored in a non-volatile memory of the display device 220. In this example, the control circuit 520 may send a request to the display device to calculate the configuration parameters based on the received one or more data signals. In some embodiments, the configuration parameters specify the waveform of one or more power supply voltages. For each power supply voltage, the configuration parameters specify the voltage level (or deviation from the nominal value) at one or more specified time points. For example, the configuration parameters may specify that ELVDD should increase by 1.5% after 3.4 microseconds from the start of the video frame, increase by 1% after 3.5 microseconds from the start of the video frame, increase by 0.5% after 3.6 microseconds from the start of the video frame, and should remain at the nominal value after 3.7 microseconds from the start of the video frame.
[0099] In addition, the controller circuit 510 can receive one or more control signals (e.g., a VSync signal) and generate a power control signal based on the received one or more control signals. For example, the control circuit 510 generates a power control signal Ctrl that is synchronized with a VSync signal received from the display device 220 or the application processor 210.
[0100] The power supply circuit 520 includes circuitry for converting power received from the power supply 290 into a set of power supply voltages to be provided to the display device 220. The power supply circuit 520 may include a set of voltage regulators that may be configured to generate regulated output voltages having voltage levels set by a power control signal Ctrl received from the control circuit 510. In some embodiments, the power supply circuit 520 may include a first voltage regulator for generating a panel voltage (AVDD), a second voltage regulator for generating a positive panel emission voltage (ELVDD), and a third voltage regulator for generating a negative panel emission voltage (ELVSS). Each voltage regulator may be configured to have a nominal voltage level and may include an input for controlling the voltage regulator to increase or decrease the output voltage based on the value of a signal provided by the input. For example, the first voltage regulator may have a nominal output voltage of 6.0V, the second voltage regulator may have a nominal output voltage of 5.0V, and the third voltage regulator may have a nominal output voltage of -2.0V.
[0101] Figure 6 A flow chart illustrating a process of generating a power supply voltage for operating the display device 220 according to one or more embodiments is shown. Figure 6 The process shown in FIG. 2 may be performed by power management circuit 270, display device 220, or application processor 210. In other embodiments, other entities may perform Figure 6 Various embodiments may include different steps and / or additional steps, or perform the steps in a different order.
[0102] Controller circuit 510 of power management circuit 270 receives 610 display data. In some embodiments, the display data received is from display panel 220 (e.g., display data received from the display panel's DDIC via connector 255 of flex 250). In other embodiments, the display data received is from application processor 210. In some embodiments, the display data is at least one of: video data of a video frame to be displayed by display device 220; a brightness level of an image to be displayed by display device 220; a frame rate of display device 220; a panel temperature of display panel 240 of display device 220; or an on-pixel ratio (OPR) of an image to be displayed by display device 220.
[0103] Based on the display data, controller circuit 510 determines 620 a LUT entry. In other embodiments, the LUT entry is determined by application processor 210 or a DDIC of display device 220. In these embodiments, display data may not be provided to power management circuit 270.
[0104] The controller circuit 510 sends a request for the configuration parameters associated with the identified LUT entry to the display device and receives 630 the configuration parameters from the display device 220. The controller circuit 510 also receives control signals (e.g., VSync signal, frame rate, etc.) from the display device 220 or from the application processor 210. Based on the control signals and the configuration parameters, the controller circuit 510 generates a Ctrl signal for controlling the power circuit 520. In some embodiments, the Ctrl signal is synchronized with the VSync signal received by the controller circuit 510. In addition, in some embodiments, the timing of the Ctrl signal is also based on the frame rate of the display device 220.
[0105] The power supply circuit 520 receives the Ctrl signal and configures one or more voltage regulators to generate an output corresponding to the value of the Ctrl signal. In some embodiments, the Ctrl signal specifies a deviation from the nominal output. The Ctrl signal can be a digital signal or an analog signal. In some embodiments, if the Ctrl signal is a digital signal, the Ctrl signal is converted to an analog signal for controlling the voltage regulators of the power supply circuit 520.
[0106] Display panel calibration
[0107] In some embodiments, a calibration process is used to generate a LUT for the display device 220. The calibration process can provide the display device with a set of images to be displayed by the display panel 240 and can capture the output of the display device 220. The captured output is analyzed and entries for the LUT are generated and stored. In some embodiments, each display device is calibrated separately and entries associated with the display device are generated and stored in the LUT. Alternatively, the calibration process can be performed in batches (e.g., each display device in a batch shares the same LUT entries).
[0108] In some embodiments, the calibration process is performed using a camera that captures optical defects of a test image displayed by the display panel 240 of the display device 220. Alternatively, in other embodiments, the calibration process is performed using a scope (e.g., an oscilloscope) that captures a voltage waveform and / or a current waveform generated in response to the display panel 240 of the display device 220 displaying the test image.
[0109] Figure 7 A flow chart illustrating a process of calibrating display device 220 in accordance with one or more embodiments is shown. Figure 7 The process shown in can be performed by the display panel 220 or a calibration system that interacts with the display panel. In other embodiments, other entities can perform Figure 7 Various embodiments may include different steps and / or additional steps, or perform the steps in a different order.
[0110] The display panel 220 receives 710 a test image and displays 715 the test image. In some embodiments, at the beginning of the calibration process, a plurality of supply voltages are provided to the display panel at their respective nominal values. The output of the display panel is captured 720 using one or more sensors. For example, the one or more sensors may include a camera that captures an image of the display panel displaying the test image. In another example, the one or more sensors include an oscilloscope that captures voltages or currents at different locations within the display panel.
[0111] The acquired output of the display panel is compared to a predetermined standard 730. If the acquired output meets the predetermined standard, the power configuration parameters used to generate the power supply voltage for operating the display device are stored in the LUT of the display device. Alternatively, if the acquired output of the display device does not meet the predetermined standard, the power profile is modified (e.g., by modifying the configuration parameters provided to the power management circuit 270), and the process loops back to step 715. This process is repeated until the acquired output of the display device meets the predetermined standard.
[0112] In some embodiments, when the captured output of the display device is an image of the display panel, the calibration system determines, in response to displaying the test image, whether the captured image exhibits visible artifacts in the display panel. If the captured image exhibits no visible artifacts (or the visible artifacts are below a predetermined standard), the calibration system determines that the output of the display device meets the predetermined standard. Alternatively, if the captured image exhibits visible artifacts in the display panel, the calibration system determines that the output of the display device does not meet the predetermined standard.
[0113] In another embodiment, when the acquired output of the display device is a set of voltage waveforms or current waveforms, the calibration system determines whether each of the voltage waveforms or current waveforms follows a predetermined range or a predetermined shape. In some embodiments, a value (e.g., an average value or a spread value) is determined based on the voltage waveforms or current waveforms, and the value is compared with a predetermined standard.
[0114] In some embodiments, the Figure 7 For example, for each test image, a new LUT entry is generated and stored in the LUT of the display device. That is, for each test image, a LUT index is calculated based on the display data associated with the test image, and the LUT index is used Figure 7 The power distribution or power configuration parameters determined in each step are associated with the determined LUT index and stored.
[0115] Example power supply voltage waveform
[0116] Figure 8 An example LUT entry 810 and an example power supply voltage waveform generated based on configuration parameters stored in the LUT entry are shown in accordance with one or more embodiments. In some embodiments, the configuration parameters stored in the LUT entry include a voltage profile for each of a plurality of power supply voltages to be provided to the display device during a given display frame. The LUT can store voltage values for a set of times (synchronized with the start of a display frame or a VSync signal).
[0117] like Figure 8As shown in LUT entry 810 of , the configuration parameters instruct the power management circuit 270 to generate an AVDD whose waveform has a nominal value between time t=0 μs and t=3.4 μs, a value that is 3.0% higher than the nominal value from time t=3.4 μs to t=3.4 μs, a value that is 2.0% higher than the nominal value from time t=3.5 μs to t=3.6 μs, a value that is 1.0% higher than the nominal value from time t=3.6 μs to t=3.7 μs, and a nominal value from time t=3.7 μs to the end of the display frame. Similarly, the configuration parameters instruct the power management circuit 270 to generate ELVDD, whose waveform has a nominal value between time t=0 microseconds and t=3.4 microseconds, a value that is 1.5% higher than the nominal value from time t=3.4 microseconds to t=3.4 microseconds, a value that is 1.0% higher than the nominal value from time t=3.5 microseconds to t=3.6 microseconds, a value that is 0.5% higher than the nominal value from time t=3.6 microseconds to t=3.7 microseconds, and a nominal value from time t=3.7 microseconds to the end of the display frame. Furthermore, the configuration parameters instruct the power management circuit 270 to generate an ELVSS waveform having a nominal value between time t=0 μs and t=3.4 μs, a value 2.0% higher than the nominal value from time t=3.4 μs to t=3.4 μs, a value 1.3% higher than the nominal value from time t=3.5 μs to t=3.6 μs, a value 0.4% higher than the nominal value from time t=3.6 μs to t=3.7 μs, and a nominal value from time t=3.7 μs to the end of the display frame. Based on the configuration parameters, the controller circuit 510 of the power management circuit 270 configures the power supply circuit 520 (e.g., a voltage regulator of the power supply circuit) to output a power supply voltage that follows the waveform specified by the configuration parameters.
[0118] System environment
[0119] Figure 9 is a system 900 including a head mounted device 905 according to one or more embodiments. In some embodiments, the head mounted device 905 may be Figure 1A Head mounted device 100 or Figure 1B The system 900 can be operated in an artificial reality environment (e.g., a virtual reality environment, an augmented reality environment, a mixed reality environment, or some combination thereof). Figure 9 The illustrated system 900 includes a head mounted device 905, an input / output (I / O) interface 910 coupled to a console 915, a network 920, and a map building server 925. Figure 9An example system 900 is shown that includes one head mounted device 905 and one I / O interface 910, but in other embodiments, any number of these components may be included in the system 900. For example, there may be multiple head mounted devices, each having an associated I / O interface 910, wherein each head mounted device and I / O interface 910 communicates with a console 915. In alternative configurations, different components and / or additional components may be included in the system 900. Furthermore, in some embodiments, the system 900 may be configured to include a plurality of head mounted devices, each having an associated I / O interface 910, wherein each head mounted device and I / O interface 910 communicates with a console 915. Figure 9 The functionality described in one or more of the components shown in FIG may be combined with Figure 9 The described methods may be distributed among the components in different ways. For example, some or all of the functions of the console 915 may be provided by the head mounted device 905.
[0120] The head mounted device 905 includes a display assembly 930, an optics block 935, one or more position sensors 940, and a DCA 945. Some embodiments of the head mounted device 905 have Figure 9 Furthermore, in other embodiments, the components described herein are different from those described herein. Figure 9 The functionality provided by the various components described may be distributed differently among the components of the head-mounted device 905 , or may be embodied in multiple separate components remote from the head-mounted device 905 .
[0121] The display assembly 930 displays content to the user based on data received from the console 915. The display assembly 930 uses one or more display elements (e.g., display element 120) to display content. The display element can be, for example, an electronic display. In various embodiments, the display assembly 930 includes a single display element or multiple display elements (e.g., a display for each eye of the user). Examples of electronic displays include: a liquid crystal display (LCD); an organic light emitting diode (OLED) display; an active-matrix organic light-emitting diode display (AMOLED); a waveguide display; some other display; or some combination thereof. Note that in some embodiments, the display element 120 can also include some or all of the functions of the optics block 935.
[0122] Optics block 935 can amplify image light received from an electronic display, correct optical errors associated with the image light, and present the corrected image light to one or two eye zones of head-mounted device 905. In various embodiments, optics block 935 includes one or more optical elements. Example optical elements included in optics block 935 include: an aperture; a Fresnel lens; a convex lens; a concave lens; an optical filter; a reflective surface; or any other suitable optical element that affects image light. Furthermore, optics block 935 can include a combination of different optical elements. In some embodiments, one or more of the multiple optical elements in optics block 935 can have one or more coatings, such as a partially reflective coating or an anti-reflective coating.
[0123] The magnification and focusing of image light by optics block 935 allows the electronic display to be physically smaller, lighter, and consume less power than larger displays. Furthermore, magnification can increase the field of view of content presented by the electronic display. For example, the field of view of the displayed content can be such that substantially all of the user's field of view (e.g., approximately 110 degrees diagonally) is used to present the displayed content, and in some cases, all of the user's field of view is used to present the displayed content. Furthermore, in some embodiments, the amount of magnification can be adjusted by adding or removing optical elements.
[0124] In some embodiments, optics block 935 can be designed to correct for one or more types of optical errors. Examples of optical errors include barrel or pincushion distortion, longitudinal chromatic aberration, or lateral chromatic aberration. Other types of optical errors may also include spherical aberration, chromatic aberration, or errors due to lens field curvature, astigmatism, or any other type of optical error. In some embodiments, content provided to an electronic display for display is pre-distorted, and optics block 935 corrects for this distortion upon receiving image light generated based on the content from the electronic display.
[0125] Position sensor 940 is an electronic device that generates data indicating the position of head-mounted device 905. Position sensor 940 generates one or more measurement signals in response to movement of head-mounted device 905. Position sensor 185 is an embodiment of position sensor 940. Examples of position sensor 940 include: one or more IMUs; one or more accelerometers; one or more gyroscopes; one or more magnetometers; another suitable type of sensor that detects motion; or some combination thereof. Position sensor 940 may include multiple accelerometers for measuring translational motion (forward / backward, up / down, left / right) and multiple gyroscopes for measuring rotational motion (e.g., pitch, yaw, roll). In some embodiments, the IMU rapidly samples the measurement signals and calculates an estimated position of the head-mounted device 905 based on the sampled data. For example, the IMU integrates multiple measurement signals received from the accelerometers over time to estimate a velocity vector, and integrates the velocity vector over time to determine the estimated position of a reference point on the head-mounted device 905. A reference point is a point that can be used to describe the position of the head-mounted device 905. However, while a reference point may generally be defined as a point in space, in practice, a reference point is defined as a point within the head mounted device 905 .
[0126] The DCA 945 generates depth information of a portion of a local area. The DCA includes one or more imaging devices and a DCA controller. The DCA 945 may also include an illuminator. Figure 1A The operation and structure of DCA 945 are described.
[0127] The audio system 950 provides audio content to the user of the head-mounted device 905. The audio system 950 is substantially the same as the audio system 200 described above. The audio system 950 may include one or more acoustic sensors, one or more transducers, and an audio controller. The audio system 950 may provide spatialized audio content to the user. In some embodiments, the audio system 950 may request multiple acoustic parameters from a map building server 925 via a network 920. These acoustic parameters describe one or more acoustic characteristics of a local area (e.g., room impulse response, reverberation time, reverberation level, etc.). The audio system 950 may provide information describing at least a portion of the local area from, for example, a DCA 945, and / or location information of the head-mounted device 905 from a location sensor 940. The audio system 950 may use one or more of the multiple acoustic parameters received from the map building server 925 to generate one or more sound filters and use these sound filters to provide audio content to the user.
[0128] The I / O interface 910 is a device that allows a user to send action requests and receive responses from the console 915. An action request is a request to perform a specific action. For example, an action request may be an instruction to start or end the acquisition of image data or video data, or an instruction to perform a specific action within an application. The I / O interface 910 may include one or more input devices. Example input devices include: a keyboard; a mouse; a game controller; or any other suitable device for receiving an action request and transmitting the action request to the console 915. The action request received by the I / O interface 910 is transmitted to the console 915, which performs the action corresponding to the action request. In some embodiments, the I / O interface 910 includes an IMU that collects calibration data indicating an estimated position of the I / O interface 910 relative to an initial position of the I / O interface 910. In some embodiments, the I / O interface 910 may provide tactile feedback to the user based on the instructions received from the console 915. For example, tactile feedback is provided when an action request is received, or when the console 915 performs an action, the console 915 transmits an instruction to the I / O interface 910 so that the I / O interface 910 generates tactile feedback.
[0129] The console 915 provides content to the head mounted device 905 for processing based on information received from one or more of: the DCA 945; the head mounted device 905; and the I / O interface 910. Figure 9 In the example shown in FIG, the console 915 includes an application repository 955, a tracking module 960, and an engine 965. Some embodiments of the console 915 have Figure 9 Similarly, the functions described further below may be combined with Figure 9 The described methods may be distributed among the multiple components of the console 915 in different ways. In some embodiments, the functions discussed herein with respect to the console 915 can be implemented in the head mounted device 905 or in a remote system.
[0130] The application repository 955 stores one or more applications for execution by the console 915. An application is a set of instructions that, when executed by the processor, generates content for presentation to the user. The content generated by the application may be responsive to user input received via movement of the head-mounted device 905 or the I / O interface 910. Examples of applications include gaming applications, conferencing applications, video playback applications, or other suitable applications.
[0131] The tracking module 960 uses information from the DCA 945, one or more position sensors 940, or some combination thereof to track the movement of the head mounted device 905 or the I / O interface 910. For example, the tracking module 960 determines the location of a reference point of the head mounted device 905 in a map of the local area based on information from the head mounted device 905. The tracking module 960 can also determine the location of an object or virtual object. In addition, in some embodiments, the tracking module 960 can use portions of the data from the position sensors 940 that indicate the location of the head mounted device 905 and the representation of the local area from the DCA 945 to predict the future location of the head mounted device 905. The tracking module 960 provides the estimated or predicted future location of the head mounted device 905 or the I / O interface 910 to the engine 965.
[0132] The engine 965 executes the application and receives position information, acceleration information, velocity information, predicted future position, or some combination thereof of the head mounted device 905 from the tracking module 960. Based on the received information, the engine 965 determines the content to be provided to the head mounted device 905 for presentation to the user. For example, if the received information indicates that the user has looked to the left, the engine 965 generates the following content for the head mounted device 905: the content reflects the user's movement in a virtual local area or in a local area (which enhances the local area with additional content). In addition, the engine 965 performs an action within the application executed on the console 915 in response to receiving an action request from the I / O interface 910, and provides feedback to the user that the action has been performed. The feedback provided can be visual feedback or auditory feedback via the head mounted device 905, or tactile feedback via the I / O interface 910.
[0133] The network 920 couples the head mounted device 905 and / or the console 915 to the map building server 925. The network 920 may include any combination of local area networks and / or wide area networks using wireless communication systems and / or wired communication systems. For example, the network 920 may include the Internet as well as a mobile phone network. In one embodiment, the network 920 uses standard communication technologies and / or protocols. Thus, the network 920 may include links using, for example, Ethernet; 802.11; worldwide interoperability for microwave access (WiMAX); 2G / 3G / 4G mobile communication protocols; digital subscriber line (DSL); asynchronous transfer mode (ATM); wireless bandwidth; PCI Express Advanced Switching; and the like. Similarly, network protocols used on the network 920 may include multiprotocol label switching (MPLS), transmission control protocol / Internet protocol (TCP / IP), user datagram protocol (UDP), hypertext transport protocol (HTTP), simple mail transfer protocol (SMTP), file transfer protocol (FTP), etc. Data exchanged on the network 920 may be represented using technologies and / or formats including: binary image data (e.g., Portable Network Graphics (PNG)), hypertext markup language (HTML), extensible markup language (XML), etc.In addition, all or some links may be encrypted using conventional encryption technologies such as secure sockets layer (SSL); transport layer security (TLS); virtual private networks (VPN); Internet Protocol security (IPsec), etc.
[0134] The map-building server 925 may include a database storing virtual models describing a plurality of spaces, wherein a location in the virtual models corresponds to the current configuration of the local area of the head-mounted device 905. The map-building server 925 receives information describing at least a portion of the local area and / or location information of the local area from the head-mounted device 905 via the network 920. A user may adjust privacy settings to allow or prevent the head-mounted device 905 from sending information to the map-building server 925. Based on the received information and / or location information, the map-building server 925 determines a location in the virtual model associated with the local area of the head-mounted device 905. The map-building server 925 determines (e.g., retrieves) one or more acoustic parameters associated with the local area based in part on the determined location in the virtual model and any acoustic parameters associated with the determined location. The map-building server 925 may send the location of the local area and any values of the acoustic parameters associated with the local area to the head-mounted device 905.
[0135] One or more components of the system 900 may include a privacy module that stores one or more privacy settings for user data elements. These user data elements describe the user or the head-mounted device 905. For example, the user data elements may describe a physical characteristic of the user, an action performed by the user, the user's position of the head-mounted device 905, the position of the head-mounted device 905, a head-related transfer function (HRTF) of the user, etc. The privacy settings (or "access settings") for the user data elements may be stored in any suitable manner, such as: associated with the user data element; in an index on an authorization server; in another suitable manner; or any suitable combination thereof.
[0136] The privacy settings for a user data element specify how the user data element (or specific information associated with the user data element) may be accessed, stored, or otherwise used (e.g., viewed, shared, modified, copied, executed, displayed, or identified). In some embodiments, the privacy settings for a user data element may specify a "blocked list" of entities that may not access certain information associated with the user data element. The privacy settings associated with a user data element may specify any suitable granularity for allowing or denying access. For example, some entities may have permission to view the existence of a particular user data element, some entities may have permission to view the content of a particular user data element, and some entities may have permission to modify a particular user data element. These privacy settings may allow a user to allow other entities to access or store a user data element for a limited period of time.
[0137] Privacy settings may allow a user to specify one or more geographic locations where user data elements may be accessed. Access or denial of access to a user data element may depend on the geographic location of the entity attempting to access the user data element. For example, a user may allow access to a user data element only while the user is in a particular location and specify that the user data element is accessible to the entity. If the user leaves that particular location, the user data element may no longer be accessible to the entity. As another example, a user may specify that a user data element is accessible only to entities within a threshold distance from the user (e.g., another user of a head mounted device in the same local area as the user). If the user subsequently changes location, the entities that had access to the user data element may lose access, and a new set of entities may gain access when they come within the threshold distance of the user.
[0138] System 900 may include one or more authorization / privacy servers for enforcing privacy settings. A request from an entity for a particular user data element may identify the entity associated with the request and may only send the user data element to the entity if the authorization server determines, based on the privacy settings associated with the user data element, that the entity is authorized to access the user data element. If the requesting entity is not authorized to access the user data element, the authorization server may prevent the requested user data element from being retrieved or may prevent the requested user data element from being sent to the entity. Although this disclosure describes enforcing privacy settings in a particular manner, this disclosure contemplates enforcing privacy settings in any suitable manner.
[0139] Additional configuration information
[0140] The foregoing description of the various embodiments has been presented for illustrative purposes; it is not intended to be exhaustive or to limit the patent rights to the precise form disclosed. Those skilled in the relevant art will appreciate that many modifications and variations are possible in light of the above disclosure.
[0141] Some parts of this specification describe various embodiments in terms of algorithms and symbolic representations for operating on information. These algorithmic descriptions and representations are typically used by those skilled in the art of data processing to effectively convey the essence of their work to those skilled in the art. Although functionally, computationally, or logically these operations have been described, these operations should be understood to be implemented by computer programs or equivalent circuits or microcodes, etc. In addition, without loss of generality, sometimes referring to these arrangements of operations as modules also proves to be convenient. The described operations and their associated modules can be implemented in software, firmware, hardware, or any combination thereof.
[0142] Any of the steps, operations, or processes described herein may be performed or implemented using one or more hardware or software modules, alone or in combination with other devices. In one embodiment, the software modules are implemented using a computer program product comprising a computer-readable medium containing computer program code that can be executed by a computer processor to perform any or all of the steps, operations, or processes described herein.
[0143] Embodiments may also relate to apparatus for performing the operations herein. The apparatus may be specially constructed for the desired purpose, and / or the apparatus may comprise a general-purpose computing device that is selectively activated or reconfigured by a computer program stored in a computer. Such a computer program may be stored in a non-transitory tangible computer-readable storage medium, or any type of medium suitable for storing electronic instructions, which may be coupled to a computer system bus. Furthermore, any computing system mentioned in the specification may comprise a single processor, or may be an architecture employing a multi-processor design to increase computing power.
[0144] Embodiments may also relate to products produced by the computing processes described herein. Such products may include information produced by the computing processes, wherein the information is stored on a non-transitory tangible computer-readable storage medium, and may include any embodiment of a computer program product or other data combination described herein.
[0145] Finally, the language used in the specification is primarily selected for readability and instructional purposes, and may not be selected to describe or limit the patent rights. Therefore, it is intended that the scope of the patent rights be limited not by this detailed description, but by any claims published in this application based thereon. Therefore, the disclosure of the various embodiments is intended to illustrate, not to limit, the scope of the patent rights set forth in the claims.
Claims
1. A power management circuit, include: a controller circuit for generating a power control signal, the controller circuit being configured to: receive a set of configuration parameters from a display device, and generate the power control signal based on the set of configuration parameters, wherein the configuration parameters are determined based on at least one of a value stored in a lookup table of the display device or an equation stored in a non-volatile memory of the display device; and A power supply circuit is coupled to the output terminal of the controller circuit, and is configured to: receive the power control signal from the controller circuit and generate one or more power supply voltages, wherein the one or more power supply voltages have a waveform based on the power control signal.
2. The power management circuit according to claim 1, in, The controller circuit is further configured to receive display data and identify a lookup table entry based on the received display data.
3. The power management circuit according to claim 2, in, The display data is received from one of the display device or an application processor.
4. The power management circuit according to claim 2 or 3, in, The display data is one of: video data of a video frame to be displayed by the display device; a brightness level of an image to be displayed by the display device; a frame rate of the display device; a panel temperature of a display panel of the display device; or an on pixel ratio (OPR) of the image to be displayed by the display device; Optionally, wherein the OPR is determined by adding the gray level of each pixel of the image to be displayed by the display panel; Optionally, the OPR indicates a ratio between an expected brightness of a display panel during a current frame and a maximum brightness of the display panel.
5. A power management circuit according to any preceding claim, in, The power supply circuit includes a plurality of voltage regulators, each voltage regulator being configured to generate a power supply voltage having a corresponding nominal value.
6. A power management circuit according to any preceding claim, in, The controller circuit is further configured to receive one or more display control signals, and wherein the controller circuit is configured to generate the power control signal based on the received one or more display control signals.
7. The power management circuit according to claim 6, in, The one or more display control signals include at least one of: a vertical synchronization signal; and a frame rate of the display device.
8. The power management circuit according to claim 7, in, The one or more display control signals are received from one of the display device or an application processor.
9. A method, include: receiving, by a controller circuit, a set of configuration parameters from a display device, wherein the configuration parameters are determined based on at least one of values stored in a lookup table of the display device or equations stored in a non-volatile memory of the display device; generating a power control signal based at least in part on the received configuration parameters; and One or more power supply voltages are generated by a power supply circuit, the one or more power supply voltages having a waveform based on the power supply control signal.
10. The method according to claim 9, further comprising: receiving display data; and A lookup table entry is identified based on the received display data.
11. The method according to claim 10, in, The display data is received from one of the display device or an application processor.
12. The method according to claim 10 or 11, in, The display data is one of: video data of a video frame to be displayed by the display device; a brightness level of an image to be displayed by the display device; a frame rate of the display device; a panel temperature of a display panel of the display device; or an on pixel ratio (OPR) of the image to be displayed by the display device; Optionally, wherein the OPR is determined by adding the gray level of each pixel of the image to be displayed by the display panel; Optionally, the OPR indicates a ratio between an expected brightness of a display panel during a current frame and a maximum brightness of the display panel.
13. The method according to any one of claims 10 to 12, further comprising: include: One or more display control signals are received by the controller circuit, wherein the one or more display control signals include at least one of: a vertical synchronization signal; a horizontal synchronization signal; and a frame rate of the display device, and Wherein, the power control signal is also generated based on the one or more received display control signals.
14. A method, include: providing a test image for display to a display device; providing a set of power supply voltages having waveforms generated based on a power profile to the display device; Acquiring an output of a display panel of the display device; as well as In response to determining that the output of the display panel satisfies a predetermined threshold, the power profile is stored in a lookup table of the display device.
15. The method according to claim 14, further comprising: include: in response to determining that the output of the display panel does not satisfy the predetermined threshold, modifying the power profile; providing a set of power supply voltages having a second waveform generated based on the modified power profile to the display device; collecting the output of the display panel of the display device; as well as responsive to determining that the output of the display panel satisfies the predetermined threshold, storing the modified power profile in the lookup table of the display device; Optionally, the output of the display panel is one of: an image of the display panel captured by a camera; a voltage waveform at multiple detection points of the display panel; and a current waveform at the multiple detection points of the display panel.
