Motion-induced blur to reduce scintillation and the appearance of boundaries separating areas of the display
Motion-induced blur techniques adjust blur based on content speed and pixel density to reduce scintillation and boundary visibility in displays with sensors, improving user experience.
Patent Information
- Application Number
- JP2023543403
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-08
- Publication Date
- 2025-10-30
- Estimated Expiration
- 2041-03-08
AI Technical Summary
Placing sensors under the display of a computing device reduces pixel density, leading to scintillation and visible boundaries, degrading the user experience.
Implement motion-induced blur techniques that adjust blur amount based on content speed and pixel density, using smoothing filters and blur control to reduce scintillation and boundary appearance.
Improves user experience by minimizing scintillation and boundary visibility in regions with lower pixel density, enhancing display clarity and usability.
Smart Images

Figure 0007762723000001 
Figure 0007762723000002 
Figure 0007762723000003
Abstract
Description
[Background technology]
[0001] Background of the Invention Placing sensors under the display of a computing device is a desirable way to increase the size of the display because it frees up space that would otherwise be used for sensors such as cameras or infrared sensors. To enable the use of these under-display sensors, some devices have a lower pixel density in the areas of the display that have the under-display sensors. The pixel density can be lower in some areas to allow light collection by, for example, a camera located under the display. However, as content moves within the display, scintillation can occur in the areas with lower pixel density. These undesirable scintillations are often visible at the boundaries separating the display areas, thereby degrading the user experience. Therefore, it is desirable to reduce the appearance of boundaries separating the display areas and to reduce scintillation in the areas with lower pixel density. Doing so can improve the user experience. Summary of the Invention
[0002] overview This specification describes techniques and devices for motion-induced blurring to reduce scintillation and the appearance of boundaries separating regions of a display. Sensors (e.g., cameras, microphones, biometric sensors, ambient light sensors, radar sensors, etc.) can be placed at least partially below a region of a display. However, placing sensors below a region of a display often requires that the pixel density of that region be reduced (e.g., relatively lower resolution compared to other regions of the display), which can cause scintillation of content as it moves across the display. The techniques described herein address some of the undesirable effects of this lower pixel density by blurring content moving within the lower-resolution region. Furthermore, the techniques can adjust the amount of blurring based on the rate or speed of the moving content. Thus, when a display includes regions of different resolutions, the techniques described herein can blur the moving content to reduce scintillation and the appearance of boundaries separating these regions of different resolutions.
[0003] Aspects described below include motion-induced blur methods, systems, devices, and means for reducing scintillation and the appearance of boundaries separating regions of a display. The method includes receiving a first resolution for a first region of a display of a computing device. The first resolution corresponds to a first pixel density. A second resolution for a second region of the display of the computing device is also received. The second resolution corresponds to a second pixel density lower than the first pixel density. The method determines a speed at which content is being moved on the display. The moving content in the second region is blurred based on the speed of the moving content, converting the moving content into blurred moving content. The blurred moving content reduces scintillation of the moving content in the second region of the display. The appearance of the boundary separating the first and second regions of the display of the computing device is similarly reduced relative to the appearance of a boundary that maintains the moving content unblurred. Then, blurred moving content is displayed in the second area and moving content is displayed in the first area.
[0004] Apparatus and techniques for motion-induced blurring to reduce scintillation and the appearance of boundaries separating regions of a display are described with reference to the following diagrams.
[0005] The same numbers are used throughout the drawings to reference like features and components. [Brief explanation of the drawings]
[0006] [Figure 1] FIG. 10 illustrates an example implementation of a technique for motion-induced blurring of moving content in a second region of a display of a computing device. [Figure 2]FIG. 1 illustrates an exemplary implementation of motion-induced blur as part of a computing device. [Figure 3] 2 is an exemplary cross-sectional view of a display of the computing device from FIG. 1. [Figure 4] 1 is an exemplary sequence flow diagram of scintillation and motion-induced blur of moving content over time. [Figure 5] 1A-1C illustrate two exemplary techniques for speed-based motion-induced blurring of moving content. [Figure 6-1] 10A-10C illustrate exemplary tactile inputs from a user that change the size and / or position of moving content. [Figure 6-2] 10A-10C illustrate two examples of a blur module that applies motion-induced blur to moving content based on haptic speed. [Figure 7] 10 is an exemplary plot showing how the pixel intensity profile of moving content is modified by a smoothing filter. [Figure 8] FIG. 1 illustrates an exemplary computing device including a first region, a second region, and a third region of a display. [Figure 9] FIG. 10 illustrates an exemplary method for motion-induced blurring to reduce scintillation and the appearance of boundaries separating regions of a display. [Figure 10] FIG. 1 illustrates an exemplary computing system capable of implementing or enabling the use of motion-induced blurring techniques to reduce scintillation and the appearance of boundaries separating regions of a display. DETAILED DESCRIPTION OF THE INVENTION
[0007] Detailed Description overview Placing sensors on the underside of a computing device's display is becoming a desirable way to increase the size of the display used to view content. Some devices use a lower pixel density (e.g., having a lower resolution) in areas of the display that contain sensors to enable operation of these sensors. The pixel density can be lower in some areas to allow light collection by a camera, for example, for photography or video. As content moves through the display, scintillations occur in the areas with lower resolution (e.g., lower pixel density). These scintillations increase the appearance of a boundary separating the low-resolution areas from areas with higher resolution (e.g., areas that do not contain sensors). The scintillations can be distracting to a user, and the appearance of the boundary can degrade the user experience.
[0008] In contrast to the techniques described herein, some devices do not display moving content in low-resolution areas, limiting the usable size of the display. Other devices display moving content at low resolution without blurring it. These other devices allow moving content to appear pixelated, resulting in more obvious scintillation as the rate or speed of the moving content increases. Other devices may blur moving content by a fixed amount, but this blur is only appropriate for certain speeds (e.g., stationary content, slow-moving content, or fast-moving content). For example, if a mobile phone includes an area with an associated fixed amount of blur (e.g., configured for stationary content that does not move over time), and the user decides to watch an action movie on their phone, scintillation will appear as the speed of the content in the action movie increases. Users may find these scintillations distracting and miss important parts of the movie, or become frustrated and watch the movie on another device. Alternatively, a constant amount of blurring accommodates fast-moving content (e.g., action movie speed), but if a user wants to read the news (e.g., still content), the content may be blurred too much. Users may have difficulty reading news sentences and headlines that appear within the blurred areas. In this case, users would benefit from pixelated content and a smaller amount of blurring.
[0009] To address these challenges, this specification describes a motion-induced blur method that reduces scintillation and the appearance of boundaries separating regions of a display. For example, a smoothing filter with adjustable weights can be used to blur moving content within these regions. The weights can be adjusted based on the rate or speed of the moving content. As used herein, reference can be made to the speed of the moving content, where speed can include the velocity, acceleration, or rate of the moving content. The speed of the moving content can also include a speed averaged over a period of time, or the instantaneous speed of the moving content. Motion-induced blur techniques can increase the amount of blur as the speed of the moving content increases, such as a user watching an action movie. They can also decrease the amount of blur based on tactile input from a user as the speed of the content decreases, such as slowly scrolling a web page.
[0010] In some cases, the technique refrains from applying motion-induced blur in regions encompassing a resolution lower than the resolution threshold. For example, if the resolution threshold is 300 pixels per inch (ppi) and a region of the display (e.g., a region of the display that includes a sensor) displays moving content at a resolution of 200 ppi, motion-induced blur is applied to moving content in this region to improve the user experience. However, if a region (e.g., a region that does not include a sensor) displays moving content at a resolution of 400 ppi, motion-induced blur is not applied to moving content in that region.
[0011] The technology can also refrain from applying motion-induced blur when the speed of moving content is below a speed threshold (e.g., below the minimum speed required to implement motion-induced blur). By doing so, the user can view stationary content without blur, even in low-resolution areas. Thus, motion-induced blur is applied in an amount appropriate to the speed of the moving content, where it is most advantageous to the user.
[0012] Example of motion-induced blur 1 illustrates an example implementation of a technique for motion-induced blurring 102 of moving content 104 in a second region 106 of a display 108 of a computing device 110. The motion-induced blurring 102 is applied to the moving content 104 to reduce scintillation 116 and the appearance of a boundary 112-1 separating a first region 114 and a second region 106.
[0013] While the exemplary computing device 110 described herein is a mobile phone, other types of computing devices may also support the techniques described herein. The computing device 110 may include one or more processors, including, for example, a central processing unit (CPU), a data processing unit (DPU), a graphics processing unit (GPU), etc. The computing device 110 may also include a computer-readable medium (CRM) that includes instructions that, when executed by the processor, direct a blur module to apply a motion-induced blur 102 to moving content 104. The computing device 110 may also include one or more sensors disposed at least partially on the underside of the display 108.
[0014] The display 108 is configured to at least partially cover the front of the computing device 110. In the exemplary environment 100-1, at least one sensor is at least partially disposed on the underside of the display 108 in the second region 106. Generally, an individual region can include any number of sensors (e.g., zero, one, two, etc.), and the computing device 110 can include one or more regions. Furthermore, the individual regions can vary in size, shape, and location. For example, the size of the second region 106 is depicted in the exemplary environment 100-1 as being smaller than the size of the first region 114. The display 108 can also include an array of pixels configured to display the moving content 104. An individual region can include a pixel density associated with the array of pixels that is either different or similar to another region of the display 108.
[0015] In the exemplary environment 100-1, the second region 106 generates scintillation 116 as the moving content 104 moves between the first region 114 and the second region 106. The scintillation 116 is due to the low resolution of the second region 106 (e.g., lower than that of the first region 114), which is configured to enable the operation of sensors. For example, a camera can be positioned at least partially below the display 108 in the second region 106 to increase the usable size of the display 108 used to view the moving content 104. However, the camera may need to collect light through the display 108 to generate a photograph or video. Therefore, a low resolution in the second region 106 is required (e.g., fewer pixels per area in the second region 106 than in the first region 114) to prevent light blockage by pixels. If light is blocked by pixels, the camera will introduce distortion into the photograph or video, which may be frustrating to the user.
[0016] These scintillations 116 may include distortions, artifacts, and aliasing effects of the moving content 104. While the scintillations 116 described herein refer exclusively to content moving on the display 108, these distortions, artifacts, and aliasing effects may also affect stationary content. This stationary content can also be blurred using some of the techniques described herein (e.g., smoothing filters with weights). For example, a still image of a scene can be blurred to reduce aliasing effects. Then, when the still image is moved across the display 108 by haptic input from the user, further motion-induced blur 102 techniques can be applied to the scene image as it moves across the display 108.
[0017] To reduce scintillation 116 and the appearance of a boundary 112-1 separating first region 114 and second region 106, a motion-induced blur 102 technique is implemented on moving content 104 within second region 106, as depicted in example environment 100-2. Moving content 104 refers to content received or stored on computing device 110 that moves over time on display 108. For example, moving content 104 may include multiple images that are successively received from a content source by computing device 110 over time before being displayed successively on display 108. The content of these successive images changes over time, resulting in the movement of the content.
[0018] The motion-induced blur 102 technique may utilize bilateral filters, smoothing techniques, Gaussian blurring, nonlinear filters, wavelet transforms, statistical methods, block matching algorithms, machine learning (ML) models, etc., each of which may include one or more weights configured to increase or decrease the amount of motion-induced blur 102 applied to moving content 104. Implementations of the motion-induced blur 102 technique are further described in connection with FIG.
[0019] 2 illustrates an exemplary implementation of the motion-induced blur 102 technology as part of a computing device 110. The computing device 110 is shown with various non-limiting exemplary devices, including a desktop computer 202-1, a tablet 202-2, a laptop 202-3, a television 202-4, a computing watch 202-5, computing glasses 202-6, a gaming system 202-7, a microwave 202-8, and a vehicle 202-9. Other devices may also be used, including a home service device, a smart speaker, a smart thermostat, a security camera, a baby monitor, a Wi-Fi router, a drone, a trackpad, a drawing pad, a netbook, an e-reader, a home automation and control system, a wall display, a virtual reality headset, and / or another home appliance. The computing device 110 may be wearable, non-wearable but mobile, or relatively stationary (e.g., desktop and household appliances).
[0020] The computing device 110 includes one or more processors 204 and one or more computer-readable media (CRM) 206. Applications and / or an operating system (not shown) embodied on the CRM 206 as computer-readable instructions are executed by the processor 204 to provide some of the functionality described herein. The CRM 206 also includes a tactile detection module 212 and a motion detection module 214. The tactile detection module 212 and the motion detection module 214 may be implemented using hardware, software, firmware, or a combination thereof. In this example, the processor 204 implements the tactile detection module 212 and the motion detection module 214. The tactile detection module 212 and the motion detection module 214 combine to enable the processor 204 to process responses (e.g., inputs, electrical signals) from, for example, the display 108 and the touch sensor 218 to blur moving content 104, reduce scintillation 116, and reduce the appearance of boundaries 112-1 separating regions of the display 108.
[0021] A user can use tactile input (e.g., touch, swipe, scroll, tap) to move or change content on the display 108. To detect tactile input, the computing device 110 can include a touch sensor 218 that receives input from the user and changes the size and / or position of the moving content 104. The touch sensor 218 can include capacitive touch sensors, resistive touch sensors, surface acoustic wave (SAW) technology, infrared touch sensors, etc. For example, the tactile detection module 212 can detect tactile input from the user and the associated tactile speed that affects the speed of the moving content 104. The tactile detection module 212 can signal the processor 204 to perform the motion-induced blur 102 technique based on the tactile speed. Alternatively, the tactile speed can be detected by the operating system, the processor 204, etc.
[0022] In another example, in the absence of haptic input, a speed associated with moving content 104 can be determined by motion detection module 214. Motion detection module 214 detects changes in moving content 104 over time and / or source speed from the content source to determine the speed of moving content 104. Motion detection module 214 signals processor 204 to perform motion-induced blur 102 techniques based on the speed. Alternatively, speed can be detected by the operating system, processor 204, etc.
[0023] CRM 206 further includes a blur module 208 configured to receive inputs from tactile detection module 212, motion detection module 214, operating system, processor 204, touch sensor 218, etc. These inputs may include the speed of the moving content 104, tactile speed, source speed, refresh speed, minimum speed threshold, maximum speed threshold, resolution threshold, region resolution, etc. Blur module 208 uses these inputs to determine whether to apply motion-induced blur 102 to the moving content 104, how much blur is needed, and signals processor 204 to apply motion-induced blur 102 to the moving content 104.
[0024] The blur module 208 includes the moving content 104 and a blur control 210. Typically, the moving content 104 can be separate from the blur module 208. The blur control 210 is configured to control the amount of motion-induced blur 102 applied to the moving content 104. The blur control 210 uses the speed of the moving content 104 to determine a weighting value or function necessary to adjust the amount of motion-induced blur 102 applied to the moving content 104. The blur control 210 adjusts the weighting value to increase or decrease the amount of motion-induced blur 102. The motion-induced blur 102 can include smoothing the moving content 104, reducing intensities associated with features (e.g., details) of the moving content 104, averaging pixel intensities of the moving content 104 based on neighboring pixel intensities, etc.
[0025] The computing device 110 includes one or more sensors 216 located at least partially under the display 108. The sensors 216 can be located in any area, and the resolution (e.g., pixel density) associated with the area containing the sensors 216 can have a lower pixel density to allow for operation of the sensors 216. While the use of sensors located under the display often results in one portion of the display having a lower resolution than another portion, the techniques described herein can be used with any display having varying resolution, and an under-display sensor is not required for the techniques to be used. Techniques for motion-induced blur 102 are further described in connection with FIG. 3.
[0026] Figure 3 illustrates an exemplary cross-sectional view of the display 108 of the computing device 110 from Figure 1. The display 108 is depicted with a transparent layer 302 (e.g., comprising a transparent material such as plastic or glass) disposed above a pixel layer 304 (e.g., comprising an array of pixels).
[0027] Typically, display 108 may include an active area, one or more organic layers (e.g., an emissive layer, an emissive layer, an array of organic light emitting diodes), a cathode, an anode, etc. Display 108 may further include an active matrix organic light emitting diode (AMOLED) display, an organic light emitting diode (OLED) display module, a light emitting diode (LED) display module, a liquid crystal display (LCD) display module, a microLED display module, display technologies using individually controllable pixels, thin film technology display modules, etc.
[0028] In the example environment 300, the first region 114 does not include a sensor, and the second region 106 includes a sensor 216 disposed at least partially on the underside of the display 108 and at least partially within the second region 106. The sensors 216 may include, for example, a camera, a microphone, a speaker, an ambient light sensor, a biometric sensor, an accelerometer, a gyroscope, a magnetometer, a proximity sensor, a global positioning system (GPS), a touchscreen sensor, a health sensor, a barcode or quick response (QR) code sensor, a barometer, a radar sensor, etc.
[0029] The first region 114 includes a first pixel density 306, and the second region 106 includes a second pixel density 308. To facilitate operation of the sensor 216, the second pixel density 308 is lower (e.g., fewer pixels per area) than the first pixel density 306. The first pixel density 306 is associated with a first resolution, and the second pixel density 308 is associated with a second resolution, which is lower than the first resolution. For purposes of enabling discussion herein, the second resolution includes a lower resolution, and the second pixel density 308 includes a lower pixel density, when compared to the first resolution and the first pixel density 306, respectively.
[0030] The pixel layer 304, including the first pixel density 306 and the second pixel density 308, includes color pixels (e.g., red, green, and blue (RGB) pixels). These color pixels allow the moving content 104 to be viewed in color on the display 108. The lower-resolution regions include a lower density of color pixels (e.g., fewer color pixels per area relative to other higher-resolution regions). In the second region 106, the second resolution includes a lower resolution to enable the operation of the sensor 216. The lower density of color pixels makes color defects (e.g., scintillation 116, color distortion) more apparent to a user. For example, the low resolution of the second region 106 can cause color defects in action movies. Color defects associated with a moving car or a person's face can be perceived by a user because the user has an expectation of how a moving car or a person's face should look. To reduce these color defects, the blur module 208 applies a motion-induced blur 102 in the second region 106 to blur the action movie and improve the user experience.
[0031] The computing device 110 can refrain from instructing the processor to apply the motion-induced blur 102 to the moving content 104 unless the resolution of the region is lower than a resolution threshold. The resolution threshold includes a minimum resolution corresponding to the minimum pixel density required to apply the motion-induced blur 102 to the moving content 104. If the pixels per area of the region are less than a specified amount of pixels per area, corresponding to the minimum resolution, the blur module 208 signals the processor to apply the motion-induced blur 102. For example, the first resolution is high (e.g., the pixels per area are greater than the specified amount of pixels per area), allowing the moving content 104 to be displayed without scintillation 116. In this example, there is no need to apply the motion-induced blur 102 to the first region 114, and the moving content 104 is displayed normally.
[0032] However, if the second resolution is lower (e.g., pixels per area less than a specified amount of pixels per area) and causes scintillation 116 of the moving content 104, then motion-induced blur 102 will be applied in the second region 106. In one example, if the resolution threshold is 250 pixels per inch (ppi) and the second resolution is 200 ppi, the blur module 208 signals the processor to apply the motion-induced blur 102 in the second region 106. If the first resolution is 300 ppi, the blur module 208 refrains from applying the motion-induced blur 102 in the first region 114.
[0033] Before the moving content 104 is displayed on the computing device 110, it may be necessary to resample the moving content 104 to match the first and second resolutions. The moving content 104 may be provided to the computing device 110 by a content source (e.g., a web page, a receiver, stored content, an application, etc.) at a resolution (e.g., a source resolution) set by the content source. The blur module 208 receives the source resolution and compares it against the first and second resolutions.
[0034] If the first resolution is different from the source resolution, the moving content 104 is resampled to match the first resolution in the first region 114. For example, if the source resolution is 400 ppi and the first resolution is 300 ppi, the moving content 104 is resampled from 400 ppi to 300 ppi. Resampling may include mathematical calculations or assumptions about how to change the source resolution to match the first resolution. Similarly, if the second resolution is different from the source resolution, the moving content 104 is resampled to match the second resolution in the second region 106. The moving content 104 may be resampled either before or after the motion-induced blur 102 is applied to the moving content 104.
[0035] 4 illustrates an exemplary sequence flow diagram of scintillation 116 and motion-induced blur 102 of moving content 104 over time 402. Moving content 104 moves from a first region 114 to a second region 106 across boundary 112-1 over time 402 from left to right. In example environments 400-1, 400-2, and 400-3, moving content 104 appears pixelated, causing scintillation 116 in the second region 106 due to the speed of the moving content 104 and the second resolution being below a resolution threshold. To reduce these scintillations 116 in the second region 106, the blur module 208 signals the processor to apply a motion-induced blur 102 to the moving content 104 prior to display (e.g., to display individual successive images over time 402), as depicted in example environments 400-4, 400-5, and 400-6. In this example, because the first resolution is above the resolution threshold, the blur module 208 refrains from signaling the processor to apply a motion-induced blur 102 to the moving content 104 in the first region 114.
[0036] To apply the motion-induced blur 102, the blur module 208 first detects the speed of the moving content 104. Speed refers to the speed at which the content will change or move when subsequently displayed on the display 108 of the computing device 110. For example, in Figure 4, the speed correlates to the changing position of the moving content 104 over time 402 (e.g., 400-1, 400-2, and 400-3). The moving content 104 is moving upward on the display 108 due to the content's inherent speed.
[0037] The blur module 208 can refrain from signaling the processor to apply the motion-induced blur 102 unless the speed of the moving content 104 exceeds a minimum speed threshold (e.g., the minimum speed required to apply the motion-induced blur 102). Furthermore, the minimum speed threshold corresponds to the minimum speed of the moving content 104 required for the scintillation 116 to be apparent to a user. For example, the scintillation 116 is not apparent when the moving content 104 is stationary. Reference may be made herein to a minimum speed threshold, which can also include a minimum rate (e.g., change measured over time), minimum velocity, and minimum acceleration required to apply the motion-induced blur 102. The minimum speed threshold can also include the instantaneous speed, velocity, acceleration, and rate of the moving content, as well as the speed, velocity, acceleration, and rate averaged over a certain duration of time. However, the scintillation 116 becomes apparent as the speed of the moving content 104 increases (e.g., in an action movie).
[0038] In another example, the minimum speed threshold is based on a rate of 10 Hertz (Hz), and the moving content 104 changes within the second region 106 at a rate of 9 Hz. The blur module 208 receives this speed input of 9 Hz and compares it against the minimum speed threshold of 10 Hz. Because this speed is slower than the minimum speed threshold, the blur module 208 refrains from signaling the processor to blur the moving content 104 and instead signals the processor to display the moving content 104 normally (e.g., without applying motion-induced blur 102). The minimum speed threshold prevents slowly moving content (e.g., content moving at a speed below the minimum speed threshold) and stationary content from being blurred. In these situations, a user may prefer pixelated content over blurred content. Instead, if the speed of the moving content 104 is 11 Hz, the blur module 208 receives this speed input of 11 Hz and compares it against the minimum speed threshold of 10 Hz. Because this speed of 11 Hz is greater than the minimum speed threshold, motion-induced blur 102 is applied to the moving content 104 within the second region 106. The amount of motion-induced blur 102 applied to the moving content 104 can be adjusted based on speed using blur control 210, as further described in FIG. 5 .
[0039] 5 illustrates two exemplary techniques for motion-induced blur 102 of moving content 104 based on speed. If the speed is greater than a minimum speed threshold, blur control 210 can be used to blur the moving content 104 by an amount associated with the speed. As the speed of the moving content 104 increases, a greater amount of motion-induced blur 102 can be applied to the moving content 104 to reduce scintillation 116 and the appearance of the boundary 112-1 separating the first region 114 and the second region 106. Similarly, as the speed of the moving content 104 decreases, a lesser amount of motion-induced blur 102 can be applied to the moving content 104.
[0040] 5, moving content 104 moves upward within display 108 over time 402, from first region 114 to second region 106, across boundary 112-1. Example environments 500-1, 500-2, and 500-3 depict a first speed 502, and example environments 500-4, 500-5, and 500-6 depict a second speed 504. First speed 502 is depicted as being slower than second speed 504. Thus, moving content 104 in example environments 500-1, 500-2, and 500-3 is less blurred than moving content 104 in example environments 500-4, 500-5, and 500-6. The amount of motion-induced blur 102 applied to moving content 104 can be linearly or non-linearly correlated to the speed of the moving content 104. For example, the amount of blur can be proportionally related to speed, including an optional offset. Alternatively, the amount of blur can be related to speed using a non-linear function, operation, or set of operations.
[0041] The blur control 210 can fix the amount of motion-induced blur 102 to a fixed amount (e.g., a static value) when the speed increases beyond a maximum speed threshold (e.g., the maximum speed allowed by the blur module 208). When the blur module 208 receives an input of the speed of the moving content 104 and determines that the speed is greater than the maximum speed threshold, a fixed amount of motion-induced blur 102 is applied to the moving content 104. Reference may be made herein to a maximum speed threshold, which may also include a maximum rate (e.g., measured change over time), maximum velocity, and maximum acceleration allowed by the blur module 208. The maximum speed threshold may also include the instantaneous speed, velocity, acceleration, and rate of the moving content, as well as the speed, velocity, acceleration, and rate averaged over a certain duration of time. For example, if the maximum speed threshold is set based on a 50 Hz rate and the moving content 104 includes a speed (e.g., displayed rate) of 60 Hz, the amount of motion-induced blur 102 applied will be held constant at the constant amount associated with the 50 Hz maximum speed threshold. In this example, if the speed increases above 60 Hz or decreases below 60 Hz but remains above 50 Hz, the amount of motion-induced blur 102 applied to the moving content 104 will remain constant.
[0042] The moving content 104 includes multiple images sequentially received by the computing device 110 over time 402 before being sequentially displayed on the display 108. For example, environments 500-1, 500-2, and 500-3 represent three sequential images of the moving content 104. The content source may configure the sequential images to be displayed at a particular speed (e.g., source speed). Source speed may be referred to herein, and source speed may also include source rate (e.g., change measured over time), source velocity, and source acceleration. Source speed may also include instantaneous speed, velocity, acceleration, and rate configured by the content source, as well as speed, velocity, acceleration, and rate averaged over a period of time.
[0043] The speed of the moving content 104 can be received by the blur module 208 based on changes occurring between successive images received from the content source. These changes can include, for example, changes in the color, position, or size of the moving content 104 based on the source speed. The blur control 210 can vary the amount of motion-induced blur 102 applied to the moving content 104 based on the speed. If the moving content 104 changes more frequently, the amount of blur can be increased. If the moving content 104 changes less frequently, the amount of blur can be decreased.
[0044] In an example, if a user is watching a video on display 108 depicting a slowly changing scene (e.g., that changes less frequently over time 402), a lesser amount of motion-induced blur 102 may be applied to accommodate the slower speed (e.g., less change) associated with the scene. However, if the video later features a high-speed car chase that changes quickly (e.g., that occurs more frequently over time 402), a greater amount of motion-induced blur 102 may be applied to accommodate the faster speed (e.g., more change) associated with the high-speed car chase.
[0045] The speed of the moving content 104 can be further correlated with the source speed configured by the content source. A faster source speed can increase the speed and the amount of motion-induced blur 102 applied to the moving content 104, resulting in less scintillation 116. A slower source speed can decrease the speed and the amount of motion-induced blur 102 applied. Additional techniques for determining the speed of the moving content 104 are further discussed in connection with FIGS. 6-1 and 6-2. Any of the techniques described herein, and in any combination, can be used to determine whether motion-induced blur 102 is needed in an area to improve the user experience.
[0046] FIG. 6-1 illustrates an exemplary tactile input 602 from a user 604 that changes the size and / or position of the moving content 104. The tactile input 602 is performed by the user 604 making contact 606 with the display 108. The contact 606 may include a touch using one or more fingers of the user 604, a swipe, a pinch, a flick, a tap, a scroll, etc. In the exemplary environments 600-1 and 600-2, the moving content 104 is enlarged on the display 108 using the contact 606 (e.g., a pinch touch) of the user 604. The computing device 110 may include a touch sensor 218 (e.g., a capacitive touch sensor, a resistive touch sensor, surface acoustic wave (SAW) technology, an infrared touch sensor, etc.) configured to detect the tactile input 602.
[0047] A speed (e.g., haptic speed) associated with the contact 606 of the haptic input 602 can be received by the blur module 208. The haptic speed of the haptic input 602 can affect the amount of motion-induced blur 102 applied to the moving content 104, as depicted in FIG. 6-2. A faster haptic speed can increase the speed of the moving content 104 and increase the amount of motion-induced blur 102 applied to the moving content 104. A slower haptic speed can decrease the speed of the moving content 104 and decrease the amount of motion-induced blur 102 applied. Haptic speed may be referred to herein, and haptic speed may also include haptic rate (e.g., the change due to the haptic input 602, measured over time), haptic velocity, and haptic acceleration. Haptic speed can also include the instantaneous speed, velocity, acceleration and rate of the haptic input 602, as well as the speed, velocity, acceleration and rate averaged over a period of time.
[0048] FIG. 6-2 illustrates two examples of the blur module 208 signaling the processor to apply motion-induced blur 102 to moving content 104 based on haptic speed. In these examples, a user 604 uses a pinch touch to resize (e.g., enlarge) the moving content 104 at different haptic speeds. A first haptic speed 608 associated with example environments 600-3, 600-4, and 600-5 is slower than a second haptic speed 610 associated with example environments 600-6, 600-7, and 600-8. Because the second haptic speed 610 is faster than the first haptic speed 608, a greater amount of motion-induced blur 102 is applied to example environments 600-6, 600-7, and 600-8 than to example environments 600-3, 600-4, and 600-5.
[0049] The blur module 208 may further receive a refresh speed that sets a limit on how quickly successive images of the moving content 104 can be displayed. In this instance, a maximum speed threshold may be set to the refresh speed. Reference may be made herein to refresh speed, which may also include refresh rate (e.g., change measured over time), refresh speed, and refresh acceleration. Refresh speed may also include the instantaneous speed, speed, acceleration, and rate at which content is refreshed, as well as the speed, speed, acceleration, and rate averaged over a period of time.
[0050] For example, if the refresh speed is based on a 90 Hz rate, the maximum speed threshold is set to 90 Hz. If the haptic speed is based on a 120 Hz rate (e.g., for fast swipe input or fast scroll input), the amount of motion-induced blur 102 applied to moving content 104 can be fixed to a constant amount associated with 90 Hz by blur control 210. If the source speed is based on a 100 Hz rate (e.g., for high-speed video), the amount of motion-induced blur 102 applied to moving content 104 can again be fixed to a constant amount associated with 90 Hz by blur control 210.
[0051] The blur control 210 may further include a smoothing filter. For example, the smoothing filter may include a bilateral filter (e.g., a nonlinear filter) used to smooth the contours of the moving content 104. In this example, the bilateral filter may replace pixel intensities associated with different pixels in the pixel layer 304 with an average of neighboring pixel intensities. The smoothing filter may also include Gaussian blurring, nonlinear filters, wavelet transforms, statistical methods, block matching algorithms, etc. The smoothing filter may utilize, for example, an ML model to adjust the blur control 210 based on the history of the moving content 104, thereby improving the user experience.
[0052] 7 shows an exemplary plot of how a pixel intensity 702 profile of moving content 104 is modified by a smoothing filter. In this example, the pixel intensities 702 associated with the moving content 104 vary over a distance 704 (e.g., across the second region 106 of the display 108). The pixel intensities 702 of the moving content 104 appear more chaotic and less smooth over the distance 704 due to scintillation 116.
[0053] The smoothing filter may use weights to smooth (e.g., average) the pixel intensities 702 of the moving content 104. The weights may represent values or functions that change depending on the speed of the moving content 104. As the speed increases, the weight values or functions change to apply a greater amount of motion-induced blur 102 to the moving content 104. As the speed decreases, the weight values or functions change to apply a lesser amount of motion-induced blur 102.
[0054] In the exemplary plot 700, two different smoothing filters 706-1 and 706-2 are applied to the moving content 104. The smoothing filter 706-2 uses different weights than the smoothing filter 706-1 to increase the amount of motion-induced blur 102 applied to the moving content 104. The pixel intensities 702 associated with the smoothing filter 706-2 are smoother over the distance 704, representing increased averaging of nearby pixel intensities (e.g., over a longer distance 704) than the smoothing filter 706-1. Further variations in the motion-induced blur 102 technique are described in connection with FIG. 8 .
[0055] 8 illustrates an exemplary computing device 110 including a first region 114, a second region 106, and a third region 802 of a display 108. The third region 802 includes a third resolution (e.g., a third pixel density) that is either different from or similar to another region. The third region 802 may also include one or more sensors 216 located at least partially on the underside of the display 108 and within the third region 802. The size, shape, and location of the third region 802 may vary within the display 108.
[0056] Similar to the technique implemented in the second region 106, the blur module 208 can signal the processor to apply a motion-induced blur 102 in the third region 802 based on the speed of the moving content 104 to reduce scintillation of the moving content 104 in the third region 802 and to reduce the appearance of the boundary 112-2 separating the third region 802 from the first region 114, relative to the appearance of the boundary 112-2 when the blur module 208 refrains from signaling the processor to blur the moving content 104. The blur module 208 can also be used to reduce the appearance of the boundary 112-2 (not depicted) separating the third region 802 from the second region 106. The speed of the moving content 104 in the third region 802 can be different or similar to its speed in the second region 106 and the first region 114. Additionally, the amount of blur in the third region 802 may be different or similar to any other region of the display 108 .
[0057] Exemplary Methods FIG. 9 illustrates an exemplary method 900 for motion-induced blurring to reduce scintillation and the appearance of boundaries separating regions of a display. Method 900 is illustrated as a set of operations (or acts) performed, the order or combination of which is not necessarily limited to that shown herein. Furthermore, any one or more of these operations may be repeated, combined, rearranged, or linked to provide a wide array of additional and / or alternative methods. While some of the following discussion may refer to the environments and entities detailed in FIGS. 1-8, reference to these environments and entities is made by way of example only. The techniques are not limited to implementation by one entity or multiple entities operating on one computing device 110.
[0058] At 902, a first resolution of a first region of a display of a computing device is received, the first resolution corresponding to a first pixel density. For example, the blur module 208 receives a first resolution of a first region 114 of the display 108, the first resolution corresponding to a first pixel density 306, as shown in Figures 1, 3, and 8. The size, shape, and location of the first region 114 may vary.
[0059] At 904, a second resolution for a second region of a display of the computing device is received. The second resolution corresponds to a second pixel density, the second pixel density being lower than the first pixel density. For example, the blur module 208 receives a second resolution for a second region 106 of the display 108. The second resolution corresponds to a second pixel density 308, which is lower than the first pixel density 306.
[0060] At 906, the speed at which the moving content is being moved through the display is determined. For example, the speed at which the moving content is being moved through the display 108 is received by the blur module 208 as shown in FIG.
[0061] At 908, the moving content is blurred in the second region based on the speed of the moving content to convert the moving content into blurred moving content. The blurred moving content is configured to reduce scintillation of the moving content in the second region and to reduce the appearance of a boundary with the moving content, relative to the appearance of a boundary separating the first and second regions of the display of the computing device. For example, the moving content 104 in the second region 106 is blurred by applying a motion-induced blur 102 to the moving content 104 as shown in FIGS. 1 and 4 using the blur module 208 to convert the moving content 104 into blurred moving content. The motion-induced blur 102 is applied to the moving content 104 based on speed to generate the blurred moving content as shown in FIGS. 5 and 6-2. The scintillation 116 of the moving content 104 is smaller in the second region 106. The boundary 112-1 separating the first region 114 and the second region 106 of the display 108 of the computing device 110 appears less apparent relative to the appearance of the boundary 112-1 when the blur module 208 refrains from signaling the processor to blur and instead signals the processor to display the moving content 104 normally.
[0062] At 910, the blurred moving content is displayed in a second region, such as moving content 104, with motion-induced blur 102 applied, as shown in environment 100-2 of FIG.
[0063] At 912, moving content is displayed within the first region, such as moving content 104, displayed within first region 114 without motion-induced blur 102 applied, as shown in environment 100-1 of FIG.
[0064] Exemplary Computing System 10 illustrates an example computing system 1000 that may implement techniques that embody or enable the use of motion-induced blur 102 techniques to reduce scintillation 116 and the appearance of boundaries 112-1 (or 112-2) separating regions of display 108. Exemplary computing system 1000 may be implemented as any type of client, server, and / or computing device described with reference to FIG.
[0065] The computing system 1000 can include device data 1002 (e.g., received data, data being received, data scheduled for broadcast, or data packets of data), a blur module 208, and one or more sensors 216. The device data 1002 or other device content can include configuration settings for the device, media content stored on the device, and / or information associated with a user 604 of the device. The media content stored on the computing system 1000 can include any type of audio, video, and / or image data. The computing system 1000 can include one or more data inputs 1004 that can receive any type of data, media content, and / or input, including contacts 606 associated with haptic input 602, user-selectable input (explicit or implicit), messages, music, television media content, recorded video content, and any other type of audio, video, and / or image data received from any content and / or data source.
[0066] Computing system 1000 may also include a communication interface 1006, which may be implemented as any one or more of a serial and / or parallel interface, a wireless interface, any type of network interface, a modem, and any other type of communication interface. Communication interface 1006 provides a connection and / or communication link between computing system 1000 and a communication network through which other electronic, computing, and communication devices communicate data with computing system 1000.
[0067] The computing system 1000 may include one or more processors 1008 (e.g., any of a microprocessor, controller, etc.) that can process various computer-executable instructions to control the operation of the computing system 1000 and enable techniques for or embody the motion-induced blur 102. Alternatively or additionally, the computing system 1000 may be implemented using any one or combination of hardware, firmware, or fixed logic circuitry implemented in association with processing and control circuitry collectively identified at 1010. Although not shown in the figures, the computing system 1000 may include a system bus or data transfer system that couples various components within the device. The system bus may include any one or combination of several different bus structures, including a memory bus or memory controller, a peripheral bus, a universal serial bus, and / or a processor or local bus utilizing any of a variety of bus architectures.
[0068] Computing system 1000 further includes computer-readable media 1012 including one or more memory devices that enable persistent and / or non-transitory data storage (i.e., as opposed to mere signal transmission), examples of which include random access memory (RAM), non-volatile memory (e.g., any one or more of read-only memory (ROM), flash memory, EPROM, EEPROM, etc.), and disk storage devices. The disk storage devices may be implemented as any type of magnetic or optical storage device, including hard disk drives, recordable and / or rewritable compact discs (CDs), any type of digital versatile disc (DVD), etc. Computing system 1000 may also include a mass storage media device (storage medium) 1014.
[0069] The computer-readable medium 1012 provides a data storage mechanism for storing device data 1002, as well as various device applications 1016 and any other type of information and / or data related to operational aspects of the computing system 1000. For example, the operating system 1018 is maintained as a computer application with the computer-readable medium 1012 and executes on the processor 1008. The device applications 1016 may include a device manager including any form of control application, software application, signal processing and control module, code specific to a particular device, a hardware abstraction layer for a particular device, etc. The computing system 1000 may use a blur module 208 to reduce the scintillation 116 of moving content 104 and the appearance of a boundary 112-1 (or 112-2) separating regions of the display 108 of the computing device 110.
[0070] conclusion Although techniques and apparatus for reducing scintillation and the appearance of boundaries separating regions of a display have been described above in language specific to features and / or methods, it should be understood that the subject matter of the appended claims is not necessarily limited to the particular features or methods described. Rather, these particular features or methods are disclosed as example implementations of motion-induced blur that can reduce scintillation and the appearance of boundaries separating regions of a display.
[0071] Some examples are described below. Example 1: A method for motion-induced blurring includes receiving a first resolution for a first region of a display of a computing device. The first resolution corresponds to a first pixel density. The method further includes receiving a second resolution for a second region of the display of the computing device. The second resolution corresponds to a second pixel density lower than the first pixel density. The method further includes determining a speed at which content moves through the display. The moving content moves within the second region at the speed. The method further includes blurring the moving content in the second region based on the speed. The blurring is configured to convert the moving content into blurred moving content, which reduces scintillation of the moving content in the second region and reduces the appearance of a boundary with the moving content separating the first and second regions of the display of the computing device. The method further includes displaying the blurred moving content in the second region and displaying the moving content in the first region.
[0072] Example 2: The method of Example 1 for motion-induced blurring of moving content on a display further includes receiving a source resolution of the moving content configured by a content source. The content source provides the moving content to the display. The method further includes comparing the source resolution and a first resolution, and, in response to the source resolution being different from the first resolution, resampling the moving content in the first region based on the first resolution before displaying the moving content in the first region. The resampling is configured to change the moving content from the source resolution to the first resolution. The method further includes comparing the source resolution and a second resolution, and, in response to the source resolution being different from the second resolution, resampling the blurred moving content in the second region based on the second resolution before displaying the blurred moving content in the second region. The resampling is further configured to change the blurred moving content from the source resolution to the second resolution.
[0073] Example 3: The method of Example 1 or 2, wherein the method for motion-induced blurring of moving content further includes comparing the second resolution to a resolution threshold. The resolution threshold includes a minimum resolution necessary to prevent scintillation of the moving content, the minimum resolution including a minimum pixel density. The method further includes blurring the moving content in the second region in response to the second resolution being lower than the resolution threshold, comparing the first resolution to the resolution threshold, and displaying the moving content in the first region in response to the first resolution being higher than the resolution threshold.
[0074] Example 4: The method of example 3, wherein the first resolution of the first region of the display is greater than the resolution threshold and the second resolution of the second region of the display is less than the resolution threshold.
[0075] Example 5: The method of Example 3, wherein the method for motion-induced blurring of moving content further includes determining that the second resolution is lower than a resolution threshold and comparing a speed of the moving content in the second region against a minimum speed threshold. The minimum speed threshold corresponds to a required minimum speed of the moving content for scintillation. The method further includes, in response to determining that the speed of the moving content in the second region is higher than the minimum speed threshold, blurring the moving content in the second region, displaying the blurred moving content in the second region of the display, and, in response to determining that the speed of the moving content in the second region is lower than the minimum speed threshold, displaying the moving content in the second region of the display.
[0076] Example 6: The method of example 5, wherein the method for motion-induced blurring of moving content includes determining that a speed of the moving content in a second region of the display is greater than a minimum speed threshold and blurring the moving content in the second region, wherein blurring the moving content further includes increasing the amount of blurring as the speed of the moving content increases and decreasing the amount of blurring as the speed of the moving content decreases.
[0077] Example 7: The method of Example 6, wherein the amount of blur of the moving content can include one or more of: a linear correlation between the amount of blur and the speed of the moving content, where an increase in speed corresponds to a linear increase in the amount of blur; and a non-linear correlation between the amount of blur and the speed of the moving content, where an increase in speed corresponds to a non-linear increase in the amount of blur.
[0078] Example 8: The method of Example 6, wherein the method for motion-induced blurring of moving content further includes comparing a speed of the moving content within the second region against a maximum speed threshold. The maximum speed threshold corresponds to a maximum speed of the moving content allowed to be displayed on the computing device. The method further includes blurring the moving content by a fixed amount of blur in response to detecting a speed that exceeds the maximum speed threshold. The fixed amount of blur is configured to and maintained at a static value as the speed increases and decreases above the maximum speed threshold.
[0079] Example 9: The method of any preceding example, wherein determining a speed of the moving content includes receiving a source speed of the moving content. The moving content includes a plurality of images successively received on the computing device over time, and the source speed corresponds to a speed of the successively received images configured by the content source over time. Determining the speed further includes detecting a change in the moving content between successively received images based on the source speed. The change in content includes one or more of a change in color of the moving content, a change in position of the moving content, or a change in size of the moving content at any different location of the moving content. Determining the speed further includes detecting an increase in speed when the change in the moving content increases between successively received images, and detecting a decrease in speed when the change in the moving content decreases between successively received images.
[0080] Example 10: The method of example 9, wherein the speed of the moving content is set by a source speed configured by the content source, where a faster source speed increases the speed of the moving content and a slower source speed decreases the speed of the moving content, and where a faster source speed increases the amount of blur and a slower source speed decreases the amount of blur.
[0081] Example 11: The method of any preceding example, wherein determining a speed of the moving content further includes receiving a tactile input on a display of the computing device. The tactile input is performed by a user contacting the display, the contact being made on the display to change a size or position of the moving content. Determining the speed further includes detecting a tactile speed associated with the tactile input, detecting an increase in the speed of the moving content when the tactile speed increases, and detecting a decrease in the speed of the moving content when the tactile speed decreases.
[0082] Example 12: The method of Examples 8-11 for motion-induced blurring of moving content on a display further includes detecting a refresh speed of the display, the refresh speed comprising a maximum refresh speed. The method further includes sequentially displaying a plurality of images of the moving content and a plurality of images of the blurred moving content on the display based on the maximum refresh speed, and setting a maximum speed threshold to the refresh speed. The maximum speed threshold is further configured to enable blurring of the moving content in the second region by a fixed blur amount in response to detecting one or more of the haptic speed being faster than the refresh speed or the source speed being faster than the refresh speed.
[0083] Example 13: The method of any preceding example, wherein the display comprises a pixel layer. The pixel layer includes a first pixel density, a second pixel density, and color pixels configured to display the moving content in color. The density of the color pixels is correlated with a resolution of the region of the display, and color defects are associated with the density of the color pixels, the color defects including color distortion and scintillation of the moving content. The color defects are configured to increase the appearance of scintillation in the second region and the appearance of a boundary separating the first region and the second region. In response to determining that the second resolution is below a resolution threshold and that the density of the color pixels is below a minimum pixel density, the method blurs the moving content in the second region to reduce the color defects.
[0084] Example 14: The method of any preceding example, wherein the display further comprises an array of pixels configured to display the moving content. The array of pixels includes a pixel intensity for each pixel of the array. The blurring of the moving content in a second region of the display further comprises a smoothing filter. The smoothing filter is configured to replace the pixel intensity for each pixel with an average of pixel intensities of neighboring pixels in the second region to blur the moving content.
[0085] Example 15: The method of example 14, wherein the smoothing filter further comprises weights that are correlated with a speed of the moving content and configured to increase the amount of blurring for faster speeds and decrease the amount of blurring for slower speeds.
[0086] Example 16: A method as described in any of the preceding examples, wherein a processor of the computing device is configured to blur moving content in the second region, and the processor comprises one or more of a central processing unit (CPU), a data processing unit (DPU), or a graphics processing unit (GPU).
[0087] Example 17: A method for motion-induced blurring of moving content further includes receiving a third resolution of a third region of a display of a computing device. The third resolution corresponds to a third pixel density, the third pixel density being lower than the first pixel density. The method further includes determining a speed at which the content moves through the display. The moving content moves within the third region at the speed. The method further includes blurring the moving content within the third region based on the speed. The blurring is configured to convert the moving content into blurred moving content, which reduces scintillation within the third region and reduces the appearance of a boundary with the moving content separating the first and third regions of the display of the computing device. The method further includes displaying the blurred moving content within the third region.
[0088] Example 18: The method of Example 17, wherein the method for motion-induced blurring of moving content further includes displaying the blurred moving content within the second region and the third region to reduce the appearance of a boundary separating the second region and the third region of the display of the computing device.
[0089] Example 19: A computing device comprising: at least one processor; and a display comprising an array of pixels. The display is configured such that the array of pixels allows moving content to be viewed on the display. The computing device further comprises a computer-readable storage medium comprising instructions, responsive to execution by the processor, for directing the computing device to perform any one of the methods described in Examples 1-18 using the display.
[0090] Example 20: The computing device of Example 19, further comprising one or more of the first sensor or the second sensor. The first sensor is disposed at least partially below a second region of the display, the second region including a second pixel density lower than a minimum pixel density, the minimum pixel density corresponding to a resolution threshold, the second pixel density configured to enable operation of the first sensor. The second sensor is disposed at least partially below a third region of the display, the third region including a third pixel density lower than the minimum pixel density, the third pixel density configured to enable operation of the second sensor.
Claims
1. 1. A method for reducing scintillation and motion-induced blur, comprising: receiving a first resolution for a first region of a display of a computing device; receiving a second resolution for a second region of the display of the computing device; determining a speed at which moving content is being moved on said display; blurring the moving content within the second region based on the speed and the second resolution; the blurring is configured to convert the moving content into blurred moving content; The method comprises: displaying the blurred moving content within the second region; and displaying the moving content within the first area.
2. The method for motion induced blur comprises: receiving a source resolution of the moving content configured by a content source; the content source supplies the moving content to the display; The method comprises: comparing the source resolution and the first resolution to provide a resolution difference; and in response to the resolution difference, resampling the moving content in the first region based on the first resolution before displaying the moving content in the first region; the resampling is configured to change the moving content from the source resolution to the first resolution; The method comprises: comparing the source resolution and the second resolution to provide a second resolution difference; and in response to the second resolution difference, resampling the blurred moving content in the second region based on the second resolution before displaying the blurred moving content in the second region; The method of claim 1 , wherein the resampling is configured to change the blurred moving content from the source resolution to the second resolution.
3. The step of determining the speed of the moving content comprises: receiving a source speed of the moving content; the moving content includes a plurality of images received successively over time; the source speed corresponds to the speed at which successive images are received over time, as constructed by the content source; The step of determining the speed comprises: detecting a change in the moving content between the successively received images based on the source speed; The changes may be at different locations of the moving content. a change in color of the moving content; A change in the location of the moving content; or Change in size of the moving content and The step of determining the speed comprises: detecting an increase in speed when the change in the moving content increases between the successively received images; 3. The method of claim 2, further comprising detecting a decrease in said speed when said change in said moving content decreases between said successively received images.
4. the speed of the moving content is set by the source speed configured by the content source; When the source speed increases, the speed of the moving content increases, and when the source speed decreases, the speed of the moving content decreases; When the source speed is increased, the amount of blurring is increased, and when the source speed is decreased, the amount of blurring is decreased; 4. The method of claim 3, wherein the blurred moving content is configured to reduce scintillation of the moving content in the second region and to reduce the appearance of a boundary separating the first region and the second region of the display of the computing device.
5. The method for motion induced blur comprises: further comprising comparing the second resolution against a resolution threshold; the resolution threshold comprises a minimum resolution to prevent scintillation of the moving content, and the minimum resolution comprises a minimum pixel density; The method comprises: blurring the moving content within the second region in response to the second resolution being less than the resolution threshold; comparing the first resolution against the resolution threshold; 3. The method of claim 1, further comprising the step of: displaying the moving content within the first area in response to the first resolution being greater than the resolution threshold.
6. The method for motion induced blur comprises: determining that the second resolution is less than the resolution threshold; and comparing the speed of the moving content within the second region against a minimum speed threshold; the minimum speed threshold corresponds to a minimum speed of the moving content that causes scintillation on the display within the second region; The method comprises: blurring the moving content in the second region in response to determining that the speed of the moving content in the second region is greater than the minimum speed threshold; displaying the blurred moving content in the second area of the display; 6. The method of claim 5, further comprising the step of: displaying the moving content in the second region of the display in response to determining that the speed of the moving content in the second region is slower than the minimum speed threshold.
7. the display comprises a pixel layer; The pixel layer comprises: a first pixel density; a second pixel density, and color pixels configured to display the moving content in color; Including, the density of the color pixels is correlated with the resolution of the area of the display; color defects are associated with the density of color pixels, the color defects including color distortions and scintillation of the moving content, and the color defects increase the appearance of scintillation of the moving content within the second region and a boundary separating the first region and the second region; 6. The method of claim 5, further comprising blurring the moving content within the second region in response to determining that the second resolution is below the resolution threshold and the density of color pixels is below the minimum pixel density.
8. The step of determining the speed of the moving content comprises: receiving tactile input on the display of the computing device; the tactile input is performed by a user contacting the display, the contact being made on the display to change the size or position of the moving content; The step of determining the speed comprises: detecting a haptic speed associated with the haptic input; The method according to any one of claims 1 to 7, wherein the speed is the haptic speed.
9. the blurring of the moving content includes increasing the amount of blurring as the speed of the moving content increases and decreasing the amount of blurring as the speed of the moving content decreases; The amount of blurring is a linear correlation between the amount of blur and the speed of the moving content, where an increase in the speed corresponds to a linear increase in the amount of blur; or 9. The method of claim 1, comprising a non-linear correlation between the amount of blur and the speed of the moving content, wherein an increase in the speed corresponds to a non-linear increase in the amount of blur.
10. the display further comprising an array of pixels configured to display the moving content, the array of pixels including a pixel intensity for each pixel of the array; the step of blurring the moving content in the second region of the display further comprises using a smoothing filter, the smoothing filter configured to replace the pixel intensity for each pixel with an average of pixel intensities of neighboring pixels in the second region to blur the moving content; 10. The method of claim 9, wherein the smoothing filter further includes weights that are correlated with the speed of the moving content and configured to increase the amount of blurring as the speed increases and decrease the amount of blurring as the speed decreases.
11. The method for motion induced blur comprises: further comprising comparing the speed of the moving content within the second region against a maximum speed threshold; the maximum speed threshold corresponds to a maximum speed of the moving content that is allowed to be displayed on the computing device; The method comprises: further comprising blurring the moving content by a fixed blur amount in response to detecting that the speed is greater than the maximum speed threshold; The method of claim 9 , wherein the constant blur amount is configured to and maintained at a static value once the speed increases above the maximum speed threshold.
12. The method for motion induced blur comprises: further comprising detecting a refresh rate of the display; the refresh speed includes a maximum refresh speed; The method comprises: displaying a plurality of images of the moving content and a plurality of images of the blurred moving content sequentially on the display based on the maximum refresh speed; and setting the maximum speed threshold to the refresh speed; The maximum speed threshold is: a haptic speed associated with a user's haptic input on the display is faster than the refresh speed; or The source speed of the moving content is faster than the refresh speed.
12. The method of claim 11, further configured to enable blurring of the moving content in the second region by the fixed blur amount in response to detecting one or more of:
13. The method for motion induced blur comprises: receiving a third resolution for a third region of the display of the computing device; determining the speed of the moving content; blurring the moving content within the third region based on the speed and the third resolution; the blurring is configured to transform the moving content into a second blurred moving content; The method comprises: The method of any one of claims 1 to 12, further comprising the step of displaying the second blurred moving content in the third area.
14. The method for motion induced blur comprises: displaying the blurred moving content in the second region of the display of the computing device; and displaying the second blurred, moving content in the third region of the display of the computing device.
15. at least one processor; a display having an array of pixels; the array of pixels is configured to allow moving content to be viewed on the display; A computing device further comprising a computer-readable storage medium comprising instructions for, in response to execution by said processor, directing said computing device to perform a method according to any one of claims 1 to 14 using said display.
16. A program for causing a processor to execute the method according to any one of claims 1 to 14.
Citation Information
Patent Citations
Resolution conversion device, resolution conversion method, resolution conversion program, and image display system
JP2008146190A
Image processing device, image processing method and program
JP2010015483A
Display unit
JP2017058671A
Image processing apparatus, image display method, and computer program
JP2019020901A