Video frame brightness filter
Through the analysis and filtering of the brightness feature of video frames, the problem of balancing eye sensitivity and insensitive user experience in the video is solved, and the brightness adjustment is achieved frame by frame, adapting to the comfortable viewing needs of different users, and suitable for storage and streaming videos.
Patent Information
- Application Number
- CN201980080643.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-12-05
- Filing Date
- 2019-11-26
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2039-11-26
AI Technical Summary
The prior art is difficult to balance the visual experience of eye-sensitive and insensitive users in video, resulting in video brightness adjustments that cannot meet the needs of both types of users at the same time, which may lead to difficult attention to details or the video is too dark and bright.
The processor of the computing device performs brightness characteristics analysis on the region of interest in the video frame, detects the high brightness conditions, and generates filters based on these characteristics, adjusts the brightness frame by frame to reduce the brightness change without causing flickering The rate makes the video more suitable for users with sensitive eyes while avoiding too dark or too bright.
It realizes the comfortable viewing experience of eye-sensitive users without seriously adjusting the overall video brightness, while ensuring that insensitive users can also enjoy the video, avoiding discomfort caused by too fast brightness changes, and is suitable for storage and streaming videos. .
Smart Images

Figure CN113170068B_ABST
Abstract
Description
Background Art
[0001] Some users of display devices have eyes that are sensitive to bright light and / or sudden increases in brightness. When such a user watches a video, the user's visual system may be irritated by certain parts of the video. Past solutions to this problem include dimming the entire video. However, dimming the entire video may make it difficult to notice details in the dark frames of the video. This problem is particularly evident when both users with sensitive eyes and users with insensitive eyes watch the video. A video that is dark enough for a user with sensitive eyes may be too dark for a user with insensitive eyes. Summary of the invention
[0002] According to one aspect of the present disclosure, a computing device is provided, which includes a display and a processor. The processor may be configured to determine, for each of a plurality of frames included in a video, a brightness feature of at least an area of interest of the frame. The processor may be further configured to determine one or more additional brightness features of at least an area of interest of one or more additional frames in the plurality of frames. The processor may be further configured to determine that there is a high brightness condition in the area of interest. The processor may be further configured to generate a filter for the frame based on the brightness feature and one or more additional brightness features. The processor may be further configured to apply the filter to at least the area of interest of the frame to generate a filtered frame. There is no high brightness condition in the area of interest of the filtered frame. The processor may be further configured to output the filtered frame for display at the display.
[0003] This Summary is provided to introduce a selection of concepts that are further described below in a simplified form. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0004] Figure 1 A computing device according to an example embodiment is shown.
[0005] Figure 2 Shown according to Figure 1 Example frames of a video of an embodiment.
[0006] Figure 3 Shown according to Figure 1 Example brightness characteristics of an embodiment of.
[0007] Figure 4 Shown according to Figure 1 Example filtered brightness features of an embodiment.
[0008] Figure 5 Shown according to Figure 1 An example determination of a predetermined brightness threshold of an embodiment.
[0009] Figure 6 Shown according to Figure 1 A flowchart of a method of an embodiment for use with a computing device.
[0010] Figure 7 A schematic diagram of an example computing environment is shown in which an Figure 1 computing device. DETAILED DESCRIPTION
[0011] To address the issues discussed above, the inventors have conceived the following system and method. Figure 1 A computing device 10 according to one embodiment of the present disclosure is shown. The computing device 10 may include a memory 12 and a processor 14 operably coupled to the memory 12. The computing device 10 may further include an input device suite 20 that may be operably coupled to the processor 14 and / or the memory 12, the input device suite 20 including one or more input devices 22. For example, the one or more input devices 22 may include one or more of a touch screen, a touchpad, a keyboard, a mouse, one or more buttons, a microphone, one or more position sensors, and / or one or more other input devices 22. The computing device 10 may further include an output device suite 30 that includes one or more output devices 32. The output device suite 30 may include a display 34. Other output devices 32 such as one or more speakers and / or tactile feedback devices may also be included in the output device suite 30. The computing device 10 may further include one or more communication devices 16, via which the computing device 10 may communicate with one or more other computing devices. In some embodiments, in addition to or in lieu of being equipped on computing device 10, one or more functions of at least one of memory 12, processor 14, one or more input devices 22, and / or one or more output devices 32 may be equipped on one or more other computing devices.
[0012] The processor 14 may be configured to receive a video 40. In some embodiments, the video 40 is stored in the memory 12 as a video file. Alternatively, the video 40 may be streamed via one or more communication devices 16, and the video is processed when it is received at the computing device 10. The video 40 may include a plurality of frames 42, each frame 42 including a plurality of pixels 44. The processor 14 may be configured to perform brightness adjustment on each frame 42 of the plurality of frames 42 included in the video 40. In some embodiments, the processor 14 may perform brightness adjustment on the entire video 40, while in other embodiments, the processor 14 may perform brightness adjustment on only a subset of the frames 42 included in the video 40. In addition, for each frame 42, the processor 14 may perform brightness adjustment on the entire frame 42. Alternatively, in some embodiments, the processor 14 may perform brightness adjustment only on a region of interest of the frame 42. Figure 2 An example frame 42 comprising a plurality of pixels 44 is shown. Figure 2 The illustrated frame 42 includes a region of interest 46 that includes a plurality of pixels 44. Figure 2 In the example of FIG. 4 , the plurality of pixels 44 include pixels 44 of different brightness shown in grayscale. Figure 2 In the embodiment of the present invention, the region of interest 46 is rectangular, but in other embodiments, the region of interest 46 can have other shapes. In some embodiments, the region of interest 46 can be the entire frame 42.
[0013] Each pixel 44 of the plurality of pixels 44 included in the frame 42 may have a corresponding brightness 54. The processor 14 may be further configured to extract brightness data 50 related to the brightness 54 of the pixels 44 included in the region of interest 46 from the frame 42. In some embodiments, the processor 14 may be configured to determine brightness characteristics 52 of at least the region of interest 46 of the frame 42. Figure 3 An example brightness characteristic 52 of a region of interest 46 is shown. The brightness characteristic 52 may be a brightness distribution including a plurality of brightness ranges 56. The distribution may be in the form of a histogram, as shown. For each brightness range 56 in the plurality of brightness ranges 56, the brightness characteristic 52 may indicate the number of pixels 44 in the region of interest 46 having a brightness 54 within that brightness range 56. In some embodiments, the brightness characteristic 52 may include a brightness range 56 for each brightness 54 that a pixel 44 can have. In other embodiments, the processor 14 may bin the pixels 44 into a smaller number of brightness ranges 56. The brightness ranges 56 may be linearly distributed. For example, as shown in FIG. Figure 3 As shown, each brightness range 56 may include one eighth of the range between the minimum brightness and the maximum brightness. Non-linear distributions may also be used if desired.
[0014] return Figure 1 , the processor 14 may be further configured to determine one or more additional brightness features 52 of at least the region of interest 46 of one or more additional frames in the plurality of frames 42. In some embodiments, the one or more additional frames may be one or more subsequent frames 42F immediately following the frame 42 in the video 40. For example, the one or more additional frames may be two subsequent frames 42F. In other embodiments, the one or more additional frames may include one or more previous frames 42P immediately preceding the frame 42.
[0015] Based on the brightness data 50, the processor 14 may be further configured to detect a high brightness condition in the region of interest of the frame 42. As an example, the high brightness condition 60 may be a condition where each of the plurality of pixels 44 in the region of interest 46 exceeding a predetermined pixel threshold number 66 has a corresponding brightness 54 exceeding a threshold brightness 62. The threshold brightness 62 may be adjusted, for example, via user input received from one or more input devices 22. Additionally or alternatively, in some embodiments, the predetermined pixel threshold number 66 may be adjusted via user input.
[0016] In other embodiments, the high brightness condition 60 may be a condition where the average brightness of the region of interest 46 exceeds a predetermined average brightness threshold 68. The average brightness of the region of interest 46 may be a mean brightness or a median brightness. Similar to the threshold brightness 62 and the predetermined threshold number of pixels 66, in some embodiments, the predetermined average brightness threshold 68 may be adjusted via user input.
[0017] In some embodiments where the threshold brightness 62 is used when the processor 14 detects a high brightness condition 60, the processor 14 may determine the threshold brightness 62 based at least in part on one or more additional brightness features. The one or more additional brightness features may include one or more previous brightness features 52P and / or one or more subsequent brightness features 52F. In some embodiments, the threshold brightness 62 may be different between frames 42. To prevent flickering in the video 40 due to rapid changes in brightness, the processor 14 may set the threshold brightness 62 so that the threshold brightness 62 differs from the highest brightness 54 in the one or more additional brightness features 52 by less than a threshold amount.
[0018] The processor 14 may be further configured to generate a filter 58 for the frame 42. The filter 58 may indicate a brightness change for each pixel 44 in the region of interest 46. The brightness change may be zero for one or more pixels 44 in the region of interest 46. In some embodiments, the brightness change may be non-uniform across the region of interest 46. Therefore, instead of uniformly dimming each pixel 44 in the region of interest 46 by the same amount, the processor 14 may apply different brightness changes to different pixels 44. For example, the filter 58 may multiply the corresponding brightness 54 of each pixel 44 in the region of interest 46 by a sigmoid curve. Example code for implementing an sigmoid curve to modify brightness is provided below:
[0019]
[0020] The processor 14 may be further configured to generate the filter 58 based at least in part on a predetermined brightness change threshold 64. In embodiments where the high brightness condition 60 is a condition where the average brightness of the region of interest 46 exceeds a predetermined average brightness threshold 68, the predetermined brightness change threshold 64 may be a threshold amount by which the average brightness of the region of interest 46 changes. In embodiments where the high brightness condition 60 is a condition where each of a plurality of pixels 44 exceeding a predetermined pixel threshold number 66 in the region of interest 46 has a corresponding brightness 54 that exceeds a threshold brightness 62, the predetermined brightness change threshold 64 may be a threshold difference between the brightness 54 of the pixel 44 in the frame 42 and the brightness 54 of the pixel 44 in the previous frame 42P. In such embodiments, the processor 14 may detect the high brightness condition 60 when the number of pixels 44 greater than the predetermined pixel threshold number 66 changes in brightness 54 by an amount that exceeds the predetermined brightness change threshold 64. In such embodiments, the threshold brightness 62 may be dynamically adjusted to avoid exceeding the predetermined brightness change threshold 64, as described below.
[0021] After generating the filter 58 , the processor 14 may be further configured to apply the filter 58 to at least the region of interest 46 of the frame 42 to generate a filtered frame 72 that may be included in the filtered video 70 . Figure 4Filtered brightness characteristics 76 of the region of interest 46 of the filtered frame 72 are shown. High brightness conditions 60 may not be present in the region of interest 46 of the filtered frame 72. In some embodiments, the number of filtered pixels 74 having corresponding filtered brightness above the threshold brightness 62 may be below the predetermined pixel threshold number 66. For example, for a number of filtered pixels 74 in the region of interest 46 of the filtered frame 72 that are less than the predetermined pixel threshold number 66, the corresponding filtered brightness may differ from the brightness 54 of the pixel 44 in the previous frame 42P and / or the subsequent frame 42F by an amount greater than the predetermined brightness change threshold 64. In other embodiments, the average brightness of the region of interest 46 of the filtered frame 72 may be below the predetermined average brightness threshold 68. Thus, as the video 40 plays, the rate at which the brightness of the region of interest 46 changes may decrease to give the user's eyes more time to adjust to the change in brightness.
[0022] In some embodiments, processor 14 may be further configured to determine threshold brightness 62 based at least in part on predetermined brightness change threshold 64. In such embodiments, when the number of pixels 44 in region of interest 46 exceeding predetermined pixel threshold number 66 relative to previous frame 42P exceeds predetermined brightness change threshold 64, filter 58 may limit the increase in the corresponding brightness of pixels 44 to an amount less than or equal to predetermined brightness change threshold 64. Figure 5 As shown, the threshold brightness 62 can be represented as the lower of a static threshold brightness 80 and a dynamic threshold brightness 82. The static threshold brightness 80 can be set by the user via user input, or can be a default value. The dynamic threshold brightness 82 can be a threshold used when the predetermined brightness change threshold 64 is about to be exceeded. Therefore, the predetermined brightness change threshold 64 can be dynamically adjusted so that the brightness 54 of the area of interest 46 does not change faster than is comfortable for the user.
[0023] In some embodiments, rather than determining that the number of pixels 44 in the region of interest 46 that exceeds the predetermined pixel threshold number 66 will exceed the predetermined brightness change threshold 64, the processor 14 may instead determine that the average brightness of the region of interest 46 will change relative to the previous frame 42P by an amount greater than the predetermined brightness change threshold 64. In such embodiments, the filter 58 may limit the increase in the average brightness of the region of interest 46 to an amount less than or equal to the predetermined brightness change threshold 64.
[0024] In embodiments where the previous frame 42P and / or the subsequent frame 42F are also filtered, the processor 14 may determine a change in brightness of the region of interest 46 by comparing the brightness feature 52 of the frame 42 with the filtered brightness feature 76 of the previous frame 42P and / or the subsequent frame 42F. For example, the processor 14 may determine whether the change in brightness between the filtered previous frame 72P and the frame 42 exceeds a predetermined brightness change threshold 68 and / or whether the change in brightness between the frame 42 and the filtered subsequent frame 72F exceeds a predetermined brightness change threshold 68. The processor may be further configured to modify the filter 58 to prevent brightness changes from exceeding a predetermined brightness change threshold 64. The change in brightness 54 may be a change in brightness 54 of a plurality of pixels 44 exceeding a predetermined pixel threshold number 66, or alternatively, a change in average brightness of the region of interest 46. In some embodiments, the filter 58 and one or more additional filters applied to one or more additional frames may be iteratively modified. Thus, filtering changes between frames may be smoothed, and flickering due to rapid changes in filtering may be avoided.
[0025] In some embodiments, filter 58 may be an infinite impulse response filter. Example code for implementing filter 58 as an infinite impulse response filter is provided below:
[0026]
[0027]
[0028] In the example code, p is the average brightness of the previous frame, mp is the maximum brightness of the previous frame, c is the average brightness of the current frame 42, mc is the maximum brightness of the current frame 42, duration is the duration of the frame 42, maxLumChange is the predetermined brightness change threshold 64, and x and y are coefficients of the infinite impulse response filter.
[0029] In other embodiments, filter 58 may be a finite impulse response filter. For example, a finite impulse response filter may be used when video 40 is a video file stored in memory 12 of computing device 10 rather than a streamed video. In embodiments where filter 58 is a finite impulse response filter, the one or more additional frames may include a plurality of previous frames 42P and a plurality of subsequent frames 42F.
[0030] After generating filtered frames 72, processor 14 may be further configured to output filtered frames 72 for display at display 34 of computing device 10. Filtered frames 72 may be output as part of filtered video 70.
[0031] Figure 6 A flow chart of a method 100 for use with a computing device is shown. The method 100 may be used with Figure 1The method 100 may be used together with a computing device 10 of the embodiment of the present invention or optionally used together with some other computing device. The steps of the method 100 may be performed for each of a plurality of frames included in the video. The plurality of frames may include the entire video or optionally only a subset of the frames of the video.
[0032] In step 102, method 100 may include determining a brightness feature of at least a region of interest of a frame. The region of interest may include the entire frame or, optionally, only a subset of the frame. In some embodiments, the brightness feature of at least the region of interest of the frame may be a brightness distribution, and for each brightness range in a plurality of brightness ranges, the brightness distribution includes a plurality of pixels in the region of interest having brightness within the brightness range. In such an embodiment, the brightness feature may include a brightness range for each possible brightness that a pixel may have. Optionally, pixels of similar brightness may be merged into the brightness range. In other embodiments, the brightness feature may be an average brightness over the region of interest, which may be a mean brightness or a median brightness. In step 104, method 100 may further include determining one or more additional brightness features of at least the region of interest of one or more additional frames in the plurality of frames. For example, the one or more additional frames may include one or more previous frames immediately before a frame in the video and / or one or more subsequent frames immediately after a frame in the video.
[0033] At step 106, method 100 may further include detecting a high brightness condition in a region of interest of the frame. Detecting the high brightness condition may include, at step 108, determining that each of a plurality of pixels in the region of interest exceeding a predetermined threshold number of pixels has a corresponding brightness exceeding a threshold brightness. Additionally or alternatively, at step 110, detecting the high brightness condition may include determining that an average brightness of the region of interest exceeds a predetermined average brightness threshold. In some embodiments, the threshold brightness may be adjusted via user input.
[0034] In some embodiments, detecting a high brightness condition can be based at least in part on a predetermined brightness change threshold. The predetermined threshold brightness can be a threshold change in brightness between a frame and a previous frame. The change in brightness can be a change in average brightness or a change in brightness of a number of pixels exceeding a predetermined threshold number of pixels. In one example, the predetermined brightness change threshold can be used to determine a dynamic threshold brightness. For example, the dynamic threshold brightness can be the sum of a predetermined brightness change threshold and the average brightness of the region of interest. The threshold brightness can be the lower of a static threshold brightness and a dynamic threshold brightness.
[0035] At step 112, method 100 may further include generating a filter for the frame based on the brightness feature and one or more additional brightness features. The filter may be an infinite impulse response filter. Alternatively, the filter may be a finite impulse response filter. At step 114, method 100 may further include applying the filter to at least the region of interest of the frame to generate a filtered frame. There may not be a high brightness condition in the region of interest of the filtered frame. For example, the region of interest of the filtered frame may include a number of pixels below a predetermined pixel threshold number that exceeds a brightness threshold. In other embodiments, the average brightness of the region of interest may be below the average brightness threshold. In some embodiments, the filter may be non-uniform across the region of interest, rather than modifying the brightness of each pixel in the region of interest by the same amount.
[0036] As described above, in addition to or in place of the threshold brightness, the filter can be generated based on a predetermined brightness change threshold. In such an embodiment, for a plurality of pixels filtered that are less than a predetermined pixel threshold number in the region of interest of the filtered frame, the corresponding filtered brightness can differ from the brightness of the pixels in the previous frame and / or subsequent frame by an amount greater than the predetermined brightness change threshold.
[0037] At step 116, method 100 may further include outputting the filtered frame for display at a display. The display may be included in the computing device executing method 100, or may be communicatively coupled to the computing device via one or more communication devices.
[0038] At step 118, method 100 may optionally include generating one or more corresponding additional filters for one or more additional frames. In embodiments performing step 118, one or more corresponding additional filters may be generated in one or more other iterations of the above steps. The one or more corresponding additional filters may be different from the filters generated for the frame. Thus, the amount of filtering applied to the region of interest may vary over multiple frames on which filtering is performed.
[0039] Using the systems and methods discussed above, the brightness of one or more frames of a video can be adjusted so that the video can be comfortably viewed by a user whose eyes are highly light sensitive. This can be done without dimming one or more frames so severely that the video will not be appreciated by a user whose eyes are not highly light sensitive. The above systems and methods for filtering video can be used with both stored and streaming video, and can allow the brightness of a video to be adjusted without large buffering delays.
[0040] In some embodiments, the methods and processes described herein may be bound to a computing system of one or more computing devices. Specifically, such methods and processes may be implemented as computer applications or services, application programming interfaces (APIs), libraries, and / or other computer program products.
[0041] Figure 7 A non-limiting embodiment of a computing system 200 that can perform one or more of the above methods and processes is schematically shown. The computing system 200 is shown in simplified form. The computing system 200 can implement the above methods and processes. Figure 1 The computing device 10 shown. The computing system 200 may take the form of one or more personal computers, server computers, tablet computers, home entertainment computers, network computing devices, gaming devices, mobile computing devices, mobile communication devices (e.g., smart phones), and / or other computing devices and wearable computing devices such as smart watches and head-mounted augmented reality devices.
[0042] The computing system 200 includes a logic processor 202, a volatile memory 204, and a non-volatile storage device 206. The computing system 200 may optionally include a display subsystem 208, an input subsystem 210, a communication subsystem 212, and / or Figure 7 Other components not shown.
[0043] Logical processor 202 includes one or more physical devices configured to execute instructions. For example, a logical processor may be configured to execute instructions that are part of one or more applications, programs, routines, libraries, objects, components, data structures, or other logical constructs. Such instructions may be implemented to perform a task, implement a data type, transform the state of one or more components, achieve a technical effect, or otherwise achieve a desired result.
[0044] The logical processor may include one or more physical processors (hardware) configured to execute software instructions. Additionally or alternatively, the logical processor may include one or more hardware logic circuits or firmware devices configured to execute hardware-implemented logic or firmware instructions. The processor of the logical processor 202 may be single-core or multi-core, and the instructions executed thereon may be configured for sequential, parallel and / or distributed processing. The various components of the logical processor may optionally be distributed between two or more separate devices, which may be remotely located and / or configured for coordinated processing. Various aspects of the logical processor may be virtualized and executed by a remotely accessible networked computing device configured with a cloud computing configuration. In such a case, it should be understood that these virtualized aspects are run on different physical logical processors of various different machines.
[0045] The non-volatile storage device 206 includes one or more physical devices that are configured to hold instructions executable by a logical processor to implement the methods and processes described herein. When implementing such methods and processes, the state of the non-volatile storage device 206 may be transformed - for example, to hold different data.
[0046] The non-volatile storage device 206 may include a removable and / or built-in physical device. The non-volatile storage device 206 may include an optical storage device (e.g., CD, DVD, HD-DVD, Blu-ray disc, etc.), a semiconductor memory (e.g., ROM, EPROM, EEPROM, flash memory, etc.), and / or a magnetic storage device (e.g., a hard disk drive, a floppy disk drive, a tape drive, MRAM, etc.) or other mass storage device technology. The non-volatile storage device 206 may include a non-volatile, dynamic, static, read / write, read-only, sequential access, location addressable, file addressable, and / or content addressable device. It should be understood that the non-volatile storage device 206 is configured to retain instructions even when power is removed from the non-volatile storage device 206.
[0047] The volatile memory 204 may include physical devices that include random access memory. The volatile memory 204 is typically used by the logical processor 202 to temporarily store information during the processing of software instructions. It should be understood that when power is removed from the volatile memory 204, the volatile memory 204 typically does not continue to store instructions.
[0048] Aspects of logic processor 202, volatile memory 204, and non-volatile storage 206 may be integrated together into one or more hardware logic components. For example, such hardware logic components may include field programmable gate arrays (FPGAs), program and application specific integrated circuits (PASIC / ASIC), program and application specific standard products (PSSP / ASSP), systems on chips (SOCs), and complex programmable logic devices (CPLDs).
[0049] The terms "module," "program," and "engine" may be used to describe an aspect of a computing system 200 that is typically implemented in software by a processor to use portions of volatile memory to perform a specific function that involves a transformation process that specifically configures the processor to perform the function. Thus, a module, program, or engine may be instantiated via a logical processor 202 executing instructions held by a non-volatile storage device 206 using portions of volatile memory 204. It should be understood that different modules, programs, and / or engines may be instantiated from the same application, service, code block, object, library, routine, API, function, etc. Likewise, the same module, program, and / or engine may be instantiated by different applications, services, code blocks, objects, routines, APIs, functions, etc. The terms "module," "program," and "engine" may include individual or groups of executable files, data files, libraries, drivers, scripts, database records, and the like.
[0050] When a display subsystem 208 is included, the display subsystem 208 can be used to present a visual representation of the data held by the non-volatile storage device 206. The visual representation can take the form of a graphical user interface (GUI). Since the methods and processes described herein change the data held by the non-volatile storage device, and thus transform the state of the non-volatile storage device, the state of the display subsystem 208 can likewise be transformed to visually represent the changes in the underlying data. The display subsystem 208 can include one or more display devices utilizing almost any type of technology. Such a display device can be combined with the logical processor 202, the volatile memory 204, and / or the non-volatile storage device 206 in a shared chassis, or such a display device can be a peripheral display device.
[0051] When input subsystem 210 is included, input subsystem 210 may include or interface with one or more user input devices (such as a keyboard, mouse, touch screen, or game controller). In some embodiments, the input subsystem may include or interface with selected natural user input (NUI) components. Such components may be integrated or peripheral, and the conversion and / or processing of input actions may be processed online or offline. Example NUI components may include microphones for voice and / or speech recognition; infrared, color, stereo, and / or depth cameras for machine vision and / or gesture recognition; head trackers, eye trackers, accelerometers, and / or gyroscopes for motion detection and / or intent recognition; and electric field sensing components for assessing brain activity; and / or any other suitable sensors.
[0052] When the communication subsystem 212 is included, the communication subsystem 212 can be configured to communicatively couple the various computing devices described herein to each other and to communicatively couple to other devices. The communication subsystem 212 can include wired and / or wireless communication devices compatible with one or more different communication protocols. As non-limiting examples, the communication subsystem can be configured to communicate via a wireless telephone network or a wired or wireless local area network or wide area network (such as HDMI over a Wi-Fi connection). In some embodiments, the communication subsystem can allow the computing system 200 to send and / or receive messages to other devices via a network such as the Internet.
[0053] According to one aspect of the present disclosure, a computing device is provided, which includes a display and a processor. The processor may be configured to determine, for each of a plurality of frames included in a video, a brightness feature of at least an area of interest of the frame. The processor may be further configured to determine one or more additional brightness features of at least an area of interest of one or more additional frames in the plurality of frames. The processor may be further configured to detect a high brightness condition in an area of interest of the frame. The processor may be further configured to generate a filter for the frame based on the brightness feature and one or more additional brightness features. The processor may be further configured to apply the filter to at least an area of interest of the frame to generate a filtered frame. There may not be a high brightness condition in the area of interest of the filtered frame. The processor may be further configured to output the filtered frame for display at the display.
[0054] According to this aspect, the filter may be an infinite impulse response filter.According to this aspect, one or more additional frames may immediately follow the frame in the video.
[0055] According to this aspect, the filter may be a finite impulse response filter.
[0056] According to this aspect, the brightness characteristic of at least the region of interest of the frame may be a brightness distribution including, for each brightness range of a plurality of brightness ranges, a plurality of pixels in the region of interest having brightness within the brightness range.
[0057] According to this aspect, the high brightness condition may be a condition where each of a plurality of pixels exceeding a predetermined pixel threshold number in the region of interest has a corresponding brightness exceeding a threshold brightness. According to this aspect, the threshold brightness is the lower of a static threshold brightness and a dynamic threshold brightness.
[0058] According to this aspect, the high brightness condition may be a condition where the average brightness of the region of interest exceeds a predetermined average brightness threshold.
[0059] According to this aspect, the processor can be configured to detect a high brightness condition based at least in part on a predetermined brightness change threshold. According to this aspect, for a plurality of filtered pixels in a region of interest of a filtered frame that is less than a predetermined pixel threshold number, the corresponding filtered brightness can differ from the brightness of the pixels in a previous frame and / or a subsequent frame by an amount greater than the predetermined brightness change threshold.
[0060] According to this aspect, the processor may be further configured to generate one or more corresponding additional filters for one or more additional frames.The one or more corresponding additional filters may be different from the filters generated for the frame.
[0061] According to this aspect, the brightness variation between frames and filtered frames may be non-uniform over at least the region of interest.
[0062] According to another aspect of the present disclosure, a method for use with a computing device is provided. The method may include, for each of a plurality of frames included in a video, determining a brightness feature of at least an area of interest of the frame. The method may further include determining one or more additional brightness characteristics of at least an area of interest of one or more additional frames in the plurality of frames. The method may further include detecting a high brightness condition in the area of interest of the frame. The method may further include generating a filter for the frame based on the brightness feature and one or more additional brightness features. The method may further include applying the filter to at least the area of interest of the frame to generate a filtered frame. There may be no high brightness condition in the area of interest of the filtered frame. The method may further include outputting the filtered frame for display at a display.
[0063] According to this aspect, the filter may be an infinite impulse response filter.
[0064] According to this aspect, the filter may be a finite impulse response filter.
[0065] According to this aspect, the brightness characteristic of at least the region of interest of the frame may be a brightness distribution including, for each brightness range of a plurality of brightness ranges, a plurality of pixels in the region of interest having brightness within the brightness range.
[0066] According to this aspect, detecting the high brightness condition may include determining that each of a plurality of pixels exceeding a predetermined threshold number of pixels in the region of interest has a respective brightness exceeding a threshold brightness.
[0067] According to this aspect, detecting the high brightness condition may include determining that an average brightness of the region of interest exceeds a predetermined average brightness threshold.
[0068] According to this aspect, detecting the high brightness condition can be based at least in part on a predetermined brightness change threshold.
[0069] According to another aspect of the present disclosure, a computing device is provided, which includes a display and a processor. The processor may be configured to determine, for each of a plurality of frames included in a video, a brightness feature of at least a region of interest of the frame. The processor may be further configured to determine additional brightness features of at least a region of interest of at least a previous frame of the plurality of frames. The processor may be further configured to determine that a high brightness condition exists in the region of interest of the frame. The high brightness condition may include an increase in the average brightness of the region of interest relative to the previous brightness of the region of interest in the previous frame exceeding a predetermined brightness change threshold. The processor may be further configured to generate a filter for the frame based on the brightness feature and one or more additional brightness features. The processor may be further configured to apply the filter to at least the region of interest of the frame to generate a filtered frame. There may not be a high brightness condition in the region of interest of the filtered frame. The processor may be further configured to output the filtered frame for display at the display.
[0070] It should be understood that the configuration and / or method described herein is exemplary in nature, and these specific embodiments or examples should not be considered restrictive, because many variations are possible. The specific routines or methods described herein can represent one or more of any number of processing strategies. Therefore, the various actions shown and / or described can be performed in the order shown and / or described, in other orders, in parallel or omitted. Similarly, the order of the above-mentioned processing can be changed.
[0071] The subject matter of the present disclosure includes all novel and nonobvious combinations and sub-combinations of the various processes, systems and configurations, and other features, functions, acts, and / or properties disclosed herein, as well as any and all equivalents thereof.
Claims
1. A computing device, include: monitor; as well as The processor is configured as: For each frame of a plurality of frames included in the video: determining a brightness characteristic of at least a region of interest of a current frame; determining one or more additional brightness characteristics of at least the region of interest for one or more additional frames in the plurality of frames before or after the current frame in the video; detecting a high brightness condition in the region of interest of the frame; generating a filter for the current frame based on the luma feature and the one or more additional luma features; applying the filter to at least the region of interest of the current frame to generate a filtered frame, wherein the high brightness condition is absent in the region of interest of the filtered frame; as well as The filtered frame is output for display at the display.
2. The computing device of claim 1, wherein the filter is an infinite impulse response filter.
3. The computing device of claim 2, wherein the one or more additional frames immediately follow the current frame in the video.
4. The computing device of claim 1, wherein the filter is a finite impulse response filter.
5. The computing device of claim 1 , wherein the brightness characteristic of at least the region of interest of the current frame is a brightness distribution, and for each brightness range in a plurality of brightness ranges, the brightness distribution includes a plurality of pixels in the region of interest having a brightness within the brightness range. 6 . The computing device of claim 1 , wherein the high brightness condition is a condition in which each pixel of a plurality of pixels exceeding a predetermined pixel threshold number in the region of interest has a corresponding brightness exceeding a threshold brightness.
7. The computing device of claim 6, wherein the threshold brightness is the lower of a static threshold brightness and a dynamic threshold brightness. 8 . The computing device of claim 1 , wherein the high brightness condition is a condition in which an average brightness of the region of interest exceeds a predetermined average brightness threshold.
9. The computing device of claim 6, wherein the processor is configured to detect the high brightness condition based at least in part on a predetermined brightness change threshold.
10. The computing device according to claim 9, in, For a plurality of filtered pixels in the region of interest in the filtered frame that is less than the predetermined pixel threshold number, the corresponding filtered brightness differs from the brightness of the pixels in a previous frame and / or in a subsequent frame in the one or more additional frames by an amount greater than the predetermined brightness change threshold.
11. The computing device according to claim 1, in: The processor is further configured to generate one or more corresponding additional filters for the one or more additional frames; and The one or more corresponding additional filters are different from the filters generated for the current frame.
12. The computing device of claim 1, wherein a brightness change between the current frame and the filtered frame is non-uniform across at least the region of interest.
13. The computing device of claim 1, wherein the plurality of frames comprises the entirety of the video.
14. The computing device of claim 1, wherein the plurality of frames comprises only a subset of frames of the video.
15. A method for use with a computing device, the method include: For each frame of a plurality of frames included in the video: determining a brightness characteristic of at least a region of interest of a current frame; determining one or more additional brightness characteristics of at least the region of interest for one or more additional frames in the plurality of frames before or after the current frame in the video; Detecting a high brightness condition in the region of interest of the current frame; generating a filter for the current frame based on the luminance feature and the one or more additional luminance features; applying the filter to at least the region of interest of the current frame to generate a filtered frame, wherein the high brightness condition is absent in the region of interest of the filtered frame; as well as The filtered frame is output for display at a display.
16. The method of claim 15, wherein the filter is an infinite impulse response filter.
17. The method of claim 15, wherein the filter is a finite impulse response filter.
18. The method of claim 15, wherein the brightness characteristic of at least the region of interest of the current frame is a brightness distribution, and for each brightness range in a plurality of brightness ranges, the brightness distribution includes a plurality of pixels in the region of interest having brightness within the brightness range.
19. The method of claim 15, wherein detecting the high brightness condition comprises determining that each pixel in a plurality of pixels exceeding a predetermined threshold number of pixels in the region of interest has a respective brightness exceeding a threshold brightness.
20. The method of claim 15, wherein detecting the high brightness condition include: It is determined that the average brightness of the region of interest exceeds a predetermined average brightness threshold.
21. The method of claim 15, wherein detecting the high brightness condition is based at least in part on a predetermined brightness change threshold.
22. A computing device, include: monitor; as well as The processor is configured as: For each frame of a plurality of frames included in the video: determining a brightness characteristic of at least a region of interest of a current frame; determining additional brightness characteristics of at least the region of interest for at least a previous frame of the plurality of frames; determining that a high brightness condition exists in the region of interest in the current frame, wherein the high brightness condition comprises an increase in average brightness of the region of interest relative to a previous brightness of the region of interest in the previous frame exceeding a predetermined brightness change threshold; generating a filter for the current frame based on the luminance feature and one or more additional luminance features; applying the filter to at least the region of interest of the current frame to generate a filtered frame, wherein the high brightness condition is absent in the region of interest of the filtered frame; as well as The filtered frame is output for display at the display.
