Camera Module Image Compensation in Display Panels

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The integration of a camera module or sensor module into the edge of a smartphone's display disrupts the viewing experience by creating a heterogeneous interface with the screen, particularly when the module is positioned in a notch, leading to a black portion that obstructs the screen display.

Innovation Solution

A method is implemented to compensate for the image around the camera module or sensor module by adjusting pixel values and applying effects such as vignette or blur to minimize visibility, allowing the screen to be extended up to the module's position without disturbing the viewing experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the display area is increased by extending the display to include the camera module region, then the screen size is improved, but the viewing experience deteriorates due to the heterogeneous interface between the screen and camera module

Engineering Contradiction:
Improvedisplay areaVSAvoidviewing experience
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent applies color matching techniques to adjust the appearance of the camera module region to match the surrounding display content. By dynamically changing the color or brightness of pixels around the camera module, the heterogeneous interface is reduced, making the camera module less visually prominent and improving the overall viewing experience while maintaining the extended display area.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent modifies display parameters such as brightness, contrast, and color values in the regions adjacent to the camera module. By dynamically adjusting these parameters based on the displayed content and camera module position, the visual heterogeneity is minimized, allowing the display to extend into the camera region without significantly degrading the viewing experience.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If a notch is defined in the front surface to accommodate the camera module, then the camera module integration is improved, but the screen display deteriorates due to the black portion obstructing the display

Engineering Contradiction:
Improvecamera module integrationVSAvoidscreen display area
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent applies color matching to the notch region by adjusting the brightness and color of pixels surrounding the camera module. This makes the black portion less visually prominent by matching it with the surrounding display content, thereby reducing the obstruction effect and effectively increasing the usable screen display area while maintaining camera module integration.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent converts the harmful effect of the black notch portion into a beneficial visual effect by using color matching techniques. The previously obtrusive black area is transformed into a visually integrated region that blends with the surrounding display content, turning the structural limitation into an aesthetic feature that does not significantly reduce the effective screen area.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

3Ease of operation

If image compensation is applied around the camera module to reduce viewing disturbance, then the viewing experience is improved, but the image processing complexity increases

Engineering Contradiction:
Improveviewing experienceVSAvoidimage processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies image compensation techniques selectively only to the regions immediately adjacent to the camera module, rather than processing the entire display. By focusing the image processing on local areas where the heterogeneity is most pronounced, the viewing experience is improved while the overall processing complexity is kept manageable through targeted rather than universal application.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3818690B1Electronic device including camera module in display and method for compensating for image around camera module
Publication Date: 2023.11.29 SAMSUNG ELECTRONICS CO LTD
  • EP3818690B1 patent drawingFigure 1~2
  • EP3818690B1 patent drawingFigure 3~4a
  • EP3818690B1 patent drawingFigure 4b

AI summary

Disclosed is an electronic device including a display configured to display a screen, a display driver circuit configured to receive video information to control the display to display the screen, a module comprising at least one of a camera or a sensor disposed in a first region of the display, and at least one processor operatively connected with the display driver circuit and the module, wherein the at least one processor or the display driver circuit is configured to control the electronic device to compensate for, based on a change in an image of the first region of the screen or a pixel value of the first region, the image displayed in the first region.