Masking visual content

WO2026195401A1PCT designated stage Publication Date: 2026-09-24ORANGE SA
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2026/056507
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-03-19
Filing Date
2026-03-10
Publication Date
2026-09-24

Smart Images

  • Figure EP2026056507_24092026_PF_FP_ABST
    Figure EP2026056507_24092026_PF_FP_ABST
Patent Text Reader

Abstract

The invention relates to a method for managing a display area of a graphical interface, the method being implemented by a processor and comprising: rendering an image representative of a first visual content, the rendering of the image causing a second visual content to be masked during rendering of the second visual content, on the display area, in front of the first visual content, the rendering of the image taking into account a nature of the second visual content.
Need to check novelty before this filing date? Find Prior Art

Description

Description Title: Visual Content Hiding technical field

[0001] This disclosure falls within the domain of graphical user interface management. More specifically, it concerns a method and device for managing a display area of ​​a graphical user interface. Previous technique

[0002] In the current state of the art, the management of the display of unwanted visual content relies mainly on two approaches.

[0003] One known approach, in the case of software that generates notifications, is to use settings specific to that software, particularly permission management parameters and allowed display modes. Some software and / or operating systems do indeed allow the user or administrator to completely disable the display of notifications, limit their visibility to certain conditions, or even choose how they appear on the screen.

[0004] However, the customization offered by these settings depends on each software and cannot be applied uniformly to all applications on a system.

[0005] A second known approach relies on the use of mechanisms to block or hide unwanted graphical elements on a user interface, particularly in web browsers.

[0006] Some extensions or specialized software intercept and prevent the display of pop-up advertisements, block the loading of certain elements of a web page, or dynamically modify the displayed content by applying filtering rules. These filtering rules rely on predefined criteria to identify the elements to block or modify, by analyzing, for example, their structure, stylesheets, or certain scripts executed on the page.

[0007] However, these techniques are limited to a specific environment, such as a web browser, and do not apply to other types of graphical interfaces. Furthermore, they often require regular updates to filtering rules to remain effective in the face of changes in displayed content. In addition, they require access to an application programming interface (API) to interact with the web page content or modify its display after it has loaded.

[0008] Both of these approaches have several limitations. There is therefore a technical need for a display management mechanism that does not suffer from all the limitations of existing techniques, and that helps improve the user experience compared to these existing techniques. Summary

[0009] This disclosure improves the situation.

[0010] A method for managing the display of a graphical interface is proposed, according to one aspect; the method includes, during rendering, in front of a first visual content, a second visual content: a rendering 23 of an image on said graphical interface causing a masking of said second visual content.

[0011] In at least one embodiment, said image is representative of the first visual content.

[0012] Thus, at least one embodiment relates to a method for managing a display area of ​​a graphical interface, the method being implemented by a processor and comprising: a rendering of an image representative of initial visual content, The image rendering process causes a second visual element to be masked during the rendering of the second visual element, in the display area, in front of the first visual element. the rendering of the image taking into account the nature of the second visual content.

[0013] According to another aspect, a display management device for a graphical interface is proposed, the device comprising a processor configured for rendering on said graphical interface, during rendering, in front of a first visual content, of a second visual content, of an image causing a masking of said second visual content.

[0014] In at least one embodiment, said image is representative of the first visual content.

[0015] Thus, at least one embodiment relates to a device for managing a display area of ​​a graphical interface, the device comprising a processor configured to: render an image representative of initial visual content, The image rendering process causes a second visual element to be masked during the rendering of the second visual element, in the display area, in front of the first visual element. the rendering of the image taking into account the nature of the second visual content.

[0016] Such a device is suitable for implementing the process as defined herein.

[0017] In another aspect, a computer program is proposed that includes instructions for implementing all or part of a process as defined herein, in any of its embodiments, when executed by a processor. In another aspect, a non-transient, computer-readable recording medium is proposed on which such a program is recorded.

[0018] The proposed process offers several technical advantages compared to existing techniques.

[0019] Unlike some known techniques for managing notification permissions, the proposed method does not necessarily (and / or solely) rely on static parameters defined by the user or the system, nor does it necessarily impose rigid choices on the user. It can contribute to a dynamic (e.g., real-time) adaptation of the display based on the context and nature of the visual content being displayed. It is not necessarily limited to permanently allowing or blocking visual content, such as a notification, but can also help to temporarily hide its display while retaining the ability to show it later. The proposed method can thus help provide finer-grained and more flexible management of a graphical interface, with this management being implemented independently of the specific parameters of each application that might send notifications.

[0020] Furthermore, unlike some known browser ad-blocking techniques, such as those that intercept graphical elements, the proposed method does not necessarily rely on static filtering criteria and does not require access to a specific application programming interface (API) to interact with the displayed visual content. It is applicable to any type of graphical interface, not just to specific environments like a web browser. This allows for more flexible management of displayed visual content without depending on a predefined set of rules or structural characteristics of the content to be hidden.

[0021] Furthermore, the proposed method can be implemented, for example, by using superimposed rendering layers to dynamically hide visual content without interacting with the applications generating that visual content, and in particular without directly altering the data of those applications. The proposed method can thus be adapted to various use cases without requiring user intervention or prior configuration of the applications generating the visual content, while still allowing for seamless and contextual display management.

[0022] The features described in this application may optionally be implemented independently of each other or in combination with each other.

[0023] In at least one embodiment, image rendering is triggered independently of the nature of the second visual content, and the nature of the second visual content is taken into account when rendering the second visual content to maintain or interrupt image rendering.

[0024] One advantage of this implementation is its compatibility with proactively masking the second visual content without requiring prior analysis of its nature. This allows for the advance management of visual content to be masked, preventing it from being visible even briefly. Furthermore, considering the nature of the second visual content to interrupt image rendering can help dynamically adapt the display based on context and improve the user experience.

[0025] In at least one embodiment, image rendering is triggered taking into account the nature of the second visual content.

[0026] One advantage of this implementation is its compatibility with targeted masking, which only occurs when a second visual element with certain characteristics is detected. This allows for greater precision in display management and avoids unnecessarily masking irrelevant content. It can also facilitate better adaptation to specific user needs and / or the requirements of a given environment. Furthermore, it can enable users to become aware of certain notifications more quickly, particularly those of an urgent nature.

[0027] In at least one embodiment, the nature of the second visual content is obtained from an analysis of a capture of at least one rendering layer including the rendering of the second visual content.

[0028] One advantage of this implementation is that it can provide reliable information about the nature of the second visual content without necessarily relying on an external source or a third-party application programming interface. Analyzing a capture of a rendering layer allows for the dynamic extraction of features of visual content rendered (at least partially) in that rendering layer, and the masking can be adapted accordingly. This can enhance the autonomy of the proposed method and its compatibility with different display environments.

[0029] In at least one embodiment, the analysis includes optical character recognition and / or graphic element detection applied to the capture of at least one rendering layer including the rendering of the second visual content.

[0030] The implementation, in certain embodiments, of optical character recognition and / or graphic element detection techniques can facilitate differentiation of rendered visual content and can reduce the risk of inappropriate masking.

[0031] In at least one embodiment, the image is obtained from a capture of at least one rendering layer including the rendering of the first visual content.

[0032] One advantage of this implementation is that the image used for masking reflects the actual state of the graphical interface. Capturing at least one rendering layer, including the initial visual content, provides a faithful and contextually appropriate representation of the interface. Using such a capture as the basis for obtaining the masking image can thus avoid, or at least minimize, graphical inconsistencies between the rendered image and its environment on the graphical interface, thereby making the masking process more discreet, or even transparent, to the user.

[0033] In at least one embodiment, the image is obtained from an interception of a video stream comprising the first visual content.

[0034] This type of implementation is particularly suitable in environments where rendering layers are not directly accessible or when the content to be masked comes from a real-time video source.

[0035] In at least one embodiment, the image is obtained from a capture of at least one rendering layer and from an interception of a video stream. These acquisition sources are selected such that the combination of the captured rendering layer and the intercepted video stream renders the initial visual content. Such an embodiment can allow for better adaptability to certain display environments. In one example use case, the initial visual content includes: a first part originating from a first source, for example a first part native to and governed by an operating system and a second part from a second source, for example a second part streamed online. In this use case example, the captured rendering layer contains the first part of the first visual content and the video stream contains the second part of the first visual content.

[0036] This combination of previously presented implementation methods combines their associated technical advantages. Capturing a rendering layer provides a detailed and accurate image of the initial visual content in its exact graphical state before display. Intercepting a video stream, on the other hand, allows for the extraction of dynamic images when the initial visual content evolves in real time, particularly in the case of continuously refreshed animations, videos, or graphical user interfaces. Combining these two complementary sources can contribute to improved fidelity and adaptation to the display context, as well as better visual continuity by avoiding, or at least minimizing, discrepancies between the initial displayed visual content and the image used for masking.Combining these two complementary sources can also offer better resilience in environments where certain rendering layers and / or a relevant video stream may not be directly accessible continuously.

[0037] In one embodiment, the image rendering is updated periodically.

[0038] Such periodic updates can help ensure that the initial visual content reflects any changes to the graphical interface over time, thus preventing the rendering of an outdated or inappropriate image. This implementation is particularly well-suited to environments where the display changes frequently, such as dynamic interfaces or screens containing regularly refreshed visual elements.

[0039] In one embodiment, the image rendering is updated after an event.

[0040] Updating the image rendering after an event is particularly suitable when the primary visual content is essentially static, such as a portion of a wallpaper or other visual content that is not subject to frequent changes. In this case, to conserve resources, periodic updates are not always necessary. An update can be triggered only in response to an event likely to affect the rendering of the primary visual content, such as a change in resolution, a modification of the user interface, or the appearance of new content. This implementation can thus help improve the use of system resources by limiting unnecessary calculations while ensuring that the image used for masking remains relevant when a significant change occurs.

[0041] In one embodiment, the second visual content includes a notification.

[0042] Hiding a notification can help improve a user's attention management by avoiding unwanted visual interruptions, especially in contexts requiring high concentration.

[0043] Compared to some known notification management techniques, this implementation can allow advanced customization of the display of a notification, offering finer control over the visibility of the notification without requiring modification of system settings or settings of a source application of the notification.

[0044] In one embodiment, the first visual content includes an interactive element, the image is representative of the interactive element and the process includes, during image rendering, a redirection of a human-machine interaction with the display area to the interactive element.

[0045] This redirection can allow the user to retain functional access to an interactive element when a second visual content, rendered in front of the interactive element, is hidden.

[0046] In one embodiment, the display area has a size and / or position corresponding to an expected size and / or display location of the second visual content.

[0047] The size and position of the display area can be adjusted, for example, to completely obscure the second visual element as much as possible and avoid unnecessarily covering other visual elements that might be displayed on the interface in addition to the first. In one example use case, two separate, side-by-side notifications appear simultaneously above the first visual element. The first notification (second visual element) is a promotional advertisement and should be hidden. The second notification (third visual element) is a critical alert and should remain visible. In this case, the size and position of the display area can be adjusted, for example, dynamically, to hide the second visual element while leaving the third visible. Brief description of the drawings

[0048] Other features, details, and advantages will become apparent upon reading the detailed description below and analyzing the attached drawings, on which: Fig. 1

[0049] [Fig. 1] shows a logical architecture of a device or system for managing a display area of ​​a graphical interface, in an example of an implementation. Fig. 2

[0050] [Fig. 2] represents a set of rendering layers superimposed on a display area of ​​a graphical interface, in an example implementation. Fig. 3

[0051] [Fig. 3] shows a hardware architecture of a computer device suitable for implementing a method for managing a display area of ​​a graphical interface, in an example embodiment. Description of embodiments

[0052] The proposed technique relates to the management of graphical interfaces and is based on masking visual content during its rendering on a display area by an image representing another visual content, for example another underlying visual content (in terms of rendering layers) to the visual content to be masked.

[0053] The proposed technique can find many practical applications, particularly for hiding notifications, advertisements, or any other unwanted visual content. Alternatively, it can be used to hide sensitive content.

[0054] Some technical explanations specific to the field of graphical interfaces are now provided to facilitate understanding of the proposed technique.

[0055] A graphical user interface (GUI) refers to any system that allows interaction between a user and an electronic device through visual elements displayed on a screen. Unlike a strictly text-based user interface (such as a command-line terminal), a GUI relies on visual representations in the form of icons, buttons, windows, menus, animations, or other graphical components.

[0056] Graphical user interfaces can be used on a wide variety of electronic devices, each with its own display and interaction constraints: On a personal computer, smartphone, or tablet, the graphical interface may include visual content from the operating system and / or one or more running applications. On a smart TV or in embedded systems such as vehicle dashboards or interactive kiosks, the graphical interface can include various visual content such as interactive menus and / or notifications. In an augmented reality (AR) or virtual reality (VR) device, the graphical interface can include 3D visual content superimposed on a real environment and / or immersed in a virtual environment.

[0057] A notification is information displayed by a system or application to alert the user to an event, such as a received message, a system alert, or an update. Notifications are designed to capture the user's attention while minimizing interruptions to their workflow. Notifications are often displayed in specific areas of the user interface, such as the bottom right corner on a computer and the top of the screen or in a floating area on a smartphone. The choice of these locations is based on ergonomic principles aimed at improving the visibility of notifications while limiting the disruptions to the user experience caused by them.

[0058] A widget is a graphical user interface element that displays information or offers interactive functionality in a specific area of ​​a screen or application. It is a self-contained component that can be integrated into a larger user interface, allowing quick access to certain features without requiring the opening of a full application.

[0059] A display area refers to a portion or all of the graphical interface in which visual content can be rendered. A display area can be defined by its position and dimensions, which can be static or dynamic.

[0060] A display area might correspond to, for example: to the entire screen when it is a full-screen display, to a specific window of an application, to a defined frame within the graphical interface, etc.

[0061] Within the framework of the proposed technique, the management of the masking of visual content is carried out on such a display area, whether it covers the entirety or only a portion of the interface.

[0062] The size and / or position of the display area can be determined based on an expected display location for the visual content to be hidden. This location may correspond to an area where the visual content to be hidden is usually displayed by an application or operating system.

[0063] For example, in the case of notifications, operating systems can define specific areas where these notifications appear, such as the bottom right corner of a computer screen, the top of a smartphone screen, or a floating pop-up bubble. In the case of advertisements displayed in a web browser, certain areas can be dedicated to banner ads at the top of a page, pop-ups, or videos embedded within the main content. In the case of multimedia or streaming applications, an interface can include a display area where content suggestions, playback controls, or service notifications can appear.

[0064] When the expected display location of the visual content to be hidden is known, the hiding management can be refined in several ways. For example, it is possible to manage one or more display areas with predefined size, position, and / or shape. Alternatively, it is possible to dynamically adjust the size and position of the display area, for example, based on a screen configuration, a usage mode (full screen or minimized window), or system settings, and / or to dynamically merge several adjacent display areas when relevant (e.g., when visual content to be hidden extends beyond the boundaries of one of the previously defined display areas).

[0065] It is also possible to manage multiple display areas jointly or separately, in order to simultaneously hide visual content superimposed on different parts of the same graphical interface. For example, several expected locations can be monitored in parallel, with or without a common hiding strategy.

[0066] Visual content refers to any information displayed on a graphical interface in the form of an image, text, animation, and / or any other element perceptible on the graphical interface. Visual content can include one or more elements, each of which can be, for example, one of the following types: text, button, icon, image, graphic, video, menu bar, window, cursor, actuator, etc.

[0067] A graphical interface relies on several hardware and software components that interact to produce a rendering of visual content.

[0068] In one example implementation, a display device, for example a screen or a projector, is combined with: a 32-bit central processing unit (CPU) and / or a graphics processing unit (GPU) configured to support computing, rendering, and display operations, and a random access memory (RAM) and / or a video random access memory configured to store, at least temporarily, the data necessary for rendering visual content.

[0069] Rendering visual content or an image refers to all the processes that transform digital data into a graphic representation that can be displayed on a screen or other display device. This process involves several steps:

[0070] An operating system or application generates instructions defining visual content to be displayed (including, for example, shapes, colors, textures, animations, etc.).

[0071] The instructions are converted, after processing by a central processing unit and / or a graphics processing unit, into usable data for display. This can include 2D / 3D rendering calculations, the application of visual effects, or the management of transparency and overlays.

[0072] The data usable for displaying visual content is temporarily stored in memory before being sent to the display device, so that the visual content is ultimately displayed in a specific display area.

[0073] The rendering can be continuously updated (for example in video games, videos, or animations) or be static, as in the case of a still image.

[0074] In certain situations, multiple visual elements may be intended to be displayed simultaneously in the same display area, creating a display conflict. This conflict can occur, for example, when two different applications each attempt to display visual content in the same screen area (e.g., a chat window appearing in front of a playing video), or when a single application attempts to display multiple overlapping visual elements, rendering some of them partially or completely invisible.

[0075] Operating systems and graphics engines have several mechanisms to manage these display conflicts, so that the final display is consistent and functional for the user.

[0076] One of the most common ways to manage these conflicts is through the use of superimposed, or stacked, rendering layers, which allow control over the display order of visual elements. A rendering layer is a graphical entity used to structure the display of visual content. Each layer can contain one or more visual elements, each occupying an associated display area on the graphical interface.

[0077] Rendering layers are rendered in a defined order, determining which visual content remains visible and which is hidden by others. The foreground (or top layer) is the rendering layer closest to the user, meaning it covers all other rendering layers behind it. The background is the rendering layer furthest from the user, meaning it is covered by all other rendering layers in front of it. The background can contain persistent elements, such as a wallpaper.

[0078] When multiple rendering layers are stacked, the visual content within those layers that occupy the same display area may partially or completely overlap. Visual content that is underlying another visual content is visual content belonging to a rendering layer located behind that other visual content. Visual content that is overlying another visual content is visual content belonging to a rendering layer located in front of that other visual content.

[0079] Consider a display system structured with two rendering layers, where each layer contains specific visual content. A first rendering layer, in the background, comprises a first visual content occupying an entire given display area, for example, a desktop background. A second rendering layer, in the foreground, comprises a second visual content displayed in front of the first visual content. In this example, the second visual content, overlaid on the first visual content, at least partially obscures the first visual content, which is itself overlaid on the second visual content.

[0080] Using superimposed rendering layers is not the only way to manage display conflicts in order to hide one visual content with another visual content without necessarily having an explicit hierarchy of rendering layers.

[0081] For example, instead of using a layered rendering overlay, the rendering of the second visual content can be overwritten on top of the first visual content, thus erasing the first visual content.

[0082] For example, instead of using a layered rendering overlay, the visual properties of the first visual content can be modified to achieve a rendering of the second visual content.

[0083] For example, instead of using a layered rendering architecture, priority levels can be defined. For instance, by using priority levels, it's possible to force a given window to remain displayed in the foreground, thus hiding any other application behind it, without resorting to explicit layer management. In the example considered, the first visual content can be assigned a first priority level, the second visual content a second priority level, and the display conflict can be resolved by comparing the first and second priority levels.

[0084] For example, the rendering of the first visual content can be suspended until certain conditions are met. Thus, in the event of inactivity, a screensaver, as an example of a second visual content, can prevent the rendering of the first visual content without requiring the use of rendering layers.

[0085] A representative image of visual content refers to an image that reproduces, in whole or in part, the visual appearance of visual content that will be or has been displayed on a graphical interface. This image can be obtained in various ways, including: by capturing the visual content, a rendering layer that includes the visual content, or a set of rendering layers that include the visual content, or by intercepting the visual content (i.e., obtaining the visual content before it is rendered) or a video stream that includes the visual content, or by reconstructing visual content resulting from such a capture or interception.

[0086] Within the proposed technique, a "representative image of a first visual content" is rendered in such a way as to mask a second visual content. This image is not representative of just any visual content, but rather of the first underlying visual content (for example, in terms of rendering layers) that underlies the second visual content displayed at the time the second visual content is rendered. In other words, when the second visual content is rendered onto a display area and overlays the first visual content, the rendering of the "representative image of the first visual content" is intended to visually restore the appearance of the first visual content in order to mask the second visual content.

[0087] Figure 1 represents a possible logical architecture for a device or system to manage a display area of ​​a graphical interface. This architecture comprises a series of logical modules defined by their function: a main module 10, a module 11 for acquiring the display area, a capture analysis module 12, a decision module 13, and a masking module 14.

[0088] The main module 10 is designed to coordinate the overall operation of a graphical interface display area management process. It manages interactions between other modules. It can also manage system parameters, configuration rules, and / or operational constraints.

[0089] Acquisition module 11 is designed to acquire images of the display area at regular intervals (periodic acquisition) or in response to a specific event (event-driven acquisition), such as when new content appears in the display area. The acquisition module thus generates a time series of successive images to analyze changes over time. The acquisition module may include an image capture module and / or a video stream interception module. Acquisition can, for example, be performed "over the top," meaning without interfering with the operation of the operating system and running applications.An "over the top" acquisition can, for example, be implemented by one or more cameras (e.g. webcams) capturing images of the display area on a screen and / or by one or more software probes tracking the display and its temporal evolution.

[0090] The analysis module 12 is designed to analyze one or more images acquired by the acquisition module. From these images, the analysis module extracts relevant features, such as the presence of overlapping visual content and / or specific properties of visual content. The analysis module may include an optical character recognition module, a graphic element detection module, a visual content type detection module, etc. The analysis can be performed immediately after capture or at a later time.

[0091] Decision module 13 is designed to determine whether or not masking should be applied to the display area. This decision can be implemented at various stages and takes into account the nature of the secondary visual content. A masking decision activates masking module 14, while a no-masking decision deactivates it.

[0092] The nature of the second visual content may include one or more of the following aspects: a type, for example text, an image, a video, an icon, an interactive button, a notification, an advertising banner, a pop-up window, a source or origin, for example a specific application (messaging, browser, operating system), a particular website, a third-party service, For example, a critical alert (low battery, emergency) may be considered more important than an application update notification. display behavior, for example persistent or ephemeral content, animated or static content, position, size or shape, for example content occupying the entire display area or only a part of it, an appearance, for example a degree of legibility, visual density, contrast, transparency or opacity, the presence or absence of interactive element(s), etc.

[0093] The decision can take into account not only the nature of the second visual content but also one or more contextual factors. For example, when a "do not disturb" mode is active, notifications deemed non-urgent can be systematically hidden, while critical alerts remain visible. Similarly, if a user is watching a video in full screen, the decision module 13 can adjust its criteria by prioritizing stricter hiding of visual interruptions.

[0094] A contextual factor can refer to a user context factor, such as obtained, for example, through a history of user interactions and indicating a recurring user behavior when faced with a variety of visual content (such as a habit of ignoring notifications of a certain type or, on the contrary, processing certain notifications of another type) or, for example, through a manual rule configured by a user and representative of a user preference.

[0095] A contextual factor can refer to a hardware and / or software context factor: For example, if a device including the user interface is in power saving mode, the management of masking can be optimized to reduce the activity of that device's processor and resource consumption.

[0096] The nature of the criteria that may guide a masking decision, as well as how several criteria can be taken into account jointly, are aspects that can vary considerably depending on the context of application of the proposed technique.

[0097] Indeed, the criteria for hiding notifications depend heavily on the context of use and the specific characteristics of the environment. For example, in a professional setting, a hiding criterion might be defined to prevent personal notifications from appearing on a shared presentation screen, while in a personal context, hiding notifications might be applied to filter out certain intrusive notifications without interrupting an ongoing activity. Similarly, hiding criteria may differ depending on whether the graphical interface is displayed on a computer, smartphone, television, tablet, or augmented or virtual reality headset.

[0098] When a masking decision is based on several criteria simultaneously, these can be taken into account using various strategies. For example, rules (of priority or combination, for example) can be defined, confidence thresholds can be set, adaptive learning can be implemented, etc.

[0099] As an example of a possible strategy, text extracted from the second visual element is compared with a list of keywords, and the second visual element is hidden when the text contains at least one keyword from that list. This strategy is relatively simple to implement and works well in environments where the content to be hidden is well-defined and identifiable based on a direct match with specific terms.

[0100] In one possible strategy, the second visual element is provided as part of a query to a classification model trained on a dataset containing images and annotations associated with categories of visual content to be hidden. This model can be trained to detect specific types of notifications (e.g., advertisements, promotional messages, non-critical system alerts), graphic characteristics specific to pop-up ads (e.g., layout of "Close" buttons, specific logos, colors associated with ads), and / or visual patterns indicating unwanted content (e.g., ad banners on videos, graphic elements overlaid on main content). The model can then be configured to generate a probability indicating whether the second visual element should be hidden. This strategy can offer several advantages.It can sometimes be more flexible than the keyword approach, as it can help recognize or classify visual content even if the exact text is not predefined. It can help dynamically adapt unmasking rules, particularly by using a model that continuously learns and improves over time. It can be used to mask content in complex environments such as videos or interactive interfaces.

[0101] A hybrid strategy may, for example, combine keyword filtering for masking decisions in some simple cases and the use of a classification model for masking or no-masking decisions in cases that keyword filtering is not sufficient to handle.

[0102] These examples are by no means exhaustive and should not be interpreted as limitations of the proposed technique. On the contrary, the masking criteria and their consideration by the decision module are not rigid but can be adapted to the specific needs of each environment.

[0103] The masking module 14 is designed to display an image representing the first visual content on the display area, in order to at least partially obscure a second visual content that is at least partially superimposed on the first visual content. The image used for masking is obtained from a previous acquisition of the display area. For example, the acquisition can be performed before the second visual content appears, more specifically at a time when the first visual content is visible on the user interface (for example, at a time when the first visual content is being rendered in the top rendering layer).

[0104] Depending on the implementation method, the masking module can be activated before or after the analysis.

[0105] The display area management device or system of the graphical interface may include additional functions beyond masking, allowing for user interaction management beyond simply hiding a second visual content.

[0106] In one embodiment, when the first visual content includes an interactive element, the image used for masking is a representative image of that interactive element. When this image is rendered on the display area, a redirection of the human-computer interaction is implemented so that an interaction with the displayed image is transferred to the corresponding interactive element of the underlying first visual content. For example, if the first visual content includes a video play button and a second visual content (e.g., an overlaid advertisement) appears on top of this button, an image representing the button's visual state can be displayed on the display area in place of the second visual content. When a user clicks on this image, the interaction is captured and transmitted to the actual button of the first visual content, so that the video starts normally without the user being aware of the masking.This additional feature preserves the functional integrity of the first visual content, even when masking is applied. It ensures that the user can continue to interact with the graphical interface as if no second visual content had been superimposed.

[0107] In one embodiment, the management system can detect recurring patterns in the appearance of certain secondary visual content and generate statistics or alerts for the user or a system administrator. If the same advertising content appears repeatedly despite being masked, a report can be generated indicating that a website or application is displaying an excessive amount of unwanted content.

[0108] Regarding the implementation of masking, several implementation methods are now described, placing ourselves in the following reference scenario.

[0109] At a first instant, the acquisition module 11 acquires a first image in which only a first visual content is rendered on the display area. At a second instant, the acquisition module 11 acquires a second image in which a second visual content is rendered in front of the first visual content, partially or totally covering it. Figure 2 represents the display area at a third instant, which, depending on the embodiment considered, may be identical to the second instant or later than the second instant. At the third instant, a rendering 21 of the first content is covered by a rendering 22 of the second content, and the rendering 22 of the second content is partially or totally masked by a rendering 23 of the first image.

[0110] In one embodiment, the masking module 14 is activated immediately after the second image is acquired, without waiting for analysis or a decision. To do this, the masking module renders the first image onto the display area. As a result, the second visual content is rendered but immediately masked by the image of the first visual content acquired at the initial instant, before the analysis module has even had time to examine it.

[0111] After analysis module 12 examines the second image and decision module 13 makes a ruling, two scenarios are possible. In the first scenario, the analysis of the second visual content confirms that it meets a criterion justifying its masking. Consequently, the decision is made to keep the first visual content's image displayed. In this case, masking module 14 remains active and continues to mask the second visual content. In the second scenario, the analysis of the second visual content reveals that it does not require masking, for example, because it does not correspond to a content type that should be masked. Consequently, the decision is made to deactivate masking module 14, causing the rendering of the first visual content's image to stop. The second visual content then becomes fully or partially visible in the display area.

[0112] In a variant of this embodiment, the masking module 14 is activated even before the second visual content is rendered. In other words, as soon as the first visual content is rendered on the display area (at the first instant), an image representing this first visual content is immediately displayed on the display area by the masking module 14. At the second and third instants, as shown in Figure 2, the second visual content is rendered on the display area but remains immediately masked since an image of the first visual content is already displayed as an overlay.

[0113] This embodiment has the advantage, thanks to immediate masking, of completely preventing the display of the second visual element before it is even analyzed. Thus, no unwanted content can be perceived by the user, even temporarily. However, this embodiment can lead to the temporary masking of visual content that did not need to be masked, since the decision to stop masking occurs after analysis.

[0114] In some embodiments, the masking module 14 is not activated immediately after the acquisition of the second image. As a result, the second visual content is rendered on top of the first visual content and remains displayed on the display area at least until the analysis and decision-making process is complete.

[0115] If masking is enabled, the masking module 14 renders an image corresponding to the first image acquired at the initial moment onto the display area. The second visual content is then masked, and the display is restored to its previous state. Conversely, if masking is disabled, the second visual content remains displayed.

[0116] This implementation avoids the unnecessary masking of visual content that does not need to be hidden. It also has the advantage of limiting unjustified display transitions, since masking only occurs when deemed necessary.

[0117] In some embodiments, the analysis of the second visual content is carried out in several successive phases, allowing for progressive decision-making and dynamic adaptation of the masking.

[0118] For example, as soon as an initial analysis result is available, the decision module 13 makes an early decision based on that initial result. This early decision may either immediately activate the masking module 14 or deactivate it pending a more complete analysis. Four scenarios are possible.

[0119] In the first scenario, the initial analysis result indicates that the second visual element is likely to be masked, and masking module 14 is immediately activated. Once the full analysis is complete, it confirms that the second visual element does indeed meet a masking criterion. Therefore, masking module 14 remains active, and the image acquired initially continues to be rendered on the display area.

[0120] In a second scenario, the initial analysis result indicates that the second visual element is likely content to be hidden, and the hiding module 14 is immediately activated. However, a full analysis reveals that the second visual element does not ultimately correspond to a content type requiring hiding. Consequently, the hiding module 14 is deactivated, and the image used for hiding is removed, thus making the second visual element visible.

[0121] In a third scenario, the initial analysis result is insufficient to determine whether the second visual element should be masked. Therefore, the masking module 14 is not activated immediately, and the rendered second visual element remains visible on the display area. When the complete analysis is finalized, it reveals that the second visual element should be masked. The masking module 14 is then activated, and the image acquired at the first instant is rendered onto the display area to mask the second visual element.

[0122] Finally, in a fourth scenario, the initial analysis result is insufficient to determine whether the second visual element should be hidden. Therefore, the hiding module 14 is not activated immediately, and the rendered second visual element remains visible in the display area. When the complete analysis is finalized, it confirms that the second visual element does not meet any hiding criteria. Consequently, the second visual element remains displayed without any hiding being applied.

[0123] This embodiment reduces reaction time when a preliminary clue is sufficient to anticipate necessary masking. It also provides dynamic correction capabilities, allowing for the invalidation of an erroneous anticipated decision. This embodiment offers a good compromise between speed of execution and accuracy of analysis, thus limiting the risk of unnecessary masking or prolonged exposure to undesirable content.

[0124] In a variant that can be combined with any of the described embodiments, the process takes into account the nature of the second visual content to adapt the rendering of the image of the first visual content.

[0125] In this variant, after the analysis module 12 identifies the nature of the second visual content, the decision module 13 chooses a specific rendering mode from among several possibilities based on this nature.

[0126] Some examples of modulations in image rendering depending on the nature of the second visual content are now described.

[0127] In one example, the second visual element is a low-priority notification (e.g., a non-urgent application update). The image of the first visual element is rendered with a semi-transparency effect, allowing the user to glimpse the second visual element without it being fully visible.

[0128] In another example, the second visual element is a clickable advertisement displayed as a pop-up. The image of the first visual element is rendered with total opacity and strict overlay, preventing any interaction with the advertisement and completely obscuring its content.

[0129] In another example, the second visual element is a critical system alert (e.g., low battery, important error message). No masking is applied; the image of the first visual element is not rendered so that the user can see and process the alert without obstruction.

[0130] In another example, the second visual element is an autoplaying video placed before the first visual element. The image of the first visual element is rendered with progressive animation (e.g., gradual fading rather than instant display) to limit an abrupt visual effect and avoid a sudden interruption in the video stream.

[0131] In another example, the second visual element is a temporary context menu (e.g., a floating menu that appears when hovering over an interactive element). The image of the first visual element is rendered only in specific areas, depending on the position and duration of the second visual element's presence, so as not to obscure essential menu items.

[0132] This variant therefore allows for the application of intelligent and adaptive masking, where the nature of the second visual content influences how the image of the first visual content is rendered rather than imposing binary masking (total or non-existent).

[0133] This variant can offer several advantages, including contributing to better management of visual interference and an improved user experience.

[0134] The way in which the image of the first visual content is rendered can be determined dynamically by the decision module 13, based on predefined rules, progressive learning, or a user-defined configuration.

[0135] Figure 3 illustrates a hardware architecture of a computer device 30 adapted to implement all or part of the modules of the device or the system for managing the display area of ​​the graphical interface.

[0136] This computer device includes a memory 31, a processor 32 and a communication interface 33.

[0137] The computing device 30 can be a local device, that is, a device that directly displays the graphical interface. This could be, for example, a computer, a smartphone, a tablet, a television, or an augmented or virtual reality headset. In this case, the device 30 is responsible for directly managing the display and applying the masking decisions.

[0138] The computer device 30 can also be a remote device, responsible for executing all or part of the functions of modules 10-14 without being directly responsible for the displayed graphical interface. It could, in particular, be a centralized control device for a single-screen or multi-screen environment, for example, a home automation hub or a display management platform in a corporate network.

[0139] In these configurations, the functions of the device or the system managing the graphical interface's display area can be distributed among several devices. For example, a local device can capture images and transmit the analysis data to a remote server, which performs the evaluation and decision-making, and then sends a command back to the local device to enable or disable masking.

[0140] Memory 31 is configured to temporarily or persistently store instructions executable by the processor 32, enabling the implementation of the various functions of the device or the system for managing the display area of ​​the graphical interface.

[0141] In the context of implementing the proposed technique, memory 31 can be configured, in particular, to store: an image acquired by the acquisition module 11, or a plurality of successive images forming a time series, and / or the image of the first visual content captured at a first instant, which can be used by the masking module 14 in the event of a masking decision, and / or a result of an analysis performed by analysis module 12, or results of such analyses, and / or one or more masking rules and / or one or more masking criteria, and / or a history of masking and non-masking decisions, etc...

[0142] The 32-bit processor is suitable for executing instructions stored in memory. It can be a central processing unit (CPU) and / or a graphics processing unit (GPU), depending on image processing requirements.

[0143] Within the framework of the proposed technique, the processor 32 can in particular be configured to implement the functions of the main module 10, the display area acquisition module 11, the capture analysis module 12, the decision module 13, and / or the masking module 14.

[0144] The processor 32 can be configured to drive the graphical interface display area by applying a masking decision or a no-masking decision.

[0145] For example, when a masking decision is made, the processor 32 can be configured to retrieve the image of the first visual content stored in memory and order the rendering of this image onto the display area, in order to mask the second visual content.

[0146] For example, when a no-masking decision is made, processor 32 can be configured to maintain the normal display area, leaving the second visual content visible and, if necessary, to ignore or remove any image rendering instructions for the first visual content in front of the second visual content.

[0147] The communication interface 33 allows the device 30 to exchange data with other devices or systems. It can use one or more wired network connection technologies (Ethernet, etc.), which may, for example, be specific to the rendering of visual content (HDMI, DisplayPort, Miracast, AirPlay, etc.) or wireless (Wi-Fi, Bluetooth, LTE, 5G, xG, etc.).

[0148] As part of the implementation of the functions of device 30, the communication interface 33 can in particular be configured to exchange captured images and / or analysis data with a remote server, for example, in an embodiment where analysis and decision-making are outsourced, the acquired images can be sent to a server responsible for evaluation and masking.

[0149] The communication interface can also allow the receiving and / or transmission of updates or new masking rules and / or new masking criteria.

[0150] The communication interface can also receive and / or transmit a command to activate or deactivate the masking module temporarily or permanently, for example at the request of a user.

[0151] When a decision to mask or not mask is made by device 30, the communication interface 33 can be used to: send an update to a remote server to adapt masking criteria based on decisions made locally (for example, according to the principle of federated learning), receive validation and / or correction from a remote device or system (for example, if device 30 is configured to implement a simple analysis of acquired visual content and make a preliminary decision to mask or not to mask, and if the remote device or system is configured to implement a complementary analysis of this acquired visual content and make a final decision to mask or not to mask).

[0152] Implementations of the process described in this disclosure for masking visual content, such as a notification, have been detailed above. Of course, the process described in this application can be implemented to mask visual content other than notifications, such as sensitive information. For example, the process can be used to mask a password (e.g., to mask entries made in a user field intended to contain a password).

[0153]

Claims

Demands

1. A method for managing the display of a graphical interface, the method comprising, during a rendering (22), in front of a first visual content, of a second visual content: a rendering (23) of an image on said graphical interface causing a masking of said second visual content.

2. Method according to claim 1 wherein said image is representative of the first visual content.

3. A method according to claim 1 or 2 wherein the rendering of the image takes into account a nature of the second visual content.

4. A method according to any one of claims 1 to 3, wherein the rendering of the image is triggered independently of the nature of the second visual content, and the nature of the second visual content is taken into account when rendering the second visual content to maintain or interrupt the rendering of the image.

5. A method according to any one of claims 1 to 3, wherein the image rendering is triggered taking into account the nature of the second visual content.

6. A method according to any one of the preceding claims, wherein the nature of the second visual content is obtained from an analysis of a capture of at least one rendering layer including the rendering of the second visual content.

7. A method according to the preceding claim, wherein the analysis includes optical character recognition and / or graphic element detection applied to the capture of at least one rendering layer including the rendering of the second visual content.

8. A method according to any one of the preceding claims, wherein the image is obtained from a capture of at least one rendering layer including the rendering of the first visual content or from an interception of a video stream including the first visual content.

9. A method according to any one of the preceding claims, wherein the image rendering is updated periodically and / or after an event.

10. A method according to any one of the preceding claims, wherein the second visual content includes a notification.

11. A method according to any one of the preceding claims, wherein the first visual content includes an interactive element, the image is representative of the interactive element and the method includes, during image rendering, a redirection of a human-machine interaction with the display area to the interactive element.

12. A method according to any one of the preceding claims, wherein the display area has a size and / or position corresponding to an expected display location of the second visual content.

13. A display management device for a graphical interface, the device comprising a processor (32) configured for rendering (23) on said graphical interface, during rendering (22), in front of a first visual content, of a second visual content, of an image causing a masking of said second visual content.

14. Device according to claim 14 wherein said image is representative of the first visual content.

15. Device according to claim 13 or 14 wherein the rendering of the image takes into account a nature of the second visual content.