METHOD FOR DISPLAYING AD CONTENT ON A FIRST SCREEN
The method addresses the challenge of displaying content across different aspect ratios by analyzing and adapting to show only the relevant section, improving readability and user convenience in screen presentations.
Patent Information
- Application Number
- DE102023111484
- Authority / Receiving Office
- DE · DE
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-03
- Publication Date
- 2024-11-07
AI Technical Summary
Existing methods fail to effectively display content optimized for one screen aspect ratio on screens with different aspect ratios, leading to readability issues and user inconvenience in adjusting the content manually.
A method that analyzes and displays only the relevant section of the content on a first screen, utilizing techniques such as cursor position, semantic analysis, and screen segmentation to determine the current focus of the presentation, and adjusts the display accordingly.
Ensures clear visibility of the relevant content without manual user intervention, enhancing user experience by automatically adapting to the screen's aspect ratio and focus changes.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical area
[0001] Embodiments relate to methods for displaying a display content on a first screen. Further embodiments relate to a computer program product with program code for executing the method. background
[0002] Modern motor vehicles are increasingly equipped with screens or monitors for displaying content, such as vehicle displays for the driver, front passenger, or rear seat passengers. These screens or displays often have specific aspect ratios, which may differ from the aspect ratios of conventional desktop monitors.
[0003] It is known that screen content can be compressed, stretched, scaled up, or scaled down, with or without respecting the original aspect ratio. This allows content originally optimized for other monitors to be displayed on vehicle monitors.
[0004] For example, if a slide presentation (e.g., in an online meeting) is displayed on a vehicle monitor (e.g., the first monitor) whose aspect ratio and / or screen resolution differs significantly from the computer monitor (e.g., the second monitor) from which the presentation is being sent, the content will be either completely unreadable or difficult to recognize for the recipient. The recipient must then make adjustments themselves (e.g., zoom in, pan) to clearly see the content. This is especially true if the recipient's monitor (e.g., in the vehicle) is smaller than the sender's monitor (e.g., the presenter's monitor at the desk). Summary
[0005] It is an object of the present disclosure to provide improved concepts for displaying display content, in particular from the field of screen presentations, on screens with different aspect ratios.
[0006] This object is achieved according to the subject matter of the independent patent claims. Further advantageous embodiments are described in the dependent patent claims, the following description, and in conjunction with the figures.
[0007] Accordingly, a method for displaying display content on a first screen is proposed. The method comprises receiving the display content, wherein the display content is optimized for a second screen that has a different aspect ratio than the first screen. The method further comprises analyzing or determining a relevant section of the display content and displaying exclusively the relevant section on the first screen.
[0008] For example, the display content may include a presentation slide from a slide show being delivered by a speaker on the second screen. The display content may have been created for the aspect ratio of the second screen, resulting in it being unreadable, difficult to read, or only partially displayed on screens with different aspect ratios, according to other concepts.
[0009] The proposed method takes advantage of the fact that in many cases not the entire display content is fully and constantly relevant, but only partial content, e.g. relevant excerpts, and / or relevant areas of the display content change temporarily. The relevant excerpt can therefore change over time, for example if the speaker first addresses a first part (e.g. upper area) of the presentation slide and then a second part (e.g. lower area). It is therefore often sufficient if the viewer of the presentation can only see the relevant excerpt of the display content on the first screen. According to the method, it can advantageously be determined which part of the display content (e.g. part of an image file or presentation slide) is currently relevant, so that precisely this area can be shown or displayed well on the first screen. For example, moving and / or enlarging or shrinking can be achieved.The display content can be reduced in size so that only the relevant section is shown on the first screen. This can prevent the user or viewer from having to manually move and / or enlarge or reduce the display content.
[0010] According to one aspect, for example, the display content comprises a slide presentation. The method can be particularly well-suited for slide presentations, since the focus of a presentation slide frequently shifts during the presentation, so continuously analyzing the currently relevant section and automatically displaying precisely this relevant section can be particularly beneficial for the user. The user can then, for example, concentrate better on the presentation.
[0011] According to one aspect, for example, the display content includes a cursor, wherein the position of the cursor within the display content is determined for analyzing the relevant section. During an online presentation, a speaker often uses a cursor or mouse pointer to indicate on their slides which part of the slide is currently relevant (e.g., by circling relevant areas). This can be advantageously used according to the method to easily determine the position or average position (e.g., when the presenter continuously circles) of the relevant section.
[0012] According to one aspect, for example, it is provided that a predetermined pixel range around the position of the cursor is displayed as the relevant section on the first screen. For example, the display on the first screen can be such that the display content is continuously shifted so that the position of the cursor is always in the center of the first screen. Advantageously, alternatively, the display content can only be shifted if the cursor moves more than a predetermined distance (e.g., more than 50 pixels or more than 100 pixels). Alternatively and / or additionally, a speed and / or acceleration of the mouse pointer / cursor can advantageously also be used as a basis for shifting the display content. For example, it can be provided that the display content is only shifted if the acceleration of the cursor is above a predetermined limit.The movement of the display content can also be linked to the acceleration of the cursor. For example, the speed and / or acceleration of the movement of the display content can be designed to be comfortable for the user, for example, by using so-called easing. This way, jerky movements can be avoided when moving the relevant section. In other words, a change to the relevant section can only occur when a threshold value is exceeded. This way, for example, constant movement of the display content can be avoided.
[0013] According to one aspect, for example, it is provided that the display content is divided into at least two segments with different formal and / or semantic content. Formal content can be differentiated, for example, by its characteristics; for example, text elements, images, graphic representations and diagrams can be differentiated and divided into different segments. For example, a first segment can have a text block and a second segment an image. For example, a presentation slide with several diagrams can be divided into a segment for each diagram. For example, an image can be divided into several segments if different objects (e.g. different semantic content) can be seen on the image. The currently most relevant segment of the at least two segments can be displayed as the relevant section on the first screen.
[0014] According to one aspect, for example, it is provided that an audio output associated with the display content is semantically analyzed, wherein a semantic analysis of the display content is carried out to analyze the relevant section, wherein the relevant section is displayed which semantically corresponds to the audio output. In a screen presentation, the slide shown is often described verbally by a speaker. The speaker can use keywords such as "table", "diagram" or "figure" and thus describe the currently relevant section of the presentation slide in the linguistic description. If a semantic analysis of the display content shows that, for example, a table or a diagram is shown on the presentation slide, it can be concluded from the analysis based on the match in terms that the area with the same content is the currently relevant section.If a figure depicts a circle and a square and the speaker is talking about a circle, the circle can be displayed on the first screen due to the semantic correspondence of the term “circle”.
[0015] According to one aspect, for example, the semantic analysis of the audio output includes speech recognition. This allows for automated analysis of which areas of the display content the speaker currently considers relevant and describes in words.
[0016] According to one aspect, for example, the semantic analysis of the display content is carried out using text recognition and / or image recognition. This analysis allows different contents (e.g. text blocks, images, diagrams) to be semantically analyzed, allowing a comparison with the terms currently used by the speaker. By comparing the analyzed terms, a similarity between the linguistic terms and the semantic content presented in the display content can be determined, and thus the relevant section can be identified, e.g. even if the speaker does not use terms that are exactly shown on the slide, but only similar terms (e.g. diagram instead of bar chart or image instead of drawing).
[0017] According to one aspect, for example, it is provided that a vehicle screen is used as the first screen. The method can advantageously be used in vehicles, since screens with special aspect ratios (e.g., adapted to the shape of the vehicle seat) are often used in the vehicle sector. With the increasing degree of automated driving, monitors in the vehicle can increasingly be used for work and, for example, for viewing presentations. In order to provide the vehicle occupant with an improved display on the vehicle screen, the proposed method for automatically selecting and displaying exclusively relevant areas of the display content on the vehicle screen can advantageously be implemented.
[0018] According to one aspect, for example, it is provided that a user request is issued to rotate the first screen or the first screen is rotated automatically if the relevant section can be displayed over a larger area in the rotated state of the first screen than in the non-rotated state. By rotating the first screen by 90°, the aspect ratio can be inverted (if the width to height aspect ratio is not equal to one). For example, an aspect ratio that is greater than one before rotation is less than one after rotation by 90°, which can be advantageous if the aspect ratio of the relevant area is also less than one. As a basis for issuing the user request or for automatic rotation, the method can provide for analyzing the current aspect ratio of the relevant area of the display content and comparing it with the aspect ratio of the first screen.Advantageously, the user prompt can only be issued if the first screen is rotatable, in order to avoid user confusion if the first screen cannot be rotated at all.
[0019] A further aspect relates to a computer program product or non-volatile storage medium with a program code for executing the method described above or below when the computer program is executed on a processor, a computer, or programmable hardware. Such a program can advantageously be executed on an on-board computer of a vehicle or a backend (e.g., a server or cloud service coupled to the vehicle and / or a mobile device of the vehicle user) to execute the proposed method and enable a better representation of the display content on the first screen. Short character description
[0020] Exemplary embodiments are explained in more detail below with reference to the accompanying figures. They show: Fig. 1 is a flowchart of a method for displaying display content; Fig. 2 a schematic example of a first and second screen with different aspect ratios; Fig. 3 a schematic example of a transmission of a display content between two screens with different aspect ratios according to the prior art; and Fig. 4 a schematic example of displaying only a relevant section of a display content on a screen. Description
[0021] Various embodiments will now be described in more detail with reference to the accompanying drawings, in which some embodiments are illustrated. In the figures, the thickness dimensions of lines, layers, and / or regions may be exaggerated for clarity. In the following description of the accompanying figures, which only show some exemplary embodiments, like reference numerals may designate like or comparable components.
[0022] An element described as being "connected" or "coupled" to another element may be directly connected or coupled to the other element, or may have intervening elements present. Unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as one of ordinary skill in the art to which the embodiments belong.
[0023] Fig. 1 shows a flowchart of a method 10 for displaying display content on a first screen. The method 10 comprises receiving 11 the display content, wherein the display content is optimized for a second screen that has a different aspect ratio than the first screen. Furthermore, a relevant section of the display content is analyzed 12 and exclusively the relevant section is displayed 13 on the first screen.
[0024] One idea underlying this disclosure is that the currently relevant (partial) content of a screen presentation is recognized and then this (partial) content (e.g., the relevant section of the display content) is displayed in a clearly recognizable / readable manner on the recipient's screen (e.g., the first screen). This can be achieved by displaying only the relevant content.
[0025] The disclosure is described below using two screens as an example, but several receiver screens with different aspect ratios / screen resolutions can also be used, on each of which the proposed method can be carried out separately.
[0026] Fig. 2 shows a schematic example 20 of a first and second screen with different aspect ratios. An aspect ratio is formed by the ratio of the width of the screen to the height of the screen. The first screen D1, on which the received 11 display content can be shown 13, has, for example, a first aspect ratio of width w1 to height h1, while the second screen D2 has a second aspect ratio of width w2 to height h2. The first aspect ratio is smaller than the second aspect ratio. In particular, the aspect ratios of the two screens D1, D2 are different, and both the two screen heights h1, h2 and widths w1, w2 can differ from one another.
[0027] It is intended that the first screen D1 is intended to display content, in particular a presentation, which is sent from a computer using the second screen D2 (e.g., sent via an online meeting to the receiving computer, e.g., the on-board computer, using the first screen D1). The first screen can be arranged, in particular, in a vehicle as a vehicle display, and the display content can be received by the vehicle's on-board computer.
[0028] Further details and aspects are mentioned in connection with the embodiments described above or below. Fig. 2 may comprise one or more optional additional features corresponding to one or more aspects that may be associated with the proposed concept or with one or more of the above (e.g. Fig. 1) or below (e.g. Fig. 3-4) described embodiments are mentioned.
[0029] Fig. Figure 3 shows a schematic example of a transmission of display content (text, image) between two screens D1, D2 with different aspect ratios according to the prior art. The screen content received by the second screen D2 comprises a text block (text) and a graphic representation (image).
[0030] On the first screen D1, the display content is usually shown in the following two ways: Only a section of the screen content is shown (see schematic representation in Fig. 3, in which the text block and the graphic image in their original size do not fully fit within the width w1 of the first screen D1 due to the larger width of the second screen D2. In this case, the text can be displayed in a readable size, for example, but the user on the receiving screen D1 must select and move the screen section themselves in order to view all areas of the text block one after the other.
[0031] Alternatively, the screen content can be scaled down (not displayed) so that everything is visible. This can, for example, make text difficult to read because it is displayed very small.
[0032] Further details and aspects are mentioned in connection with the embodiments described above or below. Fig. 3 may comprise one or more optional additional features corresponding to one or more aspects that may be associated with the proposed concept or with one or more of the above (e.g. Fig. 1-2) or below (e.g. Fig. 4) described embodiments are mentioned.
[0033] Fig. Figure 4 shows a schematic example 40 of displaying only a relevant section of display content on a screen. In order to Fig. To avoid the disadvantages described in section 3, the method 10 proposes that the relevant section of the current screen content be detected or analyzed 12. This detection can be performed in various ways: For example, the position of an input device can be detected. For example, the position of the mouse pointer (cursor) can be used to determine the relevant section. For example, a specific area around the mouse pointer (e.g., 500x500 pixels) can be declared as relevant. Alternatively, the screen content can be segmented so that the screen content is divided into contiguous text blocks, images, diagrams, etc. If the mouse pointer is now over the first text block, the entire first text block is declared as relevant.
[0034] Alternatively or additionally, speech recognition and matching with the screen content can take place: The speech of the speaker presenting the screen presentation takes place. The content (semantic content of the display content) on the screen of the sender of the display content is also recognized. The text (e.g. text block text) is either available in raw form, or it can be determined from image data, for example, using text recognition (optical character recognition). For example, with the help of machine learning, images can be classified or objects in images can be recognized. For example, if two animals are shown on a page or presentation slide, their position and dimensions can be determined.
[0035] The language spoken by the speaker is then linked to the content displayed on the screen. If the speaker speaks a different language than the textual content displayed on the screen, a translation can be performed. For example, keywords in the spoken language can be identified. If the speaker says "giraffe," for example, the image section containing the giraffe is classified as relevant.
[0036] Alternatively, the similarity of texts can be compared using natural language processing (especially semantic text matching); this means that the speaker does not have to pronounce the exact words that appear in one of the text blocks, but can also use a synonym; one possible implementation is, for example, using "SentenceTransformers."
[0037] After determining the relevant section of the display content, the relevant section is automatically moved and zoomed in or out on the receiver screen so that the relevant screen section is displayed in a clearly legible / recognizable manner on the receiver screen.
[0038] In the example 40 of the Fig. 4, a display content comprising two segments G, E is received from the second screen D2. The display content G, E is a screen presentation, and the system with the first screen D1 also receives an audio data stream with the spoken description of the presentation for the display content G, E. The semantic analysis of the display content in this case shows that two images are displayed as segments G, E, with the first image segment G representing a giraffe and the second image segment E representing an elephant. The semantic analysis of the spoken description of the presentation can show that the speaker is currently talking about the topic complex “giraffe.” Consequently, it can be concluded that the currently relevant section of the display content concerns the first image segment G. On the first screen D1, therefore, only the first image segment G can advantageously be displayed 13 as the relevant section G.
[0039] Further details and aspects are mentioned in connection with the embodiments described above or below. Fig. 4 may comprise one or more optional additional features corresponding to one or more aspects that may be associated with the proposed concept or with one or more of the above (e.g. Fig. 1-3) or embodiments described below.
[0040] Examples relate to a method for automatically adjusting the screen section of slide presentations. The relevant screen section can be detected - centrally on a server and / or - on the presenter's computer (e.g., sender of the display content) and / or - at the respective recipient. If the screen orientation of the recipient (e.g., first screen) is variable, - the screen can be rotated automatically (e.g., by a motor) and / or - the user can be prompted to rotate the first screen D1 in order to achieve better readability of the currently relevant content (e.g., relevant section G).
Claims
[1] Method (10) for displaying a display content (G, E) on a first screen (D1), the method (10) comprising: - receiving (11) the display content (G, E), wherein the display content (G, E) is optimized for a second screen (D2) having an aspect ratio different from the first screen (D1); - analyzing (12) a relevant section (G) of the display content (G, E); and - Displaying (13) only the relevant section (G) on the first screen (D1). [2] Method (10) according to claim 1, wherein the display content (G, E) comprises a screen presentation. [3] Method (10) according to claim 1 or 2, wherein the display content (G, E) comprises a cursor, wherein the analysis (12) of the relevant section (G) is carried out based on the position of the display content (G, E) at which the cursor is positioned. [4] Method (10) according to claim 3, wherein a predetermined pixel area around the position of the cursor is displayed (13) as the relevant section (G) on the first screen (D1). [5] Method (10) according to one of the preceding claims, wherein the display content (G, E) is divided into at least two segments with different formal contents (text, image), wherein the currently most relevant segment of the at least two segments (text, image) is displayed (13) as the relevant section (G) on the first screen (D1). [6] Method (10) according to one of the preceding claims, wherein an audio output associated with the display content (G, E) is semantically analyzed, wherein the analysis (12) of the relevant section (G) comprises a semantic analysis of the display content (G, E), wherein the relevant section (G) of the display content (G, E) is displayed (13), which semantically corresponds to the audio output. [7] Method (10) according to claim 6, wherein the semantic analysis of the audio output comprises speech recognition. [8] Method (10) according to claim 6 or 7, wherein the semantic analysis of the display content is carried out by means of text recognition and / or image recognition. [9] Method (10) according to one of the preceding claims, wherein a vehicle screen is used as the first screen (D1). [10] Method (10) according to one of the preceding claims, wherein a user request is issued to rotate the first screen (D1) or the first screen (D1) is automatically rotated if, in the rotated state of the first screen (D1), the relevant section (G) can be displayed over a larger area than in the non-rotated state. [11] Computer program product or non-volatile storage medium with a program code to carry out the method (10) according to any one of the preceding claims when the computer program is executed on a processor, a computer, or programmable hardware.
Citation Information
Patent Citations
JP002006018282A
