Display apparatus and method for operating same
Patent Information
- Application Number
- EP2023805463
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-30
- Filing Date
- 2023-11-02
- Publication Date
- 2025-10-29
AI Technical Summary
Existing display devices, especially in vehicles, face limitations in user interaction due to the need to physically reach all areas of large or wide display elements, leading to reduced flexibility and increased user distraction, as users can only select areas they can touch from their viewing position.
A display device with a high-resolution main display element and a lower-resolution, invisible control panel or selection display element, allowing users to select areas out of reach by using a touch function, with dynamic window resizing and prioritization of content for improved usability and safety.
Enables intuitive and distraction-reduced interaction with large display areas by allowing selection of all display elements, even those out of reach, while maintaining high-resolution clarity and reducing fingerprint interference on the main display.
Smart Images

Figure 1.1
Abstract
Description
[0001] Description
[0002] Display device and method for operating it
[0003] The present invention relates to a display device, in particular with an invisible control panel, and a method for operating the same.
[0004] US 2017 / 024 106 A1 relates to a user interface with customization of a display representation. In this case, the display representation on a display element is split by a longer press (also referred to as a "long press") on an area within the display element. A horizontal division of the display representation occurs at the point where a user has positioned the long press. A display window to be displayed in an area of the split display representation is selected by selecting a placeholder (also referred to as an "icon") by a user touching the placeholder on the display element. Assignment to the desired area of the split display representation is performed by dragging the placeholder while still touched into this area. Confirmation of the assignment is performed by ending the touch, i.e., by releasing the placeholder in this area.A disadvantage is that the user can only select the areas of the display element that he can reach for touching from his viewing position.
[0005] US 2016 046 188 A1 relates to an information display system. Splitting a display representation is not done by holding down the touch but by touching a placeholder displayed on a display element, dragging the touched placeholder to a desired location on the display element, and releasing the placeholder at that location (also known as "drag and drop"). Here, too, the user can select only those areas of the display element that are within reach of the touching position.
[0006] CN 106 959 831 A concerns a display element with a split screen. Switching between split screen modes is achieved by pressing and holding the area of the display that is desired for magnification. Here, too, the user can only select the areas of the display element that are within touching range from their viewing position.
[0007] US 6,008,809 A shows a display device with a split display representation in which a dynamic size adjustment of display windows takes place.
[0008] If the size of a display window falls below a minimum size, it is replaced by a placeholder. US 2020 / 0356427 A1 concerns a split display in which the size of display windows can be changed by moving a touch point of multiple display windows.
[0009] An improved display device and an improved method for operating it are desired.
[0010] This is achieved according to the invention by the combinations of features specified in the independent claims. Advantageous further developments are specified in the dependent claims.
[0011] A display device according to the invention comprises a main display element for displaying in high resolution, and a disappearing control panel with a selection display element with touch function and display in a lower resolution than the main display element. This has the advantage that the user can use the selection display element to select areas of the main display element that they cannot reach for touch from their viewing position. The main display element can be very wide or positioned so far in front of the user that the user cannot, or only with difficulty, reach its entire surface with their finger to make a selection there. The selection display element is positioned closer to the user and is therefore easier to reach. Advantageously, the main display element does not become soiled by fingerprints, which are inevitable with a touchscreen function. It retains its high brilliance.On the selection display element, impairment by fingerprints is less of a problem.
[0012] According to one embodiment, the main display element is a color display element, and the selection display element is a lower-resolution or monochrome display element. This has the advantage that such a selection display element can be implemented without great effort as a disappearing control panel, also known as an invisible control panel. In this case, no great effort is required regarding color fastness or color change due to the surface layer of the disappearing control panel.
[0013] According to one embodiment, the selection display element is smaller than the main display element. Operation by the user is particularly convenient if the user's hand does not have to make large movements to reach all areas of the selection display element.
[0014] According to one embodiment, the selection display element is arranged below the main display element. This has the advantage that the user does not have to raise their hand very far to touch the selection display element.
[0015] It is particularly advantageous if
[0016] - the main display element has such an extension and is arranged with respect to an intended viewer position in such a way that a viewer cannot reach every part of the display surface of the main display element with one of his fingers from the intended viewer position, and at the same time
[0017] - the selection display element has such an extension and is arranged with respect to a designated viewer position that a viewer can reach any part of the display area of the selection display element with one of their fingers from the designated viewer position. In particular, the horizontal extension of the main display element can be designed to be very large.
[0018] A further development of a display device according to the invention comprises a control device and a memory device in which information about priority image elements or about priority and subordinate image elements is stored. This has the advantage that, when reducing the size, the control device can access the information stored in the memory device regarding the priority of an image element to be displayed. A high-priority image element is then displayed or changed differently when reduced in size than one with a lower priority. Preferably, there is both information about image elements that is stored in the memory device in an unchangeable manner and changeable information. The former is, for example, information about the security relevance of an image element. Such information should not be changeable or manipulable. Other types of information, however, are changeable.These can be updated or replaced with other information, for example, as part of an update. This makes it possible to update the behavior of the display device and / or adapt it to the user by updating information stored in the storage device.
[0019] A method according to the invention for operating a display device relates to a main display element configured to display multiple display windows side by side, and a selection display element configured to display multiple small representations of display windows that can be displayed on the main display element. This method comprises:
[0020] - Detecting whether a touch of one of the representations lasts for a longer period than a predetermined first minimum period,
[0021] - Classifying the corresponding representation as a selected representation,
[0022] - reducing the size of at least one of the display windows currently displayed on the main display element, and - displaying a display window corresponding to the selected representation on the area of the main display element freed up by the reduction.
[0023] Advantageously, content on the main display element can be compressed like an accordion, but can also be expanded again without having to ensure that it is accessible to the user's finger. Expansion is preferably triggered by a further, long-press on a representation. However, other options, such as a selection for removing a display window from the main display element, such as quickly double-tapping the corresponding representation or dragging the corresponding representation up or down, can also be useful here.
[0024] A method according to the invention for operating a display device relates to a selection display element that has multiple selection areas and is configured to display multiple representations side by side. It comprises: detecting whether a touch on a selection area assigned to a representation lasts for a period longer than a predetermined second minimum period. If this is the case, the corresponding selection area is classified as a selected selection area.
[0025] Subsequently, at least one of the representations currently displayed on the selection display element is reduced in size, and then the representation corresponding to the selected selection area is displayed on the area of the selection display element freed up by the reduction. The inventive advantage of the accordion effect when adding or removing display windows or representations can also be achieved if the selection display element is operated without an associated main display element.
[0026] In contrast to solutions in which the external dimensions of several display windows are variable but the size of the displayed content remains constant, the invention provides for the size of the displayed content of at least one of the display windows to be dynamically adjusted. This also changes the external dimensions of at least one display window. There are provisions for specifications as to the extent to which or the manner in which a display window is to be reduced in size. For example, types of display windows are provided which are only reduced to a certain minimum percentage because a greater reduction in the size of the image content displayed therein would restrict its recognizability too much. For example, types of display windows are provided whose contents are compressed in a certain preferred direction when reduced in size, i.e. which are compressed horizontally, for example.
[0027] A method according to the invention for operating a display device relates to a selection display element configured to display multiple representations side by side. It comprises:
[0028] - Detecting whether a touch of a selection area assigned to a representation lasts for a longer period than a predetermined second minimum period,
[0029] - Classifying the corresponding selection area as a selected representation,
[0030] - Reduce the size of at least one of the representations currently displayed on the selection indicator and
[0031] - Display the selected representation on the area of the selection display element that has been freed up by reducing the size.
[0032] Advantageously, content on the selection display element can be compressed like an accordion, but can also be expanded again. Expansion is preferably triggered by a repeated, long-press on a representation or a selection area assigned to the representation. However, other options for removing a representation from the selection display element, such as quickly double-tapping the corresponding representation or its associated selection area, or dragging the corresponding representation up or down, can also be useful here.
[0033] Advantageously, to reduce the size of an image currently on the
[0034] To shrink the display window displayed on the main display element, its vertical dimension is maintained and its horizontal dimension is reduced. Similarly, to shrink a representation currently displayed on the selection display element, its vertical dimension is maintained and its horizontal dimension is reduced. This creates an accordion effect that does not require any overly abrupt changes in the display, thus being easy to understand and causing little or no irritation for the user.
[0035] Advantageously, when reducing a display window or representation below a specified minimum size, at least one of the image elements displayed in this display window or representation is replaced by a placeholder image element of reduced complexity or is completely removed from the display. This prevents excessive distortion of the image elements, which would make them almost unnoticeable to the user. In this case, it is advisable to replace individual image elements with a placeholder image element that is less complex in its design and thus still easily recognizable to the user while requiring little space. Removing an image element entirely from the display creates space so that other, remaining image elements can be displayed in a less compressed manner. When space becomes "tight," unimportant image content is removed from the display.
[0036] Advantageously, when reducing the size of the display windows or representations, different display windows or representations are reduced to different degrees. This has the advantage that information displays of high importance or those that are difficult to recognize at greater reduction are not reduced, or are reduced only slightly so that they remain clearly visible. For example, a display window or representation with information displays required for driving the vehicle is reduced to a lesser extent than one without such information displays.
[0037] Advantageously, priority image elements and subordinate image elements are predefined. When a display window or representation is reduced in size, the priority image elements displayed in this display window or representation retain their length-to-width ratio and / or their size, and at least one of the subordinate image elements is compressed in at least one direction or replaced by a placeholder image element of reduced complexity, or is removed completely from the display. This has the advantage that safety-relevant or frequently used image elements remain unchanged and thus retain a high recognition value. This increases safety, particularly in automotive applications.
[0038] A further development of a method according to the invention further comprises: detecting whether one of the representations or a selection area assigned to a representation is touched over a short, uninterrupted period of time. If this is the case, classifying the corresponding representation as a priority representation and replacing one or more of the currently displayed display windows or representations with the display window assigned to the priority representation or with the priority representation. This has the advantage that an urgently required display is presented by a fast, yet unambiguous command without a great time delay, and by replacing one or more currently displayed display windows or representations, a large amount of space is also available for the display. Information desired as a priority is thus also presented with priority.
[0039] When reducing the size, the relative arrangement of the image elements is advantageously changed. This makes it possible to compress a display window or representation in one direction without also compressing the shape and dimensions of the image elements contained therein. Advantageously, the changed relative arrangement only reduces the space between the individual image elements, not the shape or size of the image elements.
[0040] Advantageously, the one or more display windows arranged between a leftmost display window and a rightmost display window are displayed on the main display element according to the one or more representations assigned to it. This offers the advantage of a consistent display on the main and selection display elements. Potential misunderstandings on the part of the user are reduced, thus increasing security.
[0041] According to the invention, it is possible to add any display windows or representations that are shown on the selection display element, for example as a main or submenu item, to the main display element and / or the selection display element by pressing and holding a corresponding selection area or a corresponding representation. This also enables a mixed display of display windows that originate from different sources. For example, these are an on-board climate control display of a motor vehicle that runs on its operating system and, for example, a display of applications that are designed to run on an operating system (such as Android) of a mobile device. According to the invention, it is possible for the content of the main display element and / or that of the selection display element to be expanded or collapsed like an accordion. Up to five additional display windows orRepresentations are provided that can be added to the main display element and / or the selection display element. In this case, the compression of the individual display windows or
[0042] Representations are not yet so strong that they are no longer perceived correctly by the user. Additionally, the display windows or representations are compressed in terms of content and behave "responsively," meaning that, for example, less important image content is removed from the display when space becomes "tight."
[0043] A particularly useful detail is the "accordion effect" that occurs when display windows or representations are added or removed. A so-called bounce effect is advantageous here, where expansion or contraction does not occur at a constant speed and ends abruptly, but rather at a variable speed. Additionally or alternatively, an overshoot is provided at the end of the expansion or contraction. In this case, the display windows or representations initially contract slightly further than necessary, leaving slightly more space than required for the display window or representation to be added, and then expand again to the required size once the addition has been completed. This allows the user to more easily see where the added element (display window or representation) will be placed.This also makes it easier to determine whether the addition process is still in progress or has already been completed. A similar procedure is provided for removal, with the remaining elements initially contracting, i.e., moving away from the element to be removed, before expanding to their intended size and position. Here, too, a swayback is provided, with individual display windows potentially briefly overlapping. This also makes it easier for the user to intuitively grasp the process.
[0044] The distribution concept for the screen content is also advantageous. According to one variant of the invention, the selection display element exclusively offers options for controlling the main display element with a simplified representation. This is sometimes also referred to as "Just Controls." In this case, the corresponding visualization takes place on the main display element. In this case, each element in the main display element has a control area in the selection display element, even in the example with the accordion effect. Individual elements of the accordion can be conveniently removed from the chain by closing the corresponding button.
[0045] According to a further aspect of the invention, a computer program comprises instructions that, when executed by a computer, cause the computer to execute the steps for controlling a method according to the invention. The term "computer" is to be understood broadly. In particular, it also encompasses control units, embedded systems, and other processor-based data processing devices. The computer program can, for example, be provided for electronic retrieval or stored on a computer-readable storage medium.
[0046] There are many ways to interact with a display device. The present invention solves the problem of dynamically dividing the area available for display between multiple elements to be shown, display windows or representations. Until now, static options for dividing these areas have been known. Several sub-areas have fixed sizes. This is familiar from smartphones or tablets. The available area can be divided into two or more sub-areas. The content previously displayed on the undivided area is now displayed on one of these sub-areas. For the other, still unused sub-areas, it is necessary to select what is to be displayed on them. In modern motor vehicles, ever larger display elements are being installed. This means that the area available for display is also becoming ever larger. This makes it possible to show more than two display windows simultaneously.The present invention makes it possible to dynamically arrange multiple display windows in a customized manner. This is particularly advantageous for particularly wide display devices, such as those that extend from A-pillar to A-pillar in a motor vehicle.
[0047] Display devices in motor vehicles have so far offered only limited flexibility. Nevertheless, their operation is more distracting than with previous systems with small display surfaces or individually operated instruments. To date, it has not been possible to arrange the content to be displayed according to individual preferences. The invention makes it possible to dynamically add additional display windows or remove existing ones from the current display.
[0048] By long-pressing a selection area, the content associated with that area is added to the currently displayed content. According to the invention, intuitive interaction with the content to be displayed and the content currently displayed is achieved. With large display areas available for display, especially very wide display areas, the inventive solution leads to less distraction for the user while simultaneously providing better options for displaying and interacting.
[0049] In an advantageous embodiment, applications designed for operating systems other than the vehicle's operating system are also displayed alongside the applications designed for the vehicle's operating system. Such applications can also be added to the currently displayed content. If no information is available regarding how to handle the content of such applications when minimizing the size, they are, for example, compressed both horizontally and vertically by default so that they are fully visible even in the reduced display window.
[0050] In an advantageous embodiment, when a maximum number of simultaneously displayed display windows or representations is reached, one of them is removed as soon as another display window or representation is selected for display. For example, the display window that has been displayed the longest is removed, or the display window with which the least interaction has occurred in the last 15 minutes is removed. Advantageously, types of display windows are provided that are only removed if a further condition is met, for example, if a user provides feedback, and other types of display windows that may be removed unconditionally.
[0051] Further embodiments of the invention and their advantages are also described in the following description of exemplary embodiments with reference to figures. In the following:
[0052] Fig.1 Display device according to the invention
[0053] Fig.2 Further display device according to the invention
[0054] Fig.3 Further display device according to the invention
[0055] Fig.4 Method according to the invention
[0056] Fig.5 Further process step according to the invention Fig.6 Further process step according to the invention
[0057] Fig.7 Further process step according to the invention
[0058] Fig.8 Motor vehicle with display device according to the invention
[0059] Fig.9 Substeps of a method according to the invention Fig.10 Selection of display element
[0060] Character description
[0061] To better understand the principles of the present invention, embodiments of the invention are explained in more detail below with reference to the figures. Like reference numerals are used in the figures for like or equivalent elements and are not necessarily described again for each figure. It is understood that the invention is not limited to the illustrated embodiments and that the described features can also be combined or modified without departing from the scope of the invention as defined in the appended claims.
[0062] Fig. 1 shows a display device according to the invention. The main display element 1 for high-resolution display can be seen. It is arranged between the steering wheel 41 and the windshield 42 of a motor vehicle 4. The main display element 1 extends almost across the entire width of the motor vehicle 4, from the left to the right A-pillar 43. The A-pillar 43 is often referred to as a pillar. Also visible are a driver's seat 44, a center armrest 45, and pedals 46.
[0063] Slightly below the main display element 1 and inclined thereto is a disappearing control panel 2 with a selection display element 3. The disappearing control panel 2 projects into the interior of the motor vehicle 4. The selection display element 3 has a touch function. This means that it can detect touches by a user or even the approach, e.g. of a user's finger, assign them to a specific area of its surface and thus use them as an input signal. The selection display element 3 has a lower resolution display than the main display element 1. In the embodiment shown here, it has a lower color resolution, in which only a few different colors are used, here white and orange. In other embodiments, only a monochrome display is provided. The main display element 1, in contrast, has a full-color display with a large color space.In other embodiments, the representation of the selection display element 3 has a lower spatial resolution than the main display element 1.
[0064] The selection display element 3 has a smaller spatial extent in the horizontal direction than the main display element 1.
[0065] A disappearing control panel is a surface behind which at least one display element and at least one operator input element are arranged, which are not recognizable as such, at least when switched off. Only in certain situations is the information displayed by the display element visible through the surface, and input commands can be entered by touching certain areas of the surface. A disappearing control panel is therefore often also referred to as an invisible control panel.
[0066] In the automotive sector, but also in household appliances and other applications, a trend toward such disappearing control panels can be observed. This means that control or display functions should be as invisible as possible when switched off, achieving a minimalist design with smooth, generous surfaces. Technical elements should only be visible when needed. Such disappearing technologies are known, for example, under the names "Shytech" or "Camouflage."
[0067] To implement a disappearing technology, for example, a display panel can be placed behind a design surface. Transmissive, decorative surfaces suitable for this application can be manufactured using plastic or glass technology. The decoration is applied to the surface of a cover panel using printing technology or, alternatively, to a separate film surface. The decoration can be applied, for example, as a transmissive print or in the form of a shadow mask.
[0068] The main display element 1 has such a horizontal extent and extends so far to the right with respect to a designated viewer position 441 on the driver's seat 44 that a viewer from the designated viewer position 441 cannot reach every part of the display surface of the main display element 1 with one of their fingers. The selection display element 3, on the other hand, has such an extent and is arranged so close to the viewer with respect to the designated viewer position 441 that this viewer can reach every part of the display surface of the selection display element 3 with one of their fingers from the designated viewer position 441. The selection display element 3 is easily accessible for both a driver and a passenger as a viewer.
[0069] The main display element 1 shown here is a curved, very wide display element (also known as an ultrawide display). It extends across the entire width of the cockpit and, with its avant-garde display design, creates a new dimension for the user experience. The innovative operating concept based on the disappearing control panel 2 ensures greater safety and convenience.
[0070] In the central area of the main display element 1, which is located above the disappearing technology control panel 2, a display window 113 with navigation instructions is currently shown in the illustration. To the left of this, in front of the viewing position 441 of a driver, a display window 111 with information on the current driving status is shown, similar to that displayed in a conventional combination instrument. On the far right, a display window 115 is shown with a display of available audio content as well as an audio content that is currently being played. In the selection display window 3, a representation 315 of the display window 115 with audio content in reduced resolution is displayed. A symbol 3159 of reduced resolution contained in this representation 315, which corresponds to a symbol 1159 of higher resolution of the display window 115, is used to select the audio content represented by the symbol 1159.
[0071] Fig. 2 shows another display device according to the invention. The main display element 1 is designed similarly to that described above. On the left, a display window 111 with information about the current driving status is shown, in the middle, a display window 113 with video content, and on the right, a display window 115 with audio content.
[0072] The disappearing technology control panel 2 is wider here than shown in the previous illustration and merges with the main display element 1 in a curved shape. It has larger areas without a display function to the left and right of the selection display element 3. In a further development of the invention not shown here, display elements and / or control elements are also arranged under one or both of these areas, which can be designed either using disappearing technology or in a conventional form. A representation 314 for an audio-video communication control is shown on the selection display element 3. By pressing the representation 314 for a longer time by a user, the command is given to display a display window 114 on the main display element 1. In the example shown, it is inserted between the display windows 113 and 115, as indicated by the arrow marked with reference numeral 114'.For this purpose, the width of all or at least one of the display windows 111, 113, 115 is reduced, and a display window not shown here is displayed between the display windows 113 and 115.
[0073] Fig. 3 shows a further display device according to the invention, similar to Fig. 2. In the right-hand part of the figure, the display device is shown in three successive states. On the left-hand side, the respective selection display window 3 is shown in an enlarged view and with a different color scheme (black lines on the left instead of light lines on the right) for better identification. In the upper of the three successive states, three display windows 111, 112, 115 of approximately the same width are arranged next to one another on the main display element 1: A display window 111 with information on the current driving status, a display window 112 with navigation information, and a display window 115 with audio content. The selection display window 3 is shown enlarged on the left. It shows a representation 312 of the display window 112 with navigation information. In the representation, a list of navigation waypoints is symbolized by thick dots.Below representation 312, five selection areas 321-325 are represented by horizontal lines. Selection area 321 is assigned to a representation 311 for "media," selection area 322 is assigned to a representation 312 with navigation information, and selection area 324 is assigned to a representation 314 for "climate." If the user selects selection area 321 by touching it for a longer period of time, they reach the middle of the three consecutive states. This is indicated by arrow P1.
[0074] In the middle of the three consecutive states, the two outer display windows 111 and 115 of the main display element 1 retain their horizontal extent compared to the previous state. The originally middle display window 112 with navigation information, in contrast, has been compressed horizontally, leaving an area free on the right, on which a display window 113 with information on available media is now displayed. This media can be a hard drive installed in the vehicle, a removable storage medium connectable to the vehicle, a memory of a mobile device wirelessly connected to the vehicle, or another medium. In the selection display window 3 shown enlarged on the left, the representation 312 for navigation is reduced horizontally and arranged on the left, while a representation 313 for media is arranged on the right. The selection display element 3 has thus been divided for these two representations 312, 313.The "Media" information is symbolized in the figure by a square. If the user wishes to remove the display window 113 from the main display element 1, they enter a corresponding command via the representation 313. This can be done, for example, by double-tapping the representation 313 or by pressing and holding the selection area 321. The display device then returns to the upper of the three states, indicated by an arrow P2. If, however, the user wishes to display another display window 114 with information about the vehicle's climate control on the main display element 1, they select it by touching the selection area 324 for "Climate" for a longer period of time. This takes them to the lower of the three consecutive states. This is indicated by arrow P3.
[0075] In the lower of the three displayed states, the two outer display windows 111 and 115 are slightly compressed horizontally compared to the two states displayed above them. The two display windows 112 and 113 are also slightly more compressed than in the middle of the displayed states and are moved further to the left. A display window 114 with information about the vehicle's climate control is now displayed in the space created between display windows 113 and 115. In the selection display window 3, shown enlarged on the left, the representation 312 for navigation and the representation 313 for media are reduced horizontally and shifted to the left, while a representation 314 for climate is arranged on the right. The selection display element 3 has thus been divided again for these three representations 312, 313, and 314. The representation for "climate" is symbolized in the figure by a letter "T," which stands for temperature.Here, too, the user can remove the climate information display window 114 from the main display element 1 by entering a corresponding command via the representation 314. The previous state is then returned to, which is indicated by an arrow P4.
[0076] In the selection display element 3, a selection bar 330 is shown in the lower area. This has a solid line 331 in its left area and a dotted line 332 in its right area. The selection bar 330 is used to receive further commands. For example, this could be to adjust the volume. Touching and dragging the solid line 331 to the left reduces the volume; the dotted line 332 becomes correspondingly longer. Dragging to the right increases the volume. According to another example, the arrangement of the representations 311-315 can be changed by dragging the solid line. Other functions can also be sensibly provided here.
[0077] It can be seen that the display windows 112, 113, 114, which are arranged in the main display element 1 between a display window 111 shown on the far left and a display window 115 shown on the far right, are displayed on the main display element 1 according to the representations 312, 313, 314 assigned to them in the selection display element 3, i.e., in the same order. In alternative embodiments, the order in which the display windows 112, 113, 114 are displayed is different from that of the representations 312, 313, 314 assigned to them. For example, it can be provided that a display window 112 for navigation is always displayed as close as possible to the driver. This has the advantage that the driver can see it without having to look far away from the direction of travel. In this example, the assigned representation 312 is always displayed in the center of the selection display element 3.This has the advantage that the representation 312 is easily accessible for operation by both the driver and the passenger.
[0078] In one variant of a method according to the invention, the selection display element 3 is operated without the main display element 1. The selection display element 3 serves both for selection and display. The representations 31 n thus represent the display windows in which the display is made. The image elements displayed therein are shown in a less simplified manner in this variant than indicated in the left part of Fig. 3 in order to offer the user the highest possible quality representation. The selection display elements 3 shown in the left part of Fig. 3 thus show a simplified representation of a selection display element 3 of this variant. Fig. 4 shows, on the left side, a method according to the invention for operating a display device. The main display element 1 is configured to display multiple display windows 11 x (here: x = 1,...,5) next to each other, and the selection display element 3 is configured to display a plurality of small representations 31x (here: x=1,...,5) of display windows 11x that can be displayed on the main display element 1. The method comprises the following steps:.
[0079] - Detect S1 whether a touch on one of the representations 31x lasts for a longer period T than a predetermined first minimum period T1. This is represented in the figure by a touch detection S11 and a size comparison S12. If the result of the touch detection S11 is negative, this method ends. Otherwise, the method branches to the size comparison S12. If the result of this comparison is negative, the method returns to the touch detection S11; otherwise, the method continues to the next step S2.
[0080] - Classify S2 of the corresponding representation 31 times as a selected representation (Sel.=selected).
[0081] - Reducing S3 of at least one of the display windows 11 n currently displayed on the main display element 1. This is indicated in the figure by vertical compression in the horizontal direction.
[0082] - Displaying S4 a display window 11x corresponding to the selected representation 31x on the area of the main display element 1 freed up by the reduction. This process then ends at E. After the end of a process, the process can be run through again, or a different process can be performed first.
[0083] Fig. 4 shows, on the right side, a method for operating a display device, wherein the selection display element 3 is configured to display multiple representations 31x (here: x=1,...,5) next to each other. The method comprises the following steps:
[0084] - Detecting S5 whether a touch of a selection area 32x assigned to a representation 31x lasts for a longer period T than a predetermined second minimum period T2. This is represented, as described in step S2, by a touch detection S51 and a size comparison S52. - Classifying S6 the corresponding selection area 32x as a selected selection area.
[0085] - Reducing S7 of at least one of the representations 31 n currently displayed on the selection display element 3.
[0086] - Display S8 of the selected representation 31 x on the area of the selection display element 3 that has been freed up by reducing the size.
[0087] The procedure shown on the right side of this figure is also used, for example, in a variant in which the selection display element 3 is operated without a main display element 1.
[0088] According to an optional embodiment, following a positive result of step S52, both steps S6 and following as well as steps S2 and following are executed. This is indicated by an arrow P26. This splits both the main display element 1 and the selection display element 3 to add a further display window 11x or a further representation 31x. According to another optional embodiment, steps S5 to S8 are performed first. This provides the user with several selection options on the selection display element 3. Their selection for display on the main display element 1 is then performed using steps S1 to S4. The branching from step S8 to step S1 is indicated by the arrows P18 and the connection points V18.
[0089] Fig. 5 shows a further method step: reducing the size S31, S71 of a display window 11 n currently displayed on the main display element 1 or of a representation 31 n currently displayed on the selection display element 3, while maintaining its vertical extent and reducing its horizontal extent. In this case, the contents displayed in the display window 11 n or in the representation 31 n are, for example, compressed in the corresponding ratio.
[0090] Fig. 6 shows a further method step. When reducing the size S3, S7 of a display window 11 n or a representation 31 n below a predetermined minimum size: replacing S32, S72 at least one of the image elements 11 n1 , 11 n2 displayed in this display window 11 n or this representation 31 n with a placeholder image element 11 nT, 11 n2' that is reduced in complexity. By way of example, graphic bar displays 11 n1 for the left half of the vehicle and 11 n2 for the right side of the vehicle are each replaced by a numerical temperature display 11 nT, 11 n2' that are arranged one above the other. This is also an example of how the relative arrangement of image elements can be changed: Initially, the image elements 11 n1 , 11 n2 are arranged next to one another, as shown in the left part of the figure. After reducing the size, the corresponding placeholder image elements 11 nT, 11 n2' are arranged one above the other, as shown in the right part of the figure.
[0091] Fig.7 shows a further method step: Differently strong reduction S33, S73 of different display windows 11 n or representations 31 n. This creates an area for displaying a further display window 113.
[0092] Fig. 8 schematically shows a motor vehicle 4 that uses a display device according to the invention with a main display element 1. In this example, the motor vehicle 4 is a passenger car. The main display element 1 is arranged in a dashboard in this example. Selection information is received by means of the selection display element 3. Data on the vehicle's surroundings can be acquired using a sensor system (not shown here). This sensor system can in particular comprise sensors for environmental detection, e.g. ultrasonic sensors, laser scanners, radar sensors, lidar sensors or cameras. The information acquired by this sensor system can be used to generate content to be displayed for the display device. Further components of the motor vehicle 4 in this example are a control device 432 and a data transmission unit 433. A memory device 434 is provided for storing data.The control device 432 serves, for example, as a computer, by means of which instructions of a computer program are executed, which cause the control device 432 to carry out a method according to the invention. The control device 432 reads, among other things, information from the memory device 434 in order to appropriately consider priority image elements 11 n1", 11 n2" and subordinate image elements 11 n1 11 n2"' when reducing or enlarging. Placeholder image elements 11 n1 11 n2' are also taken from the memory device 434 by the control device 432. Information about the type of display window is also stored in the memory device 434. Such a type relates, for example, to a display window type that may not be compressed more than a predetermined percentage.A different display window type may only be removed from the main display element if certain conditions are met, such as user approval. Using the data transmission unit 433, a connection to a backend can be established, for example, to obtain updated software for components of the motor vehicle or updated image elements 11 n1 , 11 n2 or updated information about such image elements 11 n1 , 11 n2 and store them in the storage device 434 or supply them to a suitable component. Data exchange between the various components of the motor vehicle takes place via a network 35.
[0093] Fig. 9 shows partial steps of a method according to the invention for operating a display device, similar to that shown in Fig. 4. Steps S1, S11, and S12 correspond to those shown there. Further steps follow below, which are indicated here by three dots. If the result of the touch detection S11 is negative, a detection S9 is carried out as to whether a touch of one of the representations 31 x or of a selection area 32 x assigned to a representation 31 x over a short, uninterrupted period T with T3 <T<T4 erfolgt ist. Ist dies der Fall, dann erfolgt ein Einstufen S92 der entsprechenden Repräsentation 31 x als prioritär ausgewählte Repräsentation 31 p. Danach erfolgt ein Ersetzen S95 eines oder mehrerer aktuell angezeigten Anzeigefenster 11 n bzw. Repräsentationen 31 x durch das der prioritär ausgewählten Repräsentation 31 p zugeordnete Anzeigefenster 11 p bzw., wie hier symbolisiert, durch die prioritär ausgewählte Repräsentation 31 p.The figure shows this in two steps: First, a reduction S93 of one or more display windows 11n or representations 31n occurs. For replacement, the reduction S93 corresponds to a horizontal compression to zero width. Additionally or alternatively, a compression to a very small value can also occur, so that only a narrow placeholder image element remains. Subsequently, an enlargement S94 of the prioritized representation 31p occurs.
[0094] Fig. 10 shows the displayed states of a selection display element 3. A first, earlier state is shown in the upper area of the figure, and a subsequent state is shown in the lower area. On the left, a narrow representation 311 is visible, and on the far right, a similarly narrow representation 315. These represent temperature controls for the left and right sides of a motor vehicle. Between these representations 311, 315, a wide representation 314 for climate control is shown. In the lower area of the selection display element 3 are selection areas 321-325. A selection bar 330 is located above the selection areas 321-325.
[0095] In the representation 314 for climate, an image element 1141" for windscreen heating, an image element 1142" for rear window heating, an image element 1143" for air conditioning, and an image element 1144" for automatic operation are arranged next to one another in an upper row. In the center of the representation 314 for climate is an image element 1145" indicating the fan power; below this is an image element 1146" symbolizing a fan. To the left and right of the image element 1145" indicating the fan power are image elements 1147"', 1148"' indicating the temperature in the left and right areas of the passenger compartment, respectively. In the lower left corner of the representation 314 for climate there is an image element 1149" for the left seat heating, and in the lower right corner there is an image element 1140" for the right seat heating. Priority image elements are all but the image elements 1147'" and 1148'".
[0096] A circle K indicates the position of a user's finger. This finger is located in the selection area 321 for media playback. After the finger has remained in the selection area 321 for an extended period of time, a representation 313 for media is displayed on the selection display element 3. For this purpose, the representation 314 for climate is compressed horizontally. However, the content displayed using the image elements 1140"-1149" is not compressed horizontally according to the external dimensions of the representation 314, but is treated differently depending on its priority. The image elements arranged in the top row are priority image elements 1141"-1144" and remain unchanged in their size and length-to-width ratio, but are moved closer together.Image elements 1145" and 1146" are also priority, remain unchanged in their size and length-to-width ratio, and also retain their position in the center of representation 314. Image elements 1147"' and 1148"' are subordinate and are compressed horizontally and vertically. Image elements 1149" and 1140" are priority, remain unchanged in their size and length-to-width ratio, but change their relative position with respect to the other image elements and are now located centrally below image elements 1147'" and 1148'", respectively. The image elements present in representation 313 will not be discussed in detail here. It can be seen that circle K, which indicates the position of a user's finger, is located in the area of representation 313 for media playback.
[0097] The subordinate image elements 1147'" and 1148'" are thus compressed both horizontally and vertically during the transition from the upper part of the image to its lower part, which represents a later point in time. The priority image elements 1149" and 1140" are changed in their relative arrangement. Initially, they are arranged laterally offset from the image elements 1147'" and 1148'" respectively, and subsequently below these image elements 1147'" and 1148'".
[0098] In a preferred embodiment, the main display element 1 has a width of 1.29 meters and extends from one A-pillar to the other. It features a 47.5-inch TFT display illuminated by more than 3,000 LEDs on an active surface of 7,680 x 660 pixels. The matrix backlight not only produces excellent image quality with high contrast, but also offers the option of dimming individual screen areas that are not currently required. The “local dimming” technology saves power and improves readability. The very wide main display element 1 serves as the driver, central, and passenger screen in one, giving designers the greatest possible freedom to design the cockpit in a futuristic and elegant way and to fill the seamless screen area with content.The operating concept, based on a disappearing control panel 2 with the selection display element 3, which transforms into a high-contrast, highly visible display, enables comfortable and safe interaction. Operation focuses on the essentials. Interaction with the main display element 1 is achieved via the integrated disappearing control panel 2, which magically appears only when needed. This solution prevents unnecessary information from distracting the driver. The disappearing control panel 2 also allows convenient control of areas that are out of the user's reach. Haptic feedback from the disappearing control panel 2 allows the main display element 1 to be operated without having to take one's eyes off the road.The selection display element 3 is concealed behind a semi-transparent surface that seamlessly integrates the screen of the selection display element 3 into its surroundings, both visually and haptically. When the selection display element 3 is not needed, it is invisible. In this case, however, it does not appear as a black void, but rather merges with the decorative surface to form a single unit, regardless of whether it is made of wood, carbon, or other high-quality surface designs. A special matrix backlight is also used. This lighting technology allows content to be displayed in any lighting situation with the necessary brightness and the highest possible contrast, without a visible background, the so-called "postcard effect." The combination of the disappearing selection display element 3 and the very wide main display element 1 is unique because it answers the question of how the growing screens in the cockpit remain operable.Display screens that extend from A-pillar to A-pillar, in particular, pose the challenge of finding operating solutions that allow the driver and front passenger to reach the entire screen. The seamlessly integrated display control panel, the Select Display Element 3, within easy reach of the driver, solves this problem in a highly elegant way and simultaneously meets the desire of many drivers to operate display screens via touch control.
Claims
Patent claims 1 . Display device, comprising - a main display element (1 ) for displaying in high resolution, and - an invisible control panel (2) with a selection display element (3) with touch function and display in lower resolution than the main display element.
2. Display device according to claim 1, wherein the main display element (1) is a color display element, and the selection display element (3) is a lower color resolution or monochrome display element.
3. Display device according to one of the preceding claims, wherein the selection display element (3) has a smaller extent than the main display element (1) and / or wherein the selection display element (3) is arranged below the main display element (1).
4. Display device according to one of the preceding claims, wherein - the main display element (1) has such an extension and is arranged with respect to an intended viewer position (441) that a viewer cannot reach every part of the display surface of the main display element (1) with one of his fingers from the intended viewer position (441), and - the selection display element (3) has such an extension and is arranged with respect to an intended viewer position (441) that a viewer can reach any part of the display surface of the selection display element (3) with one of his fingers from the intended viewer position (441).
5. Display device according to one of the preceding claims, further comprising a control device (432) and a memory device (434) in which information about priority picture elements (11 n1 ", 11 n2") or about priority and subordinate picture elements (11 n1 ", 11 n2" and 11 nT", 11 n2"') is stored.
6. A method for operating a display device according to one of the preceding claims, wherein the main display element (1) is configured to display a plurality of display windows (111 - 115) next to one another, and the selection display element (3) is configured to display a plurality of small representations (311 - 315) of display windows (111 - 115) that can be displayed on the main display element (1), comprising - detecting S1 whether a touch of one of the representations (31 x) lasts for a longer period (T) than a predetermined first minimum period (T1), - Classifying (S2) the corresponding representation (31 x) as a selected representation, - reducing (S3) the size of at least one of the display windows (11 n) currently displayed on the main display element (1 ) and - Displaying (S4) a display window (11x) corresponding to the selected representation (31 x) on the area of the main display element (1 ) freed up by the reduction.
7. Method for operating a display device according to one of the preceding claims 1 to 5, wherein the selection display element (3) is configured to display a plurality of representations (311 - 315) next to one another, comprising - detecting (S5) whether a touch of a selection area (32x) assigned to a representation (31x) lasts for a longer period (T) than a predetermined second minimum period (T2), - Classifying (S6) the corresponding selection area (32x) as the selected selection area, - reducing (S7) at least one of the representations (31 n) currently displayed on the selection display element (3) and - Displaying (S8) the representation (31 x) corresponding to the selected selection area (32x) on the area of the selection display element (3) freed up by the reduction (S7).
8. Method for operating a display device with a selection display element (3) which has a plurality of selection areas (32x) and is designed to display a plurality of representations (311 - 315) next to one another, comprising - detecting (S5) whether a touch of a selection area (32x) assigned to a representation (31x) lasts for a longer period (T) than a predetermined second minimum period (T2), - Classifying (S6) the corresponding selection area (32x) as the selected selection area, - reducing (S7) at least one of the representations (31 n) currently displayed on the selection display element (3) and - Displaying (S8) the representation (31 x) corresponding to the selected selection area (32x) on the area of the selection display element (3) freed up by the reduction (S7).
9. Method according to one of claims 6 to 8, wherein in order to reduce the size of a display window (11 n) currently displayed on the main display element (1 ) or a representation (31 n) currently displayed on the selection display element (3), its vertical extent is maintained and its horizontal extent is reduced (S31 , S71 ).
10. The method according to one of claims 6 to 9, wherein when reducing the size of a display window (11 n) or a representation (31 n) below a predetermined minimum size, at least one of the image elements (11 n1, 11 n2) displayed in this display window (11 n) or this representation (31 n) is replaced (S32, S72) by a placeholder image element (11 n1', 11 n2') with a reduced complexity or is completely removed from the display.
11. Method according to one of claims 6 to 10, wherein when reducing the size of the display windows (111-115) or the representations (311-315), different display windows or representations are reduced to different degrees (S33, S73).
12. The method according to one of claims 6 to 11, wherein priority image elements (11 n1",11 n2") and subordinate image elements (11 n1"', 11 n2"') are predetermined, and wherein when a display window (11 n) or a representation (31 n) is reduced in size, the priority image elements (11 n1",11 n2") displayed in this display window (11 n) or in this representation (31 n) retain their length-to-width ratio and / or their size, and at least one of the subordinate image elements (11 n1 11 n2"') is compressed in at least one direction or is replaced (S32, S72) by a placeholder image element (11 n1 ', 11 n2') with a reduced complexity or is completely removed from the display.
13. The method according to any one of claims 6-12, further comprising - detecting (S9) whether a touch of one of the representations (31x) or of a selection area (32x) assigned to a representation (31x) occurs over a short, uninterrupted period (), - Classifying (S92) the corresponding representation (31 x) as a prioritized representation (31 p), - Replacing (S95) one or more currently displayed display windows (11x) or representations (31x) by the display window (11p) assigned to the representation (31p) selected with priority or by the representation (31p) selected with priority.
14. Method according to one of claims 6-13, wherein during the reduction the relative arrangement of the picture elements (11 n1 , 11 n2) to one another is changed.
15. The method according to claim 6 or a claim dependent thereon, wherein the one or more display windows (112, 113, 114) arranged between a leftmost display window (111) and a rightmost display window (115) are displayed on the main display element (1) in accordance with the one or more representations (312, 313, 314) associated with it.
16. A computer program comprising instructions which, when executed by a computer, cause the computer to carry out the steps of a method according to any one of claims 6 to 15 for operating a display device.