Method for operating a touch-sensitive display device - Patent Application 20070122997

Abstract

Examples relate to a method (10) for operating a touch-sensitive display device (21) configured to display at least two operating areas (B1, B2), the method (10) comprising the steps of: determining (11) a position (P1) of a user (N1) or multiple users (N1, N2) relative to the display device (21); assigning (12) at least two operating areas (B1, B2) to at least one user (N1); and arranging (13) the at least two operating areas (B1, B2) on the display device (21) according to the assignment to the user (N1) and the user's relative position (P1) with respect to the display device (21).

Description

[Technical Field]

[0001] Embodiments relate to a method of operating a touch-sensitive display configured to display at least two control areas, while further embodiments relate to a system including a touch-sensitive display and a vehicle including such a system. [Background technology]

[0002] Modern automobiles are increasingly incorporating large screens through which passengers can provide input. These types of touch-sensitive displays or touchscreens are seen as advantageous because, in contrast to simple screens with keys, they do not require additional space for keys or buttons, and on the other hand, the placement of the operating area on the display can be adjusted depending on the displayed content.

[0003] For example, in the field of mobile communications, it is known to adjust the size of elements on a touchscreen that display input means (e.g., called operation areas). Thus, for example, experienced users can set a small size and instead display many similar elements on the display, while other users can adopt a display of fewer, larger input elements (e.g., operation areas) (e.g., displaying apps that can be started by clicking on the touch-sensitive screen).

[0004] Nowadays, more and more vehicles are being equipped with touch-sensitive screens, via which many vehicle functions, such as climate control and seat adjustment, can be controlled by operating elements. Luxury vehicles, for example, have such screens for the first row of passengers (driver and front passenger), i.e., front screens or front seat displays, and such screens for the rear seat passengers, i.e., rear screens or rear seat displays.

[0005] It is further known to identify vehicle occupants by means of interior sensors including, for example, an interior camera and seat pressure sensors.

[0006] Patent Document 1 discloses a display device for an automobile having multiple display units. In order to reduce the energy consumption and wear of the multiple display units in the automobile, a switch device is provided that simultaneously switches the multiple display units on and off in response to a single switch signal, and a sensor device is provided that detects whether the passengers are seated in the automobile seats. In this case, all of the multiple display units are assigned to the automobile seats, and the switch signal is related to the passengers' seating status.

[0007] Patent Document 2 discloses a computer system that dynamically adjusts the size of touch-sensitive areas or "buttons" (e.g., operating areas of a touch-sensitive display device) on a touch screen based on the agility of the user's movements. Data from sensors located around the touch screen conveys slight changes in the position of the user's hand, and this data is passed to a filter that separates the movement components caused by hand tremors from the intentional movement components. Information about the degree of hand tremor can be used to dynamically increase the size of the switch area as the user moves their hand, or to call up and display a fixed screen layout with an appropriate size for the switch area.

[0008] A drawback of known display systems may still be that not all users are able to properly operate the relevant control area on the touch-sensitive display, for example, in a vehicle, where passengers may have to stretch considerably to reach a particular control area, which may be inconvenient, for example. [Prior art documents] [Patent documents]

[0009] [Patent Document 1] German Patent Application Publication No. 102017206942 [Patent Document 2] European Patent Application Publication No. 1895389 Summary of the Invention [Problem to be solved by the invention]

[0010] It is an object of the present disclosure to provide an improved method for controlling the display of a touch-sensitive screen, and in particular to improve the arrangement of operating areas on such a touch-sensitive screen. [Means for solving the problem]

[0011] This problem is solved by the subject matter of the independent patent claims. Further advantageous embodiments are explained in the dependent claims, in the following description and in conjunction with the drawings.

[0012] Accordingly, a method for operating a touch-sensitive display device configured to display at least two operation areas, such as operation fields or regions on the touch-sensitive display device that are triggered by a user's touch to cause an action, is proposed.

[0013] The proposed method includes the following steps: determining the relative positions of one or more users with respect to the display device; assigning at least one of the at least two operation areas to one of the users; and arranging the at least two operation areas on the display device according to the assignment to the users and the relative positions of the users with respect to the display device.

[0014] The relative position of the user with respect to the touch-sensitive display device may include the distance and / or angle of the user with respect to the display device. For example, various functions of the display device can be activated or controlled via operation areas. Depending on which of these functions the user needs or may use, the corresponding operation area can be appropriately assigned to the user. In this way, for example, a set of operation areas relevant to this user (these operation areas must be, for example, reachable (accessible) from the user's position) can be assigned to one user.

[0015] Arranging may include, for example, positioning the above-mentioned operation areas on the touch-sensitive display device. The positioning of a particular operation area on the touch-sensitive display device may be based on the assignment of that particular operation area to a user and depending on the user's position relative to the touch-sensitive display device. Alternatively or additionally, arranging may include not displaying a particular operation area, for example, if this operation area is not assigned to any of the recognized users and is therefore not needed. Alternatively or additionally, arranging may further include adapting the size of the operation area to the user or to the area on the touch-sensitive display device available for the operation area (e.g., displaying a larger operation area when only a few operation areas are displayed).

[0016] The proposed method allows, based on the allocation of operating areas to users, in combination with information about the users' positions relative to the touch-sensitive display device, to position the operating areas for each user at particularly suitable positions and / or with particularly suitable sizes on the display device. As a result, for example, operating areas that a user needs more frequently (e.g., operating areas with higher priority) can be displayed closer to the user and / or larger than other operating areas. For example, operating areas that a user does not need can be suppressed, at least close to the user. In this way, the screen space can be better utilized, allowing, for example, relevant operating areas to be displayed larger.

[0017] According to one example, arranging the at least two operation areas includes arranging an operation area assigned to a first user at a position on the display device closer to the first user than to a second user. Conversely, arranging the at least two operation areas may also include, for example, arranging an operation area assigned to a second user at a position on the display device closer to the second user than to the first user. In this way, for example, various users may be able to quickly access the exact operation areas they need.

[0018] According to one example, one of at least two operating areas is displayed overlapping if the operating area is to be assigned to two users, with the first operating area of ​​the overlapping operating areas being positioned closer to the first user and the second operating area of ​​the overlapping operating areas being positioned closer to the second user. The proposed method allows two users to more comfortably access the operating areas from their respective locations, as opposed to other approaches in which, for example, one or both users may not be able to access the operating areas required for both users as desired.

[0019] According to one example, assigning operation elements includes assigning none of the operation elements to one of multiple users and arranging the operation area on the display device so that the operation area is inaccessible from the user's location. For example, some display devices may have functions available that are not suitable for or should not be operated by all users in the vehicle. Therefore, operation areas corresponding to such functions can be avoided from being assigned to the user (i.e., not assigned). In this way, operation of these functions by the user can be advantageously prevented because the user cannot access the operation area that is required. This aspect can be particularly advantageous in the case of a display device with multiple display units (e.g., display units assigned to individual users or geographically distributed display units) because in such cases, the user has little or no access to operation areas arranged or displayed on other display units.

[0020] According to one example, the method further includes determining which of the at least two operating elements is relevant to the passenger user. This allows, for example, to improve the allocation of operating areas to one or more users. This determination can be achieved, for example, by recognizing the user via a camera and / or by using a stored user profile (e.g., assigned to the user's seat). When arranging the at least two operating elements, only the operating elements relevant to the passenger user can be arranged on the display device. This advantageously allows, for example, to avoid displaying operating areas that are not relevant to the passenger user. This allows for better use of the available space on the screen, for example, to display larger operating areas, making them more user-friendly, or to use more space for displaying information.

[0021] According to one example, the location determination is based on seat occupancy information or a camera provided to the user. The proposed method can be used in vehicles where appropriate sensors, such as cameras or seat occupancy sensors, are already available. In this way, existing vehicle components can be efficiently utilized to enable the proposed method to be implemented.

[0022] Yet another aspect relates to a system having a touch-sensitive display configured to display at least two operation areas, and a controller configured to perform the above or below described method, for example, for use in an end user device operated by multiple users (e.g., a shared terminal with a touch screen or a mobile device used by multiple users) or in a vehicle.

[0023] According to one example, the system is configured for use in a vehicle, and the control device is configured to, when providing at least two operation areas, display larger operation areas on the display device when there are fewer users than when there are more users. For example, the size of the operation areas may be controlled in inverse proportion to the number of displayed operation areas. For example, when there are more users, it may be necessary to display more operation areas when users require more operation areas, while conversely, when there are fewer users, there may be fewer operation areas. Because a certain area on the touch-sensitive display device can be used to display operation areas, it may be possible to display these areas larger when there are fewer operation areas. This may, for example, enable more comfortable operation for users.

[0024] According to one example, the display device comprises at least two display units spatially separated from one another. The two or more separate display units may be, for example, individual displays that can be assigned to different users (e.g., located at each user's seat). The different display units may be controlled by a common controller. The proposed system may make it possible to display only those operation areas relevant to each user of the display on each display. This may, for example, avoid displaying operation areas that a user does not need at all. Furthermore, by suppressing the display of an operation area for a specific user, this user may be prevented from operating the functions controlled by that operation area.

[0025] According to one example, the system is configured for use in a vehicle, the display device includes a front seat display and a rear seat display, and the control device is configured to place the control area only on the front seat display when a user who is not authorized to operate the display device is (e.g., exclusively) in the rear seat of the vehicle. For example, a child may be seated in the rear seat who should not be able to operate certain functions. If the control areas required to operate those functions are not displayed on the rear seat display of the vehicle, it may be difficult or impossible for a passenger in the rear seat to operate those functions.

[0026] According to one example, the system is configured for use in a vehicle, the display device includes a front seat display and a rear seat display, and the control device is configured to deactivate the rear seat display when no users are in the rear seat, thus avoiding unnecessary energy consumption in the vehicle when the rear seat display is not needed at all.

[0027] Some aspects relate to a vehicle having the system described above or below. A control device of the system (e.g., an on-board computer of the vehicle) is configured to flexibly display at least two control areas on a touch-sensitive display device according to the vehicle occupancy status of the vehicle. The vehicle occupancy status can describe the location and type of passengers (e.g., driver, passenger, child, etc.) present in the vehicle. The control areas can be positioned on the display device based on the proposed scheme so that a user who wants to operate the control area can access the control area particularly comfortably. In this case, the system can flexibly adapt to the vehicle occupancy status.

[0028] For example, a vehicle passenger can first sit in the passenger seat, during which time the control area relevant to that passenger can be displayed on the right side of a front display located in the center of the vehicle, while the rear seat display can be deactivated. By deactivating unnecessary displays, energy can be saved. When the passenger moves to the rear seat, the control area previously displayed on the right side of the front seat display can be suppressed, and the rear seat display can be activated, displaying the control area relevant to that passenger on the rear seat display.

[0029] Some examples relate to computer programs comprising program code that, when executed on a processor, computer, or programmable hardware, performs the disclosed methods. Such computer programs may advantageously be provided on a storage medium. For example, they may be provided and executed on a control device of an equipment (e.g., a vehicle), thereby enabling control of the vehicle display and the operating areas displayed thereon while adapting to the position of a passenger in the vehicle.

[0030] In the following, the embodiments will be described in more detail with reference to the accompanying drawings. [Brief explanation of the drawings]

[0031] [Figure 1] FIG. 1 shows a flow chart of a method of operating a touch-sensitive display device. [Figure 2] 1 shows a schematic example of a system with a touch-sensitive display and two users. [Figure 3] FIG. 1 shows a schematic example of a system with a touch-sensitive display device with two separate displays. DETAILED DESCRIPTION OF THE INVENTION

[0032] Various embodiments will now be described in detail with reference to the accompanying drawings in which several embodiments are shown. In the figures, thickness dimensions of lines, layers and / or regions may be exaggerated for clarity. In the following description of the accompanying drawings showing several exemplary embodiments, the same reference numerals may refer to the same or equivalent components.

[0033] An element referred to as being "connected" or "coupled" to another element may be directly connected or coupled to the other element, or there may be intervening elements. Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as given to them by one of ordinary skill in the art to which the embodiment belongs.

[0034] According to another approach, the display of control elements on the screen of a touch-sensitive vehicle is static, which makes it easy for a vehicle occupant who, for example, should not or is unable to properly operate the control elements to operate the vehicle functions without authorization.

[0035] Furthermore, the space on the touch-sensitive screen may not be used optimally. A disadvantage of the known solution may be that the display of the operating elements is optimized for the needs of only one user.

[0036] It is therefore proposed, for example, to flexibly adapt the display on the front and rear screens of the vehicle to the vehicle occupants.

[0037] 1 shows a flowchart of a method for operating a touch-sensitive display device configured to display at least two operation areas 10. The method 10 comprises the steps of: determining 11 the relative positions of a user or users with respect to the display device; assigning 12 at least one of the at least two operation areas to one of the users; and arranging 13 the at least two operation areas on the display device in response to the assignment to the users and the relative positions of the users with respect to the display device.

[0038] The method 10 may be advantageously used in a vehicle, for example, to tailor the placement or presentation of content and control areas displayed on a touch-sensitive display to the vehicle's occupants, for example, by displaying control areas on front and rear seat displays of the vehicle's display.

[0039] For example, in a first step, in-vehicle sensors (e.g., cameras, seat pressure distribution, etc.) can be used to determine whether or not passengers are seated in the vehicle seats, and if necessary, which seats they are in. Based on this, it can be determined in which direction and how far away each passenger is sitting or standing from the display (their relative position to the display).

[0040] For example, in a second step, it can be determined for each passenger on board whether they need to be able to operate vehicle functions (e.g., assigning functions to individual users) and / or whether they are, for example, a human or an animal (e.g., a dog), or in other words, functions associated with operating areas can be assigned to users.

[0041] For example, if it is recognized that only the driver is present, the display on the front screen can be adjusted so that only the functions required by the driver are controllable. Thus, for example, the operating elements for the passenger air conditioning control (e.g., the operating area of ​​a touch-sensitive display) and / or the operating elements for the air conditioning control for the rear seat passengers can be eliminated (e.g., the seat controls or rear seat entertainment can be eliminated if no one is present).

[0042] If it is recognized that passengers (e.g., children and / or animals) should not operate nearby screens (the front screen for passengers in the front seat, or the rear screen for rear seat passengers) because they are unable to operate the nearby screen properly, for example, operating elements appropriate for the passenger's seat position (e.g., climate control, seat controls, etc.) can be positioned on the front screen accessible only to the driver (e.g., particularly accessible to the driver).

[0043] If it is recognized that a passenger can operate a nearby screen themselves, the control elements can be positioned on the screen closer to the passenger's seat position to allow better access to that seat position.

[0044] The displays on the front and rear screens can be adjusted to make optimal use of the space on each screen. For example, if the driver is alone in the vehicle, this approach allows for significantly more screen space to be used (e.g., because more space is available on the display by not displaying control areas that are not needed by the driver or that are needed only by the front passenger), and also allows for the display of significantly larger controls for other functions.

[0045] 2 shows a schematic example of a system 20 with a touch-sensitive display device 21 and two users N1, N2. The two users N1, N2 may be, for example, a driver and a front passenger of a vehicle. Accordingly, the driver N1 may be seated in the driver's seat at a first position P1 relative to the touch-sensitive display device 21, and the front passenger N2 may be seated in the front passenger's seat at a second position P2 relative to the touch-sensitive display device 21. The two positions P1, P2 may, for example, be adjacent to a centrally located vehicle display 21 and at the same distance from this display, with the first position P1 being on the left side of the display and the second position P2 being on the right side of the display.

[0046] The two positions P1, P2 of the two users N1, N2 can be determined by a sensor S of the system 20 (e.g., a vehicle's internal camera or seating status sensor). Specific functions that can be controlled by the operation areas B1, B2 can be provided to the users N1, N2 via the touch-sensitive display 21. By identifying which of the users N1, N2 should operate which function, it is possible to assign which of the operation areas B1, B2 pertains to each user N1, N2. For example, a display content can be output on the touch-sensitive display 21 by the vehicle's onboard computer or control device (not shown). This display content can include touch-sensitive operation areas in addition to a simple display area (e.g., without operation functions). For example, touching the first operation area B1 can activate or set a first function, and touching the second operation area B2 can activate or set a second function.

[0047] For example, in the illustrated example, the first and second operating areas can be assigned to driver N1 because the driver must be able to operate the corresponding functions, while only the second operating area B2 can be assigned to front passenger N2. Therefore, in response to driver N1's first position P1, the two operating areas B1 and B2 are located on the left side of the touch-sensitive display 21, close to driver N1, so that the driver can comfortably access the operating areas. Because front passenger N2 must also be able to use operating area B2, this operating area is displayed overlappingly and additionally on the right side of the touch-sensitive display 21, close to front passenger N2, so that the front passenger can also comfortably access the second operating area B2. For example, the overlapping second operating area B2 for front passenger N2 can be displayed larger than the one for driver N1. This is because the first operating area B1 does not have to be displayed to the front passenger N2, and therefore more space is available to the right of the touch-sensitive display device 21.

[0048] Further details and aspects are described in relation to the above or below described embodiments. The embodiment shown in Figure 2 may include one or more additional optional features corresponding to one or more aspects described in relation to the proposed scheme or in relation to one or more above (e.g., Figure 1) or below (e.g., Figure 3) described embodiments.

[0049] 3 shows a schematic example of a system 20 with a touch-sensitive display device 21 having two separate displays 22a, 22b, which may be, for example, a front seat display 22a and a rear seat display 22b of a vehicle.

[0050] For example, the display contents can be output to the two display units 22a and 22b by an on-board computer or control device (not shown) of the vehicle, and the first and second operation areas B1 and B2 of the display contents can be distributed and displayed on the two display units 22a and 22b.

[0051] According to the illustrated example, a first user N1 is seated in the front seat and can therefore be recognized by a sensor (not shown here) to be able to operate the front seat display 22a. A second user N2 is seated in the rear seat and can therefore be able to operate the rear seat display 22b.

[0052] The second user N2 may not be authorized to input anything on the touch-sensitive display device 21. Therefore, the touch-sensitive operation areas B1 and B2 can only be displayed on the front seat display 22a, which can be operated by the first user N1. In this case, the second user N2 cannot access the operation areas B1 and B2, and therefore cannot operate them.

[0053] Optionally, a second user (e.g., a child) may be allowed to use limited entertainment system functions, such that, for example, a second control area B2 (e.g., configured to control a video display) may be displayed on the rear seat display 22b, while a first control area B1 (e.g., configured to set the climate control) is displayed only on the front seat display 22a so that only the first user N1 can operate it.

[0054] Further details and aspects are set forth in the context of the above or below described embodiments. The embodiment shown in Figure 3 may include one or more additional optional features corresponding to one or more aspects set forth in the context of the proposed scheme or in the context of one or more above (e.g., Figures 1-2) or below described embodiments.

[0055] Several examples relate to methods for automatically adapting the display of at least one screen in a vehicle to an occupant (e.g., user N1, N2). This allows, for example, adjusting the display on the front and rear screens (e.g., front-seat displays 22a, 22b) so that the space on each screen is optimally used (e.g., by hiding control areas not required by the user, e.g., by adjusting the size of the control areas on the various screens to suit the user). This also improves the accessibility of the screen control areas for passengers. In this way, when driver N1 is alone in the vehicle, for example, significantly more space can be provided on screen 21, 22a, and the control elements B1, B2 for other functions can be, for example, more appropriately positioned and / or displayed significantly larger. Thus, a method for further improving the display operation of touch-sensitive screen 21 can be provided.

Claims

1. A method (10) of operating a touch-sensitive display device (21) configured to display at least two operating areas (B1, B2), comprising: - determining (11) the relative position (P1) of a user (N1) or users (N1, N2) with respect to said display device (21); - assigning (12) at least one of the at least two operating areas (B1, B2) to one of the users (N1); and - arranging (13) at least two of the operation areas (B1, B2) on the display device (21) depending on the allocation to the user (N1) and the relative position (P1) of the user with respect to the display device (21); A method (10) comprising:

2. Arranging (13) at least two of the operation areas (B1, B2) includes arranging (13) the operation area (B1) assigned to a first user (N1) at a position on the display device (21) closer to the first user (N1) than to a second user (N2). The method (10) of claim 1.

3. If one of the at least two operation areas (B2) is to be assigned to two users (N1, N2), it is displayed in an overlapping manner, and the first operation area of ​​the overlapping operation area (B2) is arranged close to the first user (N1), and the second operation area of ​​the overlapping operation area (B2) is arranged close to the second user (N2). The method (10) according to claim 1 or 2.

4. The allocation (12) of the operation areas (B1, B2) involves not allocating any of the operation areas (B1, B2) to one of the users (N2) (12), and arranging the operation areas (B1, B2) on the display device (21) so that the user (N2) cannot reach these operation areas from his / her position (P2) (13). A method (10) according to any one of claims 1 to 3.

5. - Identifying which of the at least two operation areas (B1, B2) is related to the user (N1, N2) who is riding with the passenger, and when arranging (13) the at least two operation areas (B1, B2), arranging only the operation area (B1, B2) that is related to the user (N1, N2) who is riding with the passenger on the display device (21). Further having A method (10) according to any one of claims 1 to 4.

6. The positions (P1, P2) are identified (11) based on information on the seating status of the seats provided for the users (N1, N2) or a camera (S). A method (10) according to any one of claims 1 to 5.

7. A computer program or non-volatile storage medium comprising program code which performs the method (10) according to any one of claims 1 to 6 when the program code is run on a processor, a computer or programmable hardware.

8. A system (20) comprising a touch-sensitive display (21) configured to display at least two operating areas (B1, B2), A system (20) comprising a controller configured to carry out the method (10) according to any one of claims 1 to 6.

9. 9. A system (20) according to claim 8, comprising: configured for use in a vehicle; The control device is configured to, when arranging (13) at least two of the operation areas (B1, B2), display the operation areas (B1, B2) on the display device (21) larger when the number of users (N1, N2) is relatively small than when the number of users (N1, N2) is greater. System (20).

10. A system (20) according to claim 8 or 9, The display device (21) comprises at least two display sections (22a, 22b) that are spatially separated from each other. system.

11. A system (20) according to claim 8, 9 or 10, comprising: configured for use in a vehicle; The display device (21) includes a front seat display (22a) and a rear seat display (22b), The control device is configured to arrange operation areas (B1, B2) only on the front seat display (22a) when a user (N2) who is not authorized to operate the display device (21) is in the rear seat of the vehicle. System (20).

12. A system (20) according to any one of claims 8 to 11, comprising: configured for use in a vehicle; The display device (21) includes a front seat display (22a) and a rear seat display (22b), The control device is configured to stop the rear seat display (22b) when there is no user (N1, N2) in the rear seat. System (20).

13. A vehicle comprising a system (20) according to any one of claims 8 to 12, The vehicle is configured such that the control device flexibly arranges at least two of the operation areas (B1, B2) on the touch-sensitive display device (21) depending on the vehicle occupancy status of the vehicle.

Images