Means of transport and methods for operating a cursor on a display device of a means of transport

Abstract

A means of locomotion (10) and a method for operating a cursor (1) on a first display device (2) permanently installed in the means of locomotion (10) and integrated into its on-board network are proposed. The method comprises the following steps: detecting an input gesture on a touchpad (3) located in a door (4), center console, or armrest of the means of locomotion (10), or on a portable user device (5); determining a data set representing the input gesture using a first processor (6) associated with the touchpad (3); transmitting the data set to a second processor (7) associated with the first display device (2); and adjusting the position of the cursor (1) on the first display device (2) using the second processor (7) as a function of the data set.

Description

[0001] The present invention relates to a means of transportation and a method for operating a cursor on a first display device that is permanently installed in a means of transportation and integrated into its on-board electrical system. In particular, the present invention relates to the convenient operation of a screen that is not within the immediate reach of a user.

[0002] DE 11 2012 006 892 T5 discloses a mobile device comprising a touchscreen keypad and a control device that causes the touchscreen keypad to function as a touch-sensitive control element for operating control objects displayed on a vehicle display device when the touchscreen keypad is positioned at a predetermined location in a vehicle interior. A control device of the mobile device switches the control objects depending on the number of fingers used to perform a touch gesture on the touchscreen keypad. The control objects include a cursor, a map image, and a widget screen.

[0003] DE 10 2018 215 396 A1 discloses an operating device in a motor vehicle in which menus, submenus, and / or individual values ​​can be displayed on a screen located in the area of ​​the vehicle's dashboard and selected by means of an input device. The input device is located at a distance from the screen and is designed as a touchpad mounted on the vehicle's center console. The menus, submenus, and / or individual values ​​displayed on the screen can be accessed and selected by touching the touchpad using an input device.

[0004] DE 10 2011 101 808 A1 apparently allows a user to insert a tablet PC into a holder assigned to their vehicle seat. In this case, operation is enabled via a touchpad assigned to the respective vehicle seat, which is located, for example, next to the respective vehicle seat in the armrest or in a side door. A cursor or mouse pointer can be displayed to the user, the position of which on the tablet PC can be controlled via the touchpad.

[0005] Modern vehicles, especially higher-end models, incorporate a multitude of screens to inform and / or entertain the user. These screens are often designed as so-called "touchscreens" because they are very easy to use and the operating logic can be adapted via software updates. Furthermore, external operating aids are neither necessary, nor are there any concerns about malfunctions or contamination. However, since touchscreens require the user to touch the screen surface or a digitizer located in front of it, they are unsuitable for displays located at a distance from the user. An example of this is the BMW Theater Screen, which is installed in the rear of the vehicle's roof and impresses with its size and high resolution.These entertainment systems are typically controlled via touchscreens, either integrated into the main screen itself (as a digitizer layer) or via separate remote controls within the vehicle. These systems are designed to provide intuitive and user-friendly interaction.

[0006] US 2006 / 0155429A1 describes a vehicle entertainment and accessory control system with touchscreens capable of displaying a user interface, entertainment content, and receiving control inputs. A shared computer processor controls the touchscreens and generates corresponding control signals, which are then processed by an infrared controller. The system includes multiple touchscreens in the vehicle that can display content or the user interface individually or simultaneously. Text messages can be exchanged between users, and access to touchscreens can be disabled via a master touchscreen. The processor prevents entertainment content from being displayed on the driver's touchscreen while driving. Additionally, there is a video display and speakers for content playback, as well as a media source for various devices such as a computer hard drive or DVD player.An accessory control unit manages vehicle accessories such as air conditioning and power windows. Audio connections allow the transmission of audio signals to the touchscreens.

[0007] Despite advanced technology and ease of use, current entertainment systems have some drawbacks. A significant disadvantage is the accessibility of the controls. In long vehicles or with seats located far from the main screen, passengers, especially children or people with physical disabilities, may find it difficult to reach the controls. This limits usability and can significantly diminish the enjoyment of the entertainment. Furthermore, operating the remote control or the main screen requires taking one's eyes off the screens, which further impairs the user experience.

[0008] It is an object of the present invention to alleviate or eliminate the aforementioned disadvantages.

[0009] The aforementioned problem is solved according to the invention by a method for operating a cursor on a first display device permanently installed in a means of transport and integrated into an on-board network of the same, and by a corresponding means of transport with the features of the independent claims.

[0010] The dependent claims describe preferred embodiments of the invention.

[0011] This method is used to control a cursor. A "cursor" is understood here to be a pointer on a screen, which defines a position on the screen using software. Input, confirmation, or similar actions can be performed with respect to the cursor, allowing the user to select or operate controls (buttons, text fields, sliders, etc.) located at the cursor's position. The cursor is specifically intended as an input aid whose position depends solely on user input, and preferably not on the positions of input elements within the graphical user interface. In other words, the cursor does not jump from one element to the next, as is known in the prior art, for example, through the addition of a frame, magnification, or other visual highlighting.The vehicle's electrical system is designed for information and power distribution and is permanently connected to the first display unit for both purposes. In particular, the first display unit is therefore an integral part of the vehicle. The display unit can be located in the first, second, or subsequent row of seats. In other words, the display unit is designed and positioned to present information to passengers in the first row, or to passengers in the second, third, or further rear rows of seats in the vehicle. As a first step, an input gesture on a touchpad, which may be located, for example, in a door of the vehicle, in its center console, in an armrest, or on the user's portable smart device, is automatically recorded.In other words, a user performs an input gesture, which is then resolved / digitized via the touchpad. The input gesture is converted into a data record representing it. This occurs in a first processor associated with the touchpad. The processor can be a programmable processor housed in a casing that also contains the touchpad. This casing can also house a bus device through which the data record can be made available on the vehicle's electrical system. Alternative methods of data transmission (data lines, etc.) are also possible. The data record is provided almost instantly, allowing the input gesture to be processed in real time by the processor. In a third step, the data record is transmitted to a second processor, which is spatially and logically connected to the first display device.In particular, the second processor can be located within the housing of the first display unit. The processors then communicate via data lines or a bus, transferring the data set representing the input gesture. Upon receiving the data set in the second processor, the cursor position on the first display unit is automatically adjusted. In other words, the cursor is moved across the data set as predefined by the input gesture. The data set therefore defines at least one new position for the cursor, to which the cursor is moved. In this way, a touchpad located remotely from the first display unit can be used to control the cursor position on the first display unit. This applies if the touchpad is on a portable smart device (smartphone, smartwearable, etc.).The data set can be transmitted to the vehicle's electrical system and the second processor via a wired or wireless connection. The inventive method makes operating a cursor displayed on a first display unit more convenient and / or even possible in the first place. The touchpad is transparent and covers a second display unit. The second display unit is configured to display screen content when the first display unit is unfolded, thus supporting user operation of the cursor. Alternatively or additionally, the second display unit is configured to display screen content when the first display unit is folded down, thus supporting user operation of content on the second display unit.

[0012] According to a second aspect of the present invention, a means of transportation is proposed that includes a device for operating a cursor of a first display unit permanently installed in the means of transportation and integrated into its onboard electrical system. The means of transportation has a touchpad, which is either permanently installed or located in a portable smart device within the means of transportation. If it is a portable smart device, it is connected, at least electronically, to the onboard electrical system of the means of transportation. The touchpad is logically and spatially integrated with a first processor, for example, in a common housing. Furthermore, the means of transportation has a second processor, which is electronically and spatially integrated with the first display unit. In particular, the second processor is located in a housing of the first display unit.The means of transport is thus equipped to implement the features, combinations of features, and the resulting advantages of the method described above in such a way that, to avoid repetition, reference is made to the above explanations. The touchpad is transparent and covers a second display unit. This second display unit is configured to show screen content when the first display unit is unfolded, which supports the user's cursor control. Alternatively or additionally, the second display unit is configured to show screen content when the first display unit is folded down, which supports the user's control of content on the second display unit.

[0013] Preferred embodiments of the method and the means of transport according to the invention are presented below: Preferably, the first display device can be a matrix display, which is specifically designed for the optical playback of audio / video media files. The display device can therefore reproduce information and / or entertainment formats and, in particular, display the video track of the files. The matrix display can, for example, include an LCD monitor, a plasma screen, an OLED screen, or similar. However, it is specifically designed for displaying arbitrary content and, in particular, for displaying the cursor at an arbitrary position.

[0014] To improve user comfort, the touchpad is positioned outside the housing of the primary display unit. For example, the touchpad can be located in a door panel or center armrest, resulting in a highly comfortable operating position for the user when seated in a relaxed posture. The touchpad can be positioned so that its surface normal is inclined at least slightly towards the user's head position. This provides an almost perpendicular viewing angle for the touchpad, which is particularly advantageous if the touchpad is transparent (e.g., as a digitizer) and positioned over a touchscreen. The touchpad can be fixed or pivotable. In particular, the touchpad can be integrated into a frame in the door panel or...It may be located in an armrest in the door panel, a center console, or another ergonomically accessible area of ​​the vehicle.

[0015] The touchpad can be mounted on a screen in the form of a second display unit, which can also be operated by the touchpad, depending on the operating state. Specifically, the touchpad can operate the screen behind it when the first display unit is not in an operating mode. For example, the touchpad can be used to operate buttons displayed behind it, thereby bringing the first display unit into an operating / control mode. This can be done with motor assistance. Conversely, if the first display unit is no longer needed, the touchpad can be used to activate a button (displayed on the first and / or second display unit), whereupon the first display unit is stowed away by motor assistance.

[0016] In particular, if a control element (e.g., a hardware component) is provided for unfolding / viewing the first display, the second display located behind the touchpad can also be automatically switched to an operating mode in which the first display is operated via the touchpad in such a way that the user's swipe gestures on the touchpad can be used immediately or in real time to adjust the position of a cursor displayed on the first display. This improves user comfort, as the touchpad can be used to control either the first or second display, depending on its operating mode.Once the cursor has come to rest at a certain position after the information contained in the data set has been processed, a new input gesture (re-grasping and another swipe) can generate a new data set. This new data set, corresponding to the previous one, is then transmitted to the second processor, which uses it to adjust the cursor's position once again. In this way, even on very small touchpads, the user can make precise gestures that move the cursor on a significantly larger screen, namely the first display unit. Controlling the cursor's position on the first display unit can thus be achieved using compact touchpads that can be easily integrated into, for example, a door panel, center console, armrest, or similar locations.

[0017] Further features of the present invention are disclosed below, which can be applied in individual features or in their entirety to the features described above or can be combined with them.

[0018] A fundamental principle of the present invention is the implementation of a multi-touch trackpad integrated into the door (also referred to above as a "touchpad") or its integration into an application for mobile portable user devices, such as the "MyBMW app." This trackpad or mobile device allows users to conveniently control the in-vehicle entertainment system without having to physically access the main screen. Movements and gestures performed on the trackpad or mobile device are translated into corresponding movements of a pointer (referred to above as a "cursor") on the main screen (first display unit). This enables intuitive and user-friendly control of the system, regardless of the user's position within the vehicle.

[0019] The present invention relates to a variety of solutions for improving the controllability of vehicle entertainment systems, in particular for enhancing comfort and / or easing the burden on people with limited mobility (seniors, people with disabilities, children). A first solution consists of a multi-touch trackpad (touchpad) integrated into the door. This trackpad functions similarly to a laptop touchpad, but without being overlaid as a transparent digitizer on a display device. The trackpad allows users to control the entertainment system by performing movements and gestures on the trackpad. These movements are translated in real time into the movements of a cursor (pointer) on the main screen. The trackpad can also be implemented as a touch display, thereby providing additional functions and an improved user interface.A second solution involves integrating the control system into the MyBMW app or a handheld, touch-sensitive user device, such as a smartphone or smartwear (smartwatch). In particular, users can connect their own portable user device to the vehicle in such a way that it is configured to control the entertainment system according to the invention. The portable user device is used similarly to a laptop touchpad. This enables flexible and individual control, independent of the user's position in the vehicle. Both solutions support multi-touch gestures such as pinch-to-zoom and two-finger scrolling, thus enabling intuitive and user-friendly interaction with the entertainment system.Another key aspect of the invention lies in the communication between the control units, one of which operates the touchpad and the other the display. Communication between the control units (or their processors, as described above) can take place via the SOME / IP protocol. In particular, communication can be conducted exclusively via the SOME / IP protocol. For external connections to headphones, smartphones, etc., modern wireless technologies such as Bluetooth or Wi-Fi are used. This ensures a robust and reliable communication infrastructure. The touchscreens in the vehicle can be implemented as independent control units with their own processors. This distributed architecture offers numerous advantages, including increased system flexibility and efficiency.The implementation of this touch-pointer technology significantly improves the user experience, as users can conveniently and intuitively control the entertainment system without having to directly (physically) access the main screen.

[0020] The present invention offers several advantages over the prior art. One advantage is the improved accessibility of the control elements for influencing a cursor displayed on a remote screen. By integrating a multi-touch trackpad (also called a multi-touch touchpad) into the door or using a handheld touch device, users can conveniently control the entertainment system regardless of their position in the vehicle. This is particularly advantageous for children or people with physical disabilities, as they may not be able to make physical contact with the primary display device, or only with considerable difficulty. Furthermore, the possibility of "blind" operation is advantageous, as the user does not have to take their eyes off the main screen (primary display device) to control the system. This increases safety and ease of use.Furthermore, support for multi-touch gestures enables intuitive and user-friendly interaction with the system. The distributed architecture of the touchscreens, each with its own processor, increases the system's flexibility and efficiency. Finally, reducing the kinematic range of motion of the entertainment screen leads to cost savings in manufacturing and maintenance.

[0021] Further details, features and advantages of the invention will become apparent from the following description and the figures. These show: Fig. 1 a perspective view of the interior of a means of transport designed according to the invention; and Fig. 2 A flowchart illustrating the steps of an embodiment of a method according to the invention for operating a cursor on a screen of a means of transportation.

[0022] Fig. Figure 1 shows a perspective view of the interior of a means of transport 10, from whose headliner 12 a theater screen is provided as a first display unit 2, which can be folded down. The first display unit 2 shows a screen with three buttons 13, 14, 15 and a cursor 1 above button 15. Partially cut out, a second processor 7 is shown, which is connected to touchpads 3 in a second display unit 9 located in a door panel 8 of a door 4. The surface normals of the touchpads 3 are oriented in the negative X direction and the positive Z direction, thus enabling comfortable viewing by users (not shown) in the second row of seats 11.On seat 11, a smartphone is placed as a portable user device 5 with a touchpad 3. The first processor 6 of the touchpad can exchange data sets with the second processor 7 via a (not shown) wireless connection or wired transmission to influence the position of the cursor 1 in real time through swipe gestures. The touchpads 3 are each equipped with a processor 6, which digitizes the input gestures performed by a user while in contact with the touchpads 3, creates data packets, and sends them to the second processor 7. This arrangement allows for convenient control by the user, while the cursor 1 is displayed on a remote screen where it would not be as easily accessible through physical contact.

[0023] Fig.Figure 2 shows steps of an embodiment of a method according to the invention for operating a cursor on a first display device that is permanently installed in a means of transport and integrated into its on-board electrical system. The means of transport can be a car, van, truck, motorcycle, aircraft, and / or watercraft. In step 100, an input gesture on a touchpad 3, which is arranged in a door of the means of transport, is automatically detected by sensors. The touchpad can be pivotable or flush with a surface of the door module. In step 200, a data record representing the input gesture is assigned by a first processor. The first processor is spatially and informationally associated with the touchpad and is located, in particular, in the door or door panel of the means of transport.In step 300, the data set is transmitted from here to a second processor associated with the first display device. This second processor is spatially and informationally linked to the first display device. Specifically, the second processor can be located in the headliner of the vehicle. Alternatively, it can be located in or under the dashboard of the vehicle. Finally, the second processor can also be located in a headrest or backrest of the vehicle. In step 400, the second processor adjusts the cursor position on the first display device based on the data set. In other words, the information contained in the data set is evaluated by the second processor in such a way that a new position for the cursor is defined and used for continuous display. Reference symbol list: 1 cursor 2 first display device 3 Touchpad 4-door 5 User terminal 6 first processor 7 second processor 8 Door trim 9 second display device 10 means of transport 11 seats 12 Headliner 13 to 15 buttons 100 to 400 process steps

Claims

Method for operating a cursor (1) on a first display device (2) permanently installed in a means of transport (10) and integrated into its on-board network, comprising the steps: • Detecting (100) an input gesture on a touchpad (3) located in a door (4), center console, or armrest of the means of transport (10), or in a user's portable terminal device (5); • Determining (200) a data set representing the input gesture by means of a first processor (6) associated with the touchpad (3); • Transmitting (300) the data set to a second processor (7) associated with the first display device (2); and • Adjusting (400) the position of the cursor (1) on the first display device (2) depending on the data set, wherein the touchpad (3) is designed to be transparent and covers a second display device (9);characterized in that the second display device (9) is configured to: - when the first display device (2) is unfolded, display screen content which supports operation of the cursor (1) by a user and / or - when the first display device (2) is folded down, display screen content which supports operation of content of the second display device (9). Means of transport with a device for operating a cursor (1) on a first display device (2) permanently installed in the means of transport (10) and integrated into its on-board network, comprising: • a touchpad (3) • a first processor (6) • a second processor (7) • the first display device (2), wherein: • the touchpad (3) is configured to detect an input gesture (100), wherein the touchpad (3) is arranged in a door (4), in a center console, or in an armrest of a means of transport (10), or in a portable user terminal (5) in the means of transport (10); • the first processor (6) assigned to the touchpad (3) is configured to determine a data set representing the input gesture and to transmit the data set to the second processor (7) assigned to the first display device (2); and • the second processor (7) is configured toto adjust the position of the cursor (1) on the first display device (2) depending on the data set, wherein the touchpad (3) is designed to be transparent and covers a second display device (9); characterized in that the second display device (9) is configured to: - display screen content when the first display device (2) is unfolded, which supports operation of the cursor (1) by a user, and / or - display screen content when the first display device (2) is folded down, which supports operation of content on the second display device (9). Method according to claim 1 or means of transport according to claim 2, wherein the first display device (2) comprises a matrix display, in particular a screen configured for playing back audio / video media files. Method according to claim 1 or 3 or means of transport according to claim 2 or 3, wherein the touchpad is arranged outside a housing of the first display device (2). Method according to claim 1, 3 or 4 or means of transport according to one of claims 2 to 4, wherein the touchpad (3) is arranged in a door panel (8) of the means of transport (10). Method according to claim 1 or 3 to 5 or means of transport according to one of claims 2 to 5, wherein the user's portable terminal device (5) is configured to wirelessly transmit the data set to the second processor (6) via Bluetooth and / or WLAN. Method according to claim 1 or 3 to 6 or means of transport according to any one of claims 2 to 6, wherein the first display device (2) is a screen foldable from a roof liner (12) of the means of transport (10). Method according to claim 1 or 3 to 7 or means of transport according to one of claims 2 to 7, wherein the second display device (9) has a surface normal which is oriented with respect to a coordinate system of the means of transport (10) in the negative longitudinal direction of the vehicle (-X) and in the positive vertical direction (Z). Method according to claim 1 or 3 to 8 or means of transport according to one of claims 2 to 8, wherein the cursor (1) is configured to adjust its position on the first display device (2) again in response to the receipt of a new data set representing a new input gesture on the touchpad (3).

Images