Portable user terminal and method for assisting a user of a means of transport by means of a personal digital assistant

Abstract

A portable user terminal (4) and a method for assisting a user (1) of a means of transport (10) by means of a personal digital assistant (2) are proposed. The method comprises the steps of: using the personal digital assistant (2) on a portable digital user terminal (4) of the user (1), sensor-technically determining an approach of the user (1) to the means of transport (10) and, in response thereto, automatically displaying the personal digital assistant (2) on an external display (3) of the means of transport (10), and automatically terminating (300) the personal digital assistant (2) on the portable digital user terminal (4).

Description

[0001] The present invention relates to a means of transportation, a portable user terminal, and a method for assisting a user of a means of transportation using a virtual personal digital assistant. In particular, the present invention relates to convenient and user-friendly assistance provided by a system comprising a means of transportation and a smartphone.

[0002] The popularity of personal assistance functions in smartphones, smart wearables, etc. remains unbroken. Users are increasingly being provided with proactive assistance. For example, suggestions regarding topics such as "weather forecast," "traffic jam forecast," "navigation route," etc. are provided (without being asked). Such assistants are also increasingly found in vehicles. Voice control while driving the vehicle is particularly beneficial for road safety. If both the smartphone and the vehicle provide suggestions, a situation may arise in which both contradict each other, acoustically overlap, or information already received by the user from one instance is re-provided by the other instance. This can impair the user experience.

[0003] US 10 279 683 B2 discloses a vehicle with a digital personal assistant that can greet an approaching user or say goodbye to a departing user.

[0004] DE 10 2021 126 193 A1, JP 2010 - 257 249 A and DE 10 2021 208 039 A1 disclose further prior art which may be helpful in understanding the present invention.

[0005] Based on the aforementioned prior art, it is an object of the present invention to enable the use of a personal digital assistant in a situation-appropriate manner also in the vehicle context.

[0006] The above object is achieved according to the invention by a method having the features according to claim 1 and a portable user terminal having the features according to claim 8. The subclaims show preferred developments of the invention.

[0007] According to the method according to the invention, a personal digital assistant on a smartphone or other smart wearable can, for example, greet the user daily (at least once) or say goodbye in the evening. It can determine the position of the user / mobile phone, either prompted or unprompted, and guide the user to the assigned means of transport using voice output. A light indicator can be displayed to the user via the smartphone. For example, LEDs contained in the smartphone can be controlled to guide the user safely to their means of transport in the dark. Depending on a predefined distance or a corresponding user input, the means of transport can welcome the user or facilitate approach (e.g., in the dark) by emitting light signals, thus indicating itself to the approaching user.In particular, the personal digital assistant can display a so-called welcome animation on the user's smartphone screen and ask whether the user intends to use the means of transport for a journey. In this case, the personal digital assistant can, for example, preheat operating fluids, start an internal combustion engine, precondition an interior temperature, or at least offer the aforementioned steps by displaying a corresponding button on the smartphone display. However, if the user does not intend to travel but merely wants to insert objects into or remove objects from the means of transport, the aforementioned preconditioning steps are not necessary; the user can indicate this via a button displayed on their smartphone display.To prevent the smartphone's personal digital assistant and (after arriving at the vehicle) a corresponding personal digital assistant of the means of transport from making contradictory suggestions, simultaneously addressing voice outputs to the user, or obstructing the user by issuing identical suggestions at a later time, the invention provides that the personal digital assistant on the smartphone is terminated as soon as the personal digital assistant in the means of transport is ready and the user is sufficiently close to the means of transport to use it. In this way, the personal digital assistant, which can also be referred to as an "avatar," can accompany the user to the vehicle and into the vehicle without causing the inconveniences known in the prior art.The user's approach to the means of transport can be accompanied by light carpets or other light signals to illustrate that the means of transport is prepared for the user's arrival and to make the journey as pleasant as possible. For example, the user can be actively questioned, supported, or accompanied. This may include, for example, an inquiry about the purpose of the journey, the duration of the journey, or any other request. Furthermore, the personal digital assistant (of the smartphone or subsequently of the means of transport) can inform the user about the weather forecast or the current weather and / or an upcoming appointment according to a calendar entry.

[0008] The method disclosed herein serves to assist a user of a means of transportation using a virtual personal digital assistant, which can be implemented, for example, on a smartphone or another portable digital user device (e.g., VR / DR glasses). The means of transportation can be configured, for example, as a car, van, truck, motorcycle, aircraft, and / or watercraft. The user can be a driver or a user accessing the closed / locked means of transportation. In other words, the user has an identifier that authorizes them to access the means of transportation. In a first step, the user's proximity to the means of transportation is detected using sensors. This can be done, for example, using an antenna (in conjunction with an identifier of the portable user device carried by the user), a camera, a capacitive sensor, or similar.In response to the detection of the user's approach, the personal digital assistant is then automatically displayed on an external display of the means of transport. In other words, the personal digital assistant implemented on the means of transport starts automatically in response to the user's approach. In order to avoid the disadvantages known in the prior art, a personal digital assistant implemented on the portable user terminal is muted or deactivated / terminated at the same time or essentially at the same time. The personal digital assistant implemented in the means of transport is thus continuously used to support the user. In particular, logic of the means of transport is used for this purpose, which logic is executed on an evaluation unit of the means of transport. In other words, for example, a new instance of a (different orThe logic is continuously executed on an evaluation unit of the portable user terminal (or other) personal digital assistant on the means of transportation, rather than simply using a display device of the means of transportation to display the personal digital assistant. As a result, the user can enjoy continuous, seamless support from a personal digital assistant without suffering the duplication known in the prior art.

[0009] Preferably, the external display can be arranged in a radiator grille of the vehicle. In principle, the external display can be arranged such that its contents appear essentially as part of the outer skin or just behind the outer skin of the vehicle. Alternatively or additionally, the external display can shine through a windshield and / or a side window and / or a rear window of the vehicle or display its contents. Thus, the user can receive support from the personal digital assistant on the external display even during the boarding process.

[0010] According to the invention, the method is further developed by using the virtual personal digital assistant on a portable digital user device of the user, on which the personal digital assistant is automatically terminated in response to the detected proximity. In other words, the personal digital assistant on the smartphone is terminated, muted, or at least prevented from issuing further instructions as soon as the personal digital assistant implemented in the means of transport is ready for use. By avoiding duplicate or conflicting outputs, the processor performance and energy consumption of the smartphone can also be reduced.

[0011] The personal digital assistant can be terminated on the smartphone and restarted in response to the establishment of a data connection with the means of transport and / or the detection of the user's identity (physical characteristics, facial recognition, retinal scan, etc.) by the means of transport. The data connection can, for example, include a short-range radio connection such as Bluetooth, Bluetooth Low Energy, or similar. NFC communication protocols can also be used to detect the approach of the user or their portable device to the means of transport.Approach can also be detected using satellite-based positioning, in response to which the vehicle informs the smartphone / portable user device that the personal digital assistant in the vehicle is now available and that deactivating the personal digital assistant in the portable user device would not result in any loss of support. In response, the portable user device can mute, terminate, or at least deactivate the personal digital assistant's voice output and other notifications.

[0012] The user base for the present invention expands particularly when the virtual personal digital assistant produces a voice output to offer or provide support to the user. The voice output can be provided acoustically via a loudspeaker. In particular, a visual representation of the personal digital assistant can perform synchronous lip movements with the voice output. Given increased ambient noise levels or the user's hearing impairments, the user can thus read the lips of the personal digital assistant and, if necessary, even acknowledge the offers and suggestions presented on the external display from greater distances without a data connection.

[0013] Preferably, the personal digital assistant can be displayed on the external display of the means of transport in response to the establishment of a data connection between the portable user device and the means of transport, and alternatively or additionally in response to sensor-based detection of the user's identity (physical characteristics, retinal scan, fingerprint, facial recognition, or similar). In other words, in response to the aforementioned events, the means of transport can initiate the launch of the personal digital assistant or at least its display on the external display to signal to the user that support is now available from the means of transport (but in particular no longer from the smartphone's personal digital assistant).

[0014] To ensure that the user is not surprised by the personal digital assistant switching from their portable user device to the means of transport, or to ensure that the user has the opportunity to prevent this switching, in response to a detection of spatial proximity to the means of transport, the user can be informed of the (impending / suggested) switch of the assistant to the external display of the means of transport through spoken and / or written language via the portable user device and / or through an animation displayed on a display device thereof. In other words, the user can receive an output such as "see you in the vehicle" or "see you in a moment, I'll hop in" as information that the processing unit executing the personal digital assistant will be switching shortly.In this way, the user is not surprised by the switch and, if necessary, has the opportunity to influence the type of switch or even prevent the switch completely. In other words, the switch can simply be announced in response to the determination of the spatial proximity between the smartphone and the means of transport, at which point the user has the opportunity to intervene (e.g., for a predefined period of time).

[0015] Preferably, the personal digital assistant can continue to accompany the user as they board the vehicle. For this purpose, the user's entry into the vehicle can be detected using sensors, for example. For example, interior / exterior cameras, door contact switches, seat occupancy sensors, etc. can be used for this purpose. In response to detecting entry, the virtual personal digital assistant can switch to an interior display of the vehicle. In particular, the exterior display can be cleared by the personal digital assistant or the display can be deactivated / switched off. The personal digital assistant is then continuously displayed / executed, for example, via an instrument cluster, a head-up display, a windshield root display, or a central information display of the vehicle.

[0016] According to a second aspect of the present invention, a portable user terminal with wireless communication capability (e.g., smartphone, smart wearable, or similar) is proposed, which is configured to support the method described above. In other words, a virtual personal digital assistant can be executed on the portable user terminal, which is terminated in response to an approach to the means of transport and optionally after receiving a corresponding completion message regarding the activation of a personal digital assistant in the means of transport. In this way, the portable user terminal is configured to execute or contribute to the parts of the method according to the invention that are assigned to the portable user terminal.The features, combinations of features and advantages are so clearly evident that, to avoid repetition, reference is made to the above explanations.

[0017] According to a third aspect of the present invention, a means of transportation is proposed, which can be configured as a car, van, truck, motorcycle, aircraft, and / or watercraft. The means of transportation has a data input, an evaluation unit, and a data output. The data input can be connected, for example, to an antenna of the means of transportation, a camera of the means of transportation, or other usable sensors (e.g., a door contact switch, a seat occupancy sensor, or the like). The information connection can be established via bus systems or a single bus system. In particular, the data output of the means of transportation can be linked to an external display and / or an interior display of the means of transportation.In this way, the means of transport is also configured to be used in a method according to the invention and to carry out the steps associated with the means of transport. In conjunction with the portable user terminal according to the second aspect of the invention, a system is thus obtained which is configured to implement the features, feature combinations, and resulting advantages of the method according to the invention in a corresponding manner, so that reference is made to the above explanations to avoid repetition. Short description of the characters

[0018] Further details, advantages, and features of the present invention will become apparent from the following description of exemplary embodiments with reference to the drawings. They show: Fig. 1 a perspective view of a user approaching a means of transport when carrying out an embodiment of a method according to the invention; and Fig. 2 a flowchart illustrating steps of an embodiment of a method according to the invention for assisting a user of a means of transport by means of a virtual personal digital assistant.

[0019] Fig. 1 shows a user 1 in the form of a driver carrying a smartphone as a portable user device 4. A personal digital assistant 2 is running on the smartphone, which supports the user 1 in everyday tasks in a familiar manner. Sensory detection of a predefined proximity to the means of transport 10 in the form of a car is determined by negotiating a short-range radio connection. For this purpose, an antenna 9 of the means of transport 10 receives signals from the smartphone and forwards them to a data input 5 of an electronic control unit as an evaluation unit 6. This initiates the initialization and display of a personal digital assistant 2 on a disk root display as an external display 3, for which a data output 7 of the electronic control unit transmits the necessary commands / signals.After the personal digital assistant 2 of the means of transport 10 has been successfully started, the antenna 9 sends a corresponding completion message to the smartphone, in response to which the personal digital assistant 2 is terminated on the portable user device 4 and thus virtually "gets into the car" according to the arrow P. As soon as the user 1 has also entered the means of transport 10, this is determined via a door contact switch and a seat occupancy sensor (not shown), in response to which the personal digital assistant 2 of the means of transport 10 switches from the windscreen root display to a CID as the display device 8. In this way, the user 1 is continuously, transparently, and comfortably supported / accompanied during the initial phase of using the means of transport 10.

[0020] Fig.Figure 2 shows steps of an embodiment of a method according to the invention for assisting a user of a means of transportation using a virtual personal digital assistant. In step 100, a sensor detects the user's proximity to the means of transportation. In this process, the user's access authorization identifier for the means of transportation can also be queried. In response, in step 200, the virtual personal digital assistant is automatically displayed on an external display of the means of transportation. The display can be located in an interior of the means of transportation or integrated into an outer shell of the means of transportation.In step 300, the virtual personal digital assistant is then used in the means of transport. To avoid duplication, the personal digital assistant on the portable digital user device in the form of a smartphone is automatically terminated. From this point on, the user is therefore only supported by the personal digital assistant in the means of transport. In step 400, the user's entry into the means of transport is then determined by sensors, for which purpose, for example, a predefined switching sequence of a door contact switch and seat occupancy detection can be carried out. In response, the virtual personal digital assistant is then automatically displayed on an interior display of the means of transport in step 500. The interior display can be, for example, an instrument cluster, head-up display, windshield root display, or a central information display.Accordingly, the integration of a portable user terminal carried by the user into the vehicle's on-board information network can also be used as an opportunity to suggest and prepare for the return of the virtual personal digital assistant to the portable digital user terminal. Depending on the user's wishes, the personal digital assistant can thus be continued in a manner that is convenient for the user. It should also be noted that the portable user terminal can have all configurations known in the prior art that enable support of the method according to the invention. For example, the portable user terminal can be VR glasses, AR glasses, or MX glasses.Corresponding user terminals worn on the user's head usually have corresponding display devices and communication modules by means of which the steps according to the invention can be carried out.

[0021] The result is a very convenient and intuitive process for the user to seamlessly integrate a personal digital assistant into a device network consisting of a smartphone (or other portable user device) and a means of transport. List of reference symbols 1 user 2 (virtual) personal digital assistant 3 external display 4 portable user terminal 5 Data input 6 Evaluation unit 7 Data output 8 Interior display 9 Antenna 10 cars 100-500 process steps P Arrow

Claims

[1] Method for assisting a user (1) of a means of transportation (10) by means of a personal digital assistant (2) comprising the steps: - Using the personal digital assistant (2) on a portable digital user terminal (4) of the user (1), - Sensor-based detection (100) of the user's approach (1) to the means of transport (10) and in response to it - automatic display (200) of the personal digital assistant (2) on an external display (3) of the means of transport (10), and - automatic termination (300) of the personal digital assistant (2) on the portable digital user terminal (4). [2] Method according to claim 1, wherein the external display (3) - is located in a radiator grille and / or - through a windscreen and / or a side window and / or a rear window of the means of transport (10). [3] Method according to one of the preceding claims, wherein the personal digital assistant (2) performs speech output and in particular displays lip movements synchronous with speech output. [4] Method according to any of the preceding claims, wherein the personal digital assistant (2) responds to - the establishment of a data connection and / or - a sensor-based detection of the user's person (1) is displayed on the external display (3) of the means of transport (10). [5] Method according to one of the preceding claims, wherein the personal digital assistant (2) responds to a determination of spatial proximity to the means of transport (10) to the user (1) - through spoken and / or written language and / or - suggests, through an animation, switching to the external display (3) of the means of transport (10). [6] Method according to any one of claims 1 to 4, wherein the personal digital assistant (2) responds to a determination of spatial proximity to the means of transport (10) to the user (1) - through spoken and / or written language and / or - announces its switch to the external display (3) of the means of transport (10) by means of an animation. [7] Method according to any of the foregoing claims, further comprising - Sensor-based detection (400) of the user boarding (1) the means of transport (10) and in response to it - automatic display (500) of the personal digital assistant (2) on an interior display (8) of the means of transport (10). [8] Portable user terminal which is configured to be used as a portable digital user terminal (4) in a method according to any of the preceding claims.

Images