Method, mobile terminal, motor vehicle and computer program for capturing observation data relating to a trip of a motor vehicle, and observation data obtained in such a way
Patent Information
- Application Number
- PCT/EP2024/071323
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-29
- Filing Date
- 2024-07-26
- Publication Date
- 2025-02-27
Smart Images

Figure EP2024071323_27022025_PF_FP_ABST
Abstract
Description
[0001] Method, mobile terminal, motor vehicle and computer program for recording observation data of a journey of a motor vehicle and observation data thus obtained
[0002] DESCRIPTION:
[0003] The invention relates to a method for recording characteristic data or observation data during a journey of a motor vehicle. Such observation data relate in particular to biosensor measurements or characteristics of a driver (so-called vital data). Here, one may be interested in being able to determine whether the recorded observation data were actually caused during and / or because of the journey or by other events that are not related to the journey but occurred before or after it. Conversely, one may be interested in recording and / or evaluating this observation data only when the driver is actually on a journey, i.e., one would like to define a corresponding trigger for recording at the beginning and end of a journey.The invention also includes a mobile device and a motor vehicle that can be used to collect the observation data, as well as a computer program for a mobile device to implement the method. Observation data obtained using the method also constitute a component of the invention.
[0004] During a motor vehicle journey, it can be advantageous to collect personal observation data on a biosensory parameter (e.g., heart rate) and / or a psychological parameter (e.g., mood) to determine, for example, whether the driver is feeling well. One challenge in collecting such observation data is the reliable separation of vehicle-induced changes in these parameters—that is, the separation of changes in these parameters that correlate with the journey—from changes in these parameters that were not caused by the journey.One problem is to reliably collect and / or evaluate the observation data only when the situation of a journey actually exists, because otherwise the collected observation data will be interpreted under the assumption of incorrect boundary conditions, because it is wrongly assumed that the user is sitting in a vehicle and gives corresponding advice that only makes sense in the vehicle (e.g. "The air conditioning should be set to a cooler level.").
[0005] An important distinguishing criterion has emerged that it should be possible to reliably recognize when a journey has started and when it has ended.
[0006] The collection of personal observation data is often conducted using a portable, mobile device that cannot directly record the driving status of a motor vehicle. To gain insight into observation data from journeys, the driver must currently declare the start and end of a journey at the touch of a button, e.g., on a touchscreen of the device, if the vehicle's computer system cannot be queried. The problem with this manual definition of the start and end of a journey is that it is easily forgotten, which leads to no insights into the current journey being gained because measured observation data cannot be clearly assigned as belonging to the journey.
[0007] The invention is based on the object of enabling the separation of observation data "related to the journey" from observation data that are not influenced by the journey itself when recording observation data in a motor vehicle, or conversely, of making the recording of observation data dependent on the presence of a driving situation. This object is achieved by the subject matter of the independent patent claims. Advantageous further developments of the invention are described by the dependent patent claims, the following description, and the figure.
[0008] As one solution, the invention comprises a method for recording observation data during a journey of a motor vehicle. This observation data describes a value of at least one predetermined parameter and / or a temporal progression of the at least one parameter. For example, the observation data can describe a value that indicates a mood or temper of the driver and / or a temporal progression of a heart rate (pulse rate) and / or alertness and / or electrical skin conductivity. This observation data is categorized as belonging to the journey at the beginning and / or during and / or at the end of the journey, i.e. it is recorded under the assumption that the user is currently completing a journey. It can therefore be observation data initiating the journey (at the beginning of the journey) and / or a progression during the journey and / or a result at the end of the journey.
[0009] In order to be able to distinguish which observation data actually belong to the journey itself or to obtain a trigger for the recording of the observation data at the beginning and the stopping of the recording at the end of the journey, the method provides for the respective observation data to be recorded together with a time stamp of the time of recording, so that a date and / or time is available for the respective observation data at which they were measured or recorded. The term “observation data” here therefore refers in particular to a single measured value or a series of several measured values (with respective time stamps) for a single parameter, e.g. the pulse rate. In the method, a predetermined start event is determined or detected, which signals the start of the journey. Accordingly, a predetermined end event is also detected, which signals the end of the journey. Based on this, for example,A recording time interval is defined, extending from the start event to the end event, to which all observation data whose timestamps lie within this time interval are assigned or summarized as belonging to the trip. All observation data whose timestamps lie after the start event are categorized as belonging to the trip, up to the end event. This can be done in real time during the trip or retrospectively in a subsequent evaluation. The start event can also be used as a trigger for the recording of the observation data, while the end event can be used to control the termination of the recording.
[0010] The separation between observation data that actually belong to the trip or are dependent on it and any additional observation data that may be recorded that are not part of the trip is determined based on a predefined start event and end event, whose respective event times define the boundaries for a recording time interval. Only observation data whose timestamps lie within the recording time interval from the start event time to the end event time are then counted as belonging to the trip.Thus, when evaluating the observation data, it is known under which boundary conditions, namely between the start event and the end event, the observation data were recorded. This means that at least through this definition of the recording time interval, it is known under which boundary conditions the observation data was recorded (namely, whether it was part of the journey or not, according to the definition of the start event and the end event). The start event and the end event can also be used to control (activate or deactivate) the recording of the observation data, so that the recording of the observation data can be automatically limited to the period between the start event and the end event. A user authorization request can be sent after the start event, which only actually starts the recording of the observation data if the user of the end device agrees. E.g.A message may be displayed: "The start of a journey has been detected. Would you like to have observation data collected on your vital signs (generally, at least one parameter)?" Only if the user then agrees will the collection of observation data begin.
[0011] The invention provides the advantage that, when evaluating observation data from a journey, it is known that the observation data were observed after a predetermined starting event and that the end event has not yet occurred. Knowing these boundary conditions significantly simplifies or makes the interpretation or evaluation of the observation data more meaningful.
[0012] The method can be carried out in particular in a portable, mobile terminal device of a user of the motor vehicle, in particular a driver. From such a terminal device, it is generally very complex to recognize or detect the driving state of the motor vehicle itself, i.e. its movement, since in particular there is no access to the speed sensors or the tachograph of the motor vehicle. Therefore, when recording observation data via such a mobile terminal, the uncertainty as to when a journey in a motor vehicle actually began and when it ended is particularly great. The method enables the person skilled in the art to control the recording of observation data using other characteristic events which the person skilled in the art can determine as reliable indicators of a journey, for example through tests in test vehicles.A smartphone, a tablet PC, a smartwatch or data glasses can be used as a mobile device.
[0013] The invention also encompasses further developments which result in additional advantages. According to one further development, a wire-based and / or radio-based and / or optical coupling of the portable, mobile terminal device to a motor vehicle computer system is detected as the starting event. In particular, starting from a mobile terminal device, this results in reliable measurement-based and / or software-based detection of a connection or coupling of the terminal device to a vehicle computer system, so that the presence or arrangement in the motor vehicle can be reliably detected. The wire-based coupling can, for example, be based on a USB connection (USB - Universal Serial Bus), so that the connection to a vehicle computer system can be recognized based on a USB ID.Radio-based connection can be implemented, for example, using Bluetooth or WLAN (Wireless Local Area Network), where a unique ID of the vehicle's computer system, e.g., a MAC address (MAC - Media Access Control) or a radio ID from the end device, can be used to detect a connection. Optical connection can be implemented, for example, using WiFi technology. In this way, it can be automatically detected within a mobile device, i.e., using a computer program used there, that the device is located in a motor vehicle and that the device is connected to the vehicle's computer system.
[0014] A corresponding detection signal is preferably generated when application software (computer program) in the terminal device receives the authorization or request to provide a screen content for a screen of the vehicle computer system, as is provided, for example, when mirroring the terminal device screen content onto a screen of the vehicle computer system. Such a coupling signal arises when using the Car Play® product from Apple® and / or the Android Auto® product from Google®. Such a coupling signal, which indicates that screen control of the vehicle computer system screen is being carried out or is to be carried out by the application software of the terminal device, is referred to below for short as "connection mode."The connection mode is a reliable indicator in that the user of the terminal device considers the journey to have begun and is now actively turning his attention away from the terminal device and towards the screen of the vehicle computer because he has switched to this screen.
[0015] However, it is also possible, in addition or alternatively, to determine the status "inside the vehicle" based on other parameters. This can be the physical connection between the smartphone and the car interface (connector contact yes or no) and / or the available GNSS data (movement speed greater than a threshold, e.g., in the range of 6 km / h to 25 km / h, preferably a threshold of 7 km / h; GNSS - Global Navigation Satellite System, e.g., GPS - Global Positioning System). Based on this data, it can also be determined whether the vehicle is moving or not, whether data collection is possible, or whether the mobile device is located in a vehicle.
[0016] According to a further development, the decoupling of the portable, mobile device from the vehicle's computer system can be detected as an end event. This decoupling means that the data connection between the device and the vehicle's computer system is interrupted, which has proven to be a reliable indication that the user of the device has ended the journey and wishes to remove the device from the vehicle. In particular, the termination of the connection mode can also be detected as an end event based on the aforementioned coupling signal.
[0017] The evaluation of the coupling or uncoupling has proven to be a particularly advantageous starting event or end event in that it can be assumed that a driver, when coupling, also directs his attention or concentration to operating and / or driving the motor vehicle, so that an influence on biosensory parameters, such as the heart rate, and / or on psychological parameters, such as mood, correlates or is connected to a journey from the time the terminal is coupled because the driver concentrates on driving and / or operating the motor vehicle.Likewise, when a driver uncouples their device from the vehicle's computer system, they will also consider the journey to be complete in their consciousness or concentration. Therefore, from this point of final uncoupling, a biosensory parameter, such as heart rate, can be influenced by other events with greater influence, such as thoughts about an upcoming appointment. Thus, a reliable, indirect indicator of the impact of the journey on a person has been identified.
[0018] As already explained, coupling particularly involves redirecting or mirroring the screen output of the end device from the device's own screen to the vehicle's own screen. Since this must also be carried out in the end device by appropriate software, for example application software, this change or state can be reliably detected in the end device itself. Additionally or alternatively, a state change from "not connected" to "connected" can be detected by cyclical querying of the connection state of the end device with the vehicle computer system. This state change or querying of the connection state can be carried out by application software in the end device in an operating system of the end device, which can reliably query the connections of the end device to an external device, such as the vehicle computer system.
[0019] Likewise, according to a further development, during decoupling, it can be detected that the screen output of the end device is removed from the vehicle's own screen or terminated. This must then be handled or reacted to by the application software in the end device, so that a reliable signal can be generated in the end device that the decoupling has occurred. In addition or alternatively, the connection status can be queried or checked by cyclical polling, for example, in the end device's operating system to determine whether the state change from "connected" to "not connected" has occurred. This also allows the end event to be reliably detected within the end device.
[0020] "Application software" is understood, in particular, to mean software that provides a function that can be used directly by a user, such as, in particular, media playback (music and / or video), internet browsing, reading emails, social media, and portal operation, to name just a few examples. In particular, in connection with the invention, it can be provided that so-called health monitoring is carried out as application software, with the observation data describing at least one of the aforementioned biosensory and / or psychological parameters, and the influence of a journey on the observed person, in particular the driver, is determined.
[0021] However, according to a further development, a detected start event is ignored if observation data acquisition is already active. If the start event occurs twice in succession without an end event being detected in between, the second detected start event can be ignored. This means that a first start event was detected, but no corresponding end event was detected yet; instead, a second start event was detected. This second start event can then be ignored. This prevents, for example, transmission problems in the data connection from leading to an interruption in observation data acquisition or even the discarding of the observation data stored up to the detection of the second start event.
[0022] According to a further development, a current geoposition (for example of the motor vehicle or the mobile device) is determined using a receiver for a position signal from a GNSS (Global Navigation Satellite System). Based on map data, it is determined whether the geoposition lies within a location area specified in the map data, which is referred to here as a "temporary location area". Such a temporary location area could be, for example, a motorway service station or a petrol station. If the geoposition lies within such a temporary location area, a detected end event is ignored. This makes it possible to take into account that journey-related processes, such as refueling, can also take place outside the vehicle. The acquisition of the observation data is therefore controlled by a GNSS receiver, e.g. a GPS receiver (GPS - Global Positioning System).
[0023] Likewise, an end event can be ignored (subsequently) if a start event is detected again within a predetermined time interval after the last detected end event. This time interval can range from 0 seconds to 25 minutes. Thus, the end of the journey is detected, and within the time interval, for example, within 0 to 25 minutes, a new start event, i.e., the beginning of a new journey, is detected.
[0024] In both of these cases, i.e. if the vehicle is in a temporary location or the interruption in the journey is shorter than the time interval, the detected end event is ignored, i.e. a continuous journey is assumed or used as a basis for saving or recording observation data. This means that a short interruption in the journey (“short” in the sense of a stay in a temporary location and / or shorter than the time interval) can be ignored and the entire period before and after this interruption can be used as a continuous journey. This detection of a break in the journey has proven advantageous in that the short interruption, for example for refueling and / or running an errand, has no influence on the longer-lasting effect of a journey, such as calming down or a change in mood.In addition to the described start event and end event, a plausibility check of the status signal for the journey can also be provided. A further development involves detecting a status signal of a traction drive motor of the motor vehicle, which distinguishes between a switched-on and a switched-off state of the traction drive motor. The traction drive motor can be, for example, an internal combustion engine, an electric motor, or a hybrid drive. A last detected start event and / or a last detected end event is checked for plausibility by being ignored if a status change of the traction drive motor does not occur in the status signal within a predetermined time interval, i.e., the traction drive motor is not started or is not switched off.If a start event is detected, the drive motor's status must change from "off" to "on" within the specified time interval so that the observation data recorded up to that point is actually detected as belonging to a trip. Likewise, an end event is only valid if the drive motor's status change from "on" to "off" is also detected within the time interval; otherwise, the end event is ignored, and the recording, storage, or capture of the observation data continues. The respective time interval can be monitored before and / or after the respective event (e.g., first the motor start, then the start event, or vice versa, first the start event, then the motor start).
[0025] As already explained, the at least one parameter is a respective biosensory and / or psychological parameter. A biosensory parameter is, in particular, a heart rate or pulse rate. A psychological parameter is, in particular, mood (confident, depressed, worried, to name just a few examples) and / or a temper (in a good mood, angry, happy, to name just a few examples) and / or a degree of well-being. Such parameters have proven to be an important indicator of the quality of a journey. They can, for example, be recorded as a biosensory parameter using a sensor (available in the prior art); a psychological parameter can, for example, be determined by interviewing the observed person and / or by indirect measurements, such as a driving style compared to a typical or averaged driver profile.
[0026] For use cases or application situations that may arise during the method and which are not explicitly described here, it may be provided that, in accordance with the method, an error message and / or a request to enter user feedback is issued and / or a default setting and / or a predetermined initial state is set.
[0027] In order to implement the method, in particular in order to implement it in a portable mobile terminal or in a backend server of a motor vehicle, the invention also comprises a computer program with program instructions which, when executed by a processor circuit, cause the processor circuit to carry out an embodiment of the described method. The processor circuit can also be implemented as a distributed processor circuit in which part of the computer program is executed in a mobile terminal and another part in an internet-based server. The terminal and the server can communicate via an internet connection and / or a mobile radio connection in order to carry out the method. In connection with the implementation in a mobile terminal, the invention also comprises a portable, mobile terminal with a processor circuit which has the described computer program.In connection with the combined or distributed processor circuit, the invention also encompasses a system-comprising a portable, mobile terminal and a stationary server, wherein the terminal and the server provide a processor circuit divided between the terminal and the server, which comprises a computer program of the type described. Finally, the invention also encompasses observation data of a journey of the motor vehicle, as they result from an embodiment of the method according to the invention or are generated by such a method. Such observation data represent a valuable product of the method, which is considered to be independently protected here.
[0028] The processor circuit can have at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). In particular, a CPU (Central Processing Unit), a GPU (Graphical Processing Unit) or an NPU (Neural Processing Unit) can be used as the microprocessor. Furthermore, the processor circuit can have program code which, when executed by the processor circuit, is configured to carry out the embodiment of the method according to the invention. The program code can be stored in a data memory of the processor circuit. The processor circuit can, for example, be based on at least one circuit board and / or on at least one SoC (System on Chip).
[0029] The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.
[0030] As a further solution, the invention also encompasses a computer-readable storage medium comprising the computer program which, when executed by a computer or computer network (generally the processor circuit), causes the computer to carry out an embodiment of the method according to the invention. The storage medium can be provided at least partially as a non-volatile data memory (e.g., as a flash memory and / or as an SSD - solid state drive) and / or at least partially as a volatile data memory (e.g., as a RAM - random access memory). The storage medium can be arranged in the computer or computer network. However, the storage medium can also be operated, for example, as a so-called app store server and / or cloud server on the Internet. The computer or computer network can provide a processor circuit with, for example, at least one microprocessor.The program code may be provided as binary code and / or as assembly code and / or as source code of a programming language (e.g. C) and / or as a program script (e.g. Python).
[0031] The invention also encompasses combinations of the features of the described embodiments. The invention therefore also encompasses implementations that each comprise a combination of the features of several of the described embodiments, unless the embodiments are described as mutually exclusive.
[0032] Exemplary embodiments of the invention are described below. The single figure shows:
[0033] Fig. a schematic representation of a driving situation in which an embodiment of the method according to the invention can be carried out.
[0034] The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual features of the invention that can be considered independently of one another, each of which also develops the invention independently of one another. Therefore, the disclosure is intended to encompass combinations of the features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.
[0035] In the figures, like reference numerals designate functionally equivalent elements. Figure 1 shows a motor vehicle 10, depicting a windshield 11, a steering wheel 12, and a driver's seat 14, on which a driver 13 can sit, driving the vehicle on a journey F. Driver 13 here represents a user from whom observation data is to be recorded.
[0036] A screen 15 of a vehicle computer system, e.g., an in-vehicle infotainment system (information entertainment system), can also be arranged in the motor vehicle 10. The driver 13 can wear a smartwatch 16 that can determine at least one biosensor parameter, e.g., a pulse rate or pulse frequency of the driver 13, e.g., using a photoplethysmography sensor.
[0037] The driver 13 may have brought a mobile device 17 into the motor vehicle 10, for example a smartphone.
[0038] The terminal device 17 can be connected to the screen 15 via a data connection V, which can be designed in a manner known per se, for example as a Bluetooth connection or generally as a wired and / or radio-based data connection V. The smartwatch 16 can be coupled to the terminal device 17 via a communication network K, for example via Bluetooth.
[0039] In the terminal device 17, a computer program of an application software 20 can be operated or executed by a processor circuit, which, for example, carries out health monitoring, i.e., records a state of health and / or well-being of the driver 13 and can evaluate the influence of the journey F on the driver 13 with regard to health and / or well-being.
[0040] It is shown how the application software 20 over time t
[0041] Parameters K1 , K2 can be measured or recorded, so that
[0042] Observation data 21 of the course over time t with regard to these parameters K1, K2 result. For example, the pulse rate can be determined as observation data 21 from the smartwatch 16 as parameter K1. Via the data connection V, for example, a user survey 19 can be output by the application software 20 from the terminal 17 on the screen 15. This user survey 19 can ask the driver 13, for example, how they are feeling, whether they are in a good mood (represented as the “thumbs up” symbol) or in a bad mood (represented as the “thumbs down” symbol), or whether they are feeling comfortable or uncomfortable. This result of a survey according to such a psychological parameter can be documented as parameter K2 over time t by the application software 20.
[0043] Based on these temporal profiles or generally based on such observation data 21, it is now possible to distinguish or determine the influence of the trip F on the driver 13. For this purpose, a recording time interval 22 can be defined over time t, which includes all those observation data 21 that belong to the trip F and can thus reflect or describe the influence of the trip on the parameters K1, K2.
[0044] In order to identify over time t which observation data 21 belong to the journey F, a start event S and an end event E can be detected, the event time or occurrence time of which can mark or determine the beginning and the end of the recording time interval 22, respectively.
[0045] In particular, the connection state 18 with the screen 15 can be detected or queried via the data connection V in the mobile terminal 17 from the application software 20. The connection state 18 can, for example, be queried or polled by the application software 20 from an operating system OS of the mobile terminal 17 (polling - cyclic polling). Upon a state transition from "not connected" to "connected," the start event S can be detected; upon a state transition from "connected" to "not connected," an end event E can be detected or defined. Thus, the acquisition time interval 22 can be defined in the measurements or in the collection of the trip-related observation data 21.The individual measurement points of the observation data 21 can be recorded or stored or provided with a time stamp so that the observation data 21 can be assigned or classified as to whether they lie within the recording time interval 22 and thus belong to the journey F, or outside the recording time interval 22 and thus are to be classified as not belonging to the journey.
[0046] It can also be planned to start or begin recording or capturing the observation data only with the start event S, either automatically or after additional user authorization, and to end automatically upon detection of the end event. This allows control over whether observation data 21 is recorded or tracked at all (tracking - recording the temporal progression), namely after a start event, or not, namely before a start event and / or after an end event.
[0047] This allows users to automatically detect the start and end of a trip by recording when the user's mobile device starts and ends its connection to the vehicle via the vehicle screen connection (e.g., for screen mirroring, device -> vehicle screen). This is considered a marker for the start and end of a trip.
[0048] The advantage of automatic trip recognition is that the user cannot forget them and can be provided with increasingly detailed information about his recent trips.
[0049] The solution can utilize two mechanisms:
[0050] The application software itself recognizes when it is about to interact with the MMI screen, as it has control over what to display and when. This scenario is used to clearly identify the start of a trip, even if the vehicle is still stationary. The date and time of the start of the trip can be recorded here, and it can be ensured that trip recording is enabled.
[0051] The other mechanism is partially provided by the operating system: the connection mode can be queried to provide information about the data connection status. Regular or cyclic monitoring of the connection mode, e.g., every 15 seconds or with a cycle time ranging from 0.5 seconds to 30 seconds, allows for consideration of starting or ending the trip, especially depending on whether a trip is currently being recorded.
[0052] Overall, the examples show how automated trip detection can be provided.
[0053] The following are aspects of an idea related to health monitoring. They are considered a standalone invention that can also be implemented independently of the described trip detection solution, but can especially be combined with trip detection:
[0054] During a journey, application software can record vital data of at least one vital parameter of a user as a health monitoring function, in particular a biosensor measurement (e.g., heart rate) and / or a psychological observation parameter (e.g., mood). The driver of the vehicle is observed as the user. The observed values contained in the vital data can be stored together with a timestamp and / or a geolocation of their observation.
[0055] During and / or after a journey, a georeferenced representation of the observed values, e.g., by means of color coding for different numerical values, can be displayed to the user on a road map. It can be provided to use a filter (e.g., a correlation filter for predefined curve shapes or a gradient detector for determining a temporal gradient) and / or a threshold value comparison to detect at least one route section in which, in a temporal progression of the respective vital sign, an exceptional event defined by the filter and / or the threshold value or an exceptional state of the user defined by the filter and / or the threshold value, e.g., an increased pulse rate, is detected.
[0056] For example, the user can be questioned about such an exceptional event, e.g. by asking: "It seems you were stressed on Arnulfstrasse. What could be the reason for this?". Causal data can then be determined for the exceptional event, which indicates a cause or a potential cause of the exceptional event. The causal data can be determined using a user survey and / or a road traffic situation (e.g. a traffic jam or rush hour traffic) can be identified as the cause using traffic data and / or a route characteristic (e.g. city driving or winding road or driving through nature) can be identified as the cause using map data. An exceptional event can signal a deterioration or an improvement in the user's condition in relation to a training goal.
[0057] A countermeasure to avoid or mitigate the exceptional situation can be assigned to each exceptional event, e.g., via a look-up table or an artificial neural network. For example, for the exceptional event "increased heart rate," a countermeasure such as "increased ventilation" or "increased cooling" can be assigned. Other exemplary countermeasures could include playing music, adjusting the passenger seat, adjusting the lighting, or suggesting an exercise (e.g., for relaxation or to stimulate circulation). Thus, a countermeasure can be automatically triggered during the journey if the exceptional event is detected in real time.
[0058] In a further development, it is possible to determine whether a potential cause for an exceptional event exists for upcoming route sections, e.g., based on traffic data and / or map data. At least one countermeasure can be triggered for a detected cause before and / or upon reaching the respective route section. For example, as a countermeasure, ventilation can be increased as the vehicle approaches a traffic jam, allowing the user's body to be preconditioned for the traffic jam.
[0059] In order to offer a user a personalized lifestyle health offering (health monitoring functionality), health data (vital data) from a smartphone (e.g. vital data monitoring) can be determined by connecting to it, linking it with driving data and deriving recommendations for exercises. During the journey, the user can be automatically suggested various exercises (e.g. breathing exercises, reflection exercises) to perform in order to optimize their well-being for the journey towards an exercise goal that the user can specify at the start of the journey. After the journey, the user can view their driving and health data on the mobile application; there, preferred exercises (e.g. stretching exercises, relaxation exercises) for after the journey are suggested.Progress in achieving an exercise goal or exercise purpose can be monitored during and / or after the ride by evaluating vital data, and further exercises can be selected and suggested depending on a detected remaining discrepancy between vital data and exercise goal.
[0060] The application software is preferably networked with the user's data sources and, thanks to data-based monitoring, uses targeted opportunities to proactively promote the user's well-being (according to the exercise goal) during and after the trip through personalized services. The connection of health data to sensors and actuators in the vehicle also enables physical, situation-dependent solutions in the vehicle and / or the prevention, detection, and assistance of health emergencies.
[0061] The overall system, which can be controlled by the application software, preferably consists of the following components:
[0062] • The application software is implemented as a module for a framework software: o with functionality for reading the heart rate transmitted by a smartwatch, o with functionality for reading the API provided by the operating system of a portable mobile device for determining GPS coordinates and movement speed,
[0063] • the framework software, into which the application software is integrated merely as a module, provides the following service functions in particular: o with smartwatch connection, o connection to a console screen of the motor vehicle,
[0064] • Backend server for media content (e.g. training videos) for the application software:
[0065] ■ with File System Service for storing media and / or ■ with Serverless Code Execution Infrastructure (Lambda) for executing business and integration logic in the backend and / or
[0066] ■ with API Gateway service to offer the backend interfaces via the public Internet and / or
[0067] ■ with CloudFront service to secure temporarily and individually made available content, and / or
[0068] ■ with a hosted-zone configuration for a domain with subdomains for
[0069] • development (software development)
[0070] • staging (production operation)
[0071] When the user connects their smartphone or portable mobile device to the vehicle via a connection such as Apple® CarPlay® (wireless or wired), the app's user interface (application software) is available on the vehicle's console screen. The app's home screen may offer the option to answer a check-in question, asking whether the user is feeling well or not. The answer, along with the date and time, is saved in the app's local memory on the device, allowing it to be displayed at various locations on the app's screen.
[0072] Check-in question (e.g. when recognizing the start of a journey) after the exercise goal: 'How would you like to arrive?'
[0073] User response options: "More alert", "More relaxed", "Happier" (exercise goal)
[0074] Based on the answer to the check-in question, the trip is optimized for the user to achieve the exercise goal. Based on the user's answer, exercises are selected and recommended for the trip. For example, the user can choose between three modes: "More Alert," "More Relaxed," and "Happier." Based on the check-in question, three exercise recommendations can be issued for each trip. By performing the exercises, the user should achieve or get closer to the state of mind determined by the check-in question.
[0075] For example, the user can select three health data points (vital indicators) that are important for their driving fitness. After selecting the three data points, the user can set a goal for each data point that they want to achieve in order to feel comfortable. When the user starts a ride, they can see the current vital signs on the console screen.
[0076] The goal of "Driving Fitness" is to sensitize the user to their current health status before driving. The color scheme (green, yellow, red) of the recorded vital signs does not necessarily have a medical indication. The color scheme is intended solely to indicate the deviation from the individual goals set by the user. Experts can determine the degree of deviation that requires which color scheme to be used in simple experiments with test subjects.
[0077] A media library can be provided so that users can find and select specific content, and / or media content can be available for exercises and / or automated user environment design (e.g., nature sounds). Each piece of content belongs to a format category—for example, there are four: mood makers, breathing exercises, soundscapes, and coaching.
[0078] Media content can be displayed for different moods. For example, a specific breathing exercise can be beneficial for two different moods, e.g., three moods: "More alert," "More relaxed," and "Happier." Each exercise or piece of media content belongs to a specific "content format," e.g., "Breathing exercises," "Pause fillers," or "Coaching sessions." Depending on its characteristics, an exercise can be displayed in different mood categories.
[0079] The selection of exercises varies depending on the user’s health data (vital data).
[0080] Displaying and / or analyzing vital data raises the user's awareness that the user's health status may change during the ride.
[0081] To this end, the application software uses the described connection of the smartwatch to a road map to track at least one trip for the user. To track the trip, the user must manually start and stop the trip recording. After the trip, the color-coded route and insights into health data (= heart rate) about the trip can be displayed. Using the filter and / or threshold, the user can be shown whether, for example, the heart rate or general vital data has increased or decreased during the trip (based on the user's average measured heart rate). In other words, the filter and / or threshold can be set relative to the user's average vital data.
[0082] The user can be given more detailed information about the trip and an exercise recommendation based on the check-out question in order to avoid the exceptional events or (in the case of positive developments) to reinforce them.
[0083] One aspect of the system is to raise awareness that the user's health may change during a ride by displaying heart rate changes at the end of a ride. Based on changes in health data during the ride, a checkout question can be provided. The checkout question can be answered on the console screen or on the device. The purpose of a checkout question at the end of the ride is to give the user the opportunity to reflect on their ride and determine, for example, whether the exercise has had any effect.
[0084] This allows the user to set their individual driving fitness goal. By allowing the user to set a training goal for vital signs, a driving fitness score can be displayed, meaning that the comparison of the actual value to the specified target value allows for a quantification of the user's condition.
Claims
PATENT CLAIMS:
1. A method for acquiring observation data (21) during a journey (F) of a motor vehicle (10), wherein the observation data (21) describe a value of at least one predetermined biosensory and / or psychological parameter and / or a temporal progression of the at least one parameter and are acquired at the beginning and / or during and / or at the end of the journey (F), characterized in that the respective observation data (21) are acquired together with a time stamp of their acquisition time and a predetermined start event (S), which signals a start of the journey (F), and a predetermined end event (E), which signals an end of the journey (F), are detected in the motor vehicle (10), and from the start event (S) to the end event (E), observation data (21) whose time stamp signals a acquisition time between the start event (S) and the end event (E) are categorized as belonging to the journey (F).
2. The method according to claim 1, wherein a wire-based and / or radio-based and / or optical coupling of a portable, mobile terminal (17) to a vehicle computer system is detected as the start event and / or wherein a physical connection of the terminal (17) to a vehicle interface and / or a movement speed of the terminal (17) greater than a threshold value is detected as the start event based on GNSS data.
3. The method according to claim 2, wherein a decoupling of the portable, mobile terminal (17) from the vehicle computer system is detected as the end event.
4. The method according to claim 2 or 3, wherein the coupling comprises transferring a screen output of the terminal (17) from a device-specific screen to a vehicle-specific screen (15) of the vehicle computer system is redirected or mirrored and / or that a state change from “not connected” to “connected” occurs when a connection state (18) is cyclically polled.
5. The method according to claim 4, in its reference to claim 3, wherein the decoupling comprises that a screen output of the terminal (17) is terminated by the vehicle's own screen (15) and / or that a state change from "connected" to "not connected" occurs upon cyclical query of a connection state (18).
6. Method according to one of the preceding claims, wherein a detected start event (S) is ignored if a collection of observation data (21) is already active.
7. Method according to one of the preceding claims, wherein • a current geoposition is determined using a receiver for a position signal from a GNSS, Global Navigation Satellite System, and map data is used to determine whether the geoposition lies in a temporary location area specified in the map data, and / or • a start event (S) is detected within a predetermined time interval after a last detected end event, and in this respective case a detected end event is ignored.
8. Method according to one of the preceding claims, wherein a status signal of a traction drive motor of the motor vehicle (10) is detected, by which a distinction is made between a switched-on and a switched-off state of the traction drive motor, and a last detected start event (S) and / or a last detected end event (E) is checked for plausibility by ignoring it, if a status change of the drive motor in the status signal does not occur within a specified time interval.
9. Method according to one of the preceding claims, wherein a pulse rate and / or an electrical skin conductivity is detected as a biosensory parameter by means of at least one sensor.
10. Method according to one of the preceding claims, wherein a mood and / or a temper and / or a feeling of well-being is recorded as a respective psychological parameter by user survey.
11. Method according to one of the preceding claims, wherein the start event is used as a trigger for the acquisition of the observation data and / or the end event is used as a trigger for the termination of the acquisition of the observation data.
12. A computer program comprising program instructions which, when executed by a processor circuit, cause the processor circuit to carry out a method according to one of the preceding claims.
13. A portable, mobile terminal (17) having a processor circuit comprising a computer program according to claim 11.
14. A system comprising a portable, mobile terminal (17) and a stationary server, wherein the terminal (17) and the server provide a processor circuit divided between the terminal (17) and the server, which processor circuit has a computer program according to claim 12.
15. Observation data (21) of a journey of a motor vehicle (10), wherein the observation data (21) are generated by a method according to one of the preceding method claims.
Citation Information
Patent Citations
Control for an electronic multi-function apparatus
CN107466223A
Physiological information detection device, physiological information computing unit and physiological information detection method
JP2009082655A
Driver facts behavior information storage system
US20170097243A1
Vehicle data selection system for modifying automated driving functionalities and method thereof
US20180050696A1
Control device, system, and method for determining a comfort level of a driver
US20210153796A1