Method of operating a vehicle system and product thereof

Abstract

The present disclosure relates to a method for operating a vehicle system associated with a vehicle, comprising: obtaining input data by the vehicle system; determining, by the vehicle system and based on the obtained input data, at least one first output to be provided to one or more individuals present in (inside) the vehicle for the journey using at least one first output function of the vehicle system; controlling, by the vehicle system, the at least one first output function as a function of the determined first output; receiving, by the vehicle system, selection data relating to a selection option selected by the individual; determining, by the vehicle system and based on the received selection data, at least one second output to be provided to at least one of the one or more individuals present in the vehicle using at least one second output function of the vehicle system; the at least one second output function is controlled by the vehicle system as a function of the determined second output.

Description

Technical Field

[0001] The present disclosure relates to a method for operating a vehicle system of a vehicle. Further embodiments relate to a computer program product, a control unit for a vehicle system, and a vehicle. Background Art

[0002] Nowadays, the amount of information available to consider when planning a vehicle's itinerary is increasing. In fact, in many cases, a significant amount of information needs to be considered. For example, a trip interruption may be necessary to charge the vehicle battery, and vehicle systems must accordingly account for this when planning the trip. Other information regarding traffic and weather conditions, as well as the requirements of individuals within the vehicle, is also available and may be part of the boundary conditions considered. For example, vehicle systems typically include various onboard sensors for detecting vehicle status characteristics, one or more wireless communication units for receiving and transmitting data via a communication network (e.g., for vehicle-to-vehicle communication), and one or more user interfaces that allow the driver and other passengers to input data (e.g., for operating a navigation application, among other functions of the vehicle system). However, planning a trip based on this extensive information and taking into account the needs and requirements of one or more individuals within the vehicle can be complex. Consequently, this can place significant cognitive demands on the driver or user.

[0003] Furthermore, information automatically provided to the driver or user based on inaccurately obtained information about passengers' needs, interests, preferences, etc. can lead to driver fatigue and reduce the driver's willingness to accept automatically provided information in the future. In some cases, the driver may even disable the vehicle system from automatically providing information, in which case the vehicle system's (full) ability to assist the driver and other passengers in making decisions will remain unused.

[0004] Therefore, there is a need for improved driver and passenger assistance by vehicle systems. Summary of the Invention

[0005] According to one aspect of the present disclosure, a method for operating a vehicle system associated with a vehicle is provided. The method includes obtaining input data via the vehicle system. The method also includes determining, via the vehicle system and based on the obtained input data, at least one first output to be provided to one or more individuals present in (within) the vehicle for a trip using at least one first output function of the vehicle system, wherein the first output is determined to provide the individuals with at least one set of selection options, each set having one or more selection options, to assist the individuals in making decisions regarding a route for the trip. The method also includes controlling, via the vehicle system, the at least one first output function based on the determined first output. The method also includes receiving, via the vehicle system, selection data associated with a selection option selected by the individual. The method also includes determining, via the vehicle system and based on the received selection data, at least one second output to be provided to at least one of the one or more individuals present in the vehicle using at least one second output function of the vehicle system, wherein the second output is determined to provide the at least one individual with one or more POI (Point of Interest) options for the trip to assist the at least one individual in making decisions regarding a route for the trip. The method also includes controlling, via the vehicle system, the at least one second output function based on the determined second output.

[0006] Thus, a trip may be planned based on the selection of POIs, which in turn are determined based on the selection options taking into account appropriate input data.

[0007] In other words, a multi-stage approach is applied, where the input data is first used to determine selection options, and then the selected selection options are used to determine possible POIs that may be relevant to the itinerary. This allows, in addition to the raw input data, specifications and adaptations to be considered when evaluating possible POIs. This constitutes a fine-grained data processing approach, where possible POIs are determined across multiple processing stages. At each processing stage, an appropriate processing solution tailored to the corresponding data being processed can be used.

[0008] In addition and in particular, the multi-stage approach allows for collaborative interaction between multiple individuals present in the vehicle. For example, as described in more detail below, multiple first outputs can be provided at more than one first output function of the vehicle system. The multiple first outputs can all be different or at least partially different. For example, a single second output can be provided at a second output function of the vehicle system. For example, the second output function can be one of the first output functions, such as the first output function assigned to the vehicle driver. In an exemplary embodiment, each individual has his or her own first output function. In this way, each individual can contribute to the collaborative interaction and driving route planning. In some embodiments, the options can be pre-selected, for example depending on the type of passenger (such as space for children when riding in the vehicle or options suitable for carrying dogs).

[0009] In this way, the cognitive demands on the driver (and optionally other occupants of the vehicle) may be reduced.

[0010] At least some of the individuals can use their own mobile devices as their respective first output functions. In this case, the mobile devices for the purpose of providing the respective output functions are considered to be part of the vehicle system.

[0011] For example, the input data may be automatically collected by the vehicle to obtain the input data.

[0012] Control of at least one first output function may be performed based on the determined first output, such that the determined first output is provided to at least one of the one or more individuals (eg, to a driver and / or one or more passengers) via the at least one first output function.

[0013] Control of at least one second output function may be performed based on the determined second output, such that the determined second output is provided to at least one of the one or more individuals (e.g., to a driver and / or one or more passengers) via the at least one second output function.

[0014] The determined first output may include at least one of a visual output, an acoustic output, an olfactory output, and / or a tactile output. The determined second output may include at least one of a visual output, an acoustic output, an olfactory output, and / or a tactile output.

[0015] Obtaining input data may include obtaining, via a vehicle system, first input data related to information about one or more entities in the vehicle. The entities in the vehicle may be one or more individuals (including a driver and / or one or more passengers). Furthermore, in some examples, obtaining the first input data may include sensing an in-vehicle environment via a sensor system (e.g., a camera device, a microphone device, and / or a proximity sensor), thereby obtaining the first input data.

[0016] Such a sensor system is a preferred source for obtaining information about entities or conditions within or of the vehicle. Preferably, the sensor system is part of the vehicle system or of the vehicle associated with the vehicle system. For example, proximity sensors can be provided within one or more seats of the vehicle in order to obtain information about the number of occupied seats. In this way, the number of entities, in particular passengers, within the vehicle can be easily obtained. In some embodiments, the proximity sensors can be designed in the form of seat occupancy detection sensors, e.g. which work by detecting weight. Alternatively, or in addition, the number of entities can be obtained by camera(s) of the exterior and interior of the vehicle. For example, here digital mirror cameras can be used as sensors.

[0017] Based on the first input data, the first output can be adapted to meet the individual respective aspects. In particular, if some or all of the individuals have their own first output function, the respective first output can be adapted based on the first input data related to the respective individual. Thereby, the first output can be different for some or all of the individuals.

[0018] Alternatively or in addition, obtaining the input data can comprise obtaining, by the vehicle system, second input data related to information about a state of the vehicle, like a state of charge of the vehicle, and / or second input data related to traffic information related to the trip. Further, in some examples, obtaining the second input data can comprise sensing, by a sensor system, like a battery sensor, a part of the vehicle, and / or accessing traffic information from at least one navigation system and / or from at least one remote source, thereby obtaining the second input data.

[0019] The remote source can be external to the vehicle. In this case, the remote source can be accessed via a communication link, like a mobile connection, adapted for bidirectional data transmission provided by the vehicle system.

[0020] Such a sensor system is a preferred source for obtaining information about the vehicle, the traffic and / or the trip. Preferably, the sensor system is part of the vehicle system or of the vehicle associated with the vehicle system. For example, the sensor system can have a camera device observing the environment outside the vehicle. The respective data obtained by the sensor system, like the camera device, can comprise information about road conditions, traffic and / or other road users, and this data can be used as input data.

[0021] Obtaining input data may include obtaining, via the vehicle system and based on historical data, third input data related to information about at least one of the one or more individuals present in the vehicle. Furthermore, in some examples, the historical data is stored in a database and / or relates to previous interests, previous preferences, and / or previous visits associated with the corresponding at least one individual.

[0022] The evaluation history data can provide general information about the individual. Thus, a general adaptation of the first output is possible in order to meet the general requirements of the user in a comfortable manner.

[0023] The database may be part of the vehicle system. The database may also be external to the vehicle. In this case, the database may be accessed via a communication link suitable for bidirectional data transmission provided by the vehicle system, such as a mobile connection.

[0024] Alternatively or additionally, obtaining the input data may include obtaining, via the vehicle system, fourth input data related to contextual information of the planned trip. Furthermore, in some examples, obtaining the fourth input data may include accessing schedule information (particularly including the time, destination, and / or content of one or more schedule entries for at least one of the one or more individuals present in the vehicle), accessing weather information, accessing current location information, accessing destination information, and / or accessing traffic information related to the trip.

[0025] Based on the context information, the first output can be adapted to meet the individual aspects of the individual. In particular, if some or all individuals have their own first output function, the corresponding first output can be adapted based on the context information related to the respective individual. Thus, the first output can be different for some or all individuals.

[0026] Alternatively or additionally, obtaining the input data may include: receiving, via a vehicle system, fifth input data in the form of voice input from at least one of the one or more individuals present in the vehicle, and converting the voice input into a suitable form, thereby generating the fifth input data. Furthermore, in some examples, receiving the fifth input data may include: sensing the in-vehicle environment via a sensor system (e.g., a microphone device), thereby obtaining the voice input.

[0027] Such a sensor system is a preferred source for obtaining voice input. Preferably, the sensor system is a vehicle system or a portion of a vehicle associated with a vehicle system. For example, the sensor system may include a microphone device that records the vehicle's interior environment. The corresponding data obtained by the sensor system (e.g., the microphone device) may include information (e.g., metadata) that links the recorded voice input to the individual from whom the voice input originated.

[0028] The method may further include determining, by the vehicle system and based on the obtained input data, a plurality of first outputs using two or more first output functions of the vehicle system, each first output to be provided to at least two of the one or more individuals present in the vehicle. The plurality of first outputs may be determined, at least in part, to provide different sets of selection options (each set having one or more selection options) to different individuals to assist the individuals in a decision-making process for planning a travel route for a trip. The method may further include controlling, by the vehicle system, the two or more first output functions based on the determined first outputs.

[0029] For example, different first outputs can be adapted based at least in part on input data associated with the respective individuals. In some examples, the third input data for each individual is used to adapt the respective first output to be provided to the respective individual. This facilitates providing the respective first outputs to the individuals. For example, a first first output can be determined based at least in part on the third input data of a first individual to whom a first first output function is assigned (which is controlled based on the determined first output), and a second first output can be determined based at least in part on the third input data of a second individual to whom a second first output function is assigned (which is controlled based on the determined second first output).

[0030] Receiving selected data may include receiving data from a plurality of different devices, in particular receiving data from at least one user device (e.g., one or more tablet devices and / or one or more cellular telephone devices) and / or at least one in-vehicle device (e.g., one or more human-machine interface devices and / or one or more rear-seat display devices).

[0031] In this way, cooperation between two or more (in particular all) individuals is possible in an easy manner. For example, each individual can use a separate device to provide selection data, which are then received by the vehicle system from these devices.

[0032] Each respective device may be connected to a vehicle system and / or control unit, for example via a communication link suitable for bidirectional data transmission.

[0033] The user device may be a device assigned to one of the individuals. In particular, such a user device may be a device owned by the respective individual. This is advantageous because many individuals may already have their own devices.

[0034] The vehicle-mounted device can be installed in a vehicle. For example, the above-mentioned human-machine interface device or rear seat display device can be installed in a vehicle.

[0035] However, whether the device is owned by one of the individuals or the device is installed in a vehicle, in both cases, the corresponding device may be considered to be part of the vehicle system for the purposes of this disclosure.

[0036] The device that serves the individual to provide the selected data may simultaneously provide a first output function.

[0037] Determining at least one second output may include ranking the POI options based on the received selection data and / or based on data related to spatial, temporal, and / or contextual information associated with the trip. By ranking the POI options, one or more POI options for the trip may be obtained. The POI options may be obtained by accessing at least one internal source and / or a remote source (e.g., at least one mapping service) via the vehicle system.

[0038] For example, a plurality of possible POI options may be obtained from a remote source. Then, by sorting the possible POI options, the number of POI options may be limited and / or the order of the POI options along the itinerary may be determined.

[0039] The remote source may be accessed via a communication link suitable for bidirectional data transfer provided by the vehicle system, such as a mobile connection.

[0040] The method may further include receiving, via the vehicle system, option data associated with a POI option selected by the individual. The method may further include determining, via the vehicle system and based on the received option data and / or the provisional travel route for the trip, at least one third output to be provided to one or more individuals in the vehicle using at least one third output function of the vehicle system. The third output is determined to provide a suggested travel route for the trip associated with the selected POI option. The method may further include controlling, via the vehicle system, the at least one third output function based on the determined third output.

[0041] For example, a temporary driving route for a trip may be determined based on a desired starting location (e.g., the vehicle's current location) and a desired destination location (e.g., the location of an event). A suggested driving route for the trip may be determined based on the temporary driving route and the received option data. To this end, the temporary driving route for the trip may be adapted to take into account the POI options selected by the individual as indicated by the option data. Alternatively, the temporary driving route for the trip (which may be the fastest and / or shortest driving route between the desired starting location and the desired destination location) may be adapted so that POIs that were not originally part of the temporary driving route for the trip become part of the suggested driving route for the trip. This may result in the suggested driving route for the trip taking more time and / or being longer than the temporary driving route for the trip.

[0042] Control of at least one third output function may be performed based on the determined third output, such that the determined third output is provided to at least one of the one or more individuals (e.g., to the driver and / or one or more passengers) through the at least one third output function.

[0043] The determined third output may include at least one of a visual output, an acoustic output, an olfactory output, and / or a tactile output.

[0044] The method may further include: receiving feedback from at least one of the individuals present in the vehicle through the vehicle system; and storing the received feedback in a database to be used as first input data in future determination of the at least one first output.

[0045] The individual may provide feedback via some input device of the vehicle system (such as the user device described above).

[0046] Each first output may include: one or more first-type output elements determined based on the first input data and / or the second input data. Alternatively or in addition, each first output may include one or more second-type output elements determined based on the third input data, the fourth input data, and / or the fifth input data.

[0047] The first output element may be a smart filter.

[0048] The search interface can include smart filters for pre-selecting search contexts. These smart filters can take into account different characteristics, such as travel companions (e.g., children, bicycles), mobility restrictions, and more. The system can automatically pre-select these filters based on the companions detected in the car. The primary function of the smart filters can be to refine and prioritize points of interest (POIs) based on the pre-selected characteristics. This ensures that search results are highly relevant to the passenger's needs and preferences. For example, if the car detects a child as a companion, the smart filters will prioritize child-friendly locations. Similarly, if a bicycle is detected, the filters will emphasize places with bike lanes. Other considerations include mobility accessibility and dog-walking zones. Smart filters can significantly enhance the relevance and usefulness of POI suggestions. By automatically considering the passenger's specific needs, the search algorithm can prioritize destinations that meet these criteria. For example: Mobility-Enabled Locations: accessible venues for those with limited mobility; Dog-Walks: locations where dog walking is permitted; Bike Paths: POIs with accessible bike paths. Because the suggestions are tailored to the passenger's specific requirements and preferences, this customized approach ensures a more efficient and satisfying user experience.

[0049] The second output element may be an icon.

[0050] The visual search interface can include proactive icons for selecting search criteria. These criteria can include various categories such as shopping, eating, sightseeing, entertainment, nature, facilities, activities, health, and their associated subcategories (e.g., for shopping: clothing, groceries, gifts, flowers, etc.). Given the potentially extensive list of categories and subcategories, the proactive icons can be designed to simplify the browsing process by displaying and arranging the icons based on their relevance to the user's current situation and needs. The primary function of the proactive icons can be to facilitate efficient and relevant selection of search criteria. These icons can be dynamically displayed and prioritized based on the user's immediate goals and situation. For example, if the user is heading to a birthday party, icons related to shopping and gifts will be highlighted. At lunchtime, restaurant-related icons will be prioritized. Furthermore, if any items are missing from a travel checklist, the relevant category icons can be pre-selected.

[0051] The proactive icons can significantly enhance the relevance and efficiency of POI suggestions by tailoring the search criteria to the user's current situation and needs. This proactive approach ensures that the most relevant categories and subcategories are highlighted, making it easier for the user to find the desired POI. By dynamically adjusting the display and ordering of the icons, the system can ensure that the user can quickly and easily access the most relevant points of interest, making the search experience more efficient and satisfying.

[0052] Both the smart filters and the proactive icons can enhance the proactive Human-Machine Interface (HMI) of the vehicle, but can differ in their approach and impact on POI suggestions. The smart filters can be automatically pre-selected based on detected companions and their needs (e.g., children, bicycles, mobility restrictions), directly customizing the POI suggestions to ensure relevance. In contrast, the proactive icons can dynamically adjust the display and ordering of search categories and subcategories based on the user's immediate situation and goals (e.g., shopping, eating, sightseeing). This can help the user efficiently browse through extensive lists by highlighting the most relevant options. As such, the smart filters can automatically refine POI results based on who is traveling, and the proactive icons can guide the user to select relevant categories based on the current situation and activities.

[0053] For example, the at least one second output function can be the same as one of the at least one first output function. For example, alternatively or in addition, the at least one second output function can be a stationary on-board device.

[0054] For example, the respective second (and first) output function can be part of a navigation device installed in the vehicle. For example, the navigation device is assigned to the driver, who can be one of the individuals.

[0055] For example, the at least one third output function may be the same as one of the at least one first output function. For example, the third output function may be the same as the second output function. For example, alternatively or additionally, the at least one third output function may be a fixed vehicle-mounted device.

[0056] For example, the respective third (and second and first) output functions may be part of a navigation device installed in a vehicle.

[0057] At least one of the at least one first output function may be a mobile device of one of the one or more individuals present in the vehicle.

[0058] For example, a mobile device may be assigned to one of the passengers.

[0059] According to another aspect of the present disclosure, a computer program product is provided, which comprises program code portions that, when executed by a processor of a control unit of a vehicle system associated with a vehicle, cause the control unit to perform the method as provided herein.

[0060] According to another aspect of the present disclosure, a control unit for a vehicle system associated with a vehicle is provided. The control unit includes a processor and a storage device operably coupled to the processor. The storage device stores portions of program code that, when executed by the processor, cause the control unit to perform a method as provided herein.

[0061] According to another aspect of the present disclosure, a vehicle is provided. The vehicle includes a vehicle system, the vehicle system including a control unit as provided herein and one or more output functions operatively coupled to the control unit. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Further details and advantages of the embodiments of the present disclosure will become apparent from the detailed description taken in conjunction with the accompanying drawings, in which:

[0063] Figure 1 is a method for operating a vehicle system of a vehicle according to an embodiment;

[0064] Figure 2 A vehicle having a vehicle system including a control unit according to an embodiment; and

[0065] Figure 3 is a control unit for a vehicle system according to an embodiment. DETAILED DESCRIPTION

[0066] Figure 1A flow chart of a method 100 for operating a vehicle system of a vehicle is shown. In some examples, the method 100 is performed by a control unit of the vehicle system.

[0067] The method 100 includes step 110 of obtaining input data via a vehicle system.

[0068] Method 100 also includes step 120 of determining, by the vehicle system and based on the obtained input data, at least one first output to be provided to one or more individuals present in the vehicle for the trip using at least one first output function of the vehicle system, wherein the first output is determined to provide the individuals with at least one set of selection options, each set having one or more selection options, to assist the individuals in a decision-making process for planning a travel route for the trip.

[0069] The method 100 further includes step 130 of controlling, by the vehicle system, the at least one first output function according to the determined first output.

[0070] The method 100 further includes step 140 of receiving, via the vehicle system, selection data associated with a selection option selected by the individual.

[0071] Method 100 also includes step 150: determining, by the vehicle system and based on the received selection data, at least one second output to be provided to at least one of the one or more individuals present in the vehicle using at least one second output function of the vehicle system, wherein the second output is determined to provide the at least one individual with one or more POI options for the trip to assist the individual in the decision-making process of planning a travel route for the trip.

[0072] The method 100 further includes step 160 of controlling, by the vehicle system, the at least one second output function according to the determined second output.

[0073] Figure 2 A vehicle 200 is shown schematically and exemplarily. The vehicle 200 includes a vehicle system 210. The vehicle system 210 includes a control unit 220, which includes a processor 222 and a data storage device 224 operatively connected to the processor 222. The vehicle system 210 also includes sensor systems 240, 242, 244, 246. Figure 1Vehicle system 210 is exemplarily shown as including: a position sensor 240, such as a GPS module, for determining the location of vehicle 200; a front-facing camera 242 for detecting objects in the environment in front of vehicle 200; and an interior camera 244 for monitoring the vehicle interior and individuals within vehicle 200, such as driver D and three passengers P. Vehicle system 210 also includes at least one first output function, here a first output function 230 assigned to driver D, a first output function 232 assigned to first passenger P (e.g., a mobile phone device), a first output function 234 assigned to second passenger P (e.g., a tablet device), and a first output function 236 assigned to third passenger P (e.g., a rear-seat device). First output functions 230, 232, 234, and 236 are configured to provide perceptible outputs, such as visual outputs, to driver D and passenger P. The second and third output functions are identical to first output function 230.

[0074] In the example shown, the vehicle system 210 further includes a communication unit 250 adapted to receive and transmit communication signals, such as radio signals, via a communication network to which the vehicle system 210 is wirelessly connected. Each of the output functions 230, 232, 234, 236, the sensors 240, 242, 244, 246, and the communication unit 250 is operable to be operatively connected to the control unit 220.

[0075] Control unit 220 may be configured to obtain input data. Based on the obtained input data, control unit 220 may be configured to determine, using at least one first output function 230, 232, 234, 236 of vehicle system 210, at least one first output to be provided to one or more individuals D, P present in vehicle 200 for the trip. While four first output functions 230, 232, 234, 236 are present in this scenario, fewer or more first output functions may be present in other scenarios. Furthermore, each first output is determined to provide individuals D, P with at least one set of selection options to assist them in the decision-making process of planning a travel route for the trip. Each set includes one or more selection options. Control unit 220 may be configured to control at least one first output function 230, 232, 234, 236 based on the determined first output.

[0076] To determine the first output, control unit 220 can use any type of input data available to vehicle system 210. In one example, vehicle system 210 automatically obtains the input data. In this case, no action is required by either individual D or P. For example, the input data may indicate at least one piece of environmental information (e.g., weather information and / or time information), at least one piece of vehicle information (e.g., companion information and / or item information), and / or at least one piece of navigation information (e.g., location information, route information, and / or traffic information). For example, sensors 240, 242, 244, and / or 246 may be operable to detect, in real time, one or more input data that may indicate one or more of the aforementioned information.

[0077] In some examples, control unit 220 can be configured to determine at least one first output using a trained machine learning model, and data available to vehicle system 210 (e.g., obtained input data) can be provided as input to the trained machine learning model. In some examples, the trained machine learning model is stored via storage device 224. In other examples, the trained machine learning model is at least partially stored at a network node external to vehicle 200, and control unit 220 is communicatively connected to the network node via communication unit 250.

[0078] In an example, position sensor 240 is operable to detect the current location of vehicle 200. Combined with cartographic information, such as that stored in storage device 224 and associated with a navigation application of vehicle system 210, the detected location of vehicle 200 indicates one or more possible road tracks ahead of vehicle 200. Furthermore, the cartographic information may include location-specific data, such as terrain objects, local weather information, and the like. In some examples, such location-specific data may be operable to be updated based on information received via communication unit 250.

[0079] Additionally, in some examples, image data acquired by the front-facing camera 242 may be operable to determine one or more of weather conditions, light conditions, view conditions, time of day, season, etc. Each of these types of information may be used by the control unit 224 as input data to determine the first output.

[0080] According to some of the preceding examples, in some examples the input data comprises at least one of real-time sensor data that has been obtained by a sensor system of the vehicle system 210, such as the sensors 240, 242, 244, 246. Additionally or alternatively, in some examples the input data comprises communication data that has been received by the communication unit 250. Additionally or alternatively, in some examples the control unit 220 uses historical data to determine the input data, such as stored sensor data and / or stored trajectories of previous travels of the vehicle 200 by the driver D, wherein such data has been stored, e.g., by the storage device 224.

[0081] The determined first output is operable to be provided to the driver D and the passenger P via one or more first output functions 230, 232, 234, 236. This can be achieved, for example, by the control unit 220 generating corresponding control signals and outputting the control signals to the respective first output functions 230, 232, 234, 236. In some examples, at least two of the first outputs are different, as described in more detail below. In some examples, each of the first outputs is provided via a different first output function. In this way, it is easy to provide individual first outputs to each individual D, P. This makes it particularly easy to perform the collaborative decision process.

[0082] In some examples, the first output comprises any of a visual output, an acoustic output, an olfactory output, and / or a haptic output. In some examples, the visual output is provided via a display unit of the one or more first output functions 230, 232, 234, 236 of the vehicle system 210. Further, in some examples, the acoustic output is provided via one or more loudspeakers of the one or more first output functions 230, 232, 234, 236 of the vehicle system 210. In some examples, the olfactory output is provided via one or more scent dispensers of the one or more first output functions 230, 232, 234, 236 of the vehicle system 210. Further, in some examples, the haptic output is provided by force feedback functions comprised by a steering device, one or more pedals, and / or a vibration device in a seat of the vehicle system 210.

[0083] Control unit 220 may be configured to receive selection data related to a selection option selected by an individual. Based on the received selection data, control unit 220 may be configured to determine, using at least one second output function 230 of vehicle system 210, at least one second output to be provided to at least one of the one or more individuals D, P present in vehicle 200. Furthermore, a second output may be determined to provide at least one individual D, P with one or more POI options for a trip to assist the individual D, P in the decision-making process of planning a travel route for the trip. POIs represent points of interest, such as a lunch location during the trip. Control unit 220 may be configured to control at least one second output function 230 based on the determined second output.

[0084] Although in this scenario the output function 230 is both the first output function and the second output function (ie, the output function 230 assigned to driver D), in other examples it is possible that a different output function serves only as the second output function.

[0085] The determined second output is operable to be provided to the driver D and / or passenger P via one or more second output functions 230 . For example, this may be achieved by the control unit 220 generating corresponding control signals and outputting the control signals to the corresponding second output functions 230 .

[0086] In some examples, the second output includes any of a visual output, an acoustic output, an olfactory output, and / or a tactile output. In some examples, a visual output is provided via a display unit in one or more second output functions 230, 232, 234, 236 of the vehicle system 210. In addition, in some examples, an acoustic output is provided via one or more speakers in one or more second output functions 230, 232, 234, 236 of the vehicle system 210. In some examples, an olfactory output is provided via one or more fragrance dispensers in one or more second output functions 230, 232, 234, 236 of the vehicle system 210. In addition, in some examples, a tactile output is provided by a force feedback function included in a steering device, one or more pedals, and / or a vibration device in a seat of the vehicle system 210.

[0087] In some examples, control unit 220 can be configured to determine at least one second output using a trained machine learning model, to which data available to vehicle system 210 (e.g., received selection data) can be input. In some examples, the trained machine learning model is stored via storage device 224. In other examples, the trained machine learning model is at least partially stored at a network node external to vehicle 200, to which control unit 220 is communicatively connected via communication unit 250.

[0088] In some examples, for obtaining input data, the control unit 220 may be configured to obtain first input data related to information about one or more entities (e.g., one or more individuals D, P) present in the vehicle 200. Although in this scenario, the four entities are four individuals (driver D and three passengers P), other scenarios may exist in which more or fewer individuals are present in the vehicle 200.

[0089] Furthermore, in order to obtain the first input data, the control unit 220 can be configured to sense the vehicle interior environment. Thus, the first input data can be obtained. The vehicle environment can be the interior of the vehicle 200. This sensing can be performed using sensor systems 240, 242, 244, and / or 246. Exemplary sensor systems include camera devices 242, 244, microphone device 246, and / or proximity sensors. The proximity sensor can be part of a seat in the vehicle 200, thereby enabling detection of whether the seat is occupied by an individual.

[0090] In some examples, to obtain input data, control unit 220 may be configured to obtain second input data related to status information of vehicle 200 and / or second input data related to traffic information related to the trip. One example of such status information is the charge status of vehicle 200. Furthermore, to obtain the second input data, control unit 220 may be configured to sense a portion of the vehicle and / or access traffic information from at least one navigation system and / or from at least one remote source. In this manner, the second input data may be obtained. Sensing may be performed via sensor systems 240, 242, 244, and / or 246. Another example of a sensor system may be a battery sensor that provides the charge status of the battery of vehicle 200.

[0091] In some examples, for obtaining the input data, the control unit 220 may be configured to obtain, based on historical data, third input data related to information about at least one of the one or more individuals D, P present in the vehicle 200. In some examples, the historical data may be stored in a database and / or related to previous interests, previous preferences, and / or previous visits associated with the corresponding at least one individual D, P.

[0092] In some examples, to obtain input data, control unit 220 may be configured to obtain fourth input data related to contextual information of the planned trip. In some examples, to obtain the fourth input data, control unit 220 may be configured to access schedule information in one or more schedule entries of at least one of the one or more individuals D and P in vehicle 200, access weather information, access current location information, access destination information, and / or access traffic information related to the trip. The schedule information may include the time, destination, and / or content in one or more schedule entries of at least one of the one or more individuals D and P in vehicle 200.

[0093] In some examples, to obtain input data, control unit 220 may be configured to receive fifth input data in the form of voice input from at least one of the one or more individuals D and P present in vehicle 200. The received voice input may be translated into a suitable format to generate the fifth input data. In some examples, to receive the fifth input data, control unit 220 may be configured to sense an in-vehicle environment to obtain the voice input. The in-vehicle environment may be the interior of vehicle 200. Sensing may be performed by a sensor system (e.g., a sensor system in the form of microphone device 246).

[0094] In some examples, the control unit 220 may be further configured to determine, based on the obtained input data, a plurality of first outputs using two or more first output functions 230, 232, 234, 236 of the vehicle system 210, each of which is to be provided to at least two of the one or more individuals D and P present in the vehicle 200. Furthermore, the plurality of first outputs may be determined, at least in part, to provide different sets of selection options to different individuals D and P, each set having one or more selection options, to assist the individuals D and P in the decision-making process of planning a travel route for a trip. The control unit 220 may then be further configured to control the two or more first output functions 230, 232, 234, 236 according to the determined first outputs.

[0095] For example, a first output determined to provide a first set of selection options to the driver ID, a second output determined to provide a second set of selection options to the first passenger P, a third output determined to provide a third set of selection options to the second passenger P, and a fourth output determined to provide a fourth set of selection options to the third passenger P may all be different. This may occur because the determination of the first output results in different outputs due to the input data.

[0096] In some examples, at least two of the determined first outputs are different. In some examples, each of the first outputs is provided via a different first output function. This makes it easy to provide a separate first output to each individual D, P. This makes it particularly easy to perform collaborative decision-making.

[0097] In some examples, for receiving selection data, the control unit 220 may be configured to receive data from a plurality of different devices (e.g., devices 230, 232, 234, 236 that simultaneously function as inputs). These different devices may be two user devices 232, 234 (in the form of a cell phone device 232 assigned to one passenger P and a tablet device 234 assigned to one passenger P) and two in-vehicle devices 230, 236 (in the form of a human-machine interface device 230 assigned to the driver D and a rear-seat display device 236 assigned to one passenger P).

[0098] In some examples, to determine at least one second output, control unit 220 may be configured to sort the POI options based on the received selection data and / or data related to spatial, temporal, and / or contextual information associated with the trip. In this way, one or more POI options for the trip may be obtained. Furthermore, to obtain the POI options, control unit 220 may be configured to access at least one internal source and / or remote source, such as at least one mapping service.

[0099] In some examples, control unit 220 may also be configured to receive option data associated with a POI option selected by an individual. Control unit 220 may then be further configured to determine, based on the received option data and / or the provisional driving route based on the trip, at least one third output function 230 of vehicle system 200 to be provided to one or more individuals D and P present in vehicle 200. The third output is determined to provide a suggested driving route for the trip associated with the selected POI option. Control unit 220 may then be further configured to control at least one third output function 230 based on the determined third output.

[0100] Although in this scenario there is one third output function 230 , in other scenarios there may be more than one third output function.

[0101] Although in this scenario the output function 230 is simultaneously the first, second, and third output function (ie, the output function 230 assigned to driver D), in other examples, it is possible that a different output function serves only as the third output function.

[0102] If the third output function is assigned to the driver D, the third output can be easily used to assist the vehicle 200 in navigation.

[0103] In some examples, control unit 220 may also be configured to receive feedback from at least one of individuals D and P present in vehicle 200. Control unit 220 may then be further configured to store the received feedback in a database for use as first input data in future determination of the at least one first output. The database may be stored in storage device 224 and / or in a memory external to vehicle system 210.

[0104] For example, an individual may input feedback via devices 230, 232, 234, 236, which not only provide output functionality but are also used to input such feedback.

[0105] According to some of the aforementioned examples, each first output includes one or more first-type output elements determined based on the first input data and / or the second input data, and / or one or more second-type output elements determined based on the third input data, the fourth input data, and / or the fifth input data. For example, the first-type output element can be a smart filter. For example, the second-type output element can be an icon.

[0106] According to some of the aforementioned examples, the at least one second output function 230 is the same as one of the at least one first output function 230 , and / or the at least one second output function 230 is a fixed vehicle-mounted device.

[0107] According to some of the aforementioned examples, at least one third output function 230 is identical to one of the at least one first output function 230 (particularly the second output function 230 ), and / or at least one third output function 230 is a fixed vehicle-mounted device.

[0108] According to some of the aforementioned examples, at least one of the at least one first output function 232 , 234 is a mobile device of one of the one or more individuals P present in the vehicle.

[0109] Figure 3 Schematically and exemplarily, a control unit 300 of a vehicle system for a vehicle is shown. The control unit 300 comprises a processor 310 operatively connected to a storage device 320. The control unit 300 may be configured to receive and / or output data signals via one or more interfaces 312, 314, such as Figure 3 Schematically shown in FIG.

[0110] The storage device 320 stores program codes that can be executed by the processor 310. The control unit 300 can be controlled by an onboard control unit (such as Figure 2 In other examples, the control unit 300 may be implemented at least partially at one or more network nodes in network communication with the onboard vehicle system to receive data from the vehicle system and / or output and transmit generated data to the vehicle system via the communication network.

[0111] The storage device 320 stores a portion of the program code that, when executed by the processor 310, configures the control unit 300 to execute the above-described combined Figure 1 and 2 Describe the operation of any example.

[0112] The storage device 320 stores program codes, and through interaction with the processor 310 , the program codes constitute an input data acquisition module 322 for obtaining input data.

[0113] The storage device 320 also stores program code constituting a first output determination module 324 for determining, based on the obtained input data, at least one first output to be provided to one or more individuals present in the vehicle for the trip using at least one first output function of the vehicle system, wherein the first output is determined to provide the individuals with at least one set of selection options, each set having one or more selection options, to assist the individuals in a decision-making process for planning a travel route for the trip.

[0114] The storage device 320 further stores program codes constituting a first output function control module 326 , which is configured to control the at least one first output function according to the determined first output.

[0115] The storage device 320 also stores program code that constitutes a selection data receiving module 328 for receiving selection data associated with a selection option selected by an individual.

[0116] The storage device 320 also stores program code constituting a second output determination module 330 for determining, based on the received selection data, at least one second output to be provided to at least one of the one or more individuals present in the vehicle using at least one second output function of the vehicle system, wherein the second output is determined to provide the at least one individual with one or more POI options for the trip to assist the individual in the decision-making process of planning a driving route for the trip.

[0117] The storage device 320 further stores program codes constituting a second output function control module 332 , which is configured to control the at least one second output function according to the determined second output.

Claims

1. A method for operating a vehicle system associated with a vehicle, characterized in that The method comprises: - obtaining input data via said vehicle system; - determining, by the vehicle system and based on the obtained input data, using at least one first output function of the vehicle system, at least one first output to be provided to one or more individuals present in the vehicle for a trip, wherein the first output is determined to provide the individuals with at least one set of selection options, each set having one or more selection options, to assist the individuals in a decision-making process for planning a travel route for the trip; - controlling, by the vehicle system, the at least one first output function in dependence on the determined first output; - receiving, by the vehicle system, selection data relating to a selection option selected by the individual; - determining, by the vehicle system and based on the received selection data, using at least one second output function of the vehicle system, at least one second output to be provided to at least one individual of the one or more individuals present in the vehicle, wherein the second output is determined to provide the at least one individual with one or more POI options for the trip to assist the individual in a decision-making process for planning a travel route for the trip; - controlling, by the vehicle system, the at least one second output function in dependence on the determined second output.

2. The method according to claim 1, characterized in that Obtaining input data includes: - obtaining, by the vehicle system, first input data relating to information about one or more entities present in the vehicle, Wherein, obtaining the first input data includes: sensing the in-vehicle environment through a sensor system, thereby obtaining the first input data; and / or - obtaining, by the vehicle system, second input data relating to information about status information of the vehicle and / or second input data relating to traffic information related to the trip, Wherein, obtaining the second input data comprises: sensing a portion in the vehicle by the sensor system, and / or accessing traffic information from at least one navigation system and / or from at least one remote source, thereby obtaining the second input data.

3. The method according to claim 1 or 2, characterized in that Obtaining input data includes: - obtaining, by the vehicle system and based on historical data, third input data relating to information about at least one of the one or more individuals present in the vehicle, wherein the historical data is stored in a database and / or the historical data is related to previous interests, previous preferences and / or previous visits associated with the corresponding at least one individual; - obtaining, by the vehicle system, fourth input data relating to contextual information of the planned journey, wherein obtaining the fourth input data comprises: accessing schedule information, accessing weather information, accessing current location information, accessing destination information, and / or accessing traffic information related to the trip, wherein the schedule information respectively comprises time, destination, and / or content in one or more schedule entries of at least one of the one or more individuals present in the vehicle; and / or - receiving, by the vehicle system, fifth input data in the form of voice input from at least one of the one or more individuals present in the vehicle and converting the voice input into a suitable form, thereby generating the fifth input data, Receiving the fifth input data includes: sensing the in-vehicle environment through a sensor system to obtain the voice input.

4. The method according to any one of claims 1 to 3, characterized in that The method comprises: - determining, by the vehicle system and based on the obtained input data, a plurality of first outputs using two or more first output functions of the vehicle system, each first output to be provided to at least two of the one or more individuals present in the vehicle, wherein the plurality of first outputs are determined, at least in part, to provide different sets of selection options to different individuals, each set having one or more selection options, to assist the individuals in a decision-making process for planning a travel route for the trip; - controlling, by the vehicle system, the two or more first output functions in dependence on the determined first output.

5. The method according to any one of claims 1 to 4, characterized in that Receiving selection data includes: receiving data from multiple different devices, including at least one user device, and / or at least one vehicle-mounted device, wherein the at least one vehicle-mounted device includes one or more human-machine interface devices and / or one or more rear-seat display devices.

6. The method according to any one of claims 1 to 5, characterized in that Determining the at least one second output comprises: sorting the POI options based on the received selection data and / or based on data related to spatial, temporal and / or contextual information associated with the trip, respectively, to obtain the one or more POI options for the trip, The POI options are obtained by accessing at least one internal source and / or a remote source via the vehicle system.

7. The method according to any one of claims 1 to 6, characterized in that The method comprises: - receiving, by the vehicle system, option data relating to a POI option selected by the individual; - determining, by the vehicle system and based on the received option data and / or the temporary travel route based on the trip, at least one third output to be provided to one or more individuals present in the vehicle using at least one third output function of the vehicle system, wherein the third output is determined to provide a suggested driving route for a trip associated with the selected POI option; - controlling, by the vehicle system, the at least one third output function as a function of the determined third output.

8. The method according to any one of claims 1 to 7, characterized in that The method comprises: - receiving feedback from at least one of the individuals present in the vehicle via the vehicle system; - storing the received feedback in a database to be used as first input data in future determination of the at least one first output.

9. The method according to any one of claims 1 to 8, characterized in that Each first output includes: one or more first type output elements determined based on the first input data and / or the second input data, and / or one or more second type output elements determined based on the third input data, the fourth input data and / or the fifth input data.

10. The method according to any one of claims 1 to 9, characterized in that The at least one second output function is the same as one of the at least one first output function, and / or the at least one second output function is a fixed vehicle-mounted device.

11. The method according to any one of claims 1 to 10, characterized in that The at least one third output function is the same as one of the at least one first output function, and / or the at least one third output function is a fixed vehicle-mounted device.

12. The method according to any one of claims 1 to 11, characterized in that At least one of the at least one first output function is a mobile device of one of the one or more individuals present in the vehicle.

13. A computer program product, characterized in that The computer program product comprises portions of program code which, when executed by a processor of a control unit of a vehicle system associated with a vehicle, cause the control unit to perform a method according to any one of claims 1 to 12.

14. A control unit for a vehicle system, characterized in that: The control unit comprises a processor and a storage device operatively coupled to the processor, wherein the storage device stores portions of program code which, when executed by the processor, cause the control unit to perform the method according to any one of claims 1 to 12.

15. A vehicle, characterized in that: The vehicle includes a vehicle system, the vehicle system including: - a control unit according to claim 14, - one or more output functions operatively coupled to the control unit.

Images