Method, device and program carrier for personalized output of vehicle interaction functions

Abstract

The present invention relates to the field of in-vehicle entertainment interaction. Specifically, the present invention relates to a method for personalized output of in-vehicle entertainment interaction functions, the method comprising the steps of: detecting at least one marked condition potentially affecting the driving safety of a vehicle; determining the relevance of the at least one marked condition to driving safety; determining an output mode of the in-vehicle entertainment interaction functions based on the relevance; and outputting the corresponding in-vehicle entertainment interaction functions in the determined output mode. The present invention also relates to a device for personalized output of in-vehicle entertainment interaction functions, a corresponding vehicle and a corresponding machine-readable program carrier. The present invention aims to adaptively adjust the output mode of in-vehicle entertainment interaction functions, thereby enabling the vehicle occupants to fully enjoy the fun brought by the entertainment functions while ensuring safety.

Description

Technical Field

[0001] The present invention relates to a method for personalized output of entertainment interaction functions of a vehicle, a corresponding device, a vehicle and a machine-readable program carrier. Background Art

[0002] Current vehicles are integrated with more and more functions, especially capable of meeting various entertainment needs of passengers during vehicle use. However, the traffic conditions change rapidly, and often being overly immersed in in-vehicle entertainment functions while driving a vehicle can lead to distraction of the driver's attention and easily cause accidents.

[0003] Therefore, there is an expectation to propose a vehicle entertainment interaction system that can enable vehicle occupants to fully enjoy the fun brought by entertainment functions while ensuring safety. Summary of the Invention

[0004] The object of the present invention is to provide a method for personalized output of entertainment interaction functions of a vehicle, a device for personalized output of entertainment interaction functions of a vehicle, a vehicle and a machine-readable program carrier, so as to solve at least some problems in the prior art.

[0005] According to a first aspect of the present invention, there is provided a method for personalized output of entertainment interaction functions of a vehicle, the method comprising the following steps:

[0006] Detect at least one marked condition that potentially affects the driving safety of the vehicle;

[0007] Determine the relevance of the at least one marked condition to driving safety;

[0008] Based on the relevance, determine an output mode of the entertainment interaction function of the vehicle; and

[0009] Output the corresponding entertainment interaction function in the determined output mode.

[0010] The present invention particularly includes the following technical concept: Under the condition of fully considering various factors in the vehicle use environment and their relevance to driving safety, a personalized entertainment interaction solution is formulated for users. Here, not only can vehicle users enjoy diversified entertainment interaction services, but also driving safety is taken into account while providing these services, so as to find the best balance between riding comfort and driving safety and greatly optimize the user experience.

[0011] Optionally, the step of determining the relevance of the at least one marked condition to driving safety includes: comparing the relevance with a reference threshold, wherein when it is obtained that the relevance is greater than or equal to the reference threshold, a weakened output mode of the entertainment interaction function is determined.

[0012] Here, by comparing with a reference threshold, the causal relationship or degree of correlation between the detected marker condition and the occurrence of a dangerous situation is advantageously quantified. Marker conditions with a correlation less than the reference threshold particularly indicate factors that are not directly linked to road safety or driving safety, such as occupants whose identity does not belong to the driver, good weather conditions, smooth traffic conditions, simple road structures or terrain conditions. On the contrary, marker conditions with a correlation greater than or equal to the reference threshold particularly indicate factors that are directly linked to road safety or driving safety, such as occupants whose identity belongs to the driver, bad weather conditions, congested traffic conditions, complex road structures or terrain conditions. By differentiating marker conditions that affect driving safety to different degrees, the output mode of the entertainment interaction function can be determined more specifically.

[0013] Optionally, compared with the complete output mode of the entertainment interaction function, the weakened output mode is manifested as: a decrease in the output intensity of the entertainment interaction function, a reduction in the number of combinations of the entertainment interaction function, a decrease in the output frequency of the entertainment interaction function, a reduction in the output duration of the entertainment interaction function, a change in the output position of the entertainment interaction function, and / or a conversion in the output type of the entertainment interaction function.

[0014] In the sense of the present invention, the "weakened" output mode can also be referred to as the "mild" output mode, which should not only be interpreted in terms of the magnitude of the intensity, but rather should be understood as an output mode that is perceptually simplified and filtered by safety standards compared with the complete output mode of the entertainment interaction function. Here, by defining this weakened output mode, the distraction and interference of the driver can be minimized during vehicle driving, and an entertainment interaction experience can still be obtained to a certain extent.

[0015] Optionally, the entertainment interaction function includes the multimedia function, comfort function and / or combined function of the multimedia function and comfort function of the vehicle, and in the combined function, the multimedia function and the comfort function are output in a coupled manner.

[0016] Optionally, the output of the comfort function is controlled according to at least one characteristic of the multimedia function.

[0017] Optionally, the combined function includes a vehicle atmosphere display function. In the complete output mode of the vehicle atmosphere display function, the air outlet characteristics of the air conditioner, the seat vibration characteristics, the ambient light color characteristics, the ambient light flashing characteristics, and / or the fragrance release characteristics are controlled to change with the type, style, rhythm, and / or intensity of the vehicle's multimedia audio, especially music. In the weakened output mode of the vehicle atmosphere display function, only the air outlet characteristics of the air conditioner and the ambient light color characteristics are controlled to change with the type, style, rhythm, and / or intensity of the vehicle's multimedia audio, especially music, and / or only the multimedia audio, especially music, is output.

[0018] Here, by making multiple comfort functions respond dynamically to the characteristics of multimedia audio (such as music, movie soundtracks) in the complete output mode, a multi-sensory experience can be presented to the user even in the narrow interior space of the vehicle, achieving a better entertainment effect. By only retaining the combination of some comfort functions and multimedia functions in the weakened output mode and omitting the interaction effects that may pose potential hazards to driving safety, safety is ensured.

[0019] Optionally, the color of the ambient light is controlled to display the album color of the multimedia audio, especially music.

[0020] Optionally, the combined function includes a message prompt function. The method further includes: detecting at least one signal associated with a message. Preferably, the signal associated with the message includes the importance level of the message and / or the message push object; and determining the output mode of the message prompt function based on the signal associated with the message and the relevance of the at least one marking condition to driving safety.

[0021] Here, by way of example, a payment confirmation message is especially more worthy of attracting the attention of vehicle occupants than news or weather push content. For another example, the nature of the message (private or general) and the identity of the audience for the entertainment interaction function (driver / other occupants) can be indirectly judged by determining the message push object. Exemplarily, private messages especially refer to information specific to the identity of the push object (such as payment confirmation messages, bill amount confirmation messages, personal chat content information, etc.), while general messages especially refer to information not specific to the identity of the push object (such as multimedia messages, navigation prompt messages, voice feedback messages for in-vehicle entertainment interaction functions, etc.).

[0022] Optionally, when outputting the message prompt visually, the color of the ambient light is controlled so that the color of the application from which the message originates can be displayed; and / or when the message is a prompt for the charging status of an electronic device, the charging area of the electronic device is visually highlighted. Optionally, the charging status of the electronic device is indicated by the color of the ambient light.

[0023] Here, the category of the message to be conveyed (e.g., from which application) can be presented to the vehicle user in a more intuitive manner. Here, the potential perception of the user for the application color is skillfully utilized, and as much information as possible can be conveyed in a more concise manner. On the other hand, the charging position and status of the electronic device can be transmitted to the vehicle occupants in a simpler manner without distracting too much attention.

[0024] Optionally, at least one marking condition includes a signal associated with the vehicle itself, a signal associated with the vehicle's surrounding environment, and / or a signal associated with the vehicle's occupants.

[0025] Here, factors affecting the determination of the output mode of the entertainment interaction function are considered in a favorable manner from three typical aspects of the driving environment. Therefore, it is possible to support the provision of the entertainment interaction function in a scenario-specific manner, which positively affects the acceptance of different entertainment interaction functions by vehicle occupants.

[0026] Optionally, the signal associated with the vehicle itself includes the driving state of the vehicle and / or the environmental state inside the vehicle; and / or, the signal associated with the vehicle's surrounding environment includes the position of the vehicle, the traffic state in the vehicle's surrounding environment, the weather state in the vehicle's surrounding environment, and / or the road surface state in the vehicle's surrounding environment; and / or, the signal associated with the vehicle's occupants includes the distribution of occupant positions in the vehicle, the number of occupants, and / or the occupant state.

[0027] Here, by way of example, if the vehicle is in the process of high-speed driving or in a complex road condition, this should correspond to a more gentle output mode of the entertainment interaction function. On the contrary, if the vehicle is in a parked state or in a relatively simple driving environment (e.g., a one-way road with less traffic), it corresponds to a more obvious or richer output mode of the entertainment interaction function. Thus, the determination of the output mode of the entertainment interaction function is further refined.

[0028] Optionally, the steps for determining the output mode of the entertainment interaction function of the vehicle include: determining a weakened output mode of the entertainment interaction function in a driving state compared to a situation where the driving state is stopped; and / or, determining a weakened output mode of the entertainment interaction function in a complex traffic state in the vehicle's surrounding environment compared to a situation where the traffic state is simple; and / or, determining a weakened output mode of the entertainment interaction function when the number of occupants is one compared to a situation where the number of occupants is more than one.

[0029] Optionally, the steps for determining the output mode of the entertainment interaction function of the vehicle include: determining different output modes of the entertainment interaction function for occupants in different positions in the vehicle, wherein, compared to occupants in non-driver positions, a weakened output mode is determined for occupants in the driver position.

[0030] Optionally, as the distance from the driver's position decreases, the output mode is determined with gradually decreasing intensity.

[0031] Here, it is possible to more specifically provide suitable interaction functions for occupants with different identities. For example, compared to the driver, the entertainment interaction function can be provided to the rear-row occupants with a louder volume or stronger visual effects.

[0032] Optionally, the method includes: detecting a change in at least one marker condition; and adjusting the output mode of the entertainment interaction function of the vehicle such that the output mode of the entertainment interaction function dynamically matches the change in the at least one marker condition.

[0033] Here, the free switching of the entertainment interaction function between different output modes is achieved, enabling the entertainment interaction function to dynamically adapt to the current vehicle usage scenario.

[0034] Optionally, the step of determining the relevance of at least one marker condition to driving safety includes: assigning priorities and / or confidence scores to different marker conditions, and determining the relevance of the at least one marker condition to driving safety overall based at least on the priorities and / or the accumulated confidence scores.

[0035] Here, the priorities can particularly reflect the weights or importance among the various marker conditions. By assigning priorities, it is possible to consider different marker conditions in the order of priorities in more complex usage scenarios. Exemplarily, when it is detected that the message push object is the driver and the driver is in a driving operation on a simple road condition, but at the same time it is also detected that the driver is in a relatively fatigued state, in this case, the latter marker condition regarding the driver's state has a higher priority. Therefore, even when driving on a road with a relatively low accident risk, the corresponding output mode of the entertainment interaction function should be determined preferentially according to the driver's state, further improving safety. On the other hand, the confidence score is understood as the weight value occupied by each marker condition when determining the relevance to driving safety. Since usually the marker conditions do not occur singly but in a combined form, by calculating the accumulated confidence scores, it is possible to comprehensively judge overall the degree of impact on driving safety when multiple marker conditions act together.

[0036] Optionally, the method further includes: when it is determined that the relevance is less than a reference threshold, further determining whether the vehicle is parked in a parking area, and enabling a meditation function when it is determined that the vehicle has been parked in the parking area.

[0037] Here, first, by determining that the correlation is less than a reference threshold value, a scenario with a relatively high safety level is obtained, and thus a corresponding significant or complete output pattern is obtained. Then, by determining that the vehicle has been parked in a parking area, the deployment of an entertainment interaction function corresponding to a special scenario can be executed.

[0038] According to a second aspect of the present invention, there is provided a device for personalized output of an entertainment interaction function of a vehicle, the device being configured to execute the method according to the first aspect of the present invention, the device comprising:

[0039] A detection module configured to be able to detect at least one marked condition that potentially affects the driving safety of the vehicle;

[0040] A control module configured to be able to determine the correlation between at least one marked condition and driving safety, and determine an output pattern of the entertainment interaction function of the vehicle based on the correlation; and

[0041] An output module configured to be able to output a corresponding entertainment interaction function in the determined output pattern.

[0042] According to a third aspect of the present invention, there is provided a vehicle having the device according to the second aspect of the present invention.

[0043] According to a fourth aspect of the present invention, there is provided a machine-readable program carrier on which a computer program is stored, the computer program being configured to execute the method according to the first aspect of the present invention when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Hereinafter, the present invention will be described in more detail by referring to the accompanying drawings, and the principles, features and advantages of the present invention can be better understood. The accompanying drawings include:

[0045] Figure 1 A flowchart illustrates an exemplary embodiment of a method for personalized output of an entertainment interaction function of a vehicle according to the present invention;

[0046] Figure 2 A flowchart illustrates an exemplary embodiment of using the method for personalized output of an entertainment interaction function of a vehicle according to the present invention in a specific application scenario;

[0047] Figure 3 A flowchart illustrates another exemplary embodiment of using the method for personalized output of an entertainment interaction function of a vehicle according to the present invention in a specific application scenario;

[0048] Figure 4 A flowchart illustrates another exemplary embodiment of using the method for personalized output of an entertainment interaction function of a vehicle according to the present invention in a specific application scenario;

[0049] Figure 5 Figure 5 schematically shows an exemplary embodiment of a device for personalized output of the entertainment interaction function of a vehicle; and

[0050] Figure 6 Figure 6 schematically shows an exemplary embodiment of a detection module and a control module of a device for personalized output of the entertainment interaction function of a vehicle according to the present invention. Detailed implementation manner

[0051] In order to make the technical problems to be solved, technical solutions and beneficial technical effects of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and multiple exemplary embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the protection scope of the present invention.

[0052] Figure 1 Figure 1 shows an exemplary embodiment of a method for personalized output of the entertainment interaction function of a vehicle according to the present invention in a flowchart.

[0053] Here, the entertainment interaction function is understood as any function that interacts with the user or provides entertainment services to the user in a vehicle usage environment, which may in particular be a comfort function, a multimedia function and / or a combined function thereof.

[0054] The comfort function is provided, for example, by each actuator of the comfort function module of the vehicle, which includes, for example, an air conditioning function, a lighting function, an ambient light function, an aromatherapy function, a humidification function, a seat belt tensioning function, a seat vibration function, a seat heating function and / or a seat angle adjustment function.

[0055] The multimedia function is provided, for example, by the multimedia function module of the vehicle, especially the in-vehicle infotainment system (In-Vehicle Infotainment, abbreviated as IVI), which includes, for example, a wireless communication function, a music service function, a game function, a video service function, a navigation function and / or other multimedia information service functions.

[0056] The combined function of the comfort function and the multimedia function represents a function jointly provided by the comfort function module and the multimedia function module of the vehicle. In this combined function, the comfort function and the multimedia function are output in a coupled manner. For example, in particular, the comfort function is controlled according to at least one characteristic of the multimedia function. Which comfort functions a specific multimedia function corresponds to and how it affects the output of the comfort function can in particular be preset or changed by the user according to preferences.

[0057] In step S1, at least one marked condition that potentially affects the driving safety of the vehicle is detected.

[0058] For example, different types of signals can be detected by sensors integrated in the vehicle or included in the vehicle. These signals include, for example, signals associated with the vehicle itself, signals associated with the vehicle's surrounding environment, and / or signals associated with the vehicle's occupants.

[0059] Signals associated with the vehicle itself can be, for example, the driving speed of the vehicle (high speed / low speed), the operating state of the vehicle (in motion / stopped / engine off), the driving mode of the vehicle (manual driving / partial autonomous driving / full autonomous driving), the engine state, the fuel level, etc. In addition, signals associated with the vehicle itself can also be internal environmental conditions, such as the noise decibel level inside the vehicle, the temperature and / or humidity inside the vehicle, interfering items in the vehicle environment (pets, sundries), etc.

[0060] Signals associated with the vehicle's surrounding environment can be, for example, the current position of the vehicle, the traffic state in which the vehicle is located (complex / single / congested), the weather state in the vehicle's surrounding environment (sunny / visibility / harsh / light level), the road surface state and / or terrain state on which the vehicle is traveling (gradient / flat), the distance from other vehicles, traffic obstacles in the surrounding environment, etc.

[0061] Signals associated with the vehicle's occupants can be, for example, the number of occupants in the vehicle and / or the occupant position distribution. On the other hand, by detecting the state of the vehicle occupants, it is also possible to understand in real time the emotions (calm / nervous / excited), behaviors (driving / resting), and / or physical states (e.g., energetic / fatigued) of the vehicle occupants, etc.

[0062] In step S2, determine the relevance of at least one marking condition to driving safety.

[0063] In the sense of the present invention, relevance is a measure used to characterize the degree of correlation between the detected marking condition and driving safety. When the detected marking condition is a numerical or parametric signal, this correlation can be directly characterized by the marking condition itself or a function of the marking condition; when the marking condition is a non-numerical or non-parametric signal, a correlation coefficient can be assigned to it, and the correlation between the marking condition and driving safety is characterized by the correlation coefficient.

[0064] Here, for example, the correlation coefficient between the marking condition and driving safety can be determined by a trained machine learning model, and then this correlation is evaluated by means of a corresponding classifier according to predefined criteria, especially according to a reference threshold, in order to obtain an objective evaluation result of the magnitude of the correlation between the marking condition and driving safety.

[0065] Here, the reference threshold can especially be a value predefined by the user or a value automatically generated by the system. In addition, the reference threshold can also be understood as an indicator reflecting the degree of impact on driving safety. Exceeding this reference threshold means that the detected marking condition is significantly related to driving safety or has a high influence on driving safety, while being lower than this reference threshold means that the marking condition is less important for driving safety or will not have a significant impact on driving safety.

[0066] Exemplarily, if the detected marking condition is the weather state of the vehicle's surrounding environment, the correlation refers to the severity of the weather (for example, this severity can be characterized by a correlation coefficient of 1 - 5, where 1 represents clear and cloudless weather, and 5 represents rainy or snowy weather). Here, the reference threshold refers to a weather state with a moderate influence on safe driving (for example, a correlation coefficient of 2.5, representing a weather state with good visibility). Also exemplarily, if the detected marking condition is the vehicle speed, the correlation can be directly characterized by the numerical value of the speed. Here, the reference threshold refers to a speed threshold with a moderate influence on safe driving (for example, the vehicle speed is 30 km / h). Also exemplarily, if the detected marking condition is the number of occupants in the vehicle, the correlation can be directly characterized by a function of the specific numerical value of the number of occupants (for example, the reciprocal) (such as 1 / 5 to 1). Here, the reference threshold refers to "the number of people is one (for example, the numerical value "1")."

[0067] In step S3, based on the correlation, the output mode of the vehicle's entertainment interaction function is determined.

[0068] Here, in response to the determined correlation, for example, personalized output modes of the entertainment interaction function can be customized for different scenarios. Exemplarily, when it is determined that the correlation is less than the reference threshold, the complete output mode of the entertainment interaction function is determined, and when it is determined that the correlation is greater than or equal to the reference threshold, the weakened output mode of the entertainment interaction function is determined. Compared with the complete output mode of the entertainment interaction function, the weakened output mode is manifested as: a decrease in the output intensity of the entertainment interaction function, a reduction in the number of combinations of the entertainment interaction function, a decrease in the output frequency of the entertainment interaction function, a reduction in the output duration of the entertainment interaction function, a change in the output position of the entertainment interaction function, and / or a conversion in the output type of the entertainment interaction function.

[0069] Exemplarily, when the marking condition is the driving state of the vehicle, a relatively higher relevance to driving safety is obtained in the case of the driving state being driving compared to the case of the driving state being stopped. Therefore, this is taken into account when determining the output mode of the entertainment interaction function, so that an output mode weakened relative to the normal or complete output mode can be formulated. In addition, when the marking condition is the traffic state, a weakened output mode can also be determined in the case of a complex traffic state in the surrounding environment of the vehicle compared to the case of a simple traffic state. In addition, a weakened output mode of the entertainment interaction function is determined in the case where the number of occupants is equal to one compared to the case where the number of occupants is more than one.

[0070] In step S4, the corresponding entertainment interaction function is output in the determined output mode.

[0071] Here, an output mode can particularly correspond to one or more entertainment interaction functions of the vehicle (such as ambient lighting, air-conditioning air output, audio output, seat vibration, etc.). At the same time, different output modes also assign corresponding intensities, frequencies, durations, repetition intervals, and / or types to their corresponding entertainment interaction functions. Which entertainment interaction functions are specifically corresponding to each output mode can be defined by the user according to preferences, or can be automatically generated by the system.

[0072] Figure 2 A flowchart illustrates an exemplary embodiment of using the method for personalized output of entertainment interaction functions of a vehicle according to the present invention in a specific application scenario.

[0073] In this exemplary embodiment, for example, the method according to the present invention is described in combination with the use of the vehicle ambient display function, which is in particular one of the combined functions of the multimedia function and the comfort function.

[0074] In step S20, for example, the activation of the vehicle ambient display function is triggered based on the specific behavior of the user.

[0075] In step S21, the first marking condition and the second marking condition that potentially affect the driving safety of the vehicle are detected. Here, for example, the current speed of the vehicle is detected by means of a vehicle wheel speed sensor as the first marking condition, and at the same time, an image inside the vehicle compartment is collected by means of a camera arranged inside the vehicle and the number of occupants is identified as the second marking condition.

[0076] In step S22, the relevance between the first marking condition and driving safety is directly characterized by the magnitude of the vehicle speed value, and the current speed of the vehicle is compared with a speed threshold to determine whether it is higher than the speed threshold. When it is determined that the current speed of the vehicle is less than the speed threshold, for example, it means that the vehicle is traveling at a low speed or is in a stopped state, which especially implies a lower relevance to driving safety. Then, in step S23, the first output mode of the vehicle atmosphere display function, that is, the complete output mode, is determined. In this first output mode, the control of the air volume and direction of the air conditioner, the vibration intensity and frequency of the seat, the color of the ambient light, the blinking frequency of the ambient light, and / or the type of fragrance release varies with the type, style, rhythm, and / or intensity of the vehicle's multimedia audio, especially music. Exemplarily, in this case, the main color of the album of the currently playing music can also be displayed by the ambient light.

[0077] If it is determined in step S22 that the current speed of the vehicle is greater than or equal to the speed threshold, it means that the vehicle is traveling at a high speed, which especially implies a higher relevance to driving safety. In this case, it jumps to step S24.

[0078] In step S24, the relevance between the second marking condition and driving safety is characterized by a function of the number of occupants in the vehicle (here, the reciprocal of the number of occupants), and by comparing the reciprocal of the number of occupants with a reference threshold (such as 1), it is determined whether the number of occupants in the vehicle is greater than one. If there are other occupants in addition to the driver, for example, in step S25, the second output mode of the vehicle atmosphere display function, that is, the multi-person mode (combination mode), is determined. Here, compared with the ordinary occupant status, the driver status especially represents a higher safety relevance. Thus, in this second output mode, a weakened output mode of the vehicle atmosphere display function is enabled for the driver. In this weakened output mode, for example, only the color of the ambient light and / or the air volume of the air conditioner are controlled to vary with the type, style, rhythm, and / or intensity of the music, without outputting more significant entertainment interaction functions such as seat vibration to reduce interference to the driver. For other occupants, the complete output mode of the vehicle atmosphere display function is determined.

[0079] If it is determined in step S24 that there is only the driver in the vehicle at present, then in step S26, the third output mode of the vehicle atmosphere display function is determined, which especially refers to a weakened and single-person output mode.

[0080] Figure 3 A flowchart shows another exemplary embodiment of using the method for personalized output of the entertainment interaction function of a vehicle according to the present invention in a specific application scenario.

[0081] In this exemplary embodiment, the method according to the present invention will be described, for example, in connection with the use of a vehicle message notification function, which is in particular also one of the combined functions of a multimedia function and a comfort function.

[0082] In step S31, the basic content and type of the message are interpreted, for example, by means of a message text conversion unit and a semantic segmentation unit.

[0083] In step S32, the traffic state in the surrounding environment of the vehicle is detected, for example, by means of an environmental sensor of the vehicle, as a third marking condition.

[0084] Next, in step S33, a complexity coefficient is assigned to the current traffic state, and this complexity coefficient is compared with a reference threshold value pre-stored in the system (for example, for characterizing less traffic flow and simpler road changes) to determine whether the complexity coefficient of the current traffic state exceeds the reference threshold value. If it is determined that it is lower than the reference threshold value, it means that the current traffic state is simpler than the reference traffic state, which, for example, indicates a lower correlation between the third marking condition and driving safety. Thus, in step S34, a normal (non-muted) message notification mode is determined, in which a notification sound is emitted at a normal volume.

[0085] If it is determined in step S33 that it exceeds the reference threshold value, it means that the current traffic state is more complex than the reference traffic state, which, for example, indicates a higher correlation between the third marking condition and driving safety or a higher accident probability. In this case, in step S35, it is further determined whether the message relates to a private message or a general message. In this embodiment, a private message in particular refers to information specific to the identity of the push object (such as a payment confirmation message, a bill amount confirmation message, personal chat content information, etc.), and such messages often have a relatively high importance in terms of their content. A general message, on the other hand, in particular refers to information not specific to the identity of the push object (such as a multimedia message, a navigation prompt message, an in-vehicle entertainment interaction function voice feedback message, etc.), and such messages often have a relatively low importance in terms of their content.

[0086] If it is determined in step S35 that the message relates to a general message, then, for example, in step S36, an open-muted message notification mode is determined, which in particular refers to an open and unobtrusive message notification mode. In such a message notification mode, for example, the message can be notified by means of centralized comfort functions and multimedia functions that can be perceived by the public (such as the vehicle head unit screen flashing, the air conditioner blowing air, the atmosphere light rendering effect), while strictly controlling the intensity and notification time of the comfort functions, so as to reduce the continuous interference to the occupants.

[0087] If it is determined in step S35 that the message involves a private message, then, for example, in step S37, a private silent message prompt mode is determined. In this message prompt mode, for example, the corresponding push recipient can be notified in a partial prompt manner (such as only causing the seat of a specific user to vibrate, or only turning on the ambient light or turning on the air conditioner air outlet near the position of a specific user). According to an embodiment, in the case of visually outputting an entertainment interaction function for message prompting, the color of the ambient light can be controlled so that the color of the application program from which the message originates can be displayed.

[0088] For example, when a WeChat message for the vehicle driver is received in the vehicle, then, for example, the main color (such as green) of the WeChat application icon can be displayed in the color of the ambient light near the driver's seat of the vehicle, or its pattern can be combined, thereby being able to give the user the impression in a brief and quick manner that the message received by him / her is a WeChat message. In addition, compared with directly announcing the message content by voice or displaying the message content on the in-vehicle screen, through the above method, the user's privacy can be fully protected, and at the same time, the source and type of the message can be accurately conveyed to him / her without causing excessive distraction of attention.

[0089] Figure 4 Another exemplary embodiment of using the method according to the present invention for personalized output of the entertainment interaction function of a vehicle in a specific application scenario is shown in a flowchart.

[0090] In this exemplary embodiment, for example, the method according to the present invention is described in combination with the use of the vehicle meditation function, and the vehicle meditation function can also be one of the combined functions of the multimedia function and the comfort function.

[0091] In step S40, for example, the activation of the vehicle meditation function is triggered based on a specific behavior of the user.

[0092] In step S41, the current speed of the vehicle is detected by means of a vehicle wheel speed sensor as the fourth marking condition.

[0093] In step S42, the relevance between the fourth marking condition and driving safety is directly characterized by the numerical magnitude of the vehicle speed, and the current speed of the vehicle is compared with another speed threshold to determine whether it is higher than the other speed threshold. When it is determined that the current speed of the vehicle is greater than the other speed threshold, it indicates a relatively high relevance to driving safety. Therefore, in step S43, the corresponding output mode of the entertainment interaction function is determined and the vehicle meditation mode is not entered in particular. Here, (for example, based on the user's trigger of the meditation function), it can be determined that the user is already in the parking lot. Therefore, in the corresponding output mode of the entertainment interaction function, a navigation service to at least one available parking space in the parking lot area can be provided for the vehicle user.

[0094] If it is determined in step S42 that the current speed of the vehicle is less than the other threshold, this particularly means that the vehicle is in a parked state, which indicates a relatively low correlation with driving safety. Then, it can be further determined in step S44 whether the vehicle is parked in a parking area. If the vehicle has been parked, the vehicle meditation mode is determined to be entered in S45. In this vehicle meditation mode, for example, one or more of the following operations are performed: dimming the in-vehicle lighting, controlling the air outlet speed of the air conditioner to slow down and the air volume to decrease, controlling the in-vehicle aromatherapy device to release a soothing and sleep-promoting smell, controlling the color of the ambient light to change to a calming color (dark blue) and displaying a starry sky pattern on the roof, unbuckling the seat belt, controlling the rhythm of the ambient light to become softer, and lowering the seat backrest. Optionally, the vehicle meditation function can also have a timing function. When the preset time expires, one or more of the following operations can be performed: brightening the vehicle lighting again, restoring the seat to its original position, turning off the ambient light, turning off the aromatherapy, and turning off the air conditioner.

[0095] If it is determined in step S44 that the vehicle is not parked in a parking area, it is also possible to jump to step S43 to provide the vehicle with a navigation function to an idle parking space and not enter the meditation mode temporarily.

[0096] Figure 5 An exemplary embodiment of a device 50 for personalized output of the entertainment interaction function of a vehicle according to the present invention is schematically shown.

[0097] As Figure 5 shown, the device 50 includes:

[0098] A detection module 51, which is configured to be able to detect at least one marked condition that potentially affects the driving safety of the vehicle. In this detection module 51, multiple different types of sensors can be particularly integrated, and signals associated with the vehicle itself, signals associated with the surrounding environment of the vehicle, and signals associated with the vehicle occupants can be collected by means of these sensors.

[0099] A control module 52, which is configured to be able to determine the correlation between the at least one marked condition and driving safety, and determine the output mode of the entertainment interaction function of the vehicle based on the correlation.

[0100] An output module 53, which is configured to be able to output the corresponding entertainment interaction function in the determined output mode.

[0101] The output module 53 may, for example, have a communication interface 530 through which the output module 53 can be connected, for example, to the entertainment interaction function execution module 10 of the vehicle. The entertainment interaction function execution module 10 includes a multimedia function module 11, a comfort function module 12, and / or a combined module of the multimedia function module 11 and the comfort function module 12. If the entertainment interaction function involves a combined function of the multimedia function and the comfort function, there is also a corresponding communication connection (especially a CAN bus) and a signal processing device (such as an analog-to-digital converter) between the multimedia function module 11 and the comfort function module 12 to ensure that the multimedia function and the comfort function can be output in a coupled manner.

[0102] Figure 6 An exemplary embodiment of a detection module and a control module of a device for personalized output of the entertainment interaction function of a vehicle according to the present invention is schematically shown.

[0103] In Figure 6 the exemplary embodiment shown, the detection module 51 further includes an environment detection unit 511, a vehicle state detection unit 512, and a vehicle occupant detection unit 513.

[0104] The environment detection unit 511 is used to detect the surrounding environment information of the vehicle, which especially refers to the position where the vehicle is currently located, the traffic state (complex / simple / congested) in the surrounding environment of the vehicle, the weather conditions (sunny / visibility / harsh / light level) near the position where the vehicle is located, the road surface state and / or terrain state (gradient / flat) on which the vehicle is traveling, the distance from nearby vehicles, and traffic obstacles. The environment detection unit 511 may, for example, be a front camera of the vehicle, a GPS sensor, a proximity sensor, a radar sensor, a lidar sensor, an ultrasonic sensor, an infrared sensor, etc.

[0105] The vehicle state detection unit 512 is used to detect the state information of the vehicle, which especially refers to the driving state of the vehicle (high-speed traveling / low-speed driving / stopping / shutting down), the driving mode of the vehicle (manual driving / partially autonomous driving / full autonomous driving), the noise decibel level in the vehicle interior environment, the temperature and / or humidity inside the vehicle, interfering items (pets, sundries) in the vehicle interior environment, the engine state, the fuel level, etc. The vehicle state detection unit 512 may, for example, be a speed sensor of the vehicle, an acceleration sensor, a temperature and / or humidity sensor inside the vehicle, an in-vehicle camera, an in-vehicle noise sensor, a fuel indicating unit, an engine speed sensor, etc.

[0106] The vehicle occupant status detection unit 513 is used to detect the occupant status information of the vehicle, which particularly refers to the number of occupants in the vehicle and / or the occupant position distribution. On the other hand, the vehicle occupant's mood (calm / relaxed / tense / excited), behavior (driving / resting) and / or physical state (e.g. energetic / fatigued) can also be understood in real time by detecting the vehicle occupant status. The vehicle occupant status detection unit can be, for example, an in-vehicle camera, a seat weight sensor, a facial emotion recognition unit, etc.

[0107] from Figure 6 It can also be seen that the control module 52 further includes a correlation determination unit 521 , a reference condition storage unit 522 , a weight allocation unit 523 and a processor 524 .

[0108] After at least one marking condition is detected, the marking condition is transmitted to the relevance determination unit 521 of the control module 52, where the detected marking condition is compared with the reference condition (e.g., a reference threshold for characterizing a reference safety situation) stored in the reference condition storage unit 522, so as to obtain the relevance of the marking condition to driving safety. Here, for different types of marking conditions detected, the stored reference conditions can be defined differently, for example, depending on different situations, the reference conditions can be: the number of passengers in the vehicle is one, the lighting condition of the vehicle's surrounding environment is "sunny", the vehicle's speed is 30 km / h, and the number of lanes in the vehicle's surrounding environment is one.

[0109] In addition, as shown in the example, the confidence scores and / or priorities of different marking condition categories can also be provided from the weight allocation unit 523 to the correlation judgment unit 521, so that when determining the relevance to driving safety in the correlation judgment monocular 521, the weights and influences of different marking conditions can be comprehensively considered according to different weights and / or priorities.

[0110] The relevance of the flagged condition to driving safety is then transmitted to the processor 524 to be used therein to determine an output mode of the vehicle's entertainment interaction function.

[0111] Although specific embodiments of the present invention are described in detail herein, they are provided for the purpose of explanation only and should not be considered to limit the scope of the present invention. Various substitutions, changes and modifications may be conceived without departing from the spirit and scope of the present invention.

Claims

1. A method for personalized output of the entertainment interaction function of a vehicle, the method comprising the following steps: Detect at least one marked condition that potentially affects the driving safety of a vehicle, where the at least one marked condition includes the driving speed of the vehicle and the number of occupants; Determine the relevance of the at least one marked condition to driving safety; Based on the relevance, determine the output mode of the vehicle's entertainment interaction function. When it is concluded that the relevance is greater than or equal to a reference threshold, determine the weakened output mode of the entertainment interaction function. The weakened output mode is an output mode that is perceptually simplified compared to the complete output mode of the entertainment interaction function. Wherein, if the driving speed of the vehicle is greater than the speed threshold and if the number of occupants is more than one, determine the weakened output mode of the entertainment interaction function for the driver and the complete output mode of the entertainment interaction function for other occupants. Wherein, if the driving speed of the vehicle is greater than the speed threshold and if the number of occupants is one, only determine the weakened and single-person output mode for the driver. Wherein, if the driving speed of the vehicle is less than the speed threshold, directly determine the complete output mode of the entertainment interaction function; and output the corresponding entertainment interaction function in the determined output mode.

2. The method according to claim 1, wherein, Compared with the complete output mode of the entertainment interaction function, the weakened output mode is manifested as: a decrease in the output intensity of the entertainment interaction function, a reduction in the number of combinations of the entertainment interaction function, a decrease in the output frequency of the entertainment interaction function, a reduction in the output duration of the entertainment interaction function, a change in the output position of the entertainment interaction function, and / or a conversion in the output type of the entertainment interaction function.

3. The method according to claim 1 or 2, wherein The entertainment interaction function includes the combined function of the vehicle's multimedia function and comfort function, and in the combined function, the multimedia function and the comfort function are output coupledly.

4. The method according to claim 3, wherein The combined function includes the vehicle atmosphere display function. Wherein, in the complete output mode of the vehicle atmosphere display function, control the air outlet characteristics of the air conditioner, the seat vibration characteristics, the atmosphere lamp color characteristics, the atmosphere lamp flashing characteristics, and / or the aroma release characteristics to change with the vehicle's multimedia audio. In the weakened output mode of the vehicle atmosphere display function, only control the air outlet characteristics of the air conditioner and the atmosphere lamp color characteristics to change with the vehicle's multimedia audio, or only output the multimedia audio.

5. The method according to claim 4, wherein, Control the color of the atmosphere lamp to display the album color of the music of the multimedia audio.

6. The method according to any one of claims 1 to 5, wherein The entertainment interaction function includes a message prompt function. Wherein, the method further includes: detecting at least one signal associated with the message; and determining the output mode of the message prompt function based on the signal associated with the message and the relevance of the at least one marked condition to driving safety.

7. The method according to claim 6, wherein, When outputting the message prompt visually, control the color of the atmosphere lamp so that the color of the application program from which the message source can be displayed; and / or when the message is a prompt for the charging status of an electronic device, visually highlight the charging area of the electronic device.

8. The method according to any one of claims 1 to 7, wherein The at least one marked condition includes signals associated with the vehicle itself, signals associated with the vehicle's surrounding environment, and signals associated with the vehicle's occupants.

9. The method according to claim 8, wherein, Signals associated with the vehicle itself include the driving state of the vehicle and / or the environmental state inside the vehicle; and / or signals associated with the surrounding environment of the vehicle include the position of the vehicle, the traffic state in the surrounding environment of the vehicle, the weather state in the surrounding environment of the vehicle, and / or the road surface state in the surrounding environment of the vehicle; and / or signals associated with the vehicle occupants include the distribution of occupant positions in the vehicle and / or the occupant state.

10. The method according to claim 9, wherein, The steps of determining the output mode of the entertainment interaction function of the vehicle include: determining a weakened output mode of the entertainment interaction function in the case where the driving state is driving as compared to the case where the driving state is stopped; and / or determining a weakened output mode of the entertainment interaction function in the case where the traffic state in the surrounding environment of the vehicle is complex as compared to the case where the traffic state is simple.

11. The method according to claim 9 or 10, wherein The steps of determining the output mode of the entertainment interaction function of the vehicle include: determining different output modes of the entertainment interaction function for occupants in different positions in the vehicle, wherein, as compared to occupants in non-driver positions, a weakened output mode is determined for occupants in the driver position, and as the distance from the driver position decreases, the output mode is determined to be gradually weakened.

12. The method according to any one of claims 1 to 11, wherein, The method includes: detecting a change in the at least one marked condition; and adjusting the output mode of the entertainment interaction function of the vehicle such that the output mode of the entertainment interaction function dynamically matches the change in the at least one marked condition.

13. The method according to any one of claims 1 to 12, wherein, The steps of determining the relevance of at least one marked condition to driving safety include: assigning priorities and / or confidence scores to different marked conditions, and determining the relevance of the at least one marked condition to driving safety in general at least based on the priorities and / or the accumulated confidence scores.

14. The method according to claim 1, wherein The method further includes: when it is determined that the relevance is less than a reference threshold, further determining whether the vehicle is parked in a parking area, and enabling a meditation function when it is determined that the vehicle has been parked in the parking area.

15. The method according to claim 3, wherein, Control the output of the comfort function according to at least one characteristic of the multimedia function.

16. The method according to claim 4, wherein, The combined function includes a vehicle atmosphere display function, wherein, in the complete output mode of the vehicle atmosphere display function, controlling the air outlet characteristics of the air conditioner, the seat vibration characteristics, the atmosphere light color characteristics, the atmosphere light flashing characteristics, and / or the aroma release characteristics to change with the type, style, rhythm, and / or intensity of the music of the vehicle multimedia audio, and in the weakened output mode of the vehicle atmosphere display function, only controlling the air outlet characteristics of the air conditioner and the atmosphere light color characteristics to change with the type, style, rhythm, and / or intensity of the music of the vehicle multimedia audio, or, only outputting the music of the vehicle multimedia audio.

17. The method according to claim 6, wherein, The signals associated with the message include the importance level of the message and / or the message push target.

18. The method according to claim 7, wherein In the case where the message is a prompt for the charging state of an electronic device, visually highlight the charging area of the electronic device, and indicate the charging state of the electronic device with the color of the atmosphere light.

19. A device for personalized output of entertainment interaction functions of a vehicle, the device being used to execute the method according to any one of claims 1 to 18, the device comprising: A detection module configured to be able to detect at least one marked condition that may potentially affect the driving safety of the vehicle; A control module, which is configured to be able to determine the relevance of the at least one marking condition to driving safety, and determine an output mode of an entertainment interaction function of the vehicle based on the relevance; And an output module, which is configured to be able to output a corresponding entertainment interaction function in the determined output mode.

20. A vehicle having the device according to claim 19.

21. A machine-readable program carrier, on which a computer program is stored, and the computer program is used to execute the method according to any one of claims 1 to 18 when being executed by a processor.

Images