Interaction method and device, computer equipment, storage medium and program product

Abstract

The invention relates to an interaction method and device, computer equipment, a storage medium and a program product. The method comprises the steps that in the vehicle driving process, the health state and the driving appropriate value of a driver are determined according to first control data of the driver on the vehicle and first biological data of the driver; updating the vehicle-mounted virtual image according to the health state, the driving suitable value and the navigation data information of the vehicle; and interacting with the driver based on the updated vehicle-mounted virtual image. By adopting the method, personalized interaction service can be provided.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence technology, and in particular to an interaction method, apparatus, computer equipment, storage medium and program product. Background Art

[0002] Against the backdrop of the rapid evolution of smart cars and autonomous driving technologies, the intelligence and personalization of the in-vehicle human-machine interface (HMI) have become core elements for improving driving experience and safety.

[0003] However, existing HMI designs have limitations in terms of immersive interactive experience and personalized service provision, and fail to fully consider the profound impact of the driver's health status on driving safety and experience. Summary of the invention

[0004] Based on this, it is necessary to provide an interactive method, device, computer equipment, storage medium and program product to provide personalized interactive services in response to the above technical problems.

[0005] In a first aspect, the present application provides an interaction method, the method comprising:

[0006] During the driving of the vehicle, determining the health status and driving fitness value of the driver according to the first vehicle operation data of the driver and the first biological data of the driver;

[0007] Update the in-vehicle avatar based on health status, driving fitness value and vehicle navigation data information;

[0008] Interact with the driver based on the updated in-vehicle virtual image.

[0009] In one embodiment, the vehicle-mounted virtual image is updated according to the health status, driving fitness value and navigation data information of the vehicle, including:

[0010] According to the health status and driving suitability value, the image data and interaction mode of the vehicle-mounted virtual image are updated; wherein the interaction mode includes interaction content and / or interaction mode; according to the navigation data information of the vehicle, the updated interaction mode is adjusted.

[0011] In one embodiment, the updated interaction mode is adjusted according to the navigation data information of the vehicle, including:

[0012] The driving environment of the vehicle is determined based on the navigation data information of the vehicle; and the updated interaction mode is adjusted based on the driving environment.

[0013] In one embodiment, after interacting with the driver based on the updated in-vehicle virtual image, the method further includes:

[0014] Acquire the interaction data generated by the interaction between the updated in-vehicle virtual image and the driver, as well as the driver's second control data of the vehicle and the driver's second biological data; and update the updated in-vehicle virtual image again according to the interaction data, the second control data and the second biological data.

[0015] In one embodiment, it includes:

[0016] Determine the driving environment of the vehicle based on the navigation data information of the vehicle; determine the type of biological monitoring based on the driving environment; adjust the type of biological monitoring based on the historical biological data of the driver during historical driving; and use a device corresponding to the adjusted biological monitoring type to obtain the first biological data of the driver.

[0017] In one of the embodiments, the first biological data includes at least one of facial data, voice data and vital sign data.

[0018] In a second aspect, the present application further provides an interactive device, the device comprising:

[0019] A determination module, used to determine the health status and driving fitness value of the driver according to the first vehicle operation data of the driver and the first biological data of the driver during the driving of the vehicle;

[0020] An updating module, used for updating the in-vehicle virtual image according to the health status, driving fitness value and navigation data information of the vehicle;

[0021] The interaction module is used to interact with the driver based on the updated in-vehicle virtual image.

[0022] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0023] During the driving of the vehicle, determining the health status and driving fitness value of the driver according to the first vehicle operation data of the driver and the first biological data of the driver;

[0024] Update the in-vehicle avatar based on health status, driving fitness value and vehicle navigation data information;

[0025] Interact with the driver based on the updated in-vehicle virtual image.

[0026] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0027] During the driving of the vehicle, determining the health status and driving fitness value of the driver according to the first vehicle operation data of the driver and the first biological data of the driver;

[0028] Update the in-vehicle avatar based on health status, driving fitness value and vehicle navigation data information;

[0029] Interact with the driver based on the updated in-vehicle virtual image.

[0030] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0031] During the driving of the vehicle, determining the health status and driving fitness value of the driver according to the first vehicle operation data of the driver and the first biological data of the driver;

[0032] Update the in-vehicle avatar based on health status, driving fitness value and vehicle navigation data information;

[0033] Interact with the driver based on the updated in-vehicle virtual image.

[0034] The above-mentioned interaction method, device, computer equipment, storage medium and program product determine the driver's health status and driving fitness value by analyzing the first control data and the driver's first biological data; further, based on the health status, driving fitness value and navigation data information of the vehicle, the vehicle-mounted virtual image is updated, and finally, based on the updated vehicle-mounted virtual image, the interaction with the driver is realized. This scheme determines the driver's health status and driving fitness value by introducing the first control data and the first biological data, that is, from the driver's dimension, the vehicle-mounted virtual image is updated, which can increase the driver's interest and enhance interactivity; further, by introducing navigation data information, the vehicle-mounted virtual image is improved, that is, from the environmental dimension, the vehicle-mounted virtual image is supplemented, the situational nature of the interaction is realized, and finally a more personalized interactive service is provided to the driver. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0036] FIG1 is an application environment diagram of an interaction method provided in an embodiment of the present application;

[0037] FIG2 is a schematic diagram of an interactive process provided in an embodiment of the present application;

[0038] FIG3 is a schematic diagram of a process of updating a vehicle-mounted virtual image provided in an embodiment of the present application;

[0039] FIG4 is a schematic diagram of a flow chart of another interaction method provided in an embodiment of the present application;

[0040] FIG5 is a structural block diagram of an interactive device provided in an embodiment of the present application;

[0041] FIG. 6 is an internal structure diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0043] The interactive method provided in the embodiment of the present application can be applied to the application environment shown in FIG. 1 . The vehicle terminal 102 communicates with the server 104 through the network. The data storage system can store the data that the server 104 needs to process. The data storage system can be integrated on the server 104, or placed on the cloud or other network servers. The vehicle terminal 102 collects the driver's first control data of the vehicle and the driver's first biological data, and sends the first control data, the first biological data and the navigation data information to the server 104; further, the server 104 can determine the driver's health status and driving fitness value based on the first control data and the first biological data; further, the server 104 updates the vehicle-mounted virtual image based on the health status, the driving fitness value and the navigation data information of the vehicle, and sends the updated vehicle-mounted virtual image to the vehicle terminal 102, and controls the vehicle-mounted virtual image to interact with the driver. The terminal 102 can be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, Internet of Things devices and portable wearable devices, and the Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart vehicle-mounted devices, etc. The portable wearable device may be a smart watch, a smart bracelet, a head-mounted device, etc. The server 104 may be implemented as an independent server or a server cluster consisting of multiple servers.

[0044] In an exemplary embodiment, as shown in FIG. 2 , an interaction method is provided, which is described by taking the method applied to the server 104 in FIG. 1 as an example, and may include the following steps:

[0045] S201, during vehicle driving, determining a driver's health status and driving suitability value according to first vehicle control data of the driver and first biological data of the driver.

[0046] Among them, the first control data can represent the driver's operating data of the vehicle, which may include but is not limited to the frequency and amplitude of the driver's operations on the steering wheel, accelerator, brake, turn signal, gear, etc., as well as the vehicle's speed, acceleration and lane deviation data; the first biological data can represent the biological data of the driver's status, which may include but is not limited to at least one of facial data, voice data and vital sign data; the health status may include but is not limited to good, slightly good, slightly worse and poor; the driving suitability value can indicate whether the driver's current status is suitable for driving, such as 0<driving suitability value<=30, indicating that the driver's current status is extremely unsuitable for driving and the driver can stop driving immediately; 30<driving suitability value<=60, indicating that the driver's current status is not suitable for driving and the driver can adjust the status before continuing to drive; 60<driving suitability value<=100, indicating that the driver's current status is suitable for driving and the driver can continue to drive.

[0047] Exemplarily, during driving of the vehicle, the vehicle is monitored in real time through sensors on the vehicle, such as real-time monitoring of the vehicle's steering wheel, throttle, brakes and acceleration, and first control data is obtained; and the driver's status is monitored in real time through monitoring equipment on the vehicle, such as real-time monitoring of the driver's heart rate, blood pressure, attention and emotional state, and first biological data is obtained; further, the first control data and the first biological data can be comprehensively analyzed through advanced algorithms to determine the driver's health status and driving suitability.

[0048] S202, updating the vehicle-mounted virtual image according to the health status, driving suitability value and navigation data information of the vehicle.

[0049] Among them, navigation data information may include but is not limited to driving areas (such as urban driving, highway driving and rural driving, etc.), path characteristics (such as rugged road surface, many forks and traffic lights, etc.), driving time (such as current driving time, this driving time) and surrounding facilities (such as gas stations, rest areas and hospitals, etc.); the in-vehicle virtual image can be a three-dimensional virtual image in the vehicle, which can interact with the driver in a situation-adaptive manner to optimize the driver's driving experience and improve driving efficiency and pleasure.

[0050] For example, if the driver's health status is slightly poor, and the driving fitness value is 50, and according to the navigation data information, it can be known that the driver is driving in the city, there are many forks in the current driving route, the driving time is long, and there is a rest area one kilometer away; then, based on these health status, driving fitness values ​​and the vehicle's navigation data information, the on-board virtual image can be updated. The updated on-board virtual image will remind the driver in an interactive way, such as through verbal reminders "There are many forks ahead, you must pay full attention!", accompanied by lively actions, etc., so as to improve the driver's health status and driving fitness value.

[0051] It should be noted that the judgment of driving time can be preset, such as 0<driving time<=3, which is normal driving; 3<driving time<=6, which is fatigue driving; 6<driving time, which is dangerous driving. Optionally, the judgment of driving time can be adaptively adjusted in combination with the driver's historical driving data.

[0052] S203: interacting with the driver based on the updated in-vehicle virtual image.

[0053] The interaction may include but is not limited to language interaction and action interaction.

[0054] Exemplarily, the updated in-vehicle virtual image is sent to the vehicle end 102 , and the updated in-vehicle virtual image is controlled to interact with the driver through the vehicle end 102 .

[0055] The above-mentioned interaction method determines the driver's health status and driving fitness value by analyzing the first control data and the driver's first biological data; further, based on the health status, driving fitness value and navigation data information of the vehicle, the vehicle-mounted virtual image is updated, and finally, based on the updated vehicle-mounted virtual image, the interaction with the driver is realized. This scheme determines the driver's health status and driving fitness value by introducing the first control data and the first biological data, that is, from the driver's dimension, the vehicle-mounted virtual image is updated, which can increase the driver's interest and enhance interactivity; furthermore, by introducing navigation data information, the vehicle-mounted virtual image is improved, that is, from the environmental dimension, the vehicle-mounted virtual image is supplemented, the situational nature of the interaction is realized, and finally a more personalized interactive service is provided to the driver.

[0056] Based on the above embodiment, the present application embodiment explains the above embodiment S202 in detail. Specifically, the present application embodiment involves a process of updating the vehicle-mounted virtual image, as shown in FIG3 , which specifically includes the following steps:

[0057] S301, updating the image data and interaction mode of the in-vehicle virtual image according to the health status and driving suitability value.

[0058] Among them, image data may include but are not limited to data such as the appearance, voice and behavior of the in-vehicle virtual image; the interaction method may include but is not limited to interaction content and / or interaction mode, such as interaction content may include but is not limited to voice communication content, and interaction mode may include but is not limited to normal mode, working mode, light mode and funny mode, etc.

[0059] Exemplarily, based on the driver's health status and driving suitability, the in-vehicle virtual image is updated in a personalized manner, such as updating the in-vehicle virtual image's appearance (such as the character and skin of the in-vehicle virtual image, etc.), voice (such as the voice of the in-vehicle virtual image, optionally, the voice may include but is not limited to cute, humorous and mature types, etc.), behavior (such as the actions of the in-vehicle virtual image, optionally, the actions may include but are not limited to clapping, high-five, somersaults and jumping, etc.), interactive content (such as communication topics and communication content, etc.) and / or interactive modes (such as normal mode, light mode and funny mode, etc.), so that the updated in-vehicle virtual image can better regulate the driver's emotions, reduce the driver's visual and cognitive burden, and improve driving safety.

[0060] S302: adjusting the updated interaction mode according to the navigation data information of the vehicle.

[0061] One feasible method is to determine the driving environment of the vehicle based on the navigation data information of the vehicle; and adjust the updated interaction mode based on the driving environment.

[0062] Illustratively, the driving environment of the vehicle, such as a suburban environment with rough roads, can be determined based on the vehicle's navigation data information, such as the driving area, path characteristics, and driving time. Furthermore, the updated interaction mode can be adjusted according to the vehicle's driving environment. For example, if the driving environment is at night, the lighting in the interaction mode can be adjusted to soft lighting, and quiet music can be added to enhance the real-time interaction of the on-board virtual image and adapt to the driver's current driving needs, thereby providing the driver with personalized interaction services that match the driving environment.

[0063] Another feasible method is to directly add the navigation data information to the interactive mode of the in-vehicle virtual image, and use the in-vehicle virtual image to broadcast part of the navigation data information by voice and action to enhance the driving pleasure.

[0064] In the embodiment of the present application, by introducing navigation data information, the interactive content and interactive method of the vehicle-mounted virtual image are made more real-time, thereby improving the interaction effect with the driver and ultimately providing the driver with personalized interactive content.

[0065] Based on the above embodiments, the embodiment of the present application explains in detail the process after the interaction with the driver. Optionally, the interaction data generated by the interaction between the updated in-vehicle virtual image and the driver, as well as the driver's second control data of the vehicle and the driver's second biological data are obtained; according to the interaction data, the second control data and the second biological data, the updated in-vehicle virtual image is updated again.

[0066] Among them, the second control data can represent the driver's operation data of the vehicle when updating the on-board virtual image, which may include but is not limited to the frequency and amplitude of the driver's operations on the steering wheel, accelerator, brake, turn signal, gear, etc., and the vehicle's speed, acceleration and lane departure data; the driver's second biological data represents the biological data of the driver's status when updating the on-board virtual image, which may include but is not limited to at least one of facial data, voice data and vital sign data.

[0067] Exemplarily, the interaction data generated by the interaction between the updated in-vehicle virtual image and the driver is obtained, such as the conversation content and interaction actions. Further, the interaction data, the second control data and the second biological data are analyzed, that is, the actual effect of the interaction is analyzed, and the updated in-vehicle virtual image is updated again according to the actual effect of the interaction. If the actual effect of the interaction is not good, that is, the driver's condition is not improved or even worse, the in-vehicle virtual image is completely updated. The image data and the interaction method can be updated with very different styles (that is, the interaction mode can be updated from the working mode to the funny mode) to achieve the best adjustment of the driver's condition.

[0068] In an embodiment of the present application, by obtaining the interaction data between the updated in-vehicle virtual image and the driver, the second control data and the driver's second biological data, a data foundation is laid for determining the driver's acceptance of the updated in-vehicle virtual image, and sufficient preparations are made for better providing the driver with personalized interactive content.

[0069] Based on the above embodiments, the embodiment of the present application explains in detail the process of obtaining the first biological data of the driver. Optionally, the driving environment of the vehicle is determined according to the navigation data information of the vehicle; the biological monitoring type is determined according to the driving environment; the biological monitoring type is adjusted according to the historical biological data of the driver during the historical driving process; and the first biological data of the driver is obtained by using the device corresponding to the adjusted biological monitoring type.

[0070] Among them, the biological monitoring type can represent various indicators for monitoring the driver's status, which may include but are not limited to facial monitoring, sound monitoring and vital sign monitoring; among them, vital sign monitoring may include but is not limited to blood pressure monitoring, heart rate monitoring and body temperature monitoring, etc.

[0071] Exemplarily, the driving environment of the vehicle, such as driving at night, can be determined based on the vehicle's navigation data information; further, the type of biological monitoring for monitoring the driver can be determined based on night driving. For example, since the temperature is low at night, the driver's body temperature can be monitored, and since the driver is prone to fatigue at night, the driver's face and voice can be monitored; further, based on the driver's historical biological data during historical driving, it can be determined that the driver's blood pressure is prone to instability, so blood pressure monitoring can be added to the biological monitoring type to complete the adjustment of the biological monitoring type; further, based on the adjusted biological monitoring type, the corresponding equipment is used to monitor the driver to obtain the first biological data.

[0072] In an embodiment of the present application, the type of biological monitoring is adjusted based on the driving environment and historical biological data to better monitor the driver's status and ultimately determine the interaction content between the in-vehicle virtual image and the driver.

[0073] Based on the above embodiment, this embodiment provides an optional example of an interaction method. As shown in FIG4 , the specific implementation process is as follows:

[0074] S401, during vehicle driving, determining the health status and driving suitability value of the driver according to first vehicle control data of the driver and first biological data of the driver.

[0075] The first biological data includes at least one of facial data, voice data and vital sign data.

[0076] Optionally, the driving environment of the vehicle is determined based on the navigation data information of the vehicle; the biological monitoring type is determined based on the driving environment; the biological monitoring type is adjusted based on the historical biological data of the driver during historical driving; and the device corresponding to the adjusted biological monitoring type is used to obtain the driver's first biological data.

[0077] S402, updating the image data and interaction mode of the in-vehicle virtual image according to the health status and driving suitability value.

[0078] The interaction method includes interaction content and / or interaction mode.

[0079] S403: Determine the driving environment of the vehicle based on the navigation data information of the vehicle.

[0080] S404: adjusting the updated interaction mode according to the driving environment.

[0081] S405 , interacting with the driver based on the updated in-vehicle virtual image.

[0082] It should be noted that the interaction data generated by the interaction between the updated in-vehicle virtual image and the driver, as well as the driver's second control data of the vehicle and the driver's second biological data are obtained; based on the interaction data, the second control data and the second biological data, the updated in-vehicle virtual image is updated again.

[0083] The specific process of the above S401-S405 can refer to the description of the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0084] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0085] Based on the same inventive concept, the embodiment of the present application also provides an interactive device for implementing the interactive method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more interactive device embodiments provided below can refer to the limitations on the interactive method above, and will not be repeated here.

[0086] In an exemplary embodiment, as shown in FIG5 , an interaction device 1 is provided, comprising: a determination module 10, an update module 20 and an interaction module 30, wherein:

[0087] The determination module 10 is used to determine the health status and driving suitability value of the driver according to the first vehicle operation data of the driver and the first biological data of the driver during the driving of the vehicle.

[0088] The updating module 20 is used to update the vehicle-mounted virtual image according to the health status, driving suitability value and navigation data information of the vehicle.

[0089] The interaction module 30 is used to interact with the driver based on the updated vehicle-mounted virtual image.

[0090] In one embodiment, the update module 20 is specifically used for:

[0091] According to the health status and driving suitability value, the image data and interaction mode of the vehicle-mounted virtual image are updated; wherein the interaction mode includes interaction content and / or interaction mode; according to the navigation data information of the vehicle, the updated interaction mode is adjusted.

[0092] In one embodiment, the update module 20 is further configured to:

[0093] The driving environment of the vehicle is determined based on the navigation data information of the vehicle; and the updated interaction mode is adjusted based on the driving environment.

[0094] In one embodiment, the interaction device 1 specifically further includes:

[0095] The re-update module is used to obtain the interaction data generated by the interaction between the updated vehicle-mounted virtual image and the driver, as well as the driver's second control data of the vehicle and the driver's second biological data; based on the interaction data, the second control data and the second biological data, the updated vehicle-mounted virtual image is updated again.

[0096] In one embodiment, the interaction device 1 specifically further includes:

[0097] The acquisition module is used to determine the driving environment of the vehicle based on the navigation data information of the vehicle; determine the biological monitoring type based on the driving environment; adjust the biological monitoring type based on the historical biological data of the driver during the historical driving process; and use the device corresponding to the adjusted biological monitoring type to obtain the driver's first biological data.

[0098] Each module in the above-mentioned interactive device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module above.

[0099] In an exemplary embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be shown in FIG6. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface is connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store vehicle data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, an interactive method is implemented.

[0100] Those skilled in the art will understand that the structure shown in FIG. 6 is merely a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0101] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0102] During the driving of the vehicle, determining the health status and driving fitness value of the driver according to the first vehicle operation data of the driver and the first biological data of the driver;

[0103] Update the in-vehicle avatar based on health status, driving fitness value and vehicle navigation data information;

[0104] Interact with the driver based on the updated in-vehicle virtual image.

[0105] In one embodiment, when the processor executes the computer program, the following steps are also implemented:

[0106] According to the health status and driving suitability value, the image data and interaction mode of the vehicle-mounted virtual image are updated; wherein the interaction mode includes interaction content and / or interaction mode; according to the navigation data information of the vehicle, the updated interaction mode is adjusted.

[0107] In one embodiment, when the processor executes the computer program, the following steps are also implemented:

[0108] The driving environment of the vehicle is determined based on the navigation data information of the vehicle; and the updated interaction mode is adjusted based on the driving environment.

[0109] In one embodiment, when the processor executes the computer program, the following steps are also implemented:

[0110] Acquire the interaction data generated by the interaction between the updated in-vehicle virtual image and the driver, as well as the driver's second control data of the vehicle and the driver's second biological data; and update the updated in-vehicle virtual image again according to the interaction data, the second control data and the second biological data.

[0111] In one embodiment, when the processor executes the computer program, the following steps are also implemented:

[0112] Determine the driving environment of the vehicle based on the navigation data information of the vehicle; determine the type of biological monitoring based on the driving environment; adjust the type of biological monitoring based on the historical biological data of the driver during historical driving; and use a device corresponding to the adjusted biological monitoring type to obtain the first biological data of the driver.

[0113] In one embodiment, the first biological data includes at least one of facial data, voice data and vital sign data.

[0114] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0115] During the driving of the vehicle, determining the health status and driving fitness value of the driver according to the first vehicle operation data of the driver and the first biological data of the driver;

[0116] Update the in-vehicle avatar based on health status, driving fitness value and vehicle navigation data information;

[0117] Interact with the driver based on the updated in-vehicle virtual image.

[0118] In one embodiment, the computer program, when executed by a processor, implements the following steps:

[0119] According to the health status and driving suitability value, the image data and interaction mode of the vehicle-mounted virtual image are updated; wherein the interaction mode includes interaction content and / or interaction mode; according to the navigation data information of the vehicle, the updated interaction mode is adjusted.

[0120] In one embodiment, the computer program, when executed by a processor, implements the following steps:

[0121] The driving environment of the vehicle is determined based on the navigation data information of the vehicle; and the updated interaction mode is adjusted based on the driving environment.

[0122] In one embodiment, the computer program, when executed by a processor, implements the following steps:

[0123] Acquire the interaction data generated by the interaction between the updated in-vehicle virtual image and the driver, as well as the driver's second control data of the vehicle and the driver's second biological data; and update the updated in-vehicle virtual image again according to the interaction data, the second control data and the second biological data.

[0124] In one embodiment, the computer program, when executed by a processor, implements the following steps:

[0125] Determine the driving environment of the vehicle based on the navigation data information of the vehicle; determine the type of biological monitoring based on the driving environment; adjust the type of biological monitoring based on the historical biological data of the driver during historical driving; and use a device corresponding to the adjusted biological monitoring type to obtain the first biological data of the driver.

[0126] In one embodiment, the first biological data includes at least one of facial data, voice data and vital sign data.

[0127] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0128] During the driving of the vehicle, determining the health status and driving fitness value of the driver according to the first vehicle operation data of the driver and the first biological data of the driver;

[0129] Update the in-vehicle avatar based on health status, driving fitness value and vehicle navigation data information;

[0130] Interact with the driver based on the updated in-vehicle virtual image.

[0131] In one embodiment, the computer program, when executed by a processor, implements the following steps:

[0132] According to the health status and driving suitability value, the image data and interaction mode of the vehicle-mounted virtual image are updated; wherein the interaction mode includes interaction content and / or interaction mode; according to the navigation data information of the vehicle, the updated interaction mode is adjusted.

[0133] In one embodiment, the computer program, when executed by a processor, implements the following steps:

[0134] The driving environment of the vehicle is determined based on the navigation data information of the vehicle; and the updated interaction mode is adjusted based on the driving environment.

[0135] In one embodiment, the computer program, when executed by a processor, implements the following steps:

[0136] Acquire the interaction data generated by the interaction between the updated in-vehicle virtual image and the driver, as well as the driver's second control data of the vehicle and the driver's second biological data; and update the updated in-vehicle virtual image again according to the interaction data, the second control data and the second biological data.

[0137] In one embodiment, the computer program, when executed by a processor, implements the following steps:

[0138] Determine the driving environment of the vehicle based on the navigation data information of the vehicle; determine the type of biological monitoring based on the driving environment; adjust the type of biological monitoring based on the historical biological data of the driver during historical driving; and use a device corresponding to the adjusted biological monitoring type to obtain the first biological data of the driver.

[0139] In one embodiment, the first biological data includes at least one of facial data, voice data and vital sign data.

[0140] It should be noted that the information (including but not limited to vehicle information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0141] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0142] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0143] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. An interactive method, characterized in that: The method comprises: During the driving of the vehicle, determining the health status and driving fitness value of the driver according to the first operation data of the driver on the vehicle and the first biological data of the driver; updating the in-vehicle virtual image according to the health status, the driving fitness value and the navigation data information of the vehicle; The driver is interacted with based on the updated in-vehicle virtual image.

2. The method according to claim 1, characterized in that: The updating of the vehicle-mounted virtual image according to the health status, the driving suitability value and the navigation data information of the vehicle includes: According to the health status and the driving suitability value, the image data and interaction mode of the vehicle-mounted virtual image are updated; wherein the interaction mode includes interaction content and / or interaction mode; The updated interaction mode is adjusted according to the navigation data information of the vehicle.

3. The method according to claim 2, characterized in that The adjusting the updated interaction mode according to the navigation data information of the vehicle includes: Determining the driving environment of the vehicle according to the navigation data information of the vehicle; The updated interaction method is adjusted according to the driving environment.

4. The method according to claim 1, characterized in that: After interacting with the driver based on the updated in-vehicle virtual image, the method further includes: Acquire interaction data generated by the interaction between the updated in-vehicle virtual image and the driver, as well as second manipulation data of the driver on the vehicle and second biological data of the driver; The updated in-vehicle virtual image is updated again according to the interaction data, the second manipulation data and the second biological data.

5. The method according to claim 1, characterized in that The method further comprises: Determining the driving environment of the vehicle according to the navigation data information of the vehicle; Determining the type of biological monitoring based on the driving environment; adjusting the type of biological monitoring according to the historical biological data of the driver during historical driving; The first biological data of the driver is acquired by using a device corresponding to the adjusted biological monitoring type.

6. The method according to any one of claims 1 to 5, characterized in that The first biological data includes at least one of facial data, voice data and vital sign data.

7. An interactive device, characterized in that: The device comprises: a determination module, used to determine the health status and driving fitness value of the driver according to the first operation data of the driver on the vehicle and the first biological data of the driver during the driving of the vehicle; An updating module, configured to update the vehicle-mounted virtual image according to the health status, the driving fitness value and the navigation data information of the vehicle; The interaction module is used to interact with the driver based on the updated in-vehicle virtual image.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images