Human-vehicle interaction method and device, vehicle and storage medium

Abstract

The invention discloses a man-vehicle interaction method and device, a vehicle and a storage medium, and relates to the technical field of man-vehicle interaction, the man-vehicle interaction method is applied to the vehicle, the vehicle comprises a collection device, a plurality of display terminals and a plurality of playing devices, and the man-vehicle interaction method comprises the steps of collecting user information through the collection device, determining a current interaction scene according to the user information; determining a target display terminal and a target playing device from a plurality of display terminals and a plurality of playing devices according to the current interaction scene; based on the user information and / or the current interaction scene, virtual image display and information playing are carried out through the target display terminal and the target playing device so as to complete human-vehicle interaction, more humanized and emotional interaction attributes are given to the vehicle in combination with the actual vehicle using scene of the user, the vehicle and user interaction frequency is improved, and the user experience is improved. The interestingness of the user during driving is improved and the emotional projection of the user to the vehicle is enhanced while the vehicle use safety of the user is improved.

Description

Technical Field

[0001] The present application relates to the technical field of vehicle-human interaction, and particularly to a vehicle-human interaction method, device, vehicle, and storage medium. Background Art

[0002] Driven by the wave of automotive intelligence, the interaction experience brought by automobiles to people is becoming increasingly rich. In the process of people getting along with automobiles, more and more emotional elements are given to the vehicles, and the demand for vehicle-human interaction is gradually developing towards emotional and realistic directions.

[0003] However, current vehicle-human interaction scenarios are mostly limited to inside the vehicle. The artificial intelligence assistants on the vehicle mainly play the role of assisting managers, and assist users to complete vehicle operations by recognizing the voice commands of the vehicle owners. This interaction method is relatively passive, with obvious deficiencies in terms of humanization and emotional interaction, and active emotional communication is even less.

[0004] Therefore, how to achieve a more humanized vehicle-human interaction that can better carry real emotional projections and create higher emotional value for vehicle owners has become a new challenge faced by the automotive industry. Summary of the Invention

[0005] The main purpose of the present application is to provide a vehicle-human interaction method, device, vehicle, and storage medium, aiming to solve the technical problem of poor interactivity between current users and vehicles.

[0006] To achieve the above object, the present application proposes a vehicle-human interaction method, which is applied to a vehicle, and the vehicle includes: a collection device, a plurality of display terminals, and a plurality of playback devices, and the display terminals are installed in different areas of the vehicle;

[0007] The vehicle-human interaction method includes:

[0008] Collect user information through the collection device, and determine the current interaction scenario according to the user information;

[0009] Determine a target display terminal and a target playback device from the plurality of display terminals and the plurality of playback devices according to the current interaction scenario;

[0010] Perform virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction.

[0011] In one embodiment, the step of performing virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction includes:

[0012] When the current interaction scenario is the in-vehicle getting-off interaction scenario, obtain the in-vehicle display terminal and the out-of-vehicle display terminal through the target display terminal, and obtain the in-vehicle playback device and the out-of-vehicle playback device through the target playback device;

[0013] Obtain the dangerous reminder area of the vehicle;

[0014] Display a virtual image in the dangerous reminder area through the out-of-vehicle display terminal for danger reminder, and play an opening reminder message through the out-of-vehicle playback device to remind objects outside the vehicle to pay attention to safety;

[0015] Display a virtual image through the in-vehicle display terminal for danger reminder, and play an opening reminder message through the in-vehicle playback device to remind the user to pay attention to safety when opening the door.

[0016] In one embodiment, the step of displaying a virtual image in the dangerous reminder area through the out-of-vehicle display terminal for danger reminder, and playing an opening reminder message through the out-of-vehicle playback device to remind objects outside the vehicle to pay attention to safety includes:

[0017] Divide the dangerous reminder area into a static dangerous reminder area and a dynamic dangerous reminder area. The dynamic dangerous area is close to the object outside the vehicle, and the static dangerous area is located behind the dynamic dangerous area;

[0018] When the object outside the vehicle has not reached the dynamic dangerous area, display a dynamic virtual image in the dynamic dangerous area through the out-of-vehicle display terminal for dynamic danger reminder, and at the same time display a static warning sign in the static dangerous reminder area for static danger reminder, and play an opening reminder message through the out-of-vehicle playback device to remind the object outside the vehicle to pay attention to safety.

[0019] In one embodiment, the step of displaying a virtual image and playing information through the target display terminal and the target playback device based on the user information and / or the current interaction scenario includes:

[0020] When the current interaction scenario is that the user approaches the vehicle or moves around the vehicle, obtain the user position according to the user information;

[0021] When the user position is in the first preset position area, obtain the out-of-vehicle display terminal through the target display terminal, and obtain the out-of-vehicle playback device through the target playback device;

[0022] Display a dynamic virtual image in the first preset position area through the out-of-vehicle display terminal, and play the sound of the virtual image through the out-of-vehicle playback device;

[0023] Control the dynamic virtual image to move following the user to complete the vehicle-person interaction.

[0024] In one embodiment, the steps of performing virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction include:

[0025] When the current interaction scenario is an out-of-vehicle boarding interaction scenario, obtain an out-of-vehicle display terminal and an in-vehicle display terminal through the target display terminal, and obtain an in-vehicle playback device through the target playback device;

[0026] Display a dynamic virtual image through the out-of-vehicle display terminal, and obtain the user's position according to the user information;

[0027] When it is determined that the user is boarding according to the user's position, control the dynamic virtual image to jump from the out-of-vehicle display terminal to the in-vehicle display terminal for display, and play the sound of the dynamic virtual image through the in-vehicle playback device to complete vehicle-human interaction.

[0028] In one embodiment, the steps of performing virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction include:

[0029] When the current interaction scenario is an in-vehicle interaction scenario, obtain an in-vehicle display terminal through the target display terminal, and obtain an in-vehicle playback device through the target playback device;

[0030] Display a dynamic virtual image through the in-vehicle display terminal, and play the sound of the virtual image according to the in-vehicle playback device;

[0031] When the vehicle is in the driving process, obtain the driving speed, and adjust the running speed of the dynamic virtual image according to the driving speed.

[0032] In one embodiment, after the step of displaying a dynamic virtual image through the in-vehicle display terminal and playing the sound of the virtual image according to the in-vehicle playback device, it further includes:

[0033] When the vehicle is in a stopped state, play interactive information through the in-vehicle playback device;

[0034] Receive feedback information from the user based on the interactive information;

[0035] Determine the data to be displayed according to the feedback information;

[0036] Display the data to be displayed through the in-vehicle display terminal.

[0037] In addition, to achieve the above object, the present application further provides a vehicle-human interaction device, which includes:

[0038] A determination module, configured to collect user information through a collection device and determine a current interaction scenario according to the user information;

[0039] The determination module is further configured to determine a target display terminal and a target playback device from a plurality of display terminals and a plurality of playback devices according to the current interaction scenario;

[0040] A display and playback module, configured to perform virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction.

[0041] In addition, to achieve the above object, the present application further provides a vehicle, which includes: a collection device, a plurality of display terminals, and a plurality of playback devices, and the display terminals are installed in different areas of the vehicle; the vehicle further includes: a memory, a processor, and a computer program stored on the memory and executable on the processor, and the computer program is configured to implement the steps of the vehicle-human interaction method as described above.

[0042] In addition, to achieve the above object, the present application further provides a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the vehicle-human interaction method as described above are implemented.

[0043] In addition, to achieve the above object, the present application further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the vehicle-human interaction method as described above are implemented.

[0044] One or more technical solutions proposed in this application. The vehicle-human interaction method is applied to a vehicle, which includes: a collection device, multiple display terminals, and multiple playback devices. The display terminals are installed in different areas of the vehicle, and the display terminals in different areas can provide personalized interaction services for users in different positions, improving the flexibility and comprehensiveness of the interaction. The vehicle-human interaction method includes: collecting user information through the collection device and determining the current interaction scenario according to the user information; this helps the vehicle provide a more user-demand-fitting interaction method according to different scenarios, enhancing the pertinence and effectiveness of the interaction. Determine the target display terminal and the target playback device from multiple display terminals and multiple playback devices according to the current interaction scenario; perform virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete the vehicle-human interaction. Selecting the target device based on the current interaction scenario can achieve the rational utilization of resources. Precise device selection can improve the efficiency of information transmission, reduce unnecessary device calls, reduce energy consumption, and at the same time enhance the user experience. Displaying a virtual image through the target display terminal can interact with the user in a more vivid and intuitive way, enhancing the fun and emotional level of the interaction and shortening the distance between the vehicle and the human. Combining with the actual vehicle use scenario, by endowing the vehicle with more humanized and emotional interaction attributes, the interaction frequency between the vehicle and the user is increased, while improving the user's driving safety, enhancing the fun of the user during driving, and strengthening the user's emotional projection on the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with this application and used together with the specification to explain the principles of this application.

[0046] To more clearly illustrate the technical solutions in the embodiments of this application or in the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0047] Figure 1 It is a schematic flowchart provided for the first embodiment of the vehicle-human interaction method of this application;

[0048] Figure 2 It is a schematic flowchart provided for the second embodiment of the vehicle-human interaction method of this application;

[0049] Figure 3 It is an interaction schematic diagram when the current interaction scenario is the in-vehicle getting-off interaction scenario in an embodiment of the vehicle-human interaction method of this application;

[0050] Figure 4Schematic diagram of the division of the static danger reminder area and the dynamic danger reminder area in an embodiment of the vehicle interaction method of the present applicant;

[0051] Figure 5 Another interaction schematic diagram of the current interaction scenario being the in-vehicle getting-off interaction scenario in an embodiment of the vehicle interaction method of the present applicant;

[0052] Figure 6 Flow schematic diagram provided in Embodiment 3 of the vehicle interaction method of the present applicant;

[0053] Figure 7 Interaction schematic diagram of the user approaching the vehicle in an embodiment of the vehicle interaction method of the present applicant;

[0054] Figure 8 Interaction schematic diagram of the dynamic virtual image following the user's movement in an embodiment of the vehicle interaction method of the present applicant;

[0055] Figure 9 Flow schematic diagram provided in Embodiment 4 of the vehicle interaction method of the present applicant;

[0056] Figure 10 Flow schematic diagram provided in Embodiment 5 of the vehicle interaction method of the present applicant;

[0057] Figure 11 Schematic diagram of the in-vehicle entertainment interaction scenario when the vehicle is in a stopped state in an embodiment of the vehicle interaction method of the present applicant;

[0058] Figure 12 Brief flow schematic diagram in an embodiment of the vehicle interaction method of the present applicant;

[0059] Figure 13 Module structure schematic diagram of the vehicle-person interaction device in an embodiment of the present application;

[0060] Figure 14 Device structure schematic diagram of the hardware operating environment involved in the vehicle-person interaction method in an embodiment of the present application.

[0061] The realization of the purpose, functional features, and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. Detailed implementation manners

[0062] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0063] In order to better understand the technical solutions of the present application, the following will be described in detail with reference to the accompanying drawings of the specification and the specific implementation manners.

[0064] The main solution of the embodiment of the present application is: collecting user information through a collection device, and determining the current interaction scenario according to the user information; determining a target display terminal and a target playback device from multiple display terminals and multiple playback devices according to the current interaction scenario; and performing virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction.

[0065] Since the prior art provides a certain light language effect when the user approaches the vehicle, the light language effect is single and the human-machine interaction is weak, and it cannot provide emotional value to the user.

[0066] The present application provides a solution. When the user reaches a specific location area, a vehicle pet virtual image is displayed, and the voice of the virtual image is played through a playback device to actively greet the user. Relying on the vehicle and combining with the actual vehicle use scenario of the user, by endowing the vehicle with more humanized and emotional interaction attributes, while improving the vehicle use safety of the user, providing the emotional value of a mount and a pet to the user, and enhancing the user's emotional projection on the vehicle.

[0067] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication, and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of implementing the above functions, an in-vehicle control terminal in a vehicle, etc. Hereinafter, the in-vehicle control terminal in a vehicle is taken as an example to illustrate this embodiment and the following embodiments.

[0068] Based on this, the embodiment of the present application provides a vehicle-human interaction method, referring to Figure 1 , Figure 1 which is a schematic flowchart of the first embodiment of the vehicle-human interaction method of the present application.

[0069] In this embodiment, the vehicle-human interaction method is applied to a vehicle, and the vehicle includes: a collection device, multiple display terminals, and multiple playback devices, and the display terminals are installed in different areas of the vehicle.

[0070] It should be noted that the collection device is used to collect user information, and the collection device can be an in-vehicle camera, a sensor, a radar, or other terminal devices with a position acquisition function.

[0071] The multiple display terminals include projectors, lamps with display functions, HUD (Head Up Display), DA (Display APP, in-vehicle central control screen), etc. This embodiment does not limit this, and the display terminals are installed in different areas of the vehicle, including the car door, the vehicle taillight, or any area inside the vehicle.

[0072] The playback devices include in-vehicle speakers and out-vehicle speakers.

[0073] The described vehicle - human interaction method includes steps S10 to S30:

[0074] Step S10: Collect user information through the collection device, and determine the current interaction scenario according to the user information.

[0075] It should be noted that the user information may include user location information, user operation data and other information, and may also include other information. The collection device is used to obtain user information, and then send the user information to the vehicle control terminal. The vehicle control terminal determines the current interaction scenario according to the user information.

[0076] In specific implementation, the current interaction scenario includes an in - vehicle interaction scenario and an out - of - vehicle interaction scenario. The in - vehicle interaction scenario may include an in - vehicle getting - off interaction scenario, an in - vehicle driving scenario or an in - vehicle stationary scenario. The out - of - vehicle interaction scenario may include an out - of - vehicle moving scenario or an out - of - vehicle getting - on interaction scenario, etc.

[0077] In specific implementation, the user location can be obtained according to the user information, and the user coordinates can be determined according to the user location. The current interaction scenario is determined according to the user coordinates and the user's behavior. For example, if the user coordinates are outside the vehicle and the user is gradually approaching the vehicle, the current interaction scenario is an out - of - vehicle moving scenario. If the user opens the car door, the current interaction scenario is an out - of - vehicle getting - on interaction scenario.

[0078] Step S20: Determine the target display terminal and the target playback device from the multiple display terminals and the multiple playback devices according to the current interaction scenario.

[0079] It should be noted that after determining the current interaction scenario, the required display terminal and playback device can be selected from the multiple display terminals and the multiple playback devices as the target display terminal and the target playback device based on the current interaction scenario. For example, when the current interaction scenario is an in - vehicle driving interaction scenario, the target display terminal at this time is the in - vehicle display terminal, such as a DA screen, and the target playback device is the in - vehicle playback device, such as the in - vehicle audio.

[0080] Step S30: Based on the user information and / or the current interaction scenario, perform virtual image display and information playback through the target display terminal and the target playback device to complete the vehicle - human interaction.

[0081] It should be noted that at least one of the current interaction information and the user information can be used to control the target display terminal to perform virtual image display, and at the same time control the target playback device to perform information broadcast, so as to improve the interaction effect between the user and the vehicle. The specific image of the virtual image can be selected according to the user's needs or randomly generated.

[0082] In a specific implementation, the vehicle further includes an in-vehicle control terminal, the acquisition device is Device 1, the in-vehicle control terminal is Device 2, the out-of-vehicle display terminal is Device 3, the in-vehicle display terminal is Device 4, the out-of-vehicle playback device is Device 5, and the in-vehicle playback device is Device 6. The communication methods between Devices 1 to 4 can be link, CAN, CANFD, or Ethernet.

[0083] This embodiment provides a human-vehicle interaction method. The human-vehicle interaction method is applied to a vehicle, which includes: an acquisition device, multiple display terminals, and multiple playback devices. The display terminals are installed in different areas of the vehicle. The display terminals in different areas can provide personalized interaction services for users in different positions, improving the flexibility and comprehensiveness of the interaction. The human-vehicle interaction method includes: collecting user information through the acquisition device and determining the current interaction scenario based on the user information; this helps the vehicle provide a more user-demand-fitting interaction method according to different scenarios, enhancing the pertinence and effectiveness of the interaction. Determining a target display terminal and a target playback device from multiple display terminals and multiple playback devices according to the current interaction scenario; performing virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete the human-vehicle interaction. Selecting the target device based on the current interaction scenario can achieve the rational utilization of resources. Precise device selection can improve the efficiency of information transmission, reduce unnecessary device calls, lower energy consumption, and at the same time enhance the user experience. Displaying the virtual image through the target display terminal can interact with the user in a more vivid and intuitive way, enhancing the fun and emotional level of the interaction and narrowing the distance between the human and the vehicle. Combining with the actual vehicle use scenario of the user, by endowing the vehicle with more humanized and emotional interaction attributes, the interaction frequency between the vehicle and the user is increased, while improving the user's driving safety, enhancing the fun of the user during driving, and strengthening the user's emotional projection on the vehicle.

[0084] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar content as in the above-mentioned first embodiment can be referred to the above introduction and will not be repeated hereinafter. On this basis, please refer to Figure 2 , step S30 includes steps A301 to A304:

[0085] A301: When the current interaction scenario is an in-vehicle getting-off interaction scenario, obtain the in-vehicle display terminal and the out-of-vehicle display terminal through the target display terminal, and obtain the in-vehicle playback device and the out-of-vehicle playback device through the target playback device.

[0086] It should be noted that when the current interaction scenario is the in-vehicle getting-off interaction scenario, to avoid safety accidents caused by the failure of vehicles or pedestrians outside the vehicle to give way when the user opens the door, it is possible to simultaneously remind the objects outside the vehicle and the user inside the vehicle. Therefore, the target display terminal includes an in-vehicle display terminal and an out-of-vehicle display terminal, and the target playback device includes an in-vehicle playback device and an out-of-vehicle playback device.

[0087] A302: Obtain the danger reminder area of the vehicle.

[0088] In specific implementation, the danger reminder area can be determined according to the position of the vehicle, and can also be determined according to the distance and orientation between the vehicle and the surrounding obstacles. For example Figure 3 as shown Figure 3 is an interaction schematic diagram when the current interaction scenario is the in-vehicle getting-off interaction scenario. The currently opened door is the driver's door. Therefore, the danger reminder area is drawn according to the position of the vehicle and the position of the obstacle.

[0089] A303: Display a virtual image in the danger reminder area through the out-of-vehicle display terminal for danger reminder, and play an opening reminder message through the out-of-vehicle playback device to remind the objects outside the vehicle to pay attention to safety.

[0090] In specific implementation, it is possible to display a virtual image in the danger reminder area through the out-of-vehicle display terminal for danger reminder. For example, the out-of-vehicle display terminal is set at the door and the rear car light, so as to display the virtual image for danger reminder. At the same time, play an opening reminder message through the out-of-vehicle playback device, such as "The vehicle is opening the door! Danger! Please pay attention!", so as to remind the objects outside the vehicle to pay attention to safety when the user opens the door.

[0091] It should be noted that to improve the reminder effect, the danger reminder area can be further divided, and different reminder methods can be adopted for different areas. Step A303 can include: dividing the danger reminder area into a static danger reminder area and a dynamic danger reminder area. The dynamic danger area is close to the objects outside the vehicle, and the static danger area is located behind the dynamic danger area; when the objects outside the vehicle have not reached the dynamic danger area, display a dynamic virtual image in the dynamic danger area through the out-of-vehicle display terminal for dynamic danger reminder, and at the same time display a static warning sign in the static danger reminder area for static danger reminder, and play an opening reminder message through the out-of-vehicle playback device to remind the objects outside the vehicle to pay attention to safety.

[0092] It should be understood that, as Figure 4 shown Figure 4It is a schematic diagram for dividing the static danger reminder area and the dynamic danger reminder area. Compared with the static danger reminder area, the dynamic danger reminder area is farther from the vehicle and closer to the approaching object (potential collision target). When the object outside the vehicle has not reached the dynamic danger reminder area, a dynamic virtual image is displayed in the dynamic danger reminder area through the external vehicle display terminal, and at the same time, a static warning sign, such as a stop warning sign, is displayed in the static danger reminder area through the external vehicle display terminal to enhance the reminder effect. An opening reminder message is played through the external vehicle playback device: "The vehicle is opening the door! Danger! Pay attention!" Thus, it reminds the object outside the vehicle to slow down or avoid.

[0093] It can be understood that if the interaction scenario between the user and the vehicle is the scenario of getting into the vehicle and opening the door, the object outside the vehicle can also be reminded through the danger reminder area, and at the same time, the user opening the door is reminded to pay attention to the safety of opening the door through the external vehicle display terminal and the external vehicle playback device.

[0094] A304: The virtual image is displayed through the in-vehicle display terminal for danger reminder, and the opening reminder message is played through the in-vehicle playback device to remind the user to pay attention to the safety of opening the door.

[0095] To improve the reminder effect, at this time, the user who opens the door inside the vehicle can also be reminded, such as Figure 5 shown Figure 5 It is another interaction schematic diagram for the in-vehicle getting-off interaction scenario. By determining the in-vehicle reminder area, a virtual image is displayed in the in-vehicle reminder area through the in-vehicle display terminal for danger reminder, and at the same time, the opening reminder message is played through the in-vehicle audio, such as "Someone is approaching rapidly, don't open the door!" Thus, it reminds the user to pay attention to the safety of opening the door.

[0096] In this embodiment, when the current interaction scenario is the in-vehicle getting-off interaction scenario, the in-vehicle display terminal and the external vehicle display terminal are obtained through the target display terminal, and the in-vehicle playback device and the external vehicle playback device are obtained through the target playback device; the danger reminder area of the vehicle is acquired; a virtual image is displayed in the danger reminder area through the external vehicle display terminal for danger reminder, and an opening reminder message is played through the external vehicle playback device to remind the object outside the vehicle to pay attention to safety; a virtual image is displayed through the in-vehicle display terminal for danger reminder, and an opening reminder message is played through the in-vehicle playback device to remind the user to pay attention to the safety of opening the door. By using vivid virtual images for danger reminder, intuitive visual reminders can be provided to users and people outside the vehicle, enhancing the reminder effect, and by using different devices inside and outside the vehicle to work together, the overall interaction experience between the user and the vehicle can be improved.

[0097] Based on the first embodiment of the present application, in the third embodiment of the present application, the content that is the same as or similar to the above-mentioned embodiment one can be referred to the above introduction and will not be elaborated hereinafter. On this basis, please refer toFigure 6 , step S30 includes steps B301 to B304:

[0098] Step B301: When the current interaction scenario is that the user approaches the vehicle or moves around the vehicle, obtain the user's position according to the user information.

[0099] It should be noted that if the current interaction scenario is that the user approaches the vehicle or the user moves around the vehicle, it means that the user has the tendency to get in the car. At this time, to improve the interactivity between the user and the vehicle, a virtual image can be displayed at a specific position. Therefore, the position where the user is located can be obtained according to the user information, so as to determine whether the user reaches a specific position.

[0100] Step B302: When the user's position is within the first preset position area, obtain the out-of-vehicle display terminal through the target display terminal, and obtain the out-of-vehicle playback device through the target playback device.

[0101] It should be noted that the first preset position area can be set in advance. For example, the first preset position area is within 1m around the vehicle or the range with a radius of 1m centered on the vehicle, etc. It can also be set according to other vehicle information. This embodiment does not limit this. When the user's position is within the first preset position area, it means that the user has approached the vehicle. Therefore, the devices for display and playback at this time are out-of-vehicle devices. Then, the target display terminal is the out-of-vehicle display terminal, and the target playback device is the out-of-vehicle playback device.

[0102] Step B303: Display a dynamic virtual image in the first preset position area through the out-of-vehicle display terminal, and play the voice of the virtual image through the out-of-vehicle playback device.

[0103] In specific implementation, a dynamic virtual image can be displayed in the first preset position area through the out-of-vehicle display terminal, and at the same time, the voice of the virtual image can be played through the external speaker of the vehicle to actively greet the user.

[0104] As Figure 7 shown, Figure 7 is a schematic diagram of the interaction when the user approaches the vehicle. When the user approaches the vehicle, a dynamic virtual image is displayed in a specific area through the out-of-vehicle display terminal, and at the same time, the voice of the virtual image is played. The specific playback content can be set in advance. For example, it is "Master, you've worked hard today. Let's go home!"

[0105] Step B304: Control the dynamic virtual image to move following the user to complete the vehicle-human interaction.

[0106] It should be noted that when the user moves, the dynamic virtual image can be controlled to move following the user, so as to improve the interaction effect. As Figure 8 shown, Figure 8Schematic diagram of the interaction where a dynamic virtual avatar follows the user's movement. When the user walks around the vehicle, the virtual avatar follows the user. When the user detours to the rear of the vehicle, the external display terminal of the vehicle is located at the taillight, so that the virtual avatar is displayed on the taillight, and at the same time, the voice of the virtual avatar is played through the external speaker of the vehicle.

[0107] In this embodiment, when the current interaction scenario is that the user approaches the vehicle or moves around the vehicle, the user's position is obtained according to the user information; when the user's position is in the first preset position area, the external display terminal of the vehicle is obtained through the target display terminal, and the external playback device of the vehicle is obtained through the target playback device; a dynamic virtual avatar is displayed in the first preset position area through the external display terminal of the vehicle, and the voice of the virtual avatar is played through the external playback device; the dynamic virtual avatar is controlled to follow the user to move to complete the interaction between the person and the vehicle. When the user approaches the vehicle or moves around the vehicle, a dynamic virtual avatar is displayed through the external display terminal of the vehicle and its voice is played, breaking the monotonous mode of traditional human-vehicle interaction, bringing novel and interesting interactive experiences to users, and increasing the enthusiasm of users to interact with the vehicle. Performing human-vehicle interaction according to user information can provide personalized virtual avatars and voices for different users, making the interaction more in line with user needs.

[0108] Based on the first embodiment of the present application, in the fourth embodiment of the present application, the same or similar content as in the above-mentioned embodiment 1 can be referred to the above introduction and will not be repeated hereinafter. On this basis, please refer to Figure 9 , step S30 includes steps C301 to C303:

[0109] Step C301: When the current interaction scenario is an external vehicle boarding interaction scenario, the external display terminal of the vehicle and the internal display terminal of the vehicle are obtained through the target display terminal, and the internal playback device of the vehicle is obtained through the target playback device.

[0110] It should be noted that if the current interaction scenario is an external vehicle boarding interaction scenario, at this time, a scene switch from outside the vehicle to inside the vehicle is required. Therefore, the target display terminal includes the external display terminal of the vehicle and the internal display terminal of the vehicle, and the target playback device needs to be switched to the internal playback device of the vehicle.

[0111] Step C302: Display a dynamic virtual avatar through the external display terminal of the vehicle, and obtain the user's position according to the user information.

[0112] In a specific implementation, the way the external display terminal of the vehicle displays the dynamic virtual avatar is the same as the display method when the user approaches the vehicle or the user is in a certain area of the vehicle. At this time, the user is constantly approaching the door, so the user's position can be obtained according to the user information, and thus it can be determined whether the user opens the door to get in the vehicle according to the user's position.

[0113] It should be noted that if the user does not open the car door, the virtual image can continue to be displayed through the external display terminal and the external playback device, and the voice of the virtual image can be played.

[0114] Step C303: When it is determined that the user is getting into the car according to the user's position, control the dynamic virtual image to jump from the external display terminal to the in-vehicle display terminal for display, and play the voice of the dynamic virtual image through the in-vehicle playback device to complete the human-vehicle interaction.

[0115] In a specific implementation, when it is determined that the user is getting into the car, at this time, the external display terminal and the in-vehicle display terminal are linked. Therefore, the dynamic virtual image jumps from the display of the external display terminal to the in-vehicle display terminal for display, that is, the virtual image follows the user to the HUD or the DA screen. At the same time, the voice of the dynamic virtual image is played through the in-vehicle audio, for example: "Master, welcome aboard!".

[0116] In this embodiment, when the current interaction scenario is an external getting-into-the-car interaction scenario, the external display terminal and the in-vehicle display terminal are obtained through the target display terminal, and the in-vehicle playback device is obtained through the target playback device; the dynamic virtual image is displayed through the external display terminal, and the user's position is obtained according to the user information; when it is determined that the user is getting into the car according to the user's position, control the dynamic virtual image to jump from the external display terminal to the in-vehicle display terminal for display, and play the voice of the dynamic virtual image through the in-vehicle playback device to complete the human-vehicle interaction. In the external getting-into-the-car interaction scenario, the dynamic virtual image seamlessly jumps from the external display terminal to the in-vehicle display terminal, and the sound is also correspondingly switched to the in-vehicle playback device, creating a coherent and smooth interaction experience for the user, avoiding the sense of interaction interruption caused by scene conversion, and making the entire getting-into-the-car process more natural and smooth.

[0117] Based on the first embodiment of the present application, in the fifth embodiment of the present application, the same or similar content as that in the above-mentioned embodiment one can be referred to the above introduction and will not be repeated hereinafter. On this basis, please refer to Figure 10 , step S30 includes steps D301 to D303:

[0118] Step D301: When the current interaction scenario is an in-vehicle interaction scenario, obtain the in-vehicle display terminal through the target display terminal, and obtain the in-vehicle playback device through the target playback device.

[0119] It should be noted that the in-vehicle interaction scenario may include an in-vehicle dynamic scenario and an in-vehicle static scenario. The in-vehicle dynamic scenario is a scenario where the user is in the car and the vehicle is in motion, and the in-vehicle static scenario is a scenario where the user is in the car and the vehicle is stopped.

[0120] When the current interaction scenario is an in-vehicle interaction scenario, the target display terminal is then the in-vehicle display terminal, and the target playback device is the in-vehicle playback device.

[0121] Step D302: Display a dynamic virtual image through the in-vehicle display terminal, and play the sound of the virtual image according to the in-vehicle playback device.

[0122] It can be understood that at this time, a dynamic virtual image can be displayed through the in-vehicle display terminal, and at the same time, the sound of the virtual image can be played according to the in-vehicle audio, for example, the dynamic virtual image is displayed through the DA screen or the HUD screen.

[0123] In a feasible implementation manner, after displaying the dynamic virtual image, the state of the vehicle can be further determined to perform corresponding adjustments. Therefore, after step D302, it further includes: when the vehicle is in a stopped state, play interaction information through the in-vehicle playback device; receive feedback information of the user based on the interaction information; determine data to be displayed according to the feedback information; display the data to be displayed through the in-vehicle display terminal.

[0124] It should be understood that if the vehicle is in a stationary state, the virtual image can accompany the user to play games or for entertainment. Therefore, interaction information can be played first through the in-vehicle playback device, so that the user can make corresponding responses or feedbacks according to the interaction information. When receiving the feedback information of the user based on the interaction information, the feedback information can be analyzed, so as to determine the data to be displayed through the feedback information and display the data to be displayed on the in-vehicle display terminal. For example, the virtual image interacts with the user's interaction request to play a game, and through the in-vehicle playback device, it plays: "Master, let's play a game together! Run and jump, bounce and bounce". If the user agrees to the interactive game request, feedback information can be generated through voice or gesture operations to interact with the user.

[0125] As another example, as Figure 11 shown, Figure 11 is a schematic diagram of the in-vehicle entertainment interaction scenario when the vehicle is in a stopped state. When the vehicle is in a stopped state, play the interaction information of the voice of the virtual pet: "Master, you're tired from driving. Take a break and let's watch the movie you didn't finish last time", and receive the feedback information of the user based on the interaction information to interact with the user.

[0126] Step D303: When the vehicle is in the driving process, obtain the driving speed, and adjust the running speed of the dynamic virtual image according to the driving speed.

[0127] It should be noted that when the vehicle is in motion, the virtual image transforms into a "mount", and different running speeds can be displayed on the DA screen or HUD screen according to different driving speeds, giving users the experience of a pet mount. For example, different running speeds can be displayed through the HUD screen, and at the same time, the vehicle steering attitude can also be displayed. When there is a risk of rear-end collision, a reminder message can be played in a timely manner to alert the vehicle owner.

[0128] As another example, the virtual images of different vehicles can also interact with each other, that is, the vehicle pets can interact with each other, add friends to each other, and establish a close relationship. The interaction between the user and the vehicle pet and the interaction between the vehicle pets can both increase the pet experience value, corresponding to the growth process of the vehicle pet, and enhance the interaction effect.

[0129] In this embodiment, when the current interaction scenario is an in-vehicle interaction scenario, the in-vehicle display terminal is obtained through the target display terminal, and the in-vehicle playback device is obtained through the target playback device; a dynamic virtual image is displayed through the in-vehicle display terminal, and the sound of the virtual image is played according to the in-vehicle playback device; when the vehicle is in motion, the driving speed is obtained, and the running speed of the dynamic virtual image is adjusted according to the driving speed. As the driving speed of the vehicle changes, the running speed of the dynamic virtual image is adjusted accordingly, bringing a dynamic and vivid interaction experience to the in-vehicle users. This real-time changing interaction method breaks the static mode of traditional in-vehicle interaction, increases the fun, makes the driving process no longer monotonous, and improves the entertainment experience of users in the vehicle.

[0130] Exemplarily, to help understand the implementation process of the vehicle-human interaction method obtained by combining the above-mentioned Embodiment 1 with this embodiment, please refer to Figure 12 , Figure 12 A brief flow schematic diagram of a vehicle-human interaction method is provided. Specifically: the position of the vehicle owner is obtained through a collection device (Device 1), so as to judge whether the vehicle owner enters the set area. If so, the vehicle owner's coordinates are fed back to the vehicle-mounted control terminal (Device 2). The vehicle-mounted control terminal judges whether the vehicle owner is inside or outside the vehicle. If outside the vehicle, the projection area coordinates are calculated through Device 2, that is, the position coordinates of the displayed virtual image, and the device for performing display or projection is determined, that is, the target display terminal is determined. Then, Device 2 sends the coordinates to the target Device 3 (out-of-vehicle display terminal) and the playback device 5 (out-of-vehicle playback device), controls Device 3 to start projecting the vehicle dynamic virtual image at the corresponding coordinates, and at the same time, Device 5 plays the sound of the virtual image; if the vehicle owner is inside the vehicle, Device 2 displays the virtual image through Device 4 (in-vehicle display terminal), Device 2 performs the dynamic and static interactions inside the vehicle, sets the speed and direction of the vehicle pet according to the vehicle speed, and performs game and entertainment interactions. When necessary, information for interacting with the vehicle owner is played through Device 6 (in-vehicle playback device).

[0131] It should be noted that the above examples are only for understanding the present application and do not constitute a limitation on the vehicle interaction method of the present applicant. Based on this technical concept, more forms of simple transformations are within the protection scope of the present application.

[0132] The present application also provides a vehicle-human interaction device. Please refer to Figure 13 , the vehicle-human interaction device includes:

[0133] A determination module 10, configured to collect user information through a collection device and determine a current interaction scenario according to the user information.

[0134] The determination module 10 is further configured to determine a target display terminal and a target playback device from a plurality of display terminals and a plurality of playback devices according to the current interaction scenario.

[0135] A display and playback module 20, configured to perform virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction.

[0136] The vehicle-human interaction device provided by the present application adopts the vehicle-human interaction method in the above embodiment, and can solve the technical problem of poor interaction between the current user and the vehicle. Compared with the prior art, the beneficial effects of the vehicle-human interaction device provided by the present application are the same as those of the vehicle-human interaction method provided by the above embodiment, and other technical features in the vehicle-human interaction device are the same as those disclosed in the method of the above embodiment, and will not be elaborated here.

[0137] In one embodiment, when the current interaction scenario is an in-vehicle getting-off interaction scenario, the display and playback module 20 is further configured to obtain an in-vehicle display terminal and an out-of-vehicle display terminal through the target display terminal, and obtain an in-vehicle playback device and an out-of-vehicle playback device through the target playback device; obtain a danger warning area of the vehicle; display a virtual image in the danger warning area through the out-of-vehicle display terminal for danger warning, and play a door opening reminder message through the out-of-vehicle playback device to remind objects outside the vehicle to pay attention to safety; display a virtual image through the in-vehicle display terminal for danger warning, and play a door opening reminder message through the in-vehicle playback device to remind the user to pay attention to safety when opening the door.

[0138] In one embodiment, the display and playback module 20 is further configured to divide the danger reminder area into a static danger reminder area and a dynamic danger reminder area. The dynamic danger area is close to the external object of the vehicle, and the static danger area is located behind the dynamic danger area. When the external object has not reached the dynamic danger area, a dynamic virtual image is displayed in the dynamic danger area through the external display terminal for dynamic danger reminder, and a static warning sign is displayed in the static danger reminder area for static danger reminder. At the same time, the door opening reminder information is played through the external playback device to remind the external object to pay attention to safety.

[0139] In one embodiment, when the current interaction scenario is that the user approaches or moves around the vehicle, the display and playback module 20 is further configured to obtain the user position according to the user information. When the user position is in the first preset position area, the external display terminal is obtained through the target display terminal, and the external playback device is obtained through the target playback device. A dynamic virtual image is displayed in the first preset position area through the external display terminal, and the sound of the virtual image is played through the external playback device. The dynamic virtual image is controlled to move following the user to complete the vehicle-human interaction.

[0140] In one embodiment, when the current interaction scenario is an external vehicle boarding interaction scenario, the display and playback module 20 is further configured to obtain the external display terminal and the internal display terminal through the target display terminal, and obtain the internal playback device through the target playback device. A dynamic virtual image is displayed through the external display terminal, and the user position is obtained according to the user information. When it is determined that the user is boarding based on the user position, the dynamic virtual image is controlled to jump from the external display terminal to the internal display terminal for display, and the sound of the dynamic virtual image is played through the internal playback device to complete the vehicle-human interaction.

[0141] In one embodiment, when the current interaction scenario is an internal vehicle interaction scenario, the display and playback module 20 is further configured to obtain the internal display terminal through the target display terminal, and obtain the internal playback device through the target playback device. A dynamic virtual image is displayed through the internal display terminal, and the sound of the virtual image is played according to the internal playback device. When the vehicle is in the driving process, the driving speed is acquired, and the running speed of the dynamic virtual image is adjusted according to the driving speed.

[0142] In one embodiment, when the vehicle is in a stopped state, the display and playback module 20 is further configured to play interaction information through the internal playback device; receive feedback information of the user based on the interaction information; determine the data to be displayed according to the feedback information; and display the data to be displayed through the internal display terminal.

[0143] The present application provides a vehicle, which includes: a collection device, a plurality of display terminals, and a plurality of playback devices, and the display terminals are installed in different areas of the vehicle;

[0144] The vehicle further includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the human-vehicle interaction method in the first embodiment above.

[0145] Reference is made below to Figure 14 , which shows a schematic structural diagram of a vehicle suitable for implementing the embodiments of the present application. The vehicle in the embodiments of the present application may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions, tablet computers), PMPs (Portable Media Players), in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 14 The vehicle shown is merely an example and should not impose any limitation on the functions and usage scope of the embodiments of the present application.

[0146] As Figure 14As shown, the vehicle may include a processing device 1001 (such as a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to the program stored in the ROM (Read Only Memory) 1002 or the program loaded from the storage device 1003 into the RAM (Random Access Memory) 1004. In the RAM 1004, various programs and data required for vehicle operation are also stored. The processing device 1001, the ROM 1002, and the RAM 1004 are connected to each other through a bus 1005. The input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems may be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, an LCD (Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the vehicle to communicate with other devices wirelessly or wiredly to exchange data. Although the figure shows a vehicle having various systems, it should be understood that it is not required to implement or have all the shown systems. Instead, more or fewer systems may be implemented or had.

[0147] In particular, according to the embodiments disclosed in the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program codes for performing the methods shown in the flowcharts. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device, or installed from the storage device 1003, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above functions defined in the methods of the embodiments disclosed in the present application are executed.

[0148] The vehicle provided by the present application adopts the human-vehicle interaction method in the above embodiments, and can solve the technical problem of poor interactivity between the current user and the vehicle. Compared with the prior art, the beneficial effects of the vehicle provided by the present application are the same as those of the human-vehicle interaction method provided by the above embodiments, and the other technical features in this vehicle are the same as those disclosed in the previous embodiment method, which will not be elaborated here.

[0149] It should be understood that the various parts disclosed in the present application can be implemented by hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in a suitable manner in any one or more embodiments or examples.

[0150] As described above, it is only the specific implementation manner of this application. However, the protection scope of this application is not limited thereto. Any person skilled in the art within the technical scope disclosed by this application can easily think of changes or substitutions, which should all be covered within the protection scope of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims described above.

[0151] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., computer programs) stored thereon, and the computer-readable program instructions are used to execute the human-vehicle interaction method in the above embodiments.

[0152] The computer-readable storage medium provided by this application can be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable Read Only Memory or flash memory), an optical fiber, a CD-ROM (CD-Read Only Memory, portable compact disk read-only memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system, device, or apparatus. The program code contained on the computer-readable storage medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0153] The above computer-readable storage medium can be included in a vehicle; or it can exist separately without being assembled into a vehicle.

[0154] The above computer-readable storage medium carries one or more programs. When the above one or more programs are executed by a vehicle, the vehicle is caused to: collect user information through a collection device and determine a current interaction scenario according to the user information; determine a target display terminal and a target playback device from multiple display terminals and multiple playback devices according to the current interaction scenario; and perform virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete human-vehicle interaction.

[0155] Computer program code for performing the operations of this application can be written in one or more programming languages or combinations thereof. The above-mentioned programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a LAN (Local Area Network) or a WAN (Wide Area Network), or it can be connected to an external computer (for example, by using an Internet service provider to connect through the Internet).

[0156] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in the flowchart or block diagram can represent a module, a program segment, or a part of the code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks can occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0157] The modules described in the embodiments of this application can be implemented in software or in hardware. Among them, the name of the module does not constitute a limitation on the unit itself in some cases.

[0158] The readable storage medium provided by this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., computer programs) for performing the above-mentioned vehicle-human interaction method, and can solve the technical problem of poor interactivity between current users and vehicles. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by this application are the same as those of the vehicle-human interaction method provided in the above embodiments, and will not be elaborated here.

[0159] The present application also provides a computer program product, including a computer program which, when executed by a processor, implements the steps of the above-described vehicle-human interaction method.

[0160] The computer program product provided by the present application can solve the technical problem of poor interactivity between current users and vehicles. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as those of the vehicle-human interaction method provided by the above embodiments, and will not be elaborated herein.

[0161] The above are only partial embodiments of the present application, and thus do not limit the patent scope of the present application. Any equivalent structural transformation made by using the content of the specification and drawings of the present application under the technical concept of the present application, or any direct / indirect application in other related technical fields, is included in the patent protection scope of the present application.

Claims

1. A method for human-vehicle interaction, characterized in that, The described vehicle-human interaction method is applied to a vehicle, which includes: a collection device, a plurality of display terminals, and a plurality of playback devices, and the display terminals are installed in different areas of the vehicle; The vehicle-human interaction method includes: Collecting user information through the collection device and determining the current interaction scenario according to the user information; Determining a target display terminal and a target playback device from the plurality of display terminals and the plurality of playback devices according to the current interaction scenario; Performing virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction.

2. The method according to claim 1, characterized in that, The step of performing virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction includes: When the current interaction scenario is an in-vehicle getting-off interaction scenario, obtaining an in-vehicle display terminal and an out-of-vehicle display terminal through the target display terminal, and obtaining an in-vehicle playback device and an out-of-vehicle playback device through the target playback device; Obtaining the dangerous reminder area of the vehicle; Displaying a virtual image in the dangerous reminder area through the out-of-vehicle display terminal for danger reminder, and playing an opening reminder message through the out-of-vehicle playback device to remind objects outside the vehicle to pay attention to safety; Displaying a virtual image through the in-vehicle display terminal for danger reminder, and playing an opening reminder message through the in-vehicle playback device to remind the user to pay attention to safety when opening the door.

3. The method according to claim 2, wherein The step of displaying a virtual image in the dangerous reminder area through the out-of-vehicle display terminal for danger reminder and playing an opening reminder message through the out-of-vehicle playback device to remind objects outside the vehicle to pay attention to safety includes: Dividing the dangerous reminder area into a static dangerous reminder area and a dynamic dangerous reminder area, the dynamic dangerous area is close to the object outside the vehicle, and the static dangerous area is located behind the dynamic dangerous area; When the object outside the vehicle has not reached the dynamic dangerous area, displaying a dynamic virtual image in the dynamic dangerous area through the out-of-vehicle display terminal for dynamic danger reminder, and at the same time displaying a static warning sign in the static dangerous reminder area for static danger reminder, and playing an opening reminder message through the out-of-vehicle playback device to remind the object outside the vehicle to pay attention to safety.

4. The method according to claim 1, characterized in that The step of performing virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario includes: When the current interaction scenario is that the user approaches the vehicle or moves around the vehicle, obtaining the user position according to the user information; When the user position is in the first preset position area, obtaining an out-of-vehicle display terminal through the target display terminal, and obtaining an out-of-vehicle playback device through the target playback device; Displaying a dynamic virtual image in the first preset position area through the out-of-vehicle display terminal, and playing the sound of the virtual image through the out-of-vehicle playback device; Controlling the dynamic virtual image to move following the user to complete vehicle-human interaction.

5. The method according to claim 1, wherein The steps of performing virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction include: When the current interaction scenario is an out-of-vehicle boarding interaction scenario, obtain an out-of-vehicle display terminal and an in-vehicle display terminal through the target display terminal, and obtain an in-vehicle playback device through the target playback device; Display a dynamic virtual image through the out-of-vehicle display terminal, and obtain the user's position according to the user information; When it is determined that the user is boarding based on the user's position, control the dynamic virtual image to jump from the out-of-vehicle display terminal to the in-vehicle display terminal for display, and play the sound of the dynamic virtual image through the in-vehicle playback device to complete vehicle-human interaction.

6. The method according to claim 1, characterized in that, The steps of performing virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction include: When the current interaction scenario is an in-vehicle interaction scenario, obtain an in-vehicle display terminal through the target display terminal, and obtain an in-vehicle playback device through the target playback device; Display a dynamic virtual image through the in-vehicle display terminal, and play the sound of the virtual image according to the in-vehicle playback device; When the vehicle is in the driving process, obtain the driving speed, and adjust the running speed of the dynamic virtual image according to the driving speed.

7. The method according to claim 6, characterized in that After the step of displaying a dynamic virtual image through the in-vehicle display terminal and playing the sound of the virtual image according to the in-vehicle playback device, it further includes: When the vehicle is in a stopped state, play interactive information through the in-vehicle playback device; Receive feedback information from the user based on the interactive information; Determine the data to be displayed according to the feedback information; Display the data to be displayed through the in-vehicle display terminal.

8. A vehicle-human interaction device, characterized in that, The device includes: A determination module, configured to collect user information through a collection device and determine the current interaction scenario according to the user information; The determination module is further configured to determine a target display terminal and a target playback device from multiple display terminals and multiple playback devices according to the current interaction scenario; A display and playback module, configured to perform virtual image display and information playback through the target display terminal and the target playback device based on the user information and / or the current interaction scenario to complete vehicle-human interaction.

9. A vehicle, characterized in that, The vehicle includes: a collection device, multiple display terminals, and multiple playback devices, and the display terminals are installed in different areas of the vehicle; The vehicle further includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and the computer program is configured to implement the steps of the vehicle-human interaction method according to any one of claims 1 to 7.

10. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium, and when the computer program is executed by a processor, it implements the steps of the vehicle-human interaction method according to any one of claims 1 to 7.

Images