Interaction method and apparatus, and vehicle

Abstract

An interaction method and apparatus, and a vehicle. The method comprises: controlling a first display apparatus of a vehicle to display a virtual avatar associated with an in-vehicle infotainment assistant; acquiring a first instruction, the first instruction instructing a second display apparatus of the vehicle to display the virtual avatar; on the basis of the first instruction, controlling the virtual avatar displayed by the first display apparatus to disappear via a first animation effect; and when or after the virtual avatar displayed by the first display apparatus disappears, controlling the virtual avatar to be displayed on the second display apparatus via a second animation effect. The present technical solution can be applied to the field of vehicle cockpits of intelligent vehicles such as new energy vehicles and electric vehicles. When a virtual avatar is switched between different display apparatuses for display, a user can visually perceive the effect of seamless transition of the virtual avatar between two display apparatuses, thereby improving the level of intelligence of vehicles, and improving the interactive experience of users using in-vehicle infotainment assistants.

Description

Interaction Method, Device and Vehicle

[0001] This application claims the priority of a Chinese patent application with the application number 202411721184.0 and the invention title "Interaction Method, Device and Vehicle" filed with the China National Intellectual Property Administration on November 27, 2024, the entire content of which is incorporated herein by reference. Technical Field

[0002] This application relates to the field of vehicle cockpits, and more specifically, to an interaction method, device and vehicle. Background Art

[0003] In-vehicle voice assistants (or in-vehicle machine assistants) have been widely integrated into in-vehicle machine systems as an important part of improving driving safety and convenience. The in-vehicle machine assistant can provide a human-vehicle interaction method in addition to vision and touch for the driver, and can reduce the driving risks caused by the driver's line-of-sight transfer or touching the screen. With the improvement of the intelligence and networking level of vehicles, vehicle cockpits are gradually developing towards intelligent cockpits with human-machine interaction as the core and multi-screen linkage. Other screens in addition to the central control screen can also provide in-vehicle machine assistant services to enable the in-vehicle machine assistant to meet the entertainment needs of other passengers in the vehicle. For example, the in-vehicle machine assistant can display a series of predefined images according to specific voice commands, gesture actions, etc. to improve the entertainment experience of vehicle users.

[0004] However, in the current technical context, when users in different regions inside the cockpit wake up the in-vehicle machine assistant, the change of the virtual image of the in-vehicle machine assistant is not flexible enough, resulting in a poor interaction experience when users use the in-vehicle machine assistant.

[0005] In view of this, an interaction solution that can improve the interaction experience when users use the in-vehicle machine assistant is urgently needed to be developed. Summary of the Invention

[0006] This application provides an interaction method, device and vehicle. When switching and displaying a virtual image between different display devices, it enables users to feel the visual effect of the virtual image flowing and transferring between the two display devices, which helps to improve the intelligence level of the vehicle and can also improve the interaction experience when users use the in-vehicle machine assistant.

[0007] In a first aspect, an interaction method is provided. This method can be executed by a vehicle. For example, it can be executed by a computing platform of the vehicle, or alternatively, it can also be executed by a chip or circuit for the vehicle.

[0008] The method includes: controlling a first display device of a vehicle to display a virtual image; obtaining a first instruction, the first instruction instructing a second display device of the vehicle to display a virtual image; according to the first instruction, controlling the virtual image displayed on the first display device to disappear with a first animation effect; and controlling the virtual image to display on the second display device with a second animation effect.

[0009] In some implementations, the virtual avatar is the virtual avatar of the vehicle's infotainment system assistant, which can provide users with services such as voice interaction, information inquiry, and vehicle control.

[0010] In some implementations, the first animation effect is a pre-generated and configured video, or the first animation effect can also be a video generated in real time based on the position of the virtual image in the first display device. Controlling the virtual image to disappear with the first animation effect can include controlling the first display device to play the video of the first animation effect.

[0011] In the above technical solution, when a virtual image is displayed on one display device and it is necessary to switch to another display device to use the vehicle assistant, the virtual image is switched between the two display devices through the first and second animation effects. This allows users to experience the visual effect of the virtual image flowing between the two display devices, which helps to improve the intelligence of the vehicle and also improves the user's interactive experience when using the vehicle assistant.

[0012] In conjunction with the first aspect, in some implementations of the first aspect, the first animation effect is the disappearance of the virtual image along the first direction, and the second animation effect is the appearance of the virtual image along the second direction; wherein the first direction and the second direction correspond to the positional relationship between the first display device and the second display device, respectively.

[0013] In the above technical solution, controlling the direction in which the virtual image disappears on the original display device, based on the positional relationship between the original display device and the target display device, helps the user at the original display device to know the location of the target display device; controlling the direction in which the virtual image appears on the target display device helps the user at the target display device to know the location of the original display device. In other words, by controlling the directions of the first and second animation effects, the virtual image can clearly point to the interactive object, enriching the riding experience and alleviating the monotony and fatigue of long journeys.

[0014] In conjunction with the first aspect, in certain implementations of the first aspect, the first direction and the second direction correspond to the positional relationship between the first display device and the second display device, including any of the following: when the first display device is located to the right of the second display device, the first direction and the second direction are directions pointing to the left; when the first display device is located to the left of the second display device, the first direction and the second direction are directions pointing to the right; when the first display device is located directly behind the second display device, the first direction and the second direction are directions pointing upwards; when the first display device is located directly in front of the second display device, the first direction and the second direction are directions pointing downwards; when the first display device is located to the left front of the second display device, the first direction and the second direction are directions pointing to the lower right; when the first display device is located to the right front of the second display device, the first direction and the second direction are directions pointing to the lower left; when the first display device is located to the left rear of the second display device, the first direction and the second direction are directions pointing to the upper right; or, when the first display device is located to the right rear of the second display device, the first direction and the second direction are directions pointing to the upper left.

[0015] In the above technical solution, the directions of the first and second dynamic effects are determined according to the actual position of the display device in the cockpit. When the virtual image needs to switch between different rows of display devices, the visual effect can be formed by flowing display in one or more planes perpendicular to the XOY plane of the vehicle coordinate system, which helps to enhance the technological feel of the dynamic effects associated with the virtual image.

[0016] In conjunction with the first aspect, in certain implementations of the first aspect, the first direction and the second direction correspond to the positional relationship between the first display device and the second display device, including any of the following: when the first display device is the leftmost display device in the Nth row of the vehicle's cabin and the second display device is the rightmost display screen in the Mth row of the cabin, the first direction and the second direction are directions pointing to the left; or, when the first display device is the rightmost display device in the Nth row of the cabin and the second display device is the leftmost display screen in the Mth row of the cabin, the first direction and the second direction are directions pointing to the right; wherein the Nth row and the Mth row of the cabin are two adjacent rows in the cabin.

[0017] In the above technical solution, the display devices in the front and rear rows are regarded as arranged sequentially to the right or sequentially to the left. When the virtual image needs to switch between multiple display devices, the visual effect can be formed as a flowing display in the XOY plane parallel to the vehicle coordinate system. This makes it easier for users to understand the meaning of the relevant dynamic effects, thereby improving the user experience.

[0018] In conjunction with the first aspect, in some implementations of the first aspect, the virtual avatar is associated with the vehicle-mounted assistant to obtain a first instruction, including: when first voice information is detected in the first cockpit area, generating a first instruction based on the first voice information; wherein the first voice information is used to activate the vehicle-mounted assistant, and the first cockpit area is associated with a second display device.

[0019] In some implementations, the first cockpit area is unrelated to the second display device, but the first voice information is related to the second display device. For example, the first cockpit area is the driver's area, the first display device is the central control screen, and the second display device is the second-row right-side display screen. That is, if the user in the driver's area issues a command to display a virtual image on the second-row right-side display screen, the display of the virtual image can be switched from the central control screen to the second-row right-side display screen.

[0020] In the above technical solution, the virtual image can be switched between different display devices in response to the user's voice command, which helps to improve the user's interactive experience when using the vehicle assistant.

[0021] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: controlling the speed of the first motion effect and / or the second motion effect according to the speech rate indicated by the first voice information.

[0022] In some implementations, the speed of the first motion effect and / or the second motion effect can be accelerated as the speech rate indicated by the first voice information increases, and decelerated as the speech rate indicated by the first voice information decreases.

[0023] In the above technical solution, adjusting the speed of the first and / or second animation effects according to the user's speech speed can, on the one hand, improve the vehicle's intelligence and the user's sense of technology, and on the other hand, respond to the user's needs in a timely manner when the user is in a hurry, creating a more efficient and smooth user experience for the vehicle assistant, thereby improving the user's car-using experience.

[0024] In conjunction with the first aspect, in some implementations of the first aspect, obtaining the first instruction includes: when a first touch operation is detected on a virtual image displayed on a first display device, generating a first instruction based on the first touch operation; wherein the first touch operation instructs the virtual image to be moved to a second display device.

[0025] In the above technical solution, the virtual image can be switched between different display devices in response to the user's touch operation on the display device, which helps to improve the user's interactive experience when using the vehicle assistant.

[0026] In conjunction with the first aspect, in some implementations of the first aspect, controlling the virtual image to display on the second display device with a second motion effect includes: when the first display device and the second display device are located in the same row of the vehicle's cabin, controlling the second display device to display the second motion effect when or after the virtual image displayed on the first display device disappears; or, when the first display device and the second display device are located in different rows of the cabin, controlling the second display device to display the second motion effect while the first display device displays the first motion effect.

[0027] In the above technical solution, when the first display device and the second display device are in the same row, controlling the second display device to display the second animation effect when or after the virtual image displayed on the first display device disappears helps the user to better experience the effect of the virtual device transferring from the first display device to the second display device. When the first display device and the second display device are in different rows, the user generally will not pay attention to the screens displayed on the first display device and the second display device at the same time. Therefore, controlling the second display device to display the second animation effect while the first display device displays the first animation effect can shorten the time the user waits to use the vehicle assistant.

[0028] In some implementations, when the first display device and the second display device are located in different rows of the cockpit, the second display device can be controlled to display a second motion effect when or after the virtual image displayed on the first display device disappears.

[0029] In conjunction with the first aspect, in some implementations of the first aspect, the virtual image includes a first form and a second form. The method further includes: according to a first instruction, controlling the first display device to switch from displaying the first form of the virtual image to displaying the second form of the virtual image; controlling the virtual image displayed by the first display device to disappear with a first animation effect, including: controlling the virtual image displayed by the first display device to disappear with a first animation effect in the second form.

[0030] In the above technical solution, when the first animation effect needs to be displayed, the form of the virtual image is switched. This not only prompts the user that the virtual image is about to be displayed on another display device, but also increases the fun of the virtual image switching process, thereby improving the user's entertainment experience while driving.

[0031] In conjunction with the first aspect, in some implementations of the first aspect, controlling the virtual image to be displayed on the second display device with a second motion effect includes: controlling the virtual image to be displayed on the second display device with a second motion effect in a second form; and controlling the second display device to display the first form of the virtual image when the second motion effect is finished.

[0032] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: acquiring a second instruction while acquiring a first instruction, the second instruction instructing a second display device to display a virtual image, and the second instruction being generated in response to a second touch operation on a virtual image displayed on a third display device for a vehicle; controlling the virtual image to be displayed on the second display device with a second animation effect, including: controlling the virtual image to be displayed on the second display device with a second animation effect when the priority of the first instruction is higher than the priority of the second instruction.

[0033] In the above technical solution, when multiple display devices display virtual images, if there is a conflict in the instructions to switch the virtual images to the target display device, the priority of the instructions can be used to determine which display device's virtual image will be switched to the target display device.

[0034] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: executing either of the following according to the first instruction and the second instruction: controlling the virtual image displayed on the third display device to disappear with a third motion effect; or, after controlling the third motion effect displayed on the third display device and the fourth motion effect of the virtual image, maintaining the display of the virtual image.

[0035] In the above technical solution, when multiple display devices display virtual images, if there is a conflict in the instructions controlling the switching of the virtual images to the target display device, the virtual image displayed on one display device can be switched to the target display device, while the remaining display devices continue to display the virtual image; or, when multiple display devices display virtual images, if there is a conflict in the instructions controlling the switching of the virtual images to the target display device, the virtual image can be displayed only on the target display device, visually creating the effect of multiple virtual images being merged and displayed on the target display device, thereby enhancing the sense of technology and fun for users when using the vehicle assistant.

[0036] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: acquiring a third instruction while acquiring the first instruction, the third instruction instructing a fourth display device of the vehicle to display a virtual image; controlling the virtual image to display on the second display device with a second animation effect, including: controlling the virtual image to display on the second display device with a second animation effect when the priority of the first instruction is higher than the priority of the third instruction.

[0037] In the above technical solution, if there are multiple instructions that control the virtual image to switch to different target display devices when a virtual image is displayed on a display device, the specific instruction to be responded to can be determined according to the priority of the instructions in order to switch the virtual image display.

[0038] In some implementations, after controlling the second display device to display the second animation effect, the second display device is then controlled to display a prompt animation effect, which is used to prompt the user corresponding to the fourth display device with waiting information.

[0039] In conjunction with the first aspect, in some implementations of the first aspect, the priority of the first instruction and the priority of the third instruction are determined based on at least one of the following: the positions of the users who triggered the first instruction and the users who triggered the third instruction in the vehicle's cabin; the identity information of the users who triggered the first instruction and the users who triggered the third instruction; or, the speech rate of the voice information indicating the triggering of the first instruction and the triggering of the third instruction.

[0040] In the above technical solution, the priority of the first and third instructions is determined based on one or more of the user's identity information, the speech rate indicated by semantic information, and the location of the user who triggered the instruction. This helps to more accurately determine the urgency of the user who triggered the first instruction and the user who triggered the third instruction for the vehicle assistant, thereby meeting the needs of the user with the more urgent needs.

[0041] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: acquiring a third instruction while acquiring the first instruction, the third instruction instructing a fourth display device of the vehicle to display a virtual image; the method further includes: controlling the virtual image to split into a first virtual image and a second dotted line image; and controlling the first virtual image to be displayed on the second display device with a second animation effect, and controlling the second virtual image to be displayed on the fourth display device with a fifth animation effect.

[0042] In some implementations, the first virtual image is controlled to disappear from the first display device with a first animation effect; the second virtual image is controlled to disappear from the first display device with a sixth animation effect.

[0043] The direction of the fifth and / or sixth motion effects is related to the position between the fourth and first display devices. For a more specific description of the relationship, please refer to the description of the relationship between the first and / or second motion effects and the positions between the first and second display devices, which will not be repeated here.

[0044] In the above technical solution, when a virtual image is displayed on a display device, if an instruction is received to switch the virtual image to multiple different target display devices, the virtual image can be displayed on multiple different target display devices respectively, visually forming the effect of a virtual image split into multiple parts and displayed on multiple target display devices, thereby enhancing the sense of technology and fun for users when using the vehicle assistant.

[0045] In a second aspect, an interactive device is provided, comprising an acquisition unit and a processing unit, wherein the processing unit is configured to: control a first display device of a vehicle to display a virtual image; the acquisition unit is configured to: acquire a first instruction, the first instruction instructing a second display device of the vehicle to display a virtual image; the processing unit is further configured to: according to the first instruction, control the virtual image displayed on the first display device to disappear with a first animation effect; and control the virtual image to be displayed on the second display device with a second animation effect.

[0046] In conjunction with the second aspect, in some implementations of the second aspect, the first animation effect is the disappearance of the virtual image along the first direction, and the second animation effect is the appearance of the virtual image along the second direction; wherein the first direction and the second direction correspond to the positional relationship between the first display device and the second display device, respectively.

[0047] In conjunction with the second aspect, in certain implementations of the second aspect, the first direction and the second direction correspond to the positional relationship between the first display device and the second display device, including any of the following: when the first display device is located to the right of the second display device, the first direction and the second direction are directions pointing to the left; when the first display device is located to the left of the second display device, the first direction and the second direction are directions pointing to the right; when the first display device is located directly behind the second display device, the first direction and the second direction are directions pointing upwards; when the first display device is located directly in front of the second display device, the first direction and the second direction are directions pointing downwards; when the first display device is located to the left front of the second display device, the first direction and the second direction are directions pointing to the lower right; when the first display device is located to the right front of the second display device, the first direction and the second direction are directions pointing to the lower left; when the first display device is located to the left rear of the second display device, the first direction and the second direction are directions pointing to the upper right; or, when the first display device is located to the right rear of the second display device, the first direction and the second direction are directions pointing to the upper left.

[0048] In conjunction with the second aspect, in certain implementations of the second aspect, the first direction and the second direction correspond to the positional relationship between the first display device and the second display device, including any of the following: when the first display device is the leftmost display device in the Nth row of the vehicle's cabin and the second display device is the rightmost display screen in the Mth row of the cabin, the first direction and the second direction are directions pointing to the left; or, when the first display device is the rightmost display device in the Nth row of the cabin and the second display device is the leftmost display screen in the Mth row of the cabin, the first direction and the second direction are directions pointing to the right; wherein the Nth row and the Mth row of the cabin are two adjacent rows in the cabin.

[0049] In conjunction with the second aspect, in some implementations of the second aspect, the virtual image is associated with the vehicle-mounted assistant, and the acquisition unit is used to: generate a first command based on the first voice information when the first voice information is detected in the first cockpit area; wherein the first voice information is used to activate the vehicle-mounted assistant, and the first cockpit area is associated with the second display device.

[0050] In conjunction with the second aspect, in some implementations of the second aspect, the processing unit is further configured to: control the speed of the first motion effect and / or the second motion effect according to the speech rate indicated by the first voice information.

[0051] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition unit is configured to: upon detecting a first touch operation on a virtual image displayed on a first display device, generate a first instruction based on the first touch operation; wherein the first touch operation instructs the virtual image to be moved to a second display device.

[0052] In conjunction with the second aspect, in some implementations of the second aspect, the processing unit is configured to: when the first display device and the second display device are located in the same row of the vehicle's cabin, control the second display device to display a second motion effect when or after the virtual image displayed on the first display device disappears; or, when the first display device and the second display device are located in different rows of the cabin, control the second display device to display a second motion effect while the first display device displays a first motion effect.

[0053] In conjunction with the second aspect, in some implementations of the second aspect, the virtual image includes a first form and a second form, and the processing unit is further configured to: control the first display device to switch from displaying the first form of the virtual image to displaying the second form of the virtual image according to the first instruction; and control the virtual image displayed by the first display device to disappear with a first animation effect in the second form.

[0054] In conjunction with the second aspect, in some implementations of the second aspect, the processing unit is used to: control the virtual image to be displayed on the second display device in the second form with a second motion effect; and when the second motion effect is finished, control the second display device to display the first form of the virtual image.

[0055] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition unit is further configured to: acquire a second instruction while acquiring the first instruction, the second instruction instructing the second display device to display a virtual image, and the second instruction being generated in response to a second touch operation on the virtual image displayed on the third display device for the vehicle; the processing unit is configured to: control the virtual image to be displayed on the second display device with a second animation effect when the priority of the first instruction is higher than the priority of the second instruction.

[0056] In conjunction with the second aspect, in some implementations of the second aspect, the processing unit is further configured to: execute either of the following according to the first instruction and the second instruction: control the virtual image displayed on the third display device to disappear with a third motion effect; or, after controlling the third motion effect displayed on the third display device and the fourth motion effect of the virtual image, maintain the display of the virtual image.

[0057] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition unit is further configured to: acquire a third instruction while acquiring the first instruction, the third instruction instructing the fourth display device of the vehicle to display a virtual image; the processing unit is configured to: control the virtual image to be displayed on the second display device with a second animation effect when the priority of the first instruction is higher than the priority of the third instruction.

[0058] In conjunction with the second aspect, in some implementations of the second aspect, the priority of the first instruction and the priority of the third instruction are determined based on at least one of the following: the positions of the users who triggered the first instruction and the users who triggered the third instruction in the vehicle's cabin; the identity information of the users who triggered the first instruction and the users who triggered the third instruction; or, the speech rate of the voice information indicating the triggering of the first instruction and the triggering of the third instruction.

[0059] Thirdly, an interactive device is provided, the device comprising: a processor for executing a computer program stored in the memory, such that the device performs the method in any possible implementation of the first aspect described above.

[0060] In conjunction with the third aspect, in some implementations of the third aspect, the device also includes a memory.

[0061] Fourthly, a computer program product is provided, comprising: computer program code, which, when executed on a computer or processor, causes the computer or processor to perform the method in any possible implementation of the first aspect.

[0062] It should be noted that the above computer program code can be stored in whole or in part on a storage medium, which can be packaged together with the processor or packaged separately from the processor.

[0063] Fifthly, a computer-readable storage medium is provided, the computer-readable medium storing instructions that, when executed by a processor, cause the processor to implement the method in any possible implementation of the first aspect.

[0064] In a sixth aspect, a chip is provided that includes circuitry for performing the method in any of the possible implementations of the first aspect described above.

[0065] In a seventh aspect, a vehicle is provided that includes means as in any possible implementation of the second to third aspects, or the vehicle includes computer-readable storage as in any possible implementation of the fifth aspect, or the vehicle includes a chip as in any possible implementation of the sixth aspect, or the vehicle is loaded with computer program code as in any possible implementation of the fourth aspect.

[0066] In conjunction with the seventh aspect, in some implementations of the seventh aspect, the vehicle is a vehicle in a broad sense, such as a means of transportation (e.g., commercial vehicles, passenger cars, motorcycles, flying cars, trains, etc.), industrial vehicles (e.g., forklifts, trailers, tractors, etc.), engineering vehicles (e.g., excavators, bulldozers, cranes, etc.), agricultural equipment (e.g., lawnmowers, harvesters, etc.), amusement equipment, toy vehicles, etc. In practical implementation, the vehicle can also be a road vehicle, a water vehicle, an air vehicle, industrial equipment, agricultural equipment, or other intelligent driving equipment such as entertainment equipment.

[0067] For the beneficial effects not described in detail in aspects two through seven, please refer to the description in aspect one, which will not be repeated here. Attached Figure Description

[0068] Figure 1 is a functional block diagram of the vehicle provided in an embodiment of this application;

[0069] Figure 2 is a schematic diagram of a vehicle cabin scenario provided in an embodiment of this application;

[0070] Figure 3 is a schematic flowchart of the interaction method provided in an embodiment of this application;

[0071] Figure 4 is a schematic diagram of the graphical user interface (GUI) provided in an embodiment of this application;

[0072] Figure 5 is another schematic diagram of the GUI provided in the embodiments of this application;

[0073] Figure 6 is another schematic diagram of the GUI provided in the embodiments of this application;

[0074] Figure 7 is another schematic diagram of the GUI provided in the embodiments of this application;

[0075] Figure 8 is another schematic diagram of the GUI provided in the embodiments of this application;

[0076] Figure 9 is another schematic diagram of the GUI provided in the embodiments of this application;

[0077] Figure 10 is another schematic diagram of the GUI provided in the embodiments of this application;

[0078] Figure 11 is another schematic diagram of the GUI provided in the embodiments of this application;

[0079] Figure 12 is a schematic block diagram of the interactive device provided in an embodiment of this application;

[0080] Figure 13 is another schematic block diagram of the interactive device provided in the embodiments of this application. Detailed Implementation

[0081] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0082] Figure 1 is a functional block diagram of a vehicle provided in an embodiment of this application. As shown in Figure 1, the vehicle 100 may include a display device 130 and a computing platform 150. The display device 130 in the cabin is mainly divided into two categories: the first is an in-vehicle display screen; the second is a projection display screen, such as a head-up display (HUD). An in-vehicle display screen is a physical display screen and an important component of the in-vehicle infotainment system. Multiple displays can be installed in the cabin, such as a digital instrument cluster display screen, a central control screen, a display screen in front of the front passenger (also known as the front row passenger), a display screen in front of the left rear passenger, and a display screen in front of the right rear passenger; even the car window can be used as a display screen. A head-up display, also known as a head-up display system, is mainly used to display driving information such as speed and navigation on a display device (e.g., the windshield) in front of the driver. This reduces the driver's eye movement time, avoids pupil changes caused by eye movement, and improves driving safety and comfort. HUDs include, for example, combiner-HUD (C-HUD) systems, windshield-HUD (W-HUD) systems, and augmented reality HUD (AR-HUD) systems.

[0083] Some or all of the functions of vehicle 100 can be controlled by computing platform 150. Computing platform 150 may include processors 151 to 15n. A processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a central processing unit (CPU), microprocessor, graphics processing unit (GPU) (which can be understood as a type of microprocessor), or digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships are fixed or reconfigurable. For example, the processor may be a hardware circuit implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field-programmable gate array (FPGA). In reconfigurable hardware circuits, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement related functions. Furthermore, the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing unit (DPU), etc. In addition, the computing platform 150 may also include a memory for storing instructions. Some or all of the processors 151 to 15n can call the instructions in the memory to implement the corresponding functions.

[0084] Optionally, the structure of the vehicle 100 described above is merely illustrative. In actual applications, various components of the vehicle 100 may be added or removed as needed.

[0085] Figure 2 is a schematic diagram of a vehicle cockpit scenario provided in an embodiment of this application. The smart cockpit is equipped with one or more in-vehicle displays (or in-vehicle screens), including but not limited to display screen 201 (or central control screen), display screen 202 (or passenger entertainment screen), display screen 203 (or driver's headrest rear screen), display screen 204 (or passenger headrest rear screen), display screen 205 (or second-row entertainment screen) mounted on the cockpit ceiling, and an instrument panel. Further, displays 201 to 205 can display a graphical user interface (GUI), which may include icons of one or more applications and / or one or more cards. Exemplarily, the display device 130 shown in Figure 1 can be one or more of displays 201 to 205. In some possible implementations, display screen 201 can also be a long, continuous screen extending to the passenger area. Additionally, display screen 205 can also be a projection screen associated with a projector, which can be associated with a desktop launcher to manage applications projected onto the projection screen.

[0086] As shown in Figure 2, one or more cameras can also be installed in the cockpit to capture images inside or outside the cockpit. These could include cameras from a driver monitor system (DMS), a cabin monitor system (CMS), or a dashcam. The cameras used to capture images inside and outside the cockpit can be the same camera or different cameras. In addition, one or more pressure sensors and acoustic sensors are installed in the cockpit to monitor the presence and location of users.

[0087] It should be understood that the following embodiments are illustrated using a 5-seat vehicle as shown in Figure 2 as an example, and the embodiments of this application are not limited to this. For example, for a 7-seat sport / suburban utility vehicle (SUV), the cabin may include a central control screen, a passenger entertainment screen, a screen behind the driver's headrest, a screen behind the passenger's headrest, entertainment screens in the left-hand area of ​​the third row, and entertainment screens in the right-hand area of ​​the third row. As another example, for a bus, the cabin may include front and rear entertainment screens; or, the cabin may include a display screen in the driver's area and an entertainment screen in the passenger area. Furthermore, the following embodiments are illustrated using a left-hand drive vehicle (i.e., the driver is located on the left side of the vehicle), but in actual implementation, the vehicle may also be a right-hand drive vehicle (i.e., the driver is located on the right side of the vehicle).

[0088] Figure 3 shows a schematic flowchart of an interaction method provided in an embodiment of this application. This method 300 can be executed by the vehicle 100 shown in Figure 1, for example, by one or more processors in a computing platform 150. The method includes:

[0089] S310, the first display device controlling the vehicle displays a virtual image.

[0090] In some implementations, the virtual avatar is a virtual avatar associated with the vehicle's infotainment system.

[0091] S320, Receive first instruction, the first instruction instructs the vehicle's second display device to display a virtual image.

[0092] In some implementations, obtaining the first instruction includes: when first voice information is detected in the first cockpit area, generating a first instruction based on the first voice information; wherein the first voice information is used to activate the vehicle assistant, and the first cockpit area is associated with a second display device. In practical implementation, the speed of the first animation and / or the second animation can also be controlled according to the speech rate indicated by the first voice information. For example, the speed of the first animation and / or the second animation can accelerate as the speech rate indicated by the first voice information increases, and decelerate as the speech rate indicated by the first voice information decreases.

[0093] In some other implementations, obtaining the first instruction includes: generating a first instruction based on the first touch operation when a first touch operation is detected on a virtual image displayed on a first display device; wherein the first touch operation instructs the virtual image to be moved to a second display device.

[0094] S330, according to the first instruction, controls the virtual image displayed on the first display device to disappear with a first animation effect.

[0095] In some implementations, the virtual image includes a first form and a second form. The method further includes: according to a first instruction, controlling the first display device to switch from displaying the first form of the virtual image to displaying the second form of the virtual image; S330 can be further refined as: controlling the virtual image displayed by the first display device to disappear with a first motion effect in the second form.

[0096] S340 controls the virtual image to be displayed on a second display device with a second motion effect.

[0097] In some implementations, the first animation effect is the disappearance of the virtual image along a first direction, and the second animation effect is the appearance of the virtual image along a second direction; wherein the first direction and the second direction correspond to the positional relationship between the first display device and the second display device, respectively.

[0098] In one example, the first direction and the second direction correspond to the positional relationship between the first display device and the second display device, including any of the following: when the first display device is located to the right of the second display device, the first direction and the second direction are directions pointing to the left; when the first display device is located to the left of the second display device, the first direction and the second direction are directions pointing to the right; when the first display device is located directly behind the second display device, the first direction and the second direction are directions pointing upwards; when the first display device is located directly in front of the second display device, the first direction and the second direction are directions pointing downwards; when the first display device is located to the left front of the second display device, the first direction and the second direction are directions pointing to the lower right; when the first display device is located to the right front of the second display device, the first direction and the second direction are directions pointing to the lower left; when the first display device is located to the left rear of the second display device, the first direction and the second direction are directions pointing to the upper right; or, when the first display device is located to the right rear of the second display device, the first direction and the second direction are directions pointing to the upper left.

[0099] In another example, the first direction and the second direction correspond to the positional relationship between the first display device and the second display device, including any of the following: when the first display device is the leftmost display device in the Nth row of the vehicle's cabin and the second display device is the rightmost display screen in the Mth row of the cabin, the first direction and the second direction are directions pointing to the left; or, when the first display device is the rightmost display device in the Nth row of the cabin and the second display device is the leftmost display screen in the Mth row of the cabin, the first direction and the second direction are directions pointing to the right; wherein the Nth row and the Mth row of the cabin are two adjacent rows in the cabin.

[0100] In some implementations, controlling the virtual image to display a second animation effect on a second display device includes: when the first display device and the second display device are located in the same row of the vehicle's cabin, controlling the second display device to display the second animation effect when or after the virtual image displayed on the first display device disappears; or, when the first display device and the second display device are located in different rows of the cabin, controlling the second display device to display the second animation effect while the first display device displays the first animation effect.

[0101] In some implementations, the virtual image includes a first form and a second form. S340 can be further refined as follows: controlling the virtual image to be displayed on the second display device with a second animation effect in the second form; and controlling the second display device to display the first form of the virtual image when the second animation effect is finished.

[0102] The interactive method provided in this application, when a virtual image is displayed on one display device and it is necessary to switch to another display device to use the vehicle assistant, uses a first animation and a second animation to show the switching display of the virtual image between the two display devices. This allows the user to visually perceive the effect of the virtual image flowing between the two display devices, which helps to improve the intelligence level of the vehicle and also enhances the user's interactive experience when using the vehicle assistant.

[0103] To facilitate understanding of the specific implementation of method 300, the application scenarios of the interaction method provided in this application will be explained in detail below with reference to Figures 4 to 11.

[0104] Figure 4 illustrates a schematic diagram of a graphical user interface (GUI) provided in an embodiment of this application. Taking the central control screen and the passenger screen in the vehicle cabin as a single long screen as an example, as shown in Figure 4(a), when the virtual image 401 displayed on the left side of the long screen is detected to be dragged to the right, a fade-out animation can be displayed on the left side of the long screen, and a fade-in animation can be displayed on the right side of the long screen. For example, the fade-out animation can be the sequential display of icons 402-a, 402-b, and 402-c shown in Figure 4(b) to create a visual effect where the virtual image moves from the middle of the left side of the long screen to the right edge of the left side of the long screen and disappears from the right edge of the left side of the long screen. The fade-in animation can be the sequential display of icons 402-d, 402-e, and 402-f shown in Figure 4(b) to create a visual effect where the virtual image appears from the left edge of the right side of the long screen and moves towards the middle of the right side of the long screen. After the fade-in animation finishes displaying, the virtual image displayed in the long screen is as shown in Figure 4(c). That is, the virtual image is no longer displayed on the left side of the long screen, while the virtual image 403 is displayed on the right side. It can be understood that displaying icons 402-a, 402-b, 402-c, 402-d, 402-e, and 402-f as shown in Figure 4(b) sequentially creates the visual effect of the virtual image moving from the center of the left side of the long screen to the center of the right side. Furthermore, icons 402-a, 402-b, and 402-c can be three frames in the fade-out animation, which can also include more frames; icons 402-d, 402-e, and 402-f can be three frames in the fade-in animation, which can also include more frames.

[0105] In some implementations, when the virtual avatar 403 is displayed in the right area of ​​the long screen, upon detecting the driver's voice command "Hello, voice assistant," or upon detecting the virtual avatar being dragged to the left, a fade-out animation can be displayed in the right area of ​​the long screen, and a fade-in animation can be displayed in the left area. In this case, the fade-out animation can be the sequential display of icons 402-f, 402-e, and 402-d as shown in Figure 4(b), creating a visual effect where the virtual avatar moves from the center of the right area of ​​the long screen to the left edge of the right area and disappears from the left edge of the right area. The fade-in animation can be the sequential display of icons 402-c, 402-b, and 402-a as shown in Figure 4(b), creating a visual effect where the virtual avatar appears from the right edge of the left area of ​​the long screen and moves towards the center of the left area.

[0106] It is understandable that the left side of the long screen can be considered an example of the first display device in method 300, the right side of the long screen can be considered an example of the second display device in method 300, the fade-out animation can be considered an example of the first animation in method 300, the direction of movement corresponding to the fade-out animation (i.e., moving to the right) can be considered an example of the first direction, the fade-in animation can be considered an example of the second animation in method 300, and the direction of movement corresponding to the fade-in animation (i.e., moving to the right) can be considered an example of the second direction. Furthermore, virtual avatars 401 and 403 can be considered examples of the first form in method 300, and icons 402-a to 402-f can be considered examples of the second form in method 300.

[0107] It should be noted that Figure 4 uses a long screen as an example for illustration. In actual implementation, the aforementioned animation and interaction methods are also applied between the separately set central control screen and passenger screen, or between the left screen of the second row and the right screen of the second row.

[0108] Figure 4 illustrates an example where the first and second display devices are located in the same row. In some implementations, as shown in Figure 5, if the first display device is the passenger-side screen and the second display device is the right-side screen of the second row, when the voice command "Hello, voice assistant" is detected from the user in the cabin area corresponding to the right-side screen of the second row, the passenger-side screen switches from displaying the virtual image 501 shown in Figure 5(a) to displaying a fade-out animation, and a fade-in animation is displayed on the right-side screen of the second row. For example, the fade-out animation can be the sequential display of icons 502-a and 502-b shown in Figure 5(b) to create a visual effect where the virtual image moves from the middle of the passenger-side screen to the lower edge of the passenger-side screen and disappears from the lower edge of the passenger-side screen. The fade-in animation can be the sequential display of icons 502-c, 502-d, and 502-e shown in Figure 5(c) to create a visual effect where the virtual image falls from the upper edge of the right-side screen of the second row. In this implementation, the fade-in animation can be displayed after the fade-out animation has finished displaying, or the fade-in animation can start displaying before the fade-out animation has finished displaying. After the fade-in animation has finished displaying, the virtual character 503 shown in Figure 5(d) is displayed on the right side of the second row of the screen.

[0109] It is understandable that the fade-out animation can be considered an example of the first animation in method 300, the direction of movement corresponding to the fade-out animation (i.e., moving towards the lower edge of the display device) can be considered an example of the first direction, the fade-in animation can be considered an example of the second animation in method 300, and the direction of movement corresponding to the fade-in animation (i.e., moving towards the lower edge of the display device) can be considered an example of the second direction. Furthermore, virtual avatars 501 and 503 can be considered examples of the first form in method 300, and icons 502-b to 502-e can be considered examples of the second form in method 300.

[0110] Figures 4 and 5 illustrate the relationship between the switching direction of the virtual avatar and the physical position of the display device within the cockpit. In actual implementation, the switching direction of the virtual avatar can also be related to the virtual position of the display device. For example, taking a cockpit with a central control screen, a passenger screen, a second-row left-side screen, and a second-row right-side screen as an example, the virtual position of the aforementioned four display devices can be: the central control screen, passenger screen, second-row left-side screen, and second-row right-side screen are arranged sequentially to the right; or the virtual position of the aforementioned four display devices can also be understood as: the passenger screen, central control screen, second-row right-side screen, and second-row left-side screen are arranged sequentially to the left. That is, when it is necessary to switch from displaying a virtual avatar on the passenger screen to displaying a virtual avatar on the second-row left-side screen, the virtual avatar on the passenger screen can be dragged to the right, and the passenger screen displays a fade-out animation of the virtual avatar to the right, while the second-row left-side screen displays a fade-in animation of the virtual avatar to the left. In some implementations, dragging the virtual avatar on the second-row right-side screen to the right can switch to displaying the virtual avatar on the central control screen.

[0111] For example, as shown in Figure 6(a), when it is detected that the virtual image 601 displayed on the passenger side screen is dragged to the right, the passenger side screen is controlled to display a fade-out animation including icons 602-a, 602-b and 602-c as shown in Figure 6(b), and the left side screen of the second row is controlled to display a fade-in animation including icons 602-d, 602-e and 602-f as shown in Figure 6(c), so that the left side screen of the second row displays the virtual image 603 as shown in Figure 6(d).

[0112] In some implementations, when controlling the display device to switch the display of virtual images based on the aforementioned virtual positional relationship, if the first display device is located to the left of the second display device in the virtual position, the first animation effect can be a fade-out animation effect that sequentially displays icons 602-a, 602-b, and 602-c, and the second animation effect can be a fade-in animation effect that sequentially displays icons 602-d, 602-e, and 602-f. If the first display device is located to the right of the second display device in the virtual position, the first animation effect can be a fade-out animation effect that sequentially displays icons 602-f, 602-e, and 602-d, and the second animation effect can be a fade-in animation effect that sequentially displays icons 602-c, 602-b, and 602-a. It should be noted that there may be no other display devices between the first display device and the second display device. For example, the first display device and the second display device may be the passenger screen and the second-row left-side screen, respectively. Alternatively, there may be one or more display devices between the first display device and the second display device. For example, the first display device and the second display device may be the passenger screen and the second-row right-side screen, respectively.

[0113] In some implementations, when the switching direction of the virtual avatar is related to the virtual position of the display device, if dragging the virtual avatar controls other display devices to display the virtual avatar, the target display device can be determined based on the dragging speed. For example, when the dragging speed is slow, the display device closest to the original display device (i.e., the first display device) can be determined as the target display device (i.e., the second display device); as the dragging speed increases, the virtual distance between the target display device and the original display device increases. For example, if the original display device is the passenger-side screen, then when dragging the virtual device to the right at a slow speed, the target display device can be the second-row left-side screen; if the dragging speed is fast, the target display device can be the second-row right-side screen or the center console screen.

[0114] Figures 4 to 6 above illustrate the example of multiple display devices in the cabin displaying only one virtual image within the same time period. In actual implementation, two or more display devices in the cabin can also display one virtual image each within the same time period. Each virtual image can be associated with a vehicle assistant, meaning that each virtual image can independently respond to a user's operation and provide the corresponding service to that user.

[0115] When two or more display devices among a plurality of display devices can each display a virtual avatar, method 300 may further include: acquiring a second instruction while acquiring a first instruction, the second instruction instructing a second display device to display a virtual avatar, and the second instruction being generated in response to a second touch operation on a virtual avatar displayed on a third display device for a vehicle; controlling the virtual avatar to display on the second display device with a second animation effect, including: controlling the virtual avatar to display on the second display device with a second animation effect when the priority of the first instruction is higher than the priority of the second instruction.

[0116] Furthermore, method 300 may also include: performing either of the following according to the first instruction and the second instruction: controlling the virtual image displayed on the third display device to disappear with a third motion effect; or, after controlling the third motion effect displayed on the third display device and the fourth motion effect of the virtual image, maintaining the display of the virtual image.

[0117] In some implementations, the priority of the first and second instructions can be determined based on at least one of the following: the timing of triggering the first and second instructions; the method of triggering the first and second instructions; the users (i.e., different identities) who trigger the first and second instructions; or, the positions of the users who trigger the first and second instructions in the vehicle cabin. For example, if the triggering time of the first instruction is earlier than the triggering time of the second instruction, then the priority of the first instruction is determined to be higher than the priority of the second instruction; as another example, if the first instruction is triggered based on the user's voice information and the second instruction is triggered based on touch screen operation, then the priority of the first instruction is determined to be higher than the priority of the second instruction; as yet another example, if the first and second instructions are triggered by the user in the driver's area and the user in the passenger's area, respectively, then the priority of the first instruction is higher than the priority of the second instruction; as yet another example, if the first and second instructions are triggered by the vehicle owner and other users, respectively, then the priority of the first instruction is higher than the priority of the second instruction.

[0118] It should be understood that the priority of the first and second instructions can also be determined based on combinations of two or more of the aforementioned factors. For complex scenarios, this allows for a more accurate assessment of the urgency levels of different users. For example, the priority of the two instructions can be determined based on the method of triggering the first and second instructions, as well as the positions of the users triggering them within the vehicle's cabin. More specifically, if the first instruction is triggered by voice input from the passenger in the front passenger seat, and the second instruction is triggered by touchscreen operation from the driver in the front passenger seat, then the second instruction has a higher priority. Furthermore, the priority of instructions can also be determined based on the vehicle's status, combined with the aforementioned priority determination methods. For instance, when the vehicle is in motion, the priority of the instruction can be determined based on the position of the user triggering the instruction within the vehicle's cabin; for example, instructions triggered by the driver in the front passenger seat have a higher priority. When the vehicle is parked, the priority of the instruction can be determined based on the triggering method and the user triggering the instruction; for example, voice-triggered instructions have a higher priority, and instructions triggered by authorized users have a higher priority than those triggered by unauthorized users.

[0119] Regarding the above implementation method, Figure 7 shows a schematic diagram of the GUI that may be involved in this implementation method. As shown in (a) and (c) of Figure 7, the central control screen and the second-row right-side screen display virtual avatar 701 and virtual avatar 701', respectively. When it is detected that virtual avatar 701 is dragged to the right, it can be determined that the user wants to switch virtual avatar 701 to be displayed on the passenger-side screen, and when it is detected that virtual avatar 701' is dragged upward, it can be determined that the user wants to switch virtual avatar 701' to be displayed on the passenger-side screen. For example, when it is detected that virtual avatar 701 is dragged to the right, a fade-out animation effect including icons 702-a, 702-b, and 702-c as shown in Figure 7 (b) can be displayed; when it is detected that virtual avatar 701' is dragged upward, a fade-out animation effect including icons 702-a' and 702-b' as shown in Figure 7 (d) can be displayed, which can create a visual effect that the virtual avatar disappears along the direction towards the upper edge of the display device.

[0120] In one example, if the command generated by dragging virtual avatar 701 to the right conflicts with the command generated by dragging virtual avatar 701' upward, the command generated by dragging virtual avatar 701' upward can be executed to switch virtual avatar 701' to the passenger-side screen. At this time, the passenger-side screen can display the fade-in animation of icons 702-d' and 702-e' as shown in Figure 7(h), and the central control screen displays the animation of icons 702-d1, 702-e1, and 702-f1 as shown in Figure 7(e). It can be understood that when multiple frames of icons including icons 702-d' and 702-e' are displayed in sequence, the visual effect of virtual avatar 701' appearing from the bottom edge of the passenger-side screen can be created. Combined with the fade-out animation shown in Figure 7(d), the visual effect of virtual avatar flying out from the top edge of the second-row right-side screen and flying in from the bottom edge of the passenger-side screen can be created. When the animation of multiple frames of icons including icons 702-d1, 702-e1, and 702-f1 is displayed sequentially, a visual effect can be created where the virtual character 701 is bounced back from the right edge of the central control screen. Combined with the fade-out animation shown in Figure 7(b), a visual effect can be created where the virtual character tries to fly out from the right edge of the central control screen but fails and is bounced back after hitting the wall. In this example, the second-row right-side screen can be considered as an example of the first display device in method 300, the passenger-side screen can be considered as an example of the second display device in method 300, the central control screen can be considered as an example of the third display device in method 300, the command generated by dragging the virtual character 701' upward can be considered as an example of the first command in method 300, and the command generated by dragging the virtual character 701 to the right can be considered as an example of the second command in method 300. The animation associated with Figure 7(b) can be considered as an example of the third animation in method 300, and the animation associated with Figure 7(e) can be considered as an example of the fourth animation in method 300.

[0121] In another example, when the command to drag virtual avatar 701 to the right conflicts with the command to drag virtual avatar 701' upward, the command to drag virtual avatar 701 to the right can also be executed to switch virtual avatar 701 to the passenger-side screen. At this time, the passenger-side screen can display fade-in animations including icons 702-d, 702-e, and 702-f as shown in Figure 7(g), and the second-row right-side screen can display animations including icons 702-c1' and 702-d1' as shown in Figure 7(f). It is understandable that displaying multiple frames of fade-in animations including icons 702-d, 702-e, and 702-f sequentially creates the visual effect of virtual avatar 701 appearing from the left edge of the passenger-side screen. Combined with the fade-out animation shown in Figure 7(b), it creates the visual effect of the virtual avatar flying out from the right edge of the central control screen and flying in from the left edge of the passenger-side screen. When the animation of multiple frames of icons, including icons 702-c1' and 702-d1', is displayed sequentially, a visual effect can be created where the virtual character 701' is bounced back from the upper edge (or a position below the upper edge) of the second-row right-side screen. Combined with the fade-out animation shown in Figure 7(d), a visual effect can be created where the virtual character tries to fly out from the upper edge of the second-row right-side screen but fails and is bounced back after hitting the wall. In this example, the central control screen can be regarded as an example of the first display device in method 300, the passenger screen can be regarded as an example of the second display device in method 300, the second-row right-side screen can be regarded as an example of the third display device in method 300, the command generated by dragging the virtual character 701' to the right can be regarded as an example of the first command in method 300, and the command generated by dragging the virtual character 701' upward can be regarded as an example of the second command in method 300. The motion effect associated with (d) in Figure 7 can be regarded as an example of the third motion effect in method 300, and the motion effect associated with (f) in Figure 7 can be regarded as an example of the fourth motion effect in method 300.

[0122] In some implementations, where two or more display devices can each display a virtual avatar, the colors of the virtual avatars displayed on different display devices can be different. When a second instruction is received simultaneously with a first instruction, the virtual avatars on the first and third display devices can be merged according to the first and second instructions, and the second display device can be controlled to display the merged virtual avatar. For example, the color of the merged virtual avatar can be a new color resulting from mixing the colors of the two virtual avatars before merging. For instance, as shown in Figures 8(a) and (b), the central control screen and the second-row right-side screen display virtual avatars 701-a and 701-a' of different colors, respectively. When virtual avatar 701-a is detected being dragged to the right, it can be determined that the user wants to switch virtual avatar 701-a to be displayed on the passenger-side screen; similarly, when virtual avatar 701-a' is detected being dragged upwards, it can be determined that the user wants to switch virtual avatar 701' to be displayed on the passenger-side screen. For example, when the virtual avatar 701-a is detected to be dragged to the right, a fade-out animation effect including icons 702-a, 702-b, and 702-c as shown in Figure 7(b) can be displayed; when the virtual avatar 701-a' is detected to be dragged upwards, a fade-out animation effect including icons 702-a' and 702-b' as shown in Figure 7(d) can be displayed, which can create a visual effect of the virtual avatar disappearing along the direction towards the upper edge of the display device. Further, after the fade-out animation effects on the central control screen and the second-row right-side screen are displayed, the passenger-side screen can display animation effect 703 as shown in Figure 8(c), which can create a visual effect of the virtual avatar flashing. After animation effect 703 is displayed, the passenger-side screen displays the virtual avatar 704 as shown in Figure 8(d). The color of the virtual avatar 704 can be a color produced by mixing the colors of the virtual avatar 701-a and the virtual avatar 701-a'.

[0123] In some implementations, if only one of the vehicle's multiple display devices displays a virtual image within the same time period, and multiple instructions are received to switch the virtual image to another display device, the target display device can be determined based on the priority of the instructions. Specifically, method 300 may further include: acquiring a third instruction simultaneously with acquiring a first instruction, the third instruction instructing a fourth display device of the vehicle to display the virtual image; controlling the virtual image to display on the second display device with a second animation effect, including: controlling the virtual image to display on the second display device with a second animation effect when the priority of the first instruction is higher than the priority of the third instruction.

[0124] For example, the priority of the first instruction and the priority of the third instruction are determined based on at least one of the following: the positions of the users who triggered the first instruction and the users who triggered the third instruction in the vehicle's cabin; the identity information of the users who triggered the first instruction and the users who triggered the third instruction; or, the speech rate indicated by the voice information that triggered the first instruction and the third instruction.

[0125] Regarding the above implementation method, Figure 9 shows a schematic diagram of the GUI that may be involved in this implementation method. As shown in Figure 9(a), when the virtual avatar 801 displayed on the central control screen is detected to be dragged to the right, a fade-out animation of multiple frames of icons, including icons 802-a, 802-b, and 802-c shown in Figure 9(b), can be displayed on the central control screen. If, at the same time as the virtual avatar 801 displayed on the central control screen is detected to be dragged to the right, the voice command "Hello, voice assistant" from the passenger on the right side of the second row is detected, the virtual avatar 801 can be switched to the passenger-side screen for display, or the virtual avatar 801 can be switched to the right side of the second row screen for display. When it is determined to switch to the passenger-side screen for displaying the virtual avatar, the passenger-side screen can display a fade-in animation of multiple frames of icons, including icons 802-d, 802-e, and 802-f shown in Figure 9(c). When the switch to displaying the virtual avatar on the second-row right-side screen is confirmed, the second-row right-side screen can display a multi-frame fade-in animation of icons, including icons 803-a, 803-b, and 803-c shown in Figure 9(d). It should be understood that when the switch to displaying the virtual avatar on the passenger-side screen is confirmed, the virtual avatar and its related animations are not displayed on the second-row right-side screen; conversely, when the switch to displaying the virtual avatar on the second-row right-side screen is confirmed, the virtual avatar and its related animations are not displayed on the passenger-side screen. The specific screen to which the virtual avatar is displayed can be determined based on the priority of the relevant instructions. The specific implementation of determining the priority of the instructions can be referred to the description in the foregoing embodiments, and will not be repeated here.

[0126] It should be noted that the animation associated with (d) in Figure 9 can be understood as the virtual image moving to the passenger-side screen and then to the second-row right-side screen, but the passenger-side screen does not display the relevant animation. In actual implementation, when the virtual image is switched to the second-row right-side screen, the central control screen does not display the animation associated with (b) in Figure 9. Instead, it displays a fade-out animation of the virtual image moving towards the lower right corner of the central control screen and disappearing from the lower right corner. Correspondingly, the second-row right-side screen does not display the animation associated with (d) in Figure 9. Instead, it displays a fade-out animation of the virtual image appearing from the upper left corner of the second-row right-side screen and moving towards the center of the second-row right-side screen.

[0127] Furthermore, in this implementation, after switching to the second display device to display the virtual avatar, the second display device can display the prompt message "Don't worry, I'll be right there" as shown in Figure 10 and / or related audio information. Alternatively, it can display animations indicating that the virtual avatar is tired in order to soothe the emotions of the user corresponding to the fourth display device. Furthermore, after using the vehicle assistant on the second display device, it can switch to the fourth display device to display the virtual avatar.

[0128] In this implementation, the commands and voice commands triggered by dragging the virtual avatar 801 to the right can be regarded as examples of the first command and the third command in method 300, respectively.

[0129] In some implementations, method 300 may further include: acquiring a third instruction while acquiring a first instruction, the third instruction instructing a fourth display device of the vehicle to display a virtual image; the method further includes: controlling the virtual image to split into a first virtual image and a second dotted line image; and controlling the first virtual image to be displayed on the second display device with a second animation effect, and controlling the second virtual image to be displayed on the fourth display device with a fifth animation effect.

[0130] More specifically, before the first virtual image is displayed on the second display device with a second animation effect, and before the second virtual image is displayed on the fourth display device with a fifth animation effect, the first virtual image is controlled to disappear from the first display device with a first animation effect; and the second virtual image is controlled to disappear from the first display device with a sixth animation effect.

[0131] Regarding the above implementation method, Figure 11 shows a schematic diagram of the GUI that may be involved in this implementation method. As shown in Figure 11(a), when the virtual image 901 displayed on the passenger side screen is detected to be dragged to the right, and the voice command "Hello, voice assistant" from the passenger on the right side of the second row is detected, the virtual image can be split into two virtual images. One virtual image is the virtual image associated with icons 902-a to 902-c shown in Figure 11(b) (hereinafter referred to as virtual image a), and the other virtual image is the virtual image associated with icons 902-a1 to 902-b1 shown in Figure 11(b) (hereinafter referred to as virtual image b). Further, the passenger side screen displays a fade-out animation effect of multiple frames of icons including icons 902-a, 902-b, and 902-c, as well as a fade-out animation effect of multiple frames of icons including icons 902-a1 and 902-b1. After the passenger screen finishes displaying the fade-out animation, the passenger screen and the second-row right-side screen display the fade-in animation respectively. The central control screen displays the fade-in animation of multiple frames of icons, including icons 902-d, 902-e, and 902-f shown in Figure 11(c), while the second-row right-side screen displays the fade-in animation of multiple frames of icons, including icons 902-c1, 902-d1, and 902-e1 shown in Figure 11(d). It is understandable that the fade-out animation of multiple frames of icons, including icons 902-a, 902-b, and 902-c, combined with the fade-in effect associated with (c) in Figure 11, can create the visual effect of virtual image a flying out from the left edge of the passenger screen and flying into the center screen from the right edge; the fade-out animation of multiple frames of icons, including icons 902-a1 and 902-b1, combined with the fade-in effect associated with (d) in Figure 11, can create the visual effect of virtual image b flying out from the bottom edge of the passenger screen and flying into the second-row right-side screen from the top edge.

[0132] In the foregoing embodiments, if the command triggering the switching of the display device displaying the virtual image is a voice command, the speed of the fade-out animation and / or fade-in animation can be controlled according to the speech rate of the voice command. For example, if the preset total display duration of the fade-out and fade-in animations is 0.5 seconds, the total display duration can be shortened as the speech rate of the voice command increases. For instance, when the speech rate of the voice command is fast, the total display duration can be shortened to 0.4 seconds, and when the speech rate of the voice command is even faster, the total display duration can be shortened to 0.3 seconds, or 0.25 seconds, etc.

[0133] Furthermore, the motion effects associated with the aforementioned embodiments can be pre-generated videos comprising multiple frames. When a relevant motion effect needs to be displayed, the display device is controlled to play the video containing that motion effect. In some implementations, the motion effects in the aforementioned embodiments can also be generated in real time. For example, multiple frames can be generated based on the initial position of the virtual image on the display device to represent the virtual image moving from its initial position to its final position on the display device. The final position can be the position of the virtual image in the last frame of the fade-out motion effect displayed on the display device. This final position can be determined based on the positional relationship between the original display device (i.e., the display device currently displaying the virtual image) and the target display device. For example, if the original display device is located to the left of the target display device, the final position can be the right edge of the original display device or a position where the distance to the right edge is less than or equal to a certain threshold.

[0134] It should be noted that the styles of the virtual avatars and animations shown in Figures 4 to 11 are merely illustrative examples. In actual implementation, the virtual avatars can have other styles, and the animations can also be other animations. Furthermore, the display device can also display more or fewer interface elements besides the virtual avatars.

[0135] In the various embodiments of this application, unless otherwise specified or in case of logical conflict, the terminology and / or descriptions between the various embodiments are consistent and can be referenced by each other. Technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.

[0136] The methods provided by the embodiments of this application have been described in detail above with reference to Figures 1 to 11. The apparatus provided by the embodiments of this application will now be described in detail with reference to Figures 12 and 13. It should be understood that the descriptions of the apparatus embodiments correspond to the descriptions of the method embodiments; therefore, any content not described in detail can be found in the above method embodiments, and for the sake of brevity, will not be repeated here.

[0137] Figure 12 shows a schematic block diagram of an interactive device 2000 provided in an embodiment of this application. The device 2000 may include units for executing the methods described in the foregoing embodiments. Furthermore, each unit in the device 2000 implements a corresponding process of the above method embodiments. The device 2000 includes an acquisition unit 2010, which can be used to implement corresponding data acquisition or transmission / reception functions. The device 2000 also includes a processing unit 2020, which can be used to implement corresponding processing functions.

[0138] Optionally, the device 2000 further includes a storage unit, which can be used to store instructions and / or data. The processing unit 2020 can read the instructions and / or data in the storage unit so that the device can perform the relevant actions in the aforementioned method embodiments.

[0139] It should be understood that the specific process of each unit performing the above-mentioned corresponding steps has been described in detail in the above method embodiments, and will not be repeated here for the sake of brevity.

[0140] It should also be understood that the device 2000 described herein is embodied in the form of a functional unit. The terms “module” or “unit” may refer to application-specific ASICs, electronic circuits, processors (e.g., shared processors, proprietary processors, or group processors) and memory for executing one or more software or firmware programs, integrated logic circuits, and / or other suitable components that support the described functions.

[0141] The apparatuses described above are capable of implementing the corresponding steps performed by the computing platform 150 in the methods described above. These functions can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the functions described above; for example, the acquisition unit 2010 can be replaced by a transceiver, and other units, such as processing units, can be replaced by a processor, used to execute the relevant processing operations in each method embodiment.

[0142] Exemplarily, the acquisition unit 2010 and the processing unit 2020 can be disposed in the vehicle 100 shown in FIG. 1. More specifically, the acquisition unit 2010 and the processing unit 2020 can be disposed in the computing platform 150. Exemplarily, the operations performed by the acquisition unit 2010 and the processing unit 2020 can be performed by a single processor, or by different processors. In specific implementation, the one or more processors can be processors disposed in the vehicle 100 shown in FIG. 1; or, the device 2000 can be a chip disposed in the vehicle 100.

[0143] In the specific implementation process, the units in the above device can be fully or partially integrated together, or they can be implemented independently. In one implementation, these units are integrated together and implemented in the form of a system-on-a-chip (SoC).

[0144] Figure 13 is another schematic block diagram of the interactive device provided in an embodiment of this application. The device 2100 shown in Figure 13 may include a processor 2110, a transceiver 2120, and a memory 2130. The processor 2110, transceiver 2120, and memory 2130 are connected via internal connection paths. The memory 2130 is used to store instructions, and the processor 2110 is used to execute the instructions stored in the memory 2130 to implement the methods in the above embodiments. Optionally, the memory 2130 may be coupled to the processor 2110 via an interface or integrated with the processor 2110.

[0145] It should be noted that the transceiver 2120 mentioned above may include, but is not limited to, transceiver devices such as input / output interfaces, to realize communication between device 2100 and other devices or communication networks.

[0146] Memory 2130 can be volatile memory and / or non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM). For example, RAM can be used as an external cache. By way of example and not limitation, RAM includes various forms such as: static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).

[0147] Transceiver 2120 uses transceiver devices, such as but not limited to transceivers, to enable communication between device 2100 and other devices or communication networks to receive / send data / information for implementing the methods in the above embodiments.

[0148] This application also provides an intelligent driving device, which includes the device 2000 or device 2100 in the above embodiments.

[0149] This application also provides a computer program product, which includes computer program code. When the computer program code is run on a computer, it causes the computer to implement the methods described in the above embodiments of this application.

[0150] This application also provides a computer-readable storage medium storing computer instructions that, when executed on a computer, cause the computer to implement the methods described in the above embodiments of this application.

[0151] This application also provides a chip, including circuitry, for performing the methods described in the above embodiments of this application.

[0152] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0153] In the description of the embodiments of this application, unless otherwise stated, " / " means "or", for example, A / B can mean A or B; "and / or" in this document describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. In this application, "at least one" means one or more, and "more" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0154] The use of prefixes such as "first" and "second" in this application embodiment is solely for distinguishing different descriptive objects and does not limit the position, order, priority, quantity, or content of the described objects. The use of ordinal numbers and other prefixes to distinguish descriptive objects in this application embodiment does not constitute a limitation on the described objects. The description of the described objects is found in the claims or the context of the embodiments, and the use of such prefixes should not constitute unnecessary restrictions.

[0155] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0156] In the various embodiments of this application, unless otherwise specified or in case of logical conflict, the terminology and / or descriptions between the various embodiments are consistent and can be referenced by each other. Technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.

[0157] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0158] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0159] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An interaction method, characterized in that, include: The primary display device controlling the vehicle shows a virtual image; A first instruction is obtained, which instructs the second display device of the vehicle to display the virtual image; According to the first instruction, the virtual image displayed on the first display device is controlled to disappear with a first animation effect; And control the virtual image to display it on the second display device with a second animation effect.

2. The method according to claim 1, characterized in that, The first animation effect is that the virtual image disappears along a first direction, and the second animation effect is that the virtual image appears along a second direction; The first direction and the second direction correspond to the positional relationship between the first display device and the second display device, respectively.

3. The method according to claim 2, characterized in that, The first direction and the second direction correspond to the positional relationship between the first display device and the second display device, including any one of the following: When the first display device is located to the right of the second display device, the first direction and the second direction are pointing to the left. When the first display device is located to the left of the second display device, the first direction and the second direction are pointing to the right. When the first display device is located directly behind the second display device, the first direction and the second direction are upward directions; When the first display device is located directly in front of the second display device, the first direction and the second direction are downward directions; When the first display device is located to the left front of the second display device, the first direction and the second direction are pointing to the lower right side; When the first display device is located to the right front of the second display device, the first direction and the second direction are pointing to the lower left side; When the first display device is located to the left rear of the second display device, the first direction and the second direction are pointing towards the upper right; or... When the first display device is located to the right rear of the second display device, the first direction and the second direction are pointing to the upper left.

4. The method according to claim 2 or 3, characterized in that, The first direction and the second direction correspond to the positional relationship between the first display device and the second display device, including any one of the following: When the first display device is the leftmost display device in the Nth row of the vehicle's cabin, and the second display device is the rightmost display screen in the Mth row of the cabin, the first direction and the second direction are directions pointing to the left; or, When the first display device is the rightmost display device in the Nth row of the cockpit, and the second display device is the leftmost display screen in the Mth row of the cockpit, the first direction and the second direction are directions pointing to the right. Wherein, the N row and the M row of the cabin are two adjacent rows in the cabin.

5. The method according to any one of claims 1 to 4, characterized in that, The virtual avatar is associated with the vehicle's infotainment system assistant, and the step of obtaining the first instruction includes: When the first voice information is detected in the first cockpit area, the first instruction is generated based on the first voice information; The first voice information is used to activate the vehicle assistant, and the first cockpit area is associated with the second display device.

6. The method according to claim 5, characterized in that, The method further includes: The speed of the first motion effect and / or the second motion effect is controlled according to the speech rate indicated by the first voice information.

7. The method according to any one of claims 1 to 6, characterized in that, The acquisition of the first instruction includes: Upon detecting a first touch operation on the virtual image displayed on the first display device, the first instruction is generated based on the first touch operation; The first touch operation instruction moves the virtual image to the second display device.

8. The method according to any one of claims 1 to 7, characterized in that, The control of displaying the virtual image with a second animation effect on the second display device includes: When the first display device and the second display device are located in the same row of the vehicle's cabin, the second display device is controlled to display the second animation effect when or after the virtual image displayed on the first display device disappears; or, When the first display device and the second display device are located in different rows of the cockpit, the second display device is controlled to display the second animation effect while the first display device displays the first animation effect.

9. The method according to any one of claims 1 to 8, characterized in that, The virtual avatar includes a first form and a second form, and the method further includes: According to the first instruction, the first display device is controlled to switch from displaying the first form of the virtual image to displaying the second form of the virtual image; The control of the virtual image displayed on the first display device to disappear with a first animation effect includes: The virtual image displayed on the first display device is controlled to disappear in the second form with the first animation effect.

10. The method according to claim 9, characterized in that, The control of displaying the virtual image with a second animation effect on the second display device includes: Control the virtual image to be displayed on the second display device in the second form with the second animation effect; And when the second animation effect is finished, control the second display device to display the first form of the virtual image.

11. The method according to any one of claims 1 to 10, characterized in that, The method further includes: Simultaneously with acquiring the first instruction, a second instruction is acquired, the second instruction instructing the second display device to display the virtual image, and the second instruction is generated in response to a second touch operation on the virtual image displayed on the third display device of the vehicle; The control of displaying the virtual image with a second animation effect on the second display device includes: When the priority of the first instruction is higher than that of the second instruction, the virtual image is controlled to be displayed on the second display device with the second animation effect.

12. The method according to claim 11, characterized in that, The method further includes: Execute any one of the following according to the first instruction and the second instruction: The virtual image displayed on the third display device disappears with a third animation effect; or, After controlling the third animation effect and the fourth animation effect of the virtual image displayed by the third display device, the virtual image is kept displayed.

13. The method according to any one of claims 1 to 10, characterized in that, The method further includes: While acquiring the first instruction, a third instruction is acquired, which instructs the vehicle's fourth display device to display the virtual image; The control of displaying the virtual image with a second animation effect on the second display device includes: When the priority of the first instruction is higher than that of the third instruction, the virtual image is controlled to be displayed on the second display device with a second animation effect.

14. The method according to claim 13, characterized in that, The priority of the first instruction and the priority of the third instruction are determined according to at least one of the following: The locations of the users who triggered the first instruction and the users who triggered the third instruction within the vehicle's cabin; The identity information of the users who triggered the first instruction and the third instruction; or, The speech rate indicated by the voice information that triggers the first instruction and the third instruction.

15. An interactive device, characterized in that, include: The processing unit is used to control the vehicle's first display device to display a virtual image; An acquisition unit is configured to acquire a first instruction, the first instruction instructing a second display device of the vehicle to display the virtual image; The processing unit is further configured to: control the virtual image displayed by the first display device to disappear with a first animation effect according to the first instruction; And control the virtual image to display it on the second display device with a second animation effect.

16. The apparatus according to claim 15, characterized in that, The first animation effect is that the virtual image disappears along a first direction, and the second animation effect is that the virtual image appears along a second direction; The first direction and the second direction correspond to the positional relationship between the first display device and the second display device, respectively.

17. The apparatus according to claim 16, characterized in that, The first direction and the second direction correspond to the positional relationship between the first display device and the second display device, including any one of the following: When the first display device is located to the right of the second display device, the first direction and the second direction are pointing to the left. When the first display device is located to the left of the second display device, the first direction and the second direction are pointing to the right. When the first display device is located directly behind the second display device, the first direction and the second direction are upward directions; When the first display device is located directly in front of the second display device, the first direction and the second direction are downward directions; When the first display device is located to the left front of the second display device, the first direction and the second direction are pointing to the lower right side; When the first display device is located to the right front of the second display device, the first direction and the second direction are pointing to the lower left side; When the first display device is located to the left rear of the second display device, the first direction and the second direction are pointing towards the upper right; or... When the first display device is located to the right rear of the second display device, the first direction and the second direction are pointing to the upper left.

18. The apparatus according to claim 16 or 17, characterized in that, The first direction and the second direction correspond to the positional relationship between the first display device and the second display device, including any one of the following: When the first display device is the leftmost display device in the Nth row of the vehicle's cabin, and the second display device is the rightmost display screen in the Mth row of the cabin, the first direction and the second direction are directions pointing to the left; or, When the first display device is the rightmost display device in the Nth row of the cockpit, and the second display device is the leftmost display screen in the Mth row of the cockpit, the first direction and the second direction are directions pointing to the right. Wherein, the N row and the M row of the cabin are two adjacent rows in the cabin.

19. The apparatus according to any one of claims 15 to 18, characterized in that, The virtual avatar is associated with the vehicle's infotainment system assistant, and the acquisition unit is used for: When the first voice information is detected in the first cockpit area, the first instruction is generated based on the first voice information; The first voice information is used to activate the vehicle assistant, and the first cockpit area is associated with the second display device.

20. The apparatus according to claim 19, characterized in that, The processing unit is also used for: The speed of the first motion effect and / or the second motion effect is controlled according to the speech rate indicated by the first voice information.

21. The apparatus according to any one of claims 15 to 20, characterized in that, The acquisition unit is used for: Upon detecting a first touch operation on the virtual image displayed on the first display device, the first instruction is generated based on the first touch operation; The first touch operation instruction moves the virtual image to the second display device.

22. The apparatus according to any one of claims 15 to 21, characterized in that, The processing unit is used for: When the first display device and the second display device are located in the same row of the vehicle's cabin, the second display device is controlled to display the second animation effect when or after the virtual image displayed on the first display device disappears; or, When the first display device and the second display device are located in different rows of the cockpit, the second display device is controlled to display the second animation effect while the first display device displays the first animation effect.

23. The apparatus according to any one of claims 15 to 22, characterized in that, The virtual image includes a first form and a second form, and the processing unit is further configured to: According to the first instruction, the first display device is controlled to switch from displaying the first form of the virtual image to displaying the second form of the virtual image; The virtual image displayed on the first display device is controlled to disappear in the second form with the first animation effect.

24. The apparatus according to claim 23, characterized in that, The processing unit is used for: Control the virtual image to be displayed on the second display device in the second form with the second animation effect; And when the second animation effect is finished, control the second display device to display the first form of the virtual image.

25. The apparatus according to any one of claims 15 to 24, characterized in that, The acquisition unit is also used for: Simultaneously with acquiring the first instruction, a second instruction is acquired, the second instruction instructing the second display device to display the virtual image, and the second instruction is generated in response to a second touch operation on the virtual image displayed on the third display device of the vehicle; The processing unit is used for: When the priority of the first instruction is higher than that of the second instruction, the virtual image is controlled to be displayed on the second display device with the second animation effect.

26. The apparatus according to claim 25, characterized in that, The processing unit further includes: Execute any one of the following according to the first instruction and the second instruction: The virtual image displayed on the third display device disappears with a third animation effect; or, After controlling the third animation effect and the fourth animation effect of the virtual image displayed by the third display device, the virtual image is kept displayed.

27. The apparatus according to any one of claims 15 to 24, characterized in that, The acquisition unit is also used for: While acquiring the first instruction, a third instruction is acquired, which instructs the vehicle's fourth display device to display the virtual image; The processing unit is used for: When the priority of the first instruction is higher than that of the third instruction, the virtual image is controlled to be displayed on the second display device with a second animation effect.

28. The apparatus according to claim 27, characterized in that, The priority of the first instruction and the priority of the third instruction are determined according to at least one of the following: The locations of the users who triggered the first instruction and the users who triggered the third instruction within the vehicle's cabin; The identity information of the users who triggered the first instruction and the third instruction; or, The speech rate indicated by the voice information that triggers the first instruction and the third instruction.

29. An interactive device, characterized in that, include: A processor for executing a computer program stored in memory to cause the apparatus to perform the method as described in any one of claims 1 to 14.

30. A computer-readable storage medium, characterized in that, It stores instructions that, when executed by a processor, implement the method as described in any one of claims 1 to 14.

31. A chip, characterized in that, The chip includes circuitry for performing the method as described in any one of claims 1 to 14.

32. A computer program product, characterized in that, The computer program product includes: computer program code, which, when executed by a processor, implements the method as described in any one of claims 1 to 14.

33. A vehicle, characterized in that, It includes at least two display devices, and the device as claimed in any one of claims 15 to 29, or the computer-readable storage medium as claimed in claim 30, or the chip as claimed in claim 31, or the vehicle is equipped with the computer program product as claimed in claim 32.

Images