Interaction method and apparatus, and vehicle

Abstract

Provided in the present application are an interaction method and apparatus, and a vehicle, which can be applied to the field of intelligent cabins. The method comprises: acquiring an unfolded size of a screen in a cabin; and during the process in which the unfolded size of the screen changes from a first unfolded size to a second unfolded size, controlling an interface element on the screen to move in a first direction from a first position to a second position, wherein the first direction is associated with a size change direction of the screen. The present application is applicable to an intelligent vehicle or an electric vehicle, and adapts a position change of an interface element by means of an unfolding process of a screen, thereby facilitating an improvement in the enjoyment and riding experience of a user during the unfolding process of the screen.

Description

Interaction methods, devices and vehicles

[0001] This application, application number 202510336638.0, entitled "Invention Name," is to be filed with the China National Intellectual Property Administration on March 19, 2025.

[0002] Priority is claimed in the Chinese patent application entitled “Interactive Method, Apparatus and Vehicle”, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of smart cockpits, and more specifically, to an interaction method, device, and vehicle. Background Technology

[0004] With the increasing number of displays in vehicles, screens, which can be unfolded and retracted, are becoming increasingly popular among users. However, currently, when a screen is unfolded, the projection device does not project onto the screen, resulting in a black screen for the user. This leads to a poor user experience while waiting for the screen to unfold. Summary of the Invention

[0005] This application provides an interaction method, device, and vehicle that adapts to changes in the position of interface elements during the screen unfolding process, thereby enhancing the user's enjoyment and driving experience during screen unfolding.

[0006] In a first aspect, an interaction method is provided, the method comprising: obtaining the unfolded size of a first screen in the cockpit; and controlling a first interface element on the first screen to move from a first position to a second position along a first direction during the process of the unfolded size of the first screen changing from a first unfolded size to a second unfolded size; wherein the first direction is associated with the direction of size change of the first screen.

[0007] Based on the above technical solution, during the screen's expansion and resizing process, the direction of the screen's size change is adapted to the direction of the interface elements' positional movement. This ensures that users can see the positional changes of interface elements during screen size changes, rather than seeing a black screen, thus improving the user's visual experience. Simultaneously, by adapting the screen's expansion and resizing to the positional changes of interface elements, users experience the visual effect of interface elements moving with the screen's size, enhancing user engagement and driving experience.

[0008] In some possible implementations, the first direction is associated with the direction of size change of the first screen, including: the angle between the first direction and the direction of size change of the first screen is less than or equal to a preset angle.

[0009] In some possible implementations, the first direction is the same as the direction of size change of the first screen.

[0010] In some possible implementations, the first direction is the direction from the first position to the second position.

[0011] In some possible implementations, the first unfolded size is smaller than the second unfolded size. At this point, the first screen is in the process of unfolding.

[0012] In some possible implementations, the first unfolded size is larger than the second unfolded size. At this time, the first screen is in the process of collapsing.

[0013] In conjunction with the first aspect, in some implementations of the first aspect, the first edge of the first screen changes along the direction of size change, and during the process of the unfolded size of the first screen changing from the first unfolded size to the second unfolded size, the distance between the position of the first interface element and the first edge is less than or equal to a preset distance.

[0014] Based on the above technical solution, the position of the first interface element can be less than or equal to a preset distance from the first edge of the first screen. This ensures that the positional changes of the interface elements seen by the user are more closely aligned with the positional changes of the first edge, which helps to enhance the fun and driving experience during the unfolding of the first screen.

[0015] In some possible implementations, the first screen is a curtain, and the first side is the bottom edge of the curtain.

[0016] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: controlling the animation effects of the first interface elements according to the unfolded size of the first screen.

[0017] Based on the above technical solution, the animation effects of the first interface elements can be controlled according to the unfolded size of the first screen. This allows users to experience the visual effect of interface elements moving as the screen size changes, while also experiencing animation effects adapted to the unfolded size of the first screen, further enhancing user enjoyment and the overall driving experience.

[0018] In conjunction with the first aspect, in certain implementations of the first aspect, controlling the animation effects of the first interface elements according to the unfolded size of the first screen includes: during the unfolding of the first screen, in response to detecting that the unfolded size of the first screen is less than or equal to a first preset size, controlling the first interface element to display an entrance animation effect; or, during the unfolding of the first screen, in response to detecting that the unfolded size of the first screen is greater than or equal to a second preset size, controlling the first interface element to display an exit animation effect; or, during the collapsing of the first screen, in response to detecting that the unfolded size of the first screen is greater than or equal to a second preset size, controlling the first interface element to display an entrance animation effect; or, during the collapsing of the first screen, in response to detecting that the unfolded size of the first screen is less than or equal to a first preset size, controlling the first interface element to display an exit animation effect; wherein the first preset size is less than the second preset size.

[0019] Based on the above technical solution, during the unfolding or collapsing of the first screen, the appearance or exit animation effects of interface elements can be controlled based on the relationship between the unfolded size of the first screen and the preset size. In this way, the exit animation effect allows the user to experience the first screen beginning to unfold and collapse; the exit animation effect allows the user to experience the first screen about to complete unfolding or collapsing, helping to enhance user engagement and driving experience.

[0020] In conjunction with the first aspect, in some implementations of the first aspect, the animation effects of the first interface elements are controlled according to the unfolded size of the first screen, including: controlling the animation effects of the first interface elements according to the unfolded size of the first screen and the data collected by the sensor.

[0021] Based on the above technical solution, the animation effects of the first interface elements can be controlled by combining the unfolded size of the first screen and the data collected by the sensors. By adapting the animation effects of the interface elements to the unfolded size and the data collected by the sensors, users can experience animation effects that are appropriate for the current scene, thus improving the user's visual experience.

[0022] In some possible implementations, the animation effects of the first interface elements are controlled based on the unfolded size of the first screen and the data collected by the sensors, including: controlling the animation effects of the first interface elements based on the unfolded size of the first screen and the data collected by the camera outside the cockpit.

[0023] In some possible implementations, the animation effects of the first interface elements are controlled based on the unfolded size of the first screen and the data collected by the camera outside the cockpit, including: determining the current scene of the vehicle (e.g., forest, seaside, beach, highway) based on the data collected by the camera outside the cockpit; and controlling the animation effects of the first interface elements based on the current scene of the vehicle and the unfolded size of the first screen.

[0024] In some possible implementations, the animation effects of the first interface elements are controlled based on the unfolded size of the first screen and the data collected by the sensors, including: controlling the animation effects of the first interface elements based on the unfolded size of the first screen and the data collected by the cameras in the cockpit.

[0025] In some possible implementations, the animation effects of the first interface elements are controlled based on the unfolded size of the first screen and the data collected by the camera in the cockpit, including: determining the user's state based on the data collected by the camera in the cockpit; and controlling the animation effects of the first interface elements based on the unfolded size of the first screen and the user's state.

[0026] In conjunction with the first aspect, in some implementations of the first aspect, controlling the animation effect of the first interface element based on the unfolded size of the first screen and the data collected by the sensor includes: when the unfolded size of the first screen is a third unfolded size, generating a model with the third unfolded size and data input content to obtain information on the animation effect of the first interface element and the display area of ​​the animation effect; wherein, the method further includes: controlling a third display area on the first screen to display the animation effect of the first interface element based on the information on the display area of ​​the animation effect, wherein the third display area is the display area of ​​the first screen under the third unfolded size.

[0027] Based on the above technical solution, the unfolded size of the first screen and the data collected by the sensors can be input into the content generation model to obtain information about the animation effects of the first interface elements and the display area of ​​the animation effects. In this way, animation effects can be generated through the content generation model, allowing the animation effects of interface elements to be rendered in real time. Users can experience different animation effects in different scenarios, which helps to improve the user's visual and driving experience.

[0028] In some possible implementations, the sensor is an in-cabin sensor, and the display area of ​​the animation effect is associated with the user's position in the cabin.

[0029] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: controlling the animation effects of the first interface elements based on the content displayed on the second screen inside the cockpit.

[0030] Based on the above technical solution, the animation effects of the first interface elements on the first screen can be controlled based on the content displayed on other screens in the cockpit. This allows users in front of the first screen to experience the content displayed on other screens through the animation effects of the first interface elements, thus enhancing the user's visual and driving experience.

[0031] In conjunction with the first aspect, in some implementations of the first aspect, the content displayed on the second screen includes the content displayed by the navigation application. Based on the content displayed on the second screen in the cockpit, the animation effect of the first interface element is controlled, including: when the content displayed by the navigation application indicates that the current vehicle is in a congested road section, the animation effect of the first interface element is controlled to be a first animation effect; or, when the content displayed by the navigation application indicates that the current vehicle is in a non-congested road section, the animation effect of the first interface element is controlled to be a second animation effect.

[0032] Based on the above technical solution, when the navigation application displayed on the second screen indicates whether the vehicle is in a congested or non-congested area, different animation effects can be displayed on the first interface elements on the first screen. This allows rear passengers in the cabin to intuitively perceive the road congestion situation through the animation effects of the first interface elements, helping to improve the user's visual and driving experience.

[0033] In conjunction with the first aspect, in some implementations of the first aspect, the content displayed on the second screen includes the display content of a music application. Based on the content displayed on the second screen in the cockpit, the animation effect of the first interface element is obtained, including: when the display content of the music application indicates that a first type of music is to be played, controlling the animation effect of the first interface element to be a third animation effect; or, when the display content of the music application indicates that a second type of music is to be played, controlling the animation effect of the first interface element to be a fourth animation effect.

[0034] Based on the above technical solution, when the music application displayed on the second screen indicates the playback of the first type of music and the second type of music, different animation effects can be displayed on the first interface elements on the first screen. This allows the interface elements to be adapted to the type of music, enabling rear passengers in the cabin to be encouraged to move their bodies along with the music through the animation effects (e.g., rhythmic effects) of the first interface elements, thus enhancing user enjoyment and the driving experience.

[0035] In conjunction with the first aspect, in some implementations of the first aspect, controlling a first interface element on the first screen to move from a first position to a second position along a first direction includes: controlling the first screen to display a plurality of first interface elements that have moved from the first position to the second position; wherein the transparency of the plurality of first interface elements gradually decreases along the first direction.

[0036] Based on the above technical solution, multiple first interface elements can be displayed as the first interface element moves from a first position to a second position. By gradually decreasing the transparency of multiple first interface elements, users can clearly understand the direction of the screen's size change through the process of the transparency changes of multiple interface elements.

[0037] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: obtaining information about obstacles around the first screen; when the information about the obstacles meets preset conditions, controlling the first screen to stop unfolding and controlling the first interface elements to display a fifth animation effect according to the type of obstacle.

[0038] Based on the above technical solution, when the first screen encounters an obstacle, the animation effects of the first interface elements can be controlled according to the type of obstacle. This makes the animation effects of the interface elements more closely resemble the current scene.

[0039] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: when the unfolded size of the first screen is at a second unfolded size, obtaining input from the user in front of the first screen; controlling the position movement of the first interface element based on the input, and / or controlling the animation effect of the first interface element to display a sixth animation effect.

[0040] Based on the above technical solution, interface elements can also move according to user input. This can enhance the fun of human-computer interaction during changes in the size of the first screen.

[0041] In some possible implementations, the user's input is a gesture input from the user toward a third direction, the direction from the second position to the third position matching the third direction.

[0042] In some possible implementations, the first screen is in the process of unfolding, the user's input is a gesture input from the user towards a third direction, and the sixth animation effect is the movement of the position of the first interface element, such as first moving from the second position to the fifth position, and then free-falling from the fifth position to the sixth position. The direction from the second position to the fifth position matches the third direction, and the direction from the fifth position to the sixth position matches the unfolding direction of the first screen.

[0043] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: obtaining a first interface element from multiple interface elements based on information of the user in front of the first screen.

[0044] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: obtaining the positions of a first user and a second user in the cockpit in front of the first screen; wherein controlling a first interface element on the first screen to move from a first position to a second position along a first direction includes: controlling a first interface element in a first display area to move from a first position to a second position along the first direction and controlling a second interface element in a second display area to move from a third position to a fourth position along a second direction; wherein the second direction is associated with the direction of size change of the first screen, the first display area is associated with the position of the first user, and the second display area is associated with the position of the second user.

[0045] Based on the above technical solution, when multiple users are in front of the first screen, multiple interface elements can be displayed on the first screen, and the display area of ​​each interface element is associated with the user's location. This can improve the visual effect and driving experience for multiple users in the cockpit.

[0046] Secondly, this application provides an interactive device, which includes: an acquisition unit for acquiring the unfolded size of a first screen in the cockpit; and a control unit for controlling a first interface element on the first screen to move from a first position to a second position along a first direction during the process of the unfolded size of the first screen changing from a first unfolded size to a second unfolded size; wherein the first direction is associated with the direction of size change of the first screen.

[0047] In conjunction with the second aspect, in some implementations of the second aspect, the first edge of the first screen changes along the direction of size change, and during the process of the unfolded size of the first screen changing from the first unfolded size to the second unfolded size, the distance between the position of the first interface element and the first edge is less than or equal to a preset distance.

[0048] In conjunction with the second aspect, in some implementations of the second aspect, the control unit is also used to control the animation effects of the first interface elements according to the unfolded size of the first screen.

[0049] In conjunction with the second aspect, in some implementations of the second aspect, the control unit is configured to: during the unfolding of the first screen, in response to the unfolded size of the first screen being less than or equal to a first preset size, control the first interface element to display an animation effect of appearing; or, during the unfolding of the first screen, in response to the unfolded size of the first screen being greater than or equal to a second preset size, control the first interface element to display an animation effect of exiting; or, during the collapsing of the first screen, in response to the unfolded size of the first screen being greater than or equal to a second preset size, control the first interface element to display an animation effect of appearing; or, during the collapsing of the first screen, in response to the unfolded size of the first screen being less than or equal to a first preset size, control the first interface element to display an animation effect of exiting; wherein the first preset size is less than the second preset size.

[0050] In conjunction with the second aspect, in some implementations of the second aspect, the control unit is used to: control the animation effects of the first interface elements based on the unfolded size of the first screen and the data collected by the sensor.

[0051] In conjunction with the second aspect, in some implementations of the second aspect, the control unit is configured to: when the unfolded size of the first screen is the third unfolded size, generate a model using the third unfolded size and data input content to obtain information on the animation effect of the first interface element and the display area of ​​the animation effect; and control the third display area on the first screen to display the animation effect of the first interface element based on the information on the display area of ​​the animation effect, wherein the third display area is the display area of ​​the first screen under the third unfolded size.

[0052] In conjunction with the second aspect, in some implementations of the second aspect, the control unit is also used to control the animation effects of the first interface elements based on the content displayed on the second screen in the cockpit.

[0053] In conjunction with the second aspect, in some implementations of the second aspect, the content displayed on the second screen includes the display content of the navigation application, and the control unit is used to: control the animation effect of the first interface element to a first animation effect when the display content of the navigation application indicates that the current vehicle is in a congested road section; or, control the animation effect of the first interface element to a second animation effect when the display content of the navigation application indicates that the current vehicle is in a non-congested road section.

[0054] In conjunction with the second aspect, in some implementations of the second aspect, the content displayed on the second screen includes the display content of a music application, and the control unit is configured to: control the animation effect of the first interface element to a third animation effect when the display content of the music application indicates that a first type of music should be played; or, control the animation effect of the first interface element to a fourth animation effect when the display content of the music application indicates that a second type of music should be played.

[0055] In conjunction with the second aspect, in some implementations of the second aspect, the control unit is used to: control the display of a plurality of first interface elements on a first screen as they move from a first position to a second position; wherein the transparency of the plurality of first interface elements gradually decreases along a first direction.

[0056] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition unit is further configured to acquire information about obstacles around the first screen; the control unit is further configured to control the first screen to stop unfolding and, according to the type of obstacle, control the first interface elements to display the fifth animation effect when the information about the obstacles meets preset conditions.

[0057] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition unit is further configured to acquire the input of the user in front of the first screen when the unfolded size of the first screen is at the second unfolded size; the control unit is further configured to control the position change of the first interface element according to the input, and / or control the animation effect of the first interface element to display a sixth animation effect.

[0058] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition unit is also used to acquire the first interface element from multiple interface elements based on information of the user in front of the first screen.

[0059] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition unit is further configured to acquire the positions of the first user and the second user in front of the first screen within the cockpit; the control unit is configured to control the first interface element in the first display area to move from the first position to the second position along the first direction and to control the second interface element in the second display area to move from the third position to the fourth position along the second direction; wherein, the second direction is associated with the direction of size change of the first screen, the first display area is associated with the position of the first user, and the second display area is associated with the position of the second user.

[0060] Thirdly, this application provides an interactive device including a processor and a memory, wherein the memory is used to store instructions, and the processor executes the instructions stored in the memory to cause the device to perform any of the possible methods in the first aspect.

[0061] Fourthly, this application provides an interactive system including a computing platform and a screen, wherein the computing platform includes any of the possible devices in the second or third aspect.

[0062] In conjunction with the fourth aspect, in some implementations of the fourth aspect, the screen is a curtain.

[0063] Fifthly, this application provides a vehicle that includes any of the possible devices of the second or third aspect, or includes the system described in the fourth aspect.

[0064] Sixthly, this application provides a computer program product comprising: computer program code, which, when run on a computer, causes the computer to perform any of the possible methods described in the first aspect above.

[0065] It should be noted that the above-mentioned computer program code can be stored in whole or in part on the first storage medium, wherein the first storage medium can be packaged together with the processor or packaged separately from the processor. This application embodiment does not specifically limit this.

[0066] In a seventh aspect, this application provides a computer-readable medium storing program code that, when run on a computer, causes the computer to perform any of the possible methods described in the first aspect above.

[0067] Eighthly, this application provides a chip system including a processor for calling a computer program or computer instructions stored in a memory to cause the processor to perform any of the possible methods in the first aspect above.

[0068] In conjunction with the eighth aspect, in one possible implementation, the processor is coupled to the memory via an interface.

[0069] In conjunction with the eighth aspect, in one possible implementation, the chip system also includes a memory in which computer programs or computer instructions are stored.

[0070] Ninthly, this application provides a chip system including circuitry for performing any of the possible methods described in the first aspect above. Attached Figure Description

[0071] Figure 1 is a functional block diagram of a vehicle provided in an embodiment of this application.

[0072] Figure 2 is a schematic diagram of a vehicle cabin scenario provided in an embodiment of this application.

[0073] Figure 3 is a human-machine interface (HMI) provided in an embodiment of this application.

[0074] Figure 4 shows another HMI provided in an embodiment of this application.

[0075] Figure 5 shows another HMI provided in an embodiment of this application.

[0076] Figure 6 shows another HMI provided in an embodiment of this application.

[0077] Figure 7 shows another HMI provided in an embodiment of this application.

[0078] Figure 8 shows another HMI provided in an embodiment of this application.

[0079] Figure 9 shows another HMI provided in an embodiment of this application.

[0080] Figure 10 shows another HMI provided in an embodiment of this application.

[0081] Figure 11 shows another HMI provided in an embodiment of this application.

[0082] Figure 12 shows another HMI provided in an embodiment of this application.

[0083] Figure 13 shows another HMI provided in an embodiment of this application.

[0084] Figure 14 shows another HMI provided in an embodiment of this application.

[0085] Figure 15 shows another HMI provided in an embodiment of this application.

[0086] Figure 16 shows another HMI provided in an embodiment of this application.

[0087] Figure 17 shows another HMI provided in an embodiment of this application.

[0088] Figure 18 shows another HMI provided in an embodiment of this application.

[0089] Figure 19 shows another HMI provided in an embodiment of this application.

[0090] Figure 20 shows another HMI provided in an embodiment of this application.

[0091] Figure 21 shows another HMI provided in an embodiment of this application.

[0092] Figure 22 shows another HMI provided in an embodiment of this application.

[0093] Figure 23 is a schematic flowchart of the interaction method provided in the embodiments of this application.

[0094] Figure 24 is a schematic diagram of the projection of the projection device when the unfolded size is H1 and the unfolded size is H2, according to an embodiment of this application.

[0095] Figure 25 is a schematic block diagram of the interactive device provided in an embodiment of this application. Detailed Implementation

[0096] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0097] Figure 1 is a functional block diagram of a vehicle provided in an embodiment of this application. As shown in Figure 1, the vehicle 100 may include a display device 130 and a computing platform 150. The display device 130 in the cabin is mainly divided into two categories: the first is an in-vehicle display screen; the second is a projection display screen, such as a head-up display (HUD). An in-vehicle display screen is a physical display screen and an important component of the in-vehicle infotainment system. Multiple displays can be installed in the cabin, such as a digital instrument cluster display screen, a central control screen, a display screen in front of the front passenger (also known as the front passenger), a display screen in front of the left rear passenger, and a display screen in front of the right rear passenger; even the car window can be used as a display screen. A head-up display, also known as a head-up display system, is mainly used to display driving information such as speed and navigation on a display device (e.g., the windshield) in front of the driver. This reduces the driver's eye movement time, avoids pupil changes caused by eye movement, and improves driving safety and comfort. HUDs include, for example, combiner-HUD (C-HUD) systems, windshield-HUD (W-HUD) systems, and augmented reality HUD (AR-HUD) systems.

[0098] Some or all of the functions of vehicle 100 can be controlled by computing platform 150. Computing platform 150 may include processors 151 to 15n. A processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a central processing unit (CPU), microprocessor, graphics processing unit (GPU) (which can be understood as a type of microprocessor), or digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships are fixed or reconfigurable. For example, the processor may be a hardware circuit implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field-programmable gate array (FPGA). In reconfigurable hardware circuits, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement related functions. Furthermore, the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing unit (DPU), etc. In addition, the computing platform 150 may also include a memory for storing instructions. Some or all of the processors 151 to 15n can call the instructions in the memory to implement the corresponding functions.

[0099] Optionally, the structure of the vehicle 100 described above is merely illustrative. In actual applications, various components of the vehicle 100 may be added or removed as needed.

[0100] Figure 2 is a schematic diagram of a vehicle cockpit scenario provided in an embodiment of this application. The smart cockpit is equipped with one or more in-vehicle displays (or in-vehicle screens), including but not limited to display screen 201 (or central control screen), display screen 202 (or passenger entertainment screen), display screen 203 (or driver's headrest rear screen), display screen 204 (or passenger headrest rear screen), display screen 205 (or second-row entertainment screen) mounted on the cockpit ceiling, and an instrument panel. Further, displays 201 to 205 can display a graphical user interface (GUI), which may include icons of one or more applications and / or one or more cards. Exemplarily, the display device 130 shown in Figure 1 can be one or more of displays 201 to 205. In some possible implementations, display screen 201 can also be a long, continuous screen extending to the passenger area. Additionally, display screen 205 can also be a projection screen associated with a projector, which can be associated with a desktop launcher to manage applications projected onto the projection screen.

[0101] As shown in Figure 2, one or more cameras can also be installed in the cockpit to capture images inside or outside the cockpit. These could include cameras from a driver monitor system (DMS), a cabin monitor system (CMS), or a dashcam. The cameras used to capture images inside and outside the cockpit can be the same camera or different cameras. In addition, one or more pressure sensors and acoustic sensors are installed in the cockpit to monitor the presence and location of users.

[0102] It should be understood that the following embodiments are illustrated using a 5-seat vehicle as shown in Figure 2 as an example, and the embodiments of this application are not limited to this. For example, for a 7-seat sport / suburban utility vehicle (SUV), the cabin may include a central control screen, a passenger entertainment screen, a screen behind the driver's headrest, a screen behind the passenger's headrest, entertainment screens in the left-hand area of ​​the third row, and entertainment screens in the right-hand area of ​​the third row. As another example, for a bus, the cabin may include front and rear entertainment screens; or, the cabin may include a display screen in the driver's area and an entertainment screen in the passenger area. Furthermore, the following embodiments are illustrated using a left-hand drive vehicle (i.e., the driver is located on the left side of the vehicle), but in actual implementation, the vehicle may also be a right-hand drive vehicle (i.e., the driver is located on the right side of the vehicle).

[0103] For example, Figure 3 illustrates the human-machine interface (HMI) provided in an embodiment of this application. As shown in Figure 3, upon receiving instruction 1, the vehicle can control the screen to unfold. When the unfolded size of the screen is H1, the vehicle can display the virtual image 301 at position 1 on the current display area of ​​the screen.

[0104] Optionally, the distance between the virtual avatar 301 and the bottom edge of the screen is less than or equal to a preset distance. For example, the preset distance is 5cm. The bottom edge of the screen gradually moves towards the bottom of the cabin along the direction of the screen's size change.

[0105] For example, when the vehicle detects that a user clicks a control to unfold the curtain via a remote control, it can receive this instruction 1.

[0106] For example, when the vehicle detects that a user clicks a control on the central control screen to unfold the curtain, it can receive this instruction 1.

[0107] For example, Figure 4 illustrates another HMI provided in an embodiment of this application. As shown in Figure 4, when the unfolded size of the screen is H2, the vehicle can display a virtual image 301 at position 2 in the current display area based on the unfolded size H2 of the screen.

[0108] As can be seen from Figures 3 and 4 above, the position of the virtual character 301 changes from position 1 to position 2.

[0109] Optionally, the angle between the direction of change of the virtual image and the direction of change of the screen size is less than or equal to a preset angle. For example, the angle between the direction from position 1 to position 2 and the direction of change of the screen size is less than or equal to a preset angle.

[0110] For example, the preset included angle can be 30°.

[0111] In this embodiment of the application, during the descent of the screen, by matching the positional change of the virtual image with the direction of the screen's size change, a visual effect can be created for the user that the virtual image moves as the screen unfolds. By adapting the hardware form change of the screen to the displacement change of the virtual image, it helps to improve the user's visual and driving experience.

[0112] Optionally, during the process of the curtain's unfolded size changing from H1 to H2, the virtual avatar 301 can be a static interface element, or the virtual avatar can have no animation effects.

[0113] Optionally, during the process of the curtain's unfolded size changing from H1 to H2, the virtual avatar 301 can be a dynamic interface element, or the virtual avatar can have animation effects.

[0114] For example, Table 1 shows the correspondence between the animation effects of a virtual character and the unfolded size of the screen.

[0115] Table 1

[0116] Where H is the dimension of the side of the screen when it is fully unfolded.

[0117] For example, animation effect 1 is an entrance animation effect, animation effect 2 is an animation effect of a virtual character sliding down a pole, and animation effect 3 is an exit animation effect.

[0118] The above animation effects can be preset in the vehicle, or they can be rendered in real time.

[0119] Optionally, the vehicle can render the animation effects of the virtual avatar in real time based on the size of the screen.

[0120] Optionally, the vehicle can generate a model by inputting the size of the screen and the data collected by the sensors, thus obtaining an animated virtual image.

[0121] For example, the vehicle can generate a model by inputting the unfolded size H1 of the screen and the image 1 captured by the camera outside the cabin, and obtain the animation effect of the virtual image.

[0122] For example, if the unfolded size H1 of the screen is smaller than the first preset unfolded size, and Image 1 indicates that the vehicle is currently driving in a forest, the animation effect of the early stage of tree growth can be obtained through the content generation model. The vehicle can display the animation effect of the early stage of tree growth through the display area of ​​the screen under the unfolded size H1.

[0123] For example, if the unfolded size H1 of the curtain is smaller than the first preset unfolded size, and Image 1 indicates that it is currently raining, the animation effect of raindrops just beginning to fall from the sky can be obtained through the content generation model (for example, the shape of the raindrops can change from shape 1 to shape 2). The vehicle can display the animation effect of raindrops just beginning to fall from the sky through the display area of ​​the curtain under the unfolded size H1.

[0124] For example, the vehicle can generate a model by taking the unfolded size H2 of the screen and the image 2 captured by the camera outside the cabin as input, and obtain the animation effect of the virtual image.

[0125] For example, if the unfolded size H2 of the screen is larger than the second preset unfolded size, and Image 2 indicates that the vehicle is currently driving in a forest, the animation effect of the trees at the end of their growth phase can be obtained through the content generation model. The vehicle can display the animation effect of the trees at the end of their growth phase within the display area of ​​the screen at the unfolded size H2.

[0126] For example, if the unfolded size H2 of the screen is larger than the second preset unfolded size, and Image 2 indicates that it is currently raining, an animation effect of raindrops about to fall to the ground can be obtained through the content generation model (for example, the shape of the raindrops can change from shape 3 to shape 4). The vehicle can display the animation effect of raindrops about to fall to the ground through the display area of ​​the screen under the unfolded size H2.

[0127] Optionally, the vehicle can generate a model by inputting the size of the screen and the data collected by the sensors, thereby obtaining the animation effect of the virtual image and the display area of ​​the animation effect on the screen.

[0128] For example, the sensor could be an in-cabin camera. The vehicle can input the size H1 of the screen and the images captured by the in-cabin camera into the content generation model to obtain the animation effect of the virtual avatar. For instance, if the image captured by the in-cabin camera indicates that there is a user in front of the screen and that the user is dozing off, then the animation effect of the virtual avatar output by the content generation model could be the animation effect of the virtual avatar 301 taking a nap.

[0129] Figures 3 and 4 above illustrate the scenario with the screen unfolded. Correspondingly, for the scenario where the screen is retracted, a virtual avatar 301 can be displayed on the screen, gradually moving towards the roof of the vehicle as the screen is retracted.

[0130] Optionally, when the screen is retracted, interface elements such as balloons, airplanes (e.g., helicopters), and rockets can be displayed on the screen. By moving the positions of these interface elements along the direction the screen is retracted, the shape of the screen can adapt to the positional changes of the interface elements, thus enhancing the user's visual and driving experience during the screen retraction process.

[0131] For example, Figure 5 illustrates another HMI provided in an embodiment of this application. As shown in Figure 5, during the process of the virtual avatar's position changing from position 1 to position 2, multiple virtual avatars 301 can be displayed through the display area of ​​the screen, and the transparency of the multiple virtual avatars 301 gradually decreases along the direction in which the screen unfolds. In this way, by gradually decreasing the transparency of multiple virtual avatars, users can intuitively perceive the direction of the screen's size change through multiple virtual avatars with different transparency, which helps to improve the user's visual and driving experience.

[0132] For example, Figure 6 illustrates another HMI provided in an embodiment of this application. As shown in Figure 6, when the unfolded size of the screen is H3, the animation effect of the virtual avatar's appearance can be controlled. In this way, by displaying the animation effect of the virtual avatar's appearance when the screen just begins to unfold, a cheerful atmosphere can be created for the user, allowing the user to know through the appearance animation effect that the screen is about to unfold, or that exciting content is about to be presented to the user.

[0133] Optionally, when the unfolded size of the screen is less than or equal to the first preset size, the animation effects of the virtual image appearing can be controlled.

[0134] Optionally, the entrance animation can be a greeting to the user.

[0135] Optionally, the vehicle can acquire the location information of the user in front of the screen. Based on the user's location information, the position of the virtual avatar's entrance animation effects can be controlled.

[0136] For example, when a user is detected in the back row and that user is located in the right area of ​​the second row, the position of the virtual avatar's appearance animation effect can be controlled to be located on the right side of the screen's display area.

[0137] For example, when a user is detected in the back row and that user is located in the left area of ​​the second row, the position of the virtual avatar's appearance animation effect can be controlled to be on the left side of the screen's display area.

[0138] For example, when two users are detected in the back row and the two users are located in the left and right areas of the second row respectively, the position of the virtual image's appearance animation effect can be controlled to be centered in the display area of ​​the screen.

[0139] For example, when it is detected that there are two users in the back row and the two users are located in the left and right areas of the second row respectively, the position of the virtual avatar 1 displaying the appearance animation effect can be controlled to be on the left side of the display area of ​​the screen, and the position of the virtual avatar 2 displaying the appearance animation effect can be controlled to be on the right side of the display area of ​​the screen.

[0140] Optionally, virtual avatar 1 and virtual avatar 2 can be identified from multiple virtual avatars based on user information.

[0141] It should be noted that if the information processed in this application involves users' personal information (such as facial images, fingerprint information, voiceprint information and other biometric information, location trajectory information and personal contact information, etc.), the processing of users' personal information will be based on legality, and users will be fully informed and authorized, in accordance with the relevant laws and regulations on personal information protection in the country or region.

[0142] For example, if the user in the left area of ​​the second row is a child, the virtual avatar 1 that is related to the animated character can be identified from among multiple virtual avatars.

[0143] For example, Figure 7 illustrates another HMI provided in an embodiment of this application. As shown in Figure 7, when the unfolded size of the screen is H4, the virtual avatar's exit animation effect can be controlled. In this way, by displaying the exit animation effect of the virtual avatar when the screen is about to finish unfolding, a visual effect of the screen about to finish unfolding can be created for the user, allowing the user to know that the screen is about to finish unfolding through the exit animation effect.

[0144] Optionally, when the unfolded size of the screen is greater than or equal to the second preset size, the animation effect of the virtual character exiting the screen can be controlled.

[0145] For example, the exit animation is a virtual avatar waving goodbye.

[0146] Optionally, the vehicle can acquire the location information of the user in front of the screen. Based on the user's location information, the vehicle can control the position of the virtual avatar's exit animation effect.

[0147] For example, when a user is detected in the back row and that user is located in the right area of ​​the second row, the position of the virtual avatar's exit animation effect can be controlled to be located on the right side of the screen's display area.

[0148] For example, when a user is detected in the back row and that user is located in the left area of ​​the second row, the position of the virtual avatar's exit animation effect can be controlled to be on the left side of the screen's display area.

[0149] For example, when two users are detected in the back row and the two users are located in the left and right areas of the second row respectively, the position of the virtual image's exit animation effect can be controlled to be centered in the display area of ​​the screen.

[0150] For example, when it is detected that there are two users in the back row and the two users are located in the left and right areas of the second row respectively, the position of the exit animation effect of virtual avatar 1 can be controlled to be on the left side of the display area of ​​the screen, and the position of the exit animation effect of virtual avatar 2 can be controlled to be on the right side of the display area of ​​the screen.

[0151] For example, Figure 8 illustrates another HMI provided in an embodiment of this application. As shown in Figure 8, when the distance between the bottom edge of the screen and the user's hand is less than or equal to a preset distance during the screen's descent, the screen can be controlled to stop unfolding and the virtual avatar's expression can be switched.

[0152] Optionally, controlling the virtual avatar's facial expression switching includes: controlling the virtual avatar's facial expression switching according to the type of obstacle. For example, if the distance between the bottom edge of the screen and the user's hand is less than or equal to a preset distance, the virtual avatar can be controlled to display animation effect 4; or, if the distance between the bottom edge of the screen and the object's hand is less than or equal to a preset distance, the virtual avatar can be controlled to display animation effect 5.

[0153] For example, when the distance between the bottom edge of the screen and the user's hand is less than or equal to a preset distance and the user is a child, the virtual avatar can be controlled to display animation effect 6; or, when the distance between the bottom edge of the screen and the user's hand is less than or equal to a preset distance and the user is an adult, the virtual avatar can be controlled to display animation effect 7.

[0154] For example, during normal screen unfolding, the virtual avatar displays a happy expression. If the distance between the bottom edge of the screen and the user's hand is less than or equal to a preset distance, and the user is a child, the virtual avatar can be controlled to switch from displaying a happy expression to displaying a frightened expression. If the distance between the bottom edge of the screen and the user's hand is less than or equal to a preset distance, and the user is an adult, the virtual avatar can be controlled to switch from displaying a happy expression to displaying a staggering motion effect.

[0155] The above describes the process of adapting to the change in the unfolded size of the screen by changing the position of the virtual image. In this embodiment, other types of interface elements can also be used to adapt to the change in the unfolded size of the screen.

[0156] Figure 9 illustrates another HMI provided in an embodiment of this application. As shown in Figure 9, upon receiving instruction 1, the vehicle can control the curtain to unfold. When the unfolded size of the curtain is H1, the vehicle can display snowflakes 1 and 2 at position 3 on the current display area of ​​the curtain, but not snowflakes 3-5.

[0157] Optionally, the distance between the positions of snowflakes 1 and 2 (the dashed box shown in Figure 9) and the bottom edge of the curtain is less than or equal to a preset distance. For example, the preset distance is 5cm. The bottom edge of the curtain gradually moves towards the bottom of the cabin along the direction of the curtain's size change.

[0158] Figure 10 illustrates another HMI provided in an embodiment of this application. As shown in Figure 10, when the unfolded size of the screen is H2, the vehicle can display snowflakes 1 and 2 at position 4 on the current display area of ​​the screen, and snowflakes 3-5 at position 5.

[0159] Figure 11 illustrates another HMI provided in an embodiment of this application. As shown in Figure 11, after the screen is fully unfolded, snowflakes 1-5 will continue to fall until their positions contact the bottom edge of the screen. The bottom of the screen can then be controlled to display an animation effect of accumulated snow. As can be seen from Figures 9 to 11 above, the positions of snowflakes 1 and 2 change from position 3 to position 4, while snowflakes 3-5 are displayed from a position of 0 to 5.

[0160] Optionally, the angle between the falling direction of snowflakes 1-5 and the direction of change in the size of the curtain is less than or equal to a preset angle. For example, the preset angle can be 30°.

[0161] In this embodiment, during the descent of the curtain, by matching the falling snowflakes with the direction of the curtain's size change, a visual effect can be created for the user as snowflakes fall as the curtain unfolds. Adapting the curtain's hardware shape to the falling snowflakes helps to enhance the user's visual and driving experience.

[0162] Figure 12 illustrates another HMI provided in an embodiment of this application. As shown in Figure 12, upon receiving instruction 1, the vehicle can control the curtain to unfold. When the unfolded size of the curtain is H1, the vehicle can display the animation effect of a flowerpot at position 6 on the current display area of ​​the curtain, where the flower is in the early stage of growth (not yet in bloom).

[0163] Figure 13 illustrates another HMI provided in an embodiment of this application. As shown in Figure 13, when the unfolded size of the screen is H2, the vehicle can display another animated effect of a flowerpot at position 7 on the current display area of ​​the screen, in which the flowers are in bloom.

[0164] Optionally, the distance between the bottom of the flowerpot and the bottom edge of the curtain is less than or equal to a preset distance.

[0165] Figure 14 illustrates another HMI provided in an embodiment of this application. As shown in Figure 14, upon receiving instruction 1, the vehicle can control the screen to unfold. When the unfolded size of the screen is H1, the vehicle can display interface element a, interface element b, and interface element c at position 8 on the current display area of ​​the screen. Interface element a is the interface element corresponding to music information, interface element b is the interface element corresponding to time and date information, and interface element c is the interface element corresponding to navigation information.

[0166] For example, interface element 'a' includes multiple child elements, such as the song title (e.g., "Song A"), the artist's name (e.g., "Artist B"), and the album cover image of the song.

[0167] For example, interface element c includes multiple sub-elements, such as arrival time (e.g., 09:01), remaining mileage (e.g., 30 km), and remaining driving time (e.g., 53 minutes).

[0168] Figure 15 illustrates another HMI provided in an embodiment of this application. As shown in Figure 15, when the unfolded size of the screen is H2, the vehicle can display interface element a, interface element b, and interface element c at position 9 on the current display area of ​​the screen.

[0169] Optionally, in different curtain unfolding states, the distance between the positions of interface element a, interface element b, and interface element c and the bottom edge of the curtain is less than or equal to a preset distance.

[0170] The arrangement of the interface elements ac above is merely illustrative, and this application does not impose any specific limitations on it.

[0171] Figure 16 illustrates another HMI provided in an embodiment of this application. As shown in Figure 16, upon receiving instruction 1, the vehicle can control the screen to unfold. When the unfolded size of the screen is H1, the vehicle can display interface element dh at position 10 on the current display area of ​​the screen. Here, interface element d is the interface element corresponding to the destination, interface element e is the interface element corresponding to the arrival time, interface element f is the interface element corresponding to the remaining mileage, interface element g is the interface element corresponding to the remaining driving time, and interface element h is the interface element corresponding to the trip progress.

[0172] Figure 17 illustrates another HMI provided in an embodiment of this application. As shown in Figure 17, when the unfolded size of the screen is H2, the vehicle can display the interface element dh at position 11 on the current display area of ​​the screen.

[0173] Optionally, in different curtain unfolding states, the distance between the position of the interface element dh and the bottom edge of the curtain is less than or equal to a preset distance.

[0174] The arrangement of the interface element dh above is merely illustrative, and this application embodiment does not impose any specific limitations on it.

[0175] Figure 18 illustrates another HMI provided in an embodiment of this application. As shown in Figure 18, upon receiving instruction 1, the vehicle can control the screen to unfold. When the unfolded size of the screen is H1, the vehicle can display interface element a and interface element i at position 12 on the current display area of ​​the screen, where interface element i is the interface element corresponding to the lyrics.

[0176] Optionally, interface element a and interface element i displayed on the current display area of ​​the screen are generated from the display content on another screen in the cabin. For example, the central control screen is currently displaying the display interface of a music application, which includes multiple interface elements, including interface element a and interface element i. When the unfolded size of the screen is H1, the vehicle can control the display area on the screen to display interface element a and interface element i based on the display content on the central control screen.

[0177] Figure 19 illustrates another HMI provided in an embodiment of this application. As shown in Figure 19, when the unfolded size of the screen is H2, the vehicle can display interface element a and interface element i at position 13 on the current display area of ​​the screen.

[0178] Optionally, in different curtain unfolding states, the distance between the positions of interface element a and interface element i and the bottom edge of the curtain is less than or equal to a preset distance.

[0179] The arrangement of interface elements a and i above is merely illustrative, and this application does not impose any specific limitations on it.

[0180] Figure 20 illustrates another HMI provided in an embodiment of this application. As shown in Figure 20, when instruction 1 is received, the vehicle can control the curtain to unfold. When it is detected that the rear passenger is not wearing a seat belt and the unfolded size of the curtain is H1, the vehicle can display a virtual avatar 301 and interface element j at position 14 on the current display area of ​​the curtain. The interface element j is the text content "Please wear your seat belt" prompted by the virtual avatar.

[0181] Optionally, when the vehicle passes through the display area on the screen displaying interface elements j, a prompt "Please wear your seat belt" can also be emitted through the speakers in the cabin.

[0182] Figure 21 illustrates another HMI provided in an embodiment of this application. As shown in Figure 21, when it is detected that the rear passenger is not wearing a seatbelt and the unfolded size of the screen is H2, the vehicle can display interface element a and interface element i at position 15 on the current display area of ​​the screen.

[0183] Optionally, if a rear-seat user is detected wearing a seatbelt before the screen expands to H2, the vehicle can display a virtual avatar 301 on the screen's display area and the control interface element j disappears.

[0184] Optionally, in different curtain unfolding states, the distance between the virtual image 301 and the interface element j and the bottom edge of the curtain is less than or equal to a preset distance.

[0185] Figure 22 illustrates another set of HMIs provided in an embodiment of this application. As shown in Figure 22(a), upon receiving instruction 1, the vehicle can control the screen to unfold. Based on the content displayed by the navigation application on the central control screen, the vehicle can control the display area on the screen to display the animation effects of the virtual avatar. For example, the vehicle can display the navigation application's interface on the central control screen, which shows "Turn right in 100 meters, no congestion ahead." At this time, the vehicle can control the virtual avatar on the screen to move along direction 1 as the screen unfolds and can control the virtual avatar's expression to be a happy expression, where direction 1 is associated with the direction the screen unfolds.

[0186] For example, the angle between direction 1 and the direction of change of the curtain size is less than or equal to a preset angle.

[0187] Optionally, the vehicle can also display the voice message "Unobstructed ahead" from the virtual avatar on the screen.

[0188] As shown in Figure 22(b), upon receiving instruction 1, the vehicle can control the curtain to unfold. Based on the content displayed by the navigation application on the central control screen, the vehicle can control the display area on the curtain to show the animation effects of the virtual avatar. For example, the vehicle can display the navigation application's interface on the central control screen, which shows "Turn left in 200 meters, traffic congestion ahead." At this time, the vehicle can control the virtual avatar on the curtain to move along direction 2 as the curtain unfolds, and can control the virtual avatar's expression to be a dozing expression, where direction 2 is related to the direction the curtain unfolds.

[0189] For example, the angle between direction 2 and the direction of change in the size of the curtain is less than or equal to a preset angle.

[0190] Optionally, the vehicle can also display a voice message from the virtual avatar, such as "Road ahead is congested," on a screen display area.

[0191] Optionally, if during the unfolding of the screen, the display content of the navigation application on the central control screen is detected to switch from displaying smooth traffic to displaying congested traffic, then the virtual image on the screen can be controlled to switch from a happy expression to a dozing expression.

[0192] Figure 23 shows a schematic flowchart of the interaction method 2300 provided in an embodiment of this application. The method 2300 can be executed by the vehicle 100, or by the computing platform 150, or by a processor, chip, or circuit in the computing platform 150. The method 2300 includes:

[0193] S2310, obtain the unfolded dimensions of the first screen in the cockpit.

[0194] Optionally, obtaining the unfolded size of the first screen in the cockpit includes: in response to receiving a first instruction sent by the mobile terminal, obtaining the unfolded size of the first screen.

[0195] For example, the mobile terminal can be a mobile phone or a remote control.

[0196] Optionally, obtaining the unfolded size of the first screen in the cockpit includes: obtaining the unfolded size of the first screen in response to obtaining a rotation signal of a motor used to control the unfolding or retraction of the screen.

[0197] Optionally, obtaining the unfolded size of the first screen in the cockpit includes: obtaining the unfolded size of the first screen in response to obtaining the user's voice input.

[0198] Optionally, obtaining the unfolded size of the first screen in the cockpit includes: obtaining the unfolded size of the first screen in response to detecting a change in the first screen from a fully retracted state to a fully unfolded state.

[0199] Optionally, obtaining the unfolded size of the first screen in the cockpit includes: determining, based on the door opening signal and the signal collected by the seat pressure sensor, whether to perform an operation to unfold or retract the first screen; and in response to the operation, obtaining the unfolded size of the first screen.

[0200] Optionally, taking the first screen as an example, the unfolded size can be the size of the side of the screen.

[0201] S2320, during the process of the first screen's unfolded size changing from a first unfolded size to a second unfolded size, the first interface element on the first screen is controlled to move from a first position to a second position along a first direction, wherein the first direction is related to the direction of the first screen's size change.

[0202] For example, when the first screen is unfolded to a first unfolded size, the vehicle can acquire a first image, which is an image of the screen when it is fully unfolded. The position of the first interface element in this first image is located at a first position. For example, when the first screen is unfolded to a second unfolded size, the vehicle can acquire a second image, which is an image of the screen when it is fully unfolded. The position of the first interface element in this second image is located at a second position. Taking the unfolding process of the first screen as an example, the distance between the first position and the bottom edge of the first image is greater than the distance between the second position and the bottom edge of the second image.

[0203] The first and second images above can be the same size.

[0204] Figure 24 shows a schematic diagram of the projection device when the unfolded size is H1 and the unfolded size is H2, according to an embodiment of this application.

[0205] When the unfolded size of the screen is H1, the vehicle can remove the image within the unfolded size (H1, H] after acquiring the first image, retaining only the extracted third image. This allows the third image to be projected using a projection device. The image displayed on the screen as shown in Figure 3 is the third image.

[0206] When the unfolded size of the screen is H2, the vehicle can remove the image within the unfolded size (H2, H] after acquiring the second image, retaining only the extracted fourth image. This allows the fourth image to be projected using a projection device. The image displayed on the screen as shown in Figure 4 is the fourth image.

[0207] Optionally, if the first unfolded size is smaller than the second unfolded size, then the first screen is in the process of unfolding. At this time, the first interface elements will move in the direction of the first screen's unfolding on the display area of ​​the first screen as the first screen unfolds.

[0208] Optionally, if the first expanded size is larger than the second expanded size, then the first screen is in the process of collapsing. At this time, the first interface elements will move in the direction of the collapsed first screen's display area as the first screen collapses.

[0209] In this embodiment, during the screen's expansion and resizing process, the direction of the screen's size change is adapted to the direction of the interface elements' position movement. This ensures that users can see the positional changes of the interface elements during the screen's size change, rather than seeing a black screen, thus improving the user's visual experience. Simultaneously, by adapting the screen's expansion and resizing process to the positional changes of the interface elements, users experience the visual effect of the interface elements moving as the screen size changes, enhancing user engagement and driving experience.

[0210] Optionally, the first direction is associated with the direction of size change of the first screen, including: the angle between the first direction and the direction of size change of the first screen is less than or equal to a preset angle.

[0211] Optionally, the first direction is the same as the direction of size change of the first screen.

[0212] Optionally, the first direction is the direction from the first position to the second position.

[0213] For example, as shown in Figures 3 and 4, the first interface element can be a virtual avatar 301, the first position can be position 1, and the second position can be position 2. The direction from position 1 to position 2 is the same as the unfolding direction of the curtain.

[0214] For example, as shown in Figures 9 and 10, the first interface element can be snowflake 1-2, the first position can be position 3, and the second position can be position 4. The direction from position 3 to position 4 is the same as the unfolding direction of the curtain.

[0215] Optionally, the first edge of the first screen changes along the direction of size change. During the process of the first screen's unfolded size changing from the first unfolded size to the second unfolded size, the distance between the position of the first interface element and the first edge is less than or equal to a preset distance.

[0216] For example, as shown in Figure 3, the distance between the position of the virtual image 301 on the display area of ​​the current screen and the bottom edge of the screen is less than or equal to a preset distance.

[0217] For example, the preset distance is 5cm.

[0218] In this embodiment, the position of the first interface element can be less than or equal to a preset distance from the first edge of the first screen. This ensures that the positional changes of the interface elements seen by the user are more closely aligned with the positional changes of the first edge, which helps to enhance the fun and driving experience during the unfolding of the first screen.

[0219] Optionally, the first screen is a screen, and the first side is the bottom edge of the screen.

[0220] Optionally, the method 2300 further includes: controlling the animation effects of the first interface elements according to the unfolded size of the first screen.

[0221] In this embodiment, the animation effects of the first interface elements can be controlled based on the unfolded size of the first screen. This allows users to experience the visual effect of interface elements moving as the screen size changes, while also enjoying animation effects adapted to the unfolded size of the first screen, further enhancing user engagement and driving experience.

[0222] Optionally, the animation effects of the first interface elements are controlled according to the unfolded size of the first screen, including: during the unfolding of the first screen, in response to detecting that the unfolded size of the first screen is less than or equal to a first preset size, controlling the first interface element to display an entrance animation effect; or, during the unfolding of the first screen, in response to detecting that the unfolded size of the first screen is greater than or equal to a second preset size, controlling the first interface element to display an exit animation effect; or, during the collapsing of the first screen, in response to detecting that the unfolded size of the first screen is greater than or equal to a second preset size, controlling the first interface element to display an entrance animation effect; or, during the collapsing of the first screen, in response to detecting that the unfolded size of the first screen is less than or equal to a first preset size, controlling the first interface element to display an exit animation effect; wherein the first preset size is less than the second preset size.

[0223] For example, as shown in Figure 6, the first screen can be a curtain, and the first interface element can be a virtual avatar 301. When the curtain is first unfolded, the unfolded size of the curtain is less than or equal to a first preset size. At this time, the display area of ​​the curtain can be controlled to display the entrance animation of the virtual avatar 301 (e.g., greeting).

[0224] For example, as shown in Figure 7, the first screen can be a curtain, and the first interface element can be a virtual avatar 301. When the curtain is about to finish unfolding, the unfolded size of the curtain is greater than or equal to a first preset size. At this time, the display area of ​​the curtain can be controlled to display the exit animation of the virtual avatar 301 (e.g., waving goodbye).

[0225] For example, as shown in Figure 12, the first screen can be a curtain, and the first interface element can be a flowerpot 1201. When the curtain is first unfolded, the unfolded size of the curtain is less than or equal to a first preset size. At this time, the display area of ​​the curtain can be controlled to display that the flowers in the flowerpot 1201 have not yet bloomed.

[0226] For example, as shown in Figure 13, the first screen can be a curtain, and the first interface element can be a flowerpot 1201. When the curtain is first unfolded, the unfolded size of the curtain is greater than or equal to the second preset size. At this time, the display area of ​​the curtain can be controlled to show that the flowers in the flowerpot 1201 have bloomed.

[0227] Optionally, during the process of the screen changing from the unfolded size H1 to the unfolded size H2, the position of the flowerpot 1201 displayed on the screen can be controlled to change as the screen unfolds, and the unfolding process of the flowers in the flowerpot 1201 displayed on the screen can be controlled.

[0228] In this embodiment, during the unfolding or collapsing of the first screen, the appearance or disappearance animation effects of interface elements can be controlled based on the relationship between the unfolded size of the first screen and a preset size. Thus, the appearance animation effect allows the user to perceive the first screen beginning to unfold and begin to collapse; the disappearance animation effect allows the user to perceive the first screen about to complete unfolding or collapsing, helping to enhance user engagement and driving experience.

[0229] Optionally, the animation effects of the first interface elements are controlled according to the unfolded size of the first screen, including: controlling the animation effects of the first interface elements according to the unfolded size of the first screen and the data collected by the sensor.

[0230] Based on the above technical solution, the animation effects of the first interface elements can be controlled by combining the unfolded size of the first screen and the data collected by the sensors. By adapting the animation effects of the interface elements to the unfolded size and the data collected by the sensors, users can experience animation effects that are appropriate for the current scene, thus improving the user's visual experience.

[0231] Optionally, the animation effects of the first interface elements are controlled based on the unfolded size of the first screen and the data collected by the sensors, including: controlling the animation effects of the first interface elements based on the unfolded size of the first screen and the data collected by the camera outside the cockpit.

[0232] Optionally, the animation effects of the first interface elements are controlled based on the unfolded size of the first screen and the data collected by the camera outside the cockpit, including: determining the current scene of the vehicle (e.g., forest, seaside, beach, highway) based on the data collected by the camera outside the cockpit; and controlling the animation effects of the first interface elements based on the current scene of the vehicle and the unfolded size of the first screen.

[0233] For example, if the image captured by the external camera indicates that the vehicle is currently in a forest, the vehicle can display the animation effect of the initial generation of trees through the display area on the screen when the screen is just beginning to unfold; display the animation effect of the final generation of trees through the display area on the screen when the screen is about to finish unfolding; and display the animation effect of the gradual generation of trees through the display area on the screen during the unfolding process.

[0234] Optionally, the animation effects of the first interface elements are controlled based on the unfolded size of the first screen and the data collected by the sensors, including: controlling the animation effects of the first interface elements based on the unfolded size of the first screen and the data collected by the camera in the cockpit.

[0235] Optionally, the animation effects of the first interface elements are controlled based on the unfolded size of the first screen and the data collected by the camera in the cockpit, including: determining the user's state based on the data collected by the camera in the cockpit; and controlling the animation effects of the first interface elements based on the unfolded size of the first screen and the user's state.

[0236] For example, if the image captured by the in-cabin camera indicates that the user in front of the first screen is dozing off, the virtual avatar dozing off is displayed in the display area on the screen as the screen unfolds.

[0237] For example, as shown in Figures 20 and 21, if the image captured by the camera in the cockpit indicates that the user in front of the screen is not wearing a seat belt, during the unfolding of the screen, an animation effect of a virtual avatar talking to the user is displayed on the display area of ​​the screen. The content of the dialogue can be "Please wear your seat belt".

[0238] Optionally, the animation effect of the first interface element is controlled according to the unfolded size of the first screen and the data collected by the sensor, including: when the unfolded size of the first screen is a third unfolded size, generating a model with the third unfolded size and data input content to obtain the animation effect of the first interface element and information on the display area of ​​the animation effect; wherein, the method further includes: controlling a third display area on the first screen to display the animation effect of the first interface element according to the information on the display area of ​​the animation effect, wherein the third display area is the display area of ​​the first screen under the third unfolded size.

[0239] For example, as shown in Figures 9 to 11, the size of the screen and the images captured by the camera outside the cabin can be input into the content generation model. The content generation model can then output the animation effects of the first interface elements and the display area of ​​the first interface elements within the current unfolded size of the first screen. For instance, if the image captured by the camera indicates that the weather outside the vehicle is snowing, the content generation model can output the animation effect of snowflakes 1-5 falling from the sky.

[0240] In this embodiment, the unfolded size of the first screen and the data collected by the sensor can be input into the content generation model to obtain information about the animation effects of the first interface elements and the display area of ​​the animation effects. Thus, the content generation model enables the generation of animation effects, allowing the interface elements to have real-time rendered animation effects. Users can experience different animation effects in different scenarios, which helps to improve the user's visual and driving experience.

[0241] Optionally, the sensor is an in-cabin sensor, and the display area of ​​the animation effect is associated with the position of the user in the cabin.

[0242] For example, if a user is detected in the back row area and the user is located in the right side of the back row, then the first interface element can be displayed in the right display area of ​​the first screen.

[0243] Optionally, the method 2300 further includes: controlling the animation effects of the first interface elements according to the content displayed on the second screen in the cockpit.

[0244] In this embodiment, the animation effects of the first interface elements on the first screen can be controlled based on the content displayed on other screens in the cockpit. This allows the user in front of the first screen to experience the content displayed on other screens through the animation effects of the first interface elements, thus enhancing the user's visual and driving experience.

[0245] Optionally, the content displayed on the second screen includes the content displayed by the navigation application. Based on the content displayed on the second screen in the cockpit, the animation effect of the first interface element is controlled, including: when the content displayed by the navigation application indicates that the current vehicle is in a congested road section, the animation effect of the first interface element is controlled to be a first animation effect; or, when the content displayed by the navigation application indicates that the current vehicle is in a non-congested road section, the animation effect of the first interface element is controlled to be a second animation effect.

[0246] For example, as shown in Figure 22(a), the vehicle can display the navigation application's interface on the central control screen, which displays "Turn right in 100 meters, no congestion ahead." During the unfolding of the screen, the vehicle can control the virtual image on the screen to move along direction 1 as the screen unfolds, and can control the virtual image's expression to be happy.

[0247] For example, as shown in Figure 22(b), the vehicle can display the navigation application's interface on the central control screen, which displays "Turn left in 200 meters, traffic congestion ahead." As the screen unfolds, the vehicle can control the virtual image on the screen to move along direction 2 as the screen unfolds, and the virtual image's expression can be controlled to be a dozing expression.

[0248] In this embodiment, when the navigation application displayed on the second screen indicates whether the vehicle is in a congested or non-congested area, different animation effects can be displayed on the first interface elements on the first screen. This allows rear passengers in the cabin to intuitively perceive the traffic congestion through the animation effects of the first interface elements, thus enhancing the user's visual and driving experience.

[0249] Optionally, the content displayed on the second screen includes the display content of the music application. Based on the content displayed on the second screen in the cockpit, the animation effect of the first interface element is obtained, including: when the display content of the music application indicates that a first type of music is to be played, controlling the animation effect of the first interface element to be a third animation effect; or, when the display content of the music application indicates that a second type of music is to be played, controlling the animation effect of the first interface element to be a fourth animation effect.

[0250] In this embodiment, when the music application displayed on the second screen indicates that a first type of music and a second type of music are to be played, the first interface elements on the first screen can be controlled to display different animation effects. This allows the interface elements to be adapted to the type of music, enabling rear passengers in the cabin to be encouraged to move their bodies along with the music through the animation effects (e.g., rhythmic effects) of the first interface elements, thus enhancing user enjoyment and the driving experience.

[0251] Optionally, controlling a first interface element on the first screen to move from a first position to a second position along a first direction includes: controlling the first screen to display a plurality of first interface elements that have moved from the first position to the second position; wherein the transparency of the plurality of first interface elements gradually decreases along the first direction.

[0252] In this embodiment, multiple first interface elements can be displayed as the first interface element moves from a first position to a second position. By gradually decreasing the transparency of the multiple first interface elements, the user can clearly understand the direction of the screen's size change through the change in the transparency of the multiple interface elements.

[0253] Optionally, the method 2300 further includes: obtaining information about obstacles around the first screen; when the information about the obstacles meets preset conditions, controlling the first screen to stop unfolding and controlling the first interface elements to display a fifth animation effect according to the type of obstacle.

[0254] For example, as shown in Figure 8, when the screen is about to come into contact with the user's finger, the screen can be controlled to stop unfolding. At this time, the virtual image displayed on the screen can be switched to a scared expression.

[0255] In this embodiment, when an obstacle is encountered on the first screen, the animation effect of the first interface element can be controlled based on the type of obstacle. This makes the animation effect of the interface element more closely resemble the current scene.

[0256] Optionally, the method 2300 further includes: when the unfolded size of the first screen is at the second unfolded size, obtaining input from the user in front of the first screen; controlling the position movement of the first interface element according to the input, and / or controlling the animation effect of the first interface element to display a sixth animation effect.

[0257] In this embodiment, interface elements can also move based on user input. This enhances the engaging experience of human-computer interaction during changes in the size of the first screen.

[0258] Optionally, the user's input is a gesture input from the user toward a third direction, and the direction from the second position to the third position matches the third direction.

[0259] Optionally, the first screen is in the unfolding process, the user's input is a gesture input from the user towards a third direction, and the sixth animation effect is the movement effect of the first interface element, such as first moving from the second position to the fifth position, and then free-falling from the fifth position to the sixth position. The direction from the second position to the fifth position matches the third direction, and the direction from the fifth position to the sixth position matches the unfolding direction of the first screen.

[0260] Optionally, the method 2300 further includes: obtaining a first interface element from multiple interface elements based on information of the user in front of the first screen.

[0261] Optionally, the method 2300 further includes: obtaining the positions of the first user and the second user in the cockpit in front of the first screen; wherein controlling the first interface element on the first screen to move from the first position to the second position along a first direction includes: controlling the first interface element in the first display area to move from the first position to the second position along the first direction and controlling the second interface element in the second display area to move from the third position to the fourth position along a second direction; wherein the second direction is associated with the direction of size change of the first screen, the first display area is associated with the position of the first user, and the second display area is associated with the position of the second user.

[0262] In this embodiment, when multiple users are in front of the first screen, multiple interface elements can be displayed on the first screen, and the display area of ​​each interface element is associated with the user's location. This can improve the visual effect and driving experience for multiple users in the cockpit.

[0263] Figure 25 shows a schematic block diagram of an interactive device 2500 provided in an embodiment of this application. The device 2500 includes: an acquisition unit 2510 for acquiring the unfolded size of a first screen in the cockpit; and a control unit 2520 for controlling a first interface element on the first screen to move from a first position to a second position along a first direction during the process of the unfolded size of the first screen changing from a first unfolded size to a second unfolded size; wherein the first direction is associated with the direction of size change of the first screen.

[0264] Optionally, the first edge of the first screen changes along the direction of size change. During the process of the first screen's unfolded size changing from the first unfolded size to the second unfolded size, the distance between the position of the first interface element and the first edge is less than or equal to a preset distance.

[0265] Optionally, the control unit 2520 is also used to control the animation effects of the first interface elements according to the unfolded size of the first screen.

[0266] Optionally, the control unit 2520 is configured to: during the unfolding of the first screen, in response to the unfolded size of the first screen being less than or equal to a first preset size, control the first interface element to display an animation effect of appearing; or, during the unfolding of the first screen, in response to the unfolded size of the first screen being greater than or equal to a second preset size, control the first interface element to display an animation effect of leaving; or, during the retraction of the first screen, in response to the unfolded size of the first screen being greater than or equal to a second preset size, control the first interface element to display an animation effect of appearing; or, during the retraction of the first screen, in response to the unfolded size of the first screen being less than or equal to a first preset size, control the first interface element to display an animation effect of leaving; wherein the first preset size is less than the second preset size.

[0267] Optionally, the control unit 2520 is used to control the animation effects of the first interface elements based on the unfolded size of the first screen and the data collected by the sensor.

[0268] Optionally, the control unit 2520 is configured to: when the unfolded size of the first screen is the third unfolded size, generate a model using the third unfolded size and data input content to obtain information on the animation effect of the first interface element and the display area of ​​the animation effect; and control the third display area on the first screen to display the animation effect of the first interface element according to the information on the display area of ​​the animation effect, wherein the third display area is the display area of ​​the first screen under the third unfolded size.

[0269] Optionally, the control unit 2520 is also used to control the animation effects of the first interface elements according to the content displayed on the second screen in the cockpit.

[0270] Optionally, the content displayed on the second screen includes the display content of the navigation application. The control unit 2520 is configured to: control the animation effect of the first interface element to a first animation effect when the display content of the navigation application indicates that the current vehicle is in a congested road section; or, control the animation effect of the first interface element to a second animation effect when the display content of the navigation application indicates that the current vehicle is in a non-congested road section.

[0271] Optionally, the content displayed on the second screen includes the display content of a music application. The control unit is configured to: control the animation effect of the first interface element to a third animation effect when the display content of the music application indicates that a first type of music should be played; or, control the animation effect of the first interface element to a fourth animation effect when the display content of the music application indicates that a second type of music should be played.

[0272] Optionally, the control unit 2520 is used to: control the display of a plurality of first interface elements on the first screen as they move from a first position to a second position; wherein the transparency of the plurality of first interface elements gradually decreases along a first direction.

[0273] Optionally, the acquisition unit 2510 is further configured to acquire information about obstacles around the first screen; the control unit 2520 is further configured to control the first screen to stop unfolding and, according to the type of obstacle, control the first interface elements to display the fifth animation effect when the information about the obstacle meets the preset conditions.

[0274] Optionally, the acquisition unit 2510 is further configured to acquire user input in front of the first screen when the unfolded size of the first screen is at the second unfolded size; the control unit 2520 is further configured to control the position change of the first interface element according to the input, and / or control the animation effect of the first interface element to display a sixth animation effect.

[0275] Optionally, the acquisition unit 2510 is also used to acquire a first interface element from multiple interface elements based on information of the user in front of the first screen.

[0276] Optionally, the acquisition unit 2510 is further configured to acquire the positions of the first user and the second user in front of the first screen within the cockpit; the control unit 2520 is configured to control a first interface element in the first display area to move from a first position to a second position along a first direction and to control a second interface element in the second display area to move from a third position to a fourth position along a second direction; wherein the second direction is associated with the direction of size change of the first screen, the first display area is associated with the position of the first user, and the second display area is associated with the position of the second user.

[0277] It should be understood that the division of units in the above device is only a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, the units in the device can be implemented by a processor calling software; for example, the device includes a processor connected to memory, which stores instructions. The processor calls the instructions stored in memory to implement any of the above methods or to implement the functions of each unit in the device. The processor can be, for example, a general-purpose processor, such as a CPU or microprocessor, and the memory can be internal or external to the device. Alternatively, the units in the device can be implemented as hardware circuits. The functions of some or all units can be implemented through the design of the hardware circuits, which can be understood as one or more processors. For example, in one implementation, the hardware circuit is an ASIC, and the functions of some or all units are implemented through the design of the logical relationships between the components within the circuit. In another implementation, the hardware circuit can be implemented using a PLD, such as an FPGA, which can include a large number of logic gates. The connection relationships between the logic gates are configured through configuration files, thereby implementing the functions of some or all units. All units of the above devices can be implemented entirely through processor calling software, or entirely through hardware circuits, or partially through processor calling software with the remaining parts implemented through hardware circuits.

[0278] In this application embodiment, a processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction reading and execution capabilities, such as a CPU, microprocessor, GPU, or DSP. In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships are fixed or reconfigurable. For example, the processor may be a hardware circuit implemented as an ASIC or PLD, such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the processor loading instructions to implement the functions of some or all of the above units. Furthermore, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as an NPU, TPU, or DPU.

[0279] As can be seen, each unit in the above device can be one or more processors (or processing circuits) configured to implement the above methods, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.

[0280] Furthermore, the units in the above devices can be integrated in whole or in part, or they can be implemented independently. In one implementation, these units are integrated together as a System-on-a-Chip (SoC). The SoC may include at least one processor for implementing any of the above methods or implementing the functions of the units in the device. The at least one processor may be of different types, such as CPU and FPGA, CPU and AI processor, CPU and GPU, etc.

[0281] This application also provides an interactive device, which includes a processing unit and a storage unit. The storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to cause the device to perform the methods or steps described in the above embodiments.

[0282] Alternatively, if the interactive device is located in a vehicle, the aforementioned processing unit may be the processor 151-15n shown in FIG1.

[0283] This application embodiment also provides an interactive system. The control system may include a computing platform and a screen. The computing platform may include the aforementioned interactive device 2500, and the screen is a screen whose unfolded size changes.

[0284] This application also provides a vehicle that may include the aforementioned interactive device 2500 or interactive system.

[0285] This application also provides a computer program product, which includes computer program code that, when run on a computer, causes the computer to perform the methods described in the above embodiments.

[0286] This application also provides a computer-readable medium storing program code that, when run on a computer, causes the computer to perform the methods described in the above embodiments.

[0287] This application also provides a chip, which includes a circuit for performing the methods described in the above embodiments.

[0288] In implementation, each step of the above method can be completed by integrated logic circuits in the processor's hardware or by instructions in software. The method disclosed in the embodiments of this application can be directly implemented by a hardware processor, or by a combination of hardware and software modules within the processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, power-on erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method. To avoid repetition, detailed descriptions are omitted here.

[0289] It should be understood that in the embodiments of this application, the memory may include read-only memory and random access memory, and provides instructions and data to the processor.

[0290] It should also be understood that, in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0291] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0292] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0293] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0294] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0295] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0296] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0297] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be covered. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An interaction method, characterized in that, include: Obtain the unfolded dimensions of the first screen inside the cockpit; During the process of the first screen's unfolded size changing from the first unfolded size to the second unfolded size, the first interface element on the first screen is controlled to move from the first position to the second position along the first direction; The first direction is associated with the direction of size change of the first screen.

2. The method according to claim 1, characterized in that, The first edge of the first screen changes along the direction of the size change. During the process of the unfolded size of the first screen changing from the first unfolded size to the second unfolded size, the distance between the position of the first interface element and the first edge is less than or equal to a preset distance.

3. The method according to claim 1 or 2, characterized in that, The method further includes: The animation effects of the first interface elements are controlled according to the unfolded size of the first screen.

4. The method according to claim 3, characterized in that, The step of controlling the animation effects of the first interface elements according to the unfolded size of the first screen includes: During the unfolding of the first screen, in response to detecting that the unfolded size of the first screen is less than or equal to a first preset size, the animation effect of the first interface element being displayed is controlled; or, During the unfolding of the first screen, in response to detecting that the unfolded size of the first screen is greater than or equal to a second preset size, the system controls the first interface element to display an exit animation effect; or, During the process of the first screen collapsing, in response to detecting that the expanded size of the first screen is greater than or equal to the second preset size, the animation effect of the first interface element being displayed is controlled; or, During the process of the first screen collapsing, in response to detecting that the unfolded size of the first screen is less than or equal to the first preset size, the first interface element is controlled to display an exit animation effect; Wherein, the first preset size is smaller than the second preset size.

5. The method according to claim 3 or 4, characterized in that, The step of controlling the animation effects of the first interface elements according to the unfolded size of the first screen includes: The animation effects of the first interface elements are controlled based on the unfolded size of the first screen and the data collected by the sensors.

6. The method according to claim 5, characterized in that, The step of controlling the animation effects of the first interface elements based on the unfolded size of the first screen and the data collected by the sensors includes: When the unfolded size of the first screen is the third unfolded size, the third unfolded size and the data input content are used to generate a model to obtain the animation effect of the first interface element and the information of the display area of ​​the animation effect; The method further includes: Based on the information of the display area of ​​the animation effect, the third display area on the first screen is controlled to display the animation effect of the first interface element, wherein the third display area is the display area of ​​the first screen under the third expanded size.

7. The method according to claim 1 or 2, characterized in that, The method further includes: The animation effects of the first interface elements are controlled based on the content displayed on the second screen inside the cockpit.

8. The method according to claim 7, characterized in that, The content displayed on the second screen includes the content displayed by the navigation application. Controlling the animation effects of the first interface elements based on the content displayed on the second screen within the cockpit includes: When the navigation application's display indicates that the vehicle is currently in a congested area, the animation effect of the first interface element is controlled to be the first animation effect; or, When the navigation application displays information indicating that the vehicle is currently in a non-congested area, the animation effect of the first interface element is controlled to be the second animation effect.

9. The method according to claim 7, characterized in that, The content displayed on the second screen includes the content displayed by the music application. The step of obtaining the animation effects of the first interface elements based on the content displayed on the second screen within the cockpit includes: When the display content of the music application indicates that the first type of music should be played, the animation effect of the first interface element is controlled to be the third animation effect; or, When the display content of the music application indicates that the second type of music should be played, the animation effect of the first interface element is controlled to be the fourth animation effect.

10. The method according to any one of claims 1 to 9, characterized in that, The control of moving a first interface element on the first screen from a first position to a second position along a first direction includes: Control the first screen to display multiple first interface elements that have moved from the first position to the second position; Among them, the transparency of multiple first interface elements gradually decreases along the first direction.

11. The method according to any one of claims 1 to 10, characterized in that, The method further includes: Obtain information about obstacles surrounding the first screen; When the information of the obstacle meets the preset conditions, the first screen is controlled to stop unfolding and the first interface element is controlled to display the fifth animation effect according to the type of obstacle.

12. The method according to any one of claims 1 to 11, characterized in that, The method further includes: When the unfolded size of the first screen is the second unfolded size, obtain the input of the user in front of the first screen; Based on the input, control the position change of the first interface element, and / or control the animation effect of the first interface element to display a sixth animation effect.

13. The method according to any one of claims 1 to 12, characterized in that, The method further includes: Based on the information of the user in front of the first screen, the first interface element is obtained from multiple interface elements.

14. The method according to any one of claims 1 to 13, characterized in that, The method further includes: Obtain the positions of the first user and the second user in front of the first screen within the cockpit; The step of controlling a first interface element on the first screen to move from a first position to a second position along a first direction includes: Control the first interface element in the first display area to move from the first position to the second position along the first direction, and control the second interface element in the second display area to move from the third position to the fourth position along the second direction; Wherein, the second direction is associated with the direction of size change of the first screen, the first display area is associated with the location of the first user, and the second display area is associated with the location of the second user.

15. An interactive device, characterized in that, include: The acquisition unit is used to acquire the unfolded dimensions of the first screen inside the cockpit; The control unit is used to control a first interface element on the first screen to move from a first position to a second position along a first direction during the process of the unfolded size of the first screen changing from a first unfolded size to a second unfolded size. The first direction is associated with the direction of size change of the first screen.

16. The apparatus according to claim 15, characterized in that, The first edge of the first screen changes along the direction of the size change. During the process of the unfolded size of the first screen changing from the first unfolded size to the second unfolded size, the distance between the position of the first interface element and the first edge is less than or equal to a preset distance.

17. The apparatus according to claim 15 or 16, characterized in that, The control unit is also configured to control the animation effects of the first interface elements according to the unfolded size of the first screen.

18. The apparatus according to claim 17, characterized in that, The control unit is used for: During the unfolding of the first screen, in response to the unfolded size of the first screen being less than or equal to a first preset size, the animation effect for the first interface element to appear is controlled; or, During the unfolding of the first screen, in response to the unfolded size of the first screen being greater than or equal to a second preset size, the animation effect of the first interface element exiting is controlled; or, During the process of the first screen collapsing, in response to the unfolded size of the first screen being greater than or equal to the second preset size, the animation effect for the first interface element to appear is controlled; or, During the process of the first screen collapsing, in response to the unfolded size of the first screen being less than or equal to the first preset size, the animation effect of the first interface element being displayed exiting is controlled. Wherein, the first preset size is smaller than the second preset size.

19. The apparatus according to claim 17 or 18, characterized in that, The control unit is used for: The animation effects of the first interface elements are controlled based on the unfolded size of the first screen and the data collected by the sensors.

20. The apparatus according to claim 19, characterized in that, The control unit is used for: When the unfolded size of the first screen is the third unfolded size, the third unfolded size and the data input content are used to generate a model to obtain the animation effect of the first interface element and the information of the display area of ​​the animation effect; Based on the information of the display area of ​​the animation effect, the third display area on the first screen is controlled to display the animation effect of the first interface element, wherein the third display area is the display area of ​​the first screen under the third expanded size.

21. The apparatus according to claim 15 or 16, characterized in that, The control unit is also used to control the animation effects of the first interface elements according to the content displayed on the second screen in the cockpit.

22. The apparatus according to claim 21, characterized in that, The content displayed on the second screen includes the content displayed by the navigation application. The control unit is configured to: When the navigation application's display indicates that the vehicle is currently in a congested area, the animation effect of the first interface element is controlled to be the first animation effect; or, When the navigation application displays information indicating that the vehicle is currently in a non-congested area, the animation effect of the first interface element is controlled to be the second animation effect.

23. The apparatus according to claim 21, characterized in that, The content displayed on the second screen includes the content displayed by the music application. The control unit is used for: When the display content of the music application indicates that the first type of music should be played, the animation effect of the first interface element is controlled to be the third animation effect; or, When the display content of the music application indicates that the second type of music should be played, the animation effect of the first interface element is controlled to be the fourth animation effect.

24. The apparatus according to any one of claims 15 to 23, characterized in that, The control unit is used for: Control the first screen to display multiple first interface elements that have moved from the first position to the second position; Among them, the transparency of multiple first interface elements gradually decreases along the first direction.

25. The apparatus according to any one of claims 15 to 24, characterized in that, The acquisition unit is also used to acquire information about obstacles around the first screen; The control unit is also configured to, when the information of the obstacle meets the preset conditions, control the first screen to stop unfolding and, according to the type of the obstacle, control the first interface element to display a fifth animation effect.

26. The apparatus according to any one of claims 15 to 25, characterized in that, The acquisition unit is further configured to acquire the input of the user in front of the first screen when the unfolded size of the first screen is at the second unfolded size; The control unit is further configured to control the position change of the first interface element according to the input, and / or control the animation effect of the first interface element to display a sixth animation effect.

27. The apparatus according to any one of claims 15 to 26, characterized in that, The acquisition unit is further configured to acquire the first interface element from multiple interface elements based on the information of the user in front of the first screen.

28. The apparatus according to any one of claims 15 to 27, characterized in that, The acquisition unit is also used to acquire the positions of the first user and the second user in front of the first screen inside the cockpit; The control unit is used to control the first interface element in the first display area to move from the first position to the second position along the first direction and to control the second interface element in the second display area to move from the third position to the fourth position along the second direction. Wherein, the second direction is associated with the direction of size change of the first screen, the first display area is associated with the location of the first user, and the second display area is associated with the location of the second user.

29. An interactive device, characterized in that, include: Memory, used to store computer programs; A processor for executing a computer program stored in the memory to cause the apparatus to perform the method as described in any one of claims 1 to 14.

30. An interactive system, characterized in that, It includes a first screen and a computing platform, the computing platform including the apparatus as described in any one of claims 15 to 29, wherein the first screen is a screen whose unfolded size changes.

31. A vehicle, characterized in that, Includes the apparatus as described in any one of claims 15 to 29, or the system as described in claim 30.

32. A computer-readable storage medium, characterized in that, It stores instructions that, when executed by a processor, cause the processor to implement the method as described in any one of claims 1 to 14.

33. A computer program product, characterized in that, The computer program product includes computer program code that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 14.

34. A chip, characterized in that, The chip includes circuitry for performing the method as described in any one of claims 1 to 14.

Images