Control method, device and vehicle

Abstract

The application provides a control method and device and a vehicle, which can be applied to the field of intelligent cockpits. The method comprises the following steps: in response to a first instruction, controlling the change of the unfolding size of a first screen, the first instruction being used for indicating unfolding or folding up the first screen; in the case that the unfolding size of the first screen is a first unfolding size, adjusting the size of a target image from a first size to a first playing size according to the first unfolding size to obtain a first image; and controlling a first display area to display the first image, the first display area being a display area of the first screen under the first unfolding size. The application can be applied to a smart car or an electric car, the playing size of an image is adapted through the size change of a screen, the user can be prevented from seeing an image with black edges in the process of unfolding or folding up the screen, and the visual experience of the user can be improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of intelligent cockpits, and more particularly, to a control method, device and vehicle. BACKGROUND

[0002] There are more and more display screens in current vehicles, and a curtain, as a display screen that can be unfolded and rolled up, is increasingly favored by users. In the process of unfolding the curtain, the projection device does not project on the curtain, and the user sees a black screen. This results in poor user experience of the user in the process of waiting for the curtain to unfold. SUMMARY

[0003] The present application provides a control method, device and vehicle, which adjusts the playing size of an image based on the size change of a screen, so as to avoid the user from seeing an image with black edges in the process of unfolding or rolling up the screen, and helps to improve the visual experience of the user.

[0004] In a first aspect, a control method is provided, which includes: in response to a first instruction, controlling the size change of an unfolding size of a first screen, the first instruction being used to instruct to unfold or roll up the first screen; in a case where the unfolding size of the first screen is a first unfolding size, adjusting the size of a target image from a first size to a first playing size according to the first unfolding size, to obtain a first image; controlling a first display area to display the first image, the first display area being a display area of the first screen in the first unfolding size.

[0005] Based on the above technical solution, the size of an image can be adjusted based on the unfolding size of a screen, so as to avoid the user from seeing an image with black edges in the process of unfolding or rolling up the screen, and helps to improve the visual experience of the user.

[0006] In some possible implementation manners, the method further includes: obtaining an original image, the original image being a to-be-projected image in a completely unfolded state of the first screen; and determining the target image from the original image.

[0007] In some possible implementation manners, the target image is determined from the original image, including: segmenting the original image to obtain a plurality of sub-images; and determining part of the sub-images in the plurality of sub-images as the target image according to the contrast between the plurality of sub-images.

[0008] In some possible implementation manners, the target image is determined from the original image, including: determining the target image according to the exposure of different targets in the original image.

[0009] In some possible implementation manners of the first aspect, in a case where the expansion size of the first screen is the first expansion size, adjusting the size of the target image from the first size to the first playing size according to the first expansion size comprises: in a case where the resolution of the target image is greater than or equal to the preset resolution, adjusting the size of the target image from the first size to the first playing size according to the aspect ratio of the display area of the first screen in the first expansion size, to obtain a frame of image.

[0010] In some possible implementation manners of the first aspect, the first playing size is the aspect ratio of the display area on the first screen in the first expansion size.

[0011] Based on the technical solution described above, when the resolution of the target image is relatively large, the target image can be adjusted to a frame of image based on the expansion size of the screen. In this way, it can be ensured that the user can see a complete frame of image in different expansion sizes during the process of unfolding or folding the screen, and the user can avoid seeing an image with black edges during the process of unfolding or folding the screen, which helps to improve the visual experience of the user.

[0012] In some possible implementation manners of the first aspect, in a case where the expansion size of the first screen is the first expansion size, adjusting the size of the target image from the first size to the first playing size according to the first expansion size comprises: in a case where the resolution of the target image is less than the preset resolution, adjusting the size of the target image from the first size to the first playing size according to 1 / N of the aspect ratio of the display area of the first screen in the first expansion size, to obtain a second image, N being an integer greater than 1; and wherein controlling the first display area to display the first image comprises: controlling the first display area to display N second images.

[0013] In some possible implementation manners of the first aspect, the first playing size is 1 / N of the display area on the first screen in the first expansion size.

[0014] In some possible implementation manners of the first aspect, N is 2.

[0015] Based on the technical solution described above, when the resolution of the target image is relatively small, the target image can be adjusted to multiple frames of image based on the expansion size of the screen. In this way, it can be ensured that the user can see multiple frames of image with high definition, and the user can avoid seeing an image with black edges during the process of unfolding or folding the screen, which helps to improve the visual experience of the user.

[0016] With reference to the first aspect, in some implementations of the first aspect, when the expansion size of the first screen is the first expansion size, adjusting the size of the target image from the first size to the first playing size according to the first expansion size comprises: when there are M users in front of the first screen, adjusting the size of the target image from the first size to the first playing size according to 1 / M of the aspect ratio of the display area of the first screen in the first expansion size, to obtain a third image, M being a positive integer; and wherein controlling the first display area to display the first image comprises: controlling the first display area to display M third images.

[0017] In some possible implementations, the first playing size is 1 / M of the display area on the first screen in the first expansion size.

[0018] Based on the above technical solution, when there is one or more users in the back row, the target image can be adjusted to one or more images based on the expansion size of the screen. In this way, by adapting to the number of users in front of the first screen, the first screen can display a corresponding number of images during the expansion or folding process.

[0019] In some possible implementations, when the resolution of the target image is less than or equal to a preset resolution and there is only one user in the back row, adjusting the size of the target image from the first size to the first playing size according to the aspect ratio of the display area of the first screen in the first expansion size comprises: adjusting the size of the target image from the first size to the first playing size according to the first expansion size to obtain one image.

[0020] In some possible implementations, the first playing size is the aspect ratio of the display area on the first screen in the first expansion size.

[0021] Based on the above technical solution, when there is only one user in the back row and the resolution of the target image is low, the size of the target image can be adjusted to the first playing size based on the number of users first, so that the user can see one image during the expansion or folding process of the first screen.

[0022] With reference to the first aspect, in some implementations of the first aspect, the method further comprises: during the process in which the expansion size of the first screen changes from the first expansion size to a second expansion size, controlling a first interface element on the first screen to move in a first direction from a first position to a second position; wherein the first direction is associated with the expansion direction of the first screen.

[0023] Based on the technical solution, the size change direction of the screen is adapted to the position movement direction of the interface element during the expansion size change of the screen. In this way, the user can see the position change of the interface element during the size change of the screen, rather than seeing a black screen, which helps to improve the user's visual experience. At the same time, the position change of the interface element is adapted through the expansion process of the screen, so that the user experiences the visual effect of the interface element moving with the size change of the screen, which helps to improve the user's interest and driving experience.

[0024] In some possible implementation manners, the first direction is associated with the size change direction of the first screen, including that an included angle between the first direction and the size change direction of the first screen is less than or equal to a preset included angle.

[0025] In some possible implementation manners, the first direction is the same as the size change direction of the first screen.

[0026] In some possible implementation manners, the first direction is a direction from the first position to the second position. In combination with the first aspect, in some implementation manners of the first aspect, the first edge of the first screen changes in the expansion direction, and during the expansion size of the first screen changes from the first expansion size to the second expansion size, the distance between the position of the first interface element and the first edge is less than or equal to a preset distance.

[0027] Based on the technical solution, the distance between the position of the first interface element and the first edge of the first screen can be less than or equal to a preset distance. In this way, the position change of the interface element that the user sees can be ensured to be more consistent with the position change of the first edge, which helps to improve the interest and driving experience during the expansion of the first screen.

[0028] In some possible implementation manners, the first screen is a curtain, and the first edge is a bottom edge of the curtain.

[0029] In combination with the first aspect, in some implementation manners of the first aspect, the method further includes: controlling an animation effect of the first interface element according to the expansion size of the first screen.

[0030] Based on the technical solution, the animation effect of the first interface element can be controlled based on the expansion size of the first screen. In this way, the user can experience the visual effect of the interface element moving with the size change of the curtain, and can also experience the animation effect that is adapted to the expansion size of the first screen, which helps to further improve the user's interest and driving experience.

[0031] With reference to the first aspect, in some implementations of the first aspect, the animation effect of the first interface element is controlled according to the expansion size of the first screen, including: in a process of expansion of the first screen, in response to detecting that the expansion size of the first screen is less than or equal to a first preset size, controlling the first interface element to display an animation effect of entering a scene; or in a process of expansion of the first screen, in response to detecting that the expansion size of the first screen is greater than or equal to a second preset size, controlling the first interface element to display an animation effect of exiting the scene; or in a process of folding of the first screen, in response to detecting that the expansion size of the first screen is greater than or equal to the second preset size, controlling the first interface element to display the animation effect of entering the scene; or in a process of folding of the first screen, in response to detecting that the expansion size of the first screen is less than or equal to the first preset size, controlling the first interface element to display the animation effect of exiting the scene; wherein the first preset size is less than the second preset size.

[0032] Based on the above technical solutions, in a process of expansion or folding of the first screen, the animation effect of the interface element entering or exiting the scene can be controlled based on the relationship between the expansion size of the first screen and the preset size. In this way, through the animation effect of entering the scene, the user can experience the start of expansion of the first screen and the start of folding of the first screen; through the animation effect of exiting the scene, the user can experience that the first screen is about to complete expansion or folding, which helps to improve the interest and driving experience of the user.

[0033] With reference to the first aspect, in some implementations of the first aspect, the animation effect of the first interface element is controlled according to the expansion size of the first screen, including: the animation effect of the first interface element is controlled according to the expansion size of the first screen and data collected by a sensor.

[0034] Based on the above technical solutions, the animation effect of the first interface element can be controlled in combination with the expansion size of the first screen and the data collected by the sensor. By adapting the animation effect of the interface element to the expansion size and the data collected by the sensor, the user can experience an animation effect that is adapted to the current scene, which helps to improve the visual experience of the user.

[0035] In some possible implementations, the animation effect of the first interface element is controlled according to the expansion size of the first screen and the data collected by the sensor, including: the animation effect of the first interface element is controlled according to the expansion size of the first screen and data collected by a camera outside the cabin.

[0036] In some possible implementation manners, the animation effect of the first interface element is controlled according to the expansion size of the first screen and data collected by the camera outside the cabin, including: determining a current scene (for example, a forest, a seaside, a beach, or a highway) in which the vehicle is currently located according to the data collected by the camera outside the cabin; and controlling the animation effect of the first interface element according to the current scene in which the vehicle is currently located and the expansion size of the first screen.

[0037] In some possible implementation manners, the animation effect of the first interface element is controlled according to the expansion size of the first screen and data collected by the sensor, including: controlling the animation effect of the first interface element according to the expansion size of the first screen and data collected by the camera inside the cabin.

[0038] In some possible implementation manners, the animation effect of the first interface element is controlled according to the expansion size of the first screen and data collected by the camera inside the cabin, including: determining a state of the user according to the data collected by the camera inside the cabin; and controlling the animation effect of the first interface element according to the expansion size of the first screen and the state of the user.

[0039] With reference to the first aspect, in some implementations of the first aspect, the animation effect of the first interface element is controlled according to the expansion size of the first screen and data collected by the sensor, including: when the expansion size of the first screen is a third expansion size, inputting the third expansion size and the data into a content generation model to obtain the animation effect of the first interface element and information of a display area of the animation effect; and wherein the method further includes: controlling a third display area on the first screen to display the animation effect of the first interface element according to the information of the display area of the animation effect, the third display area being a display area of the first screen in the third expansion size.

[0040] Based on the above technical solution, the expansion size of the first screen and the data collected by the sensor can be input into a content generation model, so that the animation effect of the first interface element and information of a display area of the animation effect can be obtained. In this way, the generation of the animation effect can be implemented through the content generation model, so that the animation effect of the interface element is real-time rendered, and the user can experience different animation effects in different scenes, which helps to improve the visual experience and driving experience of the user.

[0041] In some possible implementation manners, the sensor is a sensor inside the cabin, and the display area of the animation effect is associated with a position of the user inside the cabin.

[0042] With reference to the first aspect, in some implementations of the first aspect, the method further includes: controlling the animation effect of the first interface element according to content displayed on a second screen inside the cabin.

[0043] Based on the technical solution, the animation effect of the first interface element on the first screen can be controlled based on the content displayed on the other screens in the cabin. In this way, the user in front of the first screen can experience the content displayed on the other screens through the animation effect of the first interface element, which helps to improve the visual experience and driving experience of the user.

[0044] In some implementations of the first aspect, the content displayed on the second screen includes display content of a navigation application, and the animation effect of the first interface element is controlled according to the content displayed on the second screen in the cabin, including: in a case where the display content of the navigation application indicates that the current vehicle is in a congested road section, the animation effect of the first interface element is controlled to be a first animation effect; or in a case where the display content of the navigation application indicates that the current vehicle is in a non-congested road section, the animation effect of the first interface element is controlled to be a second animation effect.

[0045] Based on the technical solution, when the display content of the navigation application displayed on the second screen indicates that the current vehicle is in a congested road section or a non-congested road section, the first interface element on the first screen can be controlled to display different animation effects. In this way, the rear passengers in the cabin can intuitively feel the congestion of the road section through the animation effect of the first interface element, which helps to improve the visual experience and driving experience of the user.

[0046] In some implementations of the first aspect, the content displayed on the second screen includes display content of a music application, and the animation effect of the first interface element is obtained according to the content displayed on the second screen in the cabin, including: in a case where the display content of the music application indicates that a first type of music is played, the animation effect of the first interface element is controlled to be a third animation effect; or in a case where the display content of the music application indicates that a second type of music is played, the animation effect of the first interface element is controlled to be a fourth animation effect.

[0047] Based on the technical solution, when the display content of the music application displayed on the second screen indicates that a first type of music and a second type of music is played, the first interface element on the first screen can be controlled to display different animation effects. In this way, the interface element can be adapted to the type of music, and the rear passengers in the cabin can be inspired to move their bodies with the music through the animation effect (e.g., rhythm effect) of the first interface element, which helps to improve the interest and driving experience of the user.

[0048] In a second aspect, the present application provides a control device, comprising: a control unit configured to control a change in an unfolded size of a first screen in response to a first instruction, the first instruction being configured to instruct unfolding or folding of the first screen; and an image size adjustment unit configured to, when the unfolded size of the first screen is a first unfolded size, adjust a size of a target image from a first size to a first playing size according to the first unfolded size to obtain a first image; and the control unit is further configured to control the first display area to display the first image, the first display area being a display area of the first screen in the first unfolded size.

[0049] With reference to the second aspect, in some implementations of the second aspect, the image size adjustment unit is configured to, when the unfolded size of the first screen is the first unfolded size and a resolution of the target image is greater than or equal to a preset resolution, adjust the size of the target image from the first size to the first playing size according to an aspect ratio of the display area of the first screen in the first unfolded size to obtain a frame of image.

[0050] With reference to the second aspect, in some implementations of the second aspect, the image size adjustment unit is configured to, when the resolution of the target image is less than the preset resolution, adjust the size of the target image from the first size to the first playing size according to 1 / N of the aspect ratio of the display area of the first screen in the first unfolded size to obtain a second image, N being an integer greater than 1; and the control unit is configured to control the first display area to display N second images.

[0051] With reference to the second aspect, in some implementations of the second aspect, the image size adjustment unit is configured to, when there are M users in front of the first screen, adjust the size of the target image from the first size to the first playing size according to 1 / M of the aspect ratio of the display area of the first screen in the first unfolded size to obtain a third image, M being a positive integer; and the control unit is configured to control the first display area to display M third images.

[0052] With reference to the second aspect, in some implementations of the second aspect, the control unit is further configured to, during a process in which the unfolded size of the first screen changes from the first unfolded size to a second unfolded size, control a first interface element on the first screen to move from a first position to a second position along a first direction, the first direction being associated with an unfolding direction of the first screen.

[0053] With reference to the second aspect, in some implementations of the second aspect, a first edge of the first screen changes in the unfolding direction, and during the process in which the unfolded size of the first screen changes from the first unfolded size to the second unfolded size, a distance between the position of the first interface element and the first edge is less than or equal to a preset distance.

[0054] With reference to the second aspect, in some implementations of the second aspect, the control unit is further configured to control the animation effect of the first interface element according to the expansion size of the first screen.

[0055] With reference to the second aspect, in some implementations of the second aspect, the control unit is configured to, during expansion of the first screen, control the first interface element to display an animation effect of entering the scene in response to detecting that the expansion size of the first screen is less than or equal to a first preset size, or during expansion of the first screen, control the first interface element to display an animation effect of exiting the scene in response to detecting that the expansion size of the first screen is greater than or equal to a second preset size, or during folding of the first screen, control the first interface element to display an animation effect of entering the scene in response to detecting that the expansion size of the first screen is greater than or equal to the second preset size, or during folding of the first screen, control the first interface element to display an animation effect of exiting the scene in response to detecting that the expansion size of the first screen is less than or equal to the first preset size, wherein the first preset size is less than the second preset size.

[0056] With reference to the second aspect, in some implementations of the second aspect, the control unit is configured to control the animation effect of the first interface element according to the expansion size of the first screen and the data collected by the sensor.

[0057] With reference to the second aspect, in some implementations of the second aspect, the control unit is configured to control the animation effect of the first interface element according to the content displayed on the second screen in the cabin.

[0058] In a third aspect, the present application provides a control device, comprising a processor and a memory, wherein the memory is configured to store instructions, and the processor is configured to execute the instructions stored in the memory, so that the device executes any possible method in the first aspect.

[0059] In a fourth aspect, the present application provides a control system, comprising a computing platform and a screen, wherein the computing platform comprises any possible device in the second aspect or the third aspect, and the expansion size of the screen can be changed.

[0060] With reference to the fourth aspect, in some implementations of the fourth aspect, the screen is a curtain.

[0061] In a fifth aspect, the present application provides a vehicle, comprising any possible device in the second aspect or the third aspect, or comprising the system in the fourth aspect.

[0062] In a sixth aspect, the present application provides a computer program product, comprising computer program code, which, when executed on a computer, causes the computer to execute any possible method in the first aspect.

[0063] It should be noted that the computer program codes described above can be stored in whole or in part on the first storage medium, which can be packaged together with the processor or packaged separately from the processor, and the embodiments of the present application do not make specific limitations in this regard.

[0064] In a seventh aspect, the present application provides a computer readable medium, which stores program codes, when the program codes are run on a computer, the computer is caused to execute any possible method in the first aspect.

[0065] In an eighth aspect, the present application provides a chip system, which comprises a processor, and is configured to invoke computer programs or computer instructions stored in a memory, so that the processor executes any possible method in the first aspect.

[0066] With reference to the eighth aspect, in a possible implementation, the processor is coupled with the memory through an interface.

[0067] With reference to the eighth aspect, in a possible implementation, the chip system further comprises a memory, and the memory stores computer programs or computer instructions.

[0068] In a ninth aspect, the present application provides a chip, which comprises a circuit, and the circuit is configured to execute any possible method in the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0069] Figure 1 is a functional block diagram of a vehicle provided by the embodiments of the present application.

[0070] Figure 2 is a schematic diagram of a vehicle cabin scene provided by the embodiments of the present application.

[0071] Figure 3 is a human-machine interface (HMI) provided by the embodiments of the present application.

[0072] Figure 4 is another HMI provided by the embodiments of the present application.

[0073] Figure 5 is another HMI provided by the embodiments of the present application.

[0074] Figure 6 is another HMI provided by the embodiments of the present application.

[0075] Figure 7 is another HMI provided by the embodiments of the present application.

[0076] Figure 8 is another HMI provided by the embodiments of the present application.

[0077] Figure 9 This is another HMI provided in the embodiments of this application.

[0078] Figure 10 This is another HMI provided in the embodiments of this application.

[0079] Figure 11 This is another HMI provided in the embodiments of this application.

[0080] Figure 12 This is a schematic flowchart of the interaction method provided in the embodiments of this application.

[0081] Figure 13 This is a schematic block diagram of the interactive device provided in the embodiments of this application. Detailed Implementation

[0082] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0083] Figure 1 This is a functional block diagram of a vehicle provided in an embodiment of this application. For example... Figure 1 As shown, the vehicle 100 may include a display device 130 and a computing platform 150. The display device 130 in the cabin is mainly divided into two categories: the first is an in-vehicle display screen; the second is a projection display screen, such as a head-up display (HUD). An in-vehicle display screen is a physical display screen and an important component of the in-vehicle infotainment system. Multiple displays can be installed in the cabin, such as a digital instrument cluster display, a central control screen, a display screen in front of the front passenger (also known as the front-seat passenger), a display screen in front of the left rear passenger, and a display screen in front of the right rear passenger; even the vehicle windows can be used as displays. A head-up display, also known as a head-up display system, is mainly used to display driving information such as speed and navigation on a display device in front of the driver (such as the windshield). This reduces the driver's eye-shifting time, avoids pupil changes caused by eye-shifting, and improves driving safety and comfort. HUDs include, for example, combiner-HUD (C-HUD) systems, windshield-HUD (W-HUD) systems, and augmented reality HUD (AR-HUD) systems.

[0084] Part or all functions of the vehicle 100 can be controlled by the computing platform 150. The computing platform 150 can include processors 151-15n, which are circuits having a processing capability of signals. In one implementation, the processors can be circuits having an instruction reading and running capability, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), a digital signal processor (DSP), and the like. In another implementation, the processors can be circuits having a fixed or reconfigurable logical relationship to implement certain functions, such as an application-specific integrated circuit (ASIC) or a programmable logic device (PLD) implemented hardware circuit, such as a field programmable gate array (FPGA). In the reconfigurable hardware circuit, the processor loads a configuration document to implement the hardware circuit configuration, which can be understood as the process of the processor loading instructions to implement the related functions. In addition, the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), and the like. In addition, the computing platform 150 can also include a memory for storing instructions, and part or all of the processors 151-15n can call the instructions in the memory to implement corresponding functions.

[0085] Optionally, the above structure of the vehicle 100 is only schematic, and in actual application, each component in the vehicle 100 described above can be added or deleted according to actual needs.

[0086] Figure 2This is a schematic diagram of a vehicle cockpit scenario provided in an embodiment of this application. The smart cockpit includes one or more in-vehicle displays (or in-vehicle screens), including but not limited to display screen 201 (or central control screen), display screen 202 (or passenger entertainment screen), display screen 203 (or driver's headrest rear screen), display screen 204 (or passenger headrest rear screen), display screen 205 (or second-row entertainment screen) mounted on the cockpit ceiling, and an instrument panel. Further, displays 201 to 205 can display a graphical user interface (GUI), which may include icons for one or more applications, and / or one or more cards. For example, Figure 1 The display device 130 shown can be one or more of the displays 201 to 205. In some possible implementations, the display 201 can also be a long screen extending into the passenger area. In addition, the display 205 can also be a projection screen associated with a projector, which can be associated with a desktop launcher to manage applications projected onto the projection screen.

[0087] Figure 2 The cockpit can also be equipped with one or more cameras to capture images inside or outside the cockpit, such as cameras from a driver monitor system (DMS), a cabin monitor system (CMS), and a dashcam. These cameras can be the same or different cameras. In addition, one or more pressure sensors and acoustic sensors are installed in the cockpit to monitor the presence and location of users.

[0088] It should be understood that the following embodiments are based on Figure 2 The embodiments shown are illustrated using a 5-seat vehicle as an example, but the present application is not limited to this. For example, for a 7-seat sport / suburban utility vehicle (SUV), the cabin may include a central control screen, a passenger entertainment screen, a screen behind the driver's headrest, a screen behind the passenger's headrest, entertainment screens in the left-hand area of ​​the third row, and entertainment screens in the right-hand area of ​​the third row. As another example, for a bus, the cabin may include front and rear entertainment screens; or, the cabin may include a display screen in the driver's area and an entertainment screen in the passenger area. Furthermore, the following embodiments use a left-hand drive vehicle (i.e., the driver is on the left side of the vehicle) as an example; in actual implementation, the vehicle may also be a right-hand drive vehicle (i.e., the driver is on the right side of the vehicle).

[0089] For example,Figure 3 A human machine interface (HMI) provided by an embodiment of the present application is shown. As shown in Figure 3 When the voice instruction "project the video on the curtain" of the user is acquired, the vehicle can control the curtain to be unfolded. When the unfolded size of the curtain is H1, the vehicle can acquire a frame of original image in the video and extract a target image from the original image. The vehicle can adjust the size of the target image according to the unfolded size H1, so that the adjusted image can fill the display area of the curtain under the unfolded size H1.

[0090] For example, the aspect ratio of the target image is 16:9. When the unfolded size of the curtain is H1, the display area of the curtain corresponds to a playing size (or aspect ratio) of 21:4, and at this time, the size of the target image can be adjusted from 16:9 to 21:4 to obtain image 1. The vehicle can control the projection device to project the image 1 to the display area of the curtain under the unfolded size H1.

[0091] For example, Figure 4 Another human machine interface (HMI) provided by an embodiment of the present application is shown. As shown in Figure 4 When the unfolded size of the curtain is H2, the vehicle can acquire another frame of original image in the video and extract a target image from the original image. The vehicle can adjust the size of the target image according to the unfolded size H2, so that the adjusted image can fill the display area of the curtain under the unfolded size H2.

[0092] For example, the aspect ratio of the target size is 16:9. When the unfolded size of the curtain is H2, the display area of the curtain corresponds to a playing size of 21:10, and at this time, the size of the target image can be adjusted from 16:9 to 21:10 to obtain image 2. The vehicle can control the projection device to project the image 2 to the display area of the curtain under the unfolded size H2.

[0093] From the above Figure 3 and Figure 4 The HMI shown in the above can be seen that, in the process of unfolding the curtain, the image displayed on the display area of the curtain can fill the entire display area after size adjustment, and there is no black border. In this way, the user can avoid seeing the image with black border during the process of unfolding or folding the screen, which helps to improve the visual experience of the user.

[0094] For example, Figure 5 Another human machine interface (HMI) provided by an embodiment of the present application is shown. As shown in Figure 5As shown, when the curtain is in the fully expanded state with the expanded size H3, the aspect ratio of the curtain is 16:9. Since the aspect ratio of the original image in the video is 16:9, the original image in the video can be displayed on the entire display area of the curtain at this time.

[0095] Exemplarily, Figure 6 Another human-machine interface HMI provided by an embodiment of the present application is shown. In the case that the resolution of the original image in the video is low, the size of the target image can be adjusted based on the expanded size of the curtain to obtain multiple frames of images.

[0096] Exemplarily, when the expanded size of the curtain is H1, the aspect ratio of the target image can be adjusted from 16:9 to half of the aspect ratio of the display area of the curtain in the expanded size H1 (for example, 10.5:4) to obtain image 3. The vehicle can control the projection device to project 2 frames of image 3 side by side to the display area of the curtain in the expanded size H1. In this way, it can not only avoid the user from seeing the image with black edges during the screen expansion or retraction process, but also ensure that the image seen by the user is clear enough, which helps to improve the user's visual experience.

[0097] In one embodiment, in the case that the resolution of the original image in the video is less than or equal to a preset resolution, the size of the target image can be adjusted to obtain multiple frames of images.

[0098] Exemplarily, the preset resolution can be 1080p.

[0099] Exemplarily, Figure 7 Another human-machine interface HMI provided by an embodiment of the present application is shown. In the case that there are multiple users in front of the first screen, the size of the target image can be adjusted based on the expanded size of the curtain and the number of users to obtain multiple frames of images.

[0100] Exemplarily, when there is only one user in front of the curtain and the expanded size of the curtain is H1, the aspect ratio of the target image can be adjusted from 16:9 to the aspect ratio of the display area of the curtain in the expanded size H1 (for example, 21:4) to obtain one frame of image. The vehicle can control the projection device to project this frame of image to the display area of the curtain in the expanded size H1.

[0101] Alternatively, when there are two users in front of the curtain and the expanded size of the curtain is H1, the aspect ratio of the target image can be adjusted from 16:9 to half of the aspect ratio of the display area of the curtain in the expanded size H1 (for example, 10.5:4) based on the number of users in front of the curtain and the expanded size H1 to obtain image 4. The vehicle can control the projection device to project 2 frames of image 4 side by side to the display area of the curtain in the expanded size H1.

[0102] Figure 8 Another HMI provided by the embodiment of the application is shown. When the unfolded size of the curtain is H1, the vehicle can display image 1 through the current display area of the curtain and display virtual image 801 at position 1.

[0103] Optionally, the distance between the virtual image 801 and the bottom edge of the curtain is less than or equal to a preset distance. For example, the preset distance is 5 cm. The bottom edge of the curtain gradually moves to the bottom of the cabin along the size change direction of the curtain.

[0104] For example, when the vehicle detects that the user clicks the control of unfolding the curtain through the remote controller, the vehicle can obtain the instruction 1.

[0105] For example, when the vehicle detects that the user clicks the control of unfolding the curtain on the center screen, the vehicle can obtain the instruction 1.

[0106] Optionally, the vehicle can adjust the color information of the virtual image 801 according to the color information of the area in the image 1 that overlaps with the virtual image 801, so that the display of the virtual image 801 does not affect the display effect of the image 1.

[0107] Figure 9 Another HMI provided by the embodiment of the application is shown. When the unfolded size of the curtain is H2, the vehicle can display image 2 on the current display area and display virtual image 801 at position 2 based on the unfolded size H2 of the curtain.

[0108] From the above Figure 8 and Figure 9 It can be seen that the position of the virtual image 801 changes from position 1 to position 2.

[0109] Optionally, the included angle between the change direction of the virtual image and the size change direction of the curtain is less than or equal to a preset included angle. For example, the included angle between the direction from position 1 to position 2 and the size change direction of the curtain is less than or equal to a preset included angle.

[0110] For example, the preset included angle can be 30°.

[0111] In the embodiment of the application, during the lowering process of the curtain, the position change of the virtual image matches the size change direction of the curtain, which can create a visual effect that the virtual image moves with the curtain unfolding for the user, and the displacement change of the virtual image adapts to the hardware morphological change of the curtain, which helps to improve the visual experience and driving experience of the user.

[0112] Optionally, during the process that the unfolded size of the curtain changes from H1 to H2, the virtual image 801 can be a static interface element, or the virtual image can have no animation effect.

[0113] Optionally, the virtual image 801 can be a dynamic interface element during the process that the size of the curtain changes from H1 to H2, or the virtual image can have an animation effect.

[0114] For example, Table 1 shows a correspondence between the animation effect of a virtual image and the size of the curtain.

[0115] Table 1

[0116] Unfolding size of the curtain Animation effect [0，30％×H) Animation effect 1 [30% x H, 70% x H) Animation effect 2 [70% x H, H] Animation effect 3

[0117] H is the size of the side edge of the curtain when the curtain is fully deployed.

[0118] For example, the animation effect 1 is an animation effect of entering the scene, the animation effect 2 is an animation effect of the virtual image sliding down from the rod, and the animation effect 3 is an animation effect of leaving the scene.

[0119] The above animation effects can be pre-installed in the vehicle, or can also be real-time rendered animation effects.

[0120] Optionally, the vehicle can render the animation effect of the virtual image in real time based on the size of the curtain.

[0121] Optionally, the vehicle can input the size of the curtain and the data collected by the sensor into the content generation model to obtain the animation effect of the virtual image.

[0122] For example, the vehicle can input the size H1 of the curtain and the image a collected by the camera outside the cabin into the content generation model to obtain the animation effect of the virtual image.

[0123] For example, when the size H1 of the curtain is less than the first preset deployment size and the image a indicates that the vehicle is currently driving in the forest, the animation effect of the initial growth of the tree can be obtained through the content generation model. The vehicle can display the animation effect of the initial growth of the tree in the display area of the curtain under the size H1.

[0124] For example, the vehicle can superimpose the image 1 and the animation effect of the initial growth of the tree to obtain the image 1a, so that the vehicle can control the curtain to display the image 1a.

[0125] For another example, when the size H1 of the curtain is less than the first preset deployment size and the image a indicates that it is currently raining, the animation effect of the raindrops just starting to fall from the sky (for example, the shape of the raindrops can change from shape 1 to shape 2) can be obtained through the content generation model. The vehicle can display the animation effect of the raindrops just starting to fall from the sky in the display area of the curtain under the size H1.

[0126] For example, the vehicle can superimpose the image 1 with the animation effect of raindrops just starting to fall from the sky to obtain an image 1b, so that the vehicle can control the curtain to display the image 1b.

[0127] For example, the vehicle can input the size H2 of the curtain and the image b captured by the camera outside the cabin into the content generation model to obtain the animation effect of the virtual image.

[0128] For example, the size H2 of the curtain is greater than the second preset size, and the image b indicates that the vehicle is currently driving in the forest, and the content generation model can obtain the animation effect of the trees in the late growth stage. The vehicle can display the animation effect of the trees in the late growth stage in the display area of the curtain with the size H2.

[0129] For example, the vehicle can superimpose the image 2 with the animation effect of the trees in the late growth stage to obtain an image 2a, so that the vehicle can control the curtain to display the image 2a.

[0130] For example, the size H2 of the curtain is greater than the second preset size, and the image b indicates that it is currently raining, and the content generation model can obtain the animation effect of the raindrops about to fall to the ground (for example, the shape of the raindrops can change from shape 3 to shape 4). The vehicle can display the animation effect of the raindrops about to fall to the ground in the display area of the curtain with the size H2.

[0131] For example, the vehicle can superimpose the image 2 with the animation effect of the raindrops about to fall to the ground to obtain an image 2b, so that the vehicle can control the curtain to display the image 2b.

[0132] Optionally, the vehicle can input the size of the curtain and the data captured by the sensor into the content generation model to obtain the animation effect of the virtual image and the display area of the animation effect on the curtain.

[0133] For example, the sensor can be a camera in the cabin. The vehicle can input the size H1 of the curtain and the image captured by the camera in the cabin into the content generation model to obtain the animation effect of the virtual image. For example, the image captured by the camera in the cabin indicates that there is a user in front of the curtain and the user is in a dozing state, and the animation effect of the virtual image output by the content generation model can be the animation effect of the virtual image 801 taking a nap.

[0134] For example, the vehicle can superimpose the image 1 with the animation effect of the virtual image 801 taking a nap to obtain an image 1c, so that the vehicle can control the curtain to display the image 1c.

[0135] The above Figure 8 and Figure 9The curtain is taken as an example for illustration. Correspondingly, for the scenario of the curtain being rolled up, the virtual image 801 can be displayed on the curtain, and the position of the virtual image 801 gradually moves to the direction in which the size of the curtain changes as the curtain is rolled up.

[0136] Optionally, in the scenario of the curtain being rolled up, the interface elements such as balloons, airplanes (e.g., helicopters), rockets, and the like can be displayed on the curtain. By moving the positions of these interface elements in the direction in which the curtain is rolled up, the morphological change of the curtain can be adapted to the position change of the interface elements, and the visual experience and the driving experience of the user can be improved in the process of rolling up the curtain.

[0137] An exemplary scenario is shown in FIG. 8. As shown in FIG. 8, the virtual image 801 can be displayed on the curtain, and the position of the virtual image 801 gradually moves to the direction in which the size of the curtain changes as the curtain is rolled up. Figure 10 Another HMI provided by an embodiment of the present application is shown in FIG. 9. As shown in FIG. 9, when the curtain is rolled up to a size of H3, the curtain can be controlled to display an image 5 in which a target image is resized, and the virtual image 801 can be controlled to display an animation effect of appearing. Figure 10 As shown in FIG. 9, when the curtain is rolled up to a size of H3, the curtain can be controlled to display an image 5 in which a target image is resized, and the virtual image 801 can be controlled to display an animation effect of appearing. In this way, when the curtain is just beginning to be rolled up, by displaying the animation effect of appearing of the virtual image, a happy atmosphere can be created for the user, so that the user can learn from the animation effect of appearing that the curtain is about to be rolled up, or that the wonderful content is about to be presented to the user.

[0138] Optionally, controlling the curtain to display the image 5 in which the target image is resized and controlling the virtual image 801 to display the animation effect of appearing includes: superimposing the animation effect of appearing of the virtual image 801 on the image 5 to obtain an image 5a, so that the curtain can be controlled to display the image 5a.

[0139] Optionally, when the size of the curtain is less than or equal to a first preset size, the virtual image can be controlled to display the animation effect of appearing.

[0140] Optionally, the animation effect of appearing is a greeting to the user.

[0141] Optionally, the vehicle can obtain position information of the user in front of the curtain. Based on the position information of the user, the position of the virtual image displaying the animation effect of appearing is controlled.

[0142] Optionally, when it is detected that there is one user in the back row and the user is located in the right area of the second row, the position of the virtual image displaying the animation effect of appearing is controlled to be located on the right side of the display area of the curtain.

[0143] Optionally, when it is detected that there is one user in the back row and the user is located in the left area of the second row, the position of the virtual image displaying the animation effect of appearing is controlled to be located on the left side of the display area of the curtain.

[0144] Exemplarily, when it is detected that there are two users in the back row and the two users are located in the left area of the second row and the right area of the second row respectively, the virtual image can be controlled to display the position of the animation effect of appearing on the center of the display area of the curtain.

[0145] Exemplarily, when it is detected that there are two users in the back row and the two users are located in the left area of the second row and the right area of the second row respectively, the virtual image 1 can be controlled to display the position of the animation effect of appearing on the left side of the display area of the curtain and the virtual image 2 can be controlled to display the position of the animation effect of appearing on the right side of the display area of the curtain.

[0146] Optionally, the virtual image 1 and the virtual image 2 can be determined from the plurality of virtual images based on the information of the user.

[0147] It should be noted that if the information processed in the present application involves personal information of the user (such as face image, fingerprint information, voiceprint information, location trajectory information, personal contact information and other biometric information), the processing of the personal information of the user will be based on a legal basis, and the user will be fully informed and authorized, and the relevant legal provisions of the personal information protection of the country or region will be met.

[0148] Exemplarily, the user located in the left area of the second row is a child, and the virtual image 1 related to the animation character can be determined from the plurality of virtual images.

[0149] Exemplarily, Figure 11 Another HMI provided by an embodiment of the present application is shown. As shown in Figure 11 When the unfolding size of the curtain is H4, the curtain can be controlled to display the image 6 obtained by adjusting the size of the target image, and the virtual image 801 can be controlled to display the animation effect of retreating. In this way, when the curtain is about to end the unfolding, by displaying the animation effect of retreating of the virtual image, a visual effect that the curtain is about to end the unfolding can be created for the user, so that the user can know that the curtain is about to end the unfolding through the animation effect of retreating.

[0150] Optionally, when the unfolding size of the curtain is greater than or equal to the second preset size, the virtual image can be controlled to display the animation effect of retreating.

[0151] Exemplarily, the animation effect of retreating is that the virtual image waves goodbye.

[0152] Optionally, the vehicle can obtain the position information of the user in front of the curtain. Based on the position information of the user, the position of the virtual image displaying the animation effect of retreating is controlled.

[0153] Exemplarily, when it is detected that there is one user in the back row and the user is located in the second row right area, the position of the animation effect of the virtual image display exit can be controlled to be located at the right side of the display area of the curtain.

[0154] Exemplarily, when it is detected that there is one user in the back row and the user is located in the second row left area, the position of the animation effect of the virtual image display exit can be controlled to be located at the left side of the display area of the curtain.

[0155] Exemplarily, when it is detected that there are two users in the back row and the two users are located in the second row left area and the second row right area respectively, the position of the animation effect of the virtual image display exit can be controlled to be located at the center position of the display area of the curtain.

[0156] Exemplarily, when it is detected that there are two users in the back row and the two users are located in the second row left area and the second row right area respectively, the position of the animation effect of the virtual image 1 display exit can be controlled to be located at the left side of the display area of the curtain and the position of the animation effect of the virtual image 2 display exit can be controlled to be located at the right side of the display area of the curtain.

[0157] Figure 12 A schematic flowchart of the control method 1200 provided by the embodiments of the present application is shown. The method 1200 can be executed by the vehicle 100, or can also be executed by the computing platform 150, or can also be executed by the processor, chip or circuit in the computing platform 150. The method 1200 comprises:

[0158] S1210, in response to a first instruction, controlling the change of the unfolding size of the first screen, the first instruction being used to instruct to unfold or fold up the first screen.

[0159] Exemplarily, the first instruction can be an instruction sent by a mobile terminal. Exemplarily, the mobile terminal can be a mobile phone or a remote controller.

[0160] Exemplarily, the first instruction can be a rotation signal of a motor for controlling the unfolding or folding up of the curtain.

[0161] Exemplarily, the first instruction can be a voice input of a user.

[0162] S1220, in a case where the unfolding size of the first screen is a first unfolding size, adjusting the size of the target image from a first size to a first playing size according to the first unfolding size, to obtain a first image.

[0163] Optionally, the 1200 further comprises: obtaining an original image, the original image being a to-be-projected image in a completely unfolded state of the first screen; and determining the target image from the original image.

[0164] Optionally, determining the target image from the original image includes: segmenting the original image to obtain multiple sub-images; and determining a portion of the multiple sub-images as the target image based on the contrast between the multiple sub-images.

[0165] For example, the original image can be divided into 24 sub-images. The foreground and background targets can be determined from the 24 sub-images by the contrast between any two adjacent sub-images, and the target image can include the foreground target.

[0166] Optionally, determining the target image from the original image includes: determining the target image based on the exposure between different targets in the original image.

[0167] For example, taking a frame from a movie as the original image, the main character's exposure is higher than that of other characters or objects in this frame. Thus, the target image, including the main character, can be segmented based on the exposure of this frame.

[0168] S1230, control the first display area to display the first image, the first display area is the display area of ​​the first screen under the first unfolded size.

[0169] In this embodiment, the image size can be adjusted based on the unfolded size of the screen, thereby preventing users from seeing images with black borders when the screen is unfolded or collapsed, which helps to improve the user's visual experience.

[0170] Optionally, when the unfolded size of the first screen is a first unfolded size, adjusting the size of the target image from a first size to a first playback size according to the first unfolded size includes: when the unfolded size of the first screen is a first unfolded size and the resolution of the target image is greater than or equal to a preset resolution, adjusting the size of the target image from a first size to a first playback size according to the aspect ratio of the display area of ​​the first screen under the first unfolded size, thereby obtaining a frame image.

[0171] For example, such as Figure 3 As shown, if the resolution of the target image is greater than the preset resolution, the target image can be adjusted from the first size to the first playback size to obtain image 1. For example, the first playback size is the aspect ratio of the display area of ​​the first screen under the first unfolded size.

[0172] Optionally, in a case where the expansion size of the first screen is the first expansion size, the size of the target image is adjusted from the first size to the first playing size according to the first expansion size, including: in a case where the resolution of the target image is less than the preset resolution, the size of the target image is adjusted from the first size to the first playing size according to 1 / N of the aspect ratio of the display area of the first screen in the first expansion size, to obtain a second image, N being an integer greater than 1; and wherein the control of the first display area to display the first image includes: control of the first display area to display N second images.

[0173] Optionally, N is 2, and the first playing size can be half of the aspect ratio of the display area of the curtain in the first expansion size.

[0174] For example, as shown in FIG. 3, in a case where the resolution of the target image is less than the preset resolution, the size of the target image can be adjusted from the first size to half of the aspect ratio of the display area of the curtain in the first expansion size, to obtain image 3. The vehicle can control the projection device to project two frames of image 3 displayed side by side in the display area of the curtain in the first expansion size. Figure 6 In the embodiments of the present application, in a case where the resolution of the target image is small, the target image can be adjusted to multiple frames of images based on the expansion size of the screen. In this way, it can not only avoid the user from seeing images with black edges during the expansion or folding of the screen, but also ensure that the user can see the clarity of multiple frames of images, which helps to improve the visual experience of the user.

[0175] Optionally, in a case where the expansion size of the first screen is the first expansion size, the size of the target image is adjusted from the first size to the first playing size according to the first expansion size, including: in a case where there are M users in front of the first screen, the size of the target image is adjusted from the first size to the first playing size according to 1 / M of the aspect ratio of the display area of the first screen in the first expansion size, to obtain a third image, M being a positive integer; and wherein the control of the first display area to display the first image includes: control of the first display area to display M third images.

[0176] For example, in a case where the number of users watching the first screen is M, the first playing size is 1 / M of the aspect ratio of the display area of the curtain in the first expansion size. As shown in FIG. 4, M is 2, and the first playing size is half of the aspect ratio of the display area of the curtain in the first expansion size. The size of the target image can be adjusted from the first size to half of the aspect ratio of the display area of the curtain in the first expansion size, to obtain image 4. The vehicle can control the projection device to project two frames of image 4 displayed side by side in the display area of the curtain in the first expansion size.

[0177] Figure 7

[0178] ​​In the embodiments of the present application, taking the first screen as an example, in the case that there is one or more users in the back row, the target image can be adjusted into one or more images based on the unfolding size of the curtain. In this way, by adapting to the number of users in front of the first screen, the first screen can display the corresponding number of images during the unfolding or folding process.

[0179] Optionally, in the case that the resolution of the target image is less than or equal to the preset resolution and there is only one user in the back row, the size of the target image is adjusted from the first size to the first playing size according to the first unfolding size, including: adjusting the size of the target image from the first size to the aspect ratio of the display area of the first screen in the first unfolding size, to obtain one image.

[0180] Optionally, the method 1200 further includes: during the process that the unfolding size of the first screen changes from the first unfolding size to the second unfolding size, controlling the first interface element on the first screen to move from the first position to the second position along the first direction; wherein the first direction is associated with the unfolding direction of the first screen.

[0181] As shown in the examples of FIGS. 8A and 8B, the first interface element can be a virtual image 801, and the first position can be position 1 and the second position can be position 2. During the process that the curtain is gradually unfolded, the position of the virtual image 801 moves along with the unfolding direction of the curtain. Figure 8 Figure 9 As shown in the examples of FIGS. 8A and 8B, the first interface element can be a virtual image 801, and the first position can be position 1 and the second position can be position 2. During the process that the curtain is gradually unfolded, the position of the virtual image 801 moves along with the unfolding direction of the curtain.

[0182] In the embodiments of the present application, during the process that the size of the screen changes, the size change direction of the screen is adapted to the position moving direction of the interface element. In this way, it is ensured that the user can see the position change of the interface element during the size change process of the screen, instead of seeing a black screen, which helps to improve the visual experience of the user; at the same time, by adapting the position change of the interface element to the unfolding process of the screen, the user experiences the visual effect that the interface element moves along with the size change of the curtain, which helps to improve the interest and driving experience of the user.

[0183] Optionally, the first direction is associated with the size change direction of the first screen, including: the included angle between the first direction and the size change direction of the first screen is less than or equal to a preset included angle.

[0184] Optionally, the first direction is the same as the size change direction of the first screen.

[0185] Optionally, the first direction is the direction from the first position to the second position.

[0186] ​Optionally, the first edge of the first screen changes in a direction of unfolding, and a distance between the position of the first interface element and the first edge is less than or equal to the preset distance in a process in which the unfolding size of the first screen changes from the first unfolding size to the second unfolding size.

[0187] In the embodiments of the present application, the distance between the position of the first interface element and the first edge of the first screen can be less than or equal to the preset distance. In this way, the position change of the interface element seen by the user can be ensured to be more consistent with the position change of the first edge, which helps to improve the interest and driving experience in the unfolding process of the first screen.

[0188] Optionally, the first screen is a curtain, and the first edge is a bottom edge of the curtain.

[0189] Optionally, the method 1200 further includes controlling an animation effect of the first interface element according to the unfolding size of the first screen.

[0190] In the embodiments of the present application, the animation effect of the first interface element can be controlled based on the unfolding size of the first screen. In this way, the user can experience the visual effect of the interface element moving with the size change of the curtain, and can also experience the animation effect that is adapted to the unfolding size of the first screen, which helps to further improve the interest and driving experience of the user.

[0191] Optionally, controlling the animation effect of the first interface element according to the unfolding size of the first screen includes: in the process of unfolding the first screen, in response to detecting that the unfolding size of the first screen is less than or equal to a first preset size, controlling the first interface element to display an animation effect of appearing on the screen; or in the process of unfolding the first screen, in response to detecting that the unfolding size of the first screen is greater than or equal to a second preset size, controlling the first interface element to display an animation effect of disappearing from the screen; or in the process of folding the first screen, in response to detecting that the unfolding size of the first screen is greater than or equal to the second preset size, controlling the first interface element to display the animation effect of appearing on the screen; or in the process of folding the first screen, in response to detecting that the unfolding size of the first screen is less than or equal to the first preset size, controlling the first interface element to display the animation effect of disappearing from the screen; wherein the first preset size is less than the second preset size.

[0192] As shown in FIG. 8B, when the unfolding size of the curtain is H3 and the unfolding size H3 is less than the first preset size, the curtain can be controlled to display the image 5 that is adjusted in size on the target image, and the virtual image 801 can be controlled to display an animation effect of appearing on the screen. Figure 10

[0193] As shown in FIG. 8B, when the unfolding size of the curtain is H3 and the unfolding size H3 is less than the first preset size, the curtain can be controlled to display the image 5 that is adjusted in size on the target image, and the virtual image 801 can be controlled to display an animation effect of appearing on the screen. Figure 11 ​As shown, when the curtain has an expanded size H4 and the expanded size H4 is greater than the second preset size, the curtain can be controlled to display the image 6 that is size-adjusted to the target image and the virtual image 801 can be controlled to display the animation effect of retreating.

[0194] In the embodiments of the present application, during the unfolding or folding of the first screen, the interface element can be controlled to display the animation effect of appearing or retreating based on the relationship between the expanded size of the first screen and the preset size. In this way, through the animation effect of appearing, the user can experience the start of unfolding of the first screen and the start of folding of the first screen; through the animation effect of retreating, the user can experience the completion of unfolding of the first screen or the completion of folding of the first screen, which helps to improve the user's interest and driving experience.

[0195] Optionally, the animation effect of the first interface element is controlled according to the expanded size of the first screen, including: the animation effect of the first interface element is controlled according to the expanded size of the first screen and the data collected by the sensor.

[0196] In the embodiments of the present application, the animation effect of the first interface element can be controlled in combination with the expanded size of the first screen and the data collected by the sensor. By adapting the animation effect of the interface element through the expanded size and the data collected by the sensor, the user can experience the animation effect that is adapted to the current scene, which helps to improve the user's visual experience.

[0197] Optionally, the animation effect of the first interface element is controlled according to the expanded size of the first screen and the data collected by the sensor, including: the animation effect of the first interface element is controlled according to the expanded size of the first screen and the data collected by the camera outside the cabin.

[0198] Optionally, the animation effect of the first interface element is controlled according to the expanded size of the first screen and the data collected by the camera outside the cabin, including: the scene (for example, forest, seaside, beach, highway) in which the vehicle is currently located is determined according to the data collected by the camera outside the cabin; the animation effect of the first interface element is controlled according to the scene in which the vehicle is currently located and the expanded size of the first screen.

[0199] Optionally, the animation effect of the first interface element is controlled according to the expanded size of the first screen and the data collected by the sensor, including: the animation effect of the first interface element is controlled according to the expanded size of the first screen and the data collected by the camera inside the cabin.

[0200] Optionally, the animation effect of the first interface element is controlled according to the expanded size of the first screen and the data collected by the camera inside the cabin, including: the state of the user is determined according to the data collected by the camera inside the cabin; the animation effect of the first interface element is controlled according to the expanded size of the first screen and the state of the user.

[0201] Optionally, the animation effect of the first interface element is controlled according to the expansion size of the first screen and the data collected by the sensor, including: when the expansion size of the first screen is a third expansion size, inputting the third expansion size and the data into a content generation model to obtain information of the animation effect of the first interface element and a display area of the animation effect; and the method further includes: controlling a third display area on the first screen to display the animation effect of the first interface element according to the information of the display area of the animation effect, the third display area being a display area of the first screen in the third expansion size.

[0202] In the embodiments of the present application, the expansion size of the first screen and the data collected by the sensor can be input into a content generation model, so that the animation effect of the first interface element and the information of the display area of the animation effect can be obtained. In this way, the generation of the animation effect can be realized through the content generation model, so that the animation effect of the interface element is a real-time rendered animation effect, and users can experience different animation effects in different scenarios, which helps to improve the visual experience and driving experience of users.

[0203] Optionally, the sensor is a sensor in the cabin, and the display area of the animation effect is associated with the position of the user in the cabin.

[0204] Optionally, the method 1200 further includes: controlling the animation effect of the first interface element according to the content displayed on the second screen in the cabin.

[0205] Based on the above technical solutions, the animation effect of the first interface element on the first screen can be controlled based on the content displayed on other screens in the cabin. In this way, the user in front of the first screen can experience the content displayed on other screens through the animation effect of the first interface element, which helps to improve the visual experience and driving experience of users.

[0206] Optionally, the content displayed on the second screen includes display content of a navigation application, and the animation effect of the first interface element is controlled according to the content displayed on the second screen in the cabin, including: in a case where the display content of the navigation application indicates that the current vehicle is in a congested road section, the animation effect of the first interface element is controlled to be a first animation effect; or in a case where the display content of the navigation application indicates that the current vehicle is in a non-congested road section, the animation effect of the first interface element is controlled to be a second animation effect.

[0207] In the embodiments of the present application, when the display content of the navigation application displayed on the second screen indicates that the current vehicle is in a congested road section or a non-congested road section, the first interface element on the first screen can be controlled to display different animation effects. In this way, the rear passengers in the cabin can intuitively feel the congestion of the road section through the animation effect of the first interface element, which helps to improve the visual experience and driving experience of users.

[0208] Optionally, the content displayed on the second screen includes display content of a music application, and the animation effect of the first interface element is obtained according to the content displayed on the second screen in the cabin, including: in a case where the display content of the music application indicates playing of a first type of music, the animation effect of the first interface element is controlled to be a third animation effect; or in a case where the display content of the music application indicates playing of a second type of music, the animation effect of the first interface element is controlled to be a fourth animation effect.

[0209] In the embodiment of the application, when the display content of the music application displayed on the second screen indicates playing of the first type of music and the second type of music, the first interface element on the first screen can be controlled to display different animation effects. In this way, the interface element can be adapted to the type of music, and the rear passengers in the cabin can be inspired to move their bodies together with the music through the animation effect (for example, the rhythm effect) of the first interface element, which helps to improve the interest and driving experience of the user.

[0210] Figure 13 A schematic block diagram of the control device 1300 provided by the embodiment of the application is shown. The device 1300 includes: a control unit 1310 configured to control a change in the unfolded size of the first screen in response to a first instruction, the first instruction being used to instruct unfolding or folding of the first screen; and an image size adjustment unit 1320 configured to, in a case where the unfolded size of the first screen is a first unfolded size, adjust the size of a target image from a first size to a first playing size according to the first unfolded size to obtain a first image; and the control unit 1310 is further configured to control the first display region to display the first image, the first display region being a display region of the first screen in the first unfolded size.

[0211] Optionally, the image size adjustment unit 1320 is configured to, in a case where the unfolded size of the first screen is the first unfolded size and the resolution of the target image is greater than or equal to a preset resolution, adjust the size of the target image from the first size to the first playing size according to the aspect ratio of the display region of the first screen in the first unfolded size to obtain a frame of image.

[0212] Optionally, the image size adjustment unit 1320 is configured to, in a case where the resolution of the target image is less than the preset resolution, adjust the size of the target image from the first size to the first playing size according to 1 / N of the aspect ratio of the display region of the first screen in the first unfolded size, to obtain a second image, N being an integer greater than 1; and the control unit is configured to control the first display region to display N second images.

[0213] Optionally, the image size adjusting unit 1320 is configured to: in a case where there are M users in front of the first screen, adjust the size of the target image from the first size to a first playing size according to 1 / M of the length-width ratio of the display area of the first screen in the first expanded size, to obtain a third image, M being a positive integer; and the control unit is configured to: control the first display area to display the M third images.

[0214] Optionally, the control unit 1310 is further configured to, in a process in which the expanded size of the first screen changes from the first expanded size to a second expanded size, control the first interface element on the first screen to move from a first position to a second position along a first direction, wherein the first direction is associated with the expansion direction of the first screen.

[0215] Optionally, the first edge of the first screen changes in the expansion direction, and in a process in which the expanded size of the first screen changes from the first expanded size to a second expanded size, the distance between the position of the first interface element and the first edge is less than or equal to a preset distance.

[0216] Optionally, the control unit 1310 is further configured to: control the animation effect of the first interface element according to the expanded size of the first screen.

[0217] Optionally, the control unit 1310 is configured to: in a process in which the first screen is expanded, in response to detecting that the expanded size of the first screen is less than or equal to a first preset size, control the first interface element to display an animation effect of entering the scene; or, in a process in which the first screen is expanded, in response to detecting that the expanded size of the first screen is greater than or equal to a second preset size, control the first interface element to display an animation effect of exiting the scene; or, in a process in which the first screen is folded, in response to detecting that the expanded size of the first screen is greater than or equal to the second preset size, control the first interface element to display an animation effect of entering the scene; or, in a process in which the first screen is folded, in response to detecting that the expanded size of the first screen is less than or equal to the first preset size, control the first interface element to display an animation effect of exiting the scene; wherein the first preset size is less than the second preset size.

[0218] Optionally, the control unit 1310 is configured to: control the animation effect of the first interface element according to the expanded size of the first screen and the data collected by the sensor.

[0219] Optionally, the control unit 1310 is configured to: control the animation effect of the first interface element according to the content displayed on the second screen in the cockpit.

[0220] It should be understood that the division of units in the above apparatus is only a logical functional division, and all or part of them can be integrated into a physical entity or physically separated when actually implemented. In addition, the units in the apparatus can be implemented in the form of processor calling software; for example, the apparatus includes a processor connected with a memory, and the memory stores instructions, and the processor calls the instructions stored in the memory to implement any of the above methods or realize the functions of the units of the apparatus, wherein the processor is, for example, a general processor such as a CPU or a microprocessor, and the memory is a memory in the apparatus or a memory outside the apparatus. Alternatively, the units in the apparatus can be implemented in the form of hardware circuit, and the functions of part or all of the units can be realized by the design of the hardware circuit, which can be understood as one or more processors; for example, in one implementation, the hardware circuit is an ASIC, and the functions of part or all of the units are realized by the design of the logical relationship of elements in the circuit; for example, in another implementation, the hardware circuit is a PLD, and taking FPGA as an example, it can include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is configured by a configuration file, so as to realize the functions of part or all of the units. All units of the above apparatus can be implemented in the form of processor calling software, or all units can be implemented in the form of hardware circuit, or part of the units are implemented in the form of processor calling software, and the remaining part is implemented in the form of hardware circuit.

[0221] In the embodiments of the present application, the processor is a circuit with signal processing capability. In one implementation, the processor can be a circuit with instruction reading and running capability, such as CPU, microprocessor, GPU, or DSP, etc. In another implementation, the processor can realize certain functions through the logical relationship of the hardware circuit, and the logical relationship of the hardware circuit is fixed or can be reconfigured, such as ASIC or PLD implemented hardware circuit, such as FPGA. In the reconfigurable hardware circuit, the processor loads the configuration document to realize the hardware circuit configuration process, which can be understood as the process of the processor loading instructions to realize the functions of part or all of the units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as a kind of ASIC, such as NPU, TPU, DPU, etc.

[0222] It can be seen that each unit in the above apparatus can be one or more processors (or processing circuits) configured to implement the above method, such as CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.

[0223] Furthermore, all or some of the units in the above apparatus can be integrated or can be independent. In one implementation, these units are integrated to be implemented in the form of SoC. The SoC can include at least one processor for implementing the functions of the above methods or the units of the apparatus, and the at least one processor can be of different types, such as CPU and FPGA, CPU and artificial intelligence processor, CPU and GPU, and the like.

[0224] The embodiments of the present application further provide a control device, which comprises a processing unit and a storage unit, wherein the storage unit is configured to store instructions, and the processing unit is configured to execute the instructions stored in the storage unit, so that the device executes the method or the steps performed by the above embodiments.

[0225] Optionally, if the control device is located in a vehicle, the processing unit can be Figure 1 the processor 151-15n shown.

[0226] The embodiments of the present application further provide a control system, which can include a computing platform and a screen, the computing platform can include the control device 1300, and the screen is a screen with a changeable unfolded size.

[0227] The embodiments of the present application further provide a vehicle, which can include the control device 1300 or the control system.

[0228] The embodiments of the present application further provide a computer program product, which comprises computer program code, and when the computer program code is run on a computer, the computer program code causes the computer to execute the method in the above embodiments.

[0229] The embodiments of the present application further provide a computer readable medium, which stores program code, and when the computer program code is run on a computer, the computer program code causes the computer to execute the method in the above embodiments.

[0230] The embodiments of the present application further provide a chip, which comprises a circuit, and the circuit is configured to execute the method in the above embodiments.

[0231] In the implementation process, each step of the above method can be completed by integrated logic circuits of hardware in the processor or instructions in the form of software. The method disclosed in combination with the embodiments of the present application can be directly embodied as hardware processor execution completion, or executed by a combination of hardware and software modules in the processor. The software module can be located in a mature storage medium in the art such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, register, etc. The storage medium is located in the memory, and the processor reads the information in the memory, and combines the hardware to complete the steps of the above method. To avoid repetition, it will not be described in detail here.

[0232] It should be understood that in the embodiments of the present application, the memory can include read-only memory and random access memory, and provide instructions and data to the processor.

[0233] It should also be understood that in various embodiments of the present application, the size of the sequence number of each process described above does not mean the order of execution, and the execution order of each process should be determined according to its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0234] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are executed in hardware or software depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0235] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0236] In several embodiments provided by the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division, and another division can be made in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.

[0237] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0238] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit.

[0239] The functions, if realized in the form of software functional units and sold or used as independent products, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application or the part of the present application that essentially contributes to the prior art or the part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various program code storage media.

[0240] The above is only a specific embodiment of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A control method characterized by, The method comprises: in response to a first instruction for indicating unfolding or folding of the first screen, controlling a size change of an unfolding size of the first screen; in a case where the unfolding size of the first screen is a first unfolding size, adjusting a size of a target image from a first size to a first playing size according to the first unfolding size, to obtain a first image; controlling the first display area to display the first image, the first display area being a display area of the first screen in the first unfolding size; the adjusting of the size of the target image from the first size to the first playing size according to the first unfolding size in the case where the unfolding size of the first screen is the first unfolding size comprises: in a case where a resolution of the target image is less than a preset resolution, adjusting the size of the target image from the first size to the first playing size according to 1 / N of an aspect ratio of the display area of the first screen in the first unfolding size, to obtain a second image, the N being an integer greater than 1; the controlling of the first display area to display the first image comprises: controlling the first display area to display N second images; or the adjusting of the size of the target image from the first size to the first playing size according to the first unfolding size in the case where the unfolding size of the first screen is the first unfolding size comprises: in a case where there are M users in front of the first screen, adjusting the size of the target image from the first size to the first playing size according to 1 / M of the aspect ratio of the display area of the first screen in the first unfolding size, to obtain a third image, the M being a positive integer; the controlling of the first display area to display the first image comprises: controlling the first display area to display M third images.

2. The method of claim 1, wherein, The method further comprises: in a process in which the unfolding size of the first screen changes from the first unfolding size to a second unfolding size, controlling a first interface element on the first screen to move from a first position to a second position in a first direction; the first direction is associated with an unfolding direction of the first screen.

3. The method of claim 2, wherein, A first edge of the first screen changes in the unfolding direction, and in the process in which the unfolding size of the first screen changes from the first unfolding size to the second unfolding size, a distance between the position of the first interface element and the first edge is less than or equal to a preset distance.

4. The method according to claim 2 or 3, characterized in that, The method further comprises: controlling an animation effect of the first interface element according to the unfolding size of the first screen.

5. The method of claim 4, wherein, The controlling of the animation effect of the first interface element according to the unfolding size of the first screen comprises: in a process in which the first screen unfolds, in response to detection that the unfolding size of the first screen is less than or equal to a first preset size, controlling the first interface element to display an animation effect of entering a scene; or in the process in which the first screen unfolds, in response to detection that the unfolding size of the first screen is greater than or equal to a second preset size, controlling the first interface element to display an animation effect of exiting the scene; or in the process in which the first screen unfolds, in response to detection that the unfolding size of the first screen is greater than or equal to a second preset size, controlling the first interface element to display an animation effect of exiting the scene. In the process of folding the first screen, in response to detecting that the unfolding size of the first screen is greater than or equal to the second preset size, the control unit controls the first interface element to display an animation effect of entering a scene; or In the process of folding the first screen, in response to detecting that the unfolding size of the first screen is less than or equal to a first preset size, the control unit controls the first interface element to display an animation effect of exiting a scene. The first preset size is less than the second preset size.

6. The method of claim 4, wherein, The control unit controls the animation effect of the first interface element according to the unfolding size of the first screen. The control unit controls the animation effect of the first interface element according to the unfolding size of the first screen and data collected by a sensor.

7. The method of claim 4, wherein, The method further includes: The control unit controls the animation effect of the first interface element according to content displayed on a second screen in the cockpit.

8. A control device characterized by comprising: The control unit controls the animation effect of the first interface element according to the unfolding size of the first screen. The control unit controls the animation effect of the first interface element according to the unfolding size of the first screen. The control unit controls the animation effect of the first interface element according to the unfolding size of the first screen. ​ ​ ​ ​ ​ 9. The apparatus of claim 8, wherein, ​ ​ 10. The apparatus of claim 9, wherein, ​ 11. The apparatus of claim 9 or 10, wherein, ​ ​ 12. The apparatus of claim 11, wherein, ​ In the process of unfolding the first screen, in response to detecting that the unfolding size of the first screen is less than or equal to a first preset size, the control unit controls the first interface element to display an animation effect of entering a scene; or, In the process of unfolding the first screen, in response to detecting that the unfolding size of the first screen is greater than or equal to a second preset size, the control unit controls the first interface element to display an animation effect of exiting a scene; or, In the process of folding the first screen, in response to detecting that the unfolding size of the first screen is greater than or equal to the second preset size, the control unit controls the first interface element to display an animation effect of entering a scene; or, In the process of folding the first screen, in response to detecting that the unfolding size of the first screen is less than or equal to a first preset size, the control unit controls the first interface element to display an animation effect of exiting a scene. The first preset size is less than the second preset size.

13. The apparatus of claim 11, wherein, The control unit is configured to: Control the animation effect of the first interface element according to the unfolding size of the first screen and the data collected by the sensor.

14. The apparatus of claim 11, wherein, The control unit is configured to: Control the animation effect of the first interface element according to the content displayed on the second screen in the cockpit.

15. A control device characterized by comprising: The system comprises: A memory for storing a computer program; A processor for executing the computer program stored in the memory, so that the device executes the method according to any one of claims 1 to 7.

16. A control system characterized by, The system comprises a first screen and a computing platform, and the computing platform comprises the device according to any one of claims 8 to 15, and the first screen is a screen with a variable unfolding size.

17. A vehicle characterized by comprising: The device according to any one of claims 8 to 15, or the system according to claim 16.

18. A computer-readable storage medium, characterized in that, The computer program product comprises computer program code, which, when executed on a computer, causes the computer to implement the method according to any one of claims 1 to 7.

19. A computer program product, characterised in that, The computer program product comprises computer program code, which, when executed on a computer, causes the computer to implement the method according to any one of claims 1 to 7.

20. A chip, characterized by The chip comprises a circuit for executing the method according to any one of claims 1 to 7.

Images